JP2012049969A - Electronic conference device, information display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic conference device capable of structuring and managing screen shots for each presently discussed topic.SOLUTION: An electronic conference device 100 comprises: first trail image storage reception means 35 which receives a storage instruction of a trail image; second trail image storage reception means 36 and 39 which receive the storage instruction of the trail image; trail image storage means 19 which adds unique identification information to a trail image being displayed on display means and stores the trail image in a first storage unit 20; identification information storage means 17 which stores, in a third storage unit 22, the identification information added by the trail image storage means; and associated information storage means 18 which stores, in a second storage unit 21, the identification information which is stored in the identification information storage means when the second trail image storage reception means receives the storage instruction as master image identification information and the identification information which is added by the trail image storage means when the second trail image storage reception means receives the storage instruction as slave image identification information, in association with each other.

Description

  The present invention relates to an electronic conference apparatus that electronically images handwritten information and presents it to participants, and more particularly to an electronic conference apparatus that stores imaged handwritten information in association with each other.

  Electronic information boards have been used in school classes and conference presentations. The electronic information board is an input / output device that displays a computer screen on a board corresponding to a blackboard or an electronic information board, receives a user operation by an input device such as a touch panel, and reflects the operation result on the computer screen.

  There are several methods for displaying a computer screen, such as a type using a flat panel such as liquid crystal or plasma, a type using a front projector, a type using a rear projector, and the like. In either case, the computer screen can be displayed on a large screen having a size of about 40 inches to 60 inches.

  FIG. 1 is a diagram showing an example of the external appearance of a front projector type electronic conference apparatus. An electronic information board 400 and a front projector 200 are connected to the PC 300. The projector 200 can greatly project the same screen as the display screen of the PC 300 on the electronic information board.

  When the speaker directly touches the computer screen displayed using the touch panel function of the electronic information board 400, the PC 300 can be operated according to the touched position.

For example, application software for the electronic information board 400 that runs on the connected PC 300 is provided together with these devices. This application software
(1) A function of displaying a screen serving as a blackboard and receiving drawing of a handwritten character or the like via a touch panel. (2) A function of drawing an accepted handwritten character on a computer screen.

  In such a conference using the electronic information board 400, the conference proceeds while a large number of participants view a screen on which common materials are displayed. In other words, it often takes a form of discussion in order to find a solution centering on the agenda that participants recognize as a common problem. If there are multiple agenda items, a moderator (hereinafter simply referred to as a user) selects one agenda item, and the discussion is centered on that agenda item.

  In the meeting, the user can proceed with the discussion while taking a screen shot using the electronic information board 400, but there is a problem that the relationship between the screen shots becomes difficult to understand. Also, when there are multiple discussions, participants tend to concentrate on one discussion and forget other topics.

  With regard to this point, a technique has been proposed that enables management of a screen image such as a memo that is desired to remain in relation to a discussion in association with display contents related to the discussion (see, for example, Patent Document 1). Patent Document 1 discloses an electronic conference apparatus that generates a screen that displays only a selected portion when a participant selects a display portion and receives an input of a participant's memo.

  However, the electronic conference apparatus described in Patent Document 1 can only associate a part of a document with a memo and has a problem that it is difficult to understand how the memo relates to the entire conference. For example, the agenda often has a hierarchical structure in which some items have a hierarchical structure. However, in the method disclosed in Patent Document 1, it is not known to which material in the hierarchy a memo relates.

  In view of the above problems, the present invention can structure and manage screenshots on the electronic information board stored in the middle for each agenda currently being discussed when discussing using the electronic information board. An object is to provide an electronic conference device, an information display method, and a program.

  The present invention includes a position detection unit (for example, the position detection unit 12) that detects an input position with respect to an information input area, and a trajectory image generation unit (for example, a trajectory image process) that visualizes the trajectory of the time-series position information as a trajectory image. Unit 14) and a display unit (for example, projector 200) for displaying the trajectory image, the electronic conference device having a first trajectory image for receiving a storage command for the trajectory image (for example, the origin agenda image) Storage accepting means (for example, agenda page designation button 35), second trajectory image storage accepting means (for example, screen shot button 34) for accepting an instruction to store the trajectory image (for example, screen shot), and the first or second Unique identification information in the trajectory image displayed by the display means when the second trajectory image storage accepting means accepts the storage command. When the storage command is received by the trajectory image storage means (for example, the image data registration section 19) and the first trajectory image storage reception means that stores the first storage section (for example, the image storage section 20). Identification information storage means (for example, parent image ID update section 17) for storing the identification information given by the locus information storage means in a third storage section (for example, parent image ID primary storage section 22), and the second locus The identification information stored in the identification information storage means when the image storage acceptance means accepts a storage command is used as a parent image, and the trajectory image storage means when the second trajectory image storage acceptance means accepts a storage command. Correspondence information storage means (for example, the structure registration unit 18) for storing the assigned identification information as a child image in association with each other in the second storage unit (for example, the image structure storage unit 21). And wherein the Rukoto.

  In one embodiment of the present invention, a third trajectory image storage receiving unit (for example, a part trajectory image (for example, an agenda image) that is a part of the trajectory image and a command for storing the partial trajectory image are received. , An agenda designation start button 36, and an agenda designation end button 39), and the trajectory image storage means assigns unique identification information to the partial trajectory image received by the third trajectory image storage accepting means. And the correspondence information storage means stores the identification information stored in the identification information storage means when the third trajectory image storage acceptance means accepts a storage command, and the third trajectory image storage. The identification information given by the trajectory image storage means is stored in association with the accepting means when the accepting instruction is received, and the identification information storage means is recorded by the third trajectory image storage acceptance means. The trace information storage means for storing the granted identification information upon receiving the instruction, characterized in that.

  Electronic conference device, information display method, and program capable of structuring and managing screen shots on electronic information board stored in the middle for each agenda currently being discussed when discussing using electronic information board Can be provided.

It is a figure which shows the example of an external appearance of a front projector type electronic information board. It is an example of the hardware block diagram of PC. It is an example of the functional block diagram of an electronic conference apparatus. It is a figure which shows an example of user information. It is a figure which shows an example of the screen of the initial state in which the locus | trajectory image is not displayed. It is a figure which shows an example of the screen where the agenda was drawn by the user. It is a figure which shows an example of the screen when a user selects the agenda. It is a figure which shows an example of the screen as which the screenshot was displayed. It is a figure which shows an example of the screen on which the closed curve was drawn in the drawing column. It is a figure which shows an example of the locus image which the user newly handwritten in the drawing column. It is a figure which shows an example of the screen on which the screen shot of the lower layer of the agenda image in which "Agenda AAAAAAAAA" was described was displayed. It is an example of the figure which shows typically the image memory | storage part of an initial state, an image structure memory | storage part, and a parent image ID primary memory | storage part. 3 is an example of a diagram schematically illustrating an image storage unit, an image structure storage unit, and a parent image ID primary storage unit. FIG. 3 is an example of a diagram schematically illustrating an image storage unit, an image structure storage unit, and a parent image ID primary storage unit. FIG. 3 is an example of a diagram schematically illustrating an image storage unit, an image structure storage unit, and a parent image ID primary storage unit. FIG. 3 is an example of a diagram schematically illustrating an image storage unit, an image structure storage unit, and a parent image ID primary storage unit. FIG. 3 is an example of a diagram schematically illustrating an image storage unit, an image structure storage unit, and a parent image ID primary storage unit. FIG. 3 is an example of a diagram schematically illustrating an image storage unit, an image structure storage unit, and a parent image ID primary storage unit. FIG. An example of the hierarchical structure memorize | stored in the image structure memory | storage part is shown. It is an example of the figure which shows typically the hierarchical structure of the image data memorize | stored in the image memory | storage part by the electronic conference. It is an example of the flowchart figure which shows the process sequence of the electronic conference apparatus when a screen shot button is pressed down. It is an example of the flowchart figure which shows the process sequence of the electronic conference apparatus when an agenda designation | designated start button is pressed down. It is an example of the flowchart figure which shows the process sequence of an image addition flow. It is an example of the flowchart figure which shows the process sequence of an agenda image display flow. It is an example of the flowchart figure which shows the process sequence of the control part when an agenda list button is pressed down. It is an example of the figure which shows the modification of an agenda image. It is a figure which shows an example of the image memory | storage part which used image information as positional information.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. The overall configuration diagram is the same as that in FIG. As shown in FIG. 1, an electronic information board 400 and a front projector 200 are connected to the PC 300. The projector 200 may be a flat panel display or a rear type projector. The electronic conference board 100 is configured by connecting the electronic information board 400 and the PC 300. Note that general-purpose projectors 200 and PCs 300 can be used.

[Outline of electronic conference apparatus 100]
For ease of explanation, a schematic feature of the electronic conference apparatus 100 according to the present embodiment will be described with reference to FIG. One feature of the electronic conferencing apparatus 100 is that it hierarchically manages locus images handwritten by the user. In addition, the user of this embodiment means a person who writes by hand on the electronic information board 400.

  In FIG. 20, the user classifies the starting agenda image (ID = 1) in which four agendas are described into four agenda images (ID = 2, 7, 8, 9). The user associates a starting agenda image (ID = 4) in which another four agendas are described below one of the four agenda images (ID = 2). In addition, the electronic conference apparatus 100 associates the screen shot (ID = 3) with the lower layer of one of the four image data (ID = 2).

  Further, the user sorts the starting agenda image (ID = 4) into four agenda images (ID = 5, 10, 11, 12), and screen shots (shown below) of one of the four agenda images (ID = 5). ID = 6).

  As described above, the electronic conference apparatus 100 stores the parent-child relationship of each image data in a chained manner even when the user develops the agenda. Therefore, the electronic conference apparatus 100 according to the present embodiment can manage handwritten images hierarchically. For example, in a meeting, a single agenda is subdivided in the process of being discussed, or various images are handwritten before and after the subdivision, but the electronic conference apparatus 100 can manage these handwritten contents hierarchically, Can be managed in association with each other.

〔Constitution〕
FIG. 2 is an example of a hardware configuration diagram of a PC (Personal Computer) 300. Like the computer, the PC 300 includes a CPU 301, an RPM 302, a RAM 303, an external I / F 304, a communication device 305, an input device 306, a display control unit 307, and a storage device 308 that are connected to each other via a bus. The CPU 301 reads an OS (Operating System) and a program 310 from the storage device 308, and executes them using the RAM 303 as a working memory.

  The program 310 provides a general function of the electronic conference system, such as a function of acquiring position information of a position where the user has operated the touch panel, a function of displaying a series of position information as a locus, and the like. Further, the program 310 provides a characteristic part of the electronic conference apparatus 100 described later. The program 310 can be executed like an add-in program in cooperation with a general word processing application or presentation application. In this case, the screen generated by the presentation application is displayed on the electronic information board 400, and characters and the like are displayed on the screen of the presentation application. Hereinafter, the program 310 and general application functions will be described without distinction.

  The RAM 303 is a work memory (main storage memory) for temporarily storing necessary data, and the ROM 302 stores BIOS, initially set data, a startup program, and the like.

  The external I / F 304 is an interface for mounting a cable such as a USB cable or a portable storage medium 320. The storage medium 20 is a flash memory such as a USB memory, an optical storage medium such as a CD-ROM, or the like. In this embodiment, a touch panel on the electronic information board side is connected to the external I / F 304. The external I / F 304 may be connected to the electronic information board 400 wirelessly instead of wired. In this case, the external I / F 304 is a Bluetooth or wireless LAN communication device.

  The communication device 305 is called a LAN card or an Ethernet (registered trademark) card, and transmits data to a computer connected via a network according to an instruction from the CPU 301.

  The input device 306 is a user interface that accepts various user operation instructions such as a keyboard and a mouse. In the present embodiment, the touch panel of the electronic information board 400 is also an input device.

  The display control unit 307 outputs screen information to the projector 200 with a predetermined resolution, number of colors, and the like based on screen information instructed by the program 310. This screen information is for drawing a screen displayed on the display when the projector 200 is not connected to the PC 300. By using a graphic board or distributor, the screen can be displayed on both the projector 200 and the display at the same time.

  The storage device 308 has a nonvolatile memory such as an HDD (Hard Disk Drive) or a flash memory as an entity, and stores an OS, a program 310, and the like. The program 310 is distributed in a state stored in the storage medium 320 or downloaded from a server (not shown).

  FIG. 3 shows an example of a functional block diagram of the electronic conference apparatus 100. The electronic conference apparatus 100 is realized by the CPU 301 executing the program 310. The video output unit 11, the position detection unit 12, the application screen generation unit 13, the trajectory image processing unit 14, the control unit 15, and the agenda image acquisition unit 16 are realized. An image data registration unit 19, a structure registration unit 18, and a parent image ID update unit 17. In addition, the electronic conference apparatus 100 includes a parent image ID primary storage unit 22, an image storage unit 20, an image structure storage unit 21, and a user information storage unit 23, each having a RAM 303 or a storage device 308.

  The position detection unit 12 detects the position on the touch panel of the electronic information board 400 that the user has touched (touched) with the stylus pen 500 or the like as a change in capacitance, pressure, or shape. The position detecting unit 12 detects the position at every predetermined cycle time, whereby the locus of the tip of the stylus pen 500 is obtained. This position is, for example, X and Y coordinates in pixel units with the upper left corner of the electronic information board 400 as the origin. Note that the user can operate the electronic information board 400 with a fingertip or the like without using the stylus pen 500. Further, the position detection unit 12 may be provided on the touch panel side. In addition, alignment is performed in advance so that the position of the video and the stylus pen 500 coincide.

  Further, the drawing position of the electronic information board 400 may be detected not as a contact position but as an irradiation position of a light spot of an optical pen (may be contacted or non-contacted). Further, the position information can also be detected by photographing the trajectory of the top of the pen with a camera.

  The control unit 15 controls the entire electronic conference apparatus 100. For example, it is determined whether the position information detected by the position detection unit 12 is a handwriting or a command operation, and storage of image data is controlled.

  The trajectory image processing unit 14 generates a trajectory image by connecting the position information detected by the position detection unit 12 in time series with a predetermined line width, and outputs the trajectory image to the video output unit 11. The line width and line color can be selected by the user.

  The application screen generation unit 13 generates application screen information for an electronic conference generated by the program 310 and outputs the application screen information to the video output unit 11. There are various types of electronic conference screens. Here, it is assumed that a drawing column 31, an agenda display column 32, a screen shot display column 33, and a command button column 30, which will be described later, are displayed.

  The video output unit 11 combines the trajectory image and the application screen information to generate screen image data, and sends the screen image data to the projector 200. For example, the locus image layer may be superimposed on the application screen layer.

  The image data registration unit 19 stores the whole or a part of the trajectory image in the image storage unit 20 among the videos displayed on the projector 200 by the video output unit 11. More specifically, the control unit 15 detects that the user has touched the command button displayed by the program 310 based on the position information, and stores all or a part of the trajectory image in the image storage unit 20. As a result, a screen shot, agenda image, and a starting point agenda image of a trajectory image in a drawing field 31 to be described later are stored in the image storage unit 20. Note that when the screen shot, the agenda image, and the starting agenda image are not distinguished, they are simply referred to as “image data”.

  The structure registration unit 18 registers the screen shot, the agenda image, and the hierarchical structure of the starting agenda image registered in the image storage unit 20 in the image structure storage unit 21. The processing of the structure registration unit 18 will be described later.

  The parent image ID update unit 17 updates the image ID of the parent image of the current trajectory image stored in the parent image ID primary storage unit 22. That is, when the current trajectory image is stored, the image data is stored in the image storage unit 20 as a child image of the image data of the image ID stored in the parent image ID primary storage unit 22.

  As described above, the image storage unit 20 stores the screen shot, the agenda image, and the starting agenda image displayed by the video output unit 11. The image structure storage unit 21 stores a hierarchical structure of image data stored in the image storage unit 20. The parent image ID temporary storage unit 22 stores the image ID of the parent image of the current trajectory image. An example of the image storage unit 20, the image structure storage unit 21, and the parent image ID primary storage unit 22 is shown below in FIG.

  The user information storage unit 23 stores user information. FIG. 4A illustrates an example of user information. The user information has a paired user name and password. Before starting to use the electronic conference apparatus 100, the user operates the electronic information board and inputs the user name and password.

  FIG. 4B shows an example of an input screen displayed on the electronic information board. The control unit 15 authenticates the user based on whether or not the set of the input user name and password is stored in the user information storage unit 23. When authentication is established, the control unit 15 permits the user to use the electronic conference device 100.

〔initial screen〕
FIG. 5 shows an example of a screen in an initial state where no trajectory image is displayed. The video output unit 11 displays an illustrated screen on the electronic information board 400 according to the application screen information generated by the application screen generation unit 13 via the projector 200.

  This screen has a drawing field 31, an agenda display field 32, a screen shot display field 33, and a command button field 30. The drawing column 31 is an area where the user handwrites characters and the like. In particular, in the present embodiment, the user draws the agenda and information necessary for the discussion in the drawing column 31 during the discussion. Regardless of whether the image displayed in the drawing field 31 is a part or the whole, it is called a trajectory image.

  The agenda image designated by the user is displayed in the agenda display field 32. The agenda image is a part of a trajectory image designated by the user from when the agenda designation start button 36 is pressed to when the agenda designation end button 39 is pressed. In this embodiment, since the user designates a trajectory image including the agenda, it is called “agenda image”, but a trajectory image other than the agenda can also be designated. In the agenda display field 32, a plurality of agenda images can be displayed.

  The screen shot display field 33 displays a reduced image of the trajectory image in the drawing field 31 when the screen shot button 34 is pressed. That is, the entire trajectory image of the drawing field 31 is displayed. In this embodiment, the image data stored by the screen shot button 34 is referred to as “screen shot”. In the screen shot display field 33, a plurality of screen shots can be displayed.

  The command button column 30 includes a screen shot button 34, an agenda page designation button 35, an agenda designation start button 36, an all deletion button 37, and an agenda list button 38. When the screen shot button 34 is selected, the image data registration unit 19 converts the entire locus image in the drawing field 31 into one image and registers it in the image storage unit 20. The format of the image data is mainly jpeg, html, pdf, bmp, etc., but raw data of position information may be stored.

  When the agenda page designation button 35 is selected, the image data registration unit 19 converts the entire locus image in the drawing column 31 into one image and registers it in the image storage unit 20. The image data in the drawing field 31 where the agenda page designation button 35 is pressed becomes a parent image having a hierarchical structure.

  In the present embodiment, the user presses the agenda page designation button 35 when one or more agenda items that have various contents to be discussed are handwritten. Called “Agenda Image”. Naturally, the user can also press the agenda page designation button 35 in a state where the agenda is not included in the drawing column 31.

  Note that pressing the agenda page designation button 35 deepens the hierarchy of the image data registration structure.

  The control unit 15 switches the video output unit 11 to the agenda specification start mode until the agenda specification end button 39 is pressed after the agenda specification start button 36 is pressed. The video output unit 11 switched to the agenda designation start mode outputs a trajectory image in a closed curve surrounded by the line image generated by the trajectory image processing unit 14 to the image data registration unit 19. The image data registration unit 19 stores the agenda image in the image storage unit 20.

  The all delete button 37 is a button for deleting all the trajectories displayed in the drawing field 31. In this case, the agenda image in the agenda display field 32 and the screen shot in the screen shot display field 33 are not deleted.

  The agenda list display button 38 is a button for reproducing and displaying the image data stored in the storage unit 20 with a hierarchical structure. By pressing the agenda list display button 38, the image data is displayed according to the hierarchical structure as shown in FIG.

〔Screen transition〕
Hereinafter, the operation of the electronic conference apparatus 100 will be described using screen transitions.
FIG. 6A is a diagram illustrating an example of a screen on which an agenda is drawn by the user. The user handwritten four agenda items using the stylus pen 500.
1. Agenda AAAAAAAAAA
2. Agenda BBBBBBBBBBB
3. Agenda CCCCCCCCCC
4). Agenda DDDDDDDDDDD
In the state of FIG. 6A, the user presses the agenda page designation button 35. Therefore, the image data in the drawing column 31 of FIG. 6 is the origin agenda image. The control unit 15 detects that the agenda page designation button 35 has been pressed based on the position information, and requests the application screen generation unit 13 to highlight the drawing field 31. This highlighting is for indicating that the current trajectory image in the drawing column 31 is the origin agenda image. The origin agenda image is stored in the image storage unit 20.

  In FIG. 6B, “Agenda page” is displayed at the upper right of the drawing field 31 as highlighting. It is only necessary to know that the trajectory image of the drawing column 31 is the origin agenda image, such as changing the color of the frame of the drawing column 31 or changing the background color.

  Next, the user designates the agenda for discussion from the four agenda items in the drawing column 31. For this reason, the user presses the agenda designation start button 36 and writes a closed curve surrounding the agenda to be designated, so that the trajectory image processing unit 16 generates a trajectory image of the closed curve.

  FIG. 6C shows an example of the drawing column 31 in which the closed curve 41 is drawn. In FIG. 6C, the first “Agenda AAAAAAAAA” is surrounded by a closed curve 41.

  When the user presses the agenda designation start button 36, the agenda designation start button 36 becomes unnecessary, and a button for accepting the end is required. Therefore, the control unit 15 instructs the app screen generation unit 13 to specify the agenda designation start button 36. Request to switch to the end button 39 for display.

  Next, when the closed curve 41 is handwritten, the user presses the agenda designation end button 39. When detecting that the agenda designation end button 39 is pressed, the control unit 15 determines whether or not the closed curve 41 is drawn. For example, on the condition that the locus is longer than a predetermined length, the first position information and the last position information of the locus are compared, and if both are within a predetermined distance, it is determined that the closed curve 41 is drawn. Then, the control unit 15 determines whether or not the closed curve 41 surrounds the agenda. For example, when the circumscribed rectangle of the closed curve 41 and the circumscribed rectangle of the agenda are generated and the circumscribed rectangle of the closed curve 41 completely surrounds the circumscribed rectangle of the agenda, the control unit 15 determines that the closed curve 41 surrounds the agenda. . In consideration of user operability, if the two circumscribed rectangles overlap in an area of about 90%, it may be determined that the closed curve 41 surrounds the agenda, and the two circumscribed rectangles are one. If even the part overlaps, it may be determined that the closed curve 41 surrounds the agenda. The position information of both is clear by the position detector 12.

  When the closed curve 41 surrounds the agenda, the control unit 15 stores the trajectory image of the agenda included in the closed curve 41 generated by the trajectory image processing unit 14 in the image storage unit 20, and displays the trajectory image in the agenda display field 32. The application screen generation unit 13 is requested. As a result, the agenda image selected by the user is displayed in the agenda display field 32 of the screen.

  FIG. 7A is a diagram illustrating an example of a screen when the user selects an agenda item. As described above, the first “Agenda AAAAAAAAA” is surrounded by the closed curve 41 and the agenda image 42 described as “Agenda AAAAAAAAA” is displayed in the agenda display field 32. In this agenda image 42, “Agenda AAAAAAAAAAA” in the agenda display field 32 is surrounded by a dotted closed curve, which has the same shape as the closed curve 41 handwritten by the user. The reason why the control unit 15 displays not only the agenda but also the closed curve 41 in the agenda display field 32 is to clearly indicate the delimiter of the agenda. May be.

  When the user presses the agenda designation end button 39, the agenda designation end button 39 becomes unnecessary, and a button for accepting the agenda designation is necessary. Therefore, the control unit 15 provides the agenda designation end button 39 to the application image generation unit. A request is made to switch to the agenda designation start button 36 for display.

  Subsequently, it is assumed that the drawing column 31 is deleted for the user to proceed with the discussion. In order to delete the drawing field 31 in the electronic conference apparatus 100, the user presses the all delete button 37. Based on the position information, the control unit 15 detects that the all deletion button 37 has been pressed, and requests the application screen generation unit 13 to delete all the trajectory images in the drawing field 31. Thereby, all the trajectory images in the drawing column 31 are deleted. The agenda image 42 in the agenda display field 32 is not deleted. Also, the agenda image in the image storage unit 20 is not deleted.

  FIG. 7B shows an example of a screen on which the all deletion button 37 is pressed. All the closed curves that specify the four agenda items and the first agenda item in the drawing column 31 are deleted. In such a state, the user can grasp at a glance that the trajectory image displayed in the drawing field 31 is about the agenda image displayed in the agenda display field 32. That is, participants can discuss more detailed items while displaying the agenda subject to discussion.

  FIG. 7C is a diagram illustrating an example of a trajectory image newly handwritten in the drawing field 31 by the user. The user handwritten “ABC”, which is a subordinate item of “Agenda AAAAAAAAA”, in the drawing column 31. When the user wants to save the trajectory image in the drawing field 31, the user presses the screen shot button 34.

  The control unit 15 detects pressing of the screenshot button 34 based on the position information, requests that the video output unit 11 store the trajectory image displayed in the drawing field 31 in the image data registration unit 19, and The screen generator 13 is requested to display a screen shot in the screen shot display field 33. Thus, the image data of the locus image handwritten as “ABC” is stored in the image storage unit 20. Also, a screen shot 43 of the locus image handwritten with “ABC” is displayed in the screen shot display field 33 of the screen.

  FIG. 8A shows an example of a screen on which a screen shot 43 is displayed. When the screen shot button 34 is pressed, a screen shot 43 is displayed in the screen shot display field 33.

  According to FIG. 8A, the agenda image 42 is displayed in the agenda display field 32, and the agenda item is displayed in the screen shot display field 33. Even if the user presses the delete all button 37, the screen shot 43 in the screen shot display field 33 does not disappear. Therefore, the user writes items one after another in the drawing field 31 while displaying the past screen shot 43 in the drawing field 31. can do. Since the agenda is always displayed, it is possible to easily grasp which agenda the trajectory image of the drawing field 31 is for.

  Subsequently, it is assumed that the user presses the delete all button 37 and handwrites a new agenda item. Based on the position information, the control unit 15 detects that the all deletion button 37 has been pressed, and requests the application screen generation unit 13 to delete all the trajectory images in the drawing field 31. Thereby, all the trajectory images in the drawing column 31 are deleted. The agenda image 42 in the agenda display field 32 and the screen shot 43 in the screen shot display field 33 are not deleted.

FIG. 8B shows an example of a new agenda item. The user has handwritten four agenda items.
1. Agenda AAAAAaaaaaa
2. Agenda BBBBBbbbb
3. Agenda CCCCCcccccc
4). Agenda DDDDDdddddd
In the state of FIG. 8B, the user presses the agenda page designation button 35. As a result, the image data in the drawing field 31 in FIG. 8B becomes the starting locus image. The control unit 15 detects that the agenda page designation button 35 has been pressed based on the position information, and requests the application screen generation unit 13 to highlight the drawing field 31. This starting point locus image is also stored in the image storage unit 20.

  FIG. 8C shows an example of a screen in which a starting point agenda image is newly specified. The agenda image 42 displayed in the agenda display field 32 is not deleted. Thereby, the user can confirm the agenda discussed in the past. Further, when the agenda page designation button 35 is pressed, “Agenda Page” is displayed in the upper right of the drawing field 31.

  On the other hand, the screen shot 43 displayed in the screen shot display field 33 is deleted. This is because the screen shot 43 is associated with the agenda, so that the screen shot 43 should be initialized if the agenda changes. However, a screen shot 43 is stored in the image storage unit 20. Therefore, the control unit 15 detects that the agenda page designation button 35 has been pressed based on the position information, and requests the application screen generation unit 13 to end the display of the screen shot in the screen shot display field 33. .

  Next, the user designates the agenda for discussion from the four agenda items in the drawing column 31. As described above, the user presses the agenda designation start button 36 and handwrites a closed curve surrounding the agenda to be designated. In addition, the user presses the agenda designation end button 39 after the closed curve is handwritten.

  FIG. 9A shows an example of a screen in which a closed curve 44 is drawn in the drawing field 31. In FIG. 9A, the first “Agenda AAAAAaaaaaa” is surrounded by a closed curve 44. As described above, the control unit 15 determines whether or not the closed curve 44 is drawn. When the closed curve 44 is handwritten, the control unit 15 stores the agenda image included in the closed curve 44 generated by the trajectory image processing unit 14 in the image storage unit 20, and displays the agenda image in the agenda display field 32. Request to the generation unit 13. As a result, the agenda selected by the user is displayed in the agenda display field 32 of the screen.

  Here, the agenda image 42 on which the agenda “AAAAAAAAAAA” has already been described is already displayed in the agenda display field 32. Therefore, the application screen generation unit 13 specifies the hierarchical structure of the agenda “AAAAAAAAA” and the agenda “AAAAAaaaaaa”. Specifically, the two agenda images 42 and 45 are connected by a line. FIG. 9B shows an example of a screen in which two agenda images 42 and 45 in the agenda display field 32 are connected by a line. By doing so, the user can grasp that the agenda item “AAAAAAAaaa” is an agenda item below the agenda item “AAAAAAAAAAA”. The detection of the hierarchical structure will be described later.

  Subsequently, it is assumed that the user presses the delete all button 37. Based on the position information, the control unit 15 detects that the all deletion button 37 has been pressed, and requests the application screen generation unit 13 to delete all the trajectory images in the drawing field 31. Thereby, all the trajectory images in the drawing column 31 are deleted. The agenda images 42 and 45 in the agenda display field 32 are not deleted.

  FIG. 9C shows an example of a screen from which the drawing column 31 has been completely erased. Since the agenda display column 32 displays the hierarchical structure of the agenda, the user can easily see that the trajectory image displayed in the drawing column 31 is for the agenda displayed in the agenda display column 32. I can grasp it.

  FIG. 10 is a diagram illustrating an example of a trajectory image newly handwritten in the drawing field 31 by the user. The user has handwritten “abc”, which is a subordinate item of “Agenda AAAAAaaaaaa”, in the drawing column 31. When the user wants to save the trajectory image in the drawing field 31, the user presses the screen shot button 34.

  The control unit 15 detects pressing of the screenshot button 34 based on the position information, requests that the video output unit 11 store the trajectory image displayed in the drawing field 31 in the image data registration unit 19, and The screen generator 13 is requested to display a screen shot in the screen shot display field 33. Thereby, the screen shot 46 of the locus image handwritten as “abc” is stored in the image storage unit 20. Further, a screen shot 46 of the locus image handwritten with “abc” is displayed in the screen shot display field 33 of the screen.

  Subsequently, the user presses “Agenda AAAAAAAAAAA” in the agenda display field 32 in order to refute the argument of “Agenda AAAAAAAAA”. The control unit 15 detects that “Agenda AAAAAAAAA” in the agenda display field 32 is selected based on the position information, and displays a screen shot 43 below the agenda image in which “Agenda AAAAAAAAA” is described in the application screen generation unit 13. It requests to be displayed in the screen shot display field 33. Further, the control unit 15 causes the application screen generation unit 13 to display one of the screen shots 43 (for example, the first screen shot) below the agenda image in which “Agenda AAAAAAAAA” is described in the drawing field 31. Request.

  FIG. 11 shows an example of a screen on which a screen shot of the lower layer of the agenda image describing “Agenda AAAAAAAAA” is displayed. The agenda image 42 describing “Agenda AAAAAAAAA” in the agenda display field 32 is highlighted (inverted). Thereby, the user can grasp at a glance that the current screen shot 43 and the trajectory image of the drawing field 31 relate to “Agenda AAAAAAAAA”.

  When the user presses the screen shot 43 in the screen shot display field 33, the control unit 15 detects that the screen shot 43 is selected based on the position information, and displays the screen shot 43 in the application screen generation unit 13. Request to display in the drawing field 31. In this way, the user can recall screen shots of past agendas at any time.

  In this way, participants in the conference can grasp not only the agenda but also the agenda and the hierarchical structure of the agenda. When there are multiple discussions in a meeting, participants repeatedly concentrate on one agenda and digest the agenda one after another. However, past agendas can be left out of consciousness. If the agenda can be subdivided into several smaller agendas, the past agendas are closely related, so it may be desirable to discuss the relevant agendas in the past.

  The electronic conferencing apparatus 100 of the present embodiment displays the current agenda while visualizing past agendas, and the participants can discuss while looking at the screen shots handwritten on the agenda. You can see at a glance whether the screenshot is being discussed.

[Memory of hierarchical structure]
Storage of the hierarchical structure for realizing the above screen will be described with reference to the screens of FIGS.

  12A schematically shows the image storage unit 20 in which nothing is stored, FIG. 12B schematically shows the image structure storage unit 21 in which nothing is stored, and FIG. Schematically shows the parent image ID primary storage unit 22 in which nothing is stored. For example, such a state is obtained immediately after the electronic conference apparatus 100 is activated.

  The image ID of the image storage unit 20 is an ID for identifying each image data registered in the image storage unit 20, the agenda flag is a flag indicating that the image data is an agenda image, and is handwritten in the image information. Various image data are registered.

  When the user presses the agenda page designation button 35 in FIG. 6A, the control unit 15 detects the press of the agenda page designation button 35 based on the position information, and the image data registration unit 19 is displayed by the application screen generation unit 13. The generated locus image (starting agenda image) of the drawing field 31 is stored in the image storage unit 20.

  As shown in the image storage unit 20 of FIG. 13A, image data of a starting agenda image in which four agendas that are trajectory images of the drawing field 31 are described in the image information is registered. The control unit 15 assigns an image ID to this image data. The image IDs do not have to overlap, but here it is assumed to be an integer value from the number “1”. Anything other than numbers, such as alphabets and symbols, can be used as the image ID as long as it can be uniquely identified.

  When the control unit 15 detects that the agenda page designation button 35 is pressed based on the position information, the parent image ID update unit 17 sets the image ID of the image data when the agenda page designation button 35 is pressed as the parent image ID. Register in the primary storage unit 22. This makes it possible to store a hierarchical structure. In FIG. 13A, “1” is described in the parent image ID primary storage unit 22.

  Although “image data” is registered in the image storage unit 20 in FIG. 13 and the like, time-series position information constituting a trajectory image may be registered in the image storage unit 20. FIG. 27 is a diagram illustrating an example of the image storage unit 20 using the image information as position information. If the position information is registered in time series, the trajectory image processing unit 14 can be visualized (converted into a trajectory image) at any time. In general, numerical data such as position information is smaller in size than image data, so that the capacity of the storage device 308 of the PC 300 can be saved.

  Next, when the user presses the agenda specification end button 39 in FIG. 6C, the control unit 15 detects the press of the agenda specification end button 39 based on the position information, and the image data registration unit 19 detects the trajectory image processing unit. The image data of the trajectory image including the closed curve and the agenda generated by 14 is stored in the image storage unit 20.

  Image data in which “Agenda AAAAAAAAA”, which is the agenda image 42, is registered in the image information of the image storage unit 20 in FIG. The image data registration unit 19 assigns an image ID “2” to this image data.

  Further, the image data registration unit 19 sets the agenda flag of the image data when the agenda designation end button 39 is pressed to TRue. This makes it clear that this image data is the agenda image designated by the user with the closed curve 41.

  Further, when the second and subsequent image data are registered in the image storage unit 20, the structure registration unit 18 stores the parent-child relationship of the image data in the image structure storage unit 21 each time the image data is registered in the image storage unit 20. sign up. Here, when the agenda image 42 is designated by pressing the agenda designation end button 39, the structure registration unit 18 stores in the image structure storage unit 21 which image data is the parent image of the agenda image 42.

  As shown in FIG. 14B, specifically, the structure registration unit 18 registers the image ID registered in the parent image ID primary storage unit 22 in “parent image ID” of the image structure storage unit 21. The image ID “2” assigned to the agenda image 42 is registered in the “child image ID” of the image structure storage unit 21.

  The parent image ID update unit 17 registers the image ID of the image data registered in the image storage unit 20 in the parent image ID primary storage unit 22 when the agenda designation end button 39 is pressed. As illustrated in FIG. 14C, “2” is registered in the parent image ID primary storage unit 22. Thereby, the agenda image 42 and the screen shot can be associated thereafter, and the parent-child relationship of all the image data registered in the image storage unit 20 can be registered.

  Next, in FIG. 7C, when the user presses the screen shot button 34, the control unit 15 detects the press of the screen shot button 34 based on the position information, and the image data registration unit 19 displays the video output unit. 11 stores the trajectory image displayed in the drawing column 31 in the image storage unit 20.

  As shown in the image storage unit 20 in FIG. 15A, the image data of the screen shot 43 is registered in the image information. The image data registration unit 19 assigns an image ID “3” to the image data.

  Further, as described above, the structure registration unit 18 registers the parent-child relationship between the image data of the screen shot 43 and the agenda image 42 that is the parent image in the image structure storage unit 21. That is, the structure registration unit 18 registers the image ID registered in the parent image ID primary storage unit 22 in the “parent image ID” of the image structure storage unit 21, and “3” added to the image data of the screen shot 43. Is registered in the “child image ID” of the image structure storage unit 21.

  Next, in FIG. 8B, when the user presses the agenda page designation button 35, the control unit 15 detects the press of the agenda page designation button 35 based on the position information, and the image data registration unit 19 The trajectory image (starting agenda image) of the drawing field 31 generated by the output unit 11 is stored in the image storage unit 20.

  As shown in the image storage unit 20 in FIG. 16A, the image data of the starting agenda image is registered in the image information. The image data registration unit 19 assigns an image ID “4” to the image data.

  Further, the structure registration unit 18 registers the parent-child relationship between the image data of the starting agenda image and the agenda image 42 in which “Agenda AAAAAAAAA” is described in the image structure storage unit 21. That is, when the control unit 15 detects that the agenda page designation button 35 is pressed, the structure registration unit 18 sets the image ID registered in the parent image ID primary storage unit 22 as the “parent image ID” of the image structure storage unit 21. The image ID “4” registered and assigned to the origin agenda image is registered in the “child image ID” of the image structure storage unit 21. Since the four agenda items in the drawing field 31 of FIG. 8B are related to “Agenda AAAAAAAAA”, the parent-child relationship between the image data of the starting agenda image of FIG. 8B and the agenda image 42 of “Agenda AAAAAAAAA” By registering, the hierarchical structure of the agenda can be stored.

  Further, the parent image ID update unit 17 registers the image ID of the image data in the image storage unit 20 when the agenda page designation button 35 is pressed in the parent image ID primary storage unit 22. Accordingly, “4” is registered in the parent image ID primary storage unit 22 in FIG. Thereby, lower-layer image data can be associated with the origin agenda image with the image ID “4”.

  Next, when the agenda designation end button 39 is pressed after the agenda “AAAAAaaa” is surrounded by a closed curve in FIG. 9A, the control unit 15 presses the agenda specification end button 39 based on the position information. The image data registration unit 19 stores the agenda image included in the closed curve generated by the trajectory image processing unit 14 in the image storage unit 20.

  As shown in the image storage unit 20 in FIG. 17A, the agenda image 45 in which “agenda AAAAAaaaaaa” is described in the image information is registered. The image data registration unit 19 assigns an image ID “5” to the image data.

  Further, the image data registration unit 19 sets the agenda flag of the image data when the agenda designation end button 39 is pressed to TRue. In FIG. 17B, the agenda flag of the image data with the image ID 5 is TRue.

  Further, the structure registration unit 18 registers the image ID registered in the primary image ID primary storage unit 22 in the “parent image ID” of the image structure storage unit 21 and adds “5” to the image data of the agenda image 45. Is registered in the “child image ID” of the image structure storage unit 21.

  In addition, the parent image ID update unit 17 registers the image ID of the image data when the agenda designation end button 39 is pressed in the parent image ID primary storage unit 22. Thereby, the lower-order image data can be associated with the agenda image, and the parent-child relationship of all the image data registered in the image storage unit 20 can be registered.

  Next, in FIG. 10A, when the user presses the screen shot button 34, the control unit 15 detects the press of the screen shot button 34 based on the position information, and the image data registration unit 19 displays the video output unit. 11 stores the trajectory image displayed in the drawing column 31 in the image storage unit 20.

  As shown in the image storage unit 20 in FIG. 18A, the image data of the screen shot 46 is registered in the image information. The image data registration unit 19 assigns an image ID “6” to the image data.

  The structure registration unit 18 registers the image ID registered in the parent image ID primary storage unit 22 in the “parent image ID” of the image structure storage unit 21 and adds “6” to the image data of the screen shot 46. Is registered in the “child image ID” of the image structure storage unit 21.

  In this way, by registering image data and image IDs in the image storage unit 20, the image structure storage unit 21, and the parent image ID primary storage area, the hierarchical structure of each image data can be stored. By referring to the image structure storage unit 21, for example, the parent image of the image data with the image ID = 6 is the image data with the image ID = 5, and the parent image of the image data with the image ID = 5 is the image ID = 4. It is found that the image data is the image data, and the parent image of the image data with the image ID = 4 is the image data with the image ID = 2. By tracing the image ID in this way, the control unit 15 can specify not only the agenda in which a certain snapshot is handwritten but also the agenda of the parent of the agenda.

  Also, the agenda images 42 and 45 (connection of the agenda “AAAAAAAAA” and the agenda “AAAAAAAAAAA”) shown in FIG. 9B are extracted in the image storage unit 20 with the agenda flag set to True. What is necessary is just to connect with a line.

[Hierarchical structure of image data]
As the conference further proceeds, image data and image ID are stored in the image storage unit 20 and the image structure storage unit 21. FIG. 19 shows an example of a hierarchical structure stored in the image structure storage unit 21. When the agenda list button 38 on the screen is pressed in such a state, the control unit 15 displays the hierarchical structure.

  FIG. 20 is an example of a diagram schematically showing a hierarchical structure of image data stored in the image storage unit 20 in the electronic conference. The control unit 15 refers to the image structure storage unit 21 and displays the entire hierarchical structure as shown in FIG. The display procedure will be described later.

[Operation procedure]
Hereinafter, display of a screen and registration of image data in the image storage unit 20 will be described with reference to flowcharts.

  FIG. 21A is an example of a flowchart illustrating a processing procedure of the electronic conference apparatus 100 when the screen shot button 34 is pressed.

  When the screen shot button 34 is pressed, the control unit 15 executes an image addition flow (S10). By this processing, the image data of the screen shot is registered in the image storage unit 20.

  Next, the control unit 15 causes the application screen generation unit 13 to display a screen shot in the screen shot display field 33 (S20).

  FIG. 21B is an example of a flowchart illustrating a processing procedure of the electronic conference apparatus 100 when the agenda page designation button 35 is pressed.

  When the agenda page designation button 35 is pressed, the control unit 15 executes an image addition flow (S10). By this processing, the image data of the agenda image is registered in the image storage unit 20.

  Next, the parent image ID update unit 17 registers the image ID given to the image data when the agenda page designation button 35 is pressed in the parent image ID primary storage unit 22 (S30).

  FIG. 22A is an example of a flowchart illustrating a processing procedure of the electronic conference apparatus 100 when the agenda designation start button 36 is pressed.

  When the agenda designation start button 36 is pressed, the control unit 15 requests the application screen generation unit 13 to switch the agenda designation start button 36 to the agenda designation end button 39 for display (S40).

  FIG. 22B is an example of a flowchart illustrating a processing procedure of the electronic conference apparatus 100 when the agenda designation end button 39 is pressed.

  When the control unit 15 detects that the agenda designation end button 39 is pressed, the control unit 15 determines whether or not the closed curve is a closed curve, and in the case of a closed curve, determines whether or not the handwritten agenda and the circumscribed rectangle of the closed curve overlap. S50).

  When a closed curve designating the agenda is detected, the control unit 15 executes an image addition flow (S10). By this process, the agenda image is registered in the image storage unit 20.

  Next, the parent image ID updating unit 17 registers the image ID given to the image data when the agenda page designation button 35 is pressed in the parent image ID primary storage unit 22 (S30).

  Next, the control unit 15 executes the agenda image display flow (S200). Thereby, the control part 15 can specify all the image data (agenda image ID) displayed on the agenda display column 32. FIG.

  The image data registration unit 19 sets the agenda flag of the image data of the agenda image registered in the image storage unit 20 to True (S60).

  Next, the control unit 15 displays the agenda images of all the agendas specified by the agenda image ID (S70).

FIG. 23 is an example of a flowchart showing the processing procedure of the image addition flow.
First, the image data registration unit 19 registers image data in the image storage unit 20 (S110). The following two image data are registered.
When the screen shot button 34 or the agenda page designation button 35 is pressed: image data of the entire trajectory image in the drawing field 31 When the agenda designation end button 39 is pressed: the agenda image surrounded by a closed curve The image data registration unit 19 assigns an image ID to the image data newly registered in the image storage unit 20 (S120). This image ID is, for example, an integer serial number.

  Next, the image data registration unit 19 determines whether or not the image ID is stored in the parent image ID primary storage unit 22 (S130). When the image ID is stored in the parent image ID primary storage unit 22 (Yes in S130), since the parent image exists in the image data registered by the image data registration unit 19, the structure registration unit 18 determines the image structure. The parent-child relationship (record) is registered in the storage unit 21 (S140). Specifically, “parent image ID” is an image ID stored in the parent image ID primary storage unit 22, and “child image ID” is an image ID newly added by the image data registration unit 19 in step S 120. is there.

  FIG. 24 is an example of a flowchart showing a processing procedure of the agenda image display flow. In this process, the image ID assigned to the image data is used as an input value.

First, the agenda image acquisition unit 16 sets an image ID, which is an input value, as a search key (S210).
Then, the agenda image acquisition unit 16 reads records one by one from the image storage unit 20 (S220).

  First, it is determined whether or not the agenda flag of the record is True (S230). If the agenda flag is True (Yes in S230), the image data becomes image data of the agenda image, and the agenda image acquisition unit 16 stores the search key in the return value array (S240).

  Next, the agenda image acquisition unit 16 stores the search key at the top of the array of the agenda image ID storage unit (not shown) (S250).

  Next, the agenda image acquisition unit 16 searches the image structure storage unit 21 for a “child image ID” that matches the search key (S260).

  When the “child image ID” that matches the search key is registered in the image structure storage unit 21 (Yes in S270), the agenda image acquisition unit 16 sets the “parent image ID” associated with the “child image ID”. Is newly set as a search key (S280).

  And the agenda image acquisition part 16 repeats the process after step S230. For example, when the agenda flag of the image ID of the next search key is not True (No in S230), since the image data is not an agenda image, the process proceeds to step S260, and the “child image ID” that matches the search key is set as the image. A search is made from the structure storage unit 21 (S260). Then, the agenda image acquisition unit 16 newly sets the “parent image ID” associated with the “child image ID” as a search key (S280), and repeats the processing from step S230 onward.

  By this processing, the image ID of the image data is stored in the agenda image ID storage unit according to the hierarchical structure. Taking the image structure storage unit 21 in FIG. 19 as an example, if the image ID in step S210 is “5”, “5” and “2” are stored in the agenda image ID storage unit, and the image ID in step S210 is “ If “10”, “10” and “2” are stored in the agenda image ID storage unit (the image data of the image ID 10 is an image of the agenda “AAAAAbbbbbb”).

  Therefore, the application screen generation unit 13 can display the image data with the image IDs “5” and “2” or the image data with the image IDs “10” and “2” in association with the agenda display field 32. .

  If the return value in step S240 is used, not only the direct hierarchical structure but also all hierarchical structures higher than the image ID in step S210 can be acquired. For example, if the image ID in step S210 is “10”, “10” and “2” are stored in the agenda image ID storage unit, and “10” and “2” are stored in the return value array.

  The control unit 15 decreases the largest value “10” in the return value array by one, and repeats the processing from step 230. Then, “5” “2” is stored after “10” “2” in the agenda image ID storage unit, and “5” “2” is stored in the return value array. Therefore, it can be seen that both are the image data of the agenda image, and the image data of image ID = 2 is associated with the image data of image ID = 5, 10 as a lower hierarchy. Using this, the control unit 15 can display the agenda image as shown in FIG. 26 in the agenda display field 32.

  FIG. 25 is an example of a flowchart illustrating a processing procedure of the control unit 15 when the agenda list button 38 is pressed. Thereby, the hierarchical structure of FIG. 20 is displayed.

  The control unit 15 detects that the agenda list button 38 is pressed based on the position information, and registers all “child image IDs” associated with the image ID = 1 in the first table (S310). Taking FIG. 19 as an example, image IDs {2, 7, 8, 9} are registered in the first table. This is the image ID of the first layer image data.

  Next, the control unit 15 sequentially extracts the image IDs registered in the first table, and registers all “child image IDs” associated with the image IDs in the second table for each image ID (S320). . Four second tables are generated. {3, 4} is in the second table with the image ID = 2, {-(none)} is in the second table with the image ID = 7, and the second table with the image ID = 8. {−} Is registered in the second table, and {−} is registered in the second table with the image ID = 9. The image ID of the second table is the image ID of the second layer image data.

  Next, the control unit 15 sequentially extracts the image IDs registered in the second table, and registers all the image IDs associated with the image IDs in the third table for each image ID (S330). Two third tables are generated, and {−} is registered in the third table with the image ID = 3, and {5, 10, 11, 12} is registered in the third table with the image ID = 4. The image ID of the third table is the image ID of the third layer image data.

  Next, the control unit 15 sequentially extracts the image IDs registered in the third table, and registers all the image IDs associated with the image IDs in the fourth table for each image ID (S340). One fourth table is generated, and {6} is registered in the fourth table with the image ID = 5. The image ID of the fourth table is the image ID of the fourth layer image data.

  The control unit 15 repeats the same processing until there is no image ID associated with the “parent image ID” (S350).

  Since the image ID for each hierarchy is registered in each table by the above processing, the hierarchical structure shown in FIG. 20 is obtained by referring to the tables in the hierarchical order and expanding the image IDs in the table. That is, the control unit 15 reads out image data from the image storage unit 20 based on the image ID, generates thumbnail images and the like, and displays a hierarchical structure as shown in FIG. 20 by connecting the images with lines. be able to.

DESCRIPTION OF SYMBOLS 11 Image | video output part 12 Position detection part 13 Application screen generation part 14 Trajectory image processing part 15 Control part 16 Agenda image acquisition part 17 Parent image ID update part 18 Structure registration part 19 Image data registration part 20 Image storage part 21 Image structure storage part 22 Parent image ID primary storage unit 23 User information storage unit 100 Electronic conference device 200 Projector 300 PC
400 Electronic information board 500 Stylus pen

JP 2007-280235 A

Claims (12)

Position detecting means for detecting an input position with respect to the information input area;
A trajectory image generating means for visualizing the trajectory of the position information in time series as a trajectory image;
An electronic conference apparatus having display means for displaying a trajectory image,
First trajectory image storage receiving means for receiving a trajectory image storage command;
Second trajectory image storage receiving means for receiving a trajectory image storage command;
A trajectory image storage unit that assigns unique identification information to the trajectory image displayed on the display unit and stores it in the first storage unit when the first or second trajectory image storage reception unit receives a storage command; ,
An identification information storage means for storing the identification information given by the locus information storage means in a third storage section when the first locus image storage acceptance means accepts a storage command;
The identification information stored in the identification information storage means when the second trajectory image storage acceptance means accepts a storage command is used as parent image identification information, and the second trajectory image storage acceptance means accepts a storage command. Correspondence information storage means for storing the identification information given by the trajectory image storage means as child image identification information and storing the parent image identification information and the child image identification information in the second storage unit in association with each other,
An electronic conferencing apparatus comprising: A third trajectory image storage accepting unit that accepts a selection of a partial trajectory image that is a part of the trajectory image and a command to store the partial trajectory image;
The trajectory image storage means assigns the identification information unique to the partial trajectory image for which the third trajectory image storage acceptance means accepts a storage command and stores the partial identification information in the first storage unit,
The correspondence information storage means includes the identification information stored in the identification information storage means when the third trajectory image storage accepting means accepts a storage command, and the third trajectory image storage accepting means stores the command. Is stored in the second storage unit in association with the identification information provided by the trajectory image storage means when receiving,
The identification information storage means stores the identification information given by the trajectory information storage means in the third storage unit when the third trajectory image storage acceptance means accepts a storage command.
The electronic conference apparatus according to claim 1. A first column for displaying the trajectory image visualized by the trajectory image generation means in real time;
Screen generating means for generating screen information including: a second field for displaying a trajectory image stored in the first storage unit by receiving a storage command by the second trajectory image storage receiving means; The electronic conference apparatus according to claim 1, wherein the electronic conference apparatus is provided.   Screen generating means for generating screen information including a third field for displaying a partial trajectory image stored in the first storage unit by receiving a storage command by the third trajectory image storage receiving means; The electronic conference apparatus according to claim 2, further comprising: The trajectory image storage means associates a predetermined flag with a partial trajectory image and stores it in the first storage unit,
The screen generation means displays the partial trajectory images associated with the flags when displaying the partial trajectory images in the third field,
The electronic conference apparatus according to claim 4. A list display receiving means for receiving a command for displaying a list of image data stored in the first storage unit,
The screen generation means reproduces a hierarchy obtained by associating parent image identification information and child image identification information stored in the second storage unit, and displays a list of a plurality of the image data in a tree shape. The electronic conference apparatus according to claim 2. Having user information storage means storing authentication information for each user;
The electronic conferencing apparatus according to claim 1, wherein use is permitted when user authentication is established.   8. The electronic device according to claim 4, wherein the trajectory image or the partial trajectory image stored in the first storage unit is time-series position information detected by the position detection unit. Conference equipment. The trajectory image in which the first trajectory image storage receiving unit receives a storage command is a trajectory image in which one or more agenda items are handwritten.
The trajectory image that the second trajectory image storage accepting unit accepts the storage command is a trajectory image handwritten on the agenda.
The electronic conferencing apparatus according to claim 1, wherein the electronic conferencing apparatus is any one of claims 1 to 8. The partial trajectory image in which the third trajectory image storage accepting unit accepts a storage command is a trajectory image in which one agenda selected from trajectory images in which one or more agenda items are handwritten is described.
The electronic conference apparatus according to claim 9. A position detecting means for detecting an input position for the information input area;
A step of visualizing a trajectory of the position information in time series as a trajectory image by a trajectory image generation unit;
A display means for displaying the trajectory image, and an information display method comprising:
A first trajectory image storage receiving unit receiving a trajectory image storage command;
A second trajectory image storage receiving means for receiving a trajectory image storage command;
The trajectory image storage means assigns unique identification information to the trajectory image displayed by the display means when the first or second trajectory image storage acceptance means accepts a storage command and stores it in the first storage unit. And steps to
A step of storing, in a third storage unit, the identification information provided by the trajectory information storage means when the first trajectory image storage acceptance means accepts a storage command;
Corresponding information storage means uses the identification information stored in the identification information storage means when the second trajectory image storage acceptance means accepts a storage command as parent image identification information, and accepts the second trajectory image storage acceptance. Storing the identification information given by the trajectory image storage means when the means accepts a storage command as child image identification information, associating the parent image identification information with the child image identification information in the second storage unit;
An information display method characterized by comprising: Position detecting means for detecting an input position with respect to the information input area;
A trajectory image generating means for visualizing the trajectory of the position information in time series as a trajectory image;
A computer having display means for displaying the locus image;
A first trajectory image storage receiving step for receiving the trajectory image storage command;
A second trajectory image storage receiving step for receiving the trajectory image storage command;
A trajectory image storage step of adding unique identification information to the trajectory image displayed by the display means when the first or second trajectory image storage accepting means accepts a storage command and storing it in the first storage unit; ,
An identification information storage step of storing the identification information given by the trajectory information storage means in a third storage unit when the first trajectory image storage reception means accepts a storage command;
The identification information stored in the identification information storage means when the second trajectory image storage acceptance means accepts a storage command is used as parent image identification information, and the second trajectory image storage acceptance means accepts a storage command. A corresponding information storage step of storing the identification information given by the trajectory image storage means as child image identification information and associating the parent image identification information with the child image identification information in the second storage unit;
A program that executes

Images