JP2015106333A - Information input system, information input device, information input method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the convenience of a user who performs a handwriting input by an information input device.SOLUTION: The information input system includes: plotting means for, when the input of coordinates is instructed to a display surface on which document data are displayed, plotting the document data in layers 920 and 930 on the basis of the instructed input; and display control means for controlling the display of the display surface such that the plotting content plotted in the layers 920 and 930 is displayed so as to be superimposed on electronic data. The display control means is characterized such that the plotting content is displayable with multiple permeability.

Description

  The present invention relates to an information input system, an information input device, an information input method, and a program.

  In general, an information input device such as an electronic whiteboard can display document data on a display surface or input handwritten characters or the like using the display surface as an input surface.

  In addition, it is used as various information input systems such as a conference system and a learning support system by connecting to other devices and displaying the display contents displayed on the information input devices in synchronization with the other devices. You can also.

  However, the conventional information input device has a configuration in which input content input by handwriting is displayed superimposed on document data under a predetermined display mode. For this reason, there is a problem that it is not possible to appropriately cope with various usage scenes in the application system.

  For example, in a case where the present invention is applied to a conference system, a use scene is assumed in which underline is drawn by handwriting input at an emphasized portion in order to emphasize predetermined description contents of document data. In this case, if the underline overlaps with the emphasized portion, there is a problem that it becomes difficult to see the emphasized portion. For this reason, in the conventional conference system, the input position must be taken into consideration when the user performs handwriting input.

  In addition, for example, when applied to a learning support system, a usage scene is assumed in which a part of the description content of the document data is painted black by handwriting input to give a question. In this case, in order to cancel the black-painted portion, the user needs to perform an erasing operation using a so-called “eraser” function or the like, which is inconvenient.

  For this reason, information input devices are required to improve the convenience of handwriting input in consideration of usage scenes in various systems as application destinations.

  SUMMARY An advantage of some aspects of the invention is that it improves the convenience of a user who performs handwriting input in an information input device.

An information input device according to an embodiment of the present invention has the following configuration. That is,
When a coordinate input is instructed on a display surface on which electronic data is displayed, drawing means for drawing on a layer based on the instructed input;
Display control means for controlling display on the display surface so that the drawing content drawn on the layer is displayed superimposed on the electronic data;
The display control means can display the drawing content with a plurality of different transmissivities.

  According to each embodiment of the present invention, it is possible to improve user convenience in an information input device.

It is a figure which shows an example of a system configuration at the time of applying the client apparatus which concerns on embodiment to a conference system. It is a figure which shows the hardware constitutions of each apparatus which comprises a conference system. It is a figure which shows the function structure of each apparatus which comprises a conference system. It is a figure which shows an example of the meeting information stored in the meeting information database. It is a figure which shows an example of the user information stored in the user information database. It is a figure which shows an example of the document information stored in the document information database. It is a sequence diagram which shows the flow of the conference process in a conference system. It is a figure for demonstrating the mode at the time of the display control process in a client apparatus. It is a figure for demonstrating the outline | summary of the display control process for displaying by several transparency. It is a figure which shows the example of a display when handwritten input is performed with respect to document data. It is a figure which shows an example of the user interface in a client apparatus. It is a figure which shows the correspondence of the input content input by handwriting, and document data. It is a flowchart which shows the flow of the display control process in a client apparatus. It is a figure which shows an example of the user interface at the time of performing a display control process in a client apparatus. It is a figure which shows an example of the user interface in a client apparatus. It is a flowchart which shows the flow of the display control process in a client apparatus. It is a flowchart which shows the flow of the display control process in a client apparatus. It is a figure which shows an example of the user interface at the time of performing a display control process in a client apparatus. It is a figure which shows an example of the user interface in a client apparatus. It is a figure which shows an example of the user interface in a client apparatus. It is a flowchart which shows the flow of the display control process in a client apparatus. It is a flowchart which shows the flow of the display control process in a client apparatus. It is a flowchart which shows the flow of the display control process in a client apparatus. It is a figure which shows an example of the user interface at the time of performing a display control process in a client apparatus. It is a figure which shows an example of the user interface in a client apparatus. It is a figure which shows an example of the user interface in a client apparatus. It is a figure which shows an example of a system configuration at the time of applying the client apparatus which concerns on embodiment to a learning assistance system. It is a sequence diagram which shows the flow of the learning assistance process in a learning assistance system. It is a figure which shows an example of a data structure of permission notification.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Of the following embodiments, in the first to sixth embodiments, a case where the information input device according to the present invention is applied to a conference system will be described. In the seventh embodiment, a case where the information input device according to the present invention is applied to a learning support system will be described. However, the system to which the information input device according to the present invention is applied is not limited to these, and it is needless to say that it can be applied to other information input systems.

  In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

[First Embodiment]
<1. System configuration of conference system>
FIG. 1 is a diagram illustrating an example of a system configuration of a conference system 100 to which the information input device according to the present embodiment is applied. As shown in FIG. 1, the conference system 100 includes one or more client devices 110 that are information input devices according to the present embodiment.

  As shown in FIG. 1, the information input device according to the present embodiment is used as a client device 110 operated by a presenter or a client device 110 operated by a participant in a conference system 100. The client device 110 is configured by an electronic whiteboard, a PC (personal computer), a tablet terminal, a smart phone, a mobile phone, a portable information terminal such as a PDA, and the like.

  Note that display devices 120 and 130 may be connected to the client device 110, respectively. The display devices 120 and 130 are assumed to be configured by a video projection device such as a projector, an electronic blackboard, a large monitor, or the like.

  The conference system 100 further includes a conference system server device 140 and a document management server device 150. The conference system server device 140 is a device that performs information processing related to the conference, and the document management server device 150 is a device that performs information processing related to management of document data (electronic data) such as conference materials used in the conference. The conference system server device 140 and the document management server device 150 are configured by a WS (workstation), a PC, or the like.

  The above devices (client device 110, conference system server device 140, document management server device 150) constituting the conference system 100 are connected via a network 160 by wire or wirelessly.

  In the configuration example shown in FIG. 1, the conference system server device 140 and the document management server device 150 are configured separately, but the configuration of the conference system 100 is not limited to this. For example, the conference system server device 140 and the document management server device 150 may be configured as software and services that function as respective devices on a single computer.

  Alternatively, the conference system server device 140 and the document management server device 150 may be configured as a collection of software and services that operate on one or more computers. For example, the conference system server device 140 and the document management server device 150 may be configured in a so-called cloud service form.

  The role of each device in the conference system 100 configured as described above will be briefly described below.

  The client device 110 has a conference application mounted thereon, displays document data such as conference material managed by the document management server device 150, and superimposes input contents input by handwriting during the conference on the document data. Or display.

  Further, the presenter's client device 110 further creates conference information at the time of the conference and registers it in the conference system server device 140 or registers document data such as conference materials used in the conference. In addition, document data (“input document data”) on which input contents input by handwriting during a meeting are superimposed is transmitted to the document management server apparatus 150.

  The display devices 120 and 130 enlarge the display content displayed on the client device 110 based on an instruction from the client device 110.

  The conference system server device 140 stores conference information registered by the client device 110 and manages user information for specifying a user (presenter) of the client device 110. Further, the display contents during the conference are managed, and control is performed so that the display contents are synchronized between the client apparatus 110 of the presenter and the client apparatus 110 of the participant.

  The document management server device 150 stores and manages document information including document data such as conference material used in the conference and attribute information of the document data. In addition, when handwritten input is performed on document data in a meeting, the input content including the handwritten input is stored and managed.

  Note that when the document data used in the conference and the input document data used are stored in the document management server device 150, the client device 110 of the presenter sends a communication request to the conference system server device 140. When communication is established with the conference system server device 140, the client device 110 of the presenter transmits document data to be stored or input document data to the conference system server device 140.

  The conference system server device 140 transmits the document data or input document data received from the client device 110 of the presenter to the document management server device 150 as document information together with the conference information and user information. The document management server device 150 stores and manages the received document information in an appropriate location.

<2. Hardware configuration of each device>
Next, the hardware configuration of each device constituting the conference system 100 will be described. FIG. 2 is a diagram illustrating a hardware configuration of the client device 110, the conference system server device 140, and the document management server device 150 constituting the conference system 100.

(Client device)
As shown in FIG. 2, the client device 110 includes a CPU 201, a RAM 202, an input device 203, an external I / F 204, an HDD 205, a ROM 206, a display device 207, a communication I / F 208, and the like. Has been. Note that a camera, a microphone, a speaker, and the like may be further connected to the client device 110.

  The CPU 201 is an arithmetic device that controls the entire client device 110 and implements various functions by reading programs and data from a storage device such as the ROM 206 and the HDD 205 onto the RAM 202 and executing processing. The RAM 202 is a volatile semiconductor memory that temporarily stores programs and data.

  The input device 203 includes a keyboard and a mouse, and is used to input various instructions to the client device 110.

  The external I / F 204 is an interface with an external device. The external device includes a recording medium 210 and the like. The client device 110 reads and / or writes the recording medium 210 via the external I / F 204. The recording medium 210 includes a flexible disk, CD, DVD, SD memory card, USB memory, and the like.

  The HDD 205 is a non-volatile storage device that stores programs and data. The stored programs and data include an OS that is basic software for controlling the entire client device 110, and application software (such as a conference application) for realizing various functions on the OS. The HDD 205 manages the stored programs and data by a predetermined file system and / or database.

  The ROM 206 is a nonvolatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 206 stores programs and data such as BIOS, OS settings, and network settings that are executed when the client device 110 is activated.

  The display device 207 displays the document data stored in the document management server device 150 on the display surface. In addition, the display surface of the display device 207 also functions as an input surface instructed to input coordinates, and displays the input contents input by handwriting by identifying and drawing the coordinates instructed to input.

  The communication I / F 208 is an interface that connects the client device 110 to the network 160. Thereby, the client apparatus 110 can communicate with the conference system server apparatus 140.

  The client device 110 implements various functions to be described later by executing a conference application based on the hardware configuration described above.

(Conference system server device)
As shown in FIG. 2, the conference system server device 140 includes a CPU 221, a RAM 222, an external I / F 223, an input device 224, an HDD 225, a ROM 226, a communication I / F 227, a display device 228, and the like. It is connected. Note that the input device 224 and the display device 228 may be connected and used when necessary.

  The CPU 221 is an arithmetic device that controls the entire conference system server device 140 and implements various functions by reading programs and data from the storage device such as the ROM 226 and the HDD 225 onto the RAM 222 and executing the processing. The RAM 222 is a volatile semiconductor memory that temporarily stores programs and data.

  The external I / F 223 is an interface with an external device. The external device includes a recording medium 230 and the like. The conference system server device 140 reads and / or writes the recording medium 230 via the external I / F 223. The recording medium 230 includes a flexible disk, CD, DVD, SD memory card, USB memory, and the like.

  The input device 224 includes a keyboard and a mouse, and is used to input various instructions to the conference system server device 140.

  The HDD 225 is a nonvolatile storage device that stores programs and data. The stored programs and data include an OS that is basic software for controlling the entire conference system server device 140, and application software that executes information processing related to the conference on the OS. The HDD 225 manages stored programs and data using a predetermined file system and / or database.

  The ROM 226 is a nonvolatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 226 stores programs and data such as BIOS, OS settings, and network settings that are executed when the conference system server device 140 is activated.

  The communication I / F 227 is an interface that connects the conference system server apparatus 140 to the network 160. Thereby, the conference system server device 140 can communicate with the client device 110 and the document management server device 150. The display device 228 includes a display and the like, and displays a processing result by the conference system server device 140.

  The conference system server device 140 realizes various functions to be described later by executing a program that realizes information processing related to the conference based on the above hardware configuration.

(Document management server device)
As shown in FIG. 2, the document management server device 150 includes a CPU 241, a RAM 242, an external I / F 243, an input device 244, an HDD 245, a ROM 246, a communication I / F 247, a display device 248, and the like. It is connected to the. Note that the input device 244 and the display device 248 may be connected and used when necessary.

  The CPU 241 is an arithmetic device that controls the entire document management server device 150 and implements various functions by reading programs and data from a storage device such as the ROM 246 and the HDD 245 onto the RAM 242 and executing the processing. The RAM 242 is a volatile semiconductor memory that temporarily stores programs and data.

  The external I / F 243 is an interface with an external device. Examples of the external device include a recording medium 250. The document management server device 150 reads and / or writes the recording medium 250 via the external I / F 243. The recording medium 250 includes a flexible disk, CD, DVD, SD memory card, USB memory, and the like.

  The input device 244 includes a keyboard and a mouse and is used to input various instructions to the document management server device 150.

  The HDD 245 is a non-volatile storage device that stores programs and data. The stored programs and data include an OS that is basic software that controls the entire document management server apparatus 150, and application software that performs information processing related to document management on the OS. The HDD 245 manages the stored programs and data by a predetermined file system and / or database.

The ROM 246 is a nonvolatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 246 stores programs and data such as BIOS, OS settings, and network settings that are executed when the document management server apparatus 150 is activated.

  The communication I / F 247 is an interface that connects the document management server apparatus 150 to the network 160. As a result, the document management server apparatus 150 can communicate with the conference system server apparatus 140. The display device 248 includes a display and the like, and displays a processing result by the document management server device 150.

  The document management server device 150 realizes various functions to be described later by executing a program that realizes information processing related to document management based on the above hardware configuration.

<3. Functional configuration of each device>
Next, the functional configuration of various functions realized in each device constituting the conference system 100 will be described. FIG. 3 is a diagram illustrating a functional configuration of each device constituting the conference system 100.

(Functional configuration of client device)
The client device 110 functions as an event management unit 311, a display control unit 312, a communication processing unit 313, and a file management unit 314 by executing the conference application. Of the client devices 110 of the participants, only the event management unit 311, the display control unit 312, and the communication processing unit 313 are configured to function.

  When an operation (for example, a document data reading operation, a handwriting input operation, an erasing operation, a page moving operation, etc.) is performed on the input surface of the client device 110 of the presenter, the event management unit 311 responds to the operation. Event information is generated. Further, the generated event information is transmitted to the conference system server device 140. In the client device 110 of the participant, event information is received from the conference system server device 140.

  The display control unit 312 controls the display of the conference screen displayed on the display surface based on event information generated by an operation performed on the input surface of the presenter's client device 110.

  Specifically, when a document data reading operation is performed, the document data read based on the operation is displayed on the conference screen. When a handwriting input operation is performed, the input content input by handwriting is displayed on the conference screen based on the operation. In addition, when an erasing operation is performed, the object of the portion where the erasing operation has been performed is erased from the input contents input by handwriting displayed on the conference screen. Further, when a page moving operation is performed, the page of the document data displayed on the conference screen is moved based on the operation.

  In the client device 110 of the participant, the display of the conference screen displayed on the display surface is similarly controlled based on the event information received from the conference system server device 140. Thereby, the display content of the conference screen of the presenter's client device 110 and the display content of the conference screen of the participant's client device 110 are synchronized.

  The communication processing unit 313 establishes communication with the communication processing unit 330 of the conference system server device 140. Event information in the event management unit 311 is transmitted to and received from the conference system server device 140 via the communication processing unit 313.

  When handwriting input is performed on the client device 110 of the presenter, the file management unit 314 has input the input contents input by handwriting and the document data displayed when the handwriting input is performed Save as document data.

(Functional configuration of conference system server device)
The conference system server device 140 functions as an information management unit 320, a communication processing unit 330, and the like by executing a program that realizes information processing related to the conference. The information management unit 320 further includes a conference information management unit 321, an event management unit 322, a user information management unit 323, a temporary storage file management unit 324, and the like that execute various processes in response to requests from the client device 110.

  The conference information management unit 321 receives and manages the registration of conference information from the client device 110 of the presenter before the conference. Specifically, when conference information (details will be described later) is generated by the user via the conference management screen displayed on the display screen of the client device 110 of the presenter, the conference information management unit 321 displays the conference information. Is registered in the conference information database 381.

  The event management unit 322 manages whether each client device 110 is the presenter's client device 110 or the participant's client device 110 during the conference. In other words, it manages which of the client devices 110 participating in the conference is the client device 110 of the presenter.

  In addition, event information is received from the client device of the presenter, and the conference state is managed by executing processing according to the event information. Specifically, when a document data reading operation event is received from the client device 110 of the presenter, the document data used for the conference is specified based on the conference information. Further, the document information including the specified document data is read from the document information database 383 via the document management server device 150 and transmitted to the client device 110 of the presenter and the client device 110 of the participant.

  In addition, when event information such as a handwriting input operation, an erasing operation, and a page moving operation is received from the presenter's client device 110, the event information is transmitted to the participant's client device 110.

  The user information management unit 323 manages a user information database 382 in which user account, password, and personal folder information is registered. When a user (presenter) logs in to the conference system server device 140 using an account and a password, the user (presenter) can access the personal folder based on the information of the personal folder of each user registered in the user information database 382.

  The temporary storage file management unit 324 manages the input document data stored in the client device 110 of the presenter.

  The communication processing unit 330 establishes communication between the communication processing unit 313 of the client device 110 and the communication processing unit 350 of the document management server device 150, and transmits and receives information.

  The conference system server device 140 is connected to a conference information database 381 that stores conference information managed by the conference system 100 and a user information database 382 that stores user information. The conference information database 381 stores registered conference information, document data information associated with the conference information, conference status, and the like. The user information database 382 stores an account of a user who logs in as a presenter to the conference system 100, a password, personal folder information, and the like.

(Functional configuration of document management server device)
The document management server apparatus 150 functions as an information management unit 340, a communication processing unit 350, a document registration processing unit 360, a document update processing unit 370, and the like by executing a program that realizes information processing related to document management. The information management unit 340 further includes a document information management unit 341 and a user information management unit 342.

  The document information management unit 341 stores document information including document data such as conference materials used in the conference, input document data used in the conference, and attribute information of the document data or the input document data. The document information database 383 is managed. The user information management unit 342 manages a user information database 382 in which user (presenter) account, password, and personal folder information is registered.

  The communication processing unit 350 establishes communication with the communication processing unit 330 of the conference system server device 140 and transmits / receives information.

  The document registration processing unit 360 registers document information including document data such as conference materials used in the conference and input document data used in the conference in the document information database 383. The document update processing unit 370 updates document information including document data already registered in the document information database 383 as document information, input document data, and the like.

  The document management server device 150 is connected to a user information database 382 and a document information database 383 that stores document information managed by the document management server device 150.

<4. Explanation of information stored in each database>
Next, conference information, user information, and document information stored in each database (conference information database 381, user information database 382, and document information database 383) included in the conference system 100 will be described.

(About meeting information)
FIG. 4 is a diagram showing an example of conference information stored in the conference information database 381. As shown in FIG. 4, the conference information includes items such as “ID”, “meeting name”, “number of times”, “organizer”, “document”, “date / time”, “meeting place”, “agenda”, and the like. included.

  “ID” is information for identifying the conference, and the conference ID is registered. “Conference name” and “Number of times” are information for the user to identify the conference, and the name and number of times of the conference are registered. “Organizer” is information for identifying the organizer of the conference, and the user ID of the organizer is registered.

  “Document” is information for identifying document information including document data used in the conference, and a document ID and a document URL are registered. A plurality of document IDs and document URLs can be registered in the “document”. In “Date and time”, the date and time when the meeting is held is registered. “Meeting place” is information for identifying a meeting room, and the name and ID of the meeting room are registered. “Agenda” is information such as the agenda of the meeting, and a character string, an agenda ID, and the like are registered.

(About user information)
FIG. 5 is a diagram showing an example of user information stored in the user information database 382. As shown in FIG. 5, the user information includes items such as “ID”, “account”, “password”, and “folder”.

  “ID” is information for identifying the user, and the user ID is registered. “Account” and “Password” are information used when the user logs in. “Folder” is information for specifying a personal folder, and a personal folder ID and a folder URL are registered.

(About document information)
FIG. 6 is a diagram showing an example of document information stored in the document information database 383. As shown in FIG. 6, the document information includes attribute data related to the document data, section information, and handwritten input information in addition to the actual data (not shown) of the document data.

  The attribute information includes items such as “ID”, “document name”, “creator”, “creation date”, “section”, “version information”, “location”, and “meeting”. The section information includes items such as “ID”, “document”, and “section number”.

  “ID” of the attribute information is information for identifying the document, and the document ID is registered. “Document name” is information for the user to identify document data, and the name of the document data is registered. “Creator” is information for identifying the user who created the document data, and the name and account are registered. In “creation date”, the creation date when the document data is created is registered. “Section” is information for identifying a section included in the document data, and a section information ID is registered. A plurality of section information IDs can be registered in the “section”.

  “Version information” is information for identifying the version of the document data, and is used for versioning. “Location” is information for identifying a location on the document management server device 150 where actual data of document data is stored, and a folder path is registered. “Conference” is information for identifying a meeting in which document data is used, and a meeting ID is registered.

  Further, “ID” of the section information is information for identifying the section information, and the section information ID is registered. “Document” is information for identifying a document, and a document ID is registered. “Section number” is information for identifying a section, and the section number is registered.

  The handwritten input information is added when handwritten input is performed in the conference. The handwritten input information includes items such as “ID”, “file”, “shared”, “page”, “mode”, “transparency”, “detail”, “time designation”, “timer status”, “instructed time” "," End time ", etc. are included.

  “ID” is information for identifying document data, and the document ID is registered. “File” is information for identifying a section included in document data, and a section ID is registered.

  “Shared” includes a case in which the conference screen displayed by executing the conference application is synchronized with other client devices 110 by handwriting input performed asynchronously. Handwritten input is registered. In the “page”, a page input by handwriting is registered.

  In the “mode”, it is registered whether handwriting input is performed in the normal mode described later or handwriting input is performed in the marker mode. In “Transparency”, the transparency of the drawing portion when handwriting input is performed in the marker mode is registered.

  In “Details”, stroke information input by handwriting is registered. In “time designation”, a time for changing the transparency of the drawing portion in which the handwriting input is performed in the marker mode is designated. Registered in the “timer status” is whether or not it is within the time specified in “time specification” (whether or not time measurement is being performed by the timer).

  In the “instruction time”, a change start time is registered in the case where the transparency of the drawing portion in which the handwriting input is performed in the marker mode is changed. In the “end time”, an end time is registered in the case of changing the transparency of the drawing portion in which handwriting input is performed in the marker mode.

<5. Flow of conference processing in the conference system>
Next, the flow of the entire conference process in the conference system 100 will be described. FIG. 7 is a sequence diagram illustrating the flow of the entire conference process in the conference system 100.

  In the presenter's client device 110, first, the conference application is activated and a conference management screen is displayed (step S701). When the user performs a login operation on the displayed conference management screen, a login request including user information is transmitted to the conference system server device 140 (step S702).

  Upon receiving the login request, the conference system server device 140 authenticates the presenter's client device 110 by searching the user information database 382 based on the user information included in the login request (step S703). If the authentication is successful, the conference system server apparatus 140 notifies the presenter's client apparatus 110 that the login is successful (step S704).

  The client device 110 of the presenter who has received the notification of the successful login creates conference information and transmits it to the conference system server device 140 (step S705). The conference system server device 140 that has received the conference information registers the conference information in the conference information database 381.

  The presenter's client device 110 transmits document data such as conference materials used for the conference to the conference system server device 140. Upon receiving the document data, the conference system server device 140 generates document information based on the document data, conference information, and user information, and transmits the document information to the document management server device 150 (step S708).

  The document management server device 150 stores the received document information in the document information database 383. This completes the pre-conference processing.

  Subsequently, when the conference is started, the presenter's client device 110 activates the conference application and displays a conference screen (step S710). When the user performs a login operation on the displayed conference screen, a login request including user information is transmitted to the conference system server device 140 (step S711).

  Upon receiving the login request, the conference system server apparatus 140 authenticates the presenter's client apparatus 110 by searching the user information database 382 based on the user information included in the login request (step S712). When the authentication is successful, the conference system server apparatus 140 notifies the client apparatus 110 of the presenter that the login is successful (step S713). Upon receiving this, connection from the client device 110 of the participant becomes possible. Therefore, the participant's client device 110 activates the conference application, connects to the conference system server device 140, and displays the conference screen (step S714).

  On the other hand, in the presenter client device 110, a document data read operation is performed, and event information related to the document data read operation is transmitted to the conference system server device 140 (step S715).

  The conference system server device 140 that has received the event information related to the document data reading operation identifies the document information to be read based on the conference information, and transmits a read request to the document management server device 150 (step S716). The document management server device 150 that has received the read request searches the document information database 383 for the document information (step S717) and transmits it to the conference system server device 140 (step S718).

  Upon receiving the document information, the conference system server device 140 transmits the document data included in the document information to the client device 110 of the presenter and the client device 110 of the participant (steps S719 and S720). The client device 110 of the participant who received the document data displays the document data on the conference screen (step S721).

  The presenter's client device 110 that has received the document data displays the document data and executes a display control process (step S722). Details of the display control process will be described later. By executing the display control process, event information is generated in the client device 110 of the presenter and is sequentially transmitted to the conference system server device 140 (step S723). The event information transmitted at this time includes event information related to a handwriting input operation, event information related to an erase operation, event information related to a page moving operation, and the like.

  The event information transmitted from the presenter's client device 110 is transmitted to the participant's client device 110 (step S724), and the participant's client device 110 executes processing according to the event information (step S725). . Thereby, the display content of the conference screen displayed on the client device 110 of the presenter and the display content of the conference screen displayed on the client device 110 of the participant are synchronized.

  The input contents input by handwriting during the conference are stored in the presenter's client device 110 as input document data in association with the document data, and are transmitted to the conference system server device 140 when the presenter completes the presentation ( Step S726).

  The conference system server device 140 that has received the input document data generates document information based on the input document data, the conference information, and the user information, and transmits the document information to the document management server device 150. The document management server device 150 stores the received text information (including the input document data) in the document information database 383 (step S728).

<6. Explanation of modes during display control processing>
Next, mode switching when the conference screen is activated and the display control process (step S722) is executed in the client device 110 of the presenter will be described. FIG. 8 is a diagram for describing mode switching when the conference screen is activated on the client device 110 of the presenter and the display control process (step S722) is executed.

  As shown in FIG. 8, “normal mode” and “marker mode” are included in the modes when the conference device is activated on the client device 110 of the presenter and the display control process is executed. “Normal mode” means that the drawing position pixel (drawing portion) is rendered opaque (transparency = 0%) when drawing the input content on the layer based on the coordinates instructed to input by handwriting input. It is a mode to do. Specifically, in the transparent layer, the pixel at the drawn position is converted to opaque. In the normal mode, the pixels at positions other than the rendered position are transparent. Therefore, even when the normal mode layer is superimposed on the document data, the pixels other than the rendered position are Can view the document data.

  On the other hand, the “marker mode” is a mode in which the transparency of the pixel (drawing portion) at the drawing position is set to a value other than 0% when the coordinates instructed to input by handwriting input are drawn on the layer. . Specifically, in the transparent layer, the pixel at the drawn position is converted to a transparency set to a value other than 0%. Even in the marker mode, the pixels at positions other than the rendered position are transparent, so even if the marker mode layer is superimposed on the document data, The user can visually recognize the document data.

  Switching between the normal mode and the marker mode is performed by pressing a marker input button (described later) and a normal input button (described later). The handwriting input performed after the marker input button is pressed is input in the marker mode, and the handwriting input performed after the normal input button is pressed is input in the normal mode.

<7. Overview of display control processing in client device>
Next, an overview of display control processing in the client device 110 will be described with reference to FIG. As illustrated in FIG. 9, the client device 110 has at least three layers as layers for drawing display contents to be displayed on the display surface.

  The document layer 910 is a layer on which document data such as conference material is drawn, and the first layer 920 is a layer used when the normal mode is selected when handwritten input is performed. The second layer 930 is a layer used when the marker mode is selected when handwritten input is performed.

  When the client device 110 performs an operation for reading document data, the read document data is drawn on the document layer 910. On the other hand, when a user performs a handwriting input operation, the input content is drawn on the first layer 920 or the second layer 930. Specifically, when the normal mode is selected, the mode is switched to the first layer 920, and when the marker mode is selected, the mode is switched to the second layer 930. The drawing content (object) drawn on the second layer 930 is drawn with a transparency other than 0%.

  Thus, the display of the display surface of the client device 110 is controlled by one document layer 910, one first layer 920, and one second layer 930.

  FIG. 10 is a diagram illustrating a display example when handwritten input is performed on document data. Each drawing content of the document layer 910, the first layer 920, and the second layer 930, and each of the display surfaces are displayed. A display example is shown. Among these, FIG. 10A shows an example of the display surface 1001 displayed based on the drawing contents (document data) of the document layer 910 and the drawing contents (object inputted by handwriting) of the first layer 920. ing.

  On the other hand, FIG. 10B is based on the drawing contents (document data) of the document layer 910 and the drawing contents (object inputted by handwriting) of the second layer 930 in which a transparency other than 0% is set. An example of the displayed display surface 1002 is shown. In the example of FIG. 10B, the second layer 930 is set to a transmittance of 50%.

  By drawing on the second layer 930 in which a transparency other than 0% is set, the user can see the part of the document data input by handwriting as shown on the display surface 1002. This is effective when there is a content to be emphasized for a conference participant in a conference or the like. That is, the content can be emphasized by setting the transparency to 50% and marking the portion (for example, marking in red).

In this way, by configuring so that a layer having a transmittance other than 0% can be marked, convenience for a presenter such as a conference is improved in the following points, for example.
・ When only handwriting input equivalent to the normal mode is possible as in the conventional information input device, the input position should not be overlapped with the document data description part when marking the part to be emphasized. (See FIG. 10A). In particular, when a bold pen is used for handwriting input, further consideration is required.
On the other hand, if the transparency is set in the marking mode, handwriting input can be performed without considering the input position regardless of the pen thickness (see FIG. 10B).

<8. User Interface on Client Device>
Next, a conference screen which is a user interface for performing handwritten input in the client device 110 of the presenter will be described. FIG. 11 is a diagram illustrating an example of a conference screen 1100 that is a user interface for performing handwritten input in the client device 110 of the presenter.

  As shown in FIG. 11, the conference screen 1100 includes an input operation area 1110 and a display area 1120. In the example of FIG. 11, the document data is read and displayed in the display area 1120.

  In the input operation area 1110, a share button 1111, a non-share button 1112, a file read button 1113, a normal input button 1114, a marker input button 1115, and a delete button 1116 are arranged. Further, arrow buttons 1117 and 1118 are arranged.

  The share button 1111 is an operation button that is selected when display contents are synchronized between the client device 110 of the presenter and the client device 110 of the participant. On the other hand, the non-shared button 1112 is an operation button selected when display contents are not synchronized between the presenter's client device 110 and the participant's client device 110.

  A file read button 1113 is an operation button for reading document data. When the user presses the file reading button 1113 and inputs the conference ID, the event management unit 311 transmits event information of the document data reading operation to the conference system server device 140. The conference system server device 140 identifies the document information used for the conference based on the conference ID included in the event information of the document data reading operation, and reads the document information from the document management server device 150. Further, the document data included in the read document information is transmitted to the client device 110 of the presenter and the client device 110 of the participant.

  Among these, the document data transmitted to the client device 110 of the presenter is displayed in the display area 1120 of the conference screen in FIG.

  The normal input button 1114 is an operation button for selecting handwriting input in the normal mode. When the normal input button 1114 is pressed, handwriting input in the normal mode can be performed using the display area 1120 as an input surface.

  The marker input button 1115 is an operation button for selecting handwriting input in the marker mode. When the marker input button 1115 is pressed, handwriting input in the marker mode can be performed using the display area 1120 as an input surface. When the marker input button 1115 is pressed, handwriting input can be performed with a preset transparency (transparency other than 0%).

  An erase button 1116 can erase the drawing content input by handwriting. When the user (presenter) presses the delete button 1116 and indicates a desired part in the display area 1120 while the normal input button 1114 is pressed, the first layer 920 drawn on the part is displayed. The drawing contents are deleted. In addition, when the user presses the delete button 1116 while the marker input button 1115 is pressed and designates a desired part in the display area 1120, the drawing content of the second layer 930 drawn in the part is displayed. Is erased.

  It should be noted that an eraser button may be provided instead of or in addition to the erase button 1116. The eraser button is a button that, when a desired portion in the display area 1120 is designated, erases the drawn content drawn in that portion regardless of the layer.

  In a state where both the erase button 1116 and the eraser button are arranged, the user wants to erase the drawing contents of a specific layer (transparency) among the drawing contents input by handwriting in a predetermined area. The delete button 1116 may be selected. If it is desired to erase all the drawing contents input in a predetermined area regardless of the layer, an eraser button may be selected.

  In the display area 1120, the drawing contents drawn on the document layer 910, the first layer 920, and the second layer 930 are displayed. If the document data displayed in the display area 1120 consists of a plurality of pages, the user can return to the previous page by pressing the arrow button 1117 and can advance to the next page by pressing the arrow button 1118.

  Note that the handwriting input operation with the normal input button 1114 pressed and the handwriting input operation with the marker input button 1115 pressed are sequentially transmitted to the conference system server device 140 as event information. Similarly, the event information of the erasing operation generated when the erasing button 1116 is pressed and the event information of the page moving operation generated when the arrow buttons 1117 and 1118 are pressed are sequentially stored in the conference system server. Transmitted to the device 140.

<9. Relationship between handwritten input and document data>
Next, the relationship between the input contents handwritten and the document data will be described. As described above, when document data is read in the conference system 100 and handwritten input is performed during the conference, the conference system 100 associates the input content input by handwriting with the document data, and inputs the input document data. Save as.

  FIG. 12 is a table schematically showing a correspondence relationship between input contents input by handwriting and document data in input document data.

  In the table 1200, “file name” 1201 describes the file name of the read document data. In the example of FIG. 12, the file name “document 1” is described. The “page” 1202 records the page configuration of the read document data. The example of FIG. 12 indicates that the document data of the file name “document 1” is composed of 1 to 10 pages.

  The “mode” 1203 records the mode and layer name when handwritten input is performed on each page constituting the document data. The example of FIG. 12 indicates that handwriting input in the normal mode was performed on the first page of the document data with the file name “document 1”, and “layer A-1” was used as the first layer 920. ing. In addition, handwriting input in the marker mode is performed, and “Layer B-1” is used as the second layer 930. In the example of FIG. 12, handwriting input is not performed on the third page of the document data with the file name “document 1”.

  In “details” 1204, stroke information is described as input contents handwritten in each mode on each page of the file name “document 1”.

<10. Flow of display control processing in client device>
Next, the flow of display control processing (step S722) at the time of handwriting input in the client device 110 of the presenter will be described in detail. FIG. 13 is a flowchart showing the flow of display control processing (step S722) when handwriting input is performed in the client device 110 of the presenter. In the presenter's client device 110, the conference application is activated and the conference screen 1100 shown in FIG. 11 is displayed, and then the document data is read from the document management server device 150, whereby the flowchart shown in FIG. 13 is executed. . In the flowchart illustrated in FIG. 13, in order to simplify the description, details of processing when another operation button (for example, the delete button 1116) is pressed are omitted.

  In step S1301, it is determined whether or not the input button has been pressed. If it is determined in step S1301 that the normal input button 1114 has been pressed, the process proceeds to step S1302.

  In step S1302, it is determined whether the page currently displayed in the display area 1120 is a page in which the first layer 920 has already been generated. If it is determined in step S1302 that the first layer 920 has already been generated, the process proceeds to step S1303. In step S1303, the first layer 920 associated with the page is called.

  On the other hand, if it is determined in step S1302 that the first layer 920 has not yet been generated on the page, the process proceeds to step S1304, where the first layer 920 is generated and associated with the page in the table 1200. Describe.

  In step S1305, the input content input by handwriting is drawn on the first layer 920 called in step S1303 or the first layer 920 generated in step S1304.

  On the other hand, if it is determined in step S1301 that the marker input button 1115 has been pressed, the process proceeds to step S1306. In step S1306, it is determined whether the page currently displayed in the display area 1120 is a page in which the second layer 930 has already been generated. If it is determined in step S1306 that the second layer 930 has already been generated, the process proceeds to step S1307. In step S1307, the second layer 930 associated with the page is called.

  On the other hand, if it is determined in step S1306 that the second layer 930 has not yet been generated on the page, the process advances to step S1308 to generate the second layer 930 and associate the table with the page 1200. It describes.

  In step S1309, the input content input by handwriting is drawn on the second layer 930 called in step S1307 or the second layer 930 generated in step S1308.

  In step S1310, whether or not the file reading button 1113 is pressed and an instruction to read other document data is input, or whether or not the arrow buttons 1117 and 1118 are pressed and an instruction to move to another page is input. Determine.

  If it is determined in step S1310 that neither an instruction to read other document data nor an instruction to move to another page is input, the process returns to step S1301. On the other hand, if it is determined that an instruction to read other document data is input, or if it is determined that an instruction to move to another page is input, the process advances to step S1311.

  In step S1311, the input content input by handwriting is stored as input document data in association with the page of the document data. When other document data is read by an instruction to read other document data, the display control process from step S1301 in FIG. 13 is executed again for the other document data. Similarly, when another page is displayed in response to an instruction to move to another page, the display control process from step S1301 in FIG. 13 is executed again for the other page.

<11. User interface when display control processing is executed>
FIG. 14 is a diagram illustrating an example of a user interface when display control processing is executed in the client device 110. The example of FIG. 14 illustrates a case where handwriting input in the normal input mode and handwriting input in the marker input mode are performed on the document data displayed in the display area 1120, respectively. As shown in FIG. 14, by performing handwritten input in the marker input mode on the emphasized portion of the document data, the portion can be emphasized without being hidden.

<12. Summary>
As is clear from the above description, in the client device (information input device) according to the present embodiment,
A structure in which drawing is performed by switching between two types of layers for handwriting input, that is, a layer in which the transparency of the drawn pixels is 0% and a layer in which the transparency of the drawn pixels is other than 0%. did.
A configuration in which a normal mode for selecting a layer with 0% transparency of a drawn pixel and a marker mode for selecting a layer with a transparency other than 0% of a drawn pixel are provided as a user interface It was.
-The input content input by handwriting in the state where the normal mode is selected is drawn on a layer with 0% transparency, and the input content input by handwriting in the state where the marker mode is selected has a transparency of 0 It was configured to be drawn on a layer other than%.

  As described above, since the display mode of the input content input by handwriting is configured so that it can be displayed with different transparency, it is possible to provide an effective operation for a presenter such as a conference. As a result, user convenience is improved.

[Second Embodiment]
In the first embodiment, in the normal mode, the transparency is drawn on a layer with 0%, and in the marker mode, the transparency is drawn on a layer other than 0%. However, the present invention is not limited to this.

  For example, a layer that can change the transparency may be prepared, and the normal mode and the marker mode may be switched in each layer so that the display can be performed with different transparency. Further, when switching from the normal mode to the marker mode in the same layer, it may be configured to allow handwriting input with a predetermined transparency (however, other than 0%). Further, a plurality of predetermined transmittances may be prepared. Details of this embodiment will be described below.

<1. User Interface on Client Device>
First, a meeting screen which is a user interface for performing handwritten input in the client device 110 (presenter's client device 110) according to the present embodiment will be described. FIG. 15 is a diagram illustrating an example of a conference screen 1100 that is a user interface for performing handwritten input in the client device 110 according to the present embodiment. Here, the description will focus on differences from the user interface described with reference to FIG. 11 in the first embodiment.

  As shown in FIG. 15, a handwriting input button 1514 and a setting button 1515 are arranged in the input operation area 1110.

  The handwriting input button 1514 is a button for performing handwriting input. When the handwriting input button 1514 is pressed, the user can perform handwriting input.

  A setting button 1515 is a button for setting conditions for handwritten input. When a setting button 1515 is pressed, a setting window 1530 is displayed, and a condition for performing handwriting input can be set.

  The setting window 1530 has a layer selection field 1531. When the presenter selects a desired layer from the layer selection field 1531, the input content input by handwriting is drawn on the selected layer.

  The setting window 1530 further has a layer display field 1532. In the example of FIG. 15, “Layer 1” is a layer drawn with a transparency of 75% when the marker mode is entered, and “Layer 2” is a transparency of 50% when the marker mode is entered. It is a layer drawn with. Furthermore, “Layer 3” is a layer drawn with a transparency of 25% when the mode is shifted to the marker mode. Each layer is provided with a normal mode transition field 1533 for switching to the normal mode and a marker mode transition field 1534 for switching to the marker mode.

  When the layer selection field 1531 is selected (for example, “Layer 1”) and the normal mode transition field 1533 is selected, input is performed when handwriting is input to the layer (for example, “Layer 1”). The content is drawn with 0% transparency. In addition, the drawing content (object) already drawn in the layer (for example, “Layer 1”) is changed to 0% transparency.

  In addition, when the layer selection field 1531 is selected (for example, “Layer 1”) and the marker mode transition field 1534 is selected, handwriting input is performed on the layer (for example, “Layer 1”). The input content is drawn with the set transparency (for example, transparency 75%). In addition, the object already drawn on the layer (for example, “Layer 1”) is changed to the set transparency (for example, 75% transparency).

<2. Flow of display control processing in client device>
Next, the flow of display control processing (step S722) at the time of handwriting input in the client device 110 of the presenter will be described in detail. FIG. 16 is a flowchart showing the flow of processing when the setting button 1515 is pressed in the display control processing (step S722) when handwriting input is performed in the client device 110 of the presenter.

  In the presenter's client device 110, the conference application is activated and the conference screen 1100 shown in FIG. 11 is displayed, and then the document data is read from the document management server device 150, whereby the flowchart shown in FIG. 16 is executed. .

  In step S1601, it is determined whether or not the setting button 1515 has been pressed. If it is determined in step S1601 that the setting button 1515 has been pressed, the process proceeds to step S1602.

  In step S1602, it is determined whether or not a layer has been selected in the layer selection field 1531. If it is determined that no layer is selected, the process waits until a layer is selected. On the other hand, if it is determined in step S1602 that a layer has been selected, the process advances to step S1603.

  In step S1603, the selected layer is recognized as a processing target. In step S1604, it is determined which of the normal mode transition column 1533 and the marker mode transition column 1534 has been selected for the processing target layer.

  If it is determined in step S1604 that the normal mode transition field 1533 has been selected, the process advances to step S1605 to change the transparency of the processing target layer to 0%. On the other hand, if it is determined in step S1604 that the marker mode transition field 1534 has been selected, the process proceeds to step S1606, where the transparency of the processing target layer is set to the set transparency (75% in the example of FIG. 15). , 50%, or 25%).

  In step S1607, it is determined whether an operation button other than the setting button 1515 has been pressed. If it is determined in step S1607 that no operation button other than the setting button 1515 is pressed, the process returns to step S1602. On the other hand, if it is determined in step S1607 that an operation button other than the setting button 1515 has been pressed, the process ends.

Note that when the operation button other than the setting button 1515 is pressed and another operation (for example, handwriting input operation) is performed and then the setting button 1515 is pressed, the display control process illustrated in FIG. 16 is performed again. Executed.

<3. Flow of display control processing in client device>
Subsequently, the flow of processing when the handwriting input button 1514 is pressed in the display control processing (step S722) at the time of handwriting input in the client device 110 of the presenter will be described in detail. FIG. 17 is a flowchart showing the flow of processing when the handwriting input button 1514 is pressed in the display control processing (step S722) at the time of handwriting input in the client device 110 of the presenter.

  In the presenter's client device 110, the conference application is activated and the conference screen 1100 shown in FIG. 11 is displayed, and then the document data is read from the document management server device 150, whereby the flowchart shown in FIG. 17 is executed. .

  In step S1701, it is determined whether or not the handwriting input button 1514 has been pressed. If it is determined in step S1701 that the handwriting input button 1514 has been pressed, the process proceeds to step S1702.

  In step S1702, when the handwriting input button 1514 is pressed, the layer selected in the setting window 1530 is identified. In step S1703, the mode of the selected layer is identified.

  If it is determined in step S1703 that the normal mode is selected, the process proceeds to step S1704. In step S1704, drawing is performed with a transparency of 0%. Further, the processing is continued until an operation button other than the handwriting input button 1514 is pressed in step S1705.

  On the other hand, if it is determined in step S1703 that the marker mode is selected, the process proceeds to step S1706. In step S1706, drawing is performed with the set transparency (the transparency set in association with the selected layer). Further, the processing is continued until an operation button other than the handwriting input button 1514 is pressed in step S1707.

  If an operation button other than the handwriting input button 1514 (for example, the setting button 1515) is pressed and another operation (for example, setting operation) is performed, then the handwriting input button 1514 is pressed again, The display control process shown in FIG. 17 is executed.

<4. User interface when display control processing is executed>
FIG. 18 is a diagram illustrating an example of a user interface when display control processing is executed in the client device 110. In the example of FIG. 18A, the drawing 1801 and 1802 are displayed by selecting “Layer 1” for the document data displayed in the display area 1120 and inputting by handwriting in the normal mode. ing. In addition, when “Layer 2” is selected and handwritten input is performed in the normal mode, the drawing 1811 is displayed. When “Layer 3” is selected and handwritten input is performed in the normal mode, the drawing 1812 is displayed. Show.

  FIG. 18B shows a state in which the transparency of the drawing 1811 is changed by selecting “Layer 2” in the setting window 1530 from the state shown in FIG. 18A and changing to the marker mode. Yes. FIG. 18C shows a state in which the transparency of the drawing 1812 is changed by selecting “Layer 3” from the state shown in FIG. 18A and changing to the marker mode.

<5. Summary>
As is clear from the above description, in the client device (information input device) according to the present embodiment,
-When performing handwriting input, a plurality of layers whose transparency can be changed are provided and switched to draw.
In each layer, a normal mode in which the transparency of the drawn pixel is 0% and a marker mode in which the transparency of the drawn pixel is other than 0% are provided, and the drawing is performed by switching for each layer.
The input content input by handwriting in the state where the normal mode is selected is drawn with a transparency of 0% in the corresponding layer, and the input content input in handwriting in the state where the marker mode is selected is the corresponding layer In FIG. 4, the image is drawn at a transmittance other than 0%.
-In the already drawn layer, when switching to the normal mode, the transparency of the drawn drawing content is changed to 0%, and when switching to the marker mode, the drawn drawing content is transparent. It was configured to be changed to other than 0%.

  As described above, since the display mode of the input content input by handwriting is configured so that it can be displayed with different transparency, it is possible to provide an effective operation for a presenter such as a conference. As a result, user convenience is improved.

[Third Embodiment]
In the second embodiment, the transparency when switching to the marker mode in each layer is determined in advance, but the present invention is not limited to this. For example, in each layer, the transparency when the mode is switched to the marker mode may be arbitrarily set by the user. Details of this embodiment will be described below.

  FIG. 19 is a diagram illustrating an example of a conference screen 1100 that is a user interface for performing handwritten input during display control processing in the client device 110 according to the present embodiment. Here, the description will focus on differences from the user interface described with reference to FIG. 15 in the second embodiment.

  As shown in FIG. 19, the setting window 1930 is provided with a setting bar 1935 for setting the transparency when switching to the marker mode for each layer. Thereby, the presenter can set the transparency of each layer in the marker mode to a desired transparency by sliding the setting bar 1935 to an arbitrary position.

[Fourth Embodiment]
In the second and third embodiments, when any one of the marker mode and the normal mode is selected, the presenter selects the other mode and switches to the other mode. However, the present invention is not limited to this.

  For example, even when one mode is selected, it may be configured to automatically switch to the other mode as a predetermined time elapses. Details of this embodiment will be described below.

<1. User Interface on Client Device>
First, a meeting screen that is a user interface for performing handwritten input during display control processing in the client device 110 (presenter's client device 110) according to the present embodiment will be described. FIG. 20 is a diagram illustrating an example of a conference screen 1100 that is a user interface for performing handwritten input during display control processing in the client device 110 according to the present embodiment. Here, the description will focus on differences from the user interface described with reference to FIG. 15 in the second embodiment.

  As shown in FIG. 20, the setting window 2030 is provided with a time designation field 2035 for performing time designation regarding mode switching for each layer. The presenter can automatically switch the mode of the corresponding layer by setting a desired time in the time designation field 2035.

  In the example of FIG. 20, the normal mode is selected in “Layer 2”, and “10 minutes” is set in the time designation column 2035. For this reason, the drawing content (object) drawn on the layer 2 is initially displayed with a transparency of 0%, but the transparency gradually increases as time passes, and after 10 minutes, the marker mode Thus, the transparency (for example, 50%) set in (1) is reached.

  Thus, it becomes possible to reduce the operation load of a presenter by setting it as the structure which switches a mode automatically according to progress of time.

<2. Flow of display control processing in client device>
Next, of the display control process (step S722) at the time of handwriting input in the client device 110 of the presenter, the process flow when the time designation is set will be described. FIG. 21 is a flowchart showing a flow of processing when time designation is set in the display control processing (step S722) at the time of handwriting input in the client device 110 of the presenter.

  In the presenter's client device 110, the conference application is activated and the conference screen 1100 shown in FIG. 11 is displayed, and then the document data is read from the document management server device 150, whereby the flowchart shown in FIG. 21 is executed. .

  In step S2101, it is determined whether or not the time designation is set in the setting window 2030. If it is determined in step S2101 that the time designation has been set, the process proceeds to step S2102.

  In step S2102, the transparency of the marker mode set for the layer for which the time designation is set is acquired. Further, in step S2103, after calculating the difference between the transparency in the normal mode (0%) and the transparency in the marker mode, the change in transparency per unit time (transmission) is obtained by dividing by the set time. Degree of change).

  Furthermore, in step S2104, the transparency of the time-designated layer is changed with the calculated transparency change rate. When the change is completed, the mode setting in the setting window 2030 is switched in step S2105. If the marker mode is selected when the time designation is set, the transparency is changed so that the marker mode can be switched to the normal mode. Further, when the normal mode is selected when the time designation is set, the transparency is changed so that the normal mode can be switched to the marker mode.

<3. Summary>
As is apparent from the above description, in the information input device according to this embodiment, in addition to the second or third embodiment,
-A configuration that allows time specification to be set for each of multiple layers.
-When time specification is set, the transparency is changed as time passes, and the mode is automatically switched to the other mode.

  Thereby, it becomes possible to improve a user's convenience.

[Fifth Embodiment]
In the fourth embodiment, when the time designation is set, the transmittance is gradually changed until the set time elapses. However, the present invention is not limited to this. For example, the transmittance may be switched after a specified time has elapsed.

  FIG. 22 is a flowchart showing a flow of processing when time designation is set in the display control processing (step S722) in the client device 110 according to the present embodiment.

  In step S2201, it is determined whether or not the time designation is set in the setting window 2030. If it is determined in step S2201 that the time designation has been set, the process advances to step S2202.

  In step S2202, the transparency of the marker mode set for the layer for which the time designation is set is acquired. Further, in step S2203, an elapsed time after the time designation is set is determined. If it is determined that the elapsed time has reached the set time as a result of the determination, the process advances to step S2204 to switch the transparency of the time-designated layer.

  When the switching is completed, the mode setting in the setting window 2030 is switched in step S2205. If the marker mode is selected when the time designation is set, the mode is switched from the marker mode to the normal mode, and the normal mode is selected when the time designation is set. Is switched from the normal mode to the marker mode.

[Sixth Embodiment]
In the second to fifth embodiments, a plurality of objects are drawn in the same layer. However, the present invention is not limited to this. For example, a different layer may be generated for each object. Details of this embodiment will be described below.

<1. Flow of display control processing in client device>
First, the flow of processing when the handwriting input button 1514 is pressed in the display control processing (step S722) during handwriting input in the client device 110 of the presenter will be described. FIG. 23 is a flowchart showing the flow of processing when the handwriting input button 1514 is pressed in the display control processing (step S722) when handwriting input is performed in the client device 110 of the presenter.

  In the presenter's client device 110, the conference application is activated and the conference screen 1100 shown in FIG. 11 is displayed, and then the document data is read from the document management server device 150, whereby the flowchart shown in FIG. 23 is executed. . In the flowchart shown in FIG. 23, the processing from step S1701 to step S1706 is the same as the processing from step S1701 to step S1706 in the flowchart shown in FIG.

  In step S2301, it is determined whether or not the object currently being drawn is the same object as the object drawn in step S1706 (whether or not they are integral). If it is determined in step S2301 that they are the same object, drawing is continued.

  On the other hand, if it is determined in step S2301 that they are not the same object (that is, if it is determined that another object has been drawn), the process proceeds to step S2302. In step S2302, a new layer is generated, and the other object is copied to the newly generated layer.

  In this way, by adopting a configuration in which drawing is performed on different layers for each object, the transparency can be changed in units of objects.

<2. Flow of display control processing in client device>
Of the display control processing (step S722) executed in the client device 110 according to the present embodiment, the processing when the setting button 1515 is pressed has been described with reference to FIG. 16 in the second embodiment. Therefore, the description is omitted here.

  In the case of this embodiment, when a layer is selected in the layer selection field 1531, the selected layer includes the number of layers corresponding to the number of objects. For this reason, when the transparency of the selected layer is changed, the transparency is changed for all layers of the number of objects included in the selected layer.

  On the other hand, in the present embodiment, it is possible to directly select an object and change the transparency without using the setting window 1530. Therefore, in the following, a process for directly selecting an object and changing the transparency will be described.

  FIG. 24 is a user interface for explaining the flow of processing when the transparency is changed in units of objects. In the example of FIG. 24A, the drawing 1801 and 1802 are displayed by selecting “Layer 1” for the document data displayed in the display area 1120 and inputting by handwriting in the normal mode. ing. Further, the drawing 2411 and the drawing 2412 are displayed by selecting “Layer 2” and inputting by handwriting in the normal mode.

  Here, the drawing 2411 and the drawing 2412 are objects drawn by handwriting input in a state where “Layer 2” is selected. However, since the drawing 2411 and the drawing 2412 are separate objects, they are actually drawn on different layers. Has been.

  Therefore, as shown in FIG. 24B, when the presenter selects the drawing 2411, a transparency change window 2401 is displayed. When the presenter operates the setting bar in the transparency change window 2401, the transparency of the drawing 2411 can be changed.

  Similarly, as shown in FIG. 24C, when the presenter selects the drawing 2412, a transparency change window 2402 is displayed. Here, when the presenter operates the setting bar in the transparency changing window 2402, the transparency of the drawing 2412 can be changed.

  As described above, the user convenience is further improved by adopting a configuration in which the transparency can be changed in units of objects.

[Seventh Embodiment]
In the second to sixth embodiments, the configuration is divided into the normal mode and the marker mode. However, the present invention is not limited to this, and the layers may be configured based on only the transparency.

  In this case, for example, the conference screen 1100 shown in FIG. 15 in the third embodiment is as shown in FIG. Specifically, the setting window 2530 is displayed when the setting button 1515 is pressed.

  As shown in FIG. 25, the setting window 2530 is provided with a layer selection field 1531 and a layer display field 1532, and each layer displayed in the layer display field 1532 is set with a predetermined transparency. ing.

  Thereby, the user can perform handwriting input with desired transparency by selecting a desired layer in the layer selection field 1531.

  Further, for example, the conference screen 1100 shown in FIG. 19 in the fourth embodiment is as shown in FIG. Specifically, a setting window 2630 is displayed when the setting button 1515 is pressed.

  As shown in FIG. 26, the setting window 2630 is provided with a layer selection field 1531, a layer display field 1532, and a setting bar 1935. Each layer displayed in the layer display field 1532 has a setting bar 1935, respectively. The transparency set in is set.

  Thereby, the user can perform handwriting input with desired transparency with respect to the selected layer.

[Eighth Embodiment]
In the first to seventh embodiments, the case where the information input device is applied to the conference system has been described. However, the application destination of the information input device is not limited to the conference system, and can be applied to, for example, a learning support system. For example, if the questioner creates a question by painting a part of the document data such as teaching materials in the normal mode (transparency 0%), and the answerer answers the text of the blackened part, It is possible to use such that the transparency is 100% and the answer is clearly indicated.

  In the first to seventh embodiments, document data reading operation and handwriting input operation (display control processing in FIG. 16, FIG. 17, etc.) are performed in the client device 110 of the presenter. In other words, the participant's client device 110 is merely controlled to display the same display content as the conference screen of the presenter's client device 110.

  However, for example, in the learning support system, the client device 110 of the answerer may be configured to execute the transparency changing operation (a process corresponding to the display control process in FIG. 16). By making it possible to change the transparency of entered document data, for example, when an answerer answers a question created by the questioner and the answer is correct, the answerer operates his client device. This is because the answer can be confirmed by changing the transparency.

  Hereinafter, in the present embodiment, a case will be described in which the information input device is applied to the learning support system, and the client device of the answerer has the same display control function as that of the questioner.

<1. System configuration of learning support system>
FIG. 27 is a diagram illustrating an example of a system configuration of a learning support system 2700 to which the information input device according to the present embodiment is applied. As illustrated in FIG. 27, the learning support system 2700 includes one or more client devices that are information input devices according to the present embodiment.

  In FIG. 27, a client device 2710 is an information input device operated by a questioner, and client devices 2711 to 2715 are information input devices operated by an answerer. The client devices 2710 and 2711 to 2715 are configured by a PC (personal computer), a tablet terminal, a smart phone, a mobile phone, a portable information terminal such as a PDA, and the like.

  The learning support system 2700 further includes a learning support system server device 2720 and a document management server device 150. The learning support system server device 2720 is a device that performs information processing related to learning support, and the document management server device 150 is a device that performs information processing related to document management. The learning support system server device 2720 and the document management server device 150 are configured by a WS (workstation), a PC, or the like.

  In the example of FIG. 27, the learning support system server device 2720 and the document management server device 150 are configured separately, but the present invention is not limited to this. For example, the learning support system server device 2720 and the document management server device 150 may be configured as software or services that operate on one computer. Further, the learning support system server device 2720 and the document management server device 150 may be provided as software or services that operate on one or more computers. For example, the learning support system server device 2720 and the document management server device 150 can take the form of a so-called cloud service.

  The role of each device in the learning support system 2700 configured as described above will be briefly described below.

  The questioner's client device 2710 has a learning support application for questions and displays document data such as teaching materials managed by the document management server device 150, and displays input contents input by handwriting when the questions are given. To do. Also, the input document data is stored, the stored input document data is displayed, and the transparency of the drawing content (object) is changed. Further, in response to requests from the client devices 2711 to 2715 of the answerer, permission to change the transparency in a predetermined layer is output to the client device of the answerer who satisfies a predetermined condition.

  The answerer's client devices 2711 to 2715 have a learning support application for answering and display input document data. Further, the transparency changing process is executed for the layers permitted by the client apparatus 2710 of the questioner.

  The learning support system server device 2720 manages user information for identifying the user (questioner) of the client device 2710. Also, the display state of the document data in question is managed, and control is performed so that the display contents are synchronized between the client device 2710 of the questioner and the client devices 2711 to 2715 of the answerer.

  The document management server device 150 manages document information including document data such as teaching materials used in the learning support system 2700 and attribute information of the document data. Further, when handwritten input is performed on the document data, the input content including the handwritten input is stored and managed.

  When document data used in the learning support system 2700 or used input document data is stored in the document management server apparatus 150, the client apparatus 2710 of the questioner sends a communication request to the learning support system server apparatus 2720. . When the communication is established, the client device 2710 of the questioner transmits the document data to be stored or the input document data to the learning support system server device 2720. The learning support system server device 2720 transmits the document data or input document data received from the client device 2710 of the questioner to the document management server device 150 as document information together with learning information and user information. The document management server device 150 stores and manages the received document information in an appropriate location.

<2. Flow of learning support processing in the learning support system>
Next, the overall flow of learning support processing in the learning support system 2700 will be described. FIG. 28 is a sequence diagram showing the flow of the entire learning support process in the learning support system 2700.

  The questioner's client device 2710 first activates the questioning learning support application and displays a learning management screen (step S2801). When the user performs a login operation on the displayed learning management screen, a login request including user information is transmitted to the learning support system server device 2720 (step S2802).

  The learning support system server device 2720 that has received the login request searches the user information database 382 based on the user information included in the login request to authenticate the client device 2510 of the questioner (step S2803). If the authentication is successful, the learning support system server device 2720 notifies the client device 2710 of the questioner that the login is successful (step S2804).

  Subsequently, the client device 2710 of the questioner transmits event information related to the document data reading operation to the learning support system server device 2720 (step S2805).

  The learning support system server device 2720 that has received the event information related to the document data reading operation transmits a read request to the document management server device 150 (step S2806). The document management server apparatus 150 that has received the read request searches the requested document information (step S2807), and transmits the document information to the learning support system server apparatus 2720 (step S2808). Upon receiving the document information, the learning support system server device 2720 transmits the document data included in the document information to the client device 2710 of the questioner (step S2808).

  The client device 110 of the questioner who has received the document data executes the display control process shown in FIG. 16 or 17 (step S2809). Thereby, a part of the received document data can be painted black by handwriting input.

  Through the display control process, the input content input by handwriting is transmitted to the learning support system server device 2720 as input document data in association with the document data (step S2810).

  The learning support system server device 2720 that has received the input document data generates document information based on the input document data, the learning information, and the user information, and transmits the document information to the document management server device 150 (step S2811). The document management server device 150 stores the received document information (including input document data) in the document information database 383 (step S2812).

  This completes the preparation for the questions. In the learning support system 2700, in the display control processing in step S2809, the display content of the client device 2710 of the questioner and the display content of the client devices 2711 to 2715 of the answerer are not synchronized.

  Next, processing for giving questions will be described. The questioner's client device 2710 activates the questioning learning support application and displays a learning screen (step S2813). It is assumed that the learning screen has the same function as the conference screen described above.

  When the user performs a login operation on the displayed learning screen, a login request including user information is transmitted to the learning support system server device 2720 (step S2814).

  The learning support system server device 2720 that has received the login request authenticates the client device 2710 of the questioner by searching the user information database 382 based on the user information included in the login request (step S2815). If the authentication is successful, the learning support system server device 2720 notifies the client device 2710 of the questioner that the login is successful (step S2816). In response to this, the connection from the client device 2711 of the solver becomes possible. Therefore, the answerer's client devices 2711 to 2715 activate the answering learning application, connect to the learning support system server device 2720, and display a learning screen (step S2817).

  On the other hand, the questioner's client device 2710 performs an operation of reading input document data, and transmits event information related to the operation of reading input document data to the learning support system server device 2720 (step S2818).

  The learning support system server device 2720 that has received the event information related to the read operation of the input document data transmits a read request to the document management server device 150 (step S2819). Upon receiving the read request, the document management server device 150 searches the document information database 383 for document information including the input document data (step S2820) and transmits it to the learning support system server device 2720 (step S2821).

  The learning support system server device 2720 that has received the document information transmits the input document data included in the document information to the client device 2710 of the questioner and the client devices 2711 to 2715 of the answerer (steps S2822, S2823). The client device 2710 of the questioner who has received the input document data and the client devices 2711 to 2715 of the answerer display the input document data on their respective learning screens (steps S2824 and 2825).

  Here, it is assumed that a transparency change permission request is input in any one of the client devices 2711 to 2715 (here, the client device 2711 of the answerer) of the answerer (step S2826).

  The input transparency change permission request is transmitted to the learning support system server device 2720 (step S2827), and further transmitted to the client device 2710 of the questioner (step S2828).

  Upon receiving the request for permission to change transparency, the client device 2710 of the questioner identifies the client device of the requester (client device 2711 of the answerer), and determines whether or not to allow the change of transparency (step S2829).

  As a result of the determination, when it is determined that the client device 2711 of the answerer is a device whose transparency may be changed, the client device 2710 of the questioner sends a permission notice to the client device 2711 of the answerer. Transmit (step S2830). Note that the permission notification transmitted at this time includes information specifying input document data for which change of transparency is permitted, information specifying a page, and information specifying a layer name.

  FIG. 29 is a diagram illustrating an example of a data structure 2900 of a permission notification that defines whether or not to change the transparency. As shown in FIG. 29, the permission notification describes permission / denial of changing the transparency for each answerer (for each client device), for each page, and for each layer.

  Returning to FIG. The learning support system server device 2720 that has received the permission notification transmits the permission notification to the client device of the designated answerer (here, the client device 2711 of the answerer) (step S2831).

  The client device 2711 of the answerer who has received the permission notification analyzes the permission notification and identifies the page and layer name for which the change in transparency is permitted (step S2832).

  Thereafter, the client device 2711 of the answerer monitors whether or not the page of the input document data displayed on the learning screen is the page specified in the permission notification. Further, when there is a request for changing the transparency, it is determined whether or not the layer in which the requested object is drawn is the layer specified in the permission notification.

  If it is determined that the page of the input document data specified in the permission notification is the layer specified in the permission notification, the display control process shown in FIG. 16 is executed (step S2833).

  On the other hand, if it is not the page of the input document data specified in the permission notification, or if it is determined that it is not the layer specified in the permission notification, the display control process shown in FIG. 16 is not executed.

  As described above, in the display control process when the input data is displayed in the learning support system 2700, the display contents of the questioner's client device 2710 and the display contents of the answerer's client devices 2711 to 2715 are the input document. Synchronize until data is displayed. However, after the input document data is displayed and the transparency change permission request is transmitted from the client device 2711 to 2715 of the answerer, the transparency change process is performed in the client device 2711 to 2715 of the answerer. A client device that can be executed results. For this reason, the display content of the client device 2710 of the questioner and the display content of the client devices 2711 to 2715 of the answerer are not synchronized.

<3. Summary>
As is clear from the above description, in the information input device according to the present embodiment, when applied to the learning support system, in addition to the first embodiment,
-It was configured so that the transparency change request can be made from the client device of the answerer.
When the transparency change request is transmitted from the answerer's client device, the questioner's client device determines whether or not the request is permitted.
-When transmitting a permission notice to the client device of the answerer, the page name and the layer name of the input document data are specified and transmitted.
The client device of the answerer who has received the permission notice is configured to accept a change instruction of transparency from the user for the page and layer of the specified input document data.

  As a result, the answerer's client device can also change the transparency. For example, when the answerer correctly answers, the correct answer is confirmed by changing the transparency of the answering part. It becomes possible to realize the usage method. As a result, user convenience is improved.

[Ninth Embodiment]
In the first to eighth embodiments, the information input device has been described as including the document layer 910, the first layer 920, and the second layer 930. However, the present invention is not limited to this. When the second layer 930 is a layer whose transparency can be changed, it is sufficient that at least the document layer 910 and the second layer 930 are included.

  In the second to eighth embodiments, an arbitrary transparency can be set via the setting window 1530. However, the present invention is not limited to this. For example, you may comprise so that the color of the object drawn based on handwritten input, the brightness, etc. can be selected in addition to transparency.

  Further, in the eighth embodiment, the display mode of the object whose transparency can be changed by being permitted by the permission notification, and the object that is not permitted by the permission notification and whose transparency cannot be changed. Although the display mode is the same, the present invention is not limited to this. For example, it may be configured to display in a display mode different from the display mode of the object whose transparency cannot be changed so that an object whose transparency can be changed can be seen.

  In the eighth embodiment, the answerer changes the transparency in the setting window 1530. However, the present invention is not limited to this. For example, it may be configured to automatically change to a predetermined transparency when a permission notification is received.

  Further, in the eighth embodiment, the change permission / rejection is defined for each page and for each layer. However, the present invention is not limited to this, and all pages and all layers for a specific answerer. It is good also as a structure which transmits the permission notification which permits the change of transparency.

  It should be noted that the present invention is not limited to the configuration shown here, such as a combination with other elements in the configuration described in the above embodiment. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form.

100: Conference system 110: Information input device (client device)
120, 130: Display device 140: Conference system server device 150: Document management server device 160: Network 910: Document layer 920: First layer 930: Second layer 1001, 1002: Display surface 1100: Conference screen 1110: Input Operation area 1111: Share button 1112: Non-share button 1113: File read button 1114: Normal input button 1115: Marker input button 1116: Delete button 1117, 1118: Arrow button 1120: Display area 1200: Table 1514: Handwritten input button 1515: Setting button 1530: Setting window 1930: Setting window 2030: Setting window 2401, 2402: Transparency change window 2530: Setting window 2630: Setting window 2700: Learning Learning support system 2710: Information input device (client device of the questioner)
2711 to 2715: Information input device (solver client device)
2720: Learning support system server device

JP 2007-110453 A JP 2012-103593 A

Claims (10)

When a coordinate input is instructed on a display surface on which electronic data is displayed, drawing means for drawing on a layer based on the instructed input;
Display control means for controlling the display of the display surface so that the drawing content drawn on the layer is displayed superimposed on the electronic data;
The information input device, wherein the display control means is capable of displaying the drawing content with a plurality of different transmissivities.   The information input device according to claim 1, wherein the drawing unit draws on two or more layers having different transparency.   The information input device according to claim 1, wherein the drawing unit draws on a layer whose transparency can be changed.   The information input device according to claim 3, wherein the display control unit displays the drawing contents drawn on the layer while changing the transparency according to a set time.   The information input device according to claim 3, wherein the drawing unit draws on a different layer for each object based on the instructed input.   The information input device according to claim 1, wherein the drawing unit draws on a different layer for each page of the electronic data.   When the permission to change the transparency receives information defined for each layer of each page of the electronic data, the display control means sets the transparency for the layers that are allowed to be changed in the received information. The information input device according to claim 6, wherein the information input device is changed. In the computer of the information input device,
A drawing process of drawing on a layer based on the designated input when an input of coordinates is instructed on a display surface on which electronic data is displayed;
A display control step of controlling the display of the display surface so that the drawing content drawn on the layer is displayed superimposed on the electronic data,
The display control step can display the drawing content with a plurality of different transmissivities. An information input system in which a plurality of information input devices and a server device are connected,
Each of the plurality of information input devices includes:
When a coordinate input is instructed on a display surface on which electronic data is displayed, drawing means for drawing on a layer based on the instructed input;
Display control means for controlling the display of the display surface so that the drawing content drawn on the layer is displayed superimposed on the electronic data;
The display control means can display the drawing content with a plurality of different transparency,
The server device
First transmission means for transmitting the electronic data to the plurality of information input devices in response to a request from one information input device of the plurality of information input devices;
An information input system comprising: a second transmission unit configured to transmit event information generated based on an instruction to one information input device among the plurality of information input devices to another information input device. . A drawing process of drawing on a layer based on the designated input when an input of coordinates is instructed on a display surface on which electronic data is displayed;
A display control step for controlling display of the display surface so that the drawing content drawn on the layer is displayed superimposed on the electronic data,
The information input method characterized in that the display control step can display the drawing content with a plurality of different transmissivities.