JP2013076721A - Computer device, electronic pen system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a computer device, a server device and a program capable of sharing electronic contents which are reproduced or displayed in conjunction with operation to a teaching material.SOLUTION: A computer device connected with a server device which manages electronic contents comprises: association means which associates a designated area of a teaching material and electronic contents reproduced or displayed when the designated area is selected, with conditions of reproduction or display of the electronic contents; and upload means which uploads information showing the designated area associated by the association means, the electronic contents, and the conditions of reproduction or display, to the server device.

Description

  The present invention relates to a technique using a coding pattern readable by an electronic pen.

  2. Description of the Related Art Conventionally, electronic pens that digitize written information have been developed, and “Anot pen” developed by Swedish company Anoto is known as a representative one. For example, as described in Patent Document 1, the anotopen reads a predetermined dot pattern printed on a sheet, generates entry information, and transmits the entry information to the terminal device.

  Patent Document 2 describes a rotation correction processing function that corrects an arrangement of dots on an image caused by an angle of an electronic pen facing a dot pattern. Further, Patent Document 3 has a teaching material server that stores teaching material data distributed from a distribution server in which teaching material data used in classes is stored in association with a teaching plan, and teaches teaching material data stored in the teaching material server. A class support system including a classroom terminal and a large screen for displaying along the progress of a class based on a plan is disclosed. Further, in Patent Document 4, appropriate content is acquired by accessing content servers of a plurality of content providers via the Internet from information terminals of users who participate in educational sites such as teachers, students, and students. An electronic teaching material sharing method using contents as teaching materials is disclosed. Further, Patent Document 5 discloses a technique for downloading teaching material contents from a server via the Internet or the like and displaying them on an electronic blackboard or the like for use in classes or the like.

  Further, in Patent Document 6, an RFID tag storing a code is embedded in an arbitrary page of the learning material, and the learning material content is searched from the computer by reading the code of the RFID tag, and the learning material content is searched from the projector to the screen. A technique for projecting an image of the above is disclosed. Patent Document 7 discloses a technique for associating a dot pattern of an icon printed on paper with content data. Patent Document 8 discloses a teaching material distribution system in which contents of teaching materials are uploaded to a server and other teachers can download and use the teaching materials. In this teaching material distribution system, when a digital teaching material icon is clicked, a list of explanations as teaching material contents is displayed. In this list display, the list is displayed in descending order of evaluation, the comment of the teaching material creator and the number of downloads are displayed, and the user's evaluation can also be input.

Japanese Patent No. 3874498 Special table 2003-529853 gazette JP 2002-072850 A JP 2004-226659 A JP 2004-258184 A JP 2004-012539 A Japanese Patent No. 3956026 JP 2001-242777 A

  When a lecturer taps a predetermined drawing part of an open textbook (educational material) with an electronic pen etc. during a class, etc., the electronic content such as a video related to the tapped part is played back or displayed to students. It is convenient to be able to watch. At this time, it is troublesome for each instructor to individually produce or obtain electronic contents to be reproduced or displayed. SUMMARY OF THE INVENTION Accordingly, it is a main object of the present invention to provide a computer device, a server device, and a program that can share electronic content to be played back or displayed in conjunction with an operation on a teaching material.

  A computer device according to the present invention is a computer device connected to a server device that manages electronic content, and includes a designated area for teaching materials, electronic content to be played back or displayed when the designated area is selected, and the electronic content An associating means for associating the reproduction or display condition, information indicating the designated area associated by the associating means, the electronic content, and an upload means for uploading the reproduction or display condition to the server device. Prepare.

  With this configuration, the computer apparatus associates and associates the designated area of the teaching material, the electronic content to be reproduced or displayed when the designated area is selected, and the reproduction or display condition (reproduction display condition) of the electronic content. Such information is uploaded to the server device. In this way, other computer devices that can be connected to the server device receive these pieces of information from the server device, so that the electronic content is determined in association with the designated area of the teaching material without the need for setting. It is possible to reproduce or display according to the reproduced reproduction display conditions. Therefore, according to this aspect, it is possible to preferably share electronic contents between lecturers.

  In one aspect of the above computer apparatus, the upload unit includes information indicating the designated area on a setting screen for setting the electronic content to be associated with the designated area and the reproduction or display condition of the electronic content. An input field is provided for selecting whether to upload the electronic content and the reproduction display condition to the server device. According to this aspect, the computer apparatus 3 can select whether or not to upload such information when associating the designated area, the electronic content, and the reproduction display condition, and can smoothly perform the upload.

  In another aspect of the above computer apparatus, the computer further includes an area designation receiving unit that displays an electronic teaching material obtained by digitizing the teaching material on a display unit, and receives an input for designating an arbitrary area from a display portion of the electronic teaching material, The association means associates a designated area designated based on the input, electronic content related to the contents of the electronic teaching material, and playback or display conditions of the electronic content. According to this aspect, the computer apparatus can display the electronic teaching material and allow the operator to designate an arbitrary range as a designated area associated with the electronic content.

  In another aspect of the computer device, when it is determined that the designated area is selected, the electronic content associated with the designated area is reproduced on the display unit and / or the audio output unit according to the reproduction or display condition. Alternatively, a playback display control means for displaying is further provided. According to this aspect, the computer device can preferably reproduce or display the electronic content according to the designated reproduction display condition in conjunction with the operation to the designated area.

  A server device according to the present invention is a server device that transmits information including designated electronic content to a computer device, the information indicating a designated area designated in a teaching material, and associated with the designated area Storage means for storing electronic content, content-related information related to the electronic content, and display means for displaying the electronic teaching material including the designated area on the display means of the computer device, and electronic content associated with the designated area Display control means for displaying the content related information in association with the designated area, and after the display portion of the content related information is selected, information including the electronic content indicated by the content related information is transmitted to the computer device Transmission control means.

  According to this aspect, the server device stores information indicating the designated area designated in the teaching material, electronic content associated with the designated area, and content-related information associated with the electronic content, and stores the information in the computer device. On the other hand, the electronic teaching material including the designated area is displayed, and the content related information of the electronic content associated with the designated area is displayed in association with the designated area. Then, after the display portion of the content related information is selected, the server device transmits information including the electronic content indicated by the content related information to the computer device. In this way, the server device displays the electronic teaching material while displaying the content-related information of the electronic content associated with the designated area of the electronic teaching material in association with the designated area. It is possible to easily select whether to download the content.

  In one aspect of the server device, the storage unit further stores a reproduction or display condition of the electronic content in association with the stored electronic content, and the transmission control unit uses the electronic content as information including the electronic content. The content, the information indicating the designated area associated with the electronic content, and the playback or display conditions for the electronic content are transmitted to the computer device. In this way, the server device can cause the computer device to download information on the designated area and reproduction display conditions suitable for reproducing or displaying the electronic content in addition to the electronic content.

  In another aspect of the server device, the display control unit, when a display portion of the content related information is selected, in addition to the electronic content indicated by the content related information, the display related to the electronic content A download screen for selecting whether to further download the information indicating the designated area and the reproduction or display conditions of the electronic content is displayed on the display means of the computer device. According to this aspect, in addition to the electronic content, the server device can cause the computer device to download information on a designated area suitable for reproducing or displaying the electronic content and reproduction display conditions as necessary.

  In another aspect of the server apparatus, the display control means includes, as content-related information of the electronic content, at least the number of downloads of the electronic content and an evaluation by a person who downloaded or / and viewed the electronic content. It is displayed on the display means of the computer device. According to this aspect, the server device can provide useful information when the operator of the computer device selects electronic content to be downloaded.

  In another aspect of the server device, the display control unit associates electronic contents associated with the plurality of designated areas with one designated area when the plurality of designated areas overlap a predetermined ratio or more. The content related information of the electronic content associated with the plurality of designated areas is displayed in association with the one designated area. By doing in this way, the server apparatus can suppress that a display becomes complicated.

  In another aspect of the server device, the display control unit displays the content related information of the electronic content to be displayed in association with the one designated area in the descending order of the number of downloads of the electronic content. The electronic contents are displayed side by side from the top in descending order of evaluation. Accordingly, the server device can be arranged at a position where the content related information of the popular electronic content is more easily selected, and the convenience can be improved.

  In another aspect of the server device according to the present invention, the server device transmits information including the designated electronic content to the computer device, and it is recommended that the electronic content be associated with the electronic content in the teaching material. Storage means for associating and storing information indicating a designated area and a recommended reproduction or display condition of the electronic content, and the designated area associated with the electronic content in addition to the electronic content designated by the computer device Display control means for causing the display means of the computer device to display a download screen for selecting whether or not to download the information indicated by the information and the playback or display conditions, and the electronic content and the download screen Information selected by the user is stored in the computer. And a transmission control means for transmitting to the device.

  The server device stores the electronic content, information indicating a designated area recommended to be associated with the electronic content in the teaching material, and the recommended reproduction or display condition of the electronic content in association with each other, and the computer device In addition to the designated electronic content, a download screen for selecting whether or not to download the information of the designated area associated with the electronic content and the reproduction or display conditions is displayed on the computer device. Then, the server device transmits the electronic content and the information selected to be downloaded on the download screen to the computer device. According to this aspect, in addition to the electronic content, the server device can cause the computer device to download information on a designated area suitable for reproducing or displaying the electronic content and reproduction display conditions as necessary.

  In one aspect of the server device, the display control unit provides a playback display area for playing or displaying electronic content to be downloaded on the download screen, and for inputting an evaluation of the electronic content. An evaluation input field is provided on the download screen. By doing so, the server device can allow the user of the computer device to view the target electronic content before downloading, and can input the evaluation of the electronic content based on the viewing result.

  In one aspect of the server apparatus, the display control unit displays the history of evaluation input in the evaluation input field on the download screen. As a result, the server device can provide information for reference to the operator of the computer device when deciding whether or not to download the electronic content.

  In another aspect of the server apparatus, the display control unit is written when the electronic content to be downloaded is an electronic document including print information of an encoded pattern, when the electronic content is used. Information on the number of strokes is displayed on the download screen. “Information about the number of strokes” means, for example, when the target electronic document is used in a class, the average number, minimum value, and the number of strokes that each student wrote on the print sheet of the electronic document with the electronic pen, Or the maximum value is applicable. Also according to this aspect, the server device can provide information for reference to the operator of the computer device when deciding whether or not to download the electronic content.

  A program according to the present invention is a program that is installed and executed in a computer device connected to a server device that manages electronic content, and when a designated area designated in a teaching material and the designated area are selected Associating means for associating electronic content to be reproduced or displayed with reproduction or display conditions of the electronic content, information indicating the designated area associated by the associating means, the electronic content, and the reproduction or display conditions The computer device is caused to function as upload means for uploading to the server device.

  In one aspect of the program, the upload unit includes information indicating the designated area on a setting screen for setting electronic content to be associated with the designated area and a reproduction or display condition of the electronic content. An input field is provided for selecting whether to upload the electronic content and the playback or display condition to the server device.

  In another aspect of the program, the computer apparatus is used as an area designation receiving unit that displays an electronic teaching material obtained by digitizing the teaching material on a display unit and receives an input for designating an arbitrary area from a display portion of the electronic teaching material. Further, the association means associates the designated area designated based on the input, the electronic content related to the content of the electronic teaching material, and the reproduction or display condition of the electronic content.

  In another aspect of the above program, when it is determined that the designated area has been selected, the electronic content associated with the designated area is reproduced or displayed on the display means or / and the audio output means according to the reproduction or display condition. The computer apparatus is further caused to function as reproduction display control means for display.

  In another aspect of the program according to the present invention, the information including the designated electronic content is transmitted to the computer device, the information indicating the designated area designated in the teaching material, and the electronic content associated with the designated area And a program that is mounted on and executed by a server device that includes a storage unit that stores content-related information related to the electronic content, and causes the display unit of the computer device to display the electronic teaching material including the designated area In addition, after the display control means for displaying the content related information of the electronic content associated with the designated area in association with the designated area and the display portion of the content related information are selected, the content related information indicates Transmission control means for transmitting information including electronic content to the computer device It said to function server with.

  In one aspect of the program, the storage unit further stores a reproduction or display condition of the electronic content in association with the stored electronic content, and the transmission control unit uses the electronic content as information including the electronic content. And information indicating the designated area associated with the electronic content and the playback or display conditions of the electronic content are transmitted to the computer device.

  In another aspect of the program, the storage unit stores reproduction or display conditions of the electronic content in association with the stored electronic content, and the display control unit selects a display portion of the content-related information. In this case, in addition to the electronic content indicated by the content-related information, information indicating the designated area associated with the electronic content and whether to further download or display conditions for the electronic content are selected. Download screen is displayed on the display means of the computer device.

  In another aspect of the above program, the display control means includes, as content-related information of the electronic content, at least the number of downloads of the electronic content and an evaluation by a person who downloaded or / and viewed the electronic content. It is displayed on the display means of the computer device.

  In another aspect of the program, the display control unit associates electronic contents associated with the plurality of designated areas with one designated area when the plurality of designated areas overlap a predetermined ratio or more. The content related information of the electronic content associated with the plurality of designated areas is displayed in association with the one designated area.

  In another aspect of the program, the display control unit displays the content related information of the electronic content to be displayed in association with the one designated area in the descending order of the number of downloads of the electronic content. The electronic contents are displayed side by side from the top in descending order of evaluation.

  In another aspect of the above program, the information including the designated electronic content is transmitted to the computer device, and the electronic content and the information indicating the designated area recommended to be associated with the electronic content in the teaching material, A program installed and executed in a server device comprising storage means for storing the electronic content recommended playback or display conditions in association with the electronic content, in addition to the electronic content designated by the computer device. Display control means for displaying on the display means of the computer device the display screen for selecting whether to download the information indicated by the designated area and the reproduction or display conditions, respectively, the electronic content, There is no choice to download on the download screen. And information, to function the server apparatus as a transmission control means for transmitting to the computer device.

  In another aspect of the above program, the display control unit provides a playback display area for playing or displaying electronic content to be downloaded on the download screen, and inputs an evaluation of the electronic content. Is provided on the download screen.

  In another aspect of the above program, the display control means causes the history of evaluation input in the evaluation input field to be displayed on the download screen.

  In another aspect of the program described above, the display control means, when the electronic content to be downloaded is an electronic document including print information of a coded pattern, the stroke written when the electronic content is used Information about the number is displayed on the download screen.

  The computer apparatus according to the present invention can be configured by installing and functioning these programs in the computer apparatus.

  According to the present invention, the computer device associates the designated area of the teaching material, the electronic content to be reproduced or displayed when the designated area is selected, and the reproduction or display condition of the electronic content, Upload the information to the server device. By doing so, the computer device can upload the electronic content held by itself to the server device together with information on the area of the teaching material recommended to be associated with the electronic content and the reproduction display condition. Therefore, according to this aspect, each instructor can preferably share electronic contents.

1 shows a configuration of an electronic pen system according to an embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is a display example of an area designation screen. It is a display example of an association content setting screen. Indicates the data structure of the specified area definition information. A top view of the textbook in the spread state is shown. A display example of the file “worksheet.pdf” is shown. It is a display example of a textbook selection screen. It is a display example of a content selection screen. It is an example of a display of a 1st download screen. It is an example of a display of a 2nd download screen.

  Hereinafter, preferred embodiments for carrying out the present invention will be described with reference to the drawings. The electronic pen system described below is preferably used for school lessons, etc., and associates an arbitrary range of textbooks (teaching materials) with electronic contents such as videos and their playback or display conditions, and by operating the electronic pen. A system for playing back or displaying electronic content.

[Configuration of electronic pen system]
FIG. 1 shows a configuration of an electronic pen system according to the present embodiment. As shown in FIG. 1, the electronic pen system receives an electronic pen 1 used by a teacher, a textbook (teaching material) 2 in which a dot pattern is printed on almost the entire surface of each page, and entry information from the electronic pen 1. A computer device 3 for processing, a projector 4 that is connected to the computer device 3 and projects the same image as the display screen of the display onto the dot screen 5, a dot screen 5 on which a dot pattern is printed, the computer device 3 and the Internet And a server 8 connected via a network such as a LAN (Local Area Network). Hereinafter, each of these components will be described.

(textbook)
First, the textbook (electronic pen book) 2 will be described. On each page of the textbook 2, a dot pattern (coding pattern) indicating position coordinates described later is printed on substantially the entire surface. In addition, a dot pattern in a different coordinate range is printed on each page of the textbook 2. The dot pattern is printed with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and other characters and drawings are printed with ink that does not absorb infrared rays.

(Dot screen)
In the dot screen 5, a dot pattern (coded pattern) is printed on a white resin substrate with ink containing carbon that absorbs infrared rays so that the electronic pen 1 can read it. It has a layer structure protected by a resin layer or the like.

(projector)
The projector 4 is a projector that emits light obliquely downward from a vertically upward direction with respect to the dot screen 5, and is installed on, for example, a classroom wall. The projector 4 receives an image signal from the computer apparatus 3 and projects light constituting the same image as the screen of the computer apparatus 3 onto a predetermined projection range 50. In the projection range 50, as will be described later, an electronic textbook 2A (see FIG. 6 described later) obtained by digitizing the textbook 2 is displayed. The projector 4 may be a front projector that emits light toward the front of the dot screen 5 or a rear projector that emits light toward the back of the dot screen 5.

(Dot pattern)
Next, an Anoto dot pattern (coded pattern) printed on each page of the textbook 2 and the dot screen 5 will be described with reference to FIGS. FIG. 2 is a diagram for explaining the relationship between dots of a dot pattern and values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on each page of the textbook 2 and the dot screen 5 are determined by the combination of information thus associated. In addition, a dot pattern is formed so that a coordinate area does not overlap between the pages of the textbook 2 or each page of the textbook 2 and the dot screen 5.

  FIG. 3A shows an arrangement of a certain dot pattern. As shown in FIG. 3 (a), 6 × 6 dots within a range of about 2mm in length and width are unique patterns regardless of which portion of each page of textbook 2 or dot screen 5 takes 6 × 6 dots. It is arranged to become. The dot pattern formed by these 36 dots holds the position coordinates (for example, the position of the dot pattern on each page of the textbook 2 or the dot screen 5). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. 4, the electronic pen 1 includes an ink cartridge 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the ink cartridge 104 is a pen tip portion 103, and the user brings the pen tip portion 103 of the electronic pen 1 into contact with each page of the textbook 2 and the dot screen 5 to make a stroke (handwriting stroke). Fill out. Here, the first contact of the pen tip portion 103 of the electronic pen 1 with each page of the textbook 2 is referred to as “pen down”, and the pen tip portion 103 moves away from the contact (contact) state. Is called “pen-up”. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the ink cartridge 104 from the pen tip portion 103 when the user writes or taps characters or marks on each page of the textbook 2 with the electronic pen 1, that is, writing pressure, The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like on each page of the textbook 2 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108. Determines that the user has started entry, and activates the LED 105 and the CMOS camera 106. Then, the communication unit 111 detects pen down information (hereinafter referred to as “pen down information PD”) detected by the pressure sensor 107 and identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later. Are transmitted to the computer apparatus 3 as entry information. When the user finishes entering one stroke and moves the electronic pen 1 away from each page of the textbook 2, the pressure sensor 107 detects pen-up because the writing pressure exceeding a predetermined value is not detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 (hereinafter referred to as “pen-up information PU”) and the pen ID, and transmits the information as entry information to the computer apparatus 3.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on each page of the textbook 2. The region is slightly shifted from the position where the pen tip portion 103 contacts each page of the textbook 2. The CMOS camera 106 is provided with an infrared transmission filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105, and the image data of the dot pattern is captured. This is supplied to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Therefore, even when characters, drawings, and the like are printed on each page of the textbook 2, the printed ink does not absorb in the infrared region, so the processor 108 can recognize the dot pattern. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  The processor 108 performs X and Y coordinates (hereinafter simply referred to as “X” and “Y” coordinates in each page of the textbook 2 of the stroke (handwriting) to be filled in from the dot pattern of the image data supplied by the CMOS camera 106 while the user is filling in. (Also called “coordinate data” or “coordinate information”) is continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 106 into the data array shown in FIG. The data is converted into a Y coordinate bit value, and X and Y coordinate data are calculated from the data array by a predetermined calculation method. The processor 108 has a rotation correction processing function that corrects the arrangement of dots on the image due to the angle of the electronic pen 1 facing the dot pattern, and this function is exhibited during coordinate calculation. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. In addition, since the 6 × 6 dot pattern in each page of the textbook 2 and the dot screen 5 does not overlap in each page of the textbook 2 and the dot screen 5, when the user enters characters or the like with the electronic pen 1, It can be specified by coordinate calculation by the processor 108 which position on the page of the textbook 2 or the position of the dot screen 5 the entered position corresponds to.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. In the case of the electronic pen 1B for reading and writing the dot pattern on the dot screen 5, the communication unit 111 receives the pen ID, time information (time stamp), writing pressure data, and X and Y coordinate data. In association therewith, it is transmitted to the computer apparatus 3 as entry information. In this case, transmission to the computer apparatus 3 by the communication unit 111 is immediately and sequentially performed by wireless transmission such as Bluetooth (registered trademark). Here, one or more pieces of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the computer device 3 are stored as stroke information by the computer device 3. In other words, one stroke is composed of one or a plurality of X and Y coordinates (coordinate points), and the computer apparatus 3 is configured by one or more composing one stroke by the pen-down information PD and the pen-up information PU. Recognize pieces of coordinate attribute information.

(Computer device)
Next, the computer apparatus 3 will be described. The computer device 3 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse, a keyboard, and the like. The computer apparatus 3 may be configured by a tablet PC such as iPad (registered trademark), a PDA (Personal Data Assistance), a PC (personal computer) equipped with a display, or the like.

  FIG. 5 is a functional block diagram of the computer apparatus 3. Functionally, the computer device 3 includes a first communication unit 30, an input unit 31 such as a mouse and a keyboard, a second communication unit 32, a storage unit 33, a processing unit 34, a display unit 36, and an interface 38. The first communication means 30 communicates with the server 8 via a network, and exchanges information such as electronic contents. The second communication unit 32 includes an antenna receiving circuit and the like, receives entry information from the electronic pen 1, and transmits the received information to the processing unit 34. The display means 36 is constituted by a display or the like, and displays the contents instructed by the processing means 34. The interface 38 is an interface for connecting to the projector 4. The interface 38 transmits an image signal for displaying an image on the display unit 36 to the projector 4 based on a processing command of the processing unit 34, and projects the same image as the image on the display unit 36 in synchronization.

  The processing means 34 is constituted by a processor such as a CPU and controls the entire computer device 3. The processing unit 34 includes an area designation receiving unit 341, an association unit 342, a reproduction display control unit 343, an upload unit 344, and a download unit 345. The area designation receiving means 341 is a screen displaying an electronic textbook 2A in which the textbook 2 is digitized, and a screen for specifying an arbitrary area (range) to be associated with electronic content from the displayed electronic textbook 2A (“ Is also displayed on the display means 36. Then, the area designation receiving means 341 causes the instructor who is the operator to designate an area associated with the electronic content from the displayed electronic textbook 2A by dragging the mouse on the area designation screen. The area on the electronic textbook 2A (textbook 2) designated on the area designation screen is also referred to as “designated area As”. Details of the area designation screen will be described later with reference to FIG.

  Next, the associating unit 342 of the processing unit 34 sets the electronic content to be associated with the designated designated area As and the condition for reproducing or displaying (reproducing and displaying) the electronic content (also referred to as “reproduction display condition”). A screen for designating (also referred to as “association content setting screen”) is displayed on the display means 36. Then, the association unit 342 associates the designated area As, the electronic content, and the reproduction display condition with each other and stores them in the storage unit 33 based on the input on the association content setting screen. The association content setting screen is an example of the “setting screen” in the present invention, and details thereof will be described later with reference to FIG.

  Further, the reproduction display control means 343 of the processing means 34 is configured such that the designated area As in the page of the textbook 2 is tapped with the electronic pen 1 or the designated area As of the electronic textbook 2A projected on the dot screen 5 is electronic. When tapped by the pen 1, it is recognized that the designated area As is designated by the electronic pen 1 based on the entry information received from the electronic pen 1. The reproduction display control unit 343 displays the electronic content associated with the designated area As designated on the display unit 36 according to the associated reproduction display condition. This specific process will be described in detail in the [Association Utilization Process] section.

  In addition, the upload unit 344 of the processing unit 34 causes the user to select whether or not to upload the electronic content and the reproduction display condition associated with the designated area As on the association content setting screen. Then, the upload unit 344 uploads the electronic content selected to be uploaded and the playback display condition to the server 8 together with information indicating the designated area As associated with the electronic content. This specific process will be described in detail in the [Upload process] section.

  Furthermore, the download means 345 of the processing means 34 is based on various screens for downloading the electronic content held by the server 8 and the playback display conditions associated therewith based on the screen generation information such as an HTML document supplied from the server 8. A screen is displayed on the display means 36. Then, the download unit 345 downloads the designated electronic content or the like from the server 8 based on the input by the input unit 31. This will be explained in detail in the [Download Processing] section.

  Further, the processing unit 34 causes the projector 4 to project the calibration mark onto the dot screen 5 by displaying at least two or more calibration marks on the display unit 36, and the calibration mark is projected. The coordinate conversion function for converting the coordinate system related to the dot pattern of the dot screen 5 to the coordinate system related to the display of the display means 36 by causing the electronic pen 1 to read the dot pattern at the determined position and receiving the entry information. Obtain (calibration processing function). Further, when the processing unit 34 receives the coordinate system data related to the dot pattern of the dot screen 5 using the coordinate conversion function obtained by the calibration process, the processing unit 34 displays the coordinate system applied to the display of the display unit 36. The data is converted into data, and strokes are drawn or predetermined processing is performed.

  The storage means 33 is configured by a memory such as a ROM or a RAM. The storage unit 33 stores the entry information received from the electronic pen 1 for each pen ID according to the processing instruction of the processing unit 34. Further, the storage means 33 stores, for each type of textbook 2, information on the coordinate range indicated by the dot pattern corresponding to each page of the textbook 2 and the coordinate range indicated by the dot pattern corresponding to the dot screen 5 (“coordinate definition information”). Also called).

  Furthermore, the storage means 33 stores electronic contents to be associated with the designated area As in advance. This electronic content includes video data generated as a result of the lecturer taking a picture using a photographing means such as a video camera for the class. The storage means 33 is identification information of the textbook 2 corresponding to the designated area As for each designated area As based on the control of the area designation receiving means 341 when the designated area As is designated on the area designation screen. The textbook ID, the page number in which the designated area As is written, and the in-page position indicating the relative position in the page in which the designated area As is written are stored in association with each other. Hereinafter, the textbook ID, the page number, and the position in the page, which are information necessary for specifying the designated area As, are also referred to as “designated area specifying information”. Further, when the electronic content to be associated with the designated area As and the reproduction / display conditions thereof are determined, the storage unit 33 determines the electronic content and reproduction / display that are determined for each designated area As based on the control of the association unit 342. Associate and store conditions. Hereinafter, the information indicating the correspondence between the specified area specifying information, the electronic content, and the reproduction / display conditions associated with each specified area As is also referred to as “specified area definition information”. The data structure of the designated area definition information will be described later with reference to FIG.

[server]
Next, the server 8 will be described again with reference to FIG. The server 8 includes, as hardware, a communication device capable of data communication with the computer device 3, a processor such as a CPU, and a memory such as a ROM and a RAM. As shown in FIG. 5, the server 8 functionally includes a communication unit 80, a storage unit 83, and a processing unit 84. The communication means 80 communicates with the computer apparatus 3 via the network, and exchanges data such as electronic contents, reproduction display conditions, and designated area specifying information.

  The storage unit 83 is configured by a memory such as a ROM or a RAM. The storage means 83 stores electronic textbooks obtained by digitizing various textbooks. The storage unit 83 stores user management information such as a user ID and a password required when the computer device 3 accesses a predetermined site provided by the server 8. Further, the storage unit 83 stores the electronic content uploaded from the computer device 3, the reproduction display condition, and the designated area specifying information.

  The processing unit 84 is configured by a processor such as a CPU and controls the entire server 8. The processing unit 84 includes a storage control unit 841, a display control unit 842, and a transmission control unit 843. The storage control unit 841 causes the storage unit 83 to store the electronic content uploaded from the computer device 3, the reproduction display condition, and the designated area specifying information. Further, the display control means 842 of the processing means 84 is a computer that generates electronic content uploaded from a computer device used by lecturers in the country, reproduction display conditions, and screen generation information for each screen for downloading designated area specifying information. Transmit to device 3. Then, the transmission control unit 843 of the processing unit 84 transmits the electronic content or the like designated from the computer device 3 on the above screen to the computer device 3 by the communication unit 80. Specific processing of the display control unit 842 and the transmission control unit 843 will be described in detail in the section of [Download processing].

[Association]
Next, regarding the process of determining the designated area As and the process of associating the electronic content and the playback display condition with the designated area As (these processes are also simply referred to as “association process”), the area designation screen shown in FIG. Each will be described in detail with reference to the association content setting screen shown in FIG. The association process described below corresponds to a pre-process for executing the association utilization process described later, and is a process executed by the computer device 3 based on contents input by the instructor through the input unit 31 at the stage of class preparation. . Therefore, in the association process, the projector 4 and the computer apparatus 3 may not be electrically connected.

(1) Area Designation Screen FIG. 6 is a display example of the area designation screen 60 output by the display means 36 of the computer device 3. As shown in FIG. 6, the area designation screen 60 displays an electronic textbook 2A, operation buttons 361 to 364, and a designation completion button 365. The area designation receiving means 341 of the processing means 34 displays the area designation screen 60 shown in FIG. 6 on the display means 36 when the input means 31 detects a predetermined input for starting the area designation screen 60.

  As shown in FIG. 6, the area specification screen 60 displays the electronic textbook 2 </ b> A in a spread state in which each page of the textbook 2 is digitized, and allows the user to specify a page to be displayed by the electronic textbook 2 </ b> A. Operation buttons 361 to 364 are provided. The operation button 361 is a button for returning the display page of the electronic textbook 2A to the first page, that is, returning to the state where the first and second pages of the electronic textbook 2A are displayed. The operation button 362 is a button for returning the display page of the electronic textbook 2A by two pages (in FIG. 6, the pages 20 and 21 are displayed). The operation button 363 is a button for advancing the page displayed by the electronic textbook 2A by two pages (displaying pages 24 and 25 in FIG. 6). The operation button 364 is a button for advancing the display page of the electronic textbook 2A to the last page.

  The area designation screen 60 displays “Please specify the area to be linked by dragging.” As described above, the area designation receiving unit 341 displays on the area designation screen 60 a message prompting the operator to designate the designated area As by a drag operation with a mouse or the like. Then, the area designation receiving unit 341 detects from the input unit 31 an input by a mouse drag operation on the displayed electronic textbook 2A. Areas 21A to 21D indicate areas (regions) designated by a mouse drag operation. Preferably, the processing means 34 designates the areas 21A to 21D by a broken line frame, coloring, hatching, etc. (a broken line frame in FIG. 6) so that the operator can confirm the area designated by the drag operation of the mouse. It is good to display on the area designation | designated screen 60 by the aspect different from the area which is not.

  The designation completion button 365 is a button for determining the areas 21A to 21D designated by the mouse drag operation as the designated area As. When the designation completion button 365 is selected, the area designation receiving unit 341 stores each area of the textbook 2 corresponding to the areas 21A to 21D in the storage unit 33 as the designated area As. Specifically, the area designation receiving unit 341 includes a textbook ID attached to the electronic textbook 2A, a page number to which the areas 21A to 21D belong, and a position (range) of the areas 21A to 21D in the entire page. The position is stored in the storage unit 33 in association with each designated area As.

  FIG. 8A shows the data structure of the designated area definition information after the designation completion button 365 is selected. In FIG. 8A, “designated area number” refers to a serial number assigned to the designated area As in the designated order when the designated area As is designated. In addition, the textbook ID of the electronic textbook 2A (textbook 2) is “R01”, and the position in the page is defined by corner position coordinates (Xn, Yn), height (Y direction), and width (X direction). Has been. As shown in FIG. 8A, designated area specifying information such as a designated area number and textbook ID is stored in the storage means 33 in correspondence with each of the areas 21A to 21D designated by the mouse drag operation on the area designation screen 60. It is remembered.

(2) Association Content Setting Screen FIG. 7 is a display example of the association content setting screen 61 output from the display unit 36 of the computer apparatus 3. The association unit 342 displays the association content setting screen 61 on the display unit 36 when the designation completion button 365 in FIG. 6 is selected. As shown in FIG. 7, the association content setting screen 61 includes designated area displays 367A to 367D (367), file name display fields 368A to 368D (368), reference buttons 369A to 369D (369), and a reproduction display. The condition input fields 370A, 370Ba, 370Bb, 370Ca, 370Cb (370), the screen return button 371, the setting completion button 372, the upload selection fields 380A to 380D (380), and the upload start button 381 are displayed. . On the association content setting screen 61, “Please set the content data to be linked” is displayed to the effect that the operator inputs the electronic content to be associated with the designated area As and its reproduction display conditions.

  The designated area displays 367A to 367D respectively display the areas 21A to 21D designated as the designated area As on the area designation screen of FIG. The designated area displays 367A to 367D are vertically arranged for each page number to which the designated area As to be displayed belongs. Specifically, a designation area display 367A for displaying the area 21A on the page with the page number “22” is displayed at the top together with the page number, and designation for displaying the areas 21B to 21D on the page with the page number “23”. Area displays 367B to 367D are arranged below the designated area display 367A together with the page number.

  The file name display fields 368A to 368D display the electronic content file name associated with the designated area As corresponding to the designated area displays 367A to 367D or a path including the file name of the electronic content (here, only the file name is displayed). It is a column. The file name display field 368A displays the file name designated by reference buttons 369A to 369D described later. The reference button 369 is a button for displaying a window for designating a file when selected by a click operation and for allowing the operator to designate an arbitrary file stored in the storage means 33 of the computer apparatus 3. is there.

  The reproduction display condition input field 370 is an input field for inputting a reproduction display condition associated with each designated area As corresponding to the designated area displays 367A to 367D. When the electronic content file is selected by the reference button 369, the associating unit 342 displays a reproduction display condition input field 370 corresponding to the selected electronic content file. Here, the associating unit 342 displays a reproduction display condition input field 370 for inputting a reproduction display condition according to the type of the file based on the extension of the file of the electronic content displayed in the file name display field 368. indicate.

  Specifically, since “worksheet 1.pdf” is displayed in the file name display field 368A, the associating unit 342 uses electronic contents as electronic contents associated with the designated area As corresponding to the designated area display 367A. It is determined that the document is specified. Accordingly, the associating unit 342 displays the reproduction display condition input field 370A for inputting the page number to be displayed, and displays “display page” on the left side of the reproduction display condition input field 370A.

  In addition, since “fault XX town.mp4” is displayed in the file name display field 368B, the associating unit 342 displays a moving image file as electronic content associated with the designated area As displayed in the designated area display 367A. Is determined to be specified. Accordingly, the associating means 342 includes the start time (reproduction start time) of the time zone to be actually reproduced and the end time (reproduction end time) of the time zone to be actually reproduced among all the reproduction times of “fault XX town.mp4”. Are displayed in the reproduction display condition input fields 370Ba and 370Bb, respectively. Further, the processing means 34 displays “reproduction start” on the left side of the reproduction display condition input field 370Ba to clarify that the reproduction display condition input field 370Ba is a field for inputting the reproduction start time, and also displays the reproduction display. “Reproduction end” is displayed on the left side of the condition input column 370Bb to clarify that the reproduction display condition input column 370Bb is a column for inputting a reproduction end time. Here, an input to designate “2 minutes and 10 seconds” as the reproduction start time is made in the reproduction display condition input field 370Ba, and “2 minutes and 40 seconds” is designated as the reproduction end time in the reproduction display condition input field 370Bb. An input to do so has been made.

  Similarly, since “fault △ Δ village.mp4” is displayed in the file name display field 368C, the associating unit 342 displays video as electronic content to be associated with the designated area As displayed in the designated area display 367C. Judge that the file is specified. Accordingly, the associating unit 342 displays the reproduction display condition input fields 370Ca and 370Cb for inputting the reproduction start time and the reproduction end time, respectively. In this case, the reproduction display condition input field 370Ca is inputted to designate “5 minutes 12 seconds” as the reproduction start time, and “6 minutes 30 seconds” is designated in the reproduction display condition input field 370Cb. An input indicating that it is specified in

  Further, since “Fault □□ City.jpg” is displayed in the file name display field 368D, the associating means 342 displays an image file as electronic content associated with the designated area As displayed in the designated area display 367D. Is determined to be specified. Therefore, in this case, the processing unit 34 determines that it is not necessary to set the reproduction display condition, and does not provide the reproduction display condition input field 370 corresponding to the file name display field 368D.

  The screen return button 371 is a button for returning the output screen of the display means 36 to the area designation screen 60 of FIG. The setting completion button 372 is a button for confirming the setting content on the association content setting screen 61.

  When the setting completion button 372 is selected, the associating unit 342 selects the electronic content file displayed in the file name display fields 368A to 368D for each of the specified areas As displayed in the specified area displays 367A to 367D, Information that associates the reproduction display condition input in each reproduction display condition input field 370 is stored in the storage unit 33 as designated area definition information.

  FIG. 8B shows the data structure of the designated area definition information stored in the storage means 33 after the setting completion button 372 is selected. As shown in FIG. 8B, when the setting completion button 372 is selected in the state shown in FIG. 7, the associating unit 342 performs processing for each designated area number based on the input content on the associating content setting screen 61. The storage location (path) of the electronic content and the reproduction display condition are associated with each other and stored in the storage unit 33. Thereby, when the display position of the designated area As of the electronic textbook 2A displayed on the textbook 2 or the dot screen 5 is tapped with the electronic pen 1, the computer apparatus 3 displays the designated area definition information shown in FIG. By referencing, it is possible to execute the playback display of the electronic content in accordance with the specified playback display conditions.

  In order to enable selection of an upload selection field 380 and an upload start button 381 to be described later, the association content setting screen 61 is continuously displayed on the screen of the computer apparatus 3 even when the setting completion button 372 is selected. Is done. The functions of the upload selection field 380 and the upload start button 381 will be described separately in the [Upload processing] section.

[Associate processing]
Next, the association utilization process executed after the designated area definition information is generated will be described with reference to FIGS.

  FIG. 9 shows a top view of the textbook 2 in the spread state. The two-dot chain line frames 90A to 90D in FIG. 9 are virtual lines that indicate the positions of the designated areas As corresponding to the designated area numbers in FIG. 8B.

  In the state shown in FIG. 9, when the lecturer taps any position in the two-dot chain line frames 90 </ b> A to 90 </ b> D with the electronic pen 1, the reproduction display control unit 343 refers to the designated area definition information, and The electronic content associated with the corresponding designated area As is reproduced according to the associated reproduction display condition. Specifically, when the computer apparatus 3 receives from the electronic pen 1 entry information generated by the electronic pen 1 reading dot patterns printed in the two-dot chain lines 90A to 90D, the reproduction display control means 343 Referring to the coordinate definition information, the textbook ID indicated by the position coordinate, the page number, and the position in the page are recognized from the position coordinate indicated by the coordinate information included in the received entry information. Next, the reproduction display control means 343 refers to the designated area definition information and recognizes that the designated area As corresponding to the recognized textbook ID, page number, and position within the page exists. In this case, the reproduction display control means 343 reproduces the electronic content associated with the recognized designated area As according to the associated reproduction display condition.

  For example, when an arbitrary position in the two-dot chain line frame 90A shown in FIG. 9 is tapped by the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the information shown in FIG. Based on the designated area definition information, it is recognized that the designated area As having the designated area number “1” has been selected. Accordingly, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4 to display the first page of “worksheet.pdf” in the projection range 50 of the display unit 36 and the dot screen 5. .

  FIG. 10 shows a display example of the file “worksheet.pdf”. As shown in FIG. 10, the file “worksheet.pdf” has answer columns 70 </ b> A to 70 </ b> E. Then, when a student or the like writes with the electronic pen 1 to the answer columns 70A to 70E of “worksheet.pdf” displayed on the dot screen 5, the processing unit 34 converts the coordinate information included in the entry information into the coordinate information Based on the conversion function, it is converted into coordinate information on the screen of the display means 36, and a stroke is drawn on the display means 36 based on the coordinate information. In addition, the processing unit 34 transmits an image signal for displaying an image on the display unit 36 to the projector 4 to project the same image as the image on the display unit 36 in synchronization. Thereby, the stroke drawn by the writer of the electronic pen 1 is similarly projected onto the dot screen 5.

  With reference to FIG. 9 again, the operation when the designated area As is tapped with the electronic pen 1 will be described. When an arbitrary position in the two-dot chain line frame 90B shown in FIG. 9 is tapped by the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the designated area shown in FIG. Based on the definition information, it is recognized that the designated area As having the designated area number “2” has been selected. Accordingly, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4, and the moving image of “fault XX town.mp4” is divided into two minutes in the projection range 50 of the display unit 36 and the dot screen 5. Display from 10 seconds to 2 minutes 40 seconds.

  Similarly, when an arbitrary position in the two-dot chain line frame 90C is tapped with the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the designated area definition shown in FIG. Based on the information, it is recognized that the designated area As having the designated area number “3” has been selected. Accordingly, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4, and the moving image of “fault ΔΔ village.mp4” is displayed for 5 minutes in the projection range 50 of the display unit 36 and the dot screen 5. Display from 12 seconds to 6 minutes 30 seconds. When an arbitrary position in the two-dot chain line frame 90D is tapped with the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the designated area definition information shown in FIG. 8B. Based on the above, it is recognized that the designated area As having the designated area number “4” has been selected. Therefore, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4 to display an image of “fault □□ city.jpg” in the projection range 50 of the display unit 36 and the dot screen 5. .

  Similarly, when the page of the electronic textbook 2A is displayed in the projection range 50 of the dot screen 5, the computer device 3 similarly displays the entry information transmitted from the electronic pen 1 and the designated area definition shown in FIG. Based on the information, the electronic content is reproduced and displayed in accordance with designated reproduction display conditions. Specifically, when the display position of the designated area As within the projection range 50 is tapped with the electronic pen 1, the reproduction display control unit 343 displays the coordinate information of the received entry information on the display of the display unit 36 using the coordinate conversion function. The page number and the position in the page in the displayed electronic textbook 2A indicated by the converted position coordinates are recognized. Then, the reproduction display control means 343 refers to the designated area definition information, and determines whether or not the designated area As is designated based on the textbook ID corresponding to the electronic textbook 2A being displayed, the recognized page number, and the position in the page. If it is determined that the designated area As is designated, the electronic content associated with the designated area As is reproduced according to the reproduction display condition designated in the designated area definition information.

[Upload process]
Next, uploading processing of electronic content or the like to the server 8 by the computer device 3 will be described with reference to the association content setting screen 61 shown in FIG. 7 again.

  The upload selection fields 380A to 380D (380) are respectively displayed on the electronic content displayed in the file name display fields 368A to 368D, the playback display condition input in the playback display condition input field 370, and the designation area display 367. This is a check box that is selected when uploading the designated area specifying information of the designated area As to the server 8. In FIG. 7, check marks are added to the upload selection columns 380A and 380B corresponding to the electronic contents of “worksheet 1.pdf” and “fault XX town.mp4”.

  The upload start button 381 is a button for starting uploading of electronic content or the like corresponding to the upload selection field 380 with a check mark to the server 8. When the upload start button 381 is selected, the upload unit 344 of the processing unit 34 displays the electronic content corresponding to the upload selection field 380 with a check mark and the playback display condition input in the playback display condition input field 370. And the designated area specifying information of the designated area As displayed on the designated area display 367 are transmitted to the server 8 by the first communication means 30. Here, since the upload selection fields 380A and 380B are checked, the upload unit 344 corresponds to the electronic contents of “worksheet 1.pdf” and “fault XX town.mp4” and the corresponding contents. The reproduction display condition and the specified area specifying information are transmitted to the server 8.

  And the server 8 memorize | stores the electronic content transmitted from the computer apparatus 3, the reproduction | regeneration display conditions corresponding to this, and designation | designated area specific information similarly to the data structure shown to FIG. 8 (B). As a result, the other lecturer can download the uploaded electronic content or the like by accessing the server 8 using the computer device used by the instructor.

  When the upload start button 381 is selected, the upload unit 344 pops up a window including a check box for permitting others to use the electronic content created by itself. Then, the upload unit 344 starts uploading of electronic content or the like when the check box is checked. Preferably, the upload unit 344 further includes a comment input field for inputting a comment for each electronic content to be uploaded in the above-described window, and is added to the electronic content to be uploaded and described in the comment input field. The content may be transmitted to the server 8. Thereby, the server 8 can display the comment by the creator of electronic content on the screen of the computer apparatus 3 in the download process mentioned later. This will be described later with reference to FIGS.

[Download process]
Next, download processing of uploaded electronic content and the like will be described in detail with reference to FIGS. Thereafter, as a premise, the computer device 3 transmits the user ID and password given in advance through the user registration procedure or the like to the server 8 and is authenticated by the server 8, and then the HTML document or the like transmitted from the server 8. Each screen is displayed based on the screen generation information.

(1) Textbook Selection Screen FIG. 11 shows a textbook selection screen 80 displayed on the screen of the computer device 3. When downloading electronic content or the like, the computer device 3 first accesses a predetermined URL managed by the server 8 and displays a textbook selection screen 80 shown in FIG. 11 by a browser or the like. On the textbook selection screen 80, a textbook for third graders can be selected from textbooks for first graders created by “XX Learning Company”. In FIG. 8, an icon 800 displayed as “5th grade elementary school” is selected by the cursor 9 of the mouse, whereby icons 801 to 804 indicating respective subjects of the 5th grade elementary school are displayed. Here, it is further assumed that an icon 803 displaying “science” is selected by the cursor 9.

(2) Content Selection Screen FIG. 12 shows a content selection screen 81 that is displayed after the icon 803 is selected. As shown in FIG. 12, the content selection screen 81 includes an electronic textbook 2A, operation buttons 811 to 814 for operating the display page of the electronic textbook 2A, and an electronic textbook 2A whose outline is outlined by a two-dot chain line frame. Upper areas 816A to 816D (816) and content information display boxes 817Aa, 817Ab, 817Ba, 817Bb, 817Ca, and 817Cb (817) are displayed.

  As shown in FIG. 12, on the content selection screen 81, the display control means 842 of the processing means 84 of the server 8 has the specified area specifying information and each area 816 specified based on the uploaded specified area specifying information. A content information display box 817 indicating the information of the associated electronic content is associated with and displayed on the content selection screen 81.

  The content information display box 817 includes a thumbnail of the electronic content, a name of the creator who created (that is, provided) the electronic content, a file name of the electronic content, a comment input by the creator at the time of uploading, and the server 8 The cumulative number of downloads of the electronic content (the number of downloads) and the evaluation by the person who viewed the electronic content are displayed. Here, the level of evaluation is expressed in five levels depending on the number of black star marks. When the electronic content indicated by the content information display box 817 has been recently uploaded (for example, within two days), the characters “New!” Are added to the lower right corner of the content information display box 817 (contents). Information display box 817Ab). The information displayed in the content information box 817 is an example of “content related information” in the present invention.

  Furthermore, when the electronic content indicated by the content information display box 817 is an electronic document including dot pattern print information, the content information display box 817 further displays the number of strokes (see the content information display box 817Ba). The “number of strokes” here is, for example, entered when electronic content is printed with a dot pattern in accordance with the print information and each student fills in the printing paper with the electronic pen 1. The average number, maximum value, or minimum value of the number of strokes. Details of this will be described later.

  In addition, when the display control unit 842 determines that the designated areas As indicated by the two or more uploaded designated area specifying information are at substantially the same position, the specified area specifying information indicates the same position. Treat as. For example, when the area of the designated area As indicated by two or more designated area specifying information overlaps by a predetermined ratio (for example, 90%) or more, the processing means 84 points to the same position. As a result, only a range corresponding to any one of the designated area specifying information is surrounded by a two-dot chain line and displayed as an area 816. As a result, in FIG. 12, the content information display boxes 817Aa and 817Ab are associated with one area 816A. Similarly, the content information display boxes 817Ba and 817Bb are associated with the area 816B, and the content information display boxes 817Ca and 817Cb are associated with the area 816C. Thereby, the display control means 842 of the processing means 84 can suppress the display of the content selection screen 81 from becoming complicated.

  Further, when a plurality of content information display boxes 817 correspond to one area 816, the display control means 842 arranges these content information display boxes 817 based on the number of downloads, evaluation, and the number of strokes. Specifically, the display control means 842 arranges the content information display boxes 817 in descending order of the number of displayed downloads, and arranges the content information display boxes 817 with the same number of displayed downloads in the order of high evaluation of the display, The content information display boxes 817 with the same number of downloaded downloads and the same evaluation are arranged in descending order of the number of displayed strokes.

  Then, when any content information display box 817 is selected, the display control unit 842 of the processing unit 84 displays a download screen for downloading the electronic content corresponding to the selected content information display box 817. To display. The display form of the download screen differs depending on the type of electronic content to be downloaded. In the following, a download screen (also referred to as a “first download screen”) when the electronic content to be downloaded is a moving image, and an electronic document to which the electronic content to be downloaded has dot pattern print information added. And a download screen (also referred to as a “second download screen”).

(3) First Download Screen FIG. 13 shows a display example of the first download screen 82 when the electronic content to be downloaded is a moving image. Here, it is assumed that the content information display box 817Ca is selected on the content selection screen 81 shown in FIG.

  As shown in FIG. 13, the display control means 842 causes the computer device 3 to display the first download screen 82 for the moving image content “fault XX town.mp4” corresponding to the content information display box 817Ca. Here, the first download screen 82 mainly includes a moving image display area 820, a reproduction bar 821 indicating a time zone to be reproduced, a reproduction pointer 822 indicating a reproduction position on the reproduction bar 821, and a reproduction. A playback button 823 for operating the position, evaluation display fields 824A and 824B (824), an evaluation input field 825, a recommended playback setting selection field 826, a recommended position setting selection field 827, and a download start button 828 are provided. It is displayed.

  The moving image display area 820 is an area for reproducing and displaying the electronic file “tomographic XX.mp4” to be downloaded. The operator of the computer apparatus 3 moves the playback pointer 822 on the playback bar 821 provided below the moving image display area 820 to an arbitrary playback position with the mouse cursor, or selects each playback button 823 with the mouse cursor. It is possible to control the playback of electronic content. The moving image display area 820 is an example of the “reproduction display area” in the present invention. In addition, on the right side of the moving image display area 820, the author name and file name of the electronic content to be downloaded and the comment input by the creator when the electronic content is uploaded are displayed.

  The evaluation display column 824 is a column that displays the evaluation entered by the person who has viewed the second download screen 83 in the past and viewed the electronic content “tomographic XX.mp4” in the evaluation input column 825. Specifically, the evaluation display field 824 displays a black star mark indicating the evaluation level and a comment. The evaluation display column 824 is an example of “evaluation history” in the present invention. The evaluation input column 825 is a column for inputting an evaluation of the electronic content after the electronic content is reproduced and viewed in the moving image display area 820 or the like. Specifically, in the evaluation input field 825, the operator of the computer apparatus 3 increases or decreases the number of black star marks indicating the level of evaluation by clicking the white star mark with the cursor positioned. At the same time, a comment when viewing the electronic content is written by keyboard input.

  The recommended playback setting selection field 826 is a check box for selecting whether or not the playback display conditions associated with the electronic content to be downloaded are downloaded together with the electronic content. As shown in FIG. 13, the display control unit 842 displays the playback display condition associated with the electronic content and stored in the storage unit 83 on the first download screen 82 as a recommended playback setting (recommended playback setting). At the same time, the recommended playback setting selection field 826 is used to select whether or not to adopt the recommended playback setting. When the download start button 828 is pressed while the recommended playback setting selection field 826 is selected, the transmission control unit 843 displays the playback display conditions associated with the electronic content and stored in the storage unit 83 together with the electronic content. Transmit to device 3. Then, the download unit 345 of the computer device 3 receives the electronic content and the reproduction display condition transmitted by the transmission control unit 843, and stores them in association with specified area definition information (see FIG. 8). This eliminates the need for the computer device 3 to cause the user to input playback display conditions associated with the electronic content on the association content setting screen 61 thereafter.

  The recommended position setting selection field 827 is a check box for selecting whether or not the specified area specifying information associated with the electronic content to be downloaded is downloaded together with the electronic content. In this example, the display control means 842 recommends the area 816C of the content selection screen 81 shown in FIG. 12 as the designated area As associated with the electronic content to be downloaded, and adopts the setting (recommended position setting) of the designated area As. Whether or not the recommended position setting selection field 827 is selected. When the download start button 828 is pressed in a state where the recommended position setting selection field 827 is selected, the transmission control unit 843 specifies designated area specifying information stored in the storage unit 83 in association with the electronic content together with the electronic content. Is transmitted to the computer apparatus 3. Then, the download unit 345 of the computer apparatus 3 receives the electronic content and the designated area specifying information transmitted by the transmission control unit 843, and stores the electronic content in association with the designated area definition information (see FIG. 8). As a result, the computer device 3 does not need to allow the user to designate the designated area As associated with the downloaded electronic content on the area designation screen 60, and the electronic content is assigned to the designated area As on the association content setting screen 61. It is no longer necessary to enter the association.

  Note that if the download start button 828 is selected in a state where the recommended playback setting selection field 826 and the recommended position setting selection field 827 are not selected, only the electronic content is transmitted from the server 8 to the computer apparatus 3. Even in this case, as described in the section [Association Processing], the computer apparatus 3 allows the user to designate the designated area As to be associated with the electronic content downloaded on the area designation screen 60, and to set the association contents. The screen 61 accepts an input indicating that the designated area As is associated with the downloaded electronic content and a predetermined reproduction display condition.

(4) Second Download Screen FIG. 14 shows a display example of the second download screen 83 when the electronic content to be downloaded is an electronic document with dot pattern print information attached thereto. Here, it is assumed that the content information display box 817Ba is selected on the content selection screen 81 shown in FIG.

  As shown in FIG. 14, the display control unit 842 displays a second download screen 83 of the electronic document file “worksheet 1.pdf” including dot pattern print information corresponding to the content information display box 817Ba on the screen of the computer apparatus 3. It is displayed above. Here, the second download screen 82 mainly includes a display area 830 that displays thumbnails of the electronic content “worksheet 1.pdf” and evaluation display fields 834A and 834B (834) that indicate evaluations that have been input in the past. An evaluation input field 835 for inputting an evaluation, a recommended reproduction setting selection field 836 for selecting whether to download the reproduction display condition, and a recommendation for selecting whether to download the specified area specifying information. A position setting selection field 837, a download start button 838, and a stroke number input field 839 are displayed.

  In the second download screen 83, the number of strokes is displayed on the right side of the evaluation display field 834A, and a stroke number input field 839 for inputting the number of strokes is provided on the right side of the evaluation entry field 835. As described above, the “number of strokes” indicates the number of strokes entered for the electronic content when the electronic content is actually used. Therefore, if the user of the computer apparatus 3 displaying the second download screen 83 has already used “worksheet 1.pdf” in a class or the like, the number of strokes calculated at that time is used. It inputs in the stroke number input column 839. As a premise of this, when using the “worksheet 1.pdf”, the computer apparatus 3 uses the “worksheet distributed to each student based on the entry information transmitted from the electronic pen used by each student during the lesson. 1. The average number of strokes to “pdf” on the printing paper is immediately calculated and displayed on the screen, and the number of strokes to be input to the user in advance by allowing the teacher user to visually recognize the number of strokes. To grasp.

[Operational effects of the electronic pen system of the present embodiment]
According to the electronic pen system of the present embodiment, the computer device 3 is based on the input on the association content setting screen 61, the designated area As, and the electronic content to be played back or displayed when the designated area As is selected, The electronic content reproduction / display conditions are associated with each other, and the designated area specifying information, the electronic content, and the reproduction / display conditions are uploaded to the server 8. In this way, the other computer apparatus connects to the server 8 and receives these pieces of information, so that the reproduction display that is defined in a state in which the electronic content is associated with the designated area As is not required. Playback or display is possible according to conditions. Therefore, according to this aspect, it is possible to preferably share electronic contents between lecturers.

  In addition, the server 8 stores designated area specifying information uploaded from the computer device 3, electronic content, and playback / display conditions. For the computer device 3, the page of the electronic textbook 2A including the designated area As, A content selection screen 81 displaying a content information box 817 indicating information of electronic content associated with the designated area As is displayed. Thereby, the server 8 can make the operator of the computer apparatus 3 select easily which electronic content should be downloaded.

  Further, when any content information box 817 is selected, the server 8 recommends a recommended playback setting selection field 826 for selecting whether or not to download a recommended playback display condition in addition to the electronic content. A first download screen 82 or a second download screen 83 including a recommended position setting selection field 827 for selecting whether or not to download the specified area specifying information is displayed on the computer device 3. Thereby, in addition to the electronic content, the server 8 can cause the computer device 3 to download information on the designated area As and reproduction display conditions suitable for reproducing or displaying the electronic content as necessary.

[Modification]
Next, a modification of this embodiment will be described. The following modifications may be applied in any combination to the above-described embodiment.

(Modification 1)
The electronic pen system includes an electronic board such as a pressure-sensitive board (sheet) configured to be able to detect pressure, or an electromagnetic board in which wires are embedded immediately below the surface of the board, instead of the dot screen 5. Also good. For example, in the case of a pressure-sensitive board, when pressure is applied with a predetermined pen (stylus), two electrically conductive sheets provided in the board come into contact with each other to generate an electric signal, and a computer is generated based on the electric signal. The device 3 detects the contact position. In the case of an electromagnetic board, the electronic pen system includes a stylus in which a coil is embedded instead of the electronic pen 1, and when the stylus is brought into contact with the electromagnetic board, the electromagnetic board contacts based on electromagnetic induction with the stylus. An electrical signal corresponding to the position is generated, and the computer device 3 detects the contact position based on the electrical signal.

  Then, regardless of which input system board (sheet) is used, the computer device 3 converts the coordinate system applied to the board to the coordinate system applied to the display of the display means 36 in the same manner as the dot screen 5. The coordinate conversion function for this is obtained in advance before performing the association process or the like. When the computer device 3 receives the coordinate data corresponding to the contact position on the board using the obtained coordinate conversion function, the computer device 3 converts the coordinate data into the coordinate system data applied to the display of the display means 36 and displays it. It is detected whether or not the designated area As in the electronic textbook 2A is selected.

(Modification 2)
The electronic pen system may include a tablet PC including a touch panel such as iPad (registered trademark) in which data of the electronic textbook 2 </ b> A is stored instead of the electronic pen 1 and the textbook 2.

  In this case, the tablet PC displays the electronic textbook 2A in a spread state and changes the displayed page based on the touch panel operation. Further, in the association utilization process, when the operator touches the display portion of the designated area As with a finger, the tablet PC displays the textbook ID associated with the electronic textbook 2A that has been in contact and the page number of the page that has been in contact. And a detection signal relating to the position in the page in the page is transmitted to the computer device 3, and the computer device 3 identifies the designated area As that has been in contact based on the detection signal, and the electronic device associated with the designated area As. Play and display content.

(Modification 3)
The electronic content may be a moving image content including sound, or may be content only of sound. In this case, the computer apparatus 3 further includes sound output means such as a speaker, and the reproduction display control means 343 causes the sound output means to output sound when the electronic content to be reproduced includes sound.

(Modification 4)
In the second download screen 83 of FIG. 14, instead of allowing the user of the computer device 3 to input the stroke number in the stroke number input field 839, the server 8 may automatically receive the stroke number from the computer device 3. Good. For example, the server 8 stores the user ID of the user who made the input in the evaluation input field 835, and then requests transmission of stroke number information to the computer device that requested authentication using the user ID. To do. In this case, if the computer device that has requested authentication has already calculated and stored the stroke number, the server 8 receives information on the stroke number from the computer device.

(Modification 5)
In the above embodiment, as shown in FIG. 6, an arbitrary area is designated by dragging the mouse while the electronic textbook 2A is displayed. Instead, an area such as a block displaying a photo, an illustration, or a character displayed in the electronic textbook 2A may be set in advance so that it can be designated by a mouse click operation. Thereby, the user may be allowed to specify an area to be associated with the electronic content by clicking a mouse with an area such as an arbitrary photo, illustration, or block.

  In the above embodiment, when the display control means 842 determines that the designated areas As indicated by the two or more designated area specifying information uploaded are at the same position, the display control means 842 treats that the same position is indicated. According to the fifth modification, it is possible to reliably determine the identification of the designated area As indicated by the two or more uploaded designated area specifying information.

(Modification 6)
In the above embodiment, the Anoto method is used for the electronic pen, the dot pattern (coded pattern), and the entry information. However, the Anoto method is not necessarily limited.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Dot pattern paper 3 ... Computer apparatus 4 ... Projector 5 ... Dot screen 8 ... Server

Claims (28)

A computer device connected to a server device for managing electronic contents,
An association means for associating a designated area designated in the teaching material, electronic content to be reproduced or displayed when the designated area is selected, and reproduction or display conditions of the electronic content;
A computer apparatus comprising: uploading means for uploading information indicating the designated area associated by the associating means, the electronic content, and the reproduction or display conditions to the server apparatus. The upload means
In the setting screen for setting the electronic content to be associated with the designated area and the playback or display conditions of the electronic content,
The input field for selecting whether or not to upload information indicating the designated area, the electronic content, and the reproduction or display condition to the server device is provided. Computer device. An electronic teaching material obtained by digitizing the teaching material is displayed on a display unit, and further includes an area designation receiving unit that receives an input for designating an arbitrary area from the display part of the electronic teaching material,
The association means associates a designated area designated based on the input, an electronic content related to the content of the electronic teaching material, and a reproduction or display condition of the electronic content. A computer device as described.   When it is determined that the designated area is selected, the display device further includes a reproduction display control unit that reproduces or displays the electronic content associated with the designated area on the display unit or / and the audio output unit according to the reproduction or display condition. The computer apparatus according to any one of claims 1 to 3. A server device that transmits information including designated electronic content to a computer device,
Storage means for storing information indicating a designated area designated in the teaching material, electronic content associated with the designated area, and content-related information related to the electronic content;
Display control means for displaying electronic teaching materials including the designated area on the display means of the computer device, and displaying content related information of the electronic content associated with the designated area in association with the designated area;
A server apparatus comprising: a transmission control unit configured to transmit information including electronic content indicated by the content related information to the computer device after a display portion of the content related information is selected. The storage means further stores playback or display conditions of the electronic content in association with the stored electronic content,
The transmission control means, as information including the electronic content,
6. The server device according to claim 5, wherein the electronic content, information indicating a designated area associated with the electronic content, and playback or display conditions for the electronic content are transmitted to the computer device. The storage means stores the playback or display conditions of the electronic content in association with the stored electronic content,
The display control means, when the display portion of the content related information is selected,
Download for selecting whether to further download the information indicating the designated area associated with the electronic content and the playback or display conditions of the electronic content in addition to the electronic content indicated by the content-related information The server device according to claim 5, wherein a screen is displayed on a display unit of the computer device. The display control means, as content related information of the electronic content,
The number of downloads of the electronic content and the evaluation by a person who downloaded or / and viewed the electronic content are displayed on the display unit of the computer device. The server device described in 1.   The display control means treats the electronic content associated with the plurality of designated areas as being associated with one designated area when the plurality of designated areas overlap a predetermined ratio or more. 9. The server device according to claim 5, wherein content-related information of electronic contents associated with the plurality of designated areas is displayed in association with the designated area.   The display control means displays the content related information of the electronic content to be displayed in association with the one designated area in descending order of the download count of the electronic content or / and in descending order of evaluation of the electronic content. The server apparatus according to claim 9, wherein the server apparatuses are displayed side by side. A server device that transmits information including designated electronic content to a computer device,
Storage means for storing the electronic content, information indicating a designated area recommended to be associated with the electronic content in the teaching material, and a recommended reproduction or display condition of the electronic content in association with each other;
In addition to the electronic content designated by the computer device, a download screen for selecting whether or not to download the information indicated by the designated area associated with the electronic content and the playback or display condition is displayed on the computer device. Display control means for displaying on the means;
Transmission control means for transmitting the electronic content and information selected to be downloaded on the download screen to the computer device;
A server device comprising: The display control means includes
A playback display area for playing back or displaying electronic content to be downloaded is provided on the download screen, and
The server apparatus according to claim 11, wherein an evaluation input field for inputting an evaluation of the electronic content is provided on the download screen.   The server apparatus according to claim 12, wherein the display control means displays the history of evaluation input in the evaluation input field on the download screen.   When the electronic content to be downloaded is an electronic document including coded pattern print information, the display control means displays information on the number of strokes written when the electronic content is used on the download screen. The server device according to claim 11, wherein the server device is a server device. A program installed and executed in a computer device connected to a server device that manages electronic content,
An association means for associating a designated area designated in the teaching material, electronic content to be reproduced or displayed when the designated area is selected, and reproduction or display conditions of the electronic content;
A program for causing the computer device to function as uploading means for uploading information indicating the designated area associated by the associating means, the electronic content, and the reproduction or display conditions to the server apparatus. The upload means
In the setting screen for setting the electronic content to be associated with the designated area and the playback or display conditions of the electronic content,
16. The input field for selecting whether or not to upload information indicating the designated area, the electronic content, and the reproduction or display condition to the server device is provided. program. An electronic teaching material obtained by digitizing the teaching material is displayed on a display unit, and the computer apparatus further functions as an area designation receiving unit that receives an input for designating an arbitrary area from a display portion of the electronic teaching material,
The association means associates a designated area designated based on the input, an electronic content related to the contents of the electronic teaching material, and a reproduction or display condition of the electronic content. The program described.   When it is determined that the designated area has been selected, the computer apparatus as a reproduction display control means for reproducing or displaying the electronic content associated with the designated area on the display means or / and the audio output means according to the reproduction or display conditions The program according to any one of claims 15 to 17, further comprising: Send information containing the specified electronic content to the computer device;
It is mounted on and executed by a server device having storage means for storing information indicating a designated area designated in the teaching material, electronic content associated with the designated area, and content-related information related to the electronic content. A program,
Display control means for displaying electronic teaching materials including the designated area on the display means of the computer device, and displaying content related information of the electronic content associated with the designated area in association with the designated area;
A program that causes the server device to function as transmission control means for transmitting information including electronic content indicated by the content related information to the computer device after a display portion of the content related information is selected. The storage means further stores playback or display conditions of the electronic content in association with the stored electronic content,
The transmission control means, as information including the electronic content,
The program according to claim 19, wherein the electronic content, information indicating a designated area associated with the electronic content, and playback or display conditions for the electronic content are transmitted to the computer device. The storage means stores the playback or display conditions of the electronic content in association with the stored electronic content,
The display control means, when the display portion of the content related information is selected,
Download for selecting whether to further download the information indicating the designated area associated with the electronic content and the playback or display conditions of the electronic content in addition to the electronic content indicated by the content-related information The program according to claim 19 or 20, wherein a screen is displayed on display means of the computer device. The display control means, as content related information of the electronic content,
The number of downloads of the electronic content and the evaluation by a person who downloaded or / and viewed the electronic content are displayed on the display unit of the computer device. The program described in.   The display control means treats the electronic content associated with the plurality of designated areas as being associated with one designated area when the plurality of designated areas overlap a predetermined ratio or more. The program according to any one of claims 19 to 22, wherein content-related information of electronic content associated with the plurality of designated areas is displayed in association with the designated area.   The display control means displays the content related information of the electronic content to be displayed in association with the one designated area in descending order of the download count of the electronic content or / and in descending order of evaluation of the electronic content. The program according to claim 23, wherein the programs are displayed side by side. Send information containing the specified electronic content to the computer device;
Installed in a server device comprising storage means for storing electronic content, information indicating a designated area recommended to be associated with the electronic content in the teaching material, and recommended reproduction or display conditions of the electronic content in association with each other A program to be executed,
In addition to the electronic content designated by the computer device, a download screen for selecting whether or not to download the information indicated by the designated area associated with the electronic content and the playback or display condition is displayed on the computer device. Display control means for displaying on the means;
A program that causes the server device to function as transmission control means for transmitting the electronic content and information selected to be downloaded on the download screen to the computer device. The display control means includes
A playback display area for playing back or displaying electronic content to be downloaded is provided on the download screen, and
26. The program according to claim 25, wherein an evaluation input field for inputting an evaluation of the electronic content is provided on the download screen.   27. The program according to claim 26, wherein the display control means causes the history of evaluation input in the evaluation input field to be displayed on the download screen.   When the electronic content to be downloaded is an electronic document including coded pattern print information, the display control means displays information on the number of strokes written when the electronic content is used on the download screen. The program according to any one of claims 25 to 27, wherein: