JP2013076720A - Computer device, electronic pen system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a computer device, an electronic pen system and a program capable of reproducing electronic contents on the basis of conditions of reproduction or display which an operator intends, when the electronic contents related to a teaching material is reproduced or displayed.SOLUTION: A computer device receives input which designates an arbitrary area in a display part of an electronic teaching material, and associates the designated area which is designated based on the input and electronic contents related to contents of the electronic teaching material with conditions of reproduction or display of the electronic contents. Then, the computer device reproduces or displays the electronic contents associated with the designated area according to the reproduction/display conditions, when it is determined that the designated area is selected.

Description

  The present invention relates to a technique using a coding pattern readable by an electronic pen.

  2. Description of the Related Art Conventionally, electronic pens that digitize written information have been developed, and “Anot pen” developed by Swedish company Anoto is known as a representative one. For example, as described in Patent Document 1, the anotopen reads a predetermined dot pattern printed on a sheet, generates entry information, and transmits the entry information to the terminal device.

  Patent Document 2 describes a rotation correction processing function that corrects an arrangement of dots on an image caused by an angle of an electronic pen facing a dot pattern. Further, Patent Document 3 has a teaching material server that stores teaching material data distributed from a distribution server in which teaching material data used in classes is stored in association with a teaching plan, and teaches teaching material data stored in the teaching material server. A class support system including a classroom terminal and a large screen for displaying along the progress of a class based on a plan is disclosed. Further, in Patent Document 4, appropriate content is acquired by accessing content servers of a plurality of content providers via the Internet from information terminals of users who participate in educational sites such as teachers, students, and students. An electronic teaching material sharing method using contents as teaching materials is disclosed. Further, Patent Document 5 discloses a technique for downloading teaching material contents from a server via the Internet or the like and displaying them on an electronic blackboard or the like for use in classes or the like.

  Further, in Patent Document 6, an RFID tag storing a code is embedded in an arbitrary page of the learning material, and the learning material content is searched from the computer by reading the code of the RFID tag, and the learning material content is searched from the projector to the screen. A technique for projecting an image of the above is disclosed. Patent Document 7 discloses a technique for associating a dot pattern of an icon printed on paper with content data. Patent Document 8 discloses a teaching material distribution system in which contents of teaching materials are uploaded to a server and other teachers can download and use the teaching materials. In this teaching material distribution system, when a digital teaching material icon is clicked, a list of explanations as teaching material contents is displayed. In this list display, the list is displayed in descending order of evaluation, the comment of the teaching material creator and the number of downloads are displayed, and the user's evaluation can also be input.

Japanese Patent No. 3874498 Special table 2003-529853 gazette JP 2002-072850 A JP 2004-226659 A JP 2004-258184 A JP 2004-012539 A Japanese Patent No. 3956026 JP 2001-242777 A

  When a lecturer taps a predetermined drawing part of an open textbook (educational material) with an electronic pen etc. during a class, etc., the electronic content such as a video related to the tapped part is played back or displayed to students. It is convenient to be able to watch. At this time, when the electronic content is a moving image or the like, the playback portion of the electronic content to be played back is not necessarily the entire electronic content. When the electronic content is an electronic document or the like, the electronic content to be displayed The display position is not necessarily the first page. Therefore, the present invention provides a computer device, an electronic pen system, and a program capable of reproducing electronic content based on reproduction or display conditions intended by an operator when electronic content related to a teaching material is reproduced or displayed. The main issue is to provide.

  The computer device according to the present invention displays an electronic teaching material on a display unit, an area designation receiving unit that accepts an input for designating an arbitrary area from a display part of the electronic teaching material, a designated area designated based on the input, If it is determined that the designated area is selected, and association means for associating the electronic content related to the contents of the electronic teaching material with the playback or display conditions of the electronic content, the electronic content associated with the designated area is selected as the electronic content. Reproduction display control means for causing the display means and / or the audio output means to reproduce or display according to reproduction or display conditions.

  With this configuration, the computer apparatus accepts an input for designating an arbitrary area from the display portion of the electronic teaching material, the designated area designated based on the input, the electronic content related to the content of the electronic teaching material, and the reproduction of the electronic content Alternatively, display conditions (reproduction display conditions) are associated. Thereafter, when it is determined that the designated area is selected, the computer device reproduces or displays (reproduces and displays) the electronic content associated with the designated area according to the reproduction display condition. In this way, the computer device reproduces the electronic content according to the reproduction display condition when the designated area is selected by associating the reproduction display condition in addition to the electronic content to the designated area. be able to. Therefore, the computer device can reproduce and display the electronic content intended by the operator according to the intended reproduction display conditions, and can improve convenience.

  In one aspect of the computer apparatus, the associating unit causes the display unit to display a setting screen for setting the electronic content to be associated with the designated area and a reproduction or display condition of the electronic content, and associate the electronic content with the designated area. When electronic content is set, contents to be set as the reproduction or display condition are changed according to the type of the electronic content. In general, the content of the playback display condition to be set differs depending on the type of electronic content. Therefore, according to this aspect, the computer apparatus can associate an appropriate reproduction display condition according to the type of electronic content with the designated area.

  In another aspect of the computer apparatus, the association unit inputs a reproduction start time and / or a reproduction end time of the electronic content when the type of the electronic content set on the setting screen is a moving image. Is provided in the setting screen. According to this aspect, the computer device can reproduce only the portion intended by the user when reproducing the moving image content related to the teaching material in accordance with the user's operation.

  In another aspect of the computer apparatus, when the electronic content type set on the setting screen is an electronic document, the association unit sets an input field for inputting a display page of the electronic content. Provide in the screen. According to this aspect, the computer device can immediately display the page intended by the user when displaying the electronic document related to the teaching material in accordance with the user's operation.

  The electronic pen system according to the present invention includes a screen having a coding pattern on the surface, a projector that emits light based on an image signal to the surface of the screen, and an image signal transmitted to the projector. An electronic pen system comprising: the computer device according to claim 1; and an electronic pen that reads a coded pattern to calculate a position coordinate of a pen tip portion and transmits entry information including the position coordinate to the computer device. The reproduction display control means of the computer device is configured such that the designated area of the electronic teaching material projected on the screen based on the entry information received from the electronic pen in a state where the electronic teaching material is projected and displayed on the screen. If the electronic pen is selected by the electronic pen, the electronic container associated with the designated area is selected. Tsu, said display means and / or to reproduce or display the sound output unit in accordance with the reproduction or display condition.

  In this aspect, when the electronic pen system reads the coded pattern of the display portion on the screen of the designated area associated with the electronic pen system when the electronic teaching material is projected and displayed on the screen by the projector, the electronic pen system The electronic content associated with the designated area is reproduced and displayed according to the reproduction display condition. By doing so, the electronic pen system can preferably reproduce and display the electronic content related to the teaching material according to the designated reproduction display condition based on the operation of the electronic pen on the screen.

  In another aspect of the electronic pen system according to the present invention, the computer device according to any one of claims 1 to 4, a teaching material on which a coded pattern is printed, and a pen tip portion by reading the coded pattern. An electronic pen system comprising: an electronic pen that calculates position coordinates and transmits entry information including the position coordinates to the computer device, wherein the electronic teaching material is an electronic version of the teaching material, and the reproduction display control When the means determines that an area of the teaching material corresponding to the designated area of the electronic teaching material is selected by the electronic pen based on the entry information received from the electronic pen, the electronic content associated with the designated area Are reproduced or displayed on the display means or / and the audio output means in accordance with the reproduction or display conditions.

  In this aspect, the electronic pen system has the same content as the electronic teaching material, the teaching material on which the coding pattern is printed, and the electronic pen reads the coding pattern of the position of the teaching material corresponding to the designated area associated therewith. The electronic content associated with the designated area is reproduced and displayed according to the reproduction display condition. By doing in this way, the electronic pen system can preferably reproduce and display the electronic content related to the educational material according to the designated reproduction display condition based on the operation of the electronic pen on the educational material.

  In one aspect of the electronic pen system, the computer device is connected to a server device that stores electronic content via a network, and the association unit of the computer device stores the electronic content stored in the designated area by the server device. When associating, the electronic content is received from the server device. According to this aspect, the computer apparatus can preferably receive and reproduce and display electronic content.

  In another aspect of the electronic pen system, the computer device is connected to a server device that stores electronic content via a network, and the reproduction display control means of the computer device is configured such that the designated area is selected. By downloading the electronic content associated with the designated area from the server device or receiving streaming distribution of the electronic content from the server device, the electronic content is displayed on the display means and / or the audio. Reproduce or display on the output means. According to this aspect, the computer device can reduce the electronic content to be downloaded and stored from the server device, and the storage capacity to be used can be reduced.

  The program according to the present invention is a program installed and executed on a computer device, wherein the electronic teaching material is displayed on the display means, and an area designation receiving means for receiving an input for designating an arbitrary area from the display portion of the electronic teaching material; If it is determined that the designated area designated based on the input, the electronic content related to the contents of the electronic teaching material, the reproduction or display condition of the electronic content, and the designated area are selected, The computer apparatus is caused to function as a reproduction display control unit that causes the display unit or / and the audio output unit to reproduce or display the electronic content associated with the designated area according to the reproduction or display condition.

  In one aspect of the program, the associating unit causes the display unit to display a setting screen for setting the electronic content to be associated with the designated area and a reproduction or display condition of the electronic content, and the associated electronic content. When content is set, the content to be set as the playback or display condition is changed according to the type of the electronic content.

  In another aspect of the program, when the type of the electronic content set on the setting screen is a moving image, the associating unit inputs a playback start time and / or a playback end time for the electronic content. An input field is provided in the setting screen.

  In another aspect of the program, when the type of electronic content set on the setting screen is an electronic document, the association unit includes an input field for inputting a display page of the electronic content. Set in.

  In another aspect of the program according to the present invention, a screen having a coded pattern applied to the surface, a projector that emits light based on an image signal to the surface of the screen, and an image signal transmitted to the projector. An electronic device comprising: the computer device according to any one of claims 1 to 4; and an electronic pen that reads a coded pattern, calculates position coordinates of a pen tip, and transmits entry information including the position coordinates to the computer apparatus. A program mounted on and executed by the computer device of the pen system, wherein the reproduction display control unit is configured to project the electronic teaching material on the screen and display the screen based on the entry information received from the electronic pen. If it is determined that the designated area of the electronic teaching material projected on the screen is selected by the electronic pen The electronic content associated with the constant area, is reproduced or displayed on the display means and / or said sound output unit in accordance with the reproduction or display condition.

  According to still another aspect of the program according to the present invention, the computer apparatus according to any one of claims 1 to 4, the teaching material on which the coding pattern is printed, and the position of the pen tip portion by reading the coding pattern An electronic pen system comprising: an electronic pen that calculates coordinates and transmits entry information including the position coordinates to the computer apparatus, wherein the electronic teaching material converts the teaching material into electronic The reproduction display control means, based on the entry information received from the electronic pen, if it is determined that the area of the teaching material corresponding to the designated area of the electronic teaching material has been selected by the electronic pen, The display means or / and the audio according to the playback or display conditions for the electronic content associated with the designated area Is reproduced or displayed to the force means.

  In one aspect of the program, the computer device is connected to a server device that stores electronic content via a network, and the association unit associates the electronic content stored in the server device with the designated area. Electronic content is received from the server device.

  In another aspect of the program, the computer device is connected to a server device that stores electronic content via a network, and the reproduction display control unit associates with the designated area when the designated area is selected. The electronic content is reproduced or displayed on the display unit and / or the audio output unit by downloading the electronic content from the server device or receiving streaming distribution of the electronic content from the server device. Let

  The computer apparatus according to the present invention can be configured by installing and functioning these programs in the computer apparatus.

  According to the present invention, the computer device designates an arbitrary area from the displayed electronic textbook, and associates the designated display area with the reproduction display condition in addition to the electronic content. Thus, when the designated area is selected, the computer apparatus can reproduce the associated electronic content according to the associated reproduction display condition. Therefore, the computer device can reproduce and display the electronic content intended by the operator according to the intended reproduction display conditions, and can improve convenience.

1 shows a configuration of an electronic pen system according to an embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is a display example of an area designation screen. It is a display example of an association content setting screen. Indicates the data structure of the specified area definition information. A top view of the textbook in the spread state is shown. A display example of the file “worksheet.pdf” is shown. The structure of the electronic pen system which concerns on a modification is shown.

  Hereinafter, preferred embodiments for carrying out the present invention will be described with reference to the drawings. The electronic pen system described below is preferably used for school lessons, etc., and associates an arbitrary range of textbooks (teaching materials) with electronic contents such as videos and their playback or display conditions, and by operating the electronic pen. A system for playing back or displaying electronic content.

[Configuration of electronic pen system]
FIG. 1 shows a configuration of an electronic pen system according to the present embodiment. As shown in FIG. 1, the electronic pen system receives an electronic pen 1 used by a teacher, a textbook (teaching material) 2 in which a dot pattern is printed on almost the entire surface of each page, and entry information from the electronic pen 1. A computer device 3 for processing, a projector 4 that is connected to the computer device 3 and projects the same image as the display screen of the display onto the dot screen 5, and a dot screen 5 on which a dot pattern is printed. Hereinafter, each of these components will be described.

(textbook)
First, the textbook (electronic pen book) 2 will be described. On each page of the textbook 2, a dot pattern (coding pattern) indicating position coordinates described later is printed on substantially the entire surface. In addition, a dot pattern in a different coordinate range is printed on each page of the textbook 2. The dot pattern is printed with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and other characters and drawings are printed with ink that does not absorb infrared rays.

(Dot screen)
In the dot screen 5, a dot pattern (coded pattern) is printed on a white resin substrate with ink containing carbon that absorbs infrared rays so that the electronic pen 1 can read it. It has a layer structure protected by a resin layer or the like.

(projector)
The projector 4 is a projector that emits light obliquely downward from a vertically upward direction with respect to the dot screen 5, and is installed on, for example, a classroom wall. The projector 4 receives an image signal from the computer apparatus 3 and projects light constituting the same image as the screen of the computer apparatus 3 onto a predetermined projection range 50. In the projection range 50, as will be described later, an electronic textbook 2A (see FIG. 6 described later) obtained by digitizing the textbook 2 is displayed. The projector 4 may be a front projector that emits light toward the front of the dot screen 5 or a rear projector that emits light toward the back of the dot screen 5.

(Dot pattern)
Next, an Anoto dot pattern (coded pattern) printed on each page of the textbook 2 and the dot screen 5 will be described with reference to FIGS. FIG. 2 is a diagram for explaining the relationship between dots of a dot pattern and values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on each page of the textbook 2 and the dot screen 5 are determined by the combination of information thus associated. In addition, a dot pattern is formed so that a coordinate area does not overlap between the pages of the textbook 2 or each page of the textbook 2 and the dot screen 5.

  FIG. 3A shows an arrangement of a certain dot pattern. As shown in FIG. 3 (a), 6 × 6 dots within a range of about 2mm in length and width are unique patterns regardless of which portion of each page of textbook 2 or dot screen 5 takes 6 × 6 dots. It is arranged to become. The dot pattern formed by these 36 dots holds the position coordinates (for example, the position of the dot pattern on each page of the textbook 2 or the dot screen 5). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. 4, the electronic pen 1 includes an ink cartridge 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the ink cartridge 104 is a pen tip portion 103, and the user brings the pen tip portion 103 of the electronic pen 1 into contact with each page of the textbook 2 and the dot screen 5 to make a stroke (handwriting stroke). Fill out. Here, the first contact of the pen tip portion 103 of the electronic pen 1 with each page of the textbook 2 is referred to as “pen down”, and the pen tip portion 103 moves away from the contact (contact) state. Is called “pen-up”. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the ink cartridge 104 from the pen tip portion 103 when the user writes or taps characters or marks on each page of the textbook 2 with the electronic pen 1, that is, writing pressure, The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like on each page of the textbook 2 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108. Determines that the user has started entry, and activates the LED 105 and the CMOS camera 106. Then, the communication unit 111 detects pen down information (hereinafter referred to as “pen down information PD”) detected by the pressure sensor 107 and identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later. Are transmitted to the computer apparatus 3 as entry information. When the user finishes entering one stroke and moves the electronic pen 1 away from each page of the textbook 2, the pressure sensor 107 detects pen-up because the writing pressure exceeding a predetermined value is not detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 (hereinafter referred to as “pen-up information PU”) and the pen ID, and transmits the information as entry information to the computer apparatus 3.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on each page of the textbook 2. The region is slightly shifted from the position where the pen tip portion 103 contacts each page of the textbook 2. The CMOS camera 106 is provided with an infrared transmission filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105, and the image data of the dot pattern is captured. This is supplied to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Therefore, even when characters, drawings, and the like are printed on each page of the textbook 2, the printed ink does not absorb in the infrared region, so the processor 108 can recognize the dot pattern. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  The processor 108 performs X and Y coordinates (hereinafter simply referred to as “X” and “Y” coordinates in each page of the textbook 2 of the stroke (handwriting) to be filled in from the dot pattern of the image data supplied by the CMOS camera 106 while the user is filling in. (Also called “coordinate data” or “coordinate information”) is continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 106 into the data array shown in FIG. The data is converted into a Y coordinate bit value, and X and Y coordinate data are calculated from the data array by a predetermined calculation method. The processor 108 has a rotation correction processing function that corrects the arrangement of dots on the image due to the angle of the electronic pen 1 facing the dot pattern, and this function is exhibited during coordinate calculation. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. In addition, since the 6 × 6 dot pattern in each page of the textbook 2 and the dot screen 5 does not overlap in each page of the textbook 2 and the dot screen 5, when the user enters characters or the like with the electronic pen 1, It can be specified by coordinate calculation by the processor 108 which position on the page of the textbook 2 or the position of the dot screen 5 the entered position corresponds to.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. In the case of the electronic pen 1B for reading and writing the dot pattern on the dot screen 5, the communication unit 111 receives the pen ID, time information (time stamp), writing pressure data, and X and Y coordinate data. In association therewith, it is transmitted to the computer apparatus 3 as entry information. In this case, transmission to the computer apparatus 3 by the communication unit 111 is immediately and sequentially performed by wireless transmission such as Bluetooth (registered trademark). Here, one or more pieces of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the computer device 3 are stored as stroke information by the computer device 3. In other words, one stroke is composed of one or a plurality of X and Y coordinates (coordinate points), and the computer apparatus 3 is configured by one or more composing one stroke by the pen-down information PD and the pen-up information PU. Recognize pieces of coordinate attribute information.

(Computer device)
Next, the computer apparatus 3 will be described. The computer device 3 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse, a keyboard, and the like. The computer apparatus 3 may be configured by a tablet PC such as iPad (registered trademark), a PDA (Personal Data Assistance), a PC (personal computer) equipped with a display, or the like.

  FIG. 5 is a functional block diagram of the computer apparatus 3. Functionally, the computer apparatus 3 includes an input unit 31 such as a mouse and a keyboard, a communication unit 32, a storage unit 33, a processing unit 34, a display unit 36, and an interface 38. The communication unit 32 includes an antenna receiving circuit and the like, receives entry information from the electronic pen 1, and transmits the received information to the processing unit 34. The display means 36 is constituted by a display or the like, and displays the contents instructed by the processing means 34. The interface 38 is an interface for connecting to the projector 4. The interface 38 transmits an image signal for displaying an image on the display unit 36 to the projector 4 based on a processing command of the processing unit 34, and projects the same image as the image on the display unit 36 in synchronization.

  The processing means 34 is constituted by a processor such as a CPU and controls the entire computer device 3. The processing unit 34 includes an area designation receiving unit 341, an association unit 342, and a reproduction display control unit 343. The area designation receiving means 341 is a screen that displays an electronic textbook 2A in which the textbook 2 is digitized, and is a screen for designating an arbitrary area (range) associated with electronic content from the displayed electronic textbook 2A (“ Is also displayed on the display means 36. Then, the area designation receiving means 341 causes the instructor who is the operator to designate an area associated with the electronic content from the displayed electronic textbook 2A by dragging the mouse on the area designation screen. The area on the electronic textbook 2A (textbook 2) designated on the area designation screen is also referred to as “designated area As”. Details of the area designation screen will be described later with reference to FIG.

  Next, the associating unit 342 of the processing unit 34 sets the electronic content to be associated with the designated designated area As and the condition for reproducing or displaying (reproducing and displaying) the electronic content (also referred to as “reproduction display condition”). A screen for designating (also referred to as “association content setting screen”) is displayed on the display means 36. Then, the association unit 342 associates the designated area As, the electronic content, and the reproduction display condition with each other and stores them in the storage unit 33 based on the input on the association content setting screen. The association content setting screen is an example of the “setting screen” in the present invention, and details thereof will be described later with reference to FIG.

  Further, the reproduction display control means 343 of the processing means 34 is configured such that the designated area As in the page of the textbook 2 is tapped with the electronic pen 1 or the designated area As of the electronic textbook 2A projected on the dot screen 5 is electronic. When tapped by the pen 1, it is recognized that the designated area As is designated by the electronic pen 1 based on the entry information received from the electronic pen 1. The reproduction display control unit 343 displays the electronic content associated with the designated area As designated on the display unit 36 according to the associated reproduction display condition. This specific process will be described in detail in the [Association Utilization Process] section.

  Further, the processing unit 34 causes the projector 4 to project the calibration mark onto the dot screen 5 by displaying at least two or more calibration marks on the display unit 36, and the calibration mark is projected. The coordinate conversion function for converting the coordinate system related to the dot pattern of the dot screen 5 to the coordinate system related to the display of the display means 36 by causing the electronic pen 1 to read the dot pattern at the determined position and receiving the entry information. Obtain (calibration processing function). Further, when the processing unit 34 receives the coordinate system data related to the dot pattern of the dot screen 5 using the coordinate conversion function obtained by the calibration process, the processing unit 34 displays the coordinate system applied to the display of the display unit 36. The data is converted into data, and strokes are drawn or predetermined processing is performed.

  The storage means 33 is configured by a memory such as a ROM or a RAM. The storage unit 33 stores the entry information received from the electronic pen 1 for each pen ID according to the processing instruction of the processing unit 34. Further, the storage means 33 stores, for each type of textbook 2, information on the coordinate range indicated by the dot pattern corresponding to each page of the textbook 2 and the coordinate range indicated by the dot pattern corresponding to the dot screen 5 (“coordinate definition information”). Also called).

  Furthermore, the storage means 33 stores electronic contents to be associated with the designated area As in advance. This electronic content includes video data generated as a result of the lecturer taking a picture using a photographing means such as a video camera for the class. The storage means 33 is identification information of the textbook 2 corresponding to the designated area As for each designated area As based on the control of the area designation receiving means 341 when the designated area As is designated on the area designation screen. The textbook ID, the page number in which the designated area As is written, and the in-page position indicating the relative position in the page in which the designated area As is written are stored in association with each other. Hereinafter, the textbook ID, the page number, and the position in the page are also referred to as “designated area specifying information”. Further, when the electronic content to be associated with the designated area As and the reproduction / display conditions thereof are determined, the storage unit 33 determines the electronic content and reproduction / display that are determined for each designated area As based on the control of the association unit 342. Associate and store conditions. Hereinafter, the information indicating the correspondence between the specified area specifying information, the electronic content, and the reproduction / display conditions associated with each specified area As is also referred to as “specified area definition information”. The data structure of the designated area definition information will be described later with reference to FIG.

[Association]
Next, regarding the process of determining the designated area As and the process of associating the electronic content and the playback display condition with the designated area As (these processes are also simply referred to as “association process”), the area designation screen shown in FIG. Each will be described in detail with reference to the association content setting screen shown in FIG. The association process described below corresponds to a pre-process for executing the association utilization process described later, and is a process executed by the computer device 3 based on contents input by the instructor through the input unit 31 at the stage of class preparation. . Therefore, in the association process, the projector 4 and the computer apparatus 3 may not be electrically connected.

(1) Area Designation Screen FIG. 6 is a display example of the area designation screen 60 output by the display means 36 of the computer device 3. As shown in FIG. 6, the area designation screen 60 displays an electronic textbook 2A, operation buttons 361 to 364, and a designation completion button 365. The area designation receiving means 341 of the processing means 34 displays the area designation screen 60 shown in FIG. 6 on the display means 36 when the input means 31 detects a predetermined input for starting the area designation screen 60.

  As shown in FIG. 6, the area specification screen 60 displays the electronic textbook 2 </ b> A in a spread state in which each page of the textbook 2 is digitized, and allows the user to specify a page to be displayed by the electronic textbook 2 </ b> A. Operation buttons 361 to 364 are provided. The operation button 361 is a button for returning the display page of the electronic textbook 2A to the first page, that is, returning to the state where the first and second pages of the electronic textbook 2A are displayed. The operation button 362 is a button for returning the display page of the electronic textbook 2A by two pages (in FIG. 6, the pages 20 and 21 are displayed). The operation button 363 is a button for advancing the page displayed by the electronic textbook 2A by two pages (displaying pages 24 and 25 in FIG. 6). The operation button 364 is a button for advancing the display page of the electronic textbook 2A to the last page.

  The area designation screen 60 displays “Please specify the area to be linked by dragging.” As described above, the area designation receiving unit 341 displays on the area designation screen 60 a message prompting the operator to designate the designated area As by a drag operation with a mouse or the like. Then, the area designation receiving unit 341 detects from the input unit 31 an input by a mouse drag operation on the displayed electronic textbook 2A. Areas 21A to 21D indicate areas (regions) designated by a mouse drag operation. Preferably, the processing means 34 designates the areas 21A to 21D by a broken line frame, coloring, hatching, etc. (a broken line frame in FIG. 6) so that the operator can confirm the area designated by the drag operation of the mouse. It is good to display on the area designation | designated screen 60 by the aspect different from the area which is not.

  The designation completion button 365 is a button for determining the areas 21A to 21D designated by the mouse drag operation as the designated area As. When the designation completion button 365 is selected, the area designation receiving unit 341 stores each area of the textbook 2 corresponding to the areas 21A to 21D in the storage unit 33 as the designated area As. Specifically, the area designation receiving unit 341 includes a textbook ID attached to the electronic textbook 2A, a page number to which the areas 21A to 21D belong, and a position (range) of the areas 21A to 21D in the entire page. The position is stored in the storage unit 33 in association with each designated area As.

  FIG. 8A shows the data structure of the designated area definition information after the designation completion button 365 is selected. In FIG. 8A, “designated area number” refers to a serial number assigned to the designated area As in the designated order when the designated area As is designated. In addition, the textbook ID of the electronic textbook 2A (textbook 2) is “R01”, and the position in the page is defined by corner position coordinates (Xn, Yn), height (Y direction), and width (X direction). Has been. As shown in FIG. 8A, designated area specifying information such as a designated area number and textbook ID is stored in the storage means 33 in correspondence with each of the areas 21A to 21D designated by the mouse drag operation on the area designation screen 60. It is remembered.

(2) Association Content Setting Screen FIG. 7 is a display example of the association content setting screen 61 output from the display unit 36 of the computer apparatus 3. The association unit 342 displays the association content setting screen 61 on the display unit 36 when the designation completion button 365 in FIG. 6 is selected. As shown in FIG. 7, the association content setting screen 61 includes designated area displays 367A to 367D (367), file name display fields 368A to 368D (368), reference buttons 369A to 369D (369), and a reproduction display. Condition input fields 370A, 370Ba, 370Bb, 370Ca, 370Cb (370), a screen return button 371, and a setting completion button 372 are displayed. Further, on the association content setting screen 61, “Please set the content data to be linked” is displayed to the effect that the operator inputs the electronic content to be associated with the designated area As and its reproduction display condition.

  The designated area displays 367A to 367D respectively display the areas 21A to 21D designated as the designated area As on the area designation screen of FIG. The designated area displays 367A to 367D are vertically arranged for each page number to which the designated area As to be displayed belongs. Specifically, a designation area display 367A for displaying the area 21A on the page with the page number “22” is displayed at the top together with the page number, and designation for displaying the areas 21B to 21D on the page with the page number “23”. Area displays 367B to 367D are arranged below the designated area display 367A together with the page number.

  The file name display fields 368A to 368D display the electronic content file name associated with the designated area As corresponding to the designated area displays 367A to 367D or a path including the file name of the electronic content (here, only the file name is displayed). It is a column. The file name display field 368A displays the file name designated by reference buttons 369A to 369D described later. The reference button 369 is a button for displaying a window for designating a file when selected by a click operation and for allowing the operator to designate an arbitrary file stored in the storage means 33 of the computer apparatus 3. is there.

  The reproduction display condition input field 370 is an input field for inputting a reproduction display condition associated with each designated area As corresponding to the designated area displays 367A to 367D. When the electronic content file is selected by the reference button 369, the associating unit 342 displays a reproduction display condition input field 370 corresponding to the selected electronic content file. Here, the associating unit 342 displays a reproduction display condition input field 370 for inputting a reproduction display condition according to the type of the file based on the extension of the file of the electronic content displayed in the file name display field 368. indicate.

  Specifically, since “worksheet 1.pdf” is displayed in the file name display field 368A, the associating unit 342 uses electronic contents as electronic contents associated with the designated area As corresponding to the designated area display 367A. It is determined that the document is specified. Accordingly, the associating unit 342 displays the reproduction display condition input field 370A for inputting the page number to be displayed, and displays “display page” on the left side of the reproduction display condition input field 370A.

  In addition, since “fault XX town.mp4” is displayed in the file name display field 368B, the associating unit 342 displays a moving image file as electronic content associated with the designated area As displayed in the designated area display 367A. Is determined to be specified. Accordingly, the associating means 342 includes the start time (reproduction start time) of the time zone to be actually reproduced and the end time (reproduction end time) of the time zone to be actually reproduced among all the reproduction times of “fault XX town.mp4”. Are displayed in the reproduction display condition input fields 370Ba and 370Bb, respectively. Further, the processing means 34 displays “reproduction start” on the left side of the reproduction display condition input field 370Ba to clarify that the reproduction display condition input field 370Ba is a field for inputting the reproduction start time, and also displays the reproduction display. “Reproduction end” is displayed on the left side of the condition input column 370Bb to clarify that the reproduction display condition input column 370Bb is a column for inputting a reproduction end time. Here, an input to designate “2 minutes and 10 seconds” as the reproduction start time is made in the reproduction display condition input field 370Ba, and “2 minutes and 40 seconds” is designated as the reproduction end time in the reproduction display condition input field 370Bb. An input to do so has been made.

  Similarly, since “fault △ Δ village.mp4” is displayed in the file name display field 368C, the associating unit 342 displays video as electronic content to be associated with the designated area As displayed in the designated area display 367C. Judge that the file is specified. Accordingly, the associating unit 342 displays the reproduction display condition input fields 370Ca and 370Cb for inputting the reproduction start time and the reproduction end time, respectively. In this case, the reproduction display condition input field 370Ca is inputted to designate “5 minutes 12 seconds” as the reproduction start time, and “6 minutes 30 seconds” is designated in the reproduction display condition input field 370Cb. An input indicating that it is specified in

  Further, since “Fault □□ City.jpg” is displayed in the file name display field 368D, the associating means 342 displays an image file as electronic content associated with the designated area As displayed in the designated area display 367D. Is determined to be specified. Therefore, in this case, the processing unit 34 determines that it is not necessary to set the reproduction display condition, and does not provide the reproduction display condition input field 370 corresponding to the file name display field 368D.

  The screen return button 371 is a button for returning the output screen of the display means 36 to the area designation screen 60 of FIG. The setting completion button 372 is a button for confirming the setting content on the association content setting screen 61.

  When the setting completion button 372 is selected, the associating unit 342 selects the electronic content file displayed in the file name display fields 368A to 368D for each of the specified areas As displayed in the specified area displays 367A to 367D, Information that associates the reproduction display condition input in each reproduction display condition input field 370 is stored in the storage unit 33 as designated area definition information.

  FIG. 8B shows the data structure of the designated area definition information stored in the storage means 33 after the setting completion button 372 is selected. As shown in FIG. 8B, when the setting completion button 372 is selected in the state shown in FIG. 7, the associating unit 342 performs processing for each designated area number based on the input content on the associating content setting screen 61. The storage location (path) of the electronic content and the reproduction display condition are associated with each other and stored in the storage unit 33. Thereby, when the display position of the designated area As of the electronic textbook 2A displayed on the textbook 2 or the dot screen 5 is tapped with the electronic pen 1, the computer apparatus 3 displays the designated area definition information shown in FIG. By referencing, it is possible to execute the playback display of the electronic content in accordance with the specified playback display conditions.

[Associate processing]
Next, the association utilization process executed after the designated area definition information is generated will be described with reference to FIGS.

  FIG. 9 shows a top view of the textbook 2 in the spread state. The two-dot chain line frames 90A to 90D in FIG. 9 are virtual lines that indicate the positions of the designated areas As corresponding to the designated area numbers in FIG. 8B.

  In the state shown in FIG. 9, when the lecturer taps any position in the two-dot chain line frames 90 </ b> A to 90 </ b> D with the electronic pen 1, the reproduction display control unit 343 refers to the designated area definition information, and The electronic content associated with the corresponding designated area As is reproduced according to the associated reproduction display condition. Specifically, when the computer apparatus 3 receives from the electronic pen 1 entry information generated by the electronic pen 1 reading dot patterns printed in the two-dot chain lines 90A to 90D, the reproduction display control means 343 Referring to the coordinate definition information, the textbook ID indicated by the position coordinate, the page number, and the position in the page are recognized from the position coordinate indicated by the coordinate information included in the received entry information. Next, the reproduction display control means 343 refers to the designated area definition information and recognizes that the designated area As corresponding to the recognized textbook ID, page number, and position within the page exists. In this case, the reproduction display control means 343 reproduces the electronic content associated with the recognized designated area As according to the associated reproduction display condition.

  For example, when an arbitrary position in the two-dot chain line frame 90A shown in FIG. 9 is tapped by the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the information shown in FIG. Based on the designated area definition information, it is recognized that the designated area As having the designated area number “1” has been selected. Accordingly, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4 to display the first page of “worksheet.pdf” in the projection range 50 of the display unit 36 and the dot screen 5. .

  FIG. 10 shows a display example of the file “worksheet.pdf”. As shown in FIG. 10, the file “worksheet.pdf” has answer columns 70 </ b> A to 70 </ b> E. Then, when a student or the like writes with the electronic pen 1 to the answer columns 70A to 70E of “worksheet.pdf” displayed on the dot screen 5, the processing unit 34 converts the coordinate information included in the entry information into the coordinate information Based on the conversion function, it is converted into coordinate information on the screen of the display means 36, and a stroke is drawn on the display means 36 based on the coordinate information. In addition, the processing unit 34 transmits an image signal for displaying an image on the display unit 36 to the projector 4 to project the same image as the image on the display unit 36 in synchronization. Thereby, the stroke drawn by the writer of the electronic pen 1 is similarly projected onto the dot screen 5.

  With reference to FIG. 9 again, the operation when the designated area As is tapped with the electronic pen 1 will be described. When an arbitrary position in the two-dot chain line frame 90B shown in FIG. 9 is tapped by the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the designated area shown in FIG. Based on the definition information, it is recognized that the designated area As having the designated area number “2” has been selected. Accordingly, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4, and the moving image of “fault XX town.mp4” is divided into two minutes in the projection range 50 of the display unit 36 and the dot screen 5. Display from 10 seconds to 2 minutes 40 seconds.

  Similarly, when an arbitrary position in the two-dot chain line frame 90C is tapped with the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the designated area definition shown in FIG. Based on the information, it is recognized that the designated area As having the designated area number “3” has been selected. Accordingly, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4, and the moving image of “fault ΔΔ village.mp4” is displayed for 5 minutes in the projection range 50 of the display unit 36 and the dot screen 5. Display from 12 seconds to 6 minutes 30 seconds. When an arbitrary position in the two-dot chain line frame 90D is tapped with the electronic pen 1, the reproduction display control means 343 displays the entry information transmitted from the electronic pen 1 and the designated area definition information shown in FIG. 8B. Based on the above, it is recognized that the designated area As having the designated area number “4” has been selected. Therefore, in this case, the reproduction display control unit 343 transmits an image signal to the display unit 36 and the projector 4 to display an image of “fault □□ city.jpg” in the projection range 50 of the display unit 36 and the dot screen 5. .

  Similarly, when the page of the electronic textbook 2A is displayed in the projection range 50 of the dot screen 5, the computer device 3 similarly displays the entry information transmitted from the electronic pen 1 and the designated area definition shown in FIG. Based on the information, the electronic content is reproduced and displayed in accordance with designated reproduction display conditions. Specifically, when the display position of the designated area As within the projection range 50 is tapped with the electronic pen 1, the reproduction display control unit 343 displays the coordinate information of the received entry information on the display of the display unit 36 using the coordinate conversion function. The page number and the position in the page in the displayed electronic textbook 2A indicated by the converted position coordinates are recognized. Then, the reproduction display control means 343 refers to the designated area definition information, and determines whether or not the designated area As is designated based on the textbook ID corresponding to the electronic textbook 2A being displayed, the recognized page number, and the position in the page. If it is determined that the designated area As is designated, the electronic content associated with the designated area As is reproduced according to the reproduction display condition designated in the designated area definition information.

[Operational effects of the electronic pen system of the present embodiment]
According to the electronic pen system of the present embodiment, the computer device 3 receives an input for designating the designated area As from the display part of the electronic textbook 2A on the area designation screen. Further, the computer device 3 associates the designated area As, the electronic content, and the reproduction display condition on the association content setting screen. When the computer device 3 determines that the display position of the designated area As has been tapped with the electronic pen 1 on the textbook 2 or the dot screen 5, the electronic content associated with the tapped designated area As is reproduced according to the reproduction display condition. Display playback. Therefore, the computer device 3 can reproduce and display the electronic content intended by the operator according to the intended reproduction display conditions, and can improve convenience.

  Further, when the electronic content to be associated is set on the association content setting screen, the computer device 3 changes the configuration of the reproduction display condition input field 370 according to the type of the electronic content. Thereby, the computer apparatus 3 can make an operator input the reproduction | regeneration display conditions according to the kind of electronic content.

[Modification]
Next, a modification of this embodiment will be described. The following modifications may be applied in any combination to the above-described embodiment.

(Modification 1)
The electronic content may be stored in a server electrically connected to the computer device 3 instead of being stored in the storage unit 33. FIG. 11 shows a configuration of an electronic pen system according to a modification. As shown in FIG. 11, the electronic pen system includes a server 8 connected to the computer device 3 via a network.

  First, a method for uploading electronic content to the server 8 in this modification will be described. For example, when the server 8 is connected to a LAN (Local Area Network) built in the university, electronic contents related to the contents of the textbook 2 are obtained from a computer device such as a PC (Personal Computer) used by each instructor of the university. Upload to server 8. In another example, when the server 8 is connected to the Internet, electronic contents related to the contents of the textbook 2 are uploaded to the server 8 from computer devices used by teachers and employees of teaching material production companies nationwide.

  Next, in the present modification, the timing at which the computer apparatus 3 downloads electronic content from the server 8 will be specifically described using a first example to a third example. In the first example, the computer device 3 downloads electronic content related to the textbook 2 to be used from the server 8 before executing the above-described association process based on the operation of the operator. Then, the computer apparatus 3 performs the processing described in the section [Association Processing].

  In the second example, the computer device 3 downloads electronic content from the server 8 that is designated to be associated with the predetermined designated area As when the association content setting screen 61 is displayed. In the third example, the computer device 3 downloads the electronic content from the server 8 when the designated area As is selected after the association process is completed and the electronic content associated with the designated area As is reproduced and displayed. To do. In the third example, when the electronic content is a moving image, the computer device 3 may reproduce the electronic content by streaming instead of downloading the electronic content.

  Here, in the second example and the third example, preferably, when any reference button 369 is selected on the association content setting screen 61 in FIG. By accessing the means or the like, the electronic content stored in the server 8 can be selected as the electronic content associated with the designated area As.

(Modification 2)
In the association content setting screen 61 of FIG. 7, the computer apparatus 3 causes the operator to select electronic content to be associated with the designated area As by using the reference button 369. Instead, the computer device 3 may allow the operator to specify a URL (Uniform Resource Locator) such as a moving image site where the electronic content can be browsed. For example, in this case, the file name display fields 368A to 368D are input fields that can be directly input by keyboard input or the like, and the operator selects an arbitrary file name display field 368 and selects it by keyboard input or the like. Is input to the file name display field 368.

(Modification 3)
The electronic pen system includes an electronic board such as a pressure-sensitive board (sheet) configured to be able to detect pressure, or an electromagnetic board in which wires are embedded immediately below the surface of the board, instead of the dot screen 5. Also good. For example, in the case of a pressure-sensitive board, when pressure is applied with a predetermined pen (stylus), two electrically conductive sheets provided in the board come into contact with each other to generate an electric signal, and a computer is generated based on the electric signal. The device 3 detects the contact position. In the case of an electromagnetic board, the electronic pen system includes a stylus in which a coil is embedded instead of the electronic pen 1, and when the stylus is brought into contact with the electromagnetic board, the electromagnetic board contacts based on electromagnetic induction with the stylus. An electrical signal corresponding to the position is generated, and the computer device 3 detects the contact position based on the electrical signal.

  Then, regardless of which input system board (sheet) is used, the computer device 3 converts the coordinate system applied to the board to the coordinate system applied to the display of the display means 36 in the same manner as the dot screen 5. The coordinate conversion function for this is obtained in advance before performing the association process or the like. When the computer device 3 receives the coordinate data corresponding to the contact position on the board using the obtained coordinate conversion function, the computer device 3 converts the coordinate data into the coordinate system data applied to the display of the display means 36 and displays it. It is detected whether or not the designated area As in the electronic textbook 2A is selected.

(Modification 4)
The electronic pen system may include a tablet PC including a touch panel such as iPad (registered trademark) in which data of the electronic textbook 2 </ b> A is stored instead of the electronic pen 1 and the textbook 2.

  In this case, the tablet PC displays the electronic textbook 2A in a spread state and changes the displayed page based on the touch panel operation. Further, in the association utilization process, when the operator touches the display portion of the designated area As with a finger, the tablet PC displays the textbook ID associated with the electronic textbook 2A that has been in contact and the page number of the page that has been in contact. And a detection signal regarding the position in the page in the page is transmitted to the computer device 3, and the computer device 3 identifies the designated area As that has contacted based on the detection signal and is associated with the designated area As. Play and display electronic content.

(Modification 5)
The electronic content may be a moving image content including sound, or may be content only of sound. In this case, the computer apparatus 3 further includes sound output means such as a speaker, and the reproduction display control means 343 causes the sound output means to output sound when the electronic content to be reproduced includes sound.

(Modification 6)
In the above embodiment, as shown in FIG. 6, an arbitrary area is designated by dragging the mouse while the electronic textbook 2A is displayed. Instead, an area such as a block displaying a photo, an illustration, or a character displayed in the electronic textbook 2A may be set in advance so that it can be designated by a mouse click operation. Thereby, the user may be allowed to specify an area to be associated with the electronic content by clicking a mouse with an area such as an arbitrary photo, illustration, or block.

(Modification 7)
In the above embodiment, the Anoto method is used for the electronic pen, the dot pattern (coded pattern), and the entry information. However, the Anoto method is not necessarily limited.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Dot pattern paper 3 ... Computer apparatus 4 ... Projector 5 ... Dot screen 8 ... Server

Claims (16)

An area designation receiving means for displaying an electronic teaching material on a display means and receiving an input for designating an arbitrary area from the display portion of the electronic teaching material;
An association means for associating the designated area designated based on the input, the electronic content related to the content of the electronic teaching material, and the playback or display condition of the electronic content;
When it is determined that the designated area is selected, the display unit or / and the audio output unit reproduce or display the electronic content associated with the designated area according to the reproduction or display condition. A computer apparatus characterized by the above. The association means includes
A setting screen for setting the electronic content to be associated with the designated area and the playback or display conditions of the electronic content is displayed on the display means,
The computer apparatus according to claim 1, wherein when the associated electronic content is set, content to be set as the reproduction or display condition is changed according to a type of the electronic content. The association means includes
When the type of electronic content set on the setting screen is a moving image, an input field for inputting a playback start time and / or a playback end time for the electronic content is provided in the setting screen. The computer apparatus according to claim 2. The association means includes
The input field for inputting a display page of the electronic content is provided in the setting screen when the type of electronic content set on the setting screen is an electronic document. A computer device as described. A screen with a coded pattern on the surface;
A projector that emits light based on an image signal to the surface of the screen;
The computer apparatus according to any one of claims 1 to 4, which transmits an image signal to the projector;
An electronic pen system comprising: an electronic pen that reads an encoded pattern, calculates a position coordinate of a pen tip, and transmits entry information including the position coordinate to the computer device,
The reproduction display control means of the computer device includes:
When it is determined that the designated area of the electronic teaching material projected on the screen is selected by the electronic pen based on the entry information received from the electronic pen in a state where the electronic teaching material is projected and displayed on the screen.
An electronic pen system, wherein the electronic content associated with the designated area is reproduced or displayed on the display means and / or the audio output means in accordance with the reproduction or display conditions. A computer device according to any one of claims 1 to 4,
Teaching materials with printed coding patterns;
An electronic pen system comprising: an electronic pen that reads an encoded pattern, calculates a position coordinate of a pen tip, and transmits entry information including the position coordinate to the computer device,
The electronic teaching material is an electronic version of the teaching material,
The reproduction display control means includes
Based on the entry information received from the electronic pen, if it is determined that the area of the teaching material corresponding to the designated area of the electronic teaching material has been selected by the electronic pen,
An electronic pen system, wherein the electronic content associated with the designated area is reproduced or displayed on the display means and / or the audio output means in accordance with the reproduction or display conditions. The computer device is connected to a server device that stores electronic content via a network,
The computer device association means comprises:
The electronic pen system according to claim 5 or 6, wherein when the electronic content stored in the server device is associated with the designated area, the electronic content is received from the server device. The computer device is connected to a server device that stores electronic content via a network,
The reproduction display control means of the computer device includes:
When the designated area is selected, the electronic content associated with the designated area is downloaded from the server device, or the electronic content is received from the server device by streaming distribution. The electronic pen system according to claim 5 or 6, wherein the display unit or / and the voice output unit reproduces or displays the electronic pen system. A program installed and executed on a computer device,
An area designation receiving means for displaying an electronic teaching material on a display means and receiving an input for designating an arbitrary area from the display portion of the electronic teaching material;
An association means for associating the designated area designated based on the input, the electronic content related to the content of the electronic teaching material, and the playback or display condition of the electronic content;
When it is determined that the designated area has been selected, the computer apparatus as a reproduction display control means for reproducing or displaying the electronic content associated with the designated area on the display means or / and the audio output means according to the reproduction or display conditions A program characterized by functioning. The association means includes
A setting screen for setting the electronic content to be associated with the designated area and the playback or display conditions of the electronic content is displayed on the display means,
10. The program according to claim 9, wherein when the electronic content to be associated is set, contents to be set as the reproduction or display condition are changed according to the type of the electronic content. The association means includes
When the type of electronic content set on the setting screen is a moving image, an input field for inputting a playback start time and / or a playback end time for the electronic content is provided in the setting screen. The program according to claim 10. The association means includes
The input field for inputting a display page of the electronic content is provided in the setting screen when the type of electronic content set on the setting screen is an electronic document. The listed program. A screen with a coded pattern on the surface;
A projector that emits light based on an image signal to the surface of the screen;
The computer apparatus according to any one of claims 1 to 4, which transmits an image signal to the projector;
A program that is mounted on and executed by the computer apparatus of an electronic pen system that includes an electronic pen that reads an encoded pattern, calculates position coordinates of a pen tip, and transmits entry information including the position coordinates to the computer apparatus. There,
The reproduction display control means includes
When it is determined that the designated area of the electronic teaching material projected on the screen is selected by the electronic pen based on the entry information received from the electronic pen in a state where the electronic teaching material is projected and displayed on the screen.
A program for causing the display means and / or the audio output means to reproduce or display the electronic content associated with the designated area in accordance with the reproduction or display conditions. A computer device according to any one of claims 1 to 4,
Teaching materials with printed coding patterns;
A program that is mounted on and executed by the computer apparatus of an electronic pen system that includes an electronic pen that reads an encoded pattern, calculates position coordinates of a pen tip, and transmits entry information including the position coordinates to the computer apparatus. There,
The electronic teaching material is an electronic version of the teaching material,
The reproduction display control means includes
Based on the entry information received from the electronic pen, if it is determined that the area of the teaching material corresponding to the designated area of the electronic teaching material has been selected by the electronic pen,
A program for causing the display means and / or the audio output means to reproduce or display the electronic content associated with the designated area in accordance with the reproduction or display conditions. The computer device is connected to a server device that stores electronic content via a network,
The association means includes
The program according to claim 13 or 14, wherein when the electronic content stored in the server device is associated with the designated area, the electronic content is received from the server device. The computer device is connected to a server device that stores electronic content via a network,
The reproduction display control means includes
When the designated area is selected, the electronic content associated with the designated area is downloaded from the server device, or the electronic content is received from the server device by streaming distribution. The program according to claim 13 or 14, wherein the program is reproduced or displayed on the display unit or / and the audio output unit.