JP2013196603A - Terminal device, content reproduction system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device, a content reproduction system and a program, capable of appropriately setting a schedule time for reproducing or displaying content associated with an electronic teaching material.SOLUTION: A terminal device, on the basis of input to reproduction time zone input fields 63 and 64 of a reproduction time zone setting screen, sets a reproduction time zone of content associated with each of association areas 21 and 22, in the double-page spread of an electronic teaching material 2 including the association areas. Input is detected by an electronic blackboard for detecting pressure, a method of reading a position on a sheet of paper having a coded pattern with a pen, or the like.

Description

  The present invention relates to a technique for reproducing content such as a moving image associated with an electronic teaching material.

  2. Description of the Related Art Conventionally, electronic pens that digitize written information have been developed, and “Anot pen” developed by Swedish company Anoto is known as a representative one. For example, as described in Patent Document 1, the anotopen reads a predetermined dot pattern printed on a sheet, generates entry information, and transmits the entry information to the terminal device.

  Patent Document 2 describes a rotation correction processing function that corrects an arrangement of dots on an image caused by an angle of an electronic pen facing a dot pattern. Furthermore, Patent Literature 3 describes a lesson support system that displays teaching material data on a screen based on a scenario prepared in advance during a lesson. In this lesson support system, when the button displayed as “next page” is selected on the screen, the entire display area provided in the screen transitions according to a scenario prepared in advance.

Japanese Patent No. 3874498 Special table 2003-529853 gazette JP 2002-072850 A

  Content such as video related to a predetermined drawing part of the electronic textbook (educational material) is associated, and during the class, the electronic educational material is displayed on the screen etc. Can be played at any timing of the instructor. On the other hand, when a plurality of contents are associated with each page or spread page of the electronic teaching material, the instructor determines the playback time of each content in advance and conducts the lesson while checking the scheduled playback time of each content. It is convenient to be able to proceed. Therefore, a main object of the present invention is to provide a terminal device, a content reproduction system, and a program capable of appropriately setting a scheduled time for reproduction or display of content associated with an electronic teaching material.

  The terminal device according to the present invention includes a display control unit for displaying an electronic teaching material on a display unit, and a storage unit that stores information on an association area that is an area within a predetermined page of the electronic teaching material and is associated with content. Reproduction setting means for setting a scheduled reproduction or display time of the content associated with each of the association areas on the page or spread page of the electronic teaching material in which the association area is provided, based on an external input.

  The terminal device includes a display control unit, a storage unit, and a reproduction setting unit. On the page or spread page of the electronic teaching material provided with the association area, the content associated with each of the association areas is reproduced or Set the scheduled display time. At this time, the terminal device displays the electronic teaching material and determines a scheduled time for reproducing or displaying the content based on an external input by a user operation or the like. Here, the “scheduled time for playback or display of content” is not limited to the start time of playback or display of content, but indicates a period (time period) during which playback or display of content continues. May be. According to this aspect, the user can set the scheduled time of reproduction or display of each content to be reproduced in a class or the like on the terminal device.

  In one aspect of the terminal device, the playback setting unit sets the playback or display order of the content before setting the scheduled playback or display time of the content, and the display control unit is set An input field for inputting the scheduled time of reproduction or display corresponding to each order of the reproduction or display is displayed on the display means. According to this aspect, the terminal device can preferably set the scheduled time for reproduction or display of each content in the same page or the spread page scheduled to be reproduced or displayed.

  In another aspect of the terminal device, the display control unit displays the input field on the display unit in association with the association area of the content for which the reproduction or display scheduled time is set by the input field. Let According to this aspect, the user can perform time setting while referring to the association area corresponding to the content for which scheduled playback or display time is set.

  In another aspect of the terminal device, the display control unit may perform the playback or display in a predetermined time zone including the scheduled playback time and display time and the current time after the scheduled playback or display time is set. A bar indicating the position of the scheduled time and the position of the current time is displayed on the display means. According to this aspect, the user can easily grasp the scheduled time of reproduction or display of each set content.

  In another aspect of the terminal device, the display control unit may determine the scheduled playback or display time on the bar when the scheduled playback or display time set by the playback setting unit approaches within a predetermined time. Highlight the display. With this aspect, the user can easily recognize the fact when the set scheduled time for reproduction or display of each content is approaching.

  In another aspect of the terminal device, if the corresponding content is not yet played or displayed even after the scheduled playback or display time set by the playback setting means has elapsed, the playback or display on the bar is not displayed. Highlight the scheduled time display. According to this aspect, the user can easily grasp the existence of unreproduced or undisplayed content that has passed the set scheduled reproduction or display time of each content.

  In another aspect of the terminal device, if the corresponding content is not yet played or displayed after the scheduled playback or display time set by the playback setting unit has elapsed, the content is automatically played back. Alternatively, a playback control means for displaying is further provided. According to this aspect, the terminal device can reproduce or display each content according to the scheduled reproduction time set by the user.

  In another aspect of the terminal device, the display control unit has already played or displayed the content in response to the display of the scheduled time of playback or display in the bar corresponding to the content that has already been played or displayed. A notice to that effect is attached. According to this aspect, the user can easily distinguish whether or not each display of the reproduction or display scheduled time displayed on the bar corresponds to the content that has already been reproduced or displayed.

  In another aspect of the terminal device, the display control unit may be configured such that the scheduled playback or display time of the content set by the playback setting unit is different from the actual playback or display time of the content. The display position of the scheduled time of display or reproduction of the content on the bar is changed to the position of the time when the content is actually reproduced or displayed. According to this aspect, the user can easily grasp the position of the time when the content is actually reproduced or displayed by visually recognizing the bar.

  The content reproduction system according to the present invention includes a terminal device, an electronic sheet that detects a contact position, transmits a detection signal indicating the contact position to the terminal device, and light based on an image signal transmitted from the terminal device. A content reproduction system comprising: a projector that emits light on a surface of the electronic sheet, wherein the terminal device includes display control means for projecting and displaying the electronic teaching material on the electronic sheet by the projector; and a predetermined page of the electronic teaching material Storage means for storing information on the association area associated with the content, and each of the association areas on the teaching material page or spread page provided with the association area based on the detection signal Playback setting means for setting a scheduled time for playback or display of the associated content. According to this aspect, the content reproduction system displays electronic teaching materials on an electronic sheet, and suitably determines the scheduled time for reproduction or display of the content associated with the same page or the same spread page based on an operation on the electronic sheet. be able to.

  In another aspect of the content reproduction system according to the present invention, the teaching material on which the coded pattern is printed, the terminal device, the coded pattern is read to calculate the position coordinate or code value of the pen tip, and the position coordinate or An electronic pen that transmits entry information including a code value to the terminal device, wherein the terminal device stores information on an association area of the learning material associated with content, and the electronic Playback setting means for setting a scheduled playback or display time of the content associated with the association area on the teaching material page or spread page provided with the association area based on the entry information received from the pen . According to this aspect, the content reproduction system can suitably determine the scheduled reproduction or display time of the content associated with the same page or the same spread page based on the operation of the teaching material with the electronic pen.

  In still another aspect of the content reproduction system according to the present invention, the terminal device reads the coded pattern, calculates the position coordinate or code value of the pen tip, and enters the input information including the position coordinate or code value into the terminal An electronic pen for transmitting to the device; a screen having a coding pattern on the surface; and a projector for emitting light based on an image signal transmitted from the terminal device to the surface of the screen, the terminal device Display control means for projecting and displaying the electronic teaching material on the screen by the projector, storage means for storing information on an association area that is an area within a predetermined page of the electronic teaching material and is associated with the content, Based on the entry information received from the electronic pen, the page or page of the electronic teaching material provided with the association area is provided. Having a reproduction setting means for setting a reproduction or display of scheduled time of the content associated with the associated area of the page. According to this aspect, the content reproduction system suitably determines the scheduled time for reproduction or display of the content associated with the same page or the same spread page based on the operation of the electronic pen on the screen with the coding pattern attached to the surface. be able to.

  The program according to the present invention is caused to function as any one of the terminal devices described above. By installing these programs in the terminal device and causing them to function, the terminal device according to the present invention can be configured.

  According to the present invention, the terminal device sets the scheduled time for reproduction or display of the content associated with each of the association areas on the page or spread page of the electronic teaching material provided with the association area based on the external input. As a result, in a class or the like, the user can set a scheduled time for reproduction or display of each content to be reproduced in the terminal device, and can proceed with the class while confirming the scheduled time.

1 shows a configuration of a content reproduction system according to the present embodiment. It is an example of a display of an electronic textbook. It is a functional block diagram of a terminal device. The data structure of association area information is shown. The display screen of the terminal device just before the icon for color-coded display of an association area is selected is shown. The display screen of the terminal device after the icon for color-coded display of an association area is selected is shown. The change in the position of the fingertip on the electronic textbook accompanying the setting of the playback order is shown. The display screen of the terminal device on which the spread page in which the reproduction order is set is displayed is shown. It is a display example of a reproduction time zone setting screen. The reproduction time zone setting screen immediately before the completion button is selected is shown. The reproduction time management screen displayed after a reproduction order and a reproduction time zone are set is shown. A display example of the file “worksheet 1.pdf” is shown. The reproduction time management screen concerning a modification is shown. The reproduction time management screen concerning a modification is shown. The structure of the content reproduction system which concerns on 2nd Embodiment is shown. The relationship between the dot pattern dot and the value to which the dot is converted is shown. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen.

  Hereinafter, preferred embodiments for carrying out the present invention will be described with reference to the drawings. The content playback system described below is preferably used for school classes, etc., and an arbitrary range of digitized electronic textbooks (educational materials) is associated with content such as videos, and is contained in the same spread page. This is a system in which the playback order of associated contents can be set in advance. The “page spread” refers to a set of pages that are lined up or down or left and right when an electronic textbook is displayed.

<First Embodiment>
[Content playback system configuration]
FIG. 1 shows a configuration of a content reproduction system according to the first embodiment. As shown in FIG. 1, the content reproduction system displays an electronic textbook 2 described later and performs a predetermined process based on an input from a user, and is connected to the terminal device 3, and a display screen of the display The projector 4 which projects the same image on the electronic blackboard 5, and the electronic blackboard (electronic sheet) 5 which can detect the contacted position are provided. Hereinafter, each of these components will be described.

(Electronic textbook)
First, the electronic textbook 2 displayed on the display of the terminal device 3 will be described. FIG. 2 shows a top view of the electronic textbook 2 in which a certain page (pages 22 and 23) is displayed in a spread state. The electronic textbook 2 shown in FIG. 2 is displayed on the electronic blackboard 5 in the same manner.

  As shown in FIG. 2, the electronic textbook 2 is displayed for each spread page, and each spread page is an operation in which a content display area 20 in which the content of the textbook is described and selectable icons 41 to 62 are displayed. Region 40.

  The content display area 20 includes an area (also referred to as “association area”) associated with content such as a moving image, an image, PDF (registered trademark), or audio data. When the association area is selected, the content associated with the region (also referred to as “association content”) is played by the terminal device 3.

  Next, functions associated with the icons 41 to 62 will be described. The icon 41 is an operation area for displaying a table of contents of the electronic textbook 2 shown in FIG. 3 to be described later on the display of the terminal device 3. The icon 42 is an operation area for displaying the electronic textbook 2 in front of the content when the content is reproduced or displayed on the display of the terminal device 3. The icon 43 is an operation area for returning the double-page spread of the electronic textbook 2 displayed on the display of the terminal device 3 by two pages. The icon 44 is an operation area for advancing the double-page spread of the electronic textbook 2 displayed on the display of the terminal device 3 by two pages.

  Icons 45 and 46 are operation areas for switching to the writing mode. Specifically, the icon 45 is an operation area for switching to a writing mode in which a stroke of a free curve that reproduces a locus of a position where a stylus or the like touches on the electronic textbook 2 is drawn on the electronic textbook 2. The icon 46 is an operation area for switching to a writing mode in which a linear stroke based on the locus of the position where the stylus or the like touches on the electronic textbook 2 is drawn on the electronic textbook 2. The icon 47 is an operation area for designating the stroke color drawn in the writing mode corresponding to the icon 45 or 46 as red, and the icon 48 is an operation area for designating the stroke color as blue. It is. As will be described later, the user can select the icon 45 or 46 and draw a stroke based on the locus of the contact position of the stylus on the display on the electronic textbook 2 even during the reproduction of the content. is there.

  The icon 49 is an operation area for switching between display and non-display of the stroke drawn in the writing mode corresponding to the icon 45 or 46. The icon 50 is an operation area for switching to a mode in which the display position of a stroke drawn on the electronic textbook 2 is moved based on a drag operation. The icon 51 is an operation area for enlarging and displaying an area designated by the drag operation. The icon 52 is an operation area for deleting a stroke existing at a position where contact is detected on the display. The icon 53 is an operation area for erasing all strokes drawn on the spread page on which the icon 53 is printed. The icon 54 is an operation area for starting playback of a stopped or paused moving image. The icon 55 is an operation area for rewinding the moving image being reproduced. The icon 56 is an operation area for pausing the moving image being played back. The icon 57 is an operation area for fast-forwarding the moving image being reproduced. The icon 58 is an operation area for stopping the moving image being reproduced.

  The icon 59 is an operation area for highlighting the association area in the electronic textbook 2 with a color. A display example when the icon 59 is selected will be described in detail in the section “Displaying Association Area”. The order setting icon 60 is an operation area for instructing the start and end of a mode (also referred to as “playback order setting mode”) for setting the playback order of content associated with the association area on the same spread page. is there. The playback order setting mode will be described in detail in the section “Setting the playback order”. The reproduction icon 61 is an operation area for giving an instruction to sequentially reproduce the associated content according to the set reproduction order. The functions associated with the playback icon 61 will be described in detail in the [Reproduction of content] section.

  The time setting icon 62 is a screen of the electronic textbook 2 having an input field for setting a scheduled time zone (scheduled time) for reproducing or displaying content associated with the association area on the same spread page (“playback time zone setting”). This is an operation area for displaying “screen” on the display. The playback time zone setting screen will be described in detail in the section “Setting the playback time zone”.

(projector)
The projector 4 is a projector that emits light obliquely downward from the vertically upward direction to the electronic blackboard 5, and is installed on, for example, a classroom wall. The projector 4 receives an image signal from the terminal device 3 and projects light constituting the same image as the screen of the terminal device 3 onto a predetermined projection range 50. In the projection range 50, the electronic textbook 2 and the like are displayed. The projector 4 may be a front projector that emits light toward the front of the electronic blackboard 5 or a rear projector that emits light toward the back of the electronic blackboard 5.

(Electronic blackboard)
The electronic blackboard 5 is a pressure-sensitive board (sheet) configured to be able to detect pressure. When pressure is applied to the electronic blackboard 5 with a predetermined pen (stylus), two electrically conductive sheets provided in the board come into contact with each other to generate an electric signal, and input information based on the electric signal is transmitted to the terminal. Transmit to device 3. Then, the terminal device 3 detects the contact position based on the input information received from the electronic blackboard 5.

  Further, the projector 4 projects light constituting the same image as the screen of the terminal device 3 onto the projection range 50 of the electronic blackboard 5. Specifically, the electronic textbook 2 shown in FIG.

  The electronic blackboard 5 may be an electromagnetic board in which a wire is embedded directly under the board surface. In this case, the content reproduction system includes a stylus in which a coil is embedded, and when the stylus is brought into contact with the electromagnetic board, the electromagnetic board generates an electrical signal corresponding to the contact position based on electromagnetic induction with the stylus, and Based on the electrical signal, the terminal device 3 detects the contact position.

  Even when the electronic blackboard 5 is of any input method, the terminal device 3 converts the coordinate system for the electronic blackboard 5 into a coordinate system for the display of the terminal device 3 as described later. Is obtained in advance. When the terminal device 3 receives the coordinate data corresponding to the contact position on the board using the obtained coordinate conversion function, the terminal device 3 converts the coordinate data into the data of the coordinate system applied to the display of the display means 36 and displays it. Which icon 41 to 62 in the electronic textbook 2 or the association area is selected is detected.

(Terminal device)
Next, the terminal device 3 will be described. The terminal device 3 includes, as hardware, an antenna device capable of data communication with the electronic blackboard 5, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse, a keyboard, and the like. The terminal device 3 may be configured by a tablet PC such as iPad (registered trademark), a PDA (Personal Data Assistance), or a PC (personal computer) including a display. Here, as an example, it is assumed that the terminal device 3 is a tablet PC capable of input using a touch panel.

  FIG. 3 is a functional block diagram of the terminal device 3. Functionally, the terminal device 3 includes an input unit 31 such as a touch panel, a communication unit 32, a storage unit 33, a processing unit 34, a display unit 36, and an interface 38. The communication unit 32 is configured by an antenna receiving circuit or the like, receives input information from the electronic blackboard 5, and transmits the received information to the processing unit 34. The display means 36 is constituted by a display or the like, and displays the contents instructed by the processing means 34. The interface 38 is an interface for connecting to the projector 4. The interface 38 transmits an image signal for displaying an image on the display unit 36 to the projector 4 based on a processing command of the processing unit 34, and projects the same image as the image on the display unit 36 in synchronization.

  The processing means 34 is constituted by a processor such as a CPU and controls the entire terminal device 3. The processing unit 34 includes a display control unit 341, a reproduction setting unit 342, and a reproduction control unit 343. Then, when the processing unit 34 detects that the icons 41 to 62 displayed on the display of the display unit 36 are selected by a touch panel operation, the processing unit 34 performs predetermined processing according to the function associated with the selected icon. .

  Specifically, when the icons selected by the touch panel operation are the icons 41 to 44, the display control unit 341 of the processing unit 34 follows the function associated with the icon selected by the touch panel operation, and the predetermined number of the electronic textbook 2 The display means 36 displays the page in a spread state.

  When the icon selected by the touch panel operation is the icon 45 or 46, the display control unit 341 starts the writing mode. Specifically, in the writing mode, the display control unit 341 draws a free-form curve or a straight line stroke on the electronic textbook 2 based on the position coordinates of the contact position detected by the touch panel. In this case, the display control unit 341 draws a stroke regardless of whether the content is being reproduced. In the writing mode, the display control unit 341 may display the electronic textbook 2 and the content being displayed side by side. If the content is a moving image, the display control unit 341 displays the content within the association area corresponding to the content. May be. When the content is audio data, the display control unit 341 displays only the electronic textbook 2 while not displaying the software for reproducing the audio data while outputting audio to a speaker (not shown). Also good.

  When the icons selected by the touch panel operation are the icons 47 to 53, the display control unit 341 executes a predetermined process according to the function associated with the icon selected by the touch panel operation. In addition, when the icons selected by the touch panel operation are the icons 54 to 58, the reproduction control unit 343 performs reproduction control of the moving image content to be reproduced according to the function associated with the icon selected by the touch panel operation. When the icon selected by the touch panel operation is the icon 59, the display control unit 341 displays the association area in different colors according to the type of the associated content.

  When the icon selected by the touch panel operation is the icon 60, the processing unit 34 starts the reproduction order setting mode. In the reproduction order setting mode, the reproduction setting means 342 of the processing means 34 determines the reproduction order of the contents associated with the association area on the same spread page. This process will be described in detail in the section “Setting the playback order”. When the icon selected by the touch panel operation is the reproduction icon 61, the reproduction control unit 343 reproduces the associated content to be reproduced next according to the set reproduction order. This process will be described in detail in the [Content Playback] section. When the icon selected by the touch panel operation is the time setting icon 62, the display control unit 341 displays a playback time zone setting screen on the display. Then, the playback setting means 342 sets a scheduled playback time zone (also simply referred to as “playback time zone”) of each content whose playback order is determined based on the input on the playback time zone setting screen. This process will be described in detail in the section “Setting the playback time zone”. Further, when the association area of the electronic textbook 2 is selected, the processing unit 34 refers to association area information described later, and reproduces or displays the content associated with the association area selected by the touch panel operation.

  Further, the processing unit 34 causes the projector 4 to project the calibration mark on the electronic blackboard 5 by displaying at least two calibration marks on the display unit 36, and the calibration mark is projected. By receiving the input information corresponding to the position, a coordinate conversion function for converting the coordinate system applied to the electronic blackboard 5 to the coordinate system applied to the display of the display means 36 is obtained (calibration processing function). Further, the processing means 34 converts the coordinate system data concerning the electronic blackboard 5 into the coordinate system data concerning the display of the display means 36 when the coordinate system data concerning the electronic blackboard 5 is received using the coordinate transformation function obtained by the calibration process. To do. Then, when the processing unit 34 recognizes that the icons 41 to 62 displayed on the electronic blackboard 5 are selected based on the coordinate system data on the display after conversion, the processing unit 34 is displayed on the display of the terminal device 3. The same processing as when the icons 41 to 62 are selected is executed. Further, when the processing unit 34 recognizes that the association area displayed on the electronic blackboard 5 has been selected based on the coordinate system data applied to the converted display, the processing unit 34 refers to the association area information described later and is selected. The content associated with the associated area is reproduced or displayed.

  The storage means 33 is configured by a memory such as a ROM or a RAM. The memory | storage means 33 memorize | stores the electronic textbook 2 which digitized each textbook. Furthermore, the storage unit 33 stores content associated with each association area and also stores information associated with each association area (also referred to as “association area information”). FIG. 4 shows the data structure of the association area information. As shown in FIG. 4, the association area information includes an “area number” item indicating the identification number of each association area, an “textbook ID” item indicating the identification information of the electronic textbook 2, and the page number of the association area. In the same spread page, the “page number” item indicating the relative position in the page, the “in-page position” item indicating the relative position in the page, and the “associating content” item indicating the path and file name of the associated content. The item “reproduction order” indicating the reproduction order of the associated content, the item “reproduction start time” indicating the scheduled start time of reproduction or display of the associated content, and the scheduled end time of reproduction or display of the associated content “ Information corresponding to the item “reproduction end time” is associated with each other. Here, it is assumed that the textbook ID of the electronic textbook 2 shown in FIG. 2 is “R01”, and the position in the page is the corner position coordinates (Xn, Yn), the height (Y direction), and the width (X direction). ). In addition, the value of the item “playback order” is set based on the processing described in the “playback order setting” section described later. Each value of the item “reproduction start time” and the item “reproduction end time” is set based on the processing described in the section “Setting the reproduction time zone” described later.

  Note that the association area information other than the reproduction order and the reproduction start time and the reproduction end time may be stored in the storage unit 33 in advance, or may be generated by the processing unit 34 based on a user input. In the latter case, for example, in the state where the electronic textbook 2 is displayed, the processing unit 34 allows the user to specify an area to be an association area by a drag operation to the touch panel or the like, and a content to be associated with the association area is selected for file selection. The user is designated by displaying a GUI (Graphical User Interface) or the like. The associated content may be video data generated as a result of the instructor taking a picture using a video camera or the like for the lesson, still image data, or a worksheet. May be.

[Display Association Area]
Next, display of the electronic textbook 2 when the icon 59 is selected will be described. FIG. 5 shows a display screen of the terminal device 3 immediately before the icon 59 is selected.

  As shown in FIG. 5, immediately before the icon 59 is selected, the association area of the area number N1 existing on page 22 and the association area of the area number N2 existing on page 23 stored in the association area information of FIG. Are displayed in a manner that cannot be distinguished from other areas. And a user touches the display part of the icon 59 in the display screen of the terminal device 3 with a fingertip, when setting the reproduction | regeneration order of related content.

  FIG. 6 shows the display screen of the terminal device 3 after the icon 59 is selected. As shown in FIG. 6, when the icon 59 is selected, the display control unit 341 displays each association area in different colors for each type of associated content. Specifically, the association area “21” of the area number N1 associated with the PDF file “worksheet 1.pdf” having the extension “pdf” is displayed in a state of being colored blue. On the other hand, the association area “22” associated with the moving image file “fault XX town.mp4” with the extension “mp4” is displayed in a state of being colored red. In this way, the user can easily grasp the position and range of each association area and the type of content associated with the association area. And when the icon 59 is touched again, the display control means 36 switches again from the display shown in FIG. 6 to the display shown in FIG.

  The display screens shown in FIGS. 5 and 6 are the same as the display projected on the projection range 50 of the electronic blackboard 5, and similarly when the icon 59 projected and displayed on the electronic blackboard 5 is selected. The display shown in FIG. 5 and the display shown in FIG. 6 are switched.

[Set playback order]
Next, a method for setting the playback order of related content when a plurality of related areas exist in the same spread page will be specifically described. Schematically, the reproduction setting unit 342 determines the reproduction order of the associated content based on the order of the association areas touched on the display of the terminal device 3 in the reproduction order setting mode.

  FIG. 7 is a diagram showing a change in the position of the fingertip to be operated according to the setting of the reproduction order on the electronic textbook 2 displayed on the display screen of the terminal device 3. First, the icon 60 is touched with the fingertip 80 (first step). In this case, the processing means 34 recognizes that the icon 60 has been touched based on the detection signal transmitted from the touch panel, and starts the reproduction order setting mode. Thereafter, a plurality of association areas existing in the same spread page are touched in the order in which the associated contents are to be reproduced, according to the user's intention.

  In the example shown in FIG. 7, the association area 21 is touched with the fingertip 80 (second step). In this case, the reproduction setting unit 342 of the processing unit 34 recognizes that the association area 21 has been touched based on the detection signal transmitted from the touch panel. Then, the reproduction setting unit 342 sets the reproduction order of the contents associated with the association area 21 among the associated contents associated with the spread pages (here, pages 22 and 23) to the first.

  Thereafter, the association area 22 is touched with the fingertip 80 (third step). In this case, the reproduction setting unit 342 of the processing unit 34 recognizes that the association area 22 has been selected by a touch panel operation. Then, the reproduction setting unit 342 sets the reproduction order of the associated content associated with the association area 22 among the associated content associated with the spread pages to the second.

  Next, the icon 60 is touched again with the fingertip 80 (fourth step). In this case, the reproduction setting unit 342 recognizes that the icon 60 has been touched based on the contact position detected by the touch panel, and ends the reproduction order setting mode. As a result, the reproduction setting unit 342 determines the reproduction order of the spread pages displayed on the display of the terminal device 3. Specifically, the reproduction setting unit 342 indicates that the reproduction order of “worksheet 1.pdf” which is the content associated with the association area 21 is the first, as shown in FIG. And stores in the association area information that the reproduction order of “fault XX town.mp4” that is the content associated with the association area 22 is No. 2.

  As described above, the reproduction setting unit 342 sets the reproduction order of the associated content on an arbitrary spread page having a plurality of association areas in accordance with the order that the user intentionally touches without requiring a complicated operation from the user. Can be determined.

  Even when the icon 60 of the electronic textbook 2 projected and displayed in the projection range 50 of the electronic blackboard 5 is selected, the reproduction setting unit 342 similarly starts the reproduction order setting mode. The reproduction setting means 342 stores the order in which the association area of the electronic textbook 2 projected and displayed in the projection range 50 of the electronic blackboard 5 is selected in the reproduction order setting mode. When the reproduction icon 61 is selected again and the reproduction order setting mode is terminated, the reproduction setting unit 342 displays the reproduction order on the spread page projected and displayed on the electronic blackboard 5 in the reproduction order setting mode. It determines based on the selected order, and memorize | stores in the association area information shown in FIG.

[Display after setting playback order]
Next, the display screen of the terminal device 3 after the playback order is set will be described with reference to FIG. FIG. 8 shows a display screen of the terminal device 3 on which a spread page in which the reproduction order is set is displayed.

  As shown in FIG. 8, when displaying the spread page in which the reproduction order is set, the display control unit 341 displays the reproduction order number of the corresponding associated content on the association areas 21 and 22 in which the reproduction order is set. Superimposed display. In the example shown in FIG. 8, “(1)” is displayed in the association area 21 in which the playback order is set to No. 1, and “(( 2) ”is attached.

  In this way, when the display control unit 341 displays the spread page in which the reproduction order is set on the display of the terminal device 3, the display showing the set reproduction order so that the user can visually recognize the set reproduction order. Is attached to the corresponding association area. Thereby, the user can easily grasp the set reproduction order on the display of the terminal device 3 or on the electronic blackboard 5. When the icon 59 displayed on the display of the terminal device 3 or the electronic blackboard 5 is selected, the display control unit 341 may switch the display / non-display of the reproduction order as in the case of highlighting by color.

[Playback time zone setting]
Next, a specific description will be given of a method for setting the playback time zone of each associated content for which the playback order is set. As will be described below, the display control unit 341 displays a playback time zone setting screen on the display, and the playback setting unit 342 displays each associated content in which the playback order is set based on the input on the playback time zone setting screen. Set the playback time zone.

  FIG. 9 shows a playback time zone setting screen displayed when the time setting icon 62 is selected. As shown in FIG. 9, the display control means 341 uses the operation area 40 of the playback time zone setting screen to display a playback time zone for inputting the playback time zone of the associated content in which the playback order is set instead of the icons 41 to 62. Time zone input fields 63 and 64 and a completion button 65 for confirming the input contents of the playback time zone input fields 63 and 64 are displayed.

  The playback time zone input field 63 is an input field for inputting the playback time zone of the file “worksheet 1.pdf” whose playback order is set to No. 1. The playback time zone input field 64 has the playback order. This is an input field for inputting the playback time zone of the moving image content “fault XX town.mp4” set to No. 2. The display control means 341 then displays “(()” in the same manner as in the association area 21 so that it can be visually recognized that the reproduction time zone input field 63 is a field for inputting the reproduction time zone of the first associated content in the reproduction order. 1) ”is added. In addition, the display control means 341 displays “(()” in the same manner as in the association area 22 so that it can be visually recognized that the reproduction time zone input field 64 is a field for inputting the reproduction time zone of the second related content in the reproduction order. 2) ”is added. As described above, the display control unit 341 associates the reproduction time zone input fields 63 and 64 with each association content for which the reproduction order is set, among the association content of the spread pages for which the time setting icon 62 is selected. Display each. When the playback time zone input fields 63 and 64 are selected, the playback setting means 342 displays a GUI such as a keyboard for inputting numbers, for example, and displays the playback start time and playback end time to the user by touch panel operation. Let each input.

  FIG. 10 shows a playback time zone setting screen immediately before the completion button 65 is selected. When the completion button 65 is touched with the fingertip 80, the reproduction setting unit 342 stores the reproduction start time and reproduction end time of each associated content input in the reproduction time zone input fields 63 and 64 in the storage unit 33 as association area information. Remember. Specifically, as shown in FIGS. 4 and 10, the playback setting unit 342 sets the playback start time of the file “worksheet 1.pdf” whose playback order is No. 1 to “14:20” and the playback end time. Is set to “14:25”, the playback start time of the video content “fault XX town.mp4” of playback number 2 is “14:40”, and the playback end time is “14:50” Set to each. Then, the playback setting means 342 switches the display screen from the playback time zone setting screen to the screen of the electronic textbook 2 on which the icons 41 to 62 shown in FIG. 8 are displayed.

  Even when the reproduction time zone input fields 63 and 64 of the electronic textbook 2 projected and displayed on the projection range 50 of the electronic blackboard 5 are selected, the terminal device 3 similarly has, for example, a keyboard for inputting numbers. Is displayed on the electronic blackboard 5 to allow the user to input the playback start time and playback end time. In this case, the reproduction control unit 343 converts the coordinate information of the input information received from the electronic blackboard 5 into a coordinate system applied to the display of the display unit 36 by a coordinate conversion function, and inputs the reproduction time zone based on the converted position coordinates. It is recognized that the fields 63 and 64 are designated.

[Play content]
Next, a method for reproducing content for which the reproduction order has been set will be described. After the playback order and playback time zone are set, the playback control means 343 displays a screen (also referred to as “playback time management screen”) that displays the playback time zone of each set associated content. Then, each time the reproduction icon 61 is touched, the reproduction control unit 343 starts reproduction of the associated content in the reproduction order to be reproduced.

(1) Playback Time Management Screen FIG. 11 shows a playback time management screen that is displayed after the playback order and playback time zone are set.

  As shown in FIG. 11, when the playback order and the playback time zone are set, a playback bar 90 is displayed below the operation area 40 of the electronic textbook 2.

  The display control means 341 shows a predetermined time zone in a bar shape by the reproduction bar 90. Here, the display control means 341 may set the above-mentioned predetermined time zone to a time zone from a time when the electronic textbook 2 is displayed to a time after a predetermined time (for example, one hour of class), for example. The time zone set by the user in advance (for example, the time zone from the class start time to the class end time) may be set.

  In addition, the display control means 341 displays on the playback bar 90 a current time pointer 91 that indicates the position of the current time in the playback bar 90 and playback time zone displays 92 and 93 that indicate the range of each playback time zone in the playback bar 90. Display each.

  The display control unit 341 displays the playback time zone displays 92 and 93 on the playback bar 90 so as to indicate the range of the playback time zone of each associated content set on the playback time zone setting screen. Specifically, the display control means 341 displays the playback time zone display 92 on the playback start time “14:20” set for the content “worksheet 1.pdf” whose playback order is set to the first. Is displayed so as to indicate the reproduction time zone from the reproduction end time “14:25”. Further, the display control means 341 displays the playback time zone display 93 from the playback start time “14:40” set for the moving image content “fault XX town.mp4” whose playback order is set to second. Displayed to indicate the playback time zone up to the playback end time “14:50”.

  Then, the display control means 341 displays the reproduction time zone displays 92 and 93 by coloring them in the same color as the corresponding association area. Specifically, the display control unit 341 displays the reproduction time zone display 92 in the same color as the color assigned to the corresponding association area 21 and displays the reproduction time zone display 93 in the corresponding association area 22. It is displayed in the same red color as the color attached to. Further, the display control means 341 attaches the display “(1)” attached to the association area 21 below the reproduction time zone display 92, and attaches it to the association area 22 below the reproduction time zone display 93. “(2)” is attached. Thereby, the user can clearly visually recognize the correspondence between the association areas 21 and 22 and the reproduction time zone displays 92 and 93 on the reproduction bar 90.

  When the playback time zone displays 92 and 93 are selected by touch panel operation, the playback control unit 343 plays back or displays the corresponding associated content.

  The display control means 341 changes the display mode of each reproduction time zone display 92, 93 according to the time difference between the current time and the reproduction time zone indicated by each reproduction time zone display 92, 93. This will be described in detail in the section “(3) Display bar display change” described later.

(2) Content Playback Using Playback Icon Next, processing executed by the playback control unit 343 in accordance with the touch panel operation on the playback icon 61 will be described with reference to FIG.

  In FIG. 11, first, the reproduction icon 61 is touched with the fingertip 80. In this case, the reproduction control unit 343 of the processing unit 34 recognizes that the reproduction icon 61 has been selected by a touch panel operation. In this case, the reproduction control unit 343 refers to the association area information shown in FIG. 4 and reproduces or displays the associated content in which the reproduction order is set to No. 1 on the spread pages (pages 22 and 23). Specifically, the reproduction control unit 343 displays “worksheet 1.pdf” associated with the association area 21 on the display screen. In this case, “worksheet 1.pdf” is also projected and displayed in the projection range 50 of the electronic blackboard 5.

  FIG. 12 shows a display example of the file “worksheet 1.pdf”. As illustrated in FIG. 12, the file “worksheet 1.pdf” has answer columns 70 </ b> A to 70 </ b> E. When the student or the like writes in the answer columns 70A to 70E of “worksheet 1.pdf” displayed on the electronic blackboard 5 with a writing pen (stylus) or the like, the processing means 34 The coordinate information included in the transmitted input information is converted into coordinate information on the screen of the display means 36 based on the coordinate conversion function, and a stroke is drawn on the display means 36 based on the coordinate information. Further, the processing unit 34 transmits an image signal for displaying an image on the display unit 36 to the projector 4 to project the same image as the image on the display unit 36 in synchronization. Thereby, the stroke drawn by the writer is similarly projected on the electronic blackboard 5.

  The reproduction of the associated content will be described with reference to FIG. 11 again. After the file “worksheet 1.pdf” is displayed on the display, the reproduction icon 61 is touched again with the fingertip 80. In this case, the reproduction control unit 343 of the processing unit 34 recognizes that the reproduction icon 61 is touched based on the detection signal transmitted from the touch panel. In this case, the reproduction control unit 343 refers to the association area information shown in FIG. 4 and reproduces or displays the associated content in which the reproduction order is set to No. 2 on the spread page (pages 22 and 23). Specifically, the reproduction control unit 343 reproduces the moving image content “fault XX town.mp4” associated with the association area 22. In this case, the moving image content “tomographic XX town.mp4” is also projected and displayed in the projection range 50 of the electronic blackboard 5. Note that the reproduction control means 343 may forcibly end the content “worksheet 1.pdf” when reproducing the moving image content “fault XX town.mp4”. Only the process of changing the display position to the back of “mp4” may be performed.

  As described above, the reproduction control unit 343 can appropriately reproduce the content without causing an error in the reproduction order during the lesson in accordance with the lesson scheduled by the lecturer who is the user.

  Even when the reproduction icon 61 of the electronic textbook 2 projected and displayed on the projection range 50 of the electronic blackboard 5 is touched, the terminal device 3 similarly reproduces the associated content according to the set reproduction order. Specifically, when the display position of the reproduction icon 61 within the projection range 50 is touched with a stylus or the like, the reproduction control unit 343 displays the coordinate information of the input information received from the electronic blackboard 5 using a coordinate conversion function. It is converted into a coordinate system related to the display 36, and it is recognized that the reproduction icon 61 is designated based on the converted position coordinates. In this case, the reproduction control unit 343 refers to the association area information and reproduces the associated content in the reproduction order to be reproduced for the spread page currently displayed on the display.

(3) Display Bar Display Change Next, a display bar 90 display change with time will be described.

  First, when a predetermined time (for example, 5 minutes before) each playback start time set for the associated content, the display control unit 341 highlights the playback time zone display on the playback bar 90 by blinking. The predetermined time may be set in advance by the user. Thereby, the display control means 341 actively notifies the user of the existence of the associated content that has approached the set reproduction start time.

  In the example shown in FIG. 11, when the predetermined time before the reproduction start time “14:20” set in the associated content “worksheet 1.pdf” in which the reproduction order is set to No. 1, the display control unit 341 is displayed. Causes the playback time zone display 92 to blink. Similarly, when the playback start time “14:40” set for the associated content “fault XX town.mp4” with the playback order set to No. 2 is reached, the display control unit 341 The time zone display 93 is blinked.

  In addition, when the operation to reproduce or display the associated content is not detected even when the reproduction start time set for the associated content is reached, the display control unit 341 displays the reproduction time zone display 92 until the operation is detected. Highlight by flashing. Here, the operation for reproducing or displaying the associated content indicates an operation for selecting the reproduction icon 61 and an operation for selecting the association area 21 or the reproduction time zone display 92 corresponding to the target associated content. As a result, the display control unit 341 actively notifies the user of the presence of unreproduced or undisplayed associated content for which the set reproduction start time has elapsed.

  In the example illustrated in FIG. 11, first, when an operation for displaying the associated content is not performed even after the reproduction start time “14:20” set in the associated content “worksheet 1.pdf” has elapsed, display control is performed. The means 341 causes the playback time zone display 92 to blink.

  At this time, it is preferable that the display control unit 341 blinks the reproduction time zone display 92 in a manner different from the blinking of the reproduction time zone display 92 before the reproduction start time. For example, in this case, the display control unit 341 causes the reproduction time zone display 92 to blink by changing the color, brightness, or blinking interval from the blinking time of the reproduction time zone display 92 before the reproduction start time. When any of the reproduction icon 61, the association area 21 or the reproduction time zone display 92 is selected and the associated content “worksheet 1.pdf” is displayed on the display, the display control unit 341 The playback time zone display 92 is returned from the blinking state to the normal display state.

  Similarly, if the operation to display the associated content is not detected even after the reproduction start time “14:40” set in the associated content “fault XX town.mp4” has elapsed, the display control unit 341 displays the reproduction time. The band display 93 is blinked. At this time, preferably, as in the case of the playback time zone display 92, the display control means 341 blinks the display of the playback time zone display 93 in a manner different from the flashing of the playback time zone display 93 before the playback start time. Good.

[Operational effects of the content reproduction system of the first embodiment]
According to the content reproduction system of the first embodiment, the terminal device 3 uses the association area in the spread page of the electronic textbook 2 provided with the association area based on the input to the reproduction time zone input field of the reproduction time zone setting screen. The playback time zone of the content associated with each of these is set. According to this aspect, the user can set the scheduled time for reproduction or display of each content to be reproduced in a class or the like in the terminal device 3.

  In addition, after the playback time zone of each association area is set, the terminal device 3 displays a current time pointer 91 that indicates the position of the current time, a playback time zone display 92 that indicates the range of each playback time zone in the playback bar 90, A reproduction time management screen on which a reproduction bar 90 having 93 is displayed is displayed on the display. Thereby, the lecturer who is a user can advance a lesson, grasping | ascertaining the reproduction time zone of each set content.

  When the terminal device 3 approaches the playback time zone indicated by each of the playback time zone displays 92 and 93 within a predetermined time, the terminal device 3 blinks the corresponding playback time zone display on the playback bar 90. As a result, the user can easily recognize the fact that the user has approached the set playback time zone of each content.

  In addition, the terminal device 3 displays the corresponding playback on the playback bar 90 when the corresponding content has not yet been played back or displayed even after the playback start time in the playback time zone indicated by the playback time zone displays 92 and 93 has elapsed. Flashes the time zone display. Thereby, the user can easily grasp the existence of unreproduced or undisplayed content that has passed the set reproduction start time of each content.

[Modification]
Next, a modification of the first embodiment will be described. The following modifications may be applied in any combination to the first embodiment described above.

(Modification 1)
The operation of selecting the icons 41 to 62 and the association area displayed on the display of the terminal device 3 is not limited to the touch operation with the fingertip 80, and may be a touch operation with a stylus, or the terminal device 3 uses a mouse. If it has, it may be a mouse click operation.

(Modification 2)
In the association area information shown in FIG. 8, the item “association content” stores the path and file name of the association content as information for specifying the association content. Instead, the item “association content” stores a URL (Uniform Resource Locator) for opening a video site where electronic content can be browsed, and a server device that can communicate with the terminal device 3 via the network. A URL for playing a video or the like may be stored.

  In this case, when the associated content in the reproduction order to be reproduced is specified by the URL in the association area information, the reproduction control unit 343 displays a predetermined WEB site based on the URL or the server device. To start streaming playback. In this case, the WEB site and video displayed based on the URL are examples of the “content” in the present invention.

(Modification 3)
In the electronic textbook 2 shown in FIG. 6, the association areas 21 and 22 are highlighted in color. Instead of or in addition to this, the display control means 341 displays the file name of the associated content or / and the image or video in which the content is displayed in a small size at the position corresponding to the association areas 21 and 22. You may let them. For example, the display control unit 341 colors the association areas 21 and 22 with the same color and displays the file name of the associated content at a position overlapping or close to these areas.

  Also by this, the display control means 341 can make the user recognize the content type or file name associated with each of the association areas 21 and 22.

(Modification 4)
The terminal device 3 may set the playback order of the associated content for each page instead of setting the playback order of the associated content within the same spread page. For example, in this case, an icon 60 and a reproduction icon 61 are displayed for each page of the electronic textbook 2. When the icon 60 is selected, the terminal device 3 starts the playback order setting mode for the page on which the icon 60 is displayed. When the playback icon 61 is selected, the playback icon 61 is displayed. Playback is performed according to the playback order for the displayed page.

(Modification 5)
If the operation for reproducing or displaying the associated content has not been performed even after the reproduction start time of the associated content has elapsed, the reproduction control unit 343 automatically reproduces the associated content when the reproduction start time has elapsed. It may be displayed. In this way, the content reproduction system can reproduce or display the associated content according to the set reproduction start time. In this case, preferably, the playback control means 343 highlights the mode for automatically playing back or displaying the associated content when the playback start time has elapsed, and the playback time zone display on the playback bar 90 when the playback start time has passed. It may be configured to allow the user to set in advance which mode to execute.

(Modification 6)
The display control means 341 indicates that playback or display has already been performed with respect to the playback time zone display on the playback bar 90 corresponding to the associated content that has already been played or displayed among the associated content for which the playback time zone has been set. May be attached.

  FIG. 13 shows a reproduction time management screen according to a modification. In the example shown in FIG. 13, it is assumed that the associated content “worksheet.pdf” with the playback order set to No. 1 has already been displayed in the playback time zone.

  In this case, the reproduction control means 343 displays “completed” indicating that reproduction or display has already been performed on the reproduction time zone display 92 on the reproduction bar 90 corresponding to the associated content that has already been reproduced or displayed. Attached. Thus, the user can easily distinguish the associated content that has already been reproduced or displayed from the associated content that has not yet been reproduced or displayed on the reproduction bar 90.

(Modification 7)
When the associated content in which the playback time zone is set is played back or displayed at a time different from the playback start time of the playback time zone, the display control unit 341 matches the time when playback or display is actually started, The playback time zone display on the playback bar 90 may be moved.

  FIG. 14 shows that the associated content “fault XX town.mp4” in which the playback start time zone is set from the playback start time “14:40” to the playback end time “14:50” is the actual playback time “14:00”. The playback time management screen when played back at “30 minutes” is shown. In this case, the display control unit 341 moves the left end of the reproduction time zone display 93 corresponding to the associated content “fault XX town.mp4” in accordance with the actual reproduction time “14:30”. In this way, the display control unit 341 displays the playback bar 90 in accordance with the actual playback start time even when the associated content is played or displayed earlier than the set playback start time. It is possible to display.

  Similarly, when the associated content is played or displayed later than the set playback start time, the display control unit 341 moves the playback time zone display on the playback bar 90 according to the actual playback start time. You may let them.

(Modification 8)
If the associated content is being reproduced or displayed even after the reproduction end time set for the associated content has elapsed, the display control unit 341 may output a sound or display indicating that the reproduction end time has been reached. Thereby, the user can recognize that the associated content being reproduced or displayed has reached the reproduction end time, and can smoothly advance the lesson.

(Modification 9)
In the above embodiment, the display control means 341 blinks the display of the playback time zone displays 92 and 93 on the corresponding playback bar 90 when a predetermined time before the playback start time comes. Instead of this, the playback control means 343 may highlight the playback time zone displays 92 and 93 by changing the display color or brightness of the playback time zone displays 92 and 93. Similarly, if the operation for reproducing or displaying the corresponding associated content is not performed even after the reproduction start time has elapsed, the display control unit 341 displays the reproduction time period instead of blinking the reproduction time period displays 92 and 93. The playback time zone displays 92 and 93 may be highlighted by changing the display color or brightness of the displays 92 and 93.

(Modification 10)
The display control means 341 displays the playback time zone setting screen including the playback time zone input fields 63 and 64 even when the playback order of the associated content in the spread page is not determined in the playback order setting mode. The user may set the playback time zone of each associated content.

  For example, if there is only one associated content in the spread page where the selected time setting icon 62 exists, the display control means 341 displays one playback time zone input field on the playback time zone setting screen. indicate. Further, when there are a plurality of related contents in the spread page where the selected time setting icon 62 exists, the display control means 341 corresponds to the related area located on the upper page which is a page with a small page number. After automatically assigning the playback order in order from the associated content, a playback time zone input field corresponding to each playback order may be displayed on the playback time zone setting screen. Also by this, the reproduction setting means 342 can set each reproduction time zone of the associated content in the same spread page.

Second Embodiment
FIG. 15 shows a configuration of a content reproduction system according to the second embodiment. As shown in FIG. 15, the content reproduction system is filled in from the electronic pen 1 used by the instructor, a textbook (teaching material) 2A in which a dot pattern (coded pattern) is printed on almost the entire surface of each page, and the electronic pen 1. A terminal device 3A that receives and processes information, a projector 4 that is connected to the terminal device 3A and projects the same image as the display screen of the display onto the dot screen 5A, and a dot screen 5A on which a dot pattern is printed Prepare. In the second embodiment, the content playback system sets the playback time zone of each associated content associated with the associated area in the same spread page based on the entry operation with the electronic pen 1 on the textbook 2A or the dot screen 5A. To do. Henceforth, about the part similar to 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted suitably.

(textbook)
First, the textbook (electronic pen book) 2A will be described. Each spread page of the textbook 2A has a content display area 20 and an operation area 40 on which icons 41 to 62 are printed, like the electronic textbook 2 shown in FIG. Further, a plurality of reproduction time zone input fields shown in FIG. 9 are printed in the operation area 40 of the textbook 2A. For example, when four playback time zone input fields are provided, the playback time zone of each associated content whose playback order is Nos. 1 to 4 is entered in each playback time zone input field. In the content display area 20 and the area including the icons 41 to 62, a dot pattern (coded pattern) indicating position coordinates described later is printed. In addition, dot patterns in different coordinate ranges are printed on each page of the textbook 2A. The dot pattern is printed with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and other characters and drawings are printed with ink that does not absorb infrared rays.

(Dot screen)
In the dot screen 5A, a dot pattern (coded pattern) is printed on a white resin substrate with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and the dot pattern is, for example, transparent EB cured. It has a layer structure protected by a resin layer or the like.

  Light constituting the same image as the screen of the terminal device 3A is projected by the projector 4 onto the projection range 50 of the dot screen 5A. Specifically, the electronic textbook 2 obtained by digitizing the textbook 2A shown in FIG. When the user taps the icons 41 to 62 projected and displayed on the dot screen 5 </ b> A with the electronic pen 1 and causes the dot pattern of the area on which the icon is projected to be read, the terminal device 3 </ b> A enters from the electronic pen 1. The information is received, and the displayed page of the electronic textbook 2 is changed or the writing mode by the electronic pen 1 is started according to the function assigned to the tapped icon.

(Dot pattern)
Next, an Anoto dot pattern (coded pattern) printed on each page of the textbook 2A and the dot screen 5A will be described with reference to FIGS. FIG. 16 is a diagram for explaining the relationship between dots of a dot pattern and values to which the dots are converted. As shown in FIG. 16, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on each page of the textbook 2A and the dot screen 5A are determined by the combination of the information thus associated. Note that a dot pattern is formed so that the coordinate areas do not overlap between the pages of the textbook 2A or between each page of the textbook 2A and the dot screen 5A.

  FIG. 17A shows an arrangement of a certain dot pattern. As shown in FIG. 17 (a), a pattern of 6 × 6 dots within a range of about 2 mm in length and width is unique regardless of which portion of each page of the textbook 2A or dot screen 5A takes 6 × 6 dots. It is arranged to become. The dot pattern formed by these 36 dots holds the position coordinates (for example, the position on the dot screen 5A of each page of the textbook 2A). FIG. 17B is a diagram in which each dot shown in FIG. 17A is converted into a value associated with the regularity shown in FIG. 16 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 18 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 18, the electronic pen 1 includes an ink cartridge 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real-time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the ink cartridge 104 is a pen tip portion 103, and the user makes a stroke (handwritten stroke) by bringing the pen tip portion 103 of the electronic pen 1 into contact with each page of the textbook 2A or the dot screen 5A. Fill out. Here, the first contact of the pen tip portion 103 of the electronic pen 1 with each page or the like of the textbook 2A is called “pen down”, and the pen tip portion 103 leaves the contacted (contacted) state. Is called “pen-up”. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects a pressure applied through the ink cartridge 104 from the pen tip portion 103 when the user writes or taps a character or mark on each page of the textbook 2A or the like with the electronic pen 1, that is, a writing pressure. The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like on each page of the textbook 2 </ b> A with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and the processor 108 is detected when the pressure sensor 107 detects a writing pressure higher than a predetermined value. Determines that the user has started entry, and activates the LED 105 and the CMOS camera 106. Then, the communication unit 111 detects pen down information (hereinafter referred to as “pen down information PD”) detected by the pressure sensor 107 and identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later. Are transmitted to the terminal device 3A as entry information. Further, when the user finishes entering one stroke and moves the electronic pen 1 away from each page of the textbook 2A, the pressure sensor 107 detects pen-up because the writing pressure exceeding a predetermined value is not detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 (hereinafter referred to as “pen-up information PU”) and the pen ID, and transmits the information to the terminal device 3A as entry information.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on each page of the textbook 2A. The region is slightly shifted from the position where the pen tip portion 103 contacts each page of the textbook 2A. The CMOS camera 106 is provided with an infrared transmission filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105, and the image data of the dot pattern is captured. This is supplied to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Therefore, even when characters, drawings, and the like are printed on each page of the textbook 2A, the processor 108 can recognize the dot pattern because the printed ink does not absorb in the infrared region. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 17A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  The processor 108 performs X and Y coordinates (hereinafter simply referred to as “X” and “Y” coordinates) in each page of the textbook 2A of the stroke (handwriting) to be entered by the user from the dot pattern of the image data supplied by the CMOS camera 106 during the user entry. (Also called “coordinate data” or “coordinate information”) is continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 17 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 17 (b). The data is converted into a Y coordinate bit value, and X and Y coordinate data are calculated from the data array by a predetermined calculation method. Note that the processor 108 has a rotation correction processing function for correcting the arrangement of dots on the image due to the angle of the electronic pen 1 facing the dot pattern, and that function is executed during coordinate calculation. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. The 6 × 6 dot pattern in each page of the textbook 2A and the dot screen 5A does not overlap in each page of the textbook 2A and the dot screen 5A. Therefore, when the user enters characters or the like with the electronic pen 1, It can be specified by coordinate calculation by the processor 108 which position on the page of the textbook 2A or the position of the dot screen 5A the entered position corresponds to.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID, time information (time stamp), writing pressure data, and X, Y coordinate data, and transmits the information as entry information to the terminal device 3A. In this case, transmission to the terminal device 3A by the communication unit 111 is immediately and sequentially performed by wireless transmission such as Bluetooth (registered trademark). Here, one or a plurality of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the terminal device 3A is stored as stroke information by the terminal device 3A. In other words, one stroke is composed of one or a plurality of X and Y coordinates (coordinate points), and the terminal device 3A includes one or more constituting one stroke by the pen-down information PD and the pen-up information PU. Recognize pieces of coordinate attribute information.

  The electronic pen 1 may include a pen portion that is not filled with ink instead of the ink cartridge 104. In this case, ink is not output from the nib portion 103. When the electronic pen 1 is prepared for each of the textbook 2A and the dot screen 5A, the electronic pen 1 having the ink cartridge 104 is prepared for the textbook 2A, and for the dot screen 5A. An electronic pen 1 having a pen unit may be prepared.

(Terminal device)
The terminal device 3A is, for example, a PC (personal computer) that can be input using a mouse or a keyboard, and has the same hardware configuration and functional configuration as the terminal device 3 of the first embodiment. When the processing unit 34 of the terminal device 3A reads the dot pattern when the icons 41 to 62 printed on the textbook 2A or the icons 41 to 62 projected on the dot screen 5A are tapped with the electronic pen 1. Based on the entry information generated and transmitted by the electronic pen 1, the coordinate definition information described later is referred to and the tapped icon is recognized. Then, the processing unit 34 of the terminal device 3A performs a predetermined process according to the function associated with the tapped icon.

  When the icon tapped with the electronic pen 1 is the icon 60, the playback setting means 342 of the terminal device 3A starts the playback order setting mode as described in the section [Setting of playback order] in the first embodiment. The playback order of the contents associated with the association area on the same spread page is determined. When the icon tapped with the electronic pen 1 is the reproduction icon 61, the reproduction control unit 343 reproduces next according to the set reproduction order as described in the [Content reproduction] section of the first embodiment. The content to be associated is projected onto the dot screen 5A and reproduced or displayed.

  When the icon tapped with the electronic pen 1 is the time setting icon 62, the display control unit 341, as described in the section “Setting the playback time zone”, includes a playback time zone including a playback time zone input field. A setting screen is displayed on the dot screen 5A. When the playback time zone input field is selected on the playback time zone setting screen, the playback setting means 342 displays a GUI such as a keyboard for inputting numbers, for example, and displays the playback start time and playback end time as the user. Are respectively input by the tap operation of the electronic pen 1. Then, the playback setting unit 342 determines a playback time zone of each content whose playback order is determined based on the entry information of the electronic pen 1 generated by the tap operation described above, and stores it in the association area information.

  Further, after the time setting icon 62 is tapped with the electronic pen 1, the reproduction setting means 342 receives from the electronic pen 1 that the electronic pen 1 has entered the reproduction time zone input field provided in the textbook 2A. If it is detected based on the entered information, the character recognition of the stroke is performed. Then, the playback setting means 342 determines the playback time zone of each content whose playback order is determined based on the playback start time and playback end time indicated by the stroke entered in each playback time zone input field, and associates the area information. To remember.

  Further, when the playback order and playback time zone of the associated content are set, the playback setting means 342 displays the playback time management screen on the dot screen 5A, and is described in the [Content playback] section of the first embodiment. As described above, each playback time zone display on the playback bar 90 is flashed according to the set playback start time of each associated content.

  As in the first embodiment, the processing unit 34 of the terminal device 3A performs a calibration process to convert the coordinate system related to the dot pattern of the dot screen 5A to the coordinate system related to the display of the display unit 36. Find the coordinate transformation function. Further, the processing unit 34 uses the coordinate conversion function obtained by the calibration process to receive the coordinate system data related to the dot pattern of the dot screen 5A and receives the coordinate system data applied to the display of the display unit 36. Convert to data.

  The storage unit 33 of the terminal device 3A stores the entry information received from the electronic pen 1 for each pen ID. Further, the storage means 33 stores the content display area 20 and icons 41 to 62 of each page of the textbook 2A for each type of textbook 2A, the coordinate range indicated by the dot pattern corresponding to the playback time zone input field, and the dot screen 5A. Information on the coordinate range indicated by the corresponding dot pattern (also referred to as “coordinate definition information”) is stored. In addition, as with the terminal device 3, the storage unit 33 stores association area information shown in FIG.

[Operational effects of the content reproduction system of the second embodiment]
According to the content reproduction system of the second embodiment, the terminal device 3A can reproduce the reproduction time provided in the reproduction time zone input field of the reproduction time zone setting screen projected and displayed on the dot screen 5A or each spread page of the textbook 2A. Based on the information entered with the electronic pen 1 in the band input field, the playback time zone of the content associated with each of the association areas in the same spread page is set. As a result, the user can set the terminal device 3 to schedule the playback or display of each content to be played in a class or the like by operating the textbook 2A or the dot screen 5A with the electronic pen. In addition, the content reproduction system of the second embodiment can realize the same functions as those of the first embodiment.

[Modification]
Next, a modification of the second embodiment will be described. In the second embodiment, the following modification 11 may be applied in addition to the modifications 1 to 10 of the first embodiment described above.

(Modification 11)
In the second embodiment, the Anoto method is used for the electronic pen, the dot pattern (coded pattern), and the entry information. However, the Anoto method is not limited. Further, the dot pattern (coded pattern) is not limited to the one indicating the position coordinates, and may be a code value for identifying the icon or a code value for identifying the association area.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Electronic textbook 2A ... Textbook 3, 3A ... Terminal device 4 ... Projector 5 ... Electronic blackboard 5A ... Dot screen

Claims (13)

Display control means for displaying electronic teaching materials on the display means;
Storage means for storing information of an association area that is an area within a predetermined page of the electronic teaching material and is associated with content;
Reproduction setting means for setting the reproduction or display scheduled time of the content associated with each of the association areas on the teaching material page or spread page provided with the association area based on an external input;
The terminal device characterized by having. The playback setting means sets the playback or display order of the content before setting the scheduled playback or display time of the content,
The display control means causes the display means to display an input field for inputting the scheduled time of reproduction or display corresponding to the set order of the reproduction or display. Terminal equipment.   3. The display control unit causes the display unit to display the input field in association with the association area of the content for which the reproduction or display scheduled time is set by the input field. The terminal device described. The display control means includes
After the scheduled time of reproduction or display is set, the bar indicating the position of the scheduled time of reproduction or display and the position of the current time in a predetermined time zone including the scheduled time of reproduction or display and the current time The terminal device according to claim 1, wherein the terminal device is displayed on a display unit.   The display control means highlights the display of the scheduled playback or display time on the bar when the scheduled playback or display time set by the playback setting means approaches within a predetermined time. The terminal device according to claim 4.   The display control means displays the scheduled playback or display time on the bar when the corresponding content has not yet been played or displayed even after the scheduled playback or display time set by the playback setting means has elapsed. The terminal device according to claim 4, wherein the terminal device is highlighted.   When the corresponding content has not yet been reproduced or displayed even after the scheduled reproduction or display time set by the reproduction setting unit has elapsed, the reproduction control unit is further provided to automatically reproduce or display the content. The terminal device according to claim 4, characterized in that:   The display control means attaches a display indicating that the content has already been reproduced or displayed to the display of the scheduled time of reproduction or display in the bar corresponding to the content that has already been reproduced or displayed. The terminal device as described in any one of Claims 4 thru | or 7.   The display control means, when the scheduled reproduction or display time of the content set by the reproduction setting means is different from the actual reproduction or display time of the content, the display or display of the content in the bar The terminal device according to any one of claims 4 to 8, wherein the display position of the scheduled reproduction time is changed to the position of the time when the content is actually reproduced or displayed. A terminal device;
An electronic sheet that detects a contact position and transmits a detection signal indicating the contact position to the terminal device;
A projector that emits light based on an image signal transmitted from the terminal device to the surface of the electronic sheet;
The terminal device
Display control means for projecting and displaying an electronic teaching material on the electronic sheet by the projector;
Storage means for storing information of an association area that is an area within a predetermined page of the electronic teaching material and is associated with content;
Based on the detection signal, reproduction setting means for setting a scheduled time for reproduction or display of the content associated with each of the association areas in the teaching material page or spread pages provided with the association area;
A content reproduction system comprising: Teaching materials with printed coding patterns;
A terminal device;
An electronic pen that reads a coded pattern, calculates a position coordinate or code value of the pen tip, and transmits entry information including the position coordinate or code value to the terminal device;
In a content playback system comprising:
The terminal device
Storage means for storing information of an association area of the learning material associated with the content;
Reproduction setting means for setting a scheduled time for reproduction or display of the content associated with the association area in the teaching material page or spread page provided with the association area based on the entry information received from the electronic pen;
A content reproduction system comprising: A terminal device;
An electronic pen that reads a coded pattern, calculates a position coordinate or code value of the pen tip, and transmits entry information including the position coordinate or code value to the terminal device;
A screen with a coded pattern on the surface;
A projector that emits light based on an image signal transmitted from the terminal device to the surface of the screen, and
The terminal device
Display control means for projecting and displaying electronic teaching materials on the screen by the projector;
Storage means for storing information of an association area that is an area within a predetermined page of the electronic teaching material and is associated with content;
Reproduction setting means for setting a scheduled reproduction or display time of the content associated with the association area on the page or spread page of the electronic teaching material provided with the association area based on the entry information received from the electronic pen ,
A content reproduction system comprising:   A program that functions as the terminal device according to any one of claims 1 to 12.