JP5943293B2 - Terminal device, content reproduction system, and program - Google Patents

Description

  The present invention relates to a technique for reproducing content such as a moving image associated with an electronic teaching material.

  2. Description of the Related Art Conventionally, there is known an education support system capable of reproducing content related to a displayed page as needed while projecting and displaying an electronic teaching material on a screen or the like. For example, Patent Literature 1 describes a lesson support system that displays teaching material data on a screen based on a prepared scenario during a lesson. In this lesson support system, when the button displayed as “next page” is selected on the screen, the entire display area provided in the screen transitions according to a scenario prepared in advance.

JP 2002-072850 A

  Content such as video related to a predetermined drawing part of the electronic textbook (educational material) is associated, and during the class, the electronic educational material is displayed on the screen etc. Can be played at any timing of the instructor. On the other hand, when a plurality of contents are associated with each page or spread page of the electronic teaching material, the lecturer may mistake the playback order of the contents in the class. Therefore, in this case, it is convenient that the order of reproducing or displaying the plurality of contents can be set in advance. Also, in this case, even if some content is played or displayed in an order different from the preset order due to the course flow, etc., the playback order of the remaining unplayed content is set appropriately, and there is no omission It is desirable to be able to reproduce or display.

  Therefore, the present invention provides a terminal device and content capable of appropriately setting the playback order of the remaining unplayed content even when some content is played back or displayed in an order different from the preset order. The main object is to provide a reproduction system and a program.

  The terminal device according to the present invention includes a display control unit that displays the electronic teaching material on the display unit, a storage unit that stores information on an association area that is an area within a predetermined page of the electronic teaching material and is associated with the content, Based on an external input, reproduction order setting means for setting the reproduction or display order of the content associated with the association area on the page or spread page of the electronic teaching material provided with a plurality of association areas, and the association area When the playback control means for playing back or displaying the associated content and the content that has not been played back or displayed among the content for which the playback or display order is set, the same page or the same as the content Replay each content that is associated with the association area on the facing page and that is not displayed. Or having a playback order resetting means for resetting the display order.

  The terminal device includes a display control unit, a storage unit, a reproduction order setting unit, a reproduction control unit, and a reproduction order resetting unit, and an association area is selected from each page or spread page of the electronic teaching material. A reproduction order of contents associated with a plurality of pages or spread pages is determined. Then, when content that has not been played back or displayed is played or displayed among the content for which the playback or display order is set, the terminal device is associated with the association area on the same page or the same spread page as the content. The order of reproduction or display of each content that has not been reproduced or displayed is reset. As a result, the terminal device can set the playback order of the remaining unplayed content even when a part of the content is played back or displayed in an order different from the preset order.

  In one aspect of the terminal device, the reproduction order resetting means resets the reproduction or display order of each content not reproduced or displayed based on the reproduction or display order set by the reproduction order setting means. To do. As a result, the terminal device can suitably set the reproduction order of the remaining unreproduced content even when a part of the content is reproduced or displayed in an order different from the preset order.

  In another aspect of the terminal device, each page or each spread page of the electronic teaching material is for reproduction for displaying or displaying the content based on the reproduction or display order set by the reproduction order setting unit. An icon is provided, and when the reproduction icon is selected, the reproduction control unit reproduces or displays the content corresponding to the order to be reproduced or displayed. According to this aspect, the user can reproduce or display the contents for which the order has been set in order on the terminal device simply by performing an operation of selecting a reproduction icon.

  In one aspect of the terminal device, the reproduction control unit is responsive to the set order of reproduction or display when the association area in the page or spread page of the electronic teaching material displayed on the display unit is selected. First, the content associated with the association area is reproduced or displayed. In this way, the terminal device can suitably set the reproduction order of the remaining unreproduced content even when a part of the content is reproduced or displayed in an order different from the preset order.

  In another aspect of the terminal device, the display control unit displays the association area corresponding to each content that is not reproduced or displayed on the page of the electronic teaching material or the spread page displayed on the display unit. The display means highlights the display, and displays the reproduction or display order of each content not reproduced or displayed in the corresponding association area. According to this aspect, the user can easily grasp the reproduction order of the remaining unreproduced content.

  In another aspect of the terminal device, when the display control unit displays the association area in an emphasized manner on the display unit, the display control unit displays the association area in a color-coded manner for each corresponding content type. Let According to this aspect, the user can easily grasp the type of the unreproduced content together with the reproduction order of the remaining unreproduced content.

  In another aspect of the terminal device, the reproduction order setting unit may reproduce or display the reproduction or display based on the selection order in which the association areas are selected on the page or spread page of the electronic teaching material displayed on the display control unit. Determine the order. According to this aspect, the terminal device can determine the order of reproduction or display of each content in accordance with the user's intention.

The content reproduction system according to the present invention includes a terminal device, an electronic sheet that detects a contact position, transmits a detection signal indicating the contact position to the terminal device, and light based on an image signal transmitted from the terminal device. A content reproduction system comprising: a projector that emits light on a surface of the electronic sheet, wherein the terminal device includes display control means for projecting and displaying the electronic teaching material on the electronic sheet by the projector; and a predetermined page of the electronic teaching material Storage means for storing information on an association area associated with the content, and the content associated with the association area on the page or spread page of the electronic teaching material provided with a plurality of association areas. Reproduction order setting means for setting the reproduction or display order, and the relation based on the detection signal Playback control means for playing back or displaying content associated with a display area, and content that is not played back or displayed among the content for which the playback or display order is set, is the same as that content Reproduction order resetting means for resetting the reproduction or display order of each content not reproduced or displayed associated with the association area on the page or the same spread page;
Have According to this aspect, the content reproduction system displays the electronic teaching material on the electronic sheet, and reproduces or displays a part of the content in an order different from the preset order based on the operation on the electronic sheet. However, it is possible to suitably set the playback order of the remaining unplayed content.

  In another aspect of the content reproduction system according to the present invention, the teaching material on which the coded pattern is printed, the terminal device, the coded pattern is read to calculate the position coordinate or code value of the pen tip, and the position coordinate or In a content reproduction system including an electronic pen that transmits entry information including a code value to the terminal device, the terminal device includes storage means for storing information on an association area of the teaching material associated with content, and the association area A plurality of reproduction order setting means for setting a reproduction or display order of the content associated with the associated area in the educational material page or spread page, and the educational material based on the entry information received from the electronic pen. Reproduction control means for reproducing or displaying content associated with the association area When content that has not been played back or displayed is played or displayed among the content for which the playback or display order is set, playback or display associated with an association area on the same page as the content or on the same spread page Playback order resetting means for resetting the playback or display order of each content that has not been performed. According to this aspect, the content reproduction system is configured so that the remaining unreproduced content even when a part of the content is reproduced or displayed in an order different from the preset order based on the operation with the electronic pen on the teaching material. Can be suitably set.

  In still another aspect of the content reproduction system according to the present invention, the terminal device reads the coded pattern, calculates the position coordinate or code value of the pen tip, and enters the input information including the position coordinate or code value into the terminal An electronic pen for transmitting to the device; a screen having a coding pattern on the surface; and a projector for emitting light based on an image signal transmitted from the terminal device to the surface of the screen, the terminal device Display control means for projecting and displaying the electronic teaching material on the screen by the projector, storage means for storing information on an association area that is an area within a predetermined page of the electronic teaching material and is associated with the content, Associating with the association area on the page or spread page of the electronic teaching material with a plurality of association areas A playback order setting means for setting a playback or display order of the content, a playback control means for playing back or displaying the content associated with the association area based on the entry information received from the electronic pen, and the playback Or, when content that has not been played or displayed is played or displayed among the content for which the display order is set, it is not played or displayed in association with the association area on the same page or spread page as the content. Reproduction order resetting means for resetting the order of reproduction or display of each content. According to this aspect, the content reproduction system is a case where a part of the content is reproduced or displayed in an order different from the preset order based on the operation with the electronic pen on the screen with the coded pattern on the surface. Even in such a case, it is possible to suitably set the reproduction order of the remaining unreproduced content.

The program according to the present invention causes a computer to function as any one of the terminal devices described above. Installation to Rukoto these programs in a computer, it is possible to configure the terminal apparatus according to the present invention.

  According to the present invention, when content that is not played back or displayed is played or displayed among the content that is set to be played back or displayed, the terminal device associates the content that is on the same page or the same spread page as the content. The order of reproduction or display of each content not reproduced or displayed associated with the area is reset. As a result, the terminal device can set the playback order of the remaining unplayed content even when a part of the content is played back or displayed in an order different from the preset order.

1 shows a configuration of a content reproduction system according to the present embodiment. It is an example of a display of an electronic textbook. It is a functional block diagram of a terminal device. The data structure of association area information is shown. The display screen of the terminal device just before the icon for color-coded display of an association area is selected is shown. The display screen of the terminal device after the icon for color-coded display of an association area is selected is shown. The change in the position of the fingertip on the electronic textbook accompanying the setting of the initial playback order is shown. The display screen of the terminal device on which the spread page with the initial reproduction order set is displayed is shown. It is a flowchart which shows the procedure of an update reproduction | regeneration order setting process. A state in which a reproduction operation is performed on a spread page is shown. A display example of the file “worksheet 1.pdf” is shown. The display screen of a terminal device when an unreproduced display icon is selected is shown. The structure of the content reproduction system which concerns on 2nd Embodiment is shown. The relationship between the dot pattern dot and the value to which the dot is converted is shown. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen.

  Hereinafter, preferred embodiments for carrying out the present invention will be described with reference to the drawings. The content playback system described below is preferably used for school classes, etc., and an arbitrary range of digitized electronic textbooks (educational materials) is associated with content such as videos, and is contained in the same spread page. This is a system in which the playback order of associated contents can be set in advance. The “page spread” refers to a set of pages that are lined up or down or left and right when an electronic textbook is displayed.

[Content playback system configuration]
FIG. 1 shows a configuration of a content reproduction system according to the present embodiment. As shown in FIG. 1, the content reproduction system displays an electronic textbook 2 described later and performs a predetermined process based on an input from a user, and is connected to the terminal device 3, and a display screen of the display The projector 4 which projects the same image on the electronic blackboard 5, and the electronic blackboard (electronic sheet) 5 which can detect the contacted position are provided. Hereinafter, each of these components will be described.

(Electronic textbook)
First, the electronic textbook 2 displayed on the display of the terminal device 3 will be described. FIG. 2 shows a top view of the electronic textbook 2 in which a certain page (pages 22 and 23) is displayed in a spread state. The electronic textbook 2 shown in FIG. 2 is displayed on the electronic blackboard 5 in the same manner.

  As shown in FIG. 2, the electronic textbook 2 is displayed for each spread page, and each spread page is an operation in which a content display area 20 in which the content of the textbook is described and selectable icons 41 to 62 are displayed. Region 40.

  The content display area 20 includes an area (also referred to as “association area”) associated with content such as a moving image, an image, PDF (registered trademark), or audio data. When the association area is selected, the content associated with the region (also referred to as “association content”) is played by the terminal device 3.

  Next, functions associated with the icons 41 to 62 will be described. The icon 41 is an operation area for displaying a table of contents of the electronic textbook 2 shown in FIG. 3 to be described later on the display of the terminal device 3. The icon 42 is an operation area for displaying the electronic textbook 2 in front of the content when the content is reproduced or displayed on the display of the terminal device 3. The icon 43 is an operation area for returning the double-page spread of the electronic textbook 2 displayed on the display of the terminal device 3 by two pages. The icon 44 is an operation area for advancing the double-page spread of the electronic textbook 2 displayed on the display of the terminal device 3 by two pages.

  Icons 45 and 46 are operation areas for switching to the writing mode. Specifically, the icon 45 is an operation area for switching to a writing mode in which a stroke of a free curve that reproduces a locus of a position where a stylus or the like touches on the electronic textbook 2 is drawn on the electronic textbook 2. The icon 46 is an operation area for switching to a writing mode in which a linear stroke based on the locus of the position where the stylus or the like touches on the electronic textbook 2 is drawn on the electronic textbook 2. The icon 47 is an operation area for designating the stroke color drawn in the writing mode corresponding to the icon 45 or 46 as red, and the icon 48 is an operation area for designating the stroke color as blue. It is. As will be described later, the user can select the icon 45 or 46 and draw a stroke based on the locus of the contact position of the stylus on the display on the electronic textbook 2 even during the reproduction of the content. is there.

  The icon 49 is an operation area for switching between display and non-display of the stroke drawn in the writing mode corresponding to the icon 45 or 46. The icon 50 is an operation area for switching to a mode in which the display position of a stroke drawn on the electronic textbook 2 is moved based on a drag operation. The icon 51 is an operation area for enlarging and displaying an area designated by the drag operation. The icon 52 is an operation area for deleting a stroke existing at a position where contact is detected on the display. The icon 53 is an operation area for erasing all strokes drawn on the spread page on which the icon 53 is printed. The icon 54 is an operation area for starting playback of a stopped or paused moving image. The icon 55 is an operation area for rewinding the moving image being reproduced. The icon 56 is an operation area for pausing the moving image being played back. The icon 57 is an operation area for fast-forwarding the moving image being reproduced. The icon 58 is an operation area for stopping the moving image being reproduced.

  The icon 59 is an operation area for highlighting the association area in the electronic textbook 2 with a color. A display example when the icon 59 is selected will be described in detail in the section “Displaying Association Area”. The order setting icon 60 is an operation area for instructing the start and end of a mode (also referred to as “playback order setting mode”) for setting the playback order of content associated with the association area on the same spread page. is there. Hereinafter, the reproduction order set in the reproduction order setting mode is also referred to as “initial reproduction order”. The playback order setting mode will be described in detail in the section “Setting the Initial Playback Order”. The reproduction icon 61 is an operation area for giving an instruction to sequentially reproduce the associated content according to the set initial reproduction order. The functions associated with the playback icon 61 will be described in detail in the [Reproduction of content] section. The unreproduced order display icon 62 is used to display the reproduction order of each of the associated contents that have not been reproduced or are not displayed since the initial reproduction order is set in the reproduction order setting mode (also simply referred to as “unreproduced contents”). This is the operation area. Unlike the initial playback order, the playback order displayed when the unplayed order display icon 62 is selected is different from the initial playback order, and the playback order of unplayed content excluding associated content that has already been played or displayed (also referred to as “update playback order”). Call it.) The method for determining the update playback order will be described in detail in the section “Setting the Update Playback Order”.

(projector)
The projector 4 is a projector that emits light obliquely downward from the vertically upward direction to the electronic blackboard 5, and is installed on, for example, a classroom wall. The projector 4 receives an image signal from the terminal device 3 and projects light constituting the same image as the screen of the terminal device 3 onto a predetermined projection range 50. In the projection range 50, the electronic textbook 2 and the like are displayed. The projector 4 may be a front projector that emits light toward the front of the electronic blackboard 5 or a rear projector that emits light toward the back of the electronic blackboard 5.

(Electronic blackboard)
The electronic blackboard 5 is a pressure-sensitive board (sheet) configured to be able to detect pressure. When pressure is applied to the electronic blackboard 5 with a predetermined pen (stylus), two electrically conductive sheets provided in the board come into contact with each other to generate an electric signal, and input information based on the electric signal is transmitted to the terminal. Transmit to device 3. Then, the terminal device 3 detects the contact position based on the input information received from the electronic blackboard 5.

  Further, the projector 4 projects light constituting the same image as the screen of the terminal device 3 onto the projection range 50 of the electronic blackboard 5. Specifically, the electronic textbook 2 shown in FIG.

  The electronic blackboard 5 may be an electromagnetic board in which a wire is embedded directly under the board surface. In this case, the content reproduction system includes a stylus in which a coil is embedded, and when the stylus is brought into contact with the electromagnetic board, the electromagnetic board generates an electrical signal corresponding to the contact position based on electromagnetic induction with the stylus, and Based on the electrical signal, the terminal device 3 detects the contact position.

  Even when the electronic blackboard 5 is of any input method, the terminal device 3 converts the coordinate system for the electronic blackboard 5 into a coordinate system for the display of the terminal device 3 as described later. Is obtained in advance. When the terminal device 3 receives the coordinate data corresponding to the contact position on the board using the obtained coordinate conversion function, the terminal device 3 converts the coordinate data into the data of the coordinate system applied to the display of the display means 36 and displays it. Which icon 41 to 62 in the electronic textbook 2 or the association area is selected is detected.

(Terminal device)
Next, the terminal device 3 will be described. The terminal device 3 includes, as hardware, an antenna device capable of data communication with the electronic blackboard 5, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse, a keyboard, and the like. The terminal device 3 may be configured by a tablet PC such as iPad (registered trademark), a PDA (Personal Data Assistance), or a PC (personal computer) equipped with a display. Here, as an example, it is assumed that the terminal device 3 is a tablet PC capable of input using a touch panel.

  FIG. 3 is a functional block diagram of the terminal device 3. Functionally, the terminal device 3 includes an input unit 31 such as a touch panel, a communication unit 32, a storage unit 33, a processing unit 34, a display unit 36, and an interface 38. The communication unit 32 is configured by an antenna receiving circuit or the like, receives input information from the electronic blackboard 5, and transmits the received information to the processing unit 34. The display means 36 is constituted by a display or the like, and displays the contents instructed by the processing means 34. The interface 38 is an interface for connecting to the projector 4. The interface 38 transmits an image signal for displaying an image on the display unit 36 to the projector 4 based on a processing command of the processing unit 34, and projects the same image as the image on the display unit 36 in synchronization.

  The processing means 34 is constituted by a processor such as a CPU and controls the entire terminal device 3. The processing unit 34 includes a display control unit 341, a reproduction order setting unit 342, a reproduction control unit 343, and a reproduction order resetting unit 344. Then, when the processing unit 34 detects that the icons 41 to 62 displayed on the display of the display unit 36 are selected by a touch panel operation, the processing unit 34 performs predetermined processing according to the function associated with the selected icon. .

  Specifically, when the icons selected by the touch panel operation are the icons 41 to 44, the display control unit 341 of the processing unit 34 follows the function associated with the icon selected by the touch panel operation, and the predetermined number of the electronic textbook 2 The display means 36 displays the page in a spread state.

  When the icon selected by the touch panel operation is the icon 45 or 46, the display control unit 341 starts the writing mode. Specifically, in the writing mode, the display control unit 341 draws a free-form curve or a straight line stroke on the electronic textbook 2 based on the position coordinates of the contact position detected by the touch panel. In this case, the display control unit 341 draws a stroke regardless of whether the content is being reproduced. In the writing mode, the display control unit 341 may display the electronic textbook 2 and the content being displayed side by side. If the content is a moving image, the display control unit 341 displays the content within the association area corresponding to the content. May be. When the content is audio data, the display control unit 341 displays only the electronic textbook 2 while not displaying the software for reproducing the audio data while outputting audio to a speaker (not shown). Also good.

  When the icons selected by the touch panel operation are the icons 47 to 53, the display control unit 341 executes a predetermined process according to the function associated with the icon selected by the touch panel operation. In addition, when the icons selected by the touch panel operation are the icons 54 to 58, the reproduction control unit 343 performs reproduction control of the moving image content to be reproduced according to the function associated with the icon selected by the touch panel operation. When the icon selected by the touch panel operation is the icon 59, the display control unit 341 displays the association area in different colors according to the type of the associated content.

  When the icon selected by the touch panel operation is the icon 60, the processing unit 34 starts the reproduction order setting mode. In the reproduction order setting mode, the reproduction order setting means 342 of the processing means 34 determines the initial reproduction order of the contents associated with the association area on the same spread page. This process will be described in detail in the section [Initial Playback Order Setting]. When the icon selected by the touch panel operation is the reproduction icon 61, the reproduction control unit 343 reproduces the associated content in which the update reproduction order is set to the first. Hereinafter, the reproduction or display of the associated content by selecting the reproduction icon 61 is referred to as “reproduction based on icon selection”. When the icon selected by the touch panel operation is the non-reproduction order display icon 62, the display control unit 341 highlights the association area corresponding to each non-reproduction content and superimposes the update reproduction order on each association area. To display. This process will be described in detail in the section “Displaying the updated playback order”.

  Further, when the association area of the electronic textbook 2 is selected, the processing unit 34 refers to association area information described later, and reproduces or displays the content associated with the association area selected by the touch panel operation. The reproduction or display of the associated content by selecting the association area is hereinafter also referred to as “reproduction based on area selection”.

  Further, the reproduction order resetting means 344 determines the update reproduction order of other unreproduced contents on the same spread page when the unreproduced contents are reproduced. This process will be described in detail in the section “Setting the update playback order”.

  Further, the processing unit 34 causes the projector 4 to project the calibration mark on the electronic blackboard 5 by displaying at least two calibration marks on the display unit 36, and the calibration mark is projected. By receiving the input information corresponding to the position, a coordinate conversion function for converting the coordinate system applied to the electronic blackboard 5 to the coordinate system applied to the display of the display means 36 is obtained (calibration processing function). Further, the processing means 34 converts the coordinate system data concerning the electronic blackboard 5 into the coordinate system data concerning the display of the display means 36 when the coordinate system data concerning the electronic blackboard 5 is received using the coordinate transformation function obtained by the calibration process. To do. Then, when the processing unit 34 recognizes that the icons 41 to 62 displayed on the electronic blackboard 5 are selected based on the coordinate system data on the display after conversion, the processing unit 34 is displayed on the display of the terminal device 3. The same processing as when the icons 41 to 62 are selected is executed. Further, when the processing unit 34 recognizes that the association area displayed on the electronic blackboard 5 has been selected based on the coordinate system data applied to the converted display, the processing unit 34 refers to the association area information described later and is selected. The content associated with the associated area is reproduced or displayed.

  The storage means 33 is configured by a memory such as a ROM or a RAM. The memory | storage means 33 memorize | stores the electronic textbook 2 which digitized each textbook. Furthermore, the storage unit 33 stores content associated with each association area and also stores information associated with each association area (also referred to as “association area information”). FIG. 4 shows the data structure of the association area information. As shown in FIG. 4, the association area information includes an “area number” item indicating the identification number of each association area, an “textbook ID” item indicating the identification information of the electronic textbook 2, and the page number of the association area. In the same spread page, the “page number” item indicating the relative position in the page, the “in-page position” item indicating the relative position in the page, and the “associating content” item indicating the path and file name of the associated content. Information corresponding to the item “initial playback order” indicating the initial playback order of the associated content and the item “playback order of unplayed content” indicating the updated playback order of each unplayed content within the same spread page, respectively. Associated. Here, it is assumed that the textbook ID of the electronic textbook 2 shown in FIG. 2 is “R01”, and the position in the page is the corner position coordinates (Xn, Yn), the height (Y direction), and the width (X direction). ). Further, the value of the item “initial playback order” is set based on the processing described in the section “setting of initial playback order” described later. The item “updated playback order” is set to the initial order of the value of the “initial playback order” item, and the playback order is reset based on the flowchart of FIG. 9 described later each time unplayed content is played back or displayed. Updated by means 344. In addition, the item “update playback order” is set to “played” when the corresponding associated content has already been played or displayed.

  The association area information other than the reproduction order may be stored in the storage unit 33 in advance, or may be generated by the processing unit 34 based on a user input. In the latter case, for example, in the state where the electronic textbook 2 is displayed, the processing unit 34 allows the user to specify an area to be an association area by a drag operation to the touch panel or the like, and the content to be associated with the association area is for file selection. The user is designated by displaying a GUI (Graphical User Interface) or the like. The associated content may be video data generated as a result of the instructor taking a picture using a video camera or the like for the lesson, still image data, or a worksheet. May be.

[Display Association Area]
Next, display of the electronic textbook 2 when the icon 59 is selected will be described. FIG. 5 shows a display screen of the terminal device 3 immediately before the icon 59 is selected.

  As shown in FIG. 5, immediately before the icon 59 is selected, the association area of the area number N1 existing on page 22 and the association area of the area number N2 existing on page 23 stored in the association area information of FIG. Are displayed in a manner that cannot be distinguished from other areas. And a user touches the display part of the icon 59 in the display screen of the terminal device 3 with a fingertip, when setting the reproduction | regeneration order of related content.

  FIG. 6 shows the display screen of the terminal device 3 after the icon 59 is selected. As shown in FIG. 6, when the icon 59 is selected, the display control unit 341 displays each association area in different colors for each type of associated content. Specifically, the association area “21” of the area number N1 associated with the PDF file “worksheet 1.pdf” having the extension “pdf” is displayed in a state of being colored blue. On the other hand, the association area “22” associated with the moving image file “fault XX town.mp4” with the extension “mp4” is displayed in a state of being colored red. Similarly, the association area “23” associated with the moving image file “fault ΔΔ town.mp4” having the extension “mp4” is displayed in a colored state in red, and the moving image file having the extension “mp4”. The association area “24” associated with “Fault □□ machi.mp4” is displayed in a state of being colored red. In this way, the user can easily grasp the position and range of each association area and the type of content associated with the association area. And when the icon 59 is touched again, the display control means 36 switches again from the display shown in FIG. 6 to the display shown in FIG.

  The display screens shown in FIGS. 5 and 6 are the same as the display projected on the projection range 50 of the electronic blackboard 5, and similarly when the icon 59 projected and displayed on the electronic blackboard 5 is selected. The display shown in FIG. 5 and the display shown in FIG. 6 are switched.

[Set initial playback order]
Next, a method for setting the initial reproduction order of related contents when a plurality of related areas exist in the same spread page will be described in detail. Schematically, the playback order setting unit 342 determines the initial playback order of associated content based on the order of the associated areas touched on the display of the terminal device 3 in the playback order setting mode.

  FIG. 7 is a diagram illustrating a change in the position of the fingertip to be operated in accordance with the setting of the initial reproduction order on the electronic textbook 2 displayed on the display screen of the terminal device 3. First, the icon 60 is touched with the fingertip 80 (first step). In this case, the processing means 34 recognizes that the icon 60 has been touched based on the detection signal transmitted from the touch panel, and starts the reproduction order setting mode. Thereafter, a plurality of association areas existing in the same spread page are touched in the order in which the associated contents are to be reproduced, according to the user's intention.

  In the example shown in FIG. 7, the association area 21 is touched with the fingertip 80 (second step). In this case, the reproduction order setting unit 342 of the processing unit 34 recognizes that the association area 21 has been touched based on the detection signal transmitted from the touch panel. Then, the reproduction order setting unit 342 sets the initial reproduction order of the content “worksheet 1.pdf” associated with the association area 21 among the associated content associated with the spread pages (here, pages 22 and 23) to the first. Set.

  Thereafter, the association area 24 is touched by the fingertip 80 (third step). In this case, the reproduction order setting unit 342 of the processing unit 34 recognizes that the association area 24 has been selected by a touch panel operation. Then, the reproduction order setting unit 342 sets the initial reproduction order of the associated content “fault □□ town.mp4” associated with the association area 24 among the associated content related to the spread pages to the second.

  Next, the association area 22 is touched with the fingertip 80 (fourth step). In this case, the reproduction order setting unit 342 of the processing unit 34 recognizes that the association area 22 has been selected by a touch panel operation. Then, the reproduction order setting unit 342 sets the initial reproduction order of the associated content “fault XX town.mp4” associated with the association area 22 among the associated content related to the spread pages to No. 3. Thereafter, similarly, the association area 23 is touched by the fingertip 80 (fifth step). In this case, the reproduction order setting unit 342 of the processing unit 34 recognizes that the association area 23 has been selected by a touch panel operation. Then, the reproduction order setting unit 342 sets the initial reproduction order of the associated content “fault ΔΔ town.mp4” associated with the association area 23 among the associated content associated with the spread pages to No. 4.

  Next, the icon 60 is touched again by the fingertip 80 (sixth step). In this case, the reproduction order setting unit 342 recognizes that the icon 60 has been touched based on the contact position detected by the touch panel, and ends the reproduction order setting mode. As a result, the reproduction order setting unit 342 determines the initial reproduction order of the spread pages displayed on the display of the terminal device 3. Specifically, the playback order setting unit 342 associates that the initial playback order of “worksheet 1.pdf”, which is the content associated with the association area 21, is No. 1, as shown in FIG. It is stored in the area information, and the fact that the initial reproduction order of “fault □□ town. Furthermore, the reproduction order setting means 342 stores in the association area information that the initial reproduction order of “fault XX town.mp4”, which is the content associated with the association area 22, is associated with the association area 23. It is stored in the association area information that the initial reproduction order of “fault ΔΔ town.

  As described above, the playback order setting unit 342 sets the playback order of the associated content in the order of the user's intentional touch without requiring a complicated operation on an arbitrary spread page having a plurality of related areas. Can be determined accordingly.

  Even when the icon 60 of the electronic textbook 2 projected and displayed in the projection range 50 of the electronic blackboard 5 is selected, the reproduction order setting unit 342 similarly starts the reproduction order setting mode. The reproduction order setting unit 342 stores the order in which the association area of the electronic textbook 2 projected and displayed in the projection range 50 of the electronic blackboard 5 is selected in the reproduction order setting mode. When the reproduction icon 61 is selected again and the reproduction order setting mode is ended, the reproduction order setting unit 342 associates the initial reproduction order in the spread page projected and displayed on the electronic blackboard 5 in the reproduction order setting mode. The area is determined based on the order of selection, and stored in the association area information shown in FIG.

[Display after setting the initial playback order]
Next, the display screen of the terminal device 3 after the initial playback order is set will be described with reference to FIG. FIG. 8 shows a display screen of the terminal device 3 on which a spread page with the initial playback order set is displayed.

  As shown in FIG. 8, when displaying the spread page in which the initial playback order is set, the display control unit 341 displays the initial playback order of the corresponding associated content on the association areas 21 and 22 in which the initial playback order is set. The number of is superimposed and displayed. In the example shown in FIG. 8, “(1)” is displayed in the association area 21 in which the initial reproduction order is set to No. 1, and the association area 24 in which the initial reproduction order is set to No. 2 The association area 22 with “(2)” displayed and the initial playback order set to No. 3 is associated with the display of “(3)” and the initial playback order set to No. 4. 23 is marked with “(4)”.

  As described above, when displaying the spread page with the reproduction order set on the display of the terminal device 3, the display control unit 341 changes the set initial reproduction order so that the user can visually recognize the set initial reproduction order. A display to be shown is attached to the corresponding association area. Thereby, the user can easily grasp the set initial reproduction order on the display of the terminal device 3 or on the electronic blackboard 5. When the icon 59 displayed on the display of the terminal device 3 or the electronic blackboard 5 is selected, the display control unit 341 may switch whether or not to display the initial reproduction order as in the case of highlighting by color.

[Set update playback order]
Next, a method for setting the update reproduction order executed by the reproduction order resetting unit 344 when the associated content with the predetermined reproduction order is reproduced or displayed will be described. Schematically, the playback order resetting unit 344 sets the update playback order set for the remaining unplayed content to a serial number starting from 1 according to the initial playback order when the unplayed content is played back or displayed. Set.

  FIG. 9 is a flowchart showing the procedure of the update playback order setting process performed by the playback order resetting means 344. The reproduction order resetting means 344 repeatedly executes the processing of the flowchart shown in FIG.

  First, the reproduction order resetting means 344 determines whether or not an operation for reproducing or displaying unreproduced content has been detected (step S101). Specifically, the reproduction order resetting unit 344 determines whether or not the reproduction icon 61 has been selected and whether or not an association area associated with unreproduced content has been selected. In the latter determination, the reproduction order resetting unit 344 refers to the item “update reproduction order” of the association area information and determines whether or not the content associated with the selected association area has been reproduced. To do. If no operation for reproducing or displaying the unreproduced content is detected (step S101: No), the reproduction order resetting unit 344 continues to determine whether or not an operation for reproducing or displaying the unreproduced content is detected.

  On the other hand, when the reproduction order resetting unit 344 detects an operation for reproducing or displaying the unreproduced content (step S101: Yes), the reproduction control unit 343 reproduces or displays the unreproduced content (step S102). Specifically, when the playback icon 61 is selected, the playback control unit 343 plays or displays the unplayed content whose update playback order is No. 1, and when the association area is selected, Unplayed content associated with the association area is played or displayed. Then, the reproduction order resetting unit 344 adds a flag indicating that the reproduction or display of the content has been reproduced (step S103). In the example of FIG. 4, the reproduction order resetting unit 344 sets the “update reproduction order” item of the association area information corresponding to the reproduced or displayed content to “reproduced”.

  Next, the reproduction order resetting means 344 determines whether there are other unreproduced contents on the same spread page (step S104). Specifically, the reproduction order resetting means 344 refers to the item “update reproduction order” of the association area information, and the unreproduced content associated with the same spread page as the content reproduced or displayed in step S102. Judge whether there is. If there is no other unreproduced content on the same spread page (step S104: No), the reproduction order resetting means 344 ends the process of the flowchart. In this case, the reproduction order resetting means 344 may be initialized by setting the update reproduction order of each associated content on the target spread page to the initial reproduction order. Thereby, the user can reproduce | regenerate or display each related content again based on the initial reproduction | regeneration order set in reproduction | regeneration order setting mode in the class of another class.

  On the other hand, when there are other unreproduced contents on the same spread page (step S104: Yes), the reproduction order resetting means 344 determines each of the unreproduced contents in the updated reproduction order after the contents reproduced or displayed in step S102. The update reproduction order is incremented by one (step S105). In other words, the reproduction order resetting unit 344 refers to the item “update reproduction order” of the association area information, and performs the update reproduction corresponding to the same spread page whose numerical value is larger than the update reproduction order of the content reproduced or displayed in step S102. The numerical value of the order is subtracted by “1”. As a result, the playback order resetting means 344 sets the update playback order of the remaining unplayed content even if the playback based on the area selection plays back the unplayed content whose update playback order is not No. 1. The serial numbers starting from 1 can be appropriately set according to the initial reproduction order. A specific example will be described in detail in the [Content Playback] section.

[Content playback]
Next, specific examples of content reproduction or display will be described for each case.

(1) Case where only content reproduction based on icon selection is performed First, a case where content reproduction or display is performed only by selecting the reproduction icon 61 will be described with reference to FIG. Schematically, in this case, the reproduction control unit 343 starts reproduction of related content whose update reproduction order is No. 1 each time the reproduction icon 61 is touched. FIG. 10 is a diagram illustrating that the operation is performed on the spread page displayed on the display of the terminal device 3 after the initial reproduction order is set. In the example of FIG. 10, it is assumed that none of the associated contents on the spread pages (pages 22 and 23) is reproduced or displayed.

  In FIG. 10, first, the reproduction icon 61 is touched with the fingertip 80. In this case, the reproduction control unit 343 of the processing unit 34 recognizes that the reproduction icon 61 has been selected by a touch panel operation. In this case, the reproduction control unit 343 refers to the association area information shown in FIG. 4, and the initial reproduction order is set to 1 and the update reproduction order is 1 on the spread pages (pages 22 and 23). Play or display the associated content that is the number. Specifically, the reproduction control unit 343 displays “worksheet 1.pdf” associated with the association area 21 on the display screen. In this case, “worksheet 1.pdf” is also projected and displayed in the projection range 50 of the electronic blackboard 5.

  FIG. 11 shows a display example of the file “worksheet 1.pdf”. As shown in FIG. 11, the file “worksheet 1.pdf” has answer columns 70 </ b> A to 70 </ b> E. When the student or the like writes in the answer columns 70 </ b> A to 70 </ b> E of the “worksheet 1.pdf” displayed on the electronic blackboard 5 with a writing pen (stylus) or the like, the processing unit 34 reads from the electronic blackboard 5. The coordinate information included in the transmitted input information is converted into coordinate information on the screen of the display means 36 based on the coordinate conversion function, and a stroke is drawn on the display means 36 based on the coordinate information. Further, the processing unit 34 transmits an image signal for displaying an image on the display unit 36 to the projector 4 to project the same image as the image on the display unit 36 in synchronization. Thereby, the stroke drawn by the writer is similarly projected on the electronic blackboard 5.

  With reference to FIG. 10 again, the reproduction of the associated content will be described. After the file “worksheet 1.pdf” is displayed on the display, the reproduction order resetting means 344 displays the item “update reproduction order” corresponding to the file “worksheet 1.pdf” in the association area information as “reproduction”. "Completed" (see step S103 in FIG. 9). Further, the reproduction order resetting means 344 updates each of the unreproduced contents whose update reproduction order is No. 2 or later on the same spread page (pages 22 and 23) because the update reproduction order of the displayed associated content is No. 1. The reproduction order is incremented by one (see step S105 in FIG. 9). Specifically, in this case, the update reproduction order of the associated content “fault □□ machi.mp4” is No. 2 to No. 1, and the update reproduction order of the association content “Fault XX town.mp4” is No. 3 to 2. The update playback order of the associated content “fault ΔΔ town.mp4” is from 4th to 3rd. As described above, the update reproduction order of the unreproduced content in the same spread page (pages 22 and 23) is a serial number starting from 1 again.

  Next, the reproduction icon 61 is touched again with the fingertip 80. In this case, the reproduction control unit 343 of the processing unit 34 recognizes that the reproduction icon 61 is touched based on the detection signal transmitted from the touch panel. In this case, the reproduction control means 343 refers to the association area information shown in FIG. 4 and the initial reproduction order is set to No. 2 and the update reproduction order is 1 on the spread pages (pages 22 and 23). Play or display the associated content that is the number. Specifically, the reproduction control unit 343 reproduces the moving image content “fault □□ town.mp4” associated with the association area 22. In this case, the moving image content “fault □□ machi.mp4” is also projected and displayed in the projection range 50 of the electronic blackboard 5. Note that the reproduction control unit 343 may forcibly end the content “worksheet 1.pdf” when reproducing the moving image content “fault □□ machi.mp4”. Only the process of changing the display position to the back of “mp4” may be performed. Further, the reproduction order resetting means 344 sets the item “update reproduction order” corresponding to the file “fault □□ town.mp4” of the association area information to “reproduced” (see step S103 in FIG. 9). In addition, the update reproduction order of all other unreproduced contents on the spread pages (pages 22 and 23) is incremented by 1 (see step S105 in FIG. 9). Accordingly, the update reproduction order of the associated content “fault XX town.mp4” is changed from No. 2 to No. 1, and the update reproduction order of the associated content “Fault ΔΔ town.mp4” is changed from No. 3 to No. 2.

  Similarly, when the playback icon 61 is touched again with the fingertip 80, the associated content “fault △ Δ town.mp4” having the initial playback order set to 3 and the updated playback order of 1 is played or indicate. Then, the reproduction order resetting means 344 sets the item “update reproduction order” corresponding to the file “fault ΔΔ town.mp4” of the association area information to “reproduced” (see step S103 in FIG. 9). Further, 1 is subtracted from the numerical value of the update reproduction order of other unreproduced contents on the spread pages (pages 22 and 23) (see step S105 in FIG. 9). As a result, the update reproduction order of the associated content “fault ΔΔ town.mp4” is changed from No. 2 to No. 1.

  When the reproduction icon 61 is touched again with the fingertip 80, the associated content “fault XX town.mp4” having the initial reproduction order set to the fourth and the updated reproduction order of the first is reproduced or displayed. To do. Then, the reproduction order resetting unit 344 sets the item “update reproduction order” corresponding to the file “fault XX town.mp4” of the association area information to “reproduced” (see step S103 in FIG. 9). Further, the reproduction order resetting means 344 has no other unreproduced content on the same spread page (pages 22 and 23). Processing such as returning each item of “update playback order” to the initial playback order value which is the initial value is performed.

  As described above, the reproduction control unit 343 can appropriately reproduce the content without causing an error in the reproduction order during the lesson in accordance with the lesson scheduled by the lecturer who is the user.

  Even when the reproduction icon 61 of the electronic textbook 2 projected and displayed on the projection range 50 of the electronic blackboard 5 is touched, the terminal device 3 similarly reproduces the associated content whose update reproduction order is No. 1. Specifically, when the display position of the reproduction icon 61 within the projection range 50 is touched with a stylus or the like, the reproduction control unit 343 displays the coordinate information of the input information received from the electronic blackboard 5 using a coordinate conversion function. It is converted into a coordinate system related to the display 36, and it is recognized that the reproduction icon 61 is designated based on the converted position coordinates. In this case, the reproduction control unit 343 refers to the association area information, and reproduces the associated content having the first update reproduction order for the spread page currently displayed on the display. Further, in this case, the reproduction order resetting means 344 performs a process of incrementing the update reproduction order of unreproduced content on the same spread page by one.

(2) Case where reproduction based on area selection is performed Next, a case where reproduction based on area selection is performed instead of or in addition to content reproduction based on icon selection will be described. Hereinafter, as an example, a case where the association area 22 is selected after the reproduction icon 61 has been selected will be described.

  First, when the playback icon 61 is touched with the fingertip 80, the playback control unit 343 sets the associated content “worksheet 1.pdf” whose initial playback order is set to 1 and whose update playback order is 1 Is reproduced or displayed (see step S102 in FIG. 9). Then, the reproduction order resetting unit 344 sets the item “update reproduction order” corresponding to the file “worksheet 1.pdf” of the association area information to “reproduced” (see step S103 in FIG. 9). Further, the reproduction order resetting means 344 updates each of the unreproduced contents whose update reproduction order is No. 2 or later on the same spread page (pages 22 and 23) because the update reproduction order of the displayed associated content is No. 1. The reproduction order is incremented by one (see step S105 in FIG. 9). Specifically, in this case, the update reproduction order of the associated content “fault □□ machi.mp4” is No. 2 to No. 1, and the update reproduction order of the association content “Fault XX town.mp4” is No. 3 to 2. The update playback order of the associated content “fault ΔΔ town.mp4” is from 4th to 3rd. As described above, the update reproduction order of the unreproduced content in the same spread page (pages 22 and 23) is a serial number starting from 1 again.

  Next, when the association area 22 is touched by the fingertip 80, the reproduction control unit 343 refers to the association area information and reproduces the association content “fault XX town.mp4” associated with the association area (see FIG. 9 (see step S102). Then, the reproduction order resetting unit 344 sets the item “update reproduction order” corresponding to the file “fault XX town.mp4” of the association area information to “reproduced” (see step S103 in FIG. 9). Further, the reproduction order resetting means 344 updates each of the unreproduced contents whose update reproduction order is No. 3 or later on the same spread page (pages 22 and 23) because the update reproduction order of the reproduced associated content is No. 2. The reproduction order is incremented by one (see step S105 in FIG. 9). As a result, the update reproduction order of the associated content “Fault ΔΔ Town.mp4” is changed from No. 3 to No. 2. On the other hand, the update reproduction order of the associated content “Fault □□ machi.mp4” remains the first. As described above, even if the reproduction based on the area selection is appropriately performed and the content that is not in the set order is reproduced or displayed, the reproduction order resetting unit 344 performs each update reproduction for the remaining unreproduced content. The order is reset so that the serial number starts from 1.

  When the reproduction icon 61 is touched again with the fingertip 80, the reproduction control unit 343 reproduces the associated content “fault □□ machi.mp4” whose update reproduction order is No. 1. In this case, the reproduction order resetting means 344 sets the update reproduction order of “fault ΔΔ town.mp4” whose update reproduction order was “2” to “1”.

  In this way, as a result of appropriately performing reproduction based on area selection, even when content that is not in the set order is reproduced or displayed, the terminal device 3 sets the updated reproduction order for the remaining unreproduced content to the initial value. Set serial numbers starting from 1 according to the playback order. As a result, the user can reproduce or display the content without omission even when the selection of the reproduction icon 61 and the selection of the association area are used together.

[Display update playback order]
Next, the display of the electronic textbook 2 when the unreproduced order display icon 62 is selected will be described. FIG. 12 shows a display screen of the terminal device 3 in which the unreproduced order display icon 62 is selected. Here, it is assumed that when the reproduction icon 61 is selected once and then the association area 22 is selected, the non-reproduction order display icon 62 is selected.

  As shown in FIG. 12, in this case, the display control means 341 highlights the association areas 23 and 24 associated with unreproduced content and displays the updated reproduction order in a superimposed manner. Here, similarly to the association information shown in FIG. 4, the update reproduction order of the content “fault ΔΔ town.mp4” associated with the association area 23 is “2”, and the content “fault □ associated with the association area 24 is displayed. The update reproduction order of “□ town.mp4” is “1”. Accordingly, the character “(2)” is superimposed and displayed in the association area 23, and the character “(1)” is superimposed and displayed in the association area 24.

  In this way, the user can easily grasp the association area corresponding to the unreproduced content and its updated reproduction order by selecting the unreproduced order display icon 62.

[Operational effects of the content reproduction system of the first embodiment]
According to the content reproduction system of the first embodiment, the reproduction order setting unit 342 of the terminal device 3 is configured to display content associated with a page or a spread page having a plurality of association areas among the pages or spread pages of the electronic textbook 2. Determine the initial playback order. Then, the playback order resetting means 344 of the terminal device 3 updates the update playback order of the unplayed content associated with the association area on the same spread page when the unplayed content with the initial playback order set is played back or displayed. Is set to a serial number starting from 1 based on the initial reproduction order. Thereby, the terminal device 3 can suitably set the playback order of the remaining unreproduced content even when a part of the content is played back or displayed in an order different from the preset initial playback order.

  Each spread page of the electronic textbook 2 is provided with a reproduction icon 61, and when the reproduction icon 61 is selected, the reproduction control unit 343 reproduces or displays the content whose update reproduction order is the first. . According to this aspect, the user can reproduce or display the contents without any omission in the intended order simply by performing an operation of selecting the reproduction icon 61.

  Further, when the association area in the spread page of the electronic textbook 2 is selected, the reproduction control unit 343 reproduces or reproduces the content associated with the association area regardless of whether the update reproduction order is No. 1. indicate. In this case, the reproduction order resetting means 344 increments each update reproduction order of the unreproduced content in the update reproduction order after the reproduced or displayed content by one. As described above, the terminal device 3 can suitably set the update reproduction order of the remaining unreproduced content even when a part of the content is reproduced or displayed in an order different from the preset order.

  Each spread page of the electronic textbook 2 is provided with an unreproduced order display icon 62. When the unreproduced order display icon 62 is selected, the display control means 341 displays each association area corresponding to unreproduced content. In addition to highlighting, the update reproduction order of each unreproduced content is displayed superimposed on the corresponding association area. Thereby, the user can easily grasp the reproduction order of the remaining unreproduced content.

[Modification]
Next, a modification of the first embodiment will be described. The following modifications may be applied in any combination to the above-described embodiment.

(Modification 1)
The operation of selecting the icons 41 to 62 and the association area displayed on the display of the terminal device 3 is not limited to the touch operation with the fingertip 80, and may be a touch operation with a stylus, or the terminal device 3 uses a mouse. If it has, it may be a mouse click operation.

(Modification 2)
In the association area information shown in FIG. 8, the item “association content” stores the path and file name of the association content as information for specifying the association content. Instead, the item “association content” stores a URL (Uniform Resource Locator) for opening a video site where electronic content can be browsed, and a server device that can communicate with the terminal device 3 via the network. A URL for playing a video or the like may be stored.

  In this case, when the associated content in the reproduction order to be reproduced is specified by the URL in the association area information, the reproduction control unit 343 displays a predetermined WEB site based on the URL or the server device. To start streaming playback. In this case, the WEB site and video displayed based on the URL are examples of the “content” in the present invention.

(Modification 3)
In the electronic textbook 2 shown in FIG. 6, the association areas 21 and 22 are highlighted in color. Instead of or in addition to this, the display control means 341 displays the file name of the associated content or / and the image or video in which the content is displayed in a small size at the position corresponding to the association areas 21 and 22. You may let them. For example, the display control unit 341 colors the association areas 21 and 22 with the same color and displays the file name of the associated content at a position overlapping or close to these areas.

  Also by this, the display control means 341 can make the user recognize the content type or file name associated with each of the association areas 21 and 22.

(Modification 4)
The terminal device 3 may set the initial playback order of the associated content for each page instead of setting the initial playback order of the associated content within the same spread page. For example, in this case, an icon 60 and a reproduction icon 61 are displayed for each page of the electronic textbook 2. When the icon 60 is selected, the terminal device 3 starts the playback order setting mode for the page on which the icon 60 is displayed. When the playback icon 61 is selected, the playback icon 61 is displayed. Reproduction is performed according to the initial reproduction order and the update reproduction order for the displayed page.

(Modification 5)
When the reproduction based on the area selection reproduces the unreproduced content whose update reproduction order is not the first, the reproduction order resetting unit 344 determines the updated reproduction order of the remaining unreproduced content based on the user input. May be. For example, in this case, the reproduction order resetting means 344 determines the update reproduction order of the unreproduced content by causing the unreproduced content association area to be selected in the order in which it is desired to be reproduced or displayed, as in the reproduction order setting mode. Also in this case, preferably, when an unplayed content whose update playback order is not the first is played back, the playback order resetting means 344 can determine the update playback order of the remaining unplayed content.

(Modification 6)
Instead of determining the initial playback order of the associated content in the spread page in the playback order setting mode, the playback order setting unit 342 may automatically determine the initial playback order based on a predetermined rule.

  For example, when there are a plurality of associated contents in the spread page, the display control means 341 performs initial reproduction in order from the associated contents corresponding to the associated area located on the upper page and having the smaller page number. Assign the order automatically. Thereby, the reproduction | regeneration order setting means 342 can set the appropriate initial reproduction | regeneration order according to progress of a lesson. Even in this case, the user can reproduce the unreproduced content whose update reproduction order is not No. 1 by the reproduction based on the area selection, and the reproduction order resetting means 344 is shown in the flowchart of FIG. Based on this, it is possible to appropriately set the update reproduction order of the remaining unreproduced content.

Second Embodiment
FIG. 13 shows a configuration of a content reproduction system according to the second embodiment. As shown in FIG. 13, the content reproduction system is filled in from the electronic pen 1 used by the instructor, a textbook (teaching material) 2A in which a dot pattern (coded pattern) is printed on almost the entire surface of each page, and the electronic pen 1. A terminal device 3A that receives and processes information, a projector 4 that is connected to the terminal device 3A and projects the same image as the display screen of the display onto the dot screen 5A, and a dot screen 5A on which a dot pattern is printed Prepare. In the second embodiment, the content reproduction system determines the initial reproduction order and reproduces or displays the associated content based on the entry operation with the electronic pen 1 on the textbook 2A or the dot screen 5A. Further, when an unreproduced content is reproduced or displayed, the content reproduction system sets an update reproduction order of each unreproduced content on the same spread page as in the first embodiment. Henceforth, about the part similar to 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted suitably.

(textbook)
First, the textbook (electronic pen book) 2A will be described. Each spread page of the textbook 2A has a content display area 20 and an operation area 40 on which icons 41 to 62 are printed, like the electronic textbook 2 shown in FIG. In the content display area 20 and the area including the icons 41 to 62, a dot pattern (coded pattern) indicating position coordinates described later is printed. In addition, dot patterns in different coordinate ranges are printed on each page of the textbook 2A. The dot pattern is printed with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and other characters and drawings are printed with ink that does not absorb infrared rays.

(Dot screen)
In the dot screen 5A, a dot pattern (coded pattern) is printed on a white resin substrate with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and the dot pattern is, for example, transparent EB cured. It has a layer structure protected by a resin layer or the like.

  Light constituting the same image as the screen of the terminal device 3A is projected by the projector 4 onto the projection range 50 of the dot screen 5A. Specifically, the electronic textbook 2 obtained by digitizing the textbook 2A shown in FIG. When the user taps the icons 41 to 62 projected and displayed on the dot screen 5 </ b> A with the electronic pen 1 and causes the dot pattern of the area on which the icon is projected to be read, the terminal device 3 </ b> A enters from the electronic pen 1. The information is received, and the displayed page of the electronic textbook 2 is changed or the writing mode by the electronic pen 1 is started according to the function assigned to the tapped icon.

(Dot pattern)
Next, an Anoto dot pattern (coded pattern) printed on each page of the textbook 2A and the dot screen 5A will be described with reference to FIGS. FIG. 14 is a diagram for explaining the relationship between dots of a dot pattern and values to which the dots are converted. As shown in FIG. 14, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on each page of the textbook 2A and the dot screen 5A are determined by the combination of the information thus associated. Note that a dot pattern is formed so that the coordinate areas do not overlap between the pages of the textbook 2A or between each page of the textbook 2A and the dot screen 5A.

  FIG. 15A shows an arrangement of a certain dot pattern. As shown in FIG. 15 (a), 6 × 6 dots within a range of about 2 mm in length and width are unique patterns regardless of which portion of each page of textbook 2A or dot screen 5A takes 6 × 6 dots. It is arranged to become. The dot pattern formed by these 36 dots holds the position coordinates (for example, the position on the dot screen 5A of each page of the textbook 2A). FIG. 15B is a diagram in which each dot shown in FIG. 15A is converted into a value associated with the regularity shown in FIG. 14 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 16 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 16, the electronic pen 1 includes an ink cartridge 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the ink cartridge 104 is a pen tip portion 103, and the user makes a stroke (handwritten stroke) by bringing the pen tip portion 103 of the electronic pen 1 into contact with each page of the textbook 2A or the dot screen 5A. Fill out. Here, the first contact of the pen tip portion 103 of the electronic pen 1 with each page or the like of the textbook 2A is called “pen down”, and the pen tip portion 103 leaves the contacted (contacted) state. Is called “pen-up”. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects a pressure applied through the ink cartridge 104 from the pen tip portion 103 when the user writes or taps a character or mark on each page of the textbook 2A or the like with the electronic pen 1, that is, a writing pressure. The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like on each page of the textbook 2 </ b> A with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and the processor 108 is detected when the pressure sensor 107 detects a writing pressure higher than a predetermined value. Determines that the user has started entry, and activates the LED 105 and the CMOS camera 106. Then, the communication unit 111 detects pen down information (hereinafter referred to as “pen down information PD”) detected by the pressure sensor 107 and identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later. Are transmitted to the terminal device 3A as entry information. Further, when the user finishes entering one stroke and moves the electronic pen 1 away from each page of the textbook 2A, the pressure sensor 107 detects pen-up because the writing pressure exceeding a predetermined value is not detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 (hereinafter referred to as “pen-up information PU”) and the pen ID, and transmits the information to the terminal device 3A as entry information.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on each page of the textbook 2A. The region is slightly shifted from the position where the pen tip portion 103 contacts each page of the textbook 2A. The CMOS camera 106 is provided with an infrared transmission filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105, and the image data of the dot pattern is captured. This is supplied to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Therefore, even when characters, drawings, and the like are printed on each page of the textbook 2A, the processor 108 can recognize the dot pattern because the printed ink does not absorb in the infrared region. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 15A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  While the user performs the entry, the processor 108 uses the dot pattern of the image data supplied by the CMOS camera 106 to determine the X and Y coordinates (hereinafter simply referred to as “page” of the textbook 2A of the stroke (handwriting) to be entered by the user. (Also called “coordinate data” or “coordinate information”) is continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 15 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 15 (b). The data is converted into a Y coordinate bit value, and X and Y coordinate data are calculated from the data array by a predetermined calculation method. Note that the processor 108 has a rotation correction processing function for correcting the arrangement of dots on the image due to the angle of the electronic pen 1 facing the dot pattern, and that function is executed during coordinate calculation. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. Note that each page of the textbook 2A and the 6 × 6 dot pattern on the dot screen 5A do not overlap in each page of the textbook 2A and the dot screen 5A. It can be specified by coordinate calculation by the processor 108 which position on the page of the textbook 2A or the position of the dot screen 5A the entered position corresponds to.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID, time information (time stamp), writing pressure data, and X, Y coordinate data, and transmits the information as entry information to the terminal device 3A. In this case, transmission to the terminal device 3A by the communication unit 111 is immediately and sequentially performed by wireless transmission such as Bluetooth (registered trademark). Here, one or a plurality of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the terminal device 3A is stored as stroke information by the terminal device 3A. In other words, one stroke is composed of one or a plurality of X and Y coordinates (coordinate points), and the terminal device 3A includes one or more constituting one stroke by the pen-down information PD and the pen-up information PU. Recognize pieces of coordinate attribute information.

  The electronic pen 1 may include a pen portion that is not filled with ink instead of the ink cartridge 104. In this case, ink is not output from the nib portion 103. When the electronic pen 1 is prepared for each of the textbook 2A and the dot screen 5A, the electronic pen 1 having the ink cartridge 104 is prepared for the textbook 2A, and for the dot screen 5A. An electronic pen 1 having a pen unit may be prepared.

(Terminal device)
The terminal device 3A is, for example, a PC (personal computer) that can be input using a mouse or a keyboard, and has the same hardware configuration and functional configuration as the terminal device 3 of the first embodiment. When the processing unit 34 of the terminal device 3A reads the dot pattern when the icons 41 to 62 printed on the textbook 2A or the icons 41 to 62 projected on the dot screen 5A are tapped with the electronic pen 1. Based on the entry information generated and transmitted by the electronic pen 1, the coordinate definition information described later is referred to and the tapped icon is recognized. Then, the processing unit 34 of the terminal device 3A performs a predetermined process according to the function associated with the tapped icon.

  For example, when the icon tapped with the electronic pen 1 is the icon 60, the playback order setting means 342 of the terminal device 3A sets the playback order as described in the section “Setting the initial playback order” in the first embodiment. The mode is started, and the initial reproduction order of the contents associated with the association area on the same spread page is determined. When the icon tapped with the electronic pen 1 is the playback icon 61, the playback control unit 343 projects or plays back or displays the associated content with the update playback order set to 1 on the dot screen 5A.

  When the icon tapped with the electronic pen 1 is the unreproduced order display icon 62, the display control unit 341 highlights the association area corresponding to each unreproduced content on the target spread page as shown in FIG. In addition, the update reproduction order corresponding to each association area is superimposed and displayed.

  Further, the reproduction order resetting means 344 sets the update reproduction order to be set for the remaining unreproduced content on the same spread page according to the flowchart shown in FIG. 9 when the unreproduced content is reproduced or displayed.

  As in the first embodiment, the processing unit 34 of the terminal device 3A performs a calibration process to convert the coordinate system related to the dot pattern of the dot screen 5A to the coordinate system related to the display of the display unit 36. Find the coordinate transformation function. Further, the processing unit 34 uses the coordinate conversion function obtained by the calibration process to receive the coordinate system data related to the dot pattern of the dot screen 5A and receives the coordinate system data applied to the display of the display unit 36. Convert to data.

  The storage unit 33 of the terminal device 3A stores the entry information received from the electronic pen 1 for each pen ID. In addition, the storage means 33 indicates the coordinate range indicated by the dot pattern corresponding to the content display area 20 and the icons 41 to 62 of each page of the textbook 2A and the dot pattern corresponding to the dot screen 5A for each type of textbook 2A. Coordinate range information (also referred to as “coordinate definition information”) is stored. In addition, as with the terminal device 3, the storage unit 33 stores association area information shown in FIG.

[Operational effects of the content reproduction system of the second embodiment]
According to the content reproduction system of the second embodiment, the terminal device 3 determines the initial reproduction order and reproduces or displays the associated content based on information entered by the electronic pen 1 on the textbook 2A or the dot screen 5A. Can be. Further, when the unreproduced content is reproduced or displayed, the terminal device 3 can set the update reproduction order of each unreproduced content on the same spread page to a serial number starting from 1, as in the first embodiment. . In addition, the content reproduction system of the second embodiment can realize the same functions as those of the first embodiment.

[Modification]
Next, a modification of the second embodiment will be described. In the second embodiment, the following modified example 7 may be applied in addition to the modified examples 1 to 6 of the first embodiment described above.

(Modification 7)
In the second embodiment, the Anoto method is used for the electronic pen, the dot pattern (coded pattern), and the entry information. However, the Anoto method is not limited. Further, the dot pattern (coded pattern) is not limited to the one indicating the position coordinates, and may be a code value for identifying the icon or a code value for identifying the association area.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Electronic textbook 3, 3A ... Terminal device 4 ... Projector 5 ... Electronic blackboard 5A ... Dot screen

Claims (11)

Display control means for displaying electronic teaching materials on the display means;
Storage means for storing information of an association area that is an area within a predetermined page of the electronic teaching material and is associated with content;
Reproduction order setting means for setting the reproduction or display order of the contents associated with the association area on the page or spread page of the electronic teaching material provided with a plurality of association areas;
Reproduction control means for reproducing or displaying content associated with the association area based on an external input;
When content that has not been played back or displayed is played or displayed among the content for which the playback or display order is set, the content is played back or displayed in association with the association area on the same page as the content or on the same spread page. Playback order resetting means for resetting the playback or display order of each content that is not,
The terminal device characterized by having. The reproduction order resetting means includes:
2. The terminal apparatus according to claim 1, wherein the order of reproduction or display of each content not reproduced or displayed is reset based on the order of reproduction or display set by the reproduction order setting means. Each page or each spread page of the electronic teaching material is provided with a reproduction icon for reproducing or displaying the content based on the reproduction or display order set by the reproduction order setting means.
3. The terminal device according to claim 1, wherein when the reproduction icon is selected, the reproduction control unit reproduces or displays the content corresponding to an order to be reproduced or displayed.   When the association area in the page or spread page of the electronic teaching material displayed on the display means is selected, the reproduction control unit is associated with the association area regardless of the set reproduction or display order. The terminal device according to any one of claims 1 to 3, wherein the content is reproduced or displayed. The display control means includes
In the electronic teaching material page or spread page displayed on the display means, the display area highlights the association area corresponding to each content that is not reproduced or displayed, and
5. The terminal device according to claim 1, wherein display of the order of the reproduction or display of each content not reproduced or displayed is attached to the corresponding association area. 6.   6. The display control unit according to claim 5, wherein when the display unit highlights the association area, the display unit displays the association area in a color-coded manner for each corresponding content type. The terminal device described.   The reproduction order setting unit determines the reproduction or display order based on a selection order in which the association area is selected on the page or the spread page of the electronic teaching material displayed on the display control unit. Item 7. The terminal device according to any one of Items 1 to 6. A terminal device;
An electronic sheet that detects a contact position and transmits a detection signal indicating the contact position to the terminal device;
A content reproduction system comprising: a projector that emits light based on an image signal transmitted from the terminal device to a surface of the electronic sheet;
The terminal device
Display control means for projecting and displaying an electronic teaching material on the electronic sheet by the projector;
Storage means for storing information of an association area that is an area within a predetermined page of the electronic teaching material and is associated with content;
Reproduction order setting means for setting the reproduction or display order of the contents associated with the association area on the page or spread page of the electronic teaching material provided with a plurality of association areas;
Reproduction control means for reproducing or displaying content associated with the association area based on the detection signal;
When content that has not been played back or displayed is played or displayed among the content for which the playback or display order is set, the content is played back or displayed in association with the association area on the same page as the content or on the same spread page. A content reproduction system comprising reproduction order resetting means for resetting the reproduction or display order of each content that has not been reproduced. Teaching materials with printed coding patterns;
A terminal device;
In a content reproduction system including an electronic pen that reads a coded pattern, calculates a position coordinate or code value of a pen tip, and transmits entry information including the position coordinate or code value to the terminal device.
The terminal device
Storage means for storing information of an association area of the learning material associated with the content;
Reproduction order setting means for setting the reproduction or display order of the content associated with the association area on the teaching material page or the spread page provided with a plurality of association areas;
Reproduction control means for reproducing or displaying content associated with the association area of the learning material based on the entry information received from the electronic pen;
When content that has not been played back or displayed is played or displayed among the content for which the playback or display order is set, the content is played back or displayed in association with the association area on the same page as the content or on the same spread page. A content reproduction system comprising reproduction order resetting means for resetting the reproduction or display order of each content that has not been reproduced. A terminal device;
An electronic pen that reads a coded pattern, calculates a position coordinate or code value of the pen tip, and transmits entry information including the position coordinate or code value to the terminal device;
A screen with a coded pattern on the surface;
A projector that emits light based on an image signal transmitted from the terminal device to the surface of the screen;
The terminal device
Display control means for projecting and displaying electronic teaching materials on the screen by the projector;
Storage means for storing information of an association area that is an area within a predetermined page of the electronic teaching material and is associated with content;
Reproduction order setting means for setting the reproduction or display order of the contents associated with the association area on the page or spread page of the electronic teaching material provided with a plurality of association areas;
Reproduction control means for reproducing or displaying the content associated with the association area based on the entry information received from the electronic pen;
When content that has not been played back or displayed is played or displayed among the content for which the playback or display order is set, the content is played back or displayed in association with the association area on the same page as the content or on the same spread page. A content reproduction system comprising reproduction order resetting means for resetting the reproduction or display order of each content that has not been reproduced. A program that causes a computer to function as the terminal device according to any one of claims 1 to 10.