JP2019144507A - Output device, data output system, and outputting method - Google Patents

Abstract

To provide an output device which, when one of audio and memo datasets is selected, allows for easily referring to the other dataset.SOLUTION: In order to clear the above challenge, an output device (1) according to an embodiment of the present invention is configured to store an audio dataset and memo dataset in association with each other and, when one dataset of the audio dataset corresponding to a certain chronological period and a target section of the memo dataset is selected, output the other dataset associated with the one dataset.SELECTED DRAWING: Figure 1

Description

  One embodiment of the present invention relates to an output device, a data output system, and a data output method.

  2. Description of the Related Art In recent years, classes are being held in schools and the like in which each student has a terminal such as a laptop computer or tablet. Each student uses the terminal, for example, when reading textbooks, reference books, etc., or taking notes electronically.

  In the following Patent Document 1, when taking a class using a terminal device, it is troublesome to review the class by associating and recording the open electronic textbook page and the blackboard data on the electronic blackboard. An information processing system that can reduce the risk is disclosed.

JP 2006-138930 A (released on August 4, 2016)

  However, the conventional technology as described above has a problem that it takes time and effort to search for a corresponding portion between the memo data and the recorded data when the user records the lesson and confirms it later.

  One aspect of the present invention has been made in view of the above problem, and when audio data or memo data is selected, an output device (terminal device) that can easily refer to the other data is realized. The purpose is to do.

  In order to solve the above problems, an output device according to an aspect of the present invention stores voice data and memo data in association with each other, and stores a certain section on the time series of the voice data and a target portion in the memo data. When one is selected, the other data associated with the one is output.

  According to one aspect of the present invention, when audio data or memo data is selected, an output device that can easily refer to the other data can be realized.

3 is a functional block diagram of a terminal device according to Embodiment 1. FIG. 3 is a flowchart showing a flow of processing according to the first embodiment. It is a figure which shows the example which a user writes in with respect to a note display part. It is a figure which shows the example of memo data. It is a figure which shows the example which a user writes in with respect to an electronic book display part. It is a figure which shows the example of operation history data. It is a figure which shows the example in which the display control part displayed the electronic book data, the electronic note, and the audio | voice waveform diagram on the display part. It is a figure which shows the example which mutually refers an electronic notebook, electronic book data, and audio | voice data. It is a figure which shows the example of the screen which edits audio | voice data, memo data, operation history data, or those correspondence. It is a functional block diagram of the terminal device which concerns on the modification of Embodiment 1. It is a functional block diagram of the terminal device and server which concern on Embodiment 2. FIG. 10 is a flowchart showing a flow of processing according to the second embodiment. It is the block diagram which illustrated the composition of the computer which can be used as a terminal unit or a server.

  The embodiment of the present invention will be described with reference to FIGS.

Embodiment 1
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, an embodiment of the invention will be described with reference to FIGS.

  In the present embodiment, a configuration will be described in which a user records each data related to a class using a terminal device and refers to it later.

[1. Configuration of Terminal Device 1]
Based on FIG. 1, the structure of the terminal device 1 (output device 1) which concerns on this embodiment is demonstrated. The terminal device 1 is a device such as a tablet that can input and output data due to a predetermined operation by a user.

  FIG. 1 is a functional block diagram of a terminal device 1 according to the present embodiment. As illustrated in FIG. 1, the terminal device 1 includes a control unit 10, a storage unit 20, a display unit 30, a voice acquisition unit 41, and a voice output unit 42.

  The control unit 10 is a control device that controls the entire terminal device 1, and includes a display control unit 11 and an audio output control unit 12. The display control unit 11 performs control related to the screen display of the display unit 30. The audio output control unit 12 performs control related to audio output by the audio output unit 42.

  The storage unit 20 is a storage device that holds various data, and stores audio data 21, memo data 22, operation history data 23, and electronic book data 24. The voice data 21 is data indicating a voice in which a conference, an interview, a class, or the like (referred to as a class or the like in this specification as appropriate) is recorded, for example. The memo data 22 is data indicating text or an illustration input to the terminal device 1 by the user via the display unit 30. The operation history data 23 is data indicating a user operation history for an electronic book or the like.

  The electronic book data 24 is data indicating a part or the whole of, for example, a textbook, a reference book, a print, or the like (referred to as an electronic book or the like in this specification as appropriate). The electronic book data 24 may include text, images, or both. In addition, in this specification, when calling each data mentioned above, it is not distinguished whether each said data is a part or all of the said each data.

  The display unit 30 includes a digital book display unit 31 and a notebook display unit 32 and is a touch panel capable of screen display. The user may perform an operation on the terminal device 1 via the display unit 30. The electronic book display unit 31 displays the contents of an electronic book or the like derived from the electronic book data 24. The notebook display unit 32 displays a page that the user uses as a notebook. The electronic book display unit 31 and the notebook display unit 32 correspond to part or all of the area of the display unit 30, and each size may be variable.

[2. Process flow
The flow of the process in this embodiment is demonstrated for every step based on FIGS. FIG. 2 is a flowchart showing a flow of processing according to the present embodiment. Hereinafter, as an example, a description will be given on the assumption that each user (student) taking a class has the terminal device 1.

  Note that the terminal device 1 can be in a recording mode in which each data related to a class or the like is recorded and a reproduction mode in which the user refers to the data.

(S101)
Steps S <b> 101 to S <b> 105 are processes in which the user records each data related to the lesson using the terminal device 1, that is, processes in the recording mode described above. In step S101, the display control unit 11 causes the electronic book data 24 to be displayed on the electronic book display unit 31 by a predetermined operation on the terminal device 1 by the user, and an electronic notebook (referred to as an electronic notebook in this specification as appropriate). .) Is displayed on the note display unit 32.

  Note that the control unit 10 refers to the memo data 22, and the display control unit 11 is a user's writing up to the previous lesson, and writing to the electronic book data 24 and the electronic notebook is also the electronic book display unit 31 and the notebook display unit. 32 may be displayed. Next, the control unit 10 starts the process of acquiring the content written by the user with respect to the electronic book data 24 and the electronic notebook, and storing it as memo data 22 in the storage unit 20 as needed.

(S102)
Subsequently, in step S102, the control unit 10 causes the audio acquisition unit 41 to acquire the audio of the lesson, and starts processing to save the audio data 21 indicating the audio in the storage unit 20 as needed. At this time, the recording start time is also recorded in the storage unit 20. Further, during recording of audio data, if a period in which the audio output level is equal to or lower than a threshold value continues for a certain period of time, the start time / end time of the silent period is recorded as the audio data delimiter position.

(S103)
Subsequently, in step S <b> 103, the control unit 10 acquires an operation history for the electronic book by the user, and starts processing to save operation history data 23 indicating the operation history in the storage unit 20 as needed. Note that the above-described operation history includes, for example, operations for browsing such as opening / closing, turning pages, and expanding pages of electronic book content, and a user gives a marker to text such as an electronic book, Refers to an operation that performs writing. Further, the order of processing from step S101 to S103 may be changed.

(S104)
Subsequently, in step S104, the terminal device 1 performs a predetermined end operation on the terminal device 1 with respect to the process in which the control unit 10 stores each data in the storage unit 20 described above in steps S101 to S103. Continue until.

  A user who owns the terminal device 1 appropriately writes in the electronic book display unit 31 and the notebook display unit 32 while taking a lesson.

  FIG. 3 is a diagram illustrating an example in which the user performs writing on the note display unit 32.

  When text or the like is input to the note display unit 32, the terminal device 1 shifts to a mode for adding / editing text when the user selects the button 72. Next, the user selects a text input area as shown in FIG. 3B and inputs the text from the keyboard. The keyboard may be a keyboard that is realized by software as one function of the terminal device 1 and displayed on the display unit 30. The terminal device 1 ends the mode for adding / editing text when the user selects outside the area.

  Further, when the user selects the button 73, the terminal device 1 shifts to a mode for adding / editing a freehand free line. Next, the user selects an area for inputting a free line as shown in FIG. 3C, and inputs the free line with a mouse or a pen. The terminal device 1 ends the mode for adding / editing a free line when the user selects outside the area.

  Further, the display control unit 11 may cause the note display unit 32 to display, for example, a screen display enlargement / reduction button 70 or a page switching button 71.

  FIG. 4 is a diagram illustrating an example of the memo data 22. As shown in FIG. 4, the memo data 22 includes, for example, an edit start date / time, an edit end date / time, a writing type, a page in which the memo is written, a position of the memo in the page, and a memo content.

  Note that the processing unit of each row in FIG. 4, that is, the memo data 22 is not limited to a unit for each rectangular area into which text or a free line is input. For example, when the memo data 22 is text data, the text for each line may be used as a processing unit. When the memo data 22 is a free line, free lines separated by a predetermined distance or more are separate memo data. 22 may be used.

  FIG. 5 is a diagram illustrating an example in which the user performs writing on the electronic book display unit 31. When the user performs an operation of tracing the text 50 such as the electronic book displayed on the electronic book display unit 31, the display control unit 11 selects a marker color (background color) for a part of the electronic book display unit 31. 51 is displayed. Next, when the user performs an operation of selecting any color, a marker is attached to the text according to the color selected by the user.

  The display control unit 11 also includes, for example, an electronic book selection button 80, a page switching button 81, a screen display enlargement / reduction button 82, an electronic book display end button 83, or an electronic book. Alternatively, a button 84 or the like sandwiching a bookmark may be displayed.

  FIG. 6 is a diagram illustrating an example of the operation history data 23. As illustrated in FIG. 6, the operation history data 23 includes, for example, operation date and time, operation content, operation target, operation target page, predetermined parameters, and the like. The operation history also includes operations for opening and closing electronic books and the like.

  In addition, when storing the audio data 21 in the storage unit 20, the control unit 10, at an arbitrary position of the audio data 21, for example, at the beginning of a location where the audio acquired by the audio acquisition unit 41 is equal to or higher than a predetermined volume, Alternatively, a break or index may be inserted at regular time intervals.

(S105)
Subsequently, in step S <b> 105, the terminal device 1 terminates the process in which the control unit 10 saves each data in the storage unit 20 in the processing described above in steps S <b> 101 to S <b> 104 according to a predetermined operation by the user.

(S106)
Steps S106 to S109 are processes in which the terminal device 1 outputs each data in accordance with a user's predetermined operation. In other words, the processing from step S106 to step S109 is processing in which the user uses the terminal device 1 to refer to each data recorded from step S101 to step S105, that is, processing in the above-described playback mode. Note that the series of processing from step S106 to step S109 may be repeatedly performed a plurality of times until the user ends the reproduction mode of the terminal device 1 by a predetermined operation.

  In step S <b> 106, the user selects any part of the electronic notebook, the electronic book data 24, or the audio data 21.

  FIG. 7 is a diagram illustrating an example in which the display control unit 11 causes the display unit 30 to display an audio waveform diagram 60 indicating the electronic book data 24, the electronic notebook, and the audio data 21.

  As shown in FIG. 7, the audio waveform diagram 60 includes, for example, a stop button 61 for stopping audio output, a playback button 62 for reproducing audio, a marker 63 indicating the editing start time of the memo data 22, and the like. The marker 64 etc. which show the reproduction | regeneration position of an audio | voice may be included. Moreover, the structure which can change the audio | voice reproduction | regeneration position by a user sliding the marker 64 right and left may be sufficient.

  Moreover, the structure which can change the screen ratio which each area | region occupies for the display part 30 by the operation etc. which a user traces the boundary between each area | region, for example may be sufficient. In particular, the audio waveform diagram is hidden by the user's operation of tracing the finger from the inside of the screen to the bottom of the screen via the audio waveform diagram, and conversely, the operation of tracing the finger from the bottom of the screen to the inside of the screen, etc. It is also possible to use a configuration that can be displayed again.

  The memo data 22, the operation history data 23, and the voice data 21 can be referred to each other by selecting one of them. FIG. 8 is a diagram illustrating an example in which the above-described data are referred to each other.

  In this step, for example, as shown in FIG. 8B, the user performs an operation of selecting the text 52 described in the electronic notebook. The text / handwriting unit to be selected is the unit of each line in FIG. 4, that is, the processing unit of the memo, so that the learner can easily select the memo data.

(S107)
Subsequently, in step S107, the display unit 30 presents in a selectable manner which data is referred to from the location selected by the user in step S106.

  For example, in step S <b> 106, when the user selects the text 52 displayed on the note display unit 32, the display control unit 11 displays the operation history or sound of an electronic book or the like at the time when the text 52 is recorded as the memo data 22. An option for referring to the data 21 is displayed on the note display unit 32 so as to be selectable.

  Note that the reference to the operation history of an electronic book or the like means that the opened page of the electronic book or the like at that time is opened and the operation is reproduced if an operation such as enlargement is performed.

  In step S106, for example, when the user selects the marker 63 or the vicinity of the marker 63 in the audio waveform diagram 60, the display unit 30 displays the electronic note at the time corresponding to the marker 63 or the vicinity of the marker 63. An option for referring to an operation history of an electronic book or the like is displayed.

  In step S106, for example, when the user selects a marker portion of text included in the electronic book displayed on the electronic book display unit 31, the display unit 30 displays the time at which the marker is attached to the electronic book. Alternatively, an option for referring to whether the audio data 21 or the electronic notebook is described at a time separated from the time by a time within a predetermined range is displayed.

(S108)
Subsequently, in step S108, the user performs an operation of selecting one of the options displayed on the display unit 30 in step S106.

(S109)
Subsequently, in step S109, the terminal device 1 outputs the data selected by the user in step S108.

  For example, when the user selects the button 53b for listening to the voice at the time of creation in FIG. 8B, the voice output control unit 12 sets the time when the user wrote the text 52 in the electronic notebook or within a predetermined range from the time. The voice output unit 42 is caused to output the voice acquired by the voice acquisition unit 41 starting from the time separated by the time.

  Note that, for example, when the user performs an operation of selecting the text 52 described in the electronic notebook, the notebook display unit 32 does not display the option 53, and the terminal device 1 displays the operation history and the audio data 21. The structure which outputs both or one may be sufficient.

  The above is the flow of processing based on the flowchart of FIG.

  As described above, the terminal device 1 (output device 1) according to the present embodiment stores the voice data 21, the memo data 22, and the operation history data 23 together with the information indicating the processing time. When the first data which is any data included in the data group including the memo data 22 and the operation history data 23 is selected, the first time at the same time based on each processing time is selected. The second data different from the data, or the second data and the third data are retrieved and output.

  According to said structure, when any of the audio | voice data 21, the memo data 22, or the operation history data 23 is selected, the output device which can refer other data easily is realizable.

  Each of the data may be data associated with at least a part of the same time information, that is, data recorded at the same time.

  According to the above configuration, recording is performed at the same time by selecting one of the first data (for example, voice data 21) and the second data (for example, memo data 22) associated with the same time information. The other data can be easily referred to.

<Additional Notes on Embodiment 1>
In Embodiment 1, although the terminal device 1 demonstrated the structure which records the audio | voice data 21, the memo data 22, and the operation history data 23, the terminal device 1 does not necessarily record all three types of data mentioned above. Also good. For example, the terminal device 1 (output device 1) stores the voice data 21 and the memo data 22, and when one of the sections in the time series of the voice data 21 and the target portion in the memo data 22 is selected. The other data at the same time may be searched and output from the one processing time.

  According to said structure, when the audio | voice data 21 or the memo data 22 is selected, the output device which can refer another data easily is realizable.

  Further, the audio data 21 and the memo data 22 stored in the terminal device 1 may be data associated with at least a part of the same time information.

  In general, the time when the teacher started explanation, the time when the student saved the memo data, and the operation time for the electronic book do not completely match. For example, when a student takes memo data based on the teacher's writing, and the teacher adds verbal explanation, the corresponding voice data continues after the memo data save time, whereas the teacher verbally If the teacher starts writing on the board after explanation and the student records it as memo data, the memo data storage time will follow the teacher's voice data. In addition, voice data that is not related to memo data, such as attendance confirmation and chat, may be included. Therefore, the terminal device 1 may have a function of changing the voice data 21, the memo data 22, the operation history data 23, or their corresponding relationship or deleting unnecessary voices according to a predetermined operation by the user. Good. FIG. 9 is a diagram showing an example of a screen for editing each data described above.

  In the screen shown in FIG. 9, the user performs an operation of selecting and deleting a part of an unnecessary speech waveform, for example, in units of intervals, and the control unit stores data indicating the speech corresponding to the speech waveform. The data 21 may be deleted. Also, an editing function may be provided that can divide and combine the delimiter sections according to the contents while outputting audio data. Alternatively, the user performs an operation of sliding the object 55 or the like indicating that the textbook page 23 is opened to the left or right, and the control unit changes the data indicating the time when the page is opened, and the operation history data 23 is displayed. May be updated. Further, the function may belong to either the recording mode or the reproduction mode.

  The user's writing on the electronic book may be stored as a part of the electronic book data 24 or may be stored as a part of the memo data 22. Alternatively, in particular, in the case of a light writing such as adding a marker to the text, as shown in FIG.

  Further, the display unit 30 may not have a function as a touch panel, and may be a simple display panel. In the case of the above configuration, the terminal device 1 includes an input device such as a keyboard, a button, or a mouse. Therefore, the operation history described above in step S103 is not limited to the history of operations performed by the user via the display unit 30, and may be, for example, the history of operations performed by the user via the physical keyboard. .

  Moreover, the structure implement | achieved by the apparatus different from the terminal device 1 may be sufficient as the one part member or function which the terminal device 1 has. For example, a device that is different from the terminal device 1 that edits and displays an electronic notebook may display the electronic book data 24.

  Each of the supplementary items described above can be appropriately applied to each of the embodiments and modifications described later.

[Modification]
The modification of Embodiment 1 is demonstrated based on FIG.2 and FIG.10. For convenience, members having the same functions as those described in the above embodiment are given the same reference numerals, and description thereof is omitted.

  In the present modification, a configuration in which sensor information such as an acceleration sensor is referred to when the terminal device records voice will be described.

  FIG. 10 is a functional block diagram of the terminal device 1a according to the present modification. As shown in FIG. 10, the terminal device 1 a further includes a sensor unit 43 from the terminal device 1 illustrated in FIG. 1, and the control unit 10 a further includes a sensor information acquisition unit 13 from the control unit 10.

  The sensor unit 43 includes, for example, a 6-axis sensor or an acceleration sensor (not shown in FIG. 10), and detects changes in the position and orientation of the terminal device 1a. The sensor information acquisition unit 13 acquires a signal that is a signal from the sensor unit 43 and that indicates a change in the position and orientation of the terminal device 1a.

  In the terminal device 1a according to this modification, in the process in which the control unit saves the audio data 21 in the storage unit 20 as described above in step S102 of the first embodiment, the control unit includes the sensor information acquisition unit 13 of the terminal device 1a. Due to the fact that a signal indicating a change in position and orientation is acquired, a segment or index is inserted at a position corresponding to the time at which the signal is acquired in the audio data 21 being stored in the storage unit 20.

  According to the above configuration, for example, the lesson moves to another form, so-called group learning, the user moves the desk, and the sensor unit 43 detects the movement of the terminal device 1a. Even when the sound does not stop, a break or index can be inserted at a suitable position of the sound data 21 stored in the storage unit 20.

[Embodiment 2]
A second embodiment of the present invention will be described below. For convenience, members having the same functions as those described in the above embodiment are given the same reference numerals, and description thereof is omitted.

  In the present embodiment, a configuration will be described in which the terminal device acquires and refers to audio data 21 such as a lesson and operation history for the electronic book data 24 and the like from the server.

[1. Configuration of Terminal Device 1b]
FIG. 11 is a functional block diagram of the terminal device 1b and the server 90 according to the present embodiment.

  As illustrated in FIG. 11, the terminal device 1 b is configured to further include a communication unit 44 from the configuration illustrated in FIG. 1. The control unit 10b further includes a communication control unit 14. In addition, as shown in FIG. 11, the terminal device 1b does not need to be provided with the audio | voice acquisition part 41. FIG.

  The communication unit 44 performs communication processing with an external device. The communication control unit 14 performs processing related to control of data communication processing by the communication unit 44.

  The server 90 is an electronic blackboard operated by a teacher or the like who conducts a lesson, and can display an electronic book or the like on part or all of the screen. The electronic blackboard (server 90) can store an operation history for the electronic book and audio data 21 such as a lesson, and can output each data to a client such as the terminal device 1b. In addition, the user can write a blackboard on the screen in the same manner as a normal blackboard on an electronic blackboard.

[2. Process flow
The flow of processing in this embodiment will be described step by step based on FIGS. 2 to 9, 11 and 12. FIG. 12 is a flowchart showing the flow of processing according to the present embodiment. Hereinafter, as an example, explanation will be given on the assumption that each student possesses the terminal device 1b and the teacher operates the electronic blackboard to conduct a lesson.

(S201)
In step S201, the same processing as in step S101 of the first embodiment is performed. However, in this step, the display control unit 11 does not necessarily need to display the electronic book data 24 on the electronic book display unit 31.

(S202)
Subsequently, in step S202, the electronic blackboard displays an electronic book or the like by a teacher's predetermined operation, and starts recording an operation history and a lesson voice for the electronic book or the like. Note that the processing order of steps S201 and S202 may be switched.

(S203)
Subsequently, in step S203, the terminal device 1b performs the processing described above in step S104 of the first embodiment, in which the control unit 10b stores the memo data 22 in the storage unit 20, and the student performs the processing for the terminal device 1b. Until a predetermined end operation is performed. In addition, the electronic blackboard continues the process of recording the operation history for the electronic book and the voice of the lesson until the teacher performs a predetermined end operation on the electronic blackboard.

(S204)
Subsequently, in step S204, the terminal device 1b ends the process in which the control unit 10b stores the memo data 22 in the storage unit 20 in accordance with a predetermined operation by the student. In addition, the electronic blackboard terminates the process of recording the operation history for the electronic book and the audio recording of the lesson by a predetermined operation of the teacher.

(S205)
Subsequently, in step S205, the terminal device 1b obtains operation history data 23 that is an operation history of an electronic book and audio data 21 that is audio recording data of a lesson from an electronic blackboard that is a server.

  Specifically, the communication control unit 14 causes the communication unit 44 to acquire the data from the server 90. Next, the control unit 10 b stores the data in the storage unit 20. Further, when the control unit 10b stores the data in the storage unit 20, the memo data 22, and at least a part of the operation history data 23 such as an electronic book and the audio data 21 can be mutually referred to by the same time information. As such, they may be associated with each other.

(S106 to step S109)
The processing in the playback mode of the terminal device 1b is the same as that from step S106 to step S109 of the first embodiment.

  According to the above configuration, for example, when the memo data 22 is selected, a more preferable operation history such as an electronic book by the teacher can be referred to. Even if the terminal device 1b does not include the voice acquisition unit 41, for example, when the voice data 21 is selected, a corresponding portion of the memo data 22 can be referred to.

[Modification 1]
In addition to the operation history data 23 and the audio data 21 such as an electronic book, the terminal device 1b acquires board writing data indicating the contents written on the electronic blackboard, and uses the board writing data as memo data 22 for the note display unit 32. The structure which can be displayed on may be sufficient.

  According to the above configuration, for example, a student who is absent and does not take a class can grasp the contents of the class more accurately by referring to each piece of data including the blackboard data using the terminal device 1b at a later date. Can do.

[Modification 2]
The terminal device 1c (not shown) according to this modification has a configuration that does not include the storage unit 20 from the terminal device 1b illustrated in FIG. In this configuration, the voice data 21, memo data 22, operation history data 23, and electronic book data 24 stored in the storage unit 20 in the first embodiment are stored in the server 90. In the terminal device 1c, the display control unit 11 directly displays the operation history data 23 such as an electronic book, the audio data 21, and the memo data 22 acquired from the server 90 by the communication unit 44 on the display unit 30 in a streaming format. In addition, as described above in steps S106 to S109 of the first embodiment, the display control unit 11 displays the data on the display unit 30 so that they can be referred to each other.

  Further, the terminal device 1c does not necessarily have to acquire the above-described three types of data from the server 90. For example, the terminal device acquires the voice data 21 and the memo data 22 associated with the voice data 21 from the server, and selects one of the sections in the time series of the voice data 21 and the target portion in the memo data 22. When is selected, the other data associated with the one may be output.

[Modification 3]
The terminal device 1b or the terminal device 1 or the terminal device 1a further including the communication unit 44 and the communication control unit 14 may function as a server that outputs each data such as the operation history data 23 to another device.

  According to said structure, each said data can be shared between students or between the teacher who uses the terminal device 1b etc., and students.

[Embodiment 3]
In each of the above embodiments, an example in which one server 90 is used has been described. However, each function of the server 90 may be realized by an individual server. And when applying a some server, each server may be managed by the same provider, and may be managed by a different provider.

[Embodiment 4]
Each block of the terminal device (1, 1a to 1c) and the server 90 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software. In the latter case, each of the terminal devices (1, 1a to 1c) and the server 90 can be configured using a computer (electronic computer) as shown in FIG.

  FIG. 13 is a block diagram illustrating a configuration of a computer 910 that can be used as the terminal device (1, 1a to 1c) or the server 90. The computer 910 includes an arithmetic device 912, a main storage device 913, an auxiliary storage device 914, an input / output interface 915, and a communication interface 916 that are connected to each other via a bus 911. The arithmetic device 912, the main storage device 913, and the auxiliary storage device 914 may be, for example, a processor (for example, CPU: Central Processing Unit), a RAM (random access memory), and a hard disk drive, for example. Connected to the input / output interface 915 are an input device 920 for the user to input various information to the computer 910 and an output device 930 for the computer 910 to output various information to the user. The input device 920 and the output device 930 may be incorporated in the computer 910 or may be connected (externally attached) to the computer 910. For example, the input device 920 may be a keyboard, a mouse, a touch sensor, or the like, and the output device 930 may be a display, a printer, a speaker, or the like. In addition, a device having both functions of the input device 920 and the output device 930, such as a touch panel in which a touch sensor and a display are integrated, may be applied. The communication interface 916 is an interface for the computer 910 to communicate with an external device.

  The auxiliary storage device 914 stores various programs for operating the computer 910 as the terminal device (1, 1a to 1c) or the server 90. Then, the arithmetic device 912 expands the program stored in the auxiliary storage device 914 on the main storage device 913 and executes instructions included in the program, whereby the computer 910 is connected to the terminal devices (1, 1a to 1c) or function as each unit included in the server 90. Note that the recording medium for recording information such as programs provided in the auxiliary storage device 914 may be a computer-readable “non-temporary tangible medium”. For example, tape, disk, card, semiconductor memory, programmable logic, etc. It may be a circuit or the like. Further, the main storage device 913 may be omitted if the computer can execute the program recorded on the recording medium without developing it on the main storage device 913. Each of the above devices (the arithmetic device 912, the main storage device 913, the auxiliary storage device 914, the input / output interface 915, the communication interface 916, the input device 920, and the output device 930) may be one each. There may be a plurality.

  The program may be acquired from the outside of the computer 910, and in this case, may be acquired via an arbitrary transmission medium (such as a communication network or a broadcast wave). The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The output device according to the first aspect of the present invention stores the voice data 21 and the memo data 22 together with information indicating the processing time, and in the time series of the voice data 21 and the memo data 22 When one of the target locations is selected, the other data at the same time is output based on each processing time.

  According to said structure, when the audio | voice data 21 or the memo data 22 is selected, the output device which can refer another data easily is realizable.

  The output device according to aspect 2 of the present invention stores operation history data 23 associated with at least one of the audio data 21 and the memo data 22 in the above aspect 1, and stores the audio data 21 and the memo data. When the first data which is any data included in the data group including the data 22 and the operation history data 23 is selected, the second data different from the first data, or the second data Data and third data may be output.

  According to said structure, when any of the audio | voice data 21, the memo data 22, or the operation history data 23 is selected, the output device which can refer other data easily is realizable.

  The output device according to aspect 3 of the present invention may be configured to store each of the above data associated with the same time information in at least one of the above aspects 1 or 2.

  According to said structure, the other data recorded at the same time can be referred easily by selecting one of the 1st data linked | related with the same time information, and 2nd data.

  The output device according to aspect 4 of the present invention stores audio data in any one of the above aspects 1 to 3 due to acquisition of a signal indicating that the position or orientation of the terminal device has changed. It is good also as a structure which inserts a delimiter or an index in the position in 21 corresponding to the time when the said signal was acquired.

  According to the above configuration, for example, when the lesson moves to another form, so-called group learning, the user moves the desk, and the sensor unit 43 detects the movement of the terminal device. Even when it does not stop, a break or index can be inserted at a suitable position of the audio data 21 stored in the storage unit 20.

  The output device according to the fifth aspect of the present invention acquires the voice data 21 and the memo data 22 associated with the voice data 21, and a certain section on the time series of the voice data 21 and the target in the memo data 22. When one of the locations is selected, the other data associated with the one is output.

  According to said structure, when the audio | voice data 21 or the memo data 22 is selected, the output device which can refer another data easily is realizable.

  A data output system according to a sixth aspect of the present invention is a data output system including an output device and a server, and the output device stores voice data 21 and memo data 22 acquired from the server in association with each other. When one of the sections in the time series of the audio data 21 and the target portion in the memo data 22 is selected, the other data associated with the one is output.

  The output method according to the seventh aspect of the present invention is an output method executed by the apparatus, wherein the audio data 21 and the memo data 22 are stored in association with each other, and a certain section on the time series of the audio data 21 And an output step of outputting the other data associated with the one when one of the target portions in the memo data 22 is selected.

  According to said structure, when the audio | voice data 21 or the memo data 22 is selected, the other data can be referred easily.

  A control program for causing a computer to function as an output device according to aspect 8 of the present invention, wherein the control program causes the computer to function as the output device is any one of aspects 1 to 5. A control program for causing a computer to function as the image output device may be configured to cause the computer to function as the output device.

  The recording medium according to aspect 9 of the present invention may be a computer-readable recording medium in which the control program according to aspect 8 is recorded.

  The terminal device according to each aspect of the present invention may be realized by a computer. In this case, the terminal device is realized by the computer by operating the computer as each unit (software element) included in the terminal device. A control program for the terminal device and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

1, 1a, 1b, 1c Terminal device (output device)
10, 10a, 10b Control unit 11 Display control unit 12 Audio output control unit 13 Sensor information acquisition unit 14 Communication control unit 20 Storage unit 21 Audio data 22 Memo data 23 Operation history data 24 Electronic book data 30 Display unit 31 Electronic book display unit 32 Note display unit 41 Audio acquisition unit 42 Audio output unit 43 Sensor unit 44 Communication unit 90 Server 910 Computer 911 Bus 912 Processing unit 913 Main storage unit 914 Auxiliary storage unit 915 Input / output interface 916 Communication interface 920 Input unit 930 Output unit

Claims (7)

Audio data and memo data are stored in association with each other,
An output device characterized in that when one of a section of the audio data in time series and one of target portions in memo data is selected, the other data associated with the one is output. Storing operation history data associated with at least one of the voice data and the memo data;
Second data different from the first data when the first data which is any data included in the data group including the voice data, the memo data, and the operation history data is selected; The output device according to claim 1, wherein the second data and the third data are output. The output device according to claim 1 or 2, wherein at least a part of the data is associated with the same time information. Due to the acquisition of a signal indicating that the position or orientation of the output device has changed,
4. The output device according to claim 1, wherein a delimiter or an index is inserted at a position corresponding to a time at which the signal is acquired in audio data to be stored. 5. Obtain voice data and memo data associated with the voice data,
An output device for outputting the other data associated with one of the audio data when a certain section in the time series and one of the target locations in the memo data are selected. A data output system comprising an output device and a server,
The output device stores voice data and memo data acquired from the server in association with each other,
A data output system that outputs, when a certain section in the time series of the voice data and one of target portions in memo data are selected, the other data associated with the one. An output method performed by the apparatus,
A storage step for storing voice data and memo data in association with each other;
And an output step of outputting the other data associated with one of the sections in the time series of the audio data and one of the target locations in the memo data. .

Images