JP2006053696A - Contents creating device, method, contents providing system, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To create contents permitting program search reproduction of video/audio information of guidance contents in correspondence to a writing portion of used material in guidance of technique, ability, or the like needing familiarization. <P>SOLUTION: In the contents creating device 1, an video/audio information acquiring means 2 for shooting the guidance contents and acquiring its video/audio information can be connected to a memo information acquiring means 3 for acquiring mark (memo) information to the material used in the guidance, and it is provided with a real time capture part 1a, a meta-information generating part 1b, and a contents generating part 1c. The contents creating device 1 brings in the video/audio information of the guidance contents, acquires the writing time and a dot position to the material at the writing timing to the material, generates meta-information per writing unit of the material from the writing time and dot position, and associates the writing unit of the material with the video/audio information corresponding to its writing time on the basis of the video/audio information and the meta-information. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a content creation device, a method, a content providing system, a program, and a recording medium, and more specifically, a device for creating content for confirming instruction content such as technology or ability that requires proficiency later, The present invention relates to a method, a content providing system, a program, and a recording medium.

  Conventionally, during lessons such as musical instruments and dance, video and recording equipment are brought in, and the state of the game and guidance is recorded and reviewed as necessary. Generally, after replaying the entire program once, if there is a necessity, the program is played several times depending on the time counter. At this time, there are the following problems.

(1) It is difficult to specify a necessary part. Further, as specified, it takes time to move there using a time counter or the like.
(2) In the case of a tape medium, even if it is desired to review a specific place many times, rewinding is troublesome if the necessary place is away.
In this way, the raw information of video and audio is used only for the purpose of remembering forgotten things.

On the other hand, for example, Japanese Patent Application Laid-Open No. H10-228561 is designed to enable cue reproduction by recording an arbitrary mark together with a user's designation at the time of video recording, thereby improving the efficiency of editing work. It is disclosed. In this case, the subject is photographed by the video photographing device, and a marking input by a remote control operation from the photographer is accepted. A predetermined mark is attached to the image corresponding to the position where the marking is input, and the image with the mark is recorded on the recording medium. Accordingly, it is possible to edit the video by reproducing from the marked position, and the video of the desired scene can be easily cued and reproduced after shooting.
JP 2003-153191 A

  Here, I often want to confirm the contents after receiving personal guidance in practical skills of musical instrument performance, study, and work. For example, you can check the contents taught in oral and demonstrations (exemplary performances, performances, etc.), and review your findings and samples to improve and improve your skills and skills. On the other hand, even if a mark indicating a point of attention or a comment on an improvement point is written in the material used for personal instruction (this is both when the instructor writes and the student notes), the document Not all instructional content is listed. Therefore, the contents of the instruction are reconfirmed, including those that can only be expressed by multimedia information (video / audio information, etc.) such as sounds, works, movements, etc. There is a desire to be able to confirm without missing what has been missed somehow at the venue.

  For example, in the case of practical skills such as playing a musical instrument, we want to be able to confirm whether or not the points pointed out last time have improved as a review, or in the case of work of a parent, company, etc. in the case of child education Wants to be able to confirm the contents of the guidance when the manager does not attend the guidance site.

  On the other hand, in the invention described in the above-mentioned Patent Document 1, it is possible to perform cueing reproduction by recording an arbitrary mark together with the user's designation at the time of video recording. Since there is no function for cueing and reproducing the video / audio information of the instruction content in association with the location, the above-described problems cannot be solved.

  The present invention has been made in view of the above-mentioned circumstances, and in the guidance of techniques and abilities that require proficiency, the video / audio information of the guidance content is associated with the writing location of the material used. It was made for the purpose of creating content that can be played out.

  In order to solve the above-mentioned problems, the invention of claim 1 shoots the instruction contents in a content creation device for creating contents for confirming instruction contents such as techniques and abilities that require proficiency later. The video / audio information acquisition means for acquiring the video / audio information and the writing information acquisition means for acquiring the writing information to the material used for the instruction can be connected. Video / audio information capturing means for capturing video / audio information, and writing time and writing dot position to the material are acquired from the writing information acquisition means at the timing of writing to the material, and the writing time and writing dot position A meta information generating means for generating meta information for each writing unit of the material, and storing the video / audio information and meta information Storage means; and content generation means for generating the content by associating the writing unit of the material with the video / audio information corresponding to the writing time based on the stored video / audio information and meta information. It is characterized by being.

  According to a second aspect of the present invention, in the first aspect of the invention, the meta information generation unit generates the bitmap data of the writing unit from the writing time interval and the writing dot position, and the generated bitmap data and The meta information is generated from the writing time.

  According to a third aspect of the present invention, in the second aspect of the present invention, the meta information includes at least a guidance number, a writing ID for each guidance time, a writing time, and bitmap data.

  According to a fourth aspect of the present invention, in the second aspect of the invention, the meta information generating unit includes a unit that recognizes the bitmap data of the writing unit as a character or an image, and classifies the writing unit from the recognized result. The classification information is added to the meta information.

  According to a fifth aspect of the present invention, in the invention of the fourth aspect, the meta information generating means can acquire the recognized character as text data when the bitmap data of the writing unit is recognized as a character. Features.

  According to a sixth aspect of the present invention, in the first or second aspect of the invention, the content generation unit creates a clickable area corresponding to the writing unit based on the meta information stored in the storage unit, and the creation The recorded area is associated with video / audio information corresponding to the writing time of the area.

  A seventh aspect of the invention is characterized in that, in the sixth aspect of the invention, the content generation means superimposes the clickable area on the bitmap data of the material.

  The invention of claim 8 is characterized in that, in the invention of claim 6, the content generation means changes the color or shape of the clickable area for each attribute included in the meta information.

  The invention of claim 9 is the invention of any one of claims 1 to 8, further comprising meta information editing means for editing the meta information stored in the storage means, wherein the meta information editing means is the storage means. The meta information stored in is read, the read meta information is displayed, and the meta information can be edited while reproducing the video / audio information corresponding to the meta information.

  According to a tenth aspect of the present invention, in the invention of the ninth aspect, when the material is not used during the instruction, the meta information editing means reproduces the meta information later while reproducing the video / audio information stored in the storage means. It can be added.

  According to an eleventh aspect of the present invention, in the invention of the ninth aspect, when the material is not used at the time of the instruction, the meta information generating means recognizes the audio information included in the video / audio information of the instruction content and performs text data recognition. Means for acquiring the time when the text data and the voice are input, and generating meta information based on the acquired text data and the voice input time.

  The invention according to claim 12 is a content creation method using a content creation device that creates content for confirming later the contents of instruction such as skills and abilities that require proficiency. Is connected to video / audio information acquisition means for acquiring video / audio information and writing information acquisition means for acquiring information to be written on the material used for the instruction, from the video / audio information acquisition means. A video / audio information capturing step for capturing video / audio information of instruction contents, and a writing time and a writing dot position to the material are acquired from the writing information acquisition means at a timing of writing to the material, the writing time and A meta information generating step for generating meta information for each writing unit of the material from a writing dot position; A storage step of storing audio information and meta information in a storage means provided in the content creation device, and video / audio information corresponding to the writing unit of the material and the writing time based on the stored video / audio information and meta information And a content generation step of generating the content in association with

  According to a thirteenth aspect of the present invention, in the twelfth aspect of the present invention, the meta information generating step generates bitmap data of the writing unit from the writing time interval and the writing dot position, and the generated bitmap data and The meta information is generated from the writing time.

  The invention of claim 14 is the invention of claim 12 or claim 13, wherein the content generation step creates a clickable area corresponding to the writing unit based on the meta information stored in the storage means, The created area is associated with video / audio information corresponding to the writing time of the area.

  A fifteenth aspect of the present invention is the method according to any one of the twelfth to fourteenth aspects, further comprising a meta information editing step of editing the meta information stored in the storage unit, wherein the meta information editing step includes The meta information stored in the means is read, the read meta information is displayed, and the meta information can be edited while reproducing the video / audio information corresponding to the meta information.

  According to a sixteenth aspect of the present invention, in the fifteenth aspect of the invention, when the material is not used at the time of the instruction, the meta information editing step reproduces the meta information later while reproducing the video / audio information stored in the storage means. It can be added.

  The invention of claim 17 has a server device in which the content created by the invention of any one of claims 1 to 11 is registered, and a terminal device used by a student receiving instruction, the server device And a content providing system in which the terminal device is connected via a network, the server device accepts a content browsing request from the terminal device, and content of a student who uses the terminal device from the registered content And the selected content is transmitted to the terminal device.

  The invention of claim 18 is a program for executing a function as the content creation device according to any one of claims 1 to 11.

  A nineteenth aspect of the present invention is a computer-readable recording medium on which the program according to the eighteenth aspect is recorded.

  INDUSTRIAL APPLICABILITY The present invention can be applied to all teaching and education on skills and skills that require proficiency, which involve a process that improves upon receiving a check by the instructor. For example, in addition to practical instruction such as musical instruments and dance, in the office, presentation presentation practice and review, document creation and check, program coding and review, assembly process practice, and the like.

  In the present invention, video / audio information recorded by a conventional method is effectively used in order to make the most of one instruction. That is, an apparatus is provided for generating content that makes it easy to use such video / audio information by providing an index (such as a clickable map) in the material. The content creation apparatus of the present invention is configured so as not to impose a burden on both the instructor and the student by default in order to achieve the purpose without hindering the purpose of teaching and learning. Furthermore, it is possible to create a configuration in which more substantial content can be created with a little effort.

  In instruction on skills and skills that require proficiency, you can create content that can be used to cue and replay the video / audio information of the instruction content in association with the location where the materials you used are written. The student can confirm the contents of the instruction and review the instructions and samples of the instructor, effectively improving and improving the skills and abilities without burdening the both sides.

  In all the drawings for explaining the following embodiments, portions having the same functions are denoted by the same reference numerals, and repeated description thereof is omitted.

  FIG. 1 is a block diagram showing an internal configuration example of an information processing apparatus according to the present invention. In the figure, 1 is an information processing apparatus, and the information processing apparatus 1 is a storage device 14 such as a CPU 11, RAM 12, ROM 13, HDD, or the like. , An input device 15, a display device 16, a communication device 17, an output device 18, an input / output interface (input / output I / F) 19, and a system bus 20. The program and data that are configured based on the information processing device 1 and cause the information processing device 1 to function as a content creation device are stored in the ROM 13 or the storage device 14, and are executed by the CPU 11 reading out to the RAM 12 during execution. The

  The information processing apparatus 1 can be connected to a public line, a network such as a LAN, a WAN, or the Internet through the communication device 17, and can output data to an external device such as a printer through the output device 18. The input / output I / F 19 is an interface means for connecting to various external devices. Further, the progress of the process and the processing result are presented to the operator or the like through the display device 16 such as a CRT or LCD, and the operator needs the input device 15 such as a keyboard and a mouse (pointing device) in each process. Input parameters and so on. The CPU 11, RAM 12, ROM 13, storage device (storage means) 14, input device 15, display device 16, communication device 17, output device 18, and input / output I / F 19 are connected to each other via a system bus 20. In each of the following embodiments, the information processing apparatus 1 will be described as the content creation apparatus 1.

The content created by the content creation device 1 of the present invention includes the following two types (A) and (B).
(A) When using materials or texts, for example, if you click on a writing location such as a performance score, a created document, a process manual, a presentation material, etc., the link from there will specify the required location in the video / audio information, The video / audio information of the location is reproduced.
(B) In the case of practical skills without materials or texts (lectures, dance, gymnastics, etc.), clicking on a specific location on the separately created lesson record list will identify the required location in the video / audio information using the link from there. The video / audio information of the place is reproduced. Here, the video / audio information means so-called multimedia information including information on either or both of video and audio.

(First embodiment)
FIG. 2 is a block diagram illustrating a configuration example of the content creation device 1 according to an embodiment of the present invention. The content creation device 1 captures instruction content and acquires video / audio information thereof. Means 2 is connected to memo information acquisition means 3 for acquiring writing information (hereinafter referred to as memo information) to the material used for instruction. The content creation device 1 also includes a real-time capture unit 1a, a meta information generation unit 1b, and a content generation unit 1c. These real-time capture unit 1a, meta information generation unit 1b, and content generation unit 1c are stored as content creation programs. 14 and is executed by the CPU 11 reading it into the RAM 12 during execution. The storage unit 14 (in this example, storage units 14a and 14b) stores video / audio information and meta information. The storage units 14a and 14b may be different storage media, or different storage areas of the storage unit 14 may be used.

  The video / audio information acquisition means 2 acquires video / audio information of, for example, a recorder 21, an MD (mini disk) 22, an IC recorder 23, a DVDCAM (DVD video camera) 24, a DV camera (digital video camera) 25, and the like. It is a possible device and is connected to the content creation apparatus 1 via the input / output I / F 19. As the memo information acquisition means 3, for example, writing on a tablet capable of pen input, an electronic music stand described in Japanese Patent Application Laid-Open No. 2000-305559, or plain paper or dedicated paper is used as digital data. Various devices such as an electronic pen (for example, InkLink (registered trademark) manufactured by Seiko Instruments USA Inc.) can be used.

  The real-time capture unit 1a is a means for capturing (capturing) the video / audio information of the instruction content in real time from the video / audio information acquiring means 2, and directly writing the captured video / audio information into the storage means 14a for storage. To do.

  The meta information generation unit 1b acquires the writing time and writing dot position to the material from the memo information acquisition means 2 at the timing when the information is written to the material, and for each writing unit of the material from the writing time and writing dot position. Meta information is generated. Hereinafter, the process in the meta information generation unit 1b will be described in detail.

  The meta information generation unit 1b acquires the writing time, writing coordinate position, and dot from the memo information acquisition unit 2 (device) at the timing of writing to the material. Bitmap data of the writing unit at that time is generated from the acquired writing time interval and the writing dot position. Furthermore, meta information for each writing unit is generated from the writing time and bitmap data. This meta information refers to attribute (relevant) information of video / audio information composed of a data string including, for example, the number of times of instruction, ID for each instruction time, writing time, bitmap data, and the like.

  The meta information generation unit 1b may include a means for recognizing whether it is a caution mark such as ◯, a character comment, or a figure from the bitmap data. In this case, the writing unit may be classified based on the recognition result, and the classification information may be added to the meta information. For example, an attention attribute is added when it is recognized as ◯, and a sample attribute is added when it is recognized as □. As a result, when each writing unit is displayed on the material, it can be displayed (color is changed, etc.) according to its attribute (in this example, attention / sample). Moreover, when it recognizes as a character comment, you may acquire text information by stroke recognition and character recognition. This meta information is stored in the database (storage means 14b) as a history for each instruction round.

  The content generation unit 1c generates content by associating the writing unit of the material with the video / audio information corresponding to the writing time based on the video / audio information and the meta information stored in the storage units 14a and 14b, respectively. To do. Hereinafter, the processing in the content generation unit 1c will be described in detail.

  Based on the meta information, the content generation unit 1c creates a clickable map corresponding to the bitmap data of each writing unit, and superimposes the bitmap data of the material (score, etc.) as necessary, Web content such as Flash is generated. Specifically, a shape indicating an area of a certain writing unit is drawn, a clickable map is created, and a link is attached to the corresponding video / audio information time event from there. At this time, the time event is embedded in the video / audio information.

  As described above, after the instruction is completed, the content relating to the instruction of the day for one teaching material can be automatically generated immediately, and the student can use it for the review. In the generated content, for example, a list of points to be pointed out from a leader or the like, or cueing reproduction from the pointed points written on the material to actual pointed scenes (multiple) can be performed.

  Furthermore, at the time of HTML creation, all the meta information of the guidance times may be used, or filtering may be performed for each attribute from the meta information. In this case, the color of an area (clickable map or the like) indicating the writing unit for each attribute, the color of the frame of the area, the shape, or the like may be changed for display. Also, by changing the color of the pen used for writing according to the attribute (note / sample) and recognizing the color of the pen, the color of the area indicating the writing unit for each attribute and the frame of the area You may make it display by changing a color or a shape. Further, an image divided into layers for each attribute may be created, and the attributes designated by the user (student or instructor) may be displayed in an overlapping manner. Thereby, since the student can easily distinguish whether the scene is a caution or a sample, for example, it can be effectively used for review.

  In many cases, one teaching material is taught multiple times. Meta information and video / audio information are accumulated in the database (storage means 14) for each instructional material and one instruction, and a plurality of instructions are referred to by using a meta information editing unit described later. For example, it is possible to display a list of unimproved indication items and an improvement (improvement) history display for each writing unit, among the indications accumulated by multiple times of instruction remaining as history. Become.

  Also, in the case of paper materials, the information on the materials is mixed and overlapped as guidance is overlapped. By using the contents as described above, the materials of the contents can be printed and used after electronically organizing the information, so the students can refer only to the information that should be noted at that time, and efficiently There is also an advantage that learning is advanced.

  According to the present embodiment, in the teaching of skills and skills that require proficiency, it is possible to create content that can be played back by searching for the video / audio information of the teaching content in association with the writing location of the used material. As a result, there is no burden on both the instructor and the student, and the student confirms the contents of the instruction and reviews the points and samples of the instructor to effectively improve and improve the skills and skills. Can be connected.

(Second Embodiment)
FIG. 3 is a block diagram showing a configuration example of a content creation device 1 according to another embodiment of the present invention. The content creation device 1 is connected to a video / audio information acquisition unit 2 and a memo information acquisition unit 3. . In addition to the real-time capture unit 1a, meta information generation unit 1b, and content generation unit 1c, the content creation device 1 further includes a meta information editing unit 1d. These real-time capture unit 1a, meta information generation unit 1b, content The generation unit 1c and the meta information editing unit 1d are stored in the storage unit 14 as a content creation program, and are executed when the CPU 11 reads them into the RAM 12 during execution. As in the first embodiment, the storage unit 14 (in this example, the storage units 14a and 14b) stores video / audio information and meta information. The storage units 14a and 14b may be different storage media, or different storage areas of the storage unit 14 may be used.

  The meta information editing unit 1d is a means for editing and adding the meta information stored in the storage means 14b. When the material is used at the time of instruction, the meta information editing section 1d reads and reads the meta information stored in the storage means 14b. The meta information is displayed, and the meta information can be edited while reproducing the video / audio information corresponding to the meta information.

In the content creation apparatus 1 shown in the first embodiment described above, content can be automatically created in response to writing to a material. However, only the meta information that is automatically generated from writing has the following limitations due to the trouble of writing to the material and the problem of the blank area to be written.
・ Not all indications are written.
・ The timing for writing the items to be pointed out may be different from the time pointed out.
・ It is not possible to write down the details of the items pointed out (only notes can be written).

Therefore, in the present embodiment, the meta information editing unit 1d is used to correct the contents of the meta information so that it is more complete and accurate, so that more effective contents can be created. The meta information editing unit 1d reads the automatically generated meta information, if any, and edits the meta information as follows while reproducing each meta information and the corresponding part of the video / audio information.
・ Add new indications that were not written in the materials during instruction.
・ If the timing of the meta information and the time pointed out actually deviate, correct it.
・ Add the details of the points to be pointed out.
・ Add and organize attributes. For example, the overlapping points to be pointed out are summarized. Alternatively, from the meta information stored as a history in the database (storage means 14), the previously pointed item is confirmed, whether it has been corrected, and if it is a content that overlaps with the current pointed out, the content is combined into one Add At that time, the number of indications is managed as an attribute.
・ Finely adjust the cue position of the image. Rather than deciding the exact location as the cue, roughly tentatively determine the relevant part, and then fine-tune in about 3 to 5 seconds as needed.

  Further, for example, in the case of instruction such as practical skills that do not use materials such as lectures, dances, and gymnastics, meta information cannot be automatically generated from writing on the materials. In this case, the meta information editing unit 1d can add and generate meta information later while reproducing the video / audio information stored in the storage unit 14a.

  In addition, meta information can be automatically generated without any material as described above. In this case, the meta information generating unit 1b includes means for recognizing voice information included in the video / audio information of the instruction content and converting the voice information into text information, and acquiring the text information and the time when the voice is input. Meta information can be automatically generated based on the acquired text information and voice input time.

  According to the present embodiment, in the teaching of skills and skills that require proficiency, in addition to being able to create content that can be played back by cueing the video / audio information of the teaching content in association with the writing location of the used material. In addition, the meta information corresponding to the video / audio information can be edited, and even if there is no material, the meta information corresponding to the video / audio information can be added later, so the contents are further enhanced. Content can be created.

  FIG. 4 is a diagram showing an example of content obtained by cueing and reproducing the corresponding scene of the video / audio information from writing on the material. In the figure, 30 is the content created by the content creation device 1, and the content 30 is Image data 31 (hereinafter simply referred to as the score 31) composed of a document (score in this example) and memo information written on the score, a video / audio information scene 32 corresponding to the memo information, and an indicated item (comment) 33 , ID information 34 is included. Note that the musical score 31 has a scroll function for switching and displaying the next and subsequent pages when there are subsequent pages.

  Rectangular portions on the score 31 corresponding to writing indicate clickable areas (hereinafter referred to as clickable maps) 31a, 31b, and 31c. Here, the meta information corresponding to the clickable maps 31a, 31b, 31c is displayed by changing the color of each area depending on, for example, the importance of the indication, the date and time of the indication, or whether it is a sample or a caution. Yes. In this example, there are three clickable areas. For example, when the area of the clickable map 31a is clicked, the scene 32 corresponding to writing is reproduced. By such an operation, it is possible to reproduce the indication contents and the model performance by the instructor.

  Here, the indication item 33 may display an indication item added later by the meta-information editing unit 1d, or text data that has been character-recognized or stroke-recognized from the memo information by the meta-information generation unit 1b. You may make it display as a matter, or you may make it display the text data which carried out the speech recognition of the audio | voice information contained in video / audio information by the meta information production | generation part 1b as an indication matter. Further, the ID information 34 is the ID of the indicated location. In the case of “03-02” in this example, the previous “03” is the instruction time, and the subsequent “02” is the ID of the indicated location of the instruction time. Indicates.

  FIG. 5 is a diagram showing an example of content obtained by cueing and reproducing the corresponding scene of the video / audio information from the pointed item list. In the figure, 40 is the content created by the content creation device 1, and the content 40 is indicated. A pointed item list (TODO list) 41 including items such as number of times, pointed out date, ID, pointed comment, video / audio information scene 42 corresponding to the pointed comment, pointed item (comment) 43 and ID information 44 are included. The pointed item list 41 has a scroll function for switching and displaying the next page and subsequent pages when there are subsequent pages.

  In this example, when an indication comment in the indication item list 41 is clicked, a scene 42 corresponding to the indication location is reproduced as in FIG. As described above, even when the material is not used, the corresponding scene of the video / audio information can be cued and reproduced from the indication item list 41 edited by the meta information editing unit 1d. Here, the asterisk of the number of indications included in the indication item list 41 is edited by the student or the instructor, and the number of indications for each indication comment is represented by the number of asterisks.

  FIG. 6 is a flowchart for explaining an example of the video / audio information capturing process in the content creation method to which the present invention is applied. This example will be described based on the content creation device 1 shown in FIG. First, the real-time capture unit 1a takes in video / audio information of instruction content from the video / audio information acquisition unit 2 (step S1), and stores the acquired video / audio information in the storage unit 14a (step S2).

  FIG. 7 is a flowchart for explaining an example of processing from generation of meta information to content creation in the content creation method to which the present invention is applied. The content creation device 1 of the present invention can be applied to both cases where there is a document at the time of guidance and where there is no document. First, the presence / absence of a material is determined (step S11). When there is a material (in the case of YES), memo information written in the material is acquired (step S12), and the memo information and the corresponding video / audio information are obtained. Meta information for associating is generated (step S13), and the generated meta information is stored in the storage unit 14b (step S14). In this case, when the stored meta information and video / audio information are input to the content generation unit 1c, the content can be automatically created immediately after the instruction is finished.

  On the other hand, in step S11, when there is no material (in the case of NO), there is no material to be written. Therefore, after the instruction is completed, the meta information editing unit 1d is used to add and edit the meta information while reproducing the video / audio information. Then, the meta information is stored in the storage means 14b (step S14). In this case as well, content can be generated by inputting the stored meta information and video / audio information to the content generation unit 1c. However, if there is no material, manual work for editing meta information is required. Therefore, in order to enable automatic creation of content even if there is no material, the meta information generation unit 1b applies speech recognition to audio information (pointed content) included in the video / audio information to apply text ( It may be converted into (character) information, and meta information in which the converted text information and time information thereof are paired may be generated. By inputting the meta information and the corresponding video / audio information to the content generation unit 1c, the content can be automatically generated.

  Here, as with content without material, meta information is corrected and added while reproducing video / audio information using the meta information editing unit 1d after the instruction is completed, as with content without material. The content can be recreated with more complete and organized content. Therefore, the content creating apparatus 1 determines whether or not to edit the meta information stored in the storage unit 14b (step S16). When editing (YES), the process returns to step S15 to perform the meta information editing process. . On the other hand, if the meta information is not edited in step S16 (NO), the content generation unit 1c generates content from the meta information and the video / audio information (step S17). Further, after content generation, meta information may be edited and recreated.

  When attributes and information are stored as meta information, it is possible to change how the content is displayed for each attribute. In order to display the display in a different manner, the content can be dynamically recreated by re-filtering from the meta information according to the display designation of the user, instead of recreating the content.

  FIG. 8 is a diagram illustrating an example of a user interface displayed by the meta information editing unit 1d. The user interface includes a meta information display / editing screen 50 and a video / audio information reproduction screen 60. The meta information display / edit screen 50 includes an event button 51, a meta information list 52, a replace button 53, a skip button 54, a delete button 55, a play button (not shown), and the like. It has a screen 61, a fast reverse button 62, a play button 63, a pause button 64, a fast forward button 65, a stop button 66, skip buttons 67a and 67b, a numeric input field 68, a current position display field 69, and the like.

  The meta information display / edit screen 50 can read meta information from the storage unit 14b, display, edit, and save the meta information in the storage unit 14b. When the Event button 51 is clicked, the current playback position (time t from the beginning of the video / audio information) is acquired, and one line is added to the meta information list 52. In the meta information list 52, the text portion can be edited, ID is set in Col_0 in the column, and time t is set in Col_1 (changeable), contents input column in Col_2, and optional attribute column in Col_n (history indication) Display a reference link, presence or absence of correction, etc.), select one line, and press the Skip button 54, the current position moves at the corresponding time. When the Replace button 53 is pressed, the current position is acquired, and the time of the selected meta information is corrected (timing correction). When the Delete button 55 is pressed, the selected meta information is deleted.

  On the video / audio information playback screen 60, the playback button 63 starts playback of the video from the current position. A stop button 66 stops video reproduction. The pause button 64 pauses the video. The fast reverse button 62 performs fast reverse of the video. The fast forward button 65 performs fast forward of the video. The current position display column 69 is HH: MM: SS. The current position of the playback video is displayed in the MMM format.

  The skip buttons 67a and 67b and the number input field 68 are I / Fs for finely adjusting the time from the temporarily determined position of the video / audio information, and the number input field 68 is an integer of 1 to 10 (= S seconds) can be set. When the skip button 67a is pressed, the current position is skipped to + S seconds, and when the skip button 67b is pressed, the current position is skipped to -S seconds.

  FIG. 9 is a diagram showing a configuration example of a device for creating a lesson record based on writing to a material. The content creating device 1 includes a video / audio information acquisition device 2 such as a DV camera and a microphone, and a material display function. 3a and memo information acquisition means 3 having a memo information acquisition function 3b. The memo information acquisition means 3 of this example is composed of a tablet that scans various materials and captures them as image data, and an electronic music stand (for example, see Japanese Patent Application Laid-Open No. 2000-305559) when the materials are musical scores. Then, the scanned material is displayed on the screen, and memo information written by pen input or the like on the material is acquired together with the writing time.

  FIG. 10 is a diagram showing another configuration example of an apparatus for creating a lesson record based on writing on a material. The content creation apparatus 1 includes a video / audio information acquisition device 2 such as a DV camera and a microphone, a memo, and the like. It is connected to a memo information acquisition means 3 having an information acquisition function. The memo information acquisition means 3 of this example is composed of an entry memo information acquisition device, which, as described above, is an electronic pen (for example, InkLink (registered trademark)) that can capture writing on plain paper or dedicated paper as digital data. By using such a device, it is possible to directly write on the paper material, and it is not necessary to scan and capture the material in advance.

  Furthermore, as another embodiment of the memo information acquisition means 3, a material display function and a written memo acquisition function are provided by software such as Microsoft Word (registered trademark) or Excel (registered trademark) and one of the functions. You may implement | achieve using a certain comment recording function. By using the function of commercially available software, it is possible to easily obtain the entry memo information and the time information at the time of entry.

  FIG. 11 is a diagram showing an example of a lesson indication list obtained by editing meta information of content with contents by the meta information editing unit 1d. In the figure, 70 is a lesson indication list, and the lesson indication list 70 is an indication. Includes problem areas 71 including the number of times, pointed out date, ID, pointed comment, etc., the whole day 72, which is a record of the performance of the performance, past trajectories, sample books, previous lesson records, etc. Others 73 are included. One content is constituted by the lesson indication list 70 and the content 30 of FIG. In this example, as shown in the content 30 of FIG. 4 described above, an example of a list obtained by editing meta information of content for reviewing musical instrument lessons by the meta information editing unit 1d will be described.

  In FIG. 11, the meta information editing unit 1d organizes the meta information, and creates a mapping between the comment pointed out by the problem portion 71 and the material (score) and video / audio information. When the comment pointed out at the problem location 71 is clicked, the location of the corresponding material or the location of the video / audio information is displayed. At this time, it is possible to enter only a mark such as a circle or an underline without entering details on the material (score), and then explain the demonstration in the video / audio information. In the comment pointed out (see FIG. 5 for details), information indicating that it has been pointed out repeatedly, but has not been improved, is displayed in a list together with the importance level. The star in the figure indicates the cumulative number of indications. In the example shown in FIG. 4, the map is realized as a clickable map of the material. However, if there are multiple pointed scenes for one location of the material, each line of the score is used as an image, and an item to be pointed below is required. Any number may be displayed and associated with each scene. In the case of performing display across a plurality of instruction times, individual scenes exist in a plurality of video / audio information.

  FIG. 12 is a diagram illustrating an example of meta information of content without material obtained by generation / editing by the meta information generation unit 1b and the meta information editing unit 1d. FIG. 12A shows an example of meta information in which text information obtained by recognizing the indication content in the Nth instruction of the dance instruction without materials from the sound in the video / audio information is extracted together with the time.

  FIG. 12B is a diagram showing an example in which the meta information shown in FIG. 12A is edited by the meta information editing unit 1d. Here, guidance times, correction states, and the like are further added to the meta information in FIG. In addition, 02:30 and 05:13 are remembered and added later. We also checked the history and compiled the same information that was pointed out in the past.

  FIG. 13 is a diagram illustrating an example of meta information of content with material. In this example, an example of meta information of content (with data) for confirming the content of instruction at a cram school at home is shown. This meta information is the contents filled in with time, items, and corrections when students use the problem collection or prints as materials to solve problems that serve as teaching materials and teach based on the materials corrected by the teacher. Shall be included. Corresponding to the content (writing) entered by this correction, the video / audio information of the guidance content is reproduced.

  For the sake of explanation, the contents of the video / audio information are described in words in FIG. 13, but the video / audio information corresponding to the words is actually reproduced on the screen. For example, in the case of the item (question 1) that was performed at 00:03, the document is written “Write an expression as well as an answer.” Corresponding to this writing, video / audio information of instruction content However, in this case, the teacher says to the student (children) "If you don't write a formula, you can't give a circle. Try writing a formula." Is written, and stops on the way. In response to this, a series of operations / sounds explained by the teacher are reproduced as video / sound information.

  As described above, the generated content is uploaded to the Web server for each individual immediately after the instruction is completed. At the student's home, for example, a parent enters a password to access the content of his child. Check the state of the child and the instructor from the contents, understand where you do not know or how to teach, and use it as a reference for further guidance and countermeasures. The cram school may provide such a content distribution service within a monthly fee.

  FIG. 14 is a diagram illustrating another example of meta information of content with material. This example shows an example of meta information of content (with data) to be used for in-house presentation presentation practice. This meta information is, for example, only a simple memo is written in a document such as Microsoft Power Point (registered trademark), and after that, when guidance is given in the video / audio information, the point indicated on the document, the contents of the entry (simple Memo), sample / caution attributes, etc. Corresponding to this entry content (writing), video / audio information of instruction content is reproduced.

  For the sake of explanation, the contents of the video / audio information are described in words as in FIG. 13, but the video / audio information corresponding to the words is actually reproduced on the screen. For example, if the pointed out is the beginning of the material, the content to be entered is low voice, and the attribute is attention, “Voice low” is entered on the material. In this case, for example, the boss says to his subordinates, “It's too small to hear. Try again.” In response, the subordinate demonstrates and receives the boss. Is called “more”, and in response to this, a series of actions / sounds that the subordinates demonstrate and that the boss says “about that” are reproduced as video / audio information.

  In the present invention, the more diverse the information is, the more difficult it is to view it without organizing it when all the information is shown at once. Therefore, an I / F (content generation unit 1c) for changing data to be displayed or changing a display color according to a user's specification is provided. In the case of the server type, the content may be dynamically generated at the time of user designation. However, all of the content may be prepared statically in preparation for the distribution of the content using a storage medium (CD / DVD or the like). In the user designation, for example, the display color may be changed for each instruction time, whether the sample is a caution or a caution that is not currently corrected, or the display ON / OFF may be specified for each information. .

  FIG. 15 is a diagram showing another example of content obtained by cueing and reproducing a corresponding scene of video / audio information from writing in a material. In the figure, 80 is content created by the content creation device 1, and the content 80 Indicates image data 81 (hereinafter simply referred to as score 81) composed of a material (score in this example) and memo information written on the score, a scene 82 of video / audio information corresponding to the memo information, and a comment (comment) ) 83, ID information 84 is included. Note that the score 81 can be shifted to the next page by scrolling or switching pages when there are continued pages. In addition, rectangular portions on the score 81 corresponding to writing indicate clickable maps 81a to 81p. Here, from the meta information corresponding to the clickable maps 81a to 81p, the colors of the respective regions are displayed with different colors depending on, for example, the teaching times, the sample or the caution, or the caution that is not currently corrected.

  FIG. 16 is a view showing a display example of a lesson record list for combining and using a plurality of contents. In the figure, 90 is a lesson record and a cumulative TODO list (hereinafter, lesson record list), The record list 90 includes a teacher's example collection 91, a past trajectory (through) 92, a lesson record before the previous time, and a TODO list 93. In this example, not only one content but also a list for comprehensive use in combination will be described.

It is common for a teaching material to be taught multiple times. On the other hand, the same thing may be repeatedly pointed out over several teaching materials by one instruction. Therefore, a portal page is created for each student, and a content list display page is prepared for each teaching time for each teaching material, or a content list display page for a plurality of teaching materials is prepared for each teaching time. Thereby, for example, the following can be realized.
(1) The contents of each instruction are left in the meaning of recording.
-The pointed out item and the beginning of the corresponding scene (corresponding to the lesson record before the previous time shown in FIG. 16 and the TODO list 93).
・ Check attention, bad examples, and sample ・ Comparison between sample and yourself (2) May or may not be corrected by one instruction. Clarify the remaining items that have been pointed out. In order to check how many of the same issues are present, it is displayed with priorities superimposed on the previous issues. Pick up and display important things as of that day. This corresponds to the lesson record before the previous time and the TODO list 93 shown in FIG.
(3) Display a model book for each teaching material. This corresponds to the teacher's example collection 91 shown in FIG.
(4) Display a comparison between yourself this time and the previous one. This corresponds to the trajectory (through) 92 shown in FIG.

(Third embodiment)
FIG. 17 is a diagram showing a configuration example of a content providing system using the content creation device 1 of the present invention. In the figure, 100 is the Internet, 101 is a content server device in which content is registered, and 102 is a teacher's PC (that is, content) Creation devices 1), 102a and 102b are contents created on the teacher PC 102, 103 is a student PC, 104 is a student, 105 is a teacher, and 106 is a DV camera. The teacher PC 102 can be connected to the DV camera 106. The content server apparatus 101 is connected to the student PC 103 via the Internet 100 and is connected to the teacher PC 102 via a network or the like. In the present embodiment, a system for providing a content for a student to confirm guidance contents later in a musical instrument lesson or a private cram school class will be described.

  The teacher's PC 102 (content creation apparatus 1) uploads and registers the contents 102a and 102b related to the instruction content to the content server apparatus 101. The content server apparatus 101 receives a content browsing request from the student PC 103, selects student content using the student PC 103 from the registered content, and transmits the selected content to the student PC 103.

  In this way, the teacher can upload the content and register it on the server device (or distribute it on a recording medium such as a CD or DVD), and the student side can view the content by accessing the server device. It is possible to check the contents of the instruction later, which can be used for review.

  As described above, each embodiment has been described centering on each function in the content creation apparatus and system of the present invention. However, the present invention is a content creation method as described also as a method for executing each step in the content creation apparatus. Can take form. Further, similarly to the content creation apparatus having each function, a form as a program for causing a computer to function as a content creation apparatus, and a form as a recording medium on which the program is recorded are possible.

  An embodiment of a recording medium storing a program and data for realizing a content creation function according to the present invention will be described. Specific recording media include CD-ROM (-R / -RW), magneto-optical disk, DVD-ROM (-R / -RW / -RAM), FD, HD, flash memory, memory card, Memory sticks and other various ROMs, RAMs, and the like can be assumed, and a program for realizing the function of creating content is recorded on these recording media by causing a computer to execute the functions of the above-described embodiments of the present invention. Distribution of the function facilitates the realization of the function. Then, the recording medium as described above is mounted on an information processing apparatus such as a computer and the program is read by the information processing apparatus, or the program is stored in a storage medium provided in the information processing apparatus. By reading, it is possible to execute a content creation function according to the present invention.

It is a block diagram which shows the example of an internal structure of the information processing apparatus concerning this invention. It is a block diagram which shows the structural example of the content production apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows the structural example of the content creation apparatus which concerns on other embodiment of this invention. It is a figure which shows an example of the content which searched and searched the applicable scene of the video / audio information from writing to a document. It is a figure which shows an example of the content which searched the applicable scene of the video / audio information from the pointed item list. It is a flowchart for demonstrating an example of the taking-in process of the video / audio information in the content creation method to which this invention is applied. It is a flowchart for demonstrating an example of the process from the production | generation of meta information to the production of content in the content creation method to which the present invention is applied. It is a figure which shows an example of the user interface displayed by the meta information edit part. It is a figure which shows the structural example of the apparatus for producing a lesson record based on the writing to material. It is a figure which shows the other structural example of the apparatus for producing a lesson record based on the writing to material. It is a figure which shows an example of the lesson indication list | wrist obtained by editing the meta information of content with a document by a meta information editing part. It is a figure which shows an example of the meta information of the content without a material obtained by producing / editing by a meta information production | generation part and a meta information editing part. It is a figure which shows an example of the meta information of content with a document. It is a figure which shows the other example of meta information of content with a document. It is a figure which shows the other example of the content which cued and reproduced the applicable scene of the video / audio information from the writing to the material. It is a figure which shows the example of a display of the lesson record list for combining and using a some content comprehensively. It is a figure which shows the structural example of the content provision system using the content creation apparatus of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus (content creation apparatus), 1a ... Real time capture part, 1b ... Meta information generation part, 1c ... Content generation part, 1d ... Meta information editing part, 2 ... Video / audio information acquisition means (Video / audio information) (Acquisition device), 3 ... memo information acquisition means (entry memo information acquisition device), 11 ... CPU, 12 ... RAM, 13 ... ROM, 14, 14a, 14b ... storage device (storage means), 15 ... input device, 16 ... Display device, 17 ... communication device, 18 ... output device, 19 ... input / output I / F, 20 ... system bus, 21 ... recorder, 22 ... MD, 23 ... IC recorder, 24 ... DVDCAM, 25 ... DV camera, 30 , 40, 80 ... content, 31, 81 ... image data (score), 31a, 31b, 31c, 81a to 81p ... clickable map, 32, 42, 82 ... 33, 43, 83 ... Pointed items (comments), 34, 44, 84 ... ID information, 41 ... List of pointed items (TODO list), 50 ... Meta information display / edit screen, 51 ... Event button, 52 ... Meta information list, 53 ... Replace button, 54 ... Skip button, 55 ... Delete button, 60 ... Video / audio information playback screen, 61 ... Video playback screen, 62 ... Rewind button, 63 ... Play button, 64 ... Pause button , 65 ... Fast forward button, 66 ... Stop button, 67a, 67b ... Skip button, 68 ... Number input field, 69 ... Current position display field, 70 ... Lesson record list, 71 ... Problem part, 72 ... Throughout the day, 73 ... Others, 90 ... Lesson record and cumulative to-do list, 91 ... Teacher's example book, 92 ... Traces to date (through), 93 ... Before the last time Lesson record and TODO list, 100 ... Internet, 101 ... Content server device, 102 ... Teacher PC (content creation device), 102a, 102b ... Content, 103 ... Student PC, 104 ... Student, 105 ... Teacher, 106 ... DV camera.

Claims (19)

  Video / audio information acquisition means for capturing the instruction content and acquiring the video / audio information in a content creation device for creating content for confirming the instruction content such as skills and skills that require proficiency later; Video / audio information capturing means that can be connected to writing information acquisition means for acquiring writing information to the material used for the instruction, and that captures video / audio information of the instruction content from the video / audio information acquisition means; Meta information that acquires a writing time and a writing dot position to the material from the writing information acquisition means at a timing when the material is written, and generates meta information for each writing unit of the material from the writing time and the writing dot position. Generating means, storage means for storing the video / audio information and meta information, and the stored video / audio information and memory information. Content creation apparatus characterized by in association with the video / audio information corresponding to the write unit and the writing time of the article and a content generation means for generating the content based on the information.   2. The content creation device according to claim 1, wherein the meta information generating unit generates bitmap data of the writing unit from the interval of the writing time and the writing dot position, and the generated bitmap data and the writing time. A content creation apparatus that generates the meta-information from:   3. The content creation apparatus according to claim 2, wherein the meta information includes at least a guidance number, a writing ID for each guidance time, a writing time, and bitmap data.   3. The content creation device according to claim 2, wherein the meta information generating means includes means for recognizing the bitmap data of the writing unit as a character or an image, classifying the writing unit from the recognized result, and classifying the classification. A content creating apparatus, wherein information is added to the meta information.   5. The content creation device according to claim 4, wherein the meta information generation unit can acquire the recognized character as text data when the bitmap data of the writing unit is recognized as a character. Content creation device.   3. The content creation device according to claim 1, wherein the content generation unit creates a clickable area corresponding to the writing unit based on the meta information stored in the storage unit, and A content creating apparatus that associates video / audio information corresponding to the writing time of the area.   7. The content creation apparatus according to claim 6, wherein the content generation unit superimposes the clickable area on bitmap data of the material.   7. The content creation apparatus according to claim 6, wherein the content generation unit changes the color or shape of the clickable area for each attribute included in the meta information.   9. The content creation device according to claim 1, further comprising meta information editing means for editing meta information stored in the storage means, wherein the meta information editing means is stored in the storage means. A content creation device, wherein meta information is read, the read meta information is displayed, and the meta information can be edited while reproducing video / audio information corresponding to the meta information.   10. The content creation device according to claim 9, wherein when meta data is not used at the time of instruction, the meta information editing unit can add meta information later while reproducing the video / audio information stored in the storage unit. A content creation apparatus characterized by the above.   10. The content creation device according to claim 9, wherein when no material is used at the time of guidance, the meta information generation unit recognizes voice information included in the video / audio information of the guidance content and converts it into text data. A content creation apparatus comprising means for acquiring the time when the text data and the voice are input, and generating meta information based on the acquired text data and the voice input time.   In a content creation method using a content creation device that creates content for later confirming instruction content such as skills and skills that require proficiency, the content creation device shoots the instruction content and captures the video / Video / audio information acquisition means for acquiring audio information, and writing information acquisition means for acquiring information to be written on the material used for the instruction, and the video / audio information of the instruction content from the image / audio information acquisition means A video / audio information capturing step for capturing the data, and a writing time and a writing dot position to the material from the writing information acquisition means at a timing when the data is written to the material, and from the writing time and the writing dot position, A meta information generating step for generating meta information for each writing unit; and the video / audio information and meta information Is stored in the storage means included in the content creation device, and the writing unit of the material is associated with the video / audio information corresponding to the writing time based on the stored video / audio information and meta information. A content generation method comprising: a content generation step for generating the content.   13. The content creation method according to claim 12, wherein the meta information generation step generates bitmap data of the writing unit from the writing time interval and the writing dot position, and the generated bitmap data and the writing time. The content creation method characterized in that the meta information is generated from the content.   14. The content creation method according to claim 12 or 13, wherein the content generation step creates a clickable area corresponding to the writing unit based on meta information stored in the storage means, and the created area and A method of creating content, comprising associating video / audio information corresponding to the writing time of the area.   15. The content creation method according to claim 12, further comprising a meta information editing step for editing the meta information stored in the storage unit, wherein the meta information editing step includes a meta information editing step stored in the storage unit. A content creation method, wherein information is read, the read meta information is displayed, and the meta information can be edited while reproducing video / audio information corresponding to the meta information.   16. The content creation method according to claim 15, wherein when meta data is not used at the time of instruction, the meta information editing step can add meta information later while reproducing the video / audio information stored in the storage means. A content creation method characterized by   A server device that registers content created by the content creation device according to any one of claims 1 to 11, and a terminal device that is used by a student who receives guidance, the server device and the terminal device, In the content providing system connected via a network, the server device receives a content browsing request from the terminal device, selects a content of a student who uses the terminal device from the registered content, and A content providing system for transmitting selected content to the terminal device.   The program for performing the function as a content creation apparatus of any one of Claims 1 thru | or 11. The computer-readable recording medium which recorded the program of Claim 18.