CN103177611A - Method for realizing multimedia courseware on E-ink book - Google Patents
Method for realizing multimedia courseware on E-ink book Download PDFInfo
- Publication number
- CN103177611A CN103177611A CN2011104399271A CN201110439927A CN103177611A CN 103177611 A CN103177611 A CN 103177611A CN 2011104399271 A CN2011104399271 A CN 2011104399271A CN 201110439927 A CN201110439927 A CN 201110439927A CN 103177611 A CN103177611 A CN 103177611A
- Authority
- CN
- China
- Prior art keywords
- image
- content
- paper book
- explanation
- electric paper
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention relates to a method for realizing courseware on an E-ink book. The method comprises the following steps of: (1) extracting an effective teaching content corresponding to an audio in each section of a multimedia course to form an image; (2) determining an audio file corresponding to the effective teaching content included in the image; (3) synchronizing the image of the effective teaching content in the step (1) with the corresponding audio file on a timer shaft; and (4) arranging all the images containing the effective teaching contents and corresponding audios according to the time sequence and incidence relation of the contents to form a playable file of a complete E-ink book. The scheme provided by the invention creates a new multimedia course format satisfying with the characteristic that an image on a page of the E-ink book can be remained for a period of time without consuming electricity, and enables the multimedia course and lecture with images, texts and audios to be realized in the E-ink book.
Description
Technical field
The invention belongs to electric paper book technical field, be specifically related to a kind of electric paper book of realizing multimedia teaching based on electric paper display (EPD).
Background technology
A kind of display of attempting to simulate the characteristic of paper occurred in recent years and be widely used, in this application, our unified electric paper display (EPD) that is referred to as.Other titles of such display comprise: class paper display, the zenithal bistable device, 6 paper, bistable state and electrophoretic display device (EPD) etc.
It is generally acknowledged, thisly can realize that sensitive paper equally reads comfortable, ultra-thin light, flexible, display technique ultralow power consumption and be called electric paper display (hereinafter referred to as Electronic Paper) technology; And Electronic Paper is namely a kind of like this electronic console of similar paper, and the advantage (can accomplish almost completely the same with paper etc. as visual sensory) that it has paper concurrently can continuous conversion refresh displaying contents again as our common liquid crystal display.
The approach that realizes at present electronic paper technology mainly includes cholesterol liquid crystal display technique, electrophoretic display technology and electric wetting display technique etc.
Take electrophoretic display technology as example, the principle of work of its demonstration is to move by the electron ion that is immersed among transparent or colour liquid, namely by upset or the particulate that flows, pixel is brightened or dimmed, and can be fabricated on glass, metal or plastic.Concrete technology is that the TiO 2 particles that diameter is about about 1mm is dispersed in hydrocarbon oil, black dyes, surfactant and make the charged charge control agent of particle also be added in hydrocarbon oil, it is between the parallel conductive plates of 10～100mm that this potpourri is placed on two interblocks distances, when two current-carrying plates are applied voltage, on these particles can move to thin plate with opposite charges from the thin plate at place in the mode of electrophoresis.When particle was positioned at the front (display surface) of display, display screen was white, and this is because light is scattered back reader one side by TiO 2 particles; When particle was positioned at the display back side, display was black, and this is because coloured dye has absorbed incident light.If the electrode at the back side is divided into a plurality of small pictorial elements (pixel), add that by each zone to display suitable voltage produces echo area and uptake zone pattern, can form image.
Electrophoretic techniques has following several large advantage: the one, and energy consumption is low, owing to having bistability, after power supply is closed, still can on display, image be kept several days or some months; The 2nd, the display that electrophoretic techniques is produced belongs to reflection-type, therefore has good daylight readable, equally also can in front of the light of face or side combine, be used for dark surrounds; The 3rd, have the potentiality of low production cost, because this technology does not need strict encapsulation, and the employing solution processing techniques is feasible as printing; The 4th, electrophoretic display device (EPD) flexibly as characteristic, allows that they are fabricated on plastics, metal or glass surface take form factor, so it is the optimal selection of flexible display technologies.
Electric paper display (EPD) technology and conventional cathode ray tube (CRT) or present main flow display liquid crystal display (LCD) are compared, and its power consumption is much lower.
Exactly because also above-mentioned displaying principle, electric paper display typically be that extraneous ray of reflecting is read rather than carry on the back light transmissive, therefore, the light that they can environment for use and do not require the light source that carries in equipment.
Traditional divergence form display device can be own luminous, so even also can normally use under the condition of dim light.But, increase along with ambient light intensity, the display effect of this display is just so not satisfactory, because stronger surround lighting has improved melanic brightness and reduced contrast, this is also that we can't be in the situation that direct sunlight be seen the reason of word on display clearly.And reflective display shows image by reflect ambient light, and the brightness meeting of image changes according to the intensity of ambient light, and contrast also can change thereupon, so the advantage of reflective display is more obvious under intense light.
Recently along with the advancing by leaps and bounds of EPD technology, make electric paper book in the whole world universal coming.The advantage that the low-power consumption that Electronic Paper has and natural light are read becomes the reason that people enough buy electric paper book day by day.But, along with people more and more make electricity consumption paper book, people also found electric paper book remain a lot of defectives.Topmost defective is: the displaying principle of electric paper book has caused that its response speed is slow, page turning is slow, refresh rate is low.Certainly along with technical progress, this situation can be eased, but along with the raising of refresh rate can cause expending of electric weight again.
Electronic Paper can't be play existing video and animation because refresh rate is low now, due to the refresh rate of Electronic Paper generally lower than 10 per seconds, playing animation and video are wanted more than 20 times, and existing study course class video, especially the Video tutorials such as the speech that changes into of ppt and csf, its content transforms slow, there is no need to present on electric paper book with video format fully, and this situation also is present in the study course of existing flash animated versions.
Real classroom, its content conversion rate is very low, is substantially just to refresh the content of once saying to a few minutes at several seconds.In the traditional blackboard teaching, this situation is embodied in the teacher and says that is often just write one section writing on the blackboard or the signal of drawing, and then continues explanation, and moving in circles has consisted of the process of whole classroom instruction.Existing Video tutorials has several: a kind of is direct recording writing on the blackboard and teaching process, such as quite a lot of videos of company of Bubukao, comprises the instructional video in middle school, Huang gang; Again such as burning hot open course motion is carried out in the whole world, Yale University, Harvard University, quite a lot of courses of Massachusetts Institute of Technology (MIT) substantially all adopt this form.The ppt that has again present exactly speech and classroom generally to adopt adds explanation or ppt adds the writing on the blackboard pattern, the Video tutorials of the csf form that generally adopts such as the open course of Chinese Universities, perhaps the personage that adopts of various news conferences or TED speech adds the speech of the video format that ppt makes.Also has a kind of electronic writing on blackboard pattern, having plenty of with the unit software development, such as the online instructional video of U.S. Khan study, is all with handwriting pad and film recording software development, also such as quite a lot of network tutorings of China, the courseware that similar 24 hours private tutor's nets are recorded with electronic whiteboard.
Above these tradition often present with forms such as .rm .rmvb .avi .wmv, but existing electric paper book is not temporarily supported refreshing of per second tens frames, even if can support later on, this content change Video tutorials slowly is also a waste greatly to electric energy, has produced with the original intention of Electronic Paper low-power consumption and has deviated from.So these ways of realization of existing Video tutorials can't satisfy electric paper book for the requirement of playing course.
In addition, in recent years, talking pen and supporting books thereof have started a large upsurge in recent years, have enriched rapidly the content in children ' s reading market.But along with the production and selling of the supporting books of a large amount of talking pens, a large amount of paper wastes with the resource loss that brings and problem of environmental pollution day by day seriously.So thisly waste natural resources and cause the multi-media material implementation of environmental pollution to have much room for improvement.
Be used at present making among the material faster that reaches a few tens of milliseconds switching time developing of electrophoresis showed.So up to now, electric paper book still can't be play Video tutorials and the speech that both pictures and texts are excellent.
The form that present electric paper book can be play has: text: txt, htxt, pdf, doc, xls, ppt, html, epub, chm, fb2; Image: jpg, bmp, gif, png; Audio frequency: mp3 etc.Engine energy file reading content occurs in the TTS that only has that electricity paper book is present, realize simple multimedia, but for the multimedia lecture and the teaching that realize that both pictures and texts are excellent, existing electric paper book is not accomplished also.Progress along with display technique, may occur later on refresh rate very high can displaying video electric paper book, if but play courseware, too high refresh rate has been run counter to the advantage of electric paper book low-power consumption, so we need a kind of multimedia study course form that mates the Electronic Paper characteristic.The with no paper teaching in the current whole world has been trend of the times, and electric paper book carries out with no paper teaching optimal selection beyond doubt, realize on electric paper book the multimedia teaching course also in the urgent need to.
Summary of the invention
the object of the present invention is to provide a kind of can adapt to need not to power after the page turning of electric paper book can preserve the method for multimedia courseware that realizes of this specific character of image on electric paper book, be used for solving electric paper book that prior art exists can't play existing multimedia study course (multimedia study course here refers to that both pictures and texts are excellent and the study course of sound is arranged, comprise film, TV, animation etc., show as form and comprise .rm, .rmvb, .wmv, .flv, .mp4, .avi wait the video format of main flow, also comprise the form that .csf is special, certainly also comprise this flash animation of .swf, certainly also comprise other courseware form, go up the .exe e-magazine of broadcast etc. such as pc, especially, the teaching material form that also comprises the supporting audio frequency explanation of papery teaching material, " multimedia " reads aloud audio frequency such as juvenile's story-book and supporting explanation on the whole at last, such as, go up on the market universal talking pen and supporting teaching material thereof) and existing animation and Video tutorials do not stop to refresh problems such as causing waste of energy in the constant situation of picture.
Be necessary at first to define at this video format that electric paper book can be play, we are referred to as the EPD form for the time being.The important feature of this form be exactly sound to join content be related with picture material, the explanation content that is to say audio frequency is to telling about that the word in image and figure carry out.It can regard the coherent integral body of explanation or the explanation of one section corresponding audio file of every images match as, also can regard the integral body that the image under whole audio frequency explanation background is play one by one by the content of its audio frequency explanation as.It should be noted that the image of these two kinds of forms or audio frequency are all that incidence relation according to order and content before and after the time is engaged togather.The content that comprises is as the ppt form, but background music is teacher's teaching audio frequency of speaker in other words.This form is exactly to realize a kind of form of expression of multimedia courseware on electric paper book.
The present invention is to create a kind ofly to meet that image of Electronic Paper page turning can be retained a period of time but the new multimedia study course form of this characteristic of not power consumption makes picture and text sound and luxuriant multimedia study course and lecture to realize on electric paper book for the scheme that provides is provided.Thisly realize that on electric paper book the method for multimedia courseware comprises following steps: (1), the corresponding effective content of courses of each section audio in the multimedia study course is extracted forms piece image; (2), determine the corresponding audio file of the contained effective content of courses of this width image; (3), synchronous on time shaft the image of the effective content of courses described in above-mentioned steps (1) and its corresponding audio file; (4), all images that comprises effective content of courses and corresponding audio frequency thereof, arrange according to the incidence relation of time order and function order and content, form the file that an electric paper book of completing can be play.
Realization of the present invention also is: described each section audio refers to an audio frequency that course is separated, cuts apart according to sense-group, according to different sense-groups, one or more partitioning schemes is arranged, and corresponding corresponding picture, the corresponding corresponding image of every section audio.
Realization of the present invention also is: effective image content described in abovementioned steps (1) refers to the content that the corresponding audio frequency of institute is explained in step (2), and its form is whole graph-text content of an image, can be also local graph-text content.
Realization of the present invention also is: effective content information of the described final formation image of abovementioned steps (1) is each image of the explanation corresponding animation of audio frequency or video, integral image variation or localized variation be corresponding one section explanation content all, such as the csf study course, its effective content information is exactly each image of the corresponding ppt video recording of explanation audio frequency, and the whole Zhang Bianhua of ppt image or localized variation be corresponding one section explanation content all.
Realization of the present invention also is: the audio frequency described in abovementioned steps (1) is one section audio file that independent starting point arranged or/and effective a part of audio file of content in correspondence image in the whole background audio file of whole courseware, or the recording of the teacher who records in advance or orator's explanation or explanation, or the character and graphic in image and comprise the various graphical formats of scalar sum vector, the effective content in the content of audio file and image is not word and the audio frequency one-to-one relationship of TTS formula.Spoken and written languages in the sound that is to say explanation or illustrate and the word in image can be different, but its content meaning is relevant.This also contains and the pronunciation of active computer sonification engine mechanism, such as the TTS sonification engine is by the procedure identification content of text, by speech recognition technology and simulation sonification techniques realize and text to explanation or the explanation of text, the content of explaining and content of text.
Realization of the present invention also is: the audio file of the correspondence described in abovementioned steps (2) refers to content that this section audio comprises for this is comprised the explanation of effective content images or tells about.
Realization of the present invention also is: " synchronously " described in abovementioned steps (3) is that every picture material is all effectively explained and illustrates by the respective audio file, that is to say, we can be in explanation or explanation that this audio file provides, and what see is corresponding image always; This is at time shaft, and the time that every width image takies is not less than (but can surpass can not less than) about explanation or the explanation shared time of audio file of the effective content of this image.
Realization of the present invention also is: synchronous on time shaft described in abovementioned steps (3), there is no the audio frequency joining section of sound, and whether corresponding this section audio file is not done requirement, the conversion regime in the similar ppt of the conversion regime of its image and image to image.
Realization of the present invention also is: the final file of playing on electric paper book that forms described in abovementioned steps (4), it is the file of the composition that forms of the reading aloud of one section course, one section speech, one section poem or prose, piece image or multiple image, the perhaps file that consists of of the corresponding corresponding explanation of piece image or explanation, but no matter be any pattern, the explanation of the audio file that in these files, each image is corresponding or explanation are coherent, according to the meaning of time sequencing and content related linking.
realization of the present invention also is: described in abovementioned steps (4), the final file of playing on electric paper book that forms and electric paper book underlying operating system and hardware are complementary, the system that existing various models and brand electricity paper book are commonly used, but equal playing image and sound, existing various operating systems: comprise linux, android, Symbian, wince, the system of kindle or other each manufacturers oneself customization, all support the broadcast of music and image, also just all realized the multimedia file format of this image and sound simultaneously match on time shaft by the embedded program of operating system or upper layer application (oneself or third-party).
Time shaft definition: so-called time shaft is exactly the concept of an imagery in multimedia file, sound and image being combined according to time sequencing.
Compared with prior art, the beneficial effect that has of the present invention is:
One, the present invention by the coupling on time shaft with lecture and teaching content, has reproduced the process of really teaching effectively.Particularly this method can realize on electric paper book;
Two, the present invention's combination cleverly and teaching or lecture in terms of content variation characteristic and the page turning of electric paper book after not continued power just can keep the characteristic of image, realized meeting the courseware form of Electronic Paper characteristic, reduce the redundancy that refreshes of invalid information, farthest saved the electric energy that consumes;
Three, the decomposition held within the class period by intercommunication of the present invention makes conventional video or animation study course multiframe show that the situation of same picture improves, and has significantly reduced the data volume of video, and is all very beneficial to bandwidth pressure and unit storage course quantity.Realize e-courses with minimum data volume, realized with no paper teaching with minimum power consumption.
Description of drawings
Fig. 1 is for realizing the process flow diagram of the method for multimedia courseware on electric paper book.
Fig. 2 be implementation method based on the system path schematic diagram.
Fig. 3 is the time shaft statement (from left to right arrow indication time bearing of trend, presentation of events evolution) of electric paper book multimedia file.
Fig. 4 is local transitions and whole conversion comparison diagram.
Fig. 5 is the schematic diagram of the local sectional drawing of the effective content of csf form.
Embodiment
Method realizing multimedia courseware on electric paper book of the present invention has formed a kind of solution of watching multimedia courseware on existing electric paper book hardware configuration base.Retouch referring to Fig. 2 the implementation method shown based on system path shown in: the manufacturing system of electric paper book multimedia courseware is comprised of PC 201, electric paper book 202 and server 203.PC 201 connects electric paper book 202 and server 203, and wherein electric paper book 202 both can be downloaded the multimedia courseware of making from the PC end, can directly download from server again (electric paper book band has the hardware connection device, such as bluetooth, and wifi etc.).Electricity paper book multimedia courseware can manually (refer to sectional drawing at PC shown in 201, recording waits to be operated step by step by the people and completes) or automatically (software that refers to automatic making electricity paper book multimedia courseware step by step complete) make, again can automatic or manual making on server.Certainly, if electric paper books body hardware and software conditions being possessed also can be made the e-book multimedia courseware on electric paper book.The present invention has directly solved electric paper book can not watch courseware, and existing video and this mode of animation and Electronic Paper demonstration and the unmatched problem of the mode that refreshes.Thereby reached the purpose that realizes the play multimedia courseware on electric paper book, the content that makes electric paper book to play is greatly abundant.
Referring to accompanying drawing 1, the main implementation procedure of the method that realizes multimedia courseware on electric paper book of the present invention is as follows:
Step 110: the corresponding effective content of courses of each section audio in the multimedia study course is extracted, form piece image.
Described multimedia study course comprises film, TV, animation etc., show as the video format that form comprises the main flows such as .rm .rmvb .wmv .flv .mp4 .avi, also comprise the form that .csf is special, also comprise this flash animation of .swf, certainly also comprise other courseware form, go up the .exe e-magazine of broadcast etc. such as pc, especially, it also comprises talking pen and the supporting teaching material thereof of having popularized on the market, can regard destination document as long as meet the multi-media material that can extract static effective course content.The video that can extract static effective course content described here, be exemplified below: the schematic images that contains word and/or figure and/or the embedded picture related with the audio content meaning as Fig. 5, the word related with the audio content meaning and/or figure and/or the embedded picture etc. that comprise in these images, i.e. described effective content.
Based on the above-mentioned video that can extract effective content of courses, we extract effective content of courses and mainly contain dual mode:
The first is to determine effective content according to the picture material variation of video or animation study course.Concrete mode can be that the identification word changes, and learns the variation of effective content, also can change according to picture and learn effective content change.
The second is to identify the variation of effective information according to the sense-group of audio frequency explanation or explanation.Such as one exercise question of explanation, from start to end, the picture that contains corresponding effective content is extracted in the variation that we can the whole content of perception successively.
The special point that step 110 realizes is, described each section audio refers to an audio frequency that course is separated, cuts apart according to sense-group, can more than a kind of partitioning scheme be arranged according to different sense-groups, corresponding picture is also different, but as long as the corresponding respective image of this section audio is just passable.The time shaft statement of its corresponding time shaft such as Fig. 3 image and audio frequency.In figure the audio frequency of image 1 correspondence of institute's mark be 1C to 1D, the corresponding audio frequency of image 2 be 2C to 2D, they distinguish correspondence image 1 and image 2 so.Another kind of point-score can be 1C to 2D as a section audio, so corresponding image is exactly the integrated of image 1 and image 2, the corresponding time be 1A to 2B, be corresponding with 1C to the audio frequency of 2D.But sometimes transform from existing Video tutorials, image 1 and image 2 can't be merged into an image, and the audio frequency of the audio frequency of image 1 and image 2 just can't be merged into one section so.
The special point that step 110 realizes also is, described effective content refers to the content that the corresponding audio frequency of institute is explained, and its form can be whole graph-text content of an image.In the flash courseware of New Orient, all graph-text content is all effective content basically, all comprises the effective courseware-related information in the audio frequency explanation; Can certainly be local graph-text content, as the sectional drawing of TED speech, wherein spectators, stage effect etc., be not effective content, and the effective content relation in the speech audio sound-recording is little, only has speechmaker's body language and the content on ppt to be only effective speech content.
The special point that step 110 realizes also is, the image of described final formation specifically can show as the image that width all the elements form according to certain compressed format, also can show as and play the intermediate images that word and/or figure and/or embedded picture etc. form on the sort of default background picture of ppt, every ppt lantern slide is all piece image in form certainly.
The special point that step 110 realizes also is, the extracting mode of the image of described final formation, can be by video and animation file are carried out sectional drawing, perhaps to the papery teaching material such as books or the picture and text on caricature that talking pen uses are taken pictures (manufacturing process of similar stop-motion animation), every ppt lantern slide is all piece image in form certainly.
Step 120: determine the corresponding audio file of the contained effective content of courses of this width image.
The special point that step 120 realizes is, as shown in the time shaft statement of Fig. 3 image and audio frequency.Audio frequency described in step 120 can be regarded one section audio file that independent starting point is arranged as, such as the 1C on time shaft can regard independently one section as to 1D audio frequency during this period of time, also can regard in the whole background audio of whole courseware (from 1C to 1D to 2C to 2D to NC until whole file audio frequency end point) file in correspondence image effectively a part of audio file of content as.
The special point that step 120 realizes also is, audio frequency is the recording of the teacher that records in advance or orator's explanation or explanation and to (the various figures of the character and graphic in image, comprise the various graphical formats of scalar sum vector etc.) etc., the effective content in the content of audio file and image is the word corresponding relation not necessarily.Spoken and written languages in the sound that is to say explanation or illustrate and the word in image can be different, but the content meaning is relevant.The pronunciation mechanism of this and active computer sonification engine: such as the TTS sonification engine is by the procedure identification content of text, by speech recognition technology and simulation sonification techniques realize and text to explanation or the explanation of text, the content of explaining and content of text.
Step 130: synchronous on time shaft the image that comprises effective content described in step 120 and its corresponding audio file.
The special point that step 130 realizes is, described " synchronously " is that every picture material is all effectively explained and illustrates by the respective audio file, that is to say, we can be in explanation or explanation that this audio file provides, what see is corresponding image always, as the time shaft statement of Fig. 3 electricity paper book multimedia file.Described " synchronously " this at time shaft, image 1 from the shared time period that occurs disappearing be 1A to 1B, shared time period is that 1C is between 1D from start to end in its corresponding audio frequency explanation.Wanting to reach every width image is all fully explained, in other words, every section explanation is when carrying out, picture can be seen this effect, and time of taking of image can cover (but can surpass can not less than) at least fully about explanation or the explanation shared time of audio file of the effective content of this image so.Be embodied in: 1A is always in 1C left side or overlapping, and 1B is always on 1D right side or overlapping.See that on the whole 1A arrives the time period of 1D to 1B integral body more than or equal to 1C, show as covering in form, have sound that the response picture is just arranged, do not have sound also picture may be arranged.
Step 140: all audio frequency that comprises effective content images and correspondence thereof, arrange according to the incidence relation of order and content before and after the time, form the file that an electric paper book of completing can be play.
The special point that step 140 realizes is, the file of playing on electric paper book of described final formation, it can be one section course, can be also reading aloud of one section speech or one section poem or prose, but no matter be any pattern, the explanation of the audio file that its each image is corresponding or explanation are coherent, are connected according to the incidence relation of time sequencing and content.About the time order and function order, as the time shaft statement of Fig. 3 electricity paper book multimedia file.Image 1 and image 2 are obvious sequencing (the priority here is not absolute relation, and the time 2A that the time 1B that image 1 disappears and image 2 occur can be overlapping, and so-called is successively that 2A can not occur prior to 1B) in time.About the association of content, be to be connected in terms of content as Fig. 3 image 1 and image 2; Corresponding therewith, the audio frequency explanation of image 1 and the audio frequency explanation of image 2 also are connected in terms of content.The so-called linking is exactly the middle content jump that do not have, and two sections explanations can be synthesized an integral body.
The special point that step 140 realizes is, the file of playing on electric paper book of described final formation can be piece image or multiple image, and as Fig. 3, piece image also can form a definitive document.If many images, that just directly arrives the NNA of image and the NNC of audio frequency (N is more than or equal to 2) here.No matter but how many width images, the content of its effective content and audio file explanation or explanation is corresponding, relevant.
The special point that step 140 realizes is, the file of playing on electric paper book of described final formation, and during two continuous image change, because effective content corresponding to different time audio frequency explanation is different, thereby corresponding image is different.Thereby different conversion regimes has appearred.Each intersegmental conversion is the same on the teaching effect, and choosing of different effective contents do not affect the detailed degree of explanation.As long as all corresponding picture of effective content can just have been reached the purpose of giving lessons or giving a lecture by detailed explanation.
The special point that step 140 realizes is, as shown in Figure 3, there is no the audio frequency joining section of sound, whether corresponding this section audio file is not done requirement to image, that is to say, along with the end of this section audio explanation or explanation, the purpose that this width image exists has just been completed, so before next section audio explanation beginning or at first, the corresponding image of next section audio just should be presented on screen.Between certain two width images, certain intervals can be arranged, what this interval was corresponding is the blank of audio frequency, can regard the rest that audio frequency is connected point or music as.
The special point that step 140 realizes is, the file of playing on electric paper book of described final formation is to mate electric paper book underlying operating system and hardware.Existing electric paper book is no matter be any system, but equal playing image and sound, being ready is regardless of the system that is what operating system: linux, android, Symbian, wince, kindle or other each manufacturers oneself customization, all support the broadcast of music and image, also just can realize by the embedded program of operating system or upper layer application (oneself or third-party) multimedia file format of this image and sound simultaneously match on time shaft.
Below will be described further content of the present invention by three specific embodiments.
Embodiment one: the topography that flash is transformed changes the realization of the electric paper book multimedia file of corresponding respective audio.
Step (1): the form of a flash course files by sectional drawing, effective content of courses is extracted, form a width width image.
Step (2): the form of grabbing rail by recording or audio frequency extracts the effectively corresponding audio frequency explanation of content in above-mentioned image.
Step (3): the image that comprises effective content described in step (1) and described its corresponding audio file of step 120 are arranged separately position on time shaft, realize the synchronous of picture and respective audio.
Step (4): all synchronous effective content images and corresponding audio frequency thereof of comprising, the incidence relation arrangement according to order and content before and after the time forms the file that a complete electric paper book can be play.
The software class study course in addition of similar this example is such as some picture and text study courses of Zero English or some picture and text study courses of CSC; External have a Rosetta stone etc., can realize electric paper book multimedia courseware with this kind mode.
Embodiment two: csf form with electric paper book multimedia courseware on electric paper book is realized.
Background note
The CSF formatted file is the stream media format that Jiangsu section builds the exploitation of education software company limited, it can be the video perfect adaptation of PPT and teachers, a lot of universities and large enterprise use this cover software to impart knowledge to students and record a video and long-distance education, abbreviation section builds stream media format, and the somebody even is called " college course professional format ".
The CSF courseware is that in the Related product processes of giving lessons in practice such as the ScenicRecorder, the ScenicLive that are provided by strong company of section, ScenicStation, real time record forms, thereby can demonstrate fully the on-the-spot teaching sight, embody on-the-spot atmosphere, stronger teaching efficiency is provided.
Step (1): the mode of each lantern slide (Slide) of ppt video recording in a csf file with sectional drawing extracted, form the image that a width width includes speech or lecture content, as shown in Figure 5.
Step (2): determine the corresponding audio frequency explanation of this width image or explanation, can grab the form of rail or the form realization of recording with audio frequency.
Step (3): its corresponding audio file in the every width image that comprises effective content described in step 110 and step 120 is determined position separately by time shaft, realize the synchronous of image and respective audio.
Step (4): all audio frequency that comprises effective content images and correspondence thereof, arrange according to the incidence relation of order and content before and after the time, form the file that an electric paper book of completing can be play, also can regard the making of electric paper book multimedia form as.
The PPT part and the recording thereof that also have the TED speech of similar this example, various other lectures, lecture are also the forms that PPT adds the speech phonotape and videotape, all this kind can be realized in this way.Flash animation study course (such as the New Orient the sort of) also can be made this type of.
Embodiment three:
The realization of the multimedia courseware that the electric paper book of the similar ppt pattern of encyclopaedical and supporting mp3 CD can be play.
Background information: the general supporting CD of encyclopedia, in CD, content refers to audio content here.
Step (1): shown in the every one page in many paperys encyclopaedia full section is lined up image with camera, arranged sequentially according to time and content.
Step (2): determine the contained effective content of courses of this width image the explanation part in corresponding CD.The starting point of this section audio is determined.
Step (3): synchronous on time shaft each width image and its corresponding audio frequency explanation that encyclopedia described in step (1) is clapped, form the integral body of the supporting audio frequency explanation of image one by one.
Step (4): whole described in step (3), arrange according to the incidence relation of order and content before and after the time, form the multimedia encyclopedia that an electric paper book can be play.
Certainly, similar this example in addition the respective audio file of textbook related pages or speech draft related pages or caricature related pages and explanation and/or explanation and/or caricature dialogue etc. is made the multimedia courseware form that electric paper book can be play, can realize in this way.Flash animation study course (such as the New Orient the sort of) also can be made this type of.
Special point comprises, described step (1) and step (2) and step (3) and step (4) can manually carry out also can automatically carrying out (namely completed by special electric paper book multimedia file producing software, be similar to the switching software of various video formats and make software).Such as step (1), specific to " sectional drawing " this action in Video tutorials, can manually be completed by the people, contain the image of effective information from identification, to sectional drawing to preservation etc.; Also can automatically be completed by software, particularly, be exactly a kind of conversion software, can automatically identify the image that contains effective information, and then the sectional drawing preservation is prepared for following step automatically.Same, the audio extraction of step B also can have manually, clicks the sound of video jukebox software and grabs the rail button or automatically carry out by transforming software.In like manner, step (3) and step (4) can be carried out with manual and automatic dual mode.
Point also comprises especially, and described step (1) and step (2) can synchronously be carried out, and namely can operate simultaneously animation and audio frequency.Illustrate, such as transforming csf software to electric paper book multimedia file, extract and to carry out simultaneously for sectional drawing and the csf background audio of ppt part.
at last based on above-mentioned several embodiment, the applicant makes following statement: the present invention is above-mentioned realizes multimedia courseware on electric paper book method can realize the purpose cooperated with various electric paper book hardware vendors, be about to utilize the multimedia courseware form that can play on electric paper book that the method realizing multimedia courseware on electric paper book provided by the present invention designs and the electric paper book equipment of specific playout software and various models thereof to bundle, comprise that (binding that refers to refers to methods such as using the software and hardware encryption to Software Bundling here, also refer to that this courseware form can only play on specific equipment) and the hardware bundle sale, both can promote the sale of software, can also strengthen the sale of hardware, reach two purposes that are full of.Certainly courseware also can be released general version, namely comprises at any hardware device the form that can play on pc.
The above is only preferred embodiment of the present invention, is not for limiting protection scope of the present invention, and is within the spirit and principles in the present invention all, any modification of doing, is equal to replacement, improvement etc., within all should being included in protection scope of the present invention.Be that the present invention is not limited only to the above embodiments, also have a lot of other concrete manifestation forms.
Claims (10)
1. a method that realizes multimedia courseware on electric paper book, is characterized in that, comprises following steps:
1.1 the corresponding effective content of courses of each section audio in the multimedia study course is extracted, forms piece image;
1.2 determine the corresponding audio file of the contained effective content of courses of this width image;
1.3 synchronous on time shaft the image of the effective content of courses described in above-mentioned steps 1.1 and its corresponding audio file;
1.4 all images that comprises effective content of courses and corresponding audio frequency thereof, arrange according to the incidence relation of time order and function order and content, form the file that an electric paper book of completing can be play.
2. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: described each section audio refers to an audio frequency that course is separated, cut apart according to sense-group, according to different sense-groups, one or more partitioning schemes are arranged, and corresponding corresponding picture, the corresponding corresponding image of every section audio.
3. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: the content of effective image described in step 1.1 refer in step 1.2 the content of corresponding audio frequency explanation, its form is whole graph-text content or the local graph-text content of an image.
4. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: effective content information of the described final formation image of step 1.1 is each image of the explanation corresponding animation of audio frequency or video, and integral image variation or localized variation be corresponding one section explanation content all.
5. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: the audio frequency described in step 1.2 is one section audio file that independent starting point arranged or/and effective a part of audio file of content in correspondence image in the whole background audio file of whole courseware, or the recording of the teacher who records in advance or orator's explanation or explanation, or the character and graphic in image and comprise the various graphical formats of scalar sum vector.
6. the method that realizes multimedia courseware on electric paper book as claimed in claim 1 is characterized in that: the audio file of the correspondence described in step 1.2 refers to content that this section audio comprises for this is comprised the explanation of effective content images or tells about.
7. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: " synchronously " described in step 1.3 is that every picture material is all effectively explained and illustrates by the respective audio file, namely at time shaft, the time that every width image takies was not less than about the explanation of the effective content of this image or explanation shared time of audio file.
8. realize as claimed in claim 1 the method for multimedia courseware on electric paper book, it is characterized in that: synchronous on time shaft described in step 1.3, there is no the audio frequency joining section of sound, whether corresponding this section audio file is not done requirement, the conversion regime in the similar ppt of the conversion regime of its image and image to image.
9. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: the final file of playing on electric paper book that forms described in step 1.4, it is the file of the composition that forms of the reading aloud of one section course, one section speech, one section poem or prose, piece image or multiple image, the perhaps file that consists of of the corresponding corresponding explanation of piece image or explanation, the explanation of the audio file that in these files, each image is corresponding or explanation are coherent, according to the meaning of time sequencing and content related linking.
10. the method that realizes multimedia courseware on electric paper book as claimed in claim 1, it is characterized in that: described in step 1.4, the final file of playing on electric paper book that forms and electric paper book underlying operating system and hardware are complementary, the system that existing various models and brand electricity paper book are commonly used, but equal playing image and sound, existing various operating systems: comprise linux, android, Symbian, wince, the system of kindle or other each manufacturers oneself customization, all support the broadcast of music and image, also just all realized the multimedia file format of this image and sound simultaneously match on time shaft by the embedded program of operating system or upper layer application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104399271A CN103177611A (en) | 2011-12-23 | 2011-12-23 | Method for realizing multimedia courseware on E-ink book |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104399271A CN103177611A (en) | 2011-12-23 | 2011-12-23 | Method for realizing multimedia courseware on E-ink book |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103177611A true CN103177611A (en) | 2013-06-26 |
Family
ID=48637431
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011104399271A Pending CN103177611A (en) | 2011-12-23 | 2011-12-23 | Method for realizing multimedia courseware on E-ink book |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103177611A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104952293A (en) * | 2014-03-24 | 2015-09-30 | 颜厥护 | Book-form electronic course |
| CN105005595A (en) * | 2015-06-30 | 2015-10-28 | 广东欧珀移动通信有限公司 | Sound playing method, mobile terminal, server and system |
| CN105264462A (en) * | 2013-06-07 | 2016-01-20 | 国际商业机器公司 | Resource provisioning for electronic books |
| CN105575198A (en) * | 2015-12-18 | 2016-05-11 | 北京美院帮网络科技有限公司 | Method and device for demonstrating teaching video |
| CN105869447A (en) * | 2016-03-30 | 2016-08-17 | 乐视控股（北京）有限公司 | Generating method and device of audiobook |
| CN106844679A (en) * | 2017-01-24 | 2017-06-13 | 广州朗锐数字传媒科技有限公司 | A kind of audiobook illustration display systems and method |
| CN106898170A (en) * | 2017-04-21 | 2017-06-27 | 杭州狮说教育科技有限公司 | Key to the exercises teaching method based on voice and digiboard book synchronized playback |
| CN107180566A (en) * | 2017-07-03 | 2017-09-19 | 深圳市前海思创金融研究院有限公司 | A kind of mobile phone makes the method and system of picture and text voice course |
| CN107786582A (en) * | 2016-08-24 | 2018-03-09 | 腾讯科技（深圳）有限公司 | A kind of online teaching methods, apparatus and system |
| CN109195007A (en) * | 2018-10-19 | 2019-01-11 | 深圳市轱辘汽车维修技术有限公司 | Video generation method, device, server and computer readable storage medium |
| WO2019090903A1 (en) * | 2017-11-10 | 2019-05-16 | 广州视睿电子科技有限公司 | Video processing method and apparatus, terminal device, and storage medium |
| CN110047334A (en) * | 2019-04-29 | 2019-07-23 | 四川长虹教育科技有限公司 | Tutoring system based on subject mode |
| CN110290517A (en) * | 2019-07-03 | 2019-09-27 | 深圳市麦芽智能设备有限公司 | Digital media wireless wifi communication point reading system and method |
| CN110610726A (en) * | 2018-07-20 | 2019-12-24 | 上海联课智能科技有限公司 | Method for preparing note capsule |
| CN111741359A (en) * | 2020-05-28 | 2020-10-02 | 杨伟 | Method and system for converting video into PPTX |
| CN114020939A (en) * | 2021-09-17 | 2022-02-08 | 联想(北京)有限公司 | Multimedia file control method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0713537A (en) * | 1993-05-21 | 1995-01-17 | Internatl Business Mach Corp <Ibm> | Dynamic control system of image or voice presentation |
| CN101106770A (en) * | 2006-07-13 | 2008-01-16 | 中兴通讯股份有限公司 | A method for making shot animation with background music in mobile phone |
| CN101272469A (en) * | 2007-03-23 | 2008-09-24 | 杨子江 | Recording system and method used for teaching and meeting place |
| CN101499310A (en) * | 2008-12-25 | 2009-08-05 | 爱唱数码科技（上海）有限公司 | Multimedia files production system and method |
| CN101656814A (en) * | 2008-08-18 | 2010-02-24 | 爱思开电讯投资（中国）有限公司 | Method and device for adding sound file to JPEG file |
| CN101908285A (en) * | 2010-06-18 | 2010-12-08 | 王家焱 | Method and system for inserting multimedia in electronic book |
| US20110059426A1 (en) * | 2009-09-04 | 2011-03-10 | Hm Technology International Limited | Book |
| CN102169643A (en) * | 2010-02-26 | 2011-08-31 | 卢君毅 | Dynamic electronic answering making method |
-
2011
- 2011-12-23 CN CN2011104399271A patent/CN103177611A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0713537A (en) * | 1993-05-21 | 1995-01-17 | Internatl Business Mach Corp <Ibm> | Dynamic control system of image or voice presentation |
| CN101106770A (en) * | 2006-07-13 | 2008-01-16 | 中兴通讯股份有限公司 | A method for making shot animation with background music in mobile phone |
| CN101272469A (en) * | 2007-03-23 | 2008-09-24 | 杨子江 | Recording system and method used for teaching and meeting place |
| CN101656814A (en) * | 2008-08-18 | 2010-02-24 | 爱思开电讯投资（中国）有限公司 | Method and device for adding sound file to JPEG file |
| CN101499310A (en) * | 2008-12-25 | 2009-08-05 | 爱唱数码科技（上海）有限公司 | Multimedia files production system and method |
| US20110059426A1 (en) * | 2009-09-04 | 2011-03-10 | Hm Technology International Limited | Book |
| CN102169643A (en) * | 2010-02-26 | 2011-08-31 | 卢君毅 | Dynamic electronic answering making method |
| CN101908285A (en) * | 2010-06-18 | 2010-12-08 | 王家焱 | Method and system for inserting multimedia in electronic book |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105264462B (en) * | 2013-06-07 | 2018-02-02 | 国际商业机器公司 | E-book resource allocation |
| CN105264462A (en) * | 2013-06-07 | 2016-01-20 | 国际商业机器公司 | Resource provisioning for electronic books |
| CN104952293A (en) * | 2014-03-24 | 2015-09-30 | 颜厥护 | Book-form electronic course |
| CN105005595A (en) * | 2015-06-30 | 2015-10-28 | 广东欧珀移动通信有限公司 | Sound playing method, mobile terminal, server and system |
| CN105575198A (en) * | 2015-12-18 | 2016-05-11 | 北京美院帮网络科技有限公司 | Method and device for demonstrating teaching video |
| CN105575198B (en) * | 2015-12-18 | 2019-01-11 | 北京美院帮网络科技有限公司 | The methods of exhibiting and device of instructional video |
| CN105869447A (en) * | 2016-03-30 | 2016-08-17 | 乐视控股（北京）有限公司 | Generating method and device of audiobook |
| CN107786582A (en) * | 2016-08-24 | 2018-03-09 | 腾讯科技（深圳）有限公司 | A kind of online teaching methods, apparatus and system |
| CN106844679A (en) * | 2017-01-24 | 2017-06-13 | 广州朗锐数字传媒科技有限公司 | A kind of audiobook illustration display systems and method |
| CN106898170A (en) * | 2017-04-21 | 2017-06-27 | 杭州狮说教育科技有限公司 | Key to the exercises teaching method based on voice and digiboard book synchronized playback |
| CN107180566A (en) * | 2017-07-03 | 2017-09-19 | 深圳市前海思创金融研究院有限公司 | A kind of mobile phone makes the method and system of picture and text voice course |
| WO2019090903A1 (en) * | 2017-11-10 | 2019-05-16 | 广州视睿电子科技有限公司 | Video processing method and apparatus, terminal device, and storage medium |
| CN110610726A (en) * | 2018-07-20 | 2019-12-24 | 上海联课智能科技有限公司 | Method for preparing note capsule |
| CN109195007A (en) * | 2018-10-19 | 2019-01-11 | 深圳市轱辘汽车维修技术有限公司 | Video generation method, device, server and computer readable storage medium |
| CN110047334A (en) * | 2019-04-29 | 2019-07-23 | 四川长虹教育科技有限公司 | Tutoring system based on subject mode |
| CN110290517A (en) * | 2019-07-03 | 2019-09-27 | 深圳市麦芽智能设备有限公司 | Digital media wireless wifi communication point reading system and method |
| CN111741359A (en) * | 2020-05-28 | 2020-10-02 | 杨伟 | Method and system for converting video into PPTX |
| CN114020939A (en) * | 2021-09-17 | 2022-02-08 | 联想(北京)有限公司 | Multimedia file control method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103177611A (en) | Method for realizing multimedia courseware on E-ink book | |
| Sewell et al. | Multimodal literacies in the secondary English classroom | |
| Orr et al. | Storyboard development for interactive multimedia training | |
| Joiner | Choosing and using videotexts | |
| Kurzweil et al. | Evidence-based guidelines for recording slide-based lectures | |
| Shin | Multimodal mediation and argumentative writing: A case study of a multilingual learner’s metalanguage awareness development | |
| Anderson | Audio visual aids in education | |
| Yeşilel | Technology-enhanced language learning for digital natives | |
| Hechter et al. | Promoting Creative Thinking and Expression of Science Concepts Among Elementary Teacher Candidates Through Science Content Movie Creation and Showcasing. | |
| Kist | Basement new literacies: Dialogue with a first-year teacher | |
| Wood | Aspects of Video Movie English Teaching. | |
| Cunningham | Flipping the language classroom | |
| Wang | [Retracted] A Survey of Multimedia‐Assisted English Classroom Teaching Based on Statistical Analysis | |
| Василенко et al. | Didactic video creation as a component of the implementation xxi century teachers’ methodological competencies | |
| EKWE et al. | Application of ICT in teaching and learning of social studies in secondary schools: The way forward | |
| Mora et al. | A critical deconstruction of TV ads for online English courses: toward a reconstruction of the concept of second language | |
| Lapp et al. | The communicative, visual, and performative arts: Core components of literacy education | |
| Farhi | The Significance of Audio Visual Aids in Foreign Language Teaching The Case of Second Year English Students at Mohamed Kheider University of Biskra | |
| Egelston-Dodd et al. | Video-Tutorials for Tech Sign Vocabulary in Astronomy. | |
| Dashti et al. | Students' Perceptions Relating ot Experiencing Motion Infographis in the Teaching Prosess: A Phenomenological Quatitative Study. | |
| Cox | Broadcast yourself: YouTube as a tool for interpreter education | |
| Tai et al. | Authoring tools in e-learning: A case study | |
| Akhror et al. | Creation of interactive learning rollers using scribing technology | |
| GARTON et al. | CHAPTER THREE LANGUAGE TEACHER EDUCATION | |
| Pino | Culture-Authentic Materials in the Foreign Language Classroom. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| DD01 | Delivery of document by public notice |
Addressee: Li Yunfeng Document name: Notification of Publication of the Application for Invention |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130626 |
|
| WD01 | Invention patent application deemed withdrawn after publication |