CN116483236A - Reading playback method, system and device based on electronic drawing book and storage medium - Google Patents
Reading playback method, system and device based on electronic drawing book and storage medium Download PDFInfo
- Publication number
- CN116483236A CN116483236A CN202310334556.3A CN202310334556A CN116483236A CN 116483236 A CN116483236 A CN 116483236A CN 202310334556 A CN202310334556 A CN 202310334556A CN 116483236 A CN116483236 A CN 116483236A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- electronic
- reading
- time node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000008569 process Effects 0.000 claims abstract description 34
- 230000008859 change Effects 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 4
- 238000012216 screening Methods 0.000 claims description 4
- 230000009467 reduction Effects 0.000 claims description 3
- 230000006870 function Effects 0.000 description 5
- 239000003973 paint Substances 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a reading playback method, a reading playback system, a reading playback device and a storage medium based on an electronic drawing book, and relates to the technical field of computers. The reading playback method based on the electronic drawing book comprises the following steps of: acquiring audio data and operation list data in the electronic drawing reading process, wherein the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing; displaying the electronic drawing book and playing the audio data; when the playback time of the audio data reaches an operation time node, changing the display picture of the electronic drawing according to the current operation type corresponding to the operation time node. According to the method and the device, the electronic drawing page can be adaptively adjusted along with the reading progress in the audio, and user experience is improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a reading playback method, a reading playback system, a reading playback device and a storage medium based on an electronic drawing.
Background
With the development of computer technology, electronic products are increasingly applied to the education field to guide students to learn. At present, on the basis of an electronic picture book, a reading function based on the electronic picture book is provided by means of an intelligent product, the electronic picture book is displayed on an intelligent terminal, a user describes or reads according to the content displayed by the electronic picture book, the intelligent terminal starts a recording function to record audio read by the user, and recording playback is provided for the user subsequently. However, in the current electronic book reading and playback process, only audio is played back or only the electronic book top page is displayed, and the electronic book page cannot be adaptively adjusted along with the reading progress in the audio, so that the playback experience of a user is affected.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the invention provides a method, a system, a device and a storage medium for playing back the electronic picture book, which can adaptively adjust the electronic picture book page along with the reading progress in the audio frequency, and improve the user experience.
In one aspect, the embodiment of the invention provides a reading playback method based on an electronic drawing, which comprises the following steps:
acquiring audio data and operation list data in the electronic drawing reading process, wherein the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing;
displaying the electronic drawing book and playing the audio data;
when the playback time of the audio data reaches an operation time node, changing the display picture of the electronic drawing according to the current operation type corresponding to the operation time node.
According to some embodiments of the invention, the operation type includes at least one of a next page operation, a previous page operation, an enlargement operation, a reduction operation, or a movement operation.
According to some embodiments of the present invention, the acquiring audio data and operation data in the electronic book reading process includes the following steps:
responding to the reading instruction to control the timer to start timing and collect reading audio;
monitoring whether an operation instruction is received or not in the process of collecting the reading audio;
when an operation instruction is received, determining the operation type and the current timing duration of the operation instruction, taking the timing duration as an operation time node, and carrying out association record on the operation time node and the operation type to obtain operation data;
and responding to the reading ending instruction to control the timer to finish timing, obtaining audio data according to the collected reading audio, and obtaining operation list data according to a plurality of operation data.
According to some embodiments of the present invention, the step of obtaining the audio data and the operation data in the electronic drawing reading process further includes the following steps:
responding to a background selection instruction, obtaining background audio, and storing the background audio in a second array in a PCM format;
collecting the read-aloud audio and caching the read-aloud audio to a first array in a PCM format;
when the data quantity of the first array reaches a preset value, superposing the first array and the second array to obtain a third array;
converting the PCM format data in the third array into MP3 format to obtain MP3 audio file;
and storing the operation data as tag information of the MP3 audio file to obtain the MP3 file.
According to some embodiments of the invention, the displaying the electronic drawing and playing the audio data comprises the steps of:
and responding to the first playing instruction, positioning the first page of the electronic drawing for displaying and starting to play the audio data from the audio starting node.
According to some embodiments of the invention, the displaying the electronic drawing and playing the audio data comprises the steps of:
responding to a second playing instruction, and determining a designated playing time node according to the second playing instruction;
performing data screening on the operation list data according to the designated play time node to select operation data of the operation time node before the designated play time node;
determining a designated display picture according to the operation types of all the selected operation data;
and positioning a designated display picture of the electronic drawing to display and starting to play the audio data from a designated play time node.
According to some embodiments of the present invention, when the playback duration of the audio data reaches an operation time node, changing the display screen of the electronic drawing according to the current operation type corresponding to the operation time node includes the following steps:
marking the corresponding operation type on an audio time axis of the audio data according to the operation time node in the operation list data;
when the playback time length of the audio data reaches the marking node on the audio time axis, triggering a page operation control instruction according to the operation type of the marking node to change the display picture of the electronic drawing.
On the other hand, the embodiment of the invention also provides a reading playback system based on the electronic drawing, which comprises the following steps:
the electronic drawing reading device comprises a first module, a second module and a third module, wherein the first module is used for acquiring audio data and operation list data in the electronic drawing reading process, the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing;
the second module is used for displaying the electronic drawing book and playing the audio data;
and a third module, configured to change a display screen of the electronic codebook according to a current operation type corresponding to the operation time node when the playback duration of the audio data reaches the operation time node.
On the other hand, the embodiment of the invention also provides a reading playback device based on the electronic drawing, which comprises:
at least one processor;
at least one memory for storing at least one program;
the at least one program, when executed by the at least one processor, causes the at least one processor to implement the electronic codebook-based speakable playback method as described previously.
In another aspect, embodiments of the present invention further provide a computer-readable storage medium storing computer-executable instructions for causing a computer to perform an electronic-codebook-based speakable playback method as described above.
The technical scheme of the invention has at least one of the following advantages or beneficial effects: by recording the audio data in the electronic picture book reading process and the operation list data comprising a plurality of operation data, each operation data comprises an operation type and an operation time node aiming at the electronic picture book, when the playback time length of the audio data reaches the operation time node in the process of displaying the electronic picture book and playing back the audio data, the display picture of the electronic picture book is changed according to the operation type corresponding to the current operation time node, so that the electronic picture book page can be adaptively adjusted along with the reading progress in the audio in the reading playback process, and the user experience is improved.
Drawings
FIG. 1 is a flowchart of a method for playing back a speakable reading based on an electronic codebook according to an embodiment of the present invention;
FIG. 2 is a schematic view of a speakable display interface according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a playback display interface provided by an embodiment of the present invention;
FIG. 4 is a flowchart of automatically switching a drawing page in a read-aloud playback process according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a read-aloud playback device based on an electronic drawing book according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are illustrative only and are not to be construed as limiting the invention.
In the description of the present invention, it should be understood that the direction or positional relationship indicated with respect to the description of the orientation, such as up, down, left, right, etc., is based on the direction or positional relationship shown in the drawings, is merely for convenience of describing the present invention and simplifying the description, and does not indicate or imply that the apparatus or element to be referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
In the description of the present invention, the description of first, second, etc. is for the purpose of distinguishing between technical features only, and should not be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated or implicitly indicating the precedence of the technical features indicated.
The embodiment of the invention provides a reading playback method based on an electronic drawing book, which can be applied to a terminal, wherein the terminal can be a tablet computer, a notebook computer, a desktop computer and the like, but is not limited to the method. According to the electronic picture book-based speakable playback method, the user records the operation type and the operation time node of the electronic picture book to form operation list data while recording the speakable audio in the process of speaking according to the picture book, and synchronously triggers the page control instruction of the operation type corresponding to the operation time node based on the operation list data in the process of speaking and playing back of the user, so that the display picture of the electronic picture book in the playing back process is adaptively changed according to the audio progress of the user.
Referring to fig. 1, an embodiment of the present invention provides a speakable playback method based on an electronic codebook, including but not limited to the following steps:
step S110, acquiring audio data and operation list data in the reading process of the electronic drawing, wherein the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing;
step S120, displaying an electronic drawing book and playing the audio data;
step S130, when the playback time of the audio data reaches the operation time node, changing the display picture of the electronic drawing according to the operation type corresponding to the current operation time node.
In some embodiments of step S110, the audio data includes a speakable audio collected by the microphone device on the intelligent terminal when the user speaks according to the displayed electronic drawing, and further, the audio data may further include a background audio selected by the user when the user speaks, where the background audio may be synchronously played and collected by the intelligent terminal together with the speakable audio when the user speaks. The operation list data comprises operation data of a plurality of users in a reading process, and each operation data comprises an operation time node and an operation type. The operation time node records based on the audio collection time, for example, referring to fig. 2, a user clicks "select background sound" on a speakable display interface to determine background audio, and then clicks "speaks/pauses" to start audio recording, and in the speakable process, the user can click "previous page" or "next page" to switch the picture pages, and can also control the size and display content of the picture display screen in the picture display area through gestures such as "zoom in", "zoom out" and "move". The intelligent terminal detects that a user clicks a next page on a reading display interface after 30 seconds of starting to collect audio, the intelligent terminal records operation data of the next page operation for 30 seconds while switching a drawing book to the next page, then the intelligent terminal detects that the user clicks a previous page on the reading display interface after 31 seconds of starting to collect audio, the intelligent terminal records operation data of the previous page operation for 31 seconds while switching the drawing book to the previous page, and so on, and operation list data is obtained according to a plurality of operation data after the audio collection is finished.
In some embodiments, the operation type may be a next page operation, a previous page operation, an enlargement operation, a reduction operation, a movement operation, or the like.
In some embodiments of step S120, after the audio collection is finished, the intelligent terminal switches to a playback display interface as shown in fig. 3, where a drawing display area of the playback display interface is used to display the electronic drawing. The user clicks "play" to load the above-described audio data and operation list data, and then starts audio playback.
In some embodiments of step S130, the operation list data may be converted into an array form to be represented, for example, actionArray [2] [5] = { {0, 1, 0}, {10,20,22,25,90}, where "0" in the first row indicates the next page operation, "1" indicates the previous page operation, the second row indicates the operation time node of the operation type of the same column, and the number of operation data is the total operation number n=5. Referring to fig. 4, taking the operation type as the previous page operation and the next page operation as an example, the flow of automatically switching the drawing page in the reading playback process is as follows:
step S10, after the user clicks play, the API play interface MediaPlayer is adopted to play the audio data, and the statistical variable n=0 of the number of times of initialization operation is performed
Step S20, judging whether the playback time length of the audio data reaches an action array [1] [ n ], if so, indicating that no operation event exists, returning to the step S20, and if not, indicating that the operation event exists, and executing the step S30;
step S30, judging whether the ActionArray [0] [ n ] = 0 is true, if true, executing step S50, and if false, executing step S40;
step S40, judging whether the ActionArray [0] [ n ] = 1 is true, if so, executing step S60;
step S50, generating a next page operation control instruction to switch to the next page of the current page of the electronic drawing, and then executing step S70;
step S60, generating a previous page operation control instruction to switch to a previous page of the current page of the electronic drawing, and then executing step S70;
step S70, accumulating the operation times statistical variable n by 1, and then executing step S80;
step S80, judging whether the operation times statistical variable n is larger than the total operation times, if so, ending the page switching flow, and if not, returning to step S20.
It will be appreciated that the next page operation may also take on other flag values than "0" and the previous page operation may also take on other flag values than "0". Similarly, the zoom-in operation, the zoom-out operation, or the move operation may be identified with corresponding flag values, for example, 0,1,2,3,4, 5 for the next page operation, the previous page operation, the zoom-in operation, the zoom-out operation, and the move operation, respectively. After determining that an operation event exists, starting to take a value from x=0 (x=0, 1,2,3, 4), judging whether the ActionArray [0] [ n ] = x is true, if true, generating an operation event corresponding to the x mark value, and if false, continuing to judge the ActionArray [0] [ n ] = x+1, thereby determining the operation event of the current operation time node. It should be noted that, for the moving operation, besides the type of the moving operation and the corresponding operation time node are stored in an associated manner in the audio collection process, the coordinates of the target pixels of the moving picture need to be stored in an associated manner synchronously, so that the picture can be moved to the local position corresponding to the coordinates of the target pixels in the subsequent audio playback process.
According to some embodiments of the present invention, in step S110, the step of obtaining the audio data and the operation data in the electronic book reading process includes, but is not limited to, the following steps:
step S210, a timer is controlled to start timing and the reading audio is collected in response to the reading instruction;
step S220, monitoring whether an operation instruction is received or not in the process of collecting the reading audio;
step S230, when an operation instruction is received, determining the operation type and the current timing duration of the operation instruction, taking the timing duration as an operation time node, and performing association record on the operation time node and the operation type to obtain operation data;
and step S240, controlling the timer to finish timing in response to the reading finish instruction, obtaining audio data according to the collected reading audio, and obtaining operation list data according to the plurality of operation data.
Further, step S110 further includes the steps of:
step S310, responding to a background selection instruction, obtaining background audio, and storing the background audio in a second array in a PCM format;
step S320, collecting the read-aloud audio and caching the read-aloud audio to a first array in a PCM format;
step S330, when the data quantity of the first array reaches a preset value, superposing the first array and the second array to obtain a third array;
step S330, converting the PCM format data in the third array into MP3 format to obtain MP3 audio file;
step S340, the operation data is stored as the label information of the MP3 audio file to obtain the MP3 file.
In this embodiment, PCM (Pulse Code Modulation ) is one of the encoding modes of digital communication, and the main process is to sample analog signals such as voice and image at regular intervals, discretize them, round the sampled values into integer quantization in hierarchical units, and represent the sampled values as a set of binary codes. MP3 is an Audio compression technique, which is commonly known as MPEG Audio Layer 3 (Moving Picture Experts Group Audio Layer III), abbreviated as MP3, designed to significantly reduce the amount of Audio data, and using MPEG Audio Layer 3, compresses music into smaller capacity files at a compression rate of 1:10 or even 1:12 without significantly degrading the quality of playback for most users compared to the original uncompressed Audio.
The intelligent terminal responds to the reading-out script selection instruction, jumps to display a reading-out display interface, obtains background sound selected by a user, decodes the background audio into PCM non-compressed format data by using a MedicaCodec library to facilitate data operation, and then stores the background audio into a second group of audioBGM. And calling a recording API interface MediaRecorder in response to a reading instruction of a user, starting microphone PCM format recording, storing the reading audio to a first array audioRecord, and starting a timer. If the buffer of the first array AudioRecord data does not reach the preset value (for example, 2 k), the intelligent terminal is in a waiting idle state, and if the buffer reaches the preset value, the read-aloud audio and the background audio can be synthesized at a common sampling rate of 44.1 khz (the buffer processing interval time is about t=2/44.1=45 ms), namely, the first array and the second array are stacked and stored to a third array AudioTarget, namely audiotarget=audiorecord+audiobgm. In the process of audio acquisition, if an operation instruction input by a user is detected, storing time_n=timer and action_n=x to the tail of the data set ActionRecord, wherein Time represents the current timing duration, namely an operation Time node, x represents the sign value of an operation type, and N represents accumulation of operation times. Taking the example of detecting that the user clicks the next page at 10 seconds, clicks the next page at 20 seconds, clicks the previous page at 22 seconds, clicks the next page at 25 seconds, clicks the next page at 1 minute and 30 seconds, and finishes recording at 1 minute and 40 seconds, operation list data in the ActionRecord array is as follows, wherein the next page is represented by a flag value of "0", and the previous page is represented by a flag value of "1":
Time_1:00:00:10,Action_1:0；
Time_2:00:00:20,Action_2:0；
Time_3:00:00:22,Action_3:1；
Time_4:00:00:25,Action_4:0；
Time_5:00:01:30,Action_5:0；
repeating the process of monitoring and storing the operation data until the user clicks to finish recording is detected, adopting a LAME MP3 encoder, and encoding a third array AudioTarget in a PCM format into an MP3 format by using a first instruction to obtain an MP3 audio file, wherein the first instruction is as follows:
$lame-r-s 44.1AudioTarget.pcm AudioTarget.mp3
wherein LAME represents command line format: the name [ option ] [ input filename ] [ output filename ]; "-r" designates the input file as being in Raw PCM format; "-s" designates the sampling frequency of the source file.
Adding an ActionRecord array to an MP3 audio file by adopting an FFmpeg audio-video library, and converting the ActionRecord array into an MP3 format by using a second instruction to obtain the MP3 file, wherein the second instruction is as follows:
$ffmpeg-i AudioTarget.mp3-metadata Comments＝"ActionRecord"AudioTarget_final.mp3
wherein ffmpeg characterizes command line format: ffmpeg-i [ input filename ] [ parameter option ] [ output filename ]; the "-metadata" is followed by the tag parameter that needs to be modified, and the Comments tag corresponds to the "remark" parameter, i.e., the list of operations data in the ActionRecord.
Finally, MP3 files containing audio data and operation data are stored, in the embodiment, the operation storage of page turning information and the like is realized by adopting a tag function built in an MP3 format with strong universality, and only 1 file is needed to store the audio information for reading and the operation information in the reading process, so that automatic page turning synchronization during drawing playback is realized.
Correspondingly, in the process of playing back by a user, loading the MP3 file corresponding to the drawing, and acquiring the label information in the MP3 file by using a third instruction, wherein the third instruction is as follows:
$ffmpeg-i track12.mp3-f ffmetadata metadata.txt
the export tag information is specified by using-fffmetadata and is stored in a metadata. Txt file, wherein the metadata. Txt file contains operation list data.
And filtering time and operation types from the operation list data through characters, converting a time format into seconds to obtain an array containing time and event types, such as ActionArray [2] [5] = { {0, 1, 0}, {10,20,22,25,90}, and automatically switching pages in the audio playback process according to the automatic switching drawing page flow of FIG. 4.
According to some embodiments of the present invention, in step S120, displaying the electronic script and playing the audio data includes, but is not limited to, the following steps:
in step 410, in response to the first play command, the first page of the electronic drawing is located for display, and the audio data is played from the audio start node.
In this embodiment, the first play instruction is used to characterize that the designated play time node is not detected before the play is triggered, and playback is started from scratch by default. After the user finishes reading and switches to the playback display interface shown in fig. 3, if the user detects the direct detection play instruction and does not detect the designated play time node, the intelligent terminal locates to the home page of the electronic drawing book to display and starts playing the audio data from the audio start node.
In other embodiments, step S120 further includes, but is not limited to, the following steps:
step 510, responding to the second playing instruction, and determining a designated playing time node according to the second playing instruction;
step 520, performing data screening on the operation list data according to the designated play time node to select the operation data of the operation time node before the designated play time node;
step 530, determining a designated display screen according to the operation types of all the selected operation data;
step 540, locate to the designated display screen of the electronic drawing for displaying and play the audio data from the designated play time node.
In this embodiment, the second play instruction is used to characterize that the designated play time node is detected before the play is triggered, that is, the second play instruction includes the designated play time node and the play instruction, where the designated play time node may be marked on the audio time axis by the user, or may be input in the form of a text box or the like.
For example, the designated play time node input by the user is 24 seconds, the operation time nodes included in the operation list data are respectively 10 seconds, 20 seconds, 22 seconds, 25 seconds and 90 seconds, the corresponding operation types are respectively the next page, the enlargement, the movement, the next page, the previous page and the next page, the operation list data are subjected to data screening according to the designated play time node, the operation data before 24 seconds, namely, the operation types corresponding to the operation time nodes of 10 seconds, 20 seconds and 22 seconds, can be selected, namely, the operation types are respectively the next page, the enlargement and the movement, the electronic drawing is switched from the first page picture to the next page, the logic operation of enlarging and moving to the designated local position is performed on the second page to determine the designated display picture, then the designated display picture positioned to the electronic drawing is displayed, and the audio data are played from the designated play time node.
According to some embodiments of the present invention, in step S130, when the playback duration of the audio data reaches the operation time node, the step of changing the display screen of the electronic album according to the operation type corresponding to the current operation time node includes, but is not limited to, the following steps:
step S610, marking the corresponding operation type on the audio time axis of the audio data according to the operation time node in the operation list data;
in step S620, when the playback duration of the audio data reaches the marking node on the audio time axis, the page operation control command is triggered according to the operation type of the marking node to change the display screen of the electronic drawing.
In this embodiment, the audio time axis is also called an audio progress bar, and the progress bar is used to display the speed of processing tasks in the form of pictures, that is, when the computer plays audio, the speed, the completion degree, the amount of remaining tasks that are not completed and the time that may need to be processed are displayed in the form of pictures in real time, which is generally shown in the form of rectangular bars. The corresponding operation type is marked on the audio time axis of the audio data, so that the computer can conveniently detect the operation type in time and trigger the page operation control instruction to change the display picture of the electronic drawing book when playing the audio, and the user can conveniently and intuitively observe the whole operation process.
The embodiment of the invention also provides a reading playback system based on the electronic drawing, which comprises the following steps:
the electronic drawing reading device comprises a first module, a second module and a third module, wherein the first module is used for acquiring audio data and operation list data in the electronic drawing reading process, the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing;
the second module is used for displaying the electronic drawing book and playing the audio data;
and the third module is used for changing the display picture of the electronic drawing according to the operation type corresponding to the current operation time node when the playback time of the audio data reaches the operation time node.
It can be understood that the content in the above-mentioned embodiment of the method for playing back a speakable reading based on an electronic photo is applicable to the embodiment of the system, and the functions specifically implemented by the embodiment of the system are the same as those in the embodiment of the method for playing back a speakable reading based on an electronic photo, and the beneficial effects achieved by the embodiment of the method for playing back a speakable reading based on an electronic photo are the same as those achieved by the embodiment of the method for playing back a speakable reading based on an electronic photo.
Referring to fig. 5, fig. 5 is a schematic diagram of an electronic book-based read-aloud playback device according to an embodiment of the present invention. The electronic-book-based read-aloud playback device in the embodiment of the invention includes one or more control processors and a memory, and fig. 5 illustrates one control processor and one memory as an example.
The control processor and the memory may be connected by a bus or otherwise, for example in fig. 5.
The memory, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs as well as non-transitory computer executable programs. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory remotely located relative to the control processor, the remote memory being connectable to the electronic codebook-based speakable playback device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
It will be appreciated by those skilled in the art that the device structure shown in fig. 5 is not limiting of an electronic book-based speakable playback device and may include more or fewer components than shown, or may combine certain components, or may have a different arrangement of components.
The non-transitory software program and instructions required to implement the electronic-paint-based speakable playback method applied to the electronic-paint-based speakable playback device in the above embodiment are stored in the memory, and when executed by the control processor, the electronic-paint-based speakable playback method applied to the electronic-paint-based speakable playback device in the above embodiment is executed.
In addition, an embodiment of the present invention further provides a computer readable storage medium, where computer executable instructions are stored, where the computer executable instructions are executed by one or more control processors, and the one or more control processors may cause the electronic-book-based read-back method in the foregoing method embodiment to perform.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge of one of ordinary skill in the art without departing from the spirit of the present invention.
Claims (10)
1. The reading playback method based on the electronic drawing book is characterized by comprising the following steps of:
acquiring audio data and operation list data in the electronic drawing reading process, wherein the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing;
displaying the electronic drawing book and playing the audio data;
when the playback time of the audio data reaches an operation time node, changing the display picture of the electronic drawing according to the current operation type corresponding to the operation time node.
2. The electronic codebook based read-out playback method according to claim 1, wherein the operation type includes at least one of a next page operation, a previous page operation, an enlargement operation, a reduction operation, or a movement operation.
3. The method for playback of electronic book-based speakable reading of claim 1, wherein the step of obtaining audio data and operational data during the electronic book speaking process comprises the steps of:
responding to the reading instruction to control the timer to start timing and collect reading audio;
monitoring whether an operation instruction is received or not in the process of collecting the reading audio;
when an operation instruction is received, determining the operation type and the current timing duration of the operation instruction, taking the timing duration as an operation time node, and carrying out association record on the operation time node and the operation type to obtain operation data;
and responding to the reading ending instruction to control the timer to finish timing, obtaining audio data according to the collected reading audio, and obtaining operation list data according to a plurality of operation data.
4. The method for playback of electronic book-based speakable reading of claim 3, wherein the step of obtaining the audio data and the operation data in the electronic book-based speakable reading further comprises the steps of:
responding to a background selection instruction, obtaining background audio, and storing the background audio in a second array in a PCM format;
collecting the read-aloud audio and caching the read-aloud audio to a first array in a PCM format;
when the data quantity of the first array reaches a preset value, superposing the first array and the second array to obtain a third array;
converting the PCM format data in the third array into MP3 format to obtain MP3 audio file;
and storing the operation data as tag information of the MP3 audio file to obtain the MP3 file.
5. The electronic book-based speakable playback method of claim 1 wherein the displaying the electronic book and playing the audio data comprises the steps of:
and responding to the first playing instruction, positioning the first page of the electronic drawing for displaying and starting to play the audio data from the audio starting node.
6. The electronic book-based speakable playback method of claim 1 wherein the displaying the electronic book and playing the audio data comprises the steps of:
responding to a second playing instruction, and determining a designated playing time node according to the second playing instruction;
performing data screening on the operation list data according to the designated play time node to select operation data of the operation time node before the designated play time node;
determining a designated display picture according to the operation types of all the selected operation data;
and positioning a designated display picture of the electronic drawing to display and starting to play the audio data from a designated play time node.
7. The method for reading and playing back an electronic book according to claim 1, wherein when the playback time of the audio data reaches an operation time node, changing the display screen of the electronic book according to the operation type corresponding to the current operation time node comprises the following steps:
marking the corresponding operation type on an audio time axis of the audio data according to the operation time node in the operation list data;
when the playback time length of the audio data reaches the marking node on the audio time axis, triggering a page operation control instruction according to the operation type of the marking node to change the display picture of the electronic drawing.
8. An electronic-book-based read-aloud playback system, comprising:
the electronic drawing reading device comprises a first module, a second module and a third module, wherein the first module is used for acquiring audio data and operation list data in the electronic drawing reading process, the operation list data comprises a plurality of operation data, and the operation data comprises an operation type and an operation time node aiming at the electronic drawing;
the second module is used for displaying the electronic drawing book and playing the audio data;
and a third module, configured to change a display screen of the electronic codebook according to a current operation type corresponding to the operation time node when the playback duration of the audio data reaches the operation time node.
9. An electronic-book-based reading playback device, comprising:
at least one processor;
at least one memory for storing at least one program;
when the at least one program is executed by the at least one processor, the at least one processor is caused to implement the electronic codebook-based speakable playback method as recited in any one of claims 1 to 7.
10. A computer-readable storage medium in which a processor-executable program is stored, wherein the processor-executable program is for implementing the electronic-codebook-based speakable playback method as recited in any one of claims 1 to 7 when executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310334556.3A CN116483236A (en) | 2023-03-30 | 2023-03-30 | Reading playback method, system and device based on electronic drawing book and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310334556.3A CN116483236A (en) | 2023-03-30 | 2023-03-30 | Reading playback method, system and device based on electronic drawing book and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116483236A true CN116483236A (en) | 2023-07-25 |
Family
ID=87212978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310334556.3A Pending CN116483236A (en) | 2023-03-30 | 2023-03-30 | Reading playback method, system and device based on electronic drawing book and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116483236A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050039219A1 (en) * | 1994-10-12 | 2005-02-17 | Pixel Instruments | Program viewing apparatus and method |
| CN105302424A (en) * | 2014-05-26 | 2016-02-03 | 周莹 | Multi-dimensional dynamic mark recording and replaying method and system |
| CN107515722A (en) * | 2017-08-30 | 2017-12-26 | 广州视源电子科技股份有限公司 | Information storage method, information display method, information storage device, information display device, information storage equipment and computer storage medium |
| CN109614030A (en) * | 2018-11-29 | 2019-04-12 | 广州视源电子科技股份有限公司 | Courseware making and reviewing method, device, system, equipment and storage medium |
| CN113539313A (en) * | 2021-07-22 | 2021-10-22 | 统信软件技术有限公司 | Audio marking method, audio data playing method and computing equipment |
-
2023
- 2023-03-30 CN CN202310334556.3A patent/CN116483236A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050039219A1 (en) * | 1994-10-12 | 2005-02-17 | Pixel Instruments | Program viewing apparatus and method |
| CN105302424A (en) * | 2014-05-26 | 2016-02-03 | 周莹 | Multi-dimensional dynamic mark recording and replaying method and system |
| CN107515722A (en) * | 2017-08-30 | 2017-12-26 | 广州视源电子科技股份有限公司 | Information storage method, information display method, information storage device, information display device, information storage equipment and computer storage medium |
| CN109614030A (en) * | 2018-11-29 | 2019-04-12 | 广州视源电子科技股份有限公司 | Courseware making and reviewing method, device, system, equipment and storage medium |
| CN113539313A (en) * | 2021-07-22 | 2021-10-22 | 统信软件技术有限公司 | Audio marking method, audio data playing method and computing equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1738440B (en) | Apparatus and method for processing information | |
| US7054540B2 (en) | Information processing apparatus and method, and program storage medium | |
| US20070027844A1 (en) | Navigating recorded multimedia content using keywords or phrases | |
| US20070252897A1 (en) | Image capturing apparatus and method, and recording medium therefor | |
| US20070265720A1 (en) | Content marking method, content playback apparatus, content playback method, and storage medium | |
| US8837912B2 (en) | Information processing apparatus, information processing method and program | |
| JP2001352506A (en) | Video recorder and its method and recorder | |
| CN101355674A (en) | Recording apparatus, reproducing apparatus, recording/reproducing apparatus, image pickup apparatus, recording method, and program | |
| JP4311194B2 (en) | Image reproducing apparatus and image reproducing method | |
| CN110996157A (en) | Video playing method and device, electronic equipment and machine-readable storage medium | |
| JP2000339931A (en) | Recorded image-reproducing apparatus | |
| CN1181675C (en) | Video recording and playback | |
| CN100484227C (en) | Video reproduction apparatus and intelligent skip method therefor | |
| JP4900246B2 (en) | Broadcast receiving device that prioritizes broadcast that should be provided immediately when viewing time-shift | |
| CN116483236A (en) | Reading playback method, system and device based on electronic drawing book and storage medium | |
| CN101594505A (en) | Recording and playback method and device | |
| US20050063668A1 (en) | Data editing and recording apparatus, method of editing and recording data, data editing and recording program, and recording medium having the same thereon | |
| JP2005295266A (en) | Receiver | |
| JP4786117B2 (en) | Information processing apparatus and method, and program | |
| US20040028378A1 (en) | Data reproduction apparatus, data reproduction method, and data recording medium | |
| JP2008193715A (en) | Data recorder | |
| JP4116604B2 (en) | Data recording device | |
| JP4337317B2 (en) | Information processing apparatus and program | |
| KR20070094055A (en) | Thumbnail recording method and terminal using the same | |
| KR101398781B1 (en) | Media file recording medium having a time based hyperlink and the playing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230725 |
|
| RJ01 | Rejection of invention patent application after publication |