CN106844679A - A kind of audiobook illustration display systems and method - Google Patents
A kind of audiobook illustration display systems and method Download PDFInfo
- Publication number
- CN106844679A CN106844679A CN201710055210.4A CN201710055210A CN106844679A CN 106844679 A CN106844679 A CN 106844679A CN 201710055210 A CN201710055210 A CN 201710055210A CN 106844679 A CN106844679 A CN 106844679A
- Authority
- CN
- China
- Prior art keywords
- illustration
- time
- module
- association
- audiobook
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/438—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Television Signal Processing For Recording (AREA)
- Management Or Editing Of Information On Record Carriers (AREA)
Abstract
The present invention relates to a kind of audiobook illustration display systems, management server and client, the management server include：Webpage provides module, audio management module, illustration relating module, monitoring module, illustration playing module and memory module；Default illustration related information is dynamically monitored in playing process, and transfers related illustration and played out, illustration shows more flexibly, without complicated manufacturing process, without being made as talking book in advance, related illustration can be watched during listening to storytelling, strengthen reading experience.
Description
Technical field
The invention belongs to network information processing technical field, more particularly to a kind of audiobook illustration display systems and method.
Background technology
Books typically have some illustrations, and to explain or enrich book contents, audiobook is artificial typing books at the sound
Sound and generate, when simple audio is played, user is difficult to see that corresponding illustration in paper book, and reading experience is not good enough.
In order to improve the reading experience of audiobook, a kind of talking book is disclosed in Chinese patent application CN105869447
Generation method and device, technical scheme is background picture, the reading matter voice for obtaining talking book to be generated；Receive adjustment background
Picture display order is instructed, and the instruction includes background picture to be adjusted and reading matter corresponding with the background picture to be adjusted
Speech time point；The order of the background picture to be adjusted is adjusted to by corresponding reading matter Speech time point according to the instruction
On；The talking book according to the background picture order after the adjustment and the reading matter speech production.It is that a first generation has
Sound reading matter, then the process listened to is played, it is not suitable with simply after line is listened to or downloads audiobook in the situation of client terminal playing.
On the other hand, the technical scheme is that background picture is arranged previously according to reading matter Speech time dot sequency, then generates language
Pronunciation thing；Background picture is played out according to default order, and if not arranging playing sequence, is then carried out according to upload order
Play, flexibility is not good enough, and error probability is big.
The content of the invention
In order to solve the above problems, the invention provides a kind of audiobook illustration display systems, concrete scheme is as follows：
A kind of audiobook illustration display systems, it is characterised in that the display systems include：Management server and client
End, the management server includes：Webpage provides module, audio management module, illustration relating module, monitoring module, illustration and broadcasts
Amplification module and memory module；
The webpage provides module, and the audiobook of listening to for receiving client transmission is instructed, there is provided audiobook is played detailed
The feelings page, and after client sends and plays audiobook instruction, sent to audio management module and play audio instructions；
The audio management module, chapters and sections information and reproduction time information for managing audiobook data are received and played
Audio instructions, while playing audio, the default illustration related information instruction that monitoring audio is played are sent to monitoring module；
The illustration relating module, for illustration to be associated with default illustration related information, forms multiple associations and inserts
Figure, and it is stored in memory module；
The monitoring module, for receiving the default illustration related information instruction that monitoring audio is played, when monitoring broadcasting
During default illustration related information when, sent to illustration playing module and change respective associated illustration and instruct；
The illustration playing module, the instruction of respective associated illustration is changed for receiving, and transferred in memory module with advance
If illustration related information carries out replacing broadcasting to corresponding association illustration；
The memory module, for storing voice data, illustration data and association in time illustration data.
Further, the client includes network interaction module, player module, monitors module, illustration display module
And data memory module, the management server is also including data transmission module；The webpage provides module, is additionally operable to receive visitor
The download audiobook instruction that family end sends, transmission data command is sent to data transmission module；
The data transmission module, for receiving transmission data command, transfers voice data and association in memory module
Illustration data, are sent to network interaction module；
The network interaction module, sends download audiobook instruction, and receive data transfer for providing module to webpage
The voice data of module transfer with associate illustration data, and be stored in data memory module；
The player module, for the voice data in called data memory module, and plays out audiobook audio,
And send monitoring instruction to module is monitored；
The monitoring module, instruction is monitored for receiving, and the default illustration related information that audio is played is monitored,
When default illustration related information is monitored, send displaying respective associated illustration to illustration display module and instruct；
The illustration display module, for receiving the illustration instruction of displaying respective associated, and respective associated illustration is illustrated in
Client；
The data memory module, for storing voice data and associating illustration data.
Further, the default illustration related information includes timestamp tnInformation；When the illustration relating module includes
Between associate submodule, the association in time submodule, for illustration and Preset Time to be stabbed into tnIt is associated, forms n time
Association illustration, and it is stored in memory module；
The monitoring module include time monitoring submodule, for monitoring reproduction time t, when monitor reproduction time t >=
tnWhen, change submodule to association in time illustration and send the corresponding n-th association in time illustration instruction of replacing；
The illustration playing module includes that association in time illustration changes submodule, and corresponding n-th time is changed for receiving
Association illustration instruction, and current (n-1)th association in time illustration is replaced by n-th association in time illustration；
The audio management module, while being additionally operable to play audio, when sending monitoring broadcasting to time monitoring submodule
Between t instruction.
Further, the default illustration related information also includes key word information, and the illustration relating module is also wrapped
Keyword tag submodule is included, for the association in time illustration that association in time submodule is formed to be carried out into keyword tag, is formed
Association in time illustration with keyword tag, and store to memory module；
The audio management module, while being additionally operable to play audio, sends to keyword search submodule and extracts crucial
Word is instructed；
The monitoring module also includes keyword search submodule and timestamp judging submodule；Keyword search
Module, extracts the keyword that present video plays content, and searches for the association in time illustration with the Keywords matching, works as search
During to the association in time illustration for matching, timestamp decision instruction is sent to timestamp judging submodule；The timestamp judges son
Module, for receiving timestamp decision instruction, to the timestamp t of currently playing former association in time illustrationxClosed with match time
Join the timestamp t of illustrationyJudged, worked as tx≤tyWhen, do not process；Work as tx＞ tyWhen, change submodule to matching illustration and send out
Send the instruction changed with the association in time illustration of the Keywords matching；
The illustration playing module also includes that matching illustration changes submodule, is changed and the Keywords matching for receiving
The instruction of association in time illustration, and current x-th association in time illustration is replaced by y-th association in time illustration.
Further, the monitoring module also includes time record sub module；The illustration playing module also includes original
Association in time illustration changes submodule；
The matching illustration changes submodule, is additionally operable to, when match time association illustration is changed, submodule be recorded to the time
Block sends record time command；
The time record sub module, for receiving time recording instruction, during record replacing match time association illustration
Reproduction time t, and start recording time t1, and by t1With preset time threshold t0Contrasted, worked as t1≥t0When, closed to the former time
Connection illustration changes submodule and sends the former association in time illustration instruction of replacing；
The former association in time illustration changes submodule, and former association in time illustration instruction is changed for receiving, and will be current
Y-th association in time illustration is replaced by x-th association in time illustration.
Further, the monitoring module also includes that the time contrasts submodule, and the time record sub module is additionally operable to
When record changes match time and associates the time t of illustration, time contrast instruction is sent to time contrast submodule；The time
Contrast submodule, for receiving the time to instruction, in t1＜ t0When to t+t1With next illustration timestamp tx+1Contrasted, when right
It is t+t than result1＜ tx+1When, do not process；When comparing result is t+t1≥tx+1When, change submodule to association in time illustration
Send and change future time association illustration instruction, and record time command is terminated to the transmission of time record sub module；The time
Record sub module, is additionally operable to receive and executive termination record time command.
On the other hand, the present invention also provides a kind of audiobook illustration methods of exhibiting, and methods described comprises the following steps：
S1：Client sends listens to audiobook instruction.
S2：The audiobook of listening to that management server receives client transmission is instructed, and plays audiobook audio, and monitor audio
The default illustration related information played；
S3：When the default illustration related information in monitoring audio playing process, change respective associated illustration and broadcast
Put.
Further, the default related information includes timestamp tnInformation, methods described comprises the following steps：
S1：Client sends listens to audiobook instruction；
S2：The audiobook of listening to that management server receives client transmission is instructed, and plays audiobook audio, and monitor broadcasting
Time t；
S3：Reproduction time t >=t is monitored to working asn, current (n-1)th association in time illustration is replaced by n-th time and is closed
Connection illustration.
Further, the default related information also includes key word information, and methods described also comprises the following steps：
S4：The keyword that present video plays content is extracted, and searches for the association in time illustration with the Keywords matching,
S5：When the association in time illustration of matching is searched, to the timestamp t of currently playing former association in time illustrationx
The timestamp t of illustration is associated with match timeyJudged, worked as tx≤tyWhen, do not process；Work as tx＞ tyWhen, change with it is described
The association in time illustration of Keywords matching.
Further, methods described also comprises the following steps：
S6：When changing the association in time illustration with the Keywords matching, current play time t, and start recording are recorded
Time t1, and by t1With preset time threshold t0Contrasted, when monitoring t1≥t0When, illustration is replaced by former association in time and is inserted
Figure；
S7：In t1＜ t0In time period, to t+t1With next illustration timestamp tx+1Contrasted, when comparing result is t+t1
＜ tx+1When, do not process；When comparing result is t+t1≥tx+1When, future time association illustration is changed, and stop timing.
Audiobook illustration display systems of the invention, dynamically monitor default illustration related information, and adjust in playing process
Take related illustration to play out, illustration shows more flexibly, without complicated manufacturing process, without being made as talking book in advance,
Related illustration can be watched during listening to storytelling, strengthens reading experience.
With time and keyword as related information, each illustration has unique time stamps, and monitoring module is monitored accordingly
During reproduction time, association in time illustration is carried out to transfer replacing broadcasting；Illustration is associated current time is played, but is not arrived also next
In reproduction time this period of association in time illustration, occurring recalling or other situations, can transfer and play content more
The picture of matching, is not limited solely to photo current；Method is simple, plays accurate, and various dimensions play illustration, make reading experience more
It is good.
Brief description of the drawings
Each part annexation figure of audiobook illustration display systems described in Fig. 1 embodiments 1；
Each part annexation figure of audiobook illustration display systems described in Fig. 2 embodiments 2；
Each part annexation figure of audiobook illustration display systems described in Fig. 3 embodiments 3；
Each part annexation figure of audiobook illustration display systems described in Fig. 4 embodiments 4；
Each part annexation figure of audiobook illustration display systems described in Fig. 5 embodiments 5；
The flow chart of audiobook illustration methods of exhibiting described in Fig. 6 embodiments 6；
The flow chart of audiobook illustration display systems described in Fig. 7 embodiments 7；
The flow chart of audiobook illustration display systems described in Fig. 8 embodiments 8.
Specific embodiment
The invention will be further described with reference to the accompanying drawings and examples, and the following example is only used for explaining the present invention
The content of the invention, be not intended to limit the scope of the invention.
Embodiment 1
As shown in figure 1, a kind of audiobook illustration display systems include：Management server 1 and client 2, the management clothes
Business device 1 includes：Webpage provides module 101, audio management module 102, illustration relating module 106, monitoring module 103, illustration and broadcasts
Amplification module 104 and memory module 105；
Client 2 is listened to audiobook online by webpage, and webpage provides module 101 and provides audiobook broadcasting details page
Face, on the page including audiobook various data, such as title, brief introduction, author, perform in a radio or TV programme, chapters and sections information, illustration data, together
When broadcast button is provided；Client 2 clicks on broadcast button, sends and plays audiobook instruction, and the webpage provides module 101 to sound
Frequency management module 102 sends plays audio instructions；
The audio management module 102, manages the chapters and sections information and reproduction time information of audiobook data, plays audio,
And while audio is played, the default illustration related information instruction that monitoring audio is played is sent to monitoring module 103；
The monitoring module 103, when the default illustration related information in monitoring playing process, to illustration playing module
104 send the illustration instruction of replacing respective associated；
The illustration playing module 104, transfers with default illustration related information to corresponding association in memory module 105
Illustration, carries out replacing broadcasting；
The illustration relating module 106, for illustration to be associated with default illustration related information, forms multiple associations
Illustration, and it is stored in memory module 105；
The memory module 105, for storing voice data, illustration data and associating illustration data.
It should be noted that if audiobook is without correspondence illustration data, association illustration is front cover picture, and without more
Change.
Audiobook illustration display systems of the invention, dynamically monitor default illustration related information, and adjust in playing process
Take related illustration to play out, illustration shows more flexibly, related illustration can be watched during listening to storytelling, body is read in enhancing
Test.
Embodiment 2
The audiobook illustration display systems of the present embodiment, the difference with embodiment 1 is, as shown in Fig. 2 the client
2 include network interaction module 201, player module 203, monitor module 204, illustration display module 205 and data memory module
202, the management server 1 also includes data transmission module 206；The webpage provides module 101, is additionally operable to receive client
The 2 download audiobook instructions for sending, transmission data command is sent to data transmission module 206；
The data transmission module 206, for receiving transmission data command, voice data is transferred in memory module 105
With associate illustration data, be sent to network interaction module 201；
The network interaction module 201, sends download audiobook instruction, and receive number for providing module 101 to webpage
The voice data transmitted according to transport module 206 with associate illustration data, and be stored in data memory module 202；
The player module 203, for the voice data in called data memory module 202, and plays out sound
Book audio, and send monitoring instruction to module 204 is monitored；
The monitoring module 204, monitors instruction, and the default illustration related information that audio is played is supervised for receiving
Control, when default illustration related information is monitored, sends displaying respective associated illustration and instructs to illustration display module 205；
The illustration display module 205, for receiving the illustration instruction of displaying respective associated, and respective associated illustration is shown
In client 2；
The data memory module 202, for storing voice data and associating illustration data.
The audiobook illustration display systems that the present embodiment is provided, there is provided the selection of audiobook, client are listened in a kind of download
When audiobook is downloaded in end selection, can in the lump be downloaded illustration is associated accordingly, even if when off-line state listens to audiobook, also may be used
To watch related illustration information.
Embodiment 3
The audiobook illustration display systems of the present embodiment, the difference with embodiment 1 is, as shown in figure 3, described default slotting
Figure related information includes timestamp tnInformation；The illustration relating module 106 includes association in time submodule 301, the time
Association submodule 301, for illustration and Preset Time to be stabbed into tnIt is associated, forms n association in time illustration, and be stored in
Storage module 105；
The monitoring module 103 includes time monitoring submodule 302, for monitoring reproduction time t, when broadcasting is monitored
Between t >=tnWhen, change submodule 303 to association in time illustration and send the corresponding n-th association in time illustration instruction of replacing；
The illustration playing module 104 includes that association in time illustration changes submodule 303, and corresponding n-th is changed for receiving
Individual association in time illustration instruction, and current (n-1)th association in time illustration is replaced by n-th association in time illustration；
The audio management module 102, while being additionally operable to play audio, sends to time monitoring submodule 302 and monitors
The instruction of reproduction time t.
The audiobook illustration display systems that the present embodiment is provided, with the time as related information, make each illustration have only
One timestamp, when monitoring module monitors corresponding reproduction time, carries out transferring replacing broadcasting, method letter to association in time illustration
It is single, play accurate.
Embodiment 4
The audiobook illustration display systems of the present embodiment, the difference with embodiment 3 is, as shown in figure 4, further limit
Fixed, the default illustration related information also includes key word information, and the illustration relating module 106 also includes keyword tag
Module 1, the association in time illustration for association in time submodule 301 to be formed carries out keyword tag, and being formed has keyword
The association in time illustration of mark, and store to memory module 105；
The audio management module 102, while being additionally operable to play audio, sends to keyword search submodule 401 and carries
Take keyword instruction；
The monitoring module 103 also includes keyword search submodule 401 and timestamp judging submodule 402；The pass
Keyword searches for submodule 401, extracts the keyword that present video plays content, and search for the time pass with the Keywords matching
Connection illustration, when the association in time illustration of matching is searched, timestamp decision instruction is sent to timestamp judging submodule 402；
The timestamp judging submodule 402, for receiving timestamp decision instruction, to currently playing former association in time illustration when
Between stab txThe timestamp t of illustration is associated with match timeyJudged, worked as tx≤tyWhen, do not process, if that is, matching when
Between associate illustration and do not played also, it is necessary to occur first in following sections, then do not played in advance in current time；Work as tx
＞ tyWhen, the instruction that submodule 403 sends replacing and the association in time illustration of the Keywords matching is changed to matching illustration, fit
For recall or other it is any can have the situation of illustration more matched than current time association illustration, cannot in the time
In the case of retrogressing, illustration information can be repeated playing；
The illustration playing module 104 also includes that matching illustration changes submodule 403, is changed and the key for receiving
The association in time illustration instruction of word matching, and current x-th association in time illustration is replaced by y-th association in time illustration.
The audiobook illustration display systems of the present embodiment, keyword tag is carried out to association in time illustration, is formed to have and closed
The association in time illustration of keyword mark, on the basis of being played with the time as related information, increases the association of keyword；Broadcasting
Put current time association illustration, but arrive also in reproduction time this period of future time association illustration, occur memory or
Other situations, can transfer and play the picture that content is more matched, and be not limited solely to photo current；Various dimensions play illustration,
Make reading experience more preferably.
Embodiment 5
The audiobook illustration display systems of the present embodiment, the difference with embodiment 4 is, as shown in figure 5, further limit
Fixed, the monitoring module 103 also includes time record sub module 501；The illustration playing module 104 also includes former association in time
Illustration changes submodule 502；
The matching illustration changes submodule 403, is additionally operable to, when match time association illustration is changed, son be recorded to the time
Module 501 sends record time command；
The time record sub module 501, for receiving time recording instruction, when record changes match time association illustration
Reproduction time t, and start recording time t1, and by t1With preset time threshold t0Contrasted, worked as t1≥t0When, to the former time
Association illustration changes submodule 502 and sends the former association in time illustration instruction of replacing；
The former association in time illustration changes submodule 502, and former association in time illustration instruction is changed for receiving, and ought
Preceding y-th association in time illustration is replaced by x-th association in time illustration, i.e., the former time that should occur in the time phase
Association illustration.
The monitoring module 103 also includes that the time contrasts submodule 503, and the time record sub module 501 is additionally operable to
When record changes the time t of match time association illustration, time contrast instruction is sent to time contrast submodule 503；When described
Between contrast submodule 503, for receive the time to instruction, in t1＜ t0When to t+t1With next illustration timestamp tx+1It is right to carry out
Than when comparing result is t+t1＜ tx+1When, do not process；When comparing result is t+t1≥tx+1When, changed to association in time illustration
Submodule 303 sends changes future time association illustration instruction, i.e., without more gaining x-th association in time illustration, to lower a period of time
Between stab node, directly change next (x+1)th association in time illustration, and time record sub module 501 is sent terminate recording
Time command；The time record sub module 501, is additionally operable to receive and executive termination record time command.
The audiobook based on paper book Quick Response Code of the present embodiment obtains system, during record replacing match time association illustration
Reproduction time t, and start recording time t1, the reproduction time of control matching illustration, after reaching certain display time, by illustration more
Gain original association in time illustration；On the other hand, if in the effective period of time that matching illustration is played, reached next
The timing node that association in time illustration is changed, then directly change future time association illustration, and no longer timing is original without changing
Association in time illustration, make illustration play more rationalize, it is intelligent.
Embodiment 6
This implementation provides a kind of audiobook illustration methods of exhibiting, as shown in fig. 6, methods described comprises the following steps：
S1：Client 2 sends listens to audiobook instruction.
S2：The audiobook of listening to that management server 1 receives the transmission of client 2 is instructed, and plays audiobook audio, and monitor sound
The default illustration related information that frequency is played；
S3：When the default illustration related information in monitoring audio playing process, change respective associated illustration and broadcast
Put.
The audiobook illustration methods of exhibiting of the present embodiment, client can watch correlation while audiobook is listened to
Illustration, illustration flexibly shows, without complicated manufacturing process, strengthens reading experience.
Embodiment 7
A kind of audiobook illustration methods of exhibiting of this implementation, 6 differences with embodiment are, as shown in fig. 7, further limit
Fixed, the default related information includes timestamp tnInformation, methods described comprises the following steps：
S1：Client 2 sends listens to audiobook instruction；
S2：Listen to audiobook instruction, broadcasting audiobook audio, and the monitoring that management server 1 receives the transmission of client 2 are broadcast
Put time t；
S3：Reproduction time t >=t is monitored to working asn, current (n-1)th association in time illustration is replaced by n-th time and is closed
Connection illustration.
S4：The keyword that present video plays content is extracted, and searches for the association in time illustration with the Keywords matching,
S5：When the association in time illustration of matching is searched, to the timestamp t of currently playing former association in time illustrationx
The timestamp t of illustration is associated with match timeyJudged, worked as tx≤tyWhen, do not process；Work as tx＞ tyWhen, change with it is described
The association in time illustration of Keywords matching.
Audiobook illustration methods of exhibiting of the invention, with the time as related information and keyword is as related information, each is inserted
Figure all has unique time stamps and with crucial word association, when monitoring module monitors corresponding reproduction time, association in time is inserted
Figure carries out transferring replacing broadcasting, associates illustration current time is played, but do not arrive the reproduction time that future time associates illustration also
In this period, occurring recalling or other situations, can transfer and play the picture that content is more matched, be not limited solely to work as
Preceding picture；Various dimensions play illustration, make reading experience more preferably.
Embodiment 8
A kind of audiobook illustration methods of exhibiting of this implementation, 7 differences with embodiment are, as shown in figure 8, further limit
Fixed, methods described also comprises the following steps：
S6：When changing the association in time illustration with the Keywords matching, current play time t, and start recording are recorded
Time t1, and by t1With preset time threshold t0Contrasted, when monitoring t1≥t0When, illustration is replaced by former association in time and is inserted
Figure；
S7：In t1＜ t0In time period, to t+t1With next illustration timestamp tx+1Contrasted, when comparing result is t+t1
＜ tx+1When, do not process；When comparing result is t+t1≥tx+1When, future time association illustration is changed, and stop timing.
Audiobook illustration methods of exhibiting of the invention, the audiobook based on paper book Quick Response Code of the present embodiment obtains system,
Record changes reproduction time t during match time association illustration, and start recording time t1, during the broadcasting of control matching illustration
Between, after reaching certain display time, illustration is more gained original association in time illustration；On the other hand, if in matching illustration
In the effective period of time of broadcasting, the timing node that future time association illustration is changed is reached, then directly changed future time
Association illustration, no longer timing, without original association in time illustration is changed, makes illustration play more rationalization, intellectuality.
Claims (10)
1. a kind of audiobook illustration display systems, it is characterised in that the display systems include：Management server (1) and client
End (2), the management server (1) includes：Webpage provides module (101), audio management module (102), illustration relating module
(106), monitoring module (103), illustration playing module (104) and memory module (105)；
The webpage provides module (101), and the audiobook of listening to for receiving client (2) transmission is instructed, there is provided audiobook is broadcast
Details page is put, and after client (2) sends and plays audiobook instruction, is sent to audio management module (102) and is played audio
Instruction；
The audio management module (102), chapters and sections information and reproduction time information for managing audiobook data are received and played
Audio instructions, while playing audio, the default illustration related information for sending monitoring audio broadcasting to monitoring module (103) refers to
Order；
The illustration relating module (106), for illustration to be associated with default illustration related information, forms multiple associations and inserts
Figure, and it is stored in memory module (105)；
The monitoring module (103), for receiving the default illustration related information instruction that monitoring audio is played, when monitoring broadcasting
During default illustration related information when, sent to illustration playing module (104) and change respective associated illustration and instruct；
The illustration playing module (104), changes the instruction of respective associated illustration, and adjusted in memory module (105) for receiving
Take with default illustration related information to corresponding association illustration, carry out replacing broadcasting；
The memory module (105), for storing voice data, illustration data and associating illustration data.
2. audiobook illustration display systems as claimed in claim 2, it is characterised in that the client (2) includes that network is handed over
Mutual module (201), player module (203), monitoring module (204), illustration display module (205) and data memory module
(202), the management server (1) also includes data transmission module (206)；The webpage provides module (101), is additionally operable to connect
The download audiobook instruction that client (2) sends is received, transmission data command is sent to data transmission module (206)；
The data transmission module (206), for receiving transmission data command, voice data is transferred in memory module (105)
With associate illustration data, be sent to network interaction module (201)；
The network interaction module (201), sends download audiobook instruction, and receive number for providing module (101) to webpage
The voice data transmitted according to transport module (206) with associate illustration data, and be stored in data memory module (202)；
The player module (203), for the voice data in called data memory module (202), and plays out sound
Book audio, and send monitoring instruction to module (204) is monitored；
Monitoring module (204), monitors instruction, and the default illustration related information that audio is played is supervised for receiving
Control, when default illustration related information is monitored, sends displaying respective associated illustration and instructs to illustration display module (205)；
The illustration display module (205), for receiving the illustration instruction of displaying respective associated, and respective associated illustration is illustrated in
Client (2)；
The data memory module (202), for storing voice data and associating illustration data.
3. audiobook illustration display systems as claimed in claim 1 or 2, it is characterised in that the default illustration related information
Including timestamp tnInformation；The illustration relating module (106) includes association in time submodule (301), association in time
Module (301), for illustration and Preset Time to be stabbed into tnIt is associated, forms n association in time illustration, and be stored in storage mould
Block (105)；
The monitoring module (103) includes time monitoring submodule (302), for monitoring reproduction time t, when broadcasting is monitored
Between t >=tnWhen, change submodule (303) to association in time illustration and send the corresponding n-th association in time illustration instruction of replacing；
The illustration playing module (104) changes submodule (303) including association in time illustration, and corresponding n-th is changed for receiving
Individual association in time illustration instruction, and current (n-1)th association in time illustration is replaced by n-th association in time illustration；
The audio management module (102), while being additionally operable to play audio, sends to time monitoring submodule (302) and monitors
The instruction of reproduction time t.
4. audiobook illustration display systems as claimed in claim 3, it is characterised in that the default illustration related information is also wrapped
Key word information is included, the illustration relating module (106) also includes keyword tag submodule (404), for by association in time
The association in time illustration that submodule (301) is formed carries out keyword tag, forms the association in time illustration with keyword tag,
And store to memory module (105)；
The audio management module (102), while being additionally operable to play audio, sends to keyword search submodule (401) and carries
Take keyword instruction；
The monitoring module (103) also includes keyword search submodule (401) and timestamp judging submodule (402)；It is described
Keyword search submodule (401), extract present video play content keyword, and search for the Keywords matching when
Between associate illustration, when the association in time illustration of matching is searched, to timestamp judging submodule (402) send timestamp judge
Instruction；The timestamp judging submodule (402), for receiving timestamp decision instruction, to currently playing former association in time
The timestamp t of illustrationxThe timestamp t of illustration is associated with match timeyJudged, worked as tx≤tyWhen, do not process；Work as tx＞ ty
When, change the instruction that submodule (403) sends replacing and the association in time illustration of the Keywords matching to matching illustration；
The illustration playing module (104) also includes that matching illustration changes submodule (403), is changed and the key for receiving
The association in time illustration instruction of word matching, transfers the association in time illustration in memory module (105), and by current x-th time
Association illustration is replaced by y-th association in time illustration.
5. audiobook illustration display systems as claimed in claim 4, it is characterised in that the monitoring module (103) also includes
Time record sub module (501)；The illustration playing module (104) also includes that former association in time illustration changes submodule (502)；
The matching illustration changes submodule (403), is additionally operable to, when match time association illustration is changed, submodule be recorded to the time
Block (501) sends record time command；
The time record sub module (501), for receiving time recording instruction, during record replacing match time association illustration
Reproduction time t, and start recording time t1, and by t1With preset time threshold t0Contrasted, worked as t1≥t0When, closed to the former time
Connection illustration changes submodule (502) and sends the former association in time illustration instruction of replacing；
The former association in time illustration changes submodule (502), and former association in time illustration instruction is changed for receiving, and will be current
Y-th association in time illustration is replaced by x-th association in time illustration.
6. audiobook illustration display systems as described in right wants 5, it is characterised in that when the monitoring module (103) also includes
Between contrast submodule (503), the time record sub module (501) is additionally operable to change match time association illustration in record
During time t, contrast submodule (503) to the time and send time contrast instruction；The time contrasts submodule (503), for connecing
To instruction between the time receiving, in t1＜ t0When to t+t1With next illustration timestamp tx+1Contrasted, when comparing result is t+t1＜ tx+1
When, do not process；When comparing result is t+t1≥tx+1When, change submodule (303) transmission to association in time illustration and change next
Association in time illustration is instructed, and termination record time command is sent to time record sub module (501)；The time records submodule
Block (501), is additionally operable to receive and executive termination record time command.
7. a kind of audiobook illustration methods of exhibiting, it is characterised in that methods described comprises the following steps：
S1：Client (2) sends listens to audiobook instruction；
S2：The audiobook of listening to that management server (1) receives client (2) transmission is instructed, and plays audiobook audio, and monitor sound
The default illustration related information that frequency is played；
S3：When the default illustration related information in monitoring audio playing process, change respective associated illustration and play out.
8. audiobook illustration methods of exhibiting as claimed in claim 6, it is characterised in that the default related information includes the time
Stamp tnInformation, methods described comprises the following steps：
S1：Client (2) sends listens to audiobook instruction；
S2：Listen to audiobook instruction, broadcasting audiobook audio, and the monitoring that management server (1) receives client (2) transmission are broadcast
Put time t；
S3：Reproduction time t >=t is monitored to working asn, current (n-1)th association in time illustration is replaced by n-th association in time and is inserted
Figure.
9. audiobook illustration methods of exhibiting as claimed in claim 7, it is characterised in that the default related information also includes closing
Keyword information, methods described also comprises the following steps：
S2 steps also include：The keyword that present video plays content is extracted, and searches for the time pass with the Keywords matching
Join the content of illustration,
S5：When the association in time illustration of matching is searched, to the timestamp t of currently playing former association in time illustrationxWith match
The timestamp t of association in time illustrationyJudged, worked as tx≤tyWhen, do not process；Work as tx＞ tyWhen, change and the keyword
The association in time illustration of matching.
10. audiobook illustration methods of exhibiting as claimed in claim 7, it is characterised in that methods described also comprises the following steps：
S6：When changing the association in time illustration with the Keywords matching, current play time t, and start recording time are recorded
t1, and by t1With preset time threshold t0Contrasted, when monitoring t1≥t0When, illustration is replaced by former association in time illustration；
S7：In t1＜ t0In time period, to t+t1With next illustration timestamp tx+1Contrasted, when comparing result is t+t1＜ tx+1
When, do not process；When comparing result is t+t1≥tx+1When, future time association illustration is changed, and stop timing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710055210.4A CN106844679B (en) | 2017-01-24 | 2017-01-24 | System and method for displaying audio book illustration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710055210.4A CN106844679B (en) | 2017-01-24 | 2017-01-24 | System and method for displaying audio book illustration |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106844679A true CN106844679A (en) | 2017-06-13 |
| CN106844679B CN106844679B (en) | 2021-01-22 |
Family
ID=59120495
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710055210.4A Active CN106844679B (en) | 2017-01-24 | 2017-01-24 | System and method for displaying audio book illustration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106844679B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110717066A (en) * | 2019-10-11 | 2020-01-21 | 掌阅科技股份有限公司 | Intelligent searching method based on audio electronic book and electronic equipment |
| CN110825482A (en) * | 2019-11-07 | 2020-02-21 | 网易（杭州）网络有限公司 | Method and device for processing illustration, electronic equipment and storage medium |
| CN113391866A (en) * | 2021-06-15 | 2021-09-14 | 亿览在线网络技术（北京）有限公司 | Interface display method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917329A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Network player and server for providing search service |
| CN102081941A (en) * | 2009-11-30 | 2011-06-01 | 天瀚科技股份有限公司 | Method of processing audio-video data in an E-book reader |
| CN103177611A (en) * | 2011-12-23 | 2013-06-26 | 李云峰 | Method for realizing multimedia courseware on E-ink book |
| CN103177032A (en) * | 2011-12-23 | 2013-06-26 | 李云峰 | Method for converting existing multi-media tutorials into e-book multi-media files |
| KR20140131023A (en) * | 2013-05-03 | 2014-11-12 | 정기태 | Systeme for supplying image and sound of book reading |
| US20150138385A1 (en) * | 2013-11-18 | 2015-05-21 | Heekwan Kim | Digital annotation-based visual recognition book pronunciation system and related method of operation |
| CN105869447A (en) * | 2016-03-30 | 2016-08-17 | 乐视控股（北京）有限公司 | Generating method and device of audiobook |
| CN106128486A (en) * | 2016-06-15 | 2016-11-16 | 深圳市贝美互动科技有限公司 | Electronics paints this player method and system, electronics paints this terminal, audio-frequency playing terminal |
-
2017
- 2017-01-24 CN CN201710055210.4A patent/CN106844679B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102081941A (en) * | 2009-11-30 | 2011-06-01 | 天瀚科技股份有限公司 | Method of processing audio-video data in an E-book reader |
| CN101917329A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Network player and server for providing search service |
| CN103177611A (en) * | 2011-12-23 | 2013-06-26 | 李云峰 | Method for realizing multimedia courseware on E-ink book |
| CN103177032A (en) * | 2011-12-23 | 2013-06-26 | 李云峰 | Method for converting existing multi-media tutorials into e-book multi-media files |
| KR20140131023A (en) * | 2013-05-03 | 2014-11-12 | 정기태 | Systeme for supplying image and sound of book reading |
| US20150138385A1 (en) * | 2013-11-18 | 2015-05-21 | Heekwan Kim | Digital annotation-based visual recognition book pronunciation system and related method of operation |
| CN105869447A (en) * | 2016-03-30 | 2016-08-17 | 乐视控股（北京）有限公司 | Generating method and device of audiobook |
| CN106128486A (en) * | 2016-06-15 | 2016-11-16 | 深圳市贝美互动科技有限公司 | Electronics paints this player method and system, electronics paints this terminal, audio-frequency playing terminal |
Non-Patent Citations (2)
| Title |
|---|
| SMPTE: ""RP 25:2011 - SMPTE Recommended Practice - Audio and Picture Synchronization in Motion-Picture Film Relative to Leaders for Television and Theatrical Presentation for Analog Magnetic and Photographic Records"", 《HTTPS://IEEEXPLORE.IEEE.ORG/SERVLET/OPAC?PUNUMBER=7290946》 * |
| 马仕骅: ""新媒体作品中实时音频信号与视频信号的关联性初探"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110717066A (en) * | 2019-10-11 | 2020-01-21 | 掌阅科技股份有限公司 | Intelligent searching method based on audio electronic book and electronic equipment |
| CN110825482A (en) * | 2019-11-07 | 2020-02-21 | 网易（杭州）网络有限公司 | Method and device for processing illustration, electronic equipment and storage medium |
| CN110825482B (en) * | 2019-11-07 | 2023-05-26 | 网易（杭州）网络有限公司 | Method and device for processing illustration, electronic equipment and storage medium |
| CN113391866A (en) * | 2021-06-15 | 2021-09-14 | 亿览在线网络技术（北京）有限公司 | Interface display method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106844679B (en) | 2021-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11768872B2 (en) | Apparatus, systems and methods for media content searching | |
| EP2406732B1 (en) | Bookmarking system | |
| US9936260B2 (en) | Content reproduction method and apparatus in IPTV terminal | |
| CN106847315A (en) | A kind of talking book synchronous methods of exhibiting sentence by sentence | |
| US8391455B2 (en) | Method and system for live collaborative tagging of audio conferences | |
| CN108702537A (en) | The system of the video playback of inventory for using server generation | |
| CN105120304A (en) | Information display method, device and system | |
| US8768744B2 (en) | Method and apparatus for automated user review of media content in a mobile communication device | |
| US9311918B2 (en) | Automated communication techniques | |
| MX2014008657A (en) | Receiving device, receiving method, program, and information processing system. | |
| US10334302B2 (en) | Method and system for segment based recording | |
| CN101595724A (en) | The broadcast system that utilizes local electronic service guide to generate | |
| CN106844679A (en) | A kind of audiobook illustration display systems and method | |
| JP2004030327A (en) | Device and method for providing contents-related information, electronic bulletin board system and computer program | |
| CN103650482A (en) | Method for transmitting and receiving broadcast service and receiving device thereof | |
| CN112383790A (en) | Live broadcast screen recording method and device, electronic equipment and storage medium | |
| CN101365134B (en) | Frame specifying method | |
| EP2373005A1 (en) | Method for notifying a user about a broadcast event | |
| EP3738287B1 (en) | Content matching system | |
| CN106488274A (en) | The program inventory generation method of multimedia terminal and system | |
| JP2003169312A5 (en) | ||
| JP2016213709A (en) | Moving image reproduction system, client device, server device, and program | |
| CN105704512A (en) | Video capturing system and video capturing method thereof | |
| CN101421709A (en) | User system providing previews of a user's media collection to an associated portable media player | |
| CN105049890B (en) | A kind of method for pushing and device of new advertisement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |