CN110337041A

CN110337041A - Video broadcasting method, device, computer equipment and storage medium

Info

Publication number: CN110337041A
Application number: CN201910627928.5A
Authority: CN
Inventors: 蒋伟
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-07-12
Filing date: 2019-07-12
Publication date: 2019-10-15
Anticipated expiration: 2039-07-12
Also published as: CN110337041B

Abstract

The application is about a kind of video broadcasting method, device, computer equipment and storage medium.Audio is read this method comprises: playing, the audio of reading is the speech audio that voice reads target article；The first keyword in the target article is obtained, first keyword is keyword corresponding with the reading playback progress of audio；Video playing instruction is sent to Video Applications according to first keyword, the video playing instruction is used to indicate the Video Applications and plays video corresponding with first keyword.This programme realizes the scene built in target article with visual form, to extend the mode built to the scene of article, improves the expression effect to the scene of verbal description.

Description

Video broadcasting method, device, computer equipment and storage medium

Technical field

The invention relates to audiovisual applications technical field, in particular to a kind of video broadcasting method, device, calculating Machine equipment and storage medium.

Background technique

Talking e-book is a kind of novel e-book reading application, can pass through true man's sound or electronic synthesis sound The form of sound plays the word content in article.

In the related art, the construction of some artistic conceptions would generally be added in the talking e-book that user listens to, such as the suppression of word speed Pause and transition in rhythm or melody etc. is raised to build the scene of verbal description, reaches spectacular purpose.For example, the service provider of talking e-book passes through specially The personnel that dub of industry read article, and record the sound when personnel that dub read and obtain reading audio.

However, scheme shown in the relevant technologies constructs one only by the personnel of dubbing when reading is dubbed to read sound Fixed scene, the application range built to the corresponding scene artistic conception of article is smaller, leads to the table to the scene of verbal description It is poor up to effect.

Summary of the invention

The embodiment of the present application provides a kind of video broadcasting method, device, computer equipment and storage medium method, dress It sets, computer equipment and storage medium, the mode built to the scene of article can be extended, improve the field to verbal description The expression effect of scape, the technical solution are as follows:

On the one hand, a kind of video broadcasting method is provided, the method is executed by computer equipment, which comprises

It plays and reads audio, the audio of reading is the speech audio that voice reads target article；

Obtain the first keyword in the target article, first keyword be with the broadcasting for reading audio into Spend corresponding keyword；

Video playing instruction is sent to Video Applications according to first keyword, the video playing instruction is used to indicate The Video Applications play video corresponding with first keyword.

On the other hand, a kind of video broadcasting method is provided, the method is executed by computer equipment, the method packet It includes:

Text exhibition interface includes text corresponding with the reading playback progress of audio in the text interface；

When receiving the video playing trigger action to the execution of text shown in the text interface, Video Applications are triggered Video corresponding with the first keyword in the target article is played, first keyword is and the reading audio The corresponding keyword of playback progress；

During the Video Applications play video corresponding with first keyword, read described in pause broadcasting Pronunciation frequency.

On the other hand, a kind of video play device is provided, in computer equipment, described device to include:

Audio playing module reads audio for playing, and the audio of reading is the voice sound that voice reads target article Frequently；

Keyword obtains module, for obtaining the first keyword in the target article, first keyword be with The corresponding keyword of playback progress for reading audio；

Instruction sending module, for sending video playing instruction, the view to Video Applications according to first keyword Frequency play instruction is used to indicate the Video Applications and plays video corresponding with first keyword.

Optionally, keyword obtains module, is used for,

Obtain the current play time stamp of the reading audio；

Obtain first keyword corresponding with current play time stamp.

Optionally, when obtaining with the current play time corresponding first keyword of stamp, keyword obtains module, For,

It is stabbed according to the current play time, obtains specified play time section, which is to broadcast in this prior After putting timestamp, and between current play time stamp when a length of specified duration period；

By in the target article, the keyword that reading time is in the specified play time section is retrieved as first key Word.

Optionally, keyword obtains module, is used for,

It determines in the target article, target paragraph corresponding with the playback progress of the reading audio；

The keyword for including in the target paragraph is retrieved as first keyword.

Optionally, keyword obtains module, is used for,

Text exhibition interface includes text corresponding with the playback progress of the reading audio in text interface；

When receiving the video playing trigger action to the execution of text shown in text interface, acquisition is broadcast with the video Put corresponding first keyword of trigger action.

Optionally, the instruction sending module, is used for

The first play instruction comprising first keyword is sent to the Video Applications, which is used to indicate The Video Applications are searched for video corresponding with first keyword and are played；

Alternatively,

Video corresponding with first keyword is searched for, search result is obtained；It sends to the Video Applications and is searched comprising this The second play instruction of hitch fruit, second play instruction be used to indicate the Video Applications according to the search result play with this The corresponding video of one keyword.

Optionally, video corresponding with first keyword is being searched for, before obtaining search result, which sends mould Block is also used to,

The second keyword in the target article is obtained, which is the upper and lower of paragraph where first keyword Keyword in text；

Video corresponding with first keyword is being searched for, when obtaining search result, which is used for,

It is scanned for using first keyword as search key, obtains at least one matched video；

At least one video is screened according to second keyword, obtains view corresponding with first keyword Frequently.

It optionally, also include the second keyword in first play instruction, which is first keyword Keyword in the context of place paragraph.

Optionally, the device further include:

Suspend module, for suspending during the Video Applications play video corresponding with first keyword Play the reading audio.

Optionally, the device further include:

Triggering mode obtains module, for obtaining first keyword before suspending the module pause broadcasting reading audio Triggering mode, the triggering mode include user's operation triggering or automatic trigger；

The pause module, for when the triggering mode be user's operation trigger when, execute should the Video Applications play with During the corresponding video of first keyword, suspend the step of playing the reading audio.

Optionally, above-mentioned computer equipment is terminal, which is the application in the terminal；

Alternatively,

The Video Applications are mounted in the application in other terminals except the terminal.

On the other hand, a kind of computer equipment is provided, the computer equipment includes processor and memory, described to deposit Be stored at least one instruction, at least a Duan Chengxu, code set or instruction set in reservoir, at least one instruction, it is described extremely A few Duan Chengxu, the code set or instruction set are loaded by the processor and are executed to realize video playing side as described above Method.

On the other hand, a kind of computer readable storage medium is provided, at least one finger is stored in the storage medium Enable, at least a Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, the code set or Instruction set is loaded by processor and is executed to realize video broadcasting method as described above.

Technical solution provided by the present application can include the following benefits:

By obtaining the first keyword corresponding with the playback progress of the reading audio when playing reading audio, and It indicates that Video Applications play video corresponding with first keyword, realizes the field built in target article with visual form Scape improves the expression effect to the scene of verbal description to extend the mode built to the scene of article.

It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The application can be limited.

Detailed description of the invention

The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the application Example, and together with specification it is used to explain the principle of the application.

Fig. 1 is a kind of system architecture diagram for audio/video player system that each embodiment of the application is related to；

Fig. 2 is a kind of flow chart of video broadcasting method shown according to an exemplary embodiment；

Fig. 3 is the schematic diagram for the video playing process that embodiment illustrated in fig. 2 is related to；

Fig. 4 is a kind of flow chart of video broadcasting method shown according to an exemplary embodiment；

Fig. 5 is a kind of video playing flow diagram that embodiment illustrated in fig. 4 is related to；

Fig. 6 is a kind of video that embodiment illustrated in fig. 4 is related to and the broadcasting logical schematic for reading audio；

Fig. 7 is a kind of flow chart of video broadcasting method shown according to an exemplary embodiment；

Fig. 8 is a kind of video playing flow diagram that embodiment illustrated in fig. 7 is related to；

Fig. 9 is the audio playing flow schematic diagram of talking e-book application shown according to an exemplary embodiment；

Figure 10 is the structural block diagram of video play device shown according to an exemplary embodiment；

Figure 11 is a kind of structural schematic diagram of computer equipment shown according to an exemplary embodiment.

Specific embodiment

Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the application.

The embodiment of the present application proposes a kind of scheme that video is played during playing and reading audio, and the program can According to the reading progress for reading audio, control plays the video to match with current reading progress, to build compared to sound More intuitive artistic conception impression.

Referring to FIG. 1, a kind of system architecture diagram for the audio/video player system being related to it illustrates each embodiment of the application. As shown in Figure 1, the audio/video player system includes first terminal 110 and server 120.

First terminal 110 can be the terminal device with sound-playing function, for example, first terminal 110 can be hand Machine, tablet computer, E-book reader, smart glasses, smart watches, MP3 player (Moving Picture Experts Group Audio Layer III, dynamic image expert's compression standard audio level 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert's compression standard audio level 4) it is player, on knee portable Computer and desktop computer etc.；Alternatively, first terminal 110 is also possible to smart home device, for example, smart television or Smart television set top box etc..

It include talking e-book application in first terminal 110.

It optionally, also include Video Applications in first terminal 110.

It optionally, also include second to be connected between first terminal 110 by communication network in the audio/video player system Terminal 130.It include Video Applications in the second terminal 130.

Wherein, above-mentioned second terminal 130 can be the terminal of same type with first terminal 110, for example, first terminal 110 and second terminal 130 can all be mobile phone.Alternatively, above-mentioned second terminal 130 is also possible to inhomogeneity with first terminal 110 The terminal of type；For example, above-mentioned first terminal 110 can be mobile phone, above-mentioned second terminal 130 can be smart television or intelligence TV set-top box etc..

Server 120 can be a server, or the server cluster being made of several servers, either One virtual platform or a cloud computing service center.

Optionally, corresponding server is applied comprising talking e-book in above-mentioned server 120.

It optionally, include the corresponding server of Video Applications in above-mentioned server 120.

It is connected between first terminal 110 and server 120 by communication network.Optionally, which is wired network Network or wireless network.

Optionally, above-mentioned wireless network or cable network use standard communication techniques and/or agreement.Network be usually because Special net, it may also be any network, including but not limited to local area network (Local Area Network, LAN), Metropolitan Area Network (MAN) (Metropolitan Area Network, MAN), wide area network (Wide Area Network, WAN), mobile, wired or nothing Any combination of gauze network, dedicated network or Virtual Private Network).In some embodiments, using including hypertext markup Language (Hyper Text Mark-up Language, HTML), extensible markup language (Extensible Markup Language, XML) etc. technology and/or format represent the data by network exchange.It additionally can be used such as safe Socket layer (Secure Socket Layer, SSL), Transport Layer Security (Transport Layer Security, TLS), void Quasi- dedicated network (Virtual Private Network, VPN), Internet Protocol Security (Internet Protocol Security, IPsec) etc. conventional encryption techniques encrypt all or some links.In further embodiments, can also make Replace or supplement above-mentioned data communication technology with customization and/or the exclusive data communication technology.

People receives extraneous knowledge form and mainly passes through the sense of hearing and vision, and current talking e-book is all to pass through the sense of hearing (reading audio) replaces vision (text interface) to show article content to user, although the sense of hearing can enrich people's from sense organ Imagination allows user to construct the scene in book by imagining while listening to reading video, reaches and digest, deep body The purpose of meeting.But many times, visual impact is the scene that article more can be really embodied than the imagination of user.

Scheme shown in the application subsequent embodiment combines both the sense of hearing (reading audio) and vision (video), Under most of usage scenarios, user can be the scene imagined in article by the sense of hearing.In part scene, in The Lord of the Rings Five armies battlefield scape under, pass through the construction of itself imagination and the modulation in tone of text, it is difficult to reach visual impact force, At this point, terminal can optimize this reading experience by video, for example, by text search video, search five armies it The war segment of the vidclip of war or other great impact forces is simultaneously played, and allows users to deepen the reason to text Solution, to improve the expression effect to scene described in article.The product form of the sense of hearing+vision provided by the present application, Quan Fang The sensory experience of user is enriched in position, brings user's Product Experience for being better than competing product, and the influence power and market that can expand product account for There is rate.

Fig. 2 is a kind of flow chart of video broadcasting method shown according to an exemplary embodiment, the video broadcasting method It can be executed by computer equipment, for example, this method the terminal (such as first terminal) in system can execute as shown in Figure 1, or Person, this method the server in system can execute as shown in Figure 1, alternatively, the terminal that this method can also as shown in Figure 1 in system It is executed jointly with server.The embodiment of the present application is by taking above-mentioned video broadcasting method is executed by terminal as an example, as shown in Fig. 2, the party Method may include steps of:

Step 21, it plays and reads audio, which is the speech audio that voice reads target article.

Step 22, the first keyword in the target article is obtained, which is the broadcasting with the reading audio The corresponding keyword of progress.

Step 22, video playing instruction is sent to Video Applications according to first keyword, video playing instruction is used for Indicate that the Video Applications play video corresponding with first keyword.

In the embodiment of the present application, above-mentioned Video Applications, which can be, plays the terminal for reading audio (than first as shown in figure 1 Terminal) in install Video Applications, alternatively, above-mentioned Video Applications are also possible to other terminals except the terminal, (ratio is as shown in figure 1 Second terminal) in install application.

For example, in one possible implementation, the application interface of talking e-book application is shown in the screen of terminal A, also, talking e-book is applied to play at application interface a and reads audio.The talking e-book application, which is got, currently reads After corresponding first keyword of the playback progress of pronunciation frequency, the Video Applications that can be installed into terminal send instruction, later, The screen of terminal jumps the application interface b of display Video Applications, and Video Applications play and first key in application interface b The corresponding video of word.

Alternatively, terminal can also indicate that the Video Applications installed in other terminals in alternatively possible implementation Play the above-mentioned corresponding video of first keyword.It is broadcast at application interface a for example, the talking e-book in terminal A is applied Put reading audio.After the talking e-book application gets current corresponding first keyword of playback progress for reading audio, Video Applications into terminal B send instruction, and the screen of terminal B jumps the application interface c of display Video Applications, and Video Applications exist Video corresponding with first keyword is played in application interface c.

For example, referring to FIG. 3, it illustrates the invention relates to video playing process schematic diagram.When above-mentioned It is intelligence with other terminals when Video Applications are the Video Applications installed in the other terminals played except the terminal for reading audio For energy TV, scheme shown in Fig. 3 be can be such that

31) during playing reading audio, terminal judges whether to connect smart television；If so, 32 are entered step, Otherwise terminate process.

32) terminal judges whether to trigger video search, if so, otherwise terminating process into 33).

33) whether the Video Applications in smart television search video, if so, entering step 34, otherwise terminate process.

34) Video Applications in smart television play the video searched.

For example, user, during listening to storytelling, talking e-book application can connect in the smart television in parlor in search automatically The Video Applications of installation, when user is not content with simple text sound to some reading scene or terminal is automatic When triggering video playing, so that it may trigger the operation of text search video.Talking e-book application sends an instruction to intelligent electricity Video Applications side depending in, Video Applications show the video for being best suitable for scene according to instruction, for user's appreciation.

In conclusion terminal is available to read with this when playing reading audio in scheme shown in the embodiment of the present application Corresponding first keyword of the playback progress of pronunciation frequency, and indicate that Video Applications play view corresponding with first keyword Frequently, the scene built in target article with visual form is realized, so that the mode built to the scene of article is extended, Improve the expression effect to the scene of verbal description.

In scheme shown in above-mentioned embodiment illustrated in fig. 2, need according to the corresponding video of the first keyword search, the basis The process of the corresponding video of first keyword search, can be executed by Video Applications, i.e., Video Applications are searched according to the first keyword Rope is to corresponding video and plays out；It, can also be alternatively, the above-mentioned process according to the corresponding video of the first keyword search (such as by talking e-book application execution) is executed except Video Applications, i.e., terminal is according to the first keyword search to corresponding view After frequency, search result is notified to be played out to Video Applications by Video Applications.The application subsequent embodiment by respectively to this two The implementation of kind video search is introduced.

Fig. 4 is a kind of flow chart of video broadcasting method shown according to an exemplary embodiment, the video broadcasting method It can be executed by computer equipment, for example, this method the terminal (such as first terminal) in system can execute as shown in Figure 1, or Person, this method can be executed by the server of above-mentioned system shown in Figure 1, alternatively, the end that this method can also as shown in Figure 1 in system End and server execute jointly.The embodiment of the present application is executed with above-mentioned video broadcasting method by terminal, and is wherein closed according to first For the process that keyword searches for corresponding video is executed by Video Applications, as shown in figure 4, this method may include steps of:

Step 401, it plays and reads audio, which is the speech audio that voice reads target article.

In the embodiment of the present application, talking e-book application can be installed, which applies on foreground in terminal When operation, user can select to play the reading audio of target article in the application interface that the talking e-book is applied, at this point, The reading audio for the target article that terminal can be selected from the acoustic-electric philosophical works using corresponding server or local acquisition user, And talking e-book application plays out.

Step 402, the first keyword in the target article is obtained, which is the broadcasting with the reading audio The corresponding keyword of progress.

In the embodiment of the present application, for user when using talking e-book, user can be by triggering video search manually The step of (i.e. triggering obtain the target article in the first keyword), with when needing to watch video trigger build article meaning The video playing in border.However, also having many times, user is listened to storytelling under the scene for being busy with other work, fully relies on use at this time The scheme that video playing is triggered at family manually is just unable to satisfy user demand.In order to meet the needs of different users, the application is implemented In scheme shown in example, the switch of an automatic trigger video playing can be provided for user, as long as user opens the switch, Then terminal can by the text point (i.e. keyword) that marks in advance, or the text point voluntarily extracted, go automatic trigger this Video search process, it is full-automatic to go to show broadcasting video for user；And if user closes the switch, can by with The dynamic triggering video playing of householder.

Wherein, the mode that terminal obtains the first keyword can include but is not limited to following three kinds:

One, terminal can stab according to play time and directly acquire corresponding first keyword.

For example, terminal, during playing reading audio, the current play time of the available reading audio stabs；And Obtain first keyword corresponding with current play time stamp.

In one possible implementation, when the operation maintenance personnel of talking e-book application marks in target article in advance When having keyword, the keyword of label can be tied up with triggering by the play time stamp that keyword carries out video search Fixed, when the current time stamp of terminal plays is the timestamp for being bundled with keyword, terminal can be directly by current play time The keyword of stamp binding is retrieved as above-mentioned first keyword.

It wherein, can basis when the keyword of current play time stamp binding is retrieved as above-mentioned first keyword by terminal In corresponding relationship between the timestamp and keyword of terminal local storage, above-mentioned first keyword is inquired, wherein the timestamp When corresponding relationship between keyword can be the audio file of the above-mentioned reading audio of talking e-book application downloading, from service Device is downloaded and stored at local together.

Alternatively, the corresponding relationship between above-mentioned timestamp and keyword also can store the service in talking e-book application In device, terminal can also to talking e-book apply server send include current time stamp inquiry instruction, server from In corresponding relationship between above-mentioned timestamp and keyword, inquiry obtains the first keyword and feeds back to terminal.

In alternatively possible implementation, first keyword corresponding with current play time stamp is being obtained When, terminal can be stabbed according to the current play time, obtain specified play time section, which is in this prior After play time stamp, and between current play time stamp when a length of specified duration period；And by the target In article, the keyword that reading time is in the specified play time section is retrieved as first keyword.

Due to from triggering search video to play video usually require by search, downloading and play and etc., There may be certain delays, therefore, in order to make the video of playback progress and broadcasting match as far as possible, in the application reality It applies in example, when terminal automatic trigger (such as automatic trigger according to the preset time interval), or triggers broadcasting manually by user Video, then terminal obtain target article in the first keyword when, can from current play time stamp after a certain section when Interior acquisition the first keyword triggers video search with this in advance, so as in video playing, so that the meaning that video is built Border matches with the playback progress for reading audio, to improve the effect of artistic conception construction.

For example, can be incited somebody to action when the operation maintenance personnel of talking e-book application marks related keyword in target article in advance The keyword of label is bound with the keyword in the play time stamp read in audio, in the mistake for playing above-mentioned reading audio Cheng Zhong, terminal periodically obtain (for example, obtaining for every 10 seconds primary) current play time by talking e-book reader Stamp (assuming that current play time stamp is 00:56:20), then stabs according to current play time and obtains between current play time stamp When a length of 5s (corresponding above-mentioned specified duration), time span is the specified play time section of 10s, the specified play time section For (00:56:25,00:56:35), then, terminal obtain read the play time stamp in audio in (00:56:25,00: Keyword within 56:35), there are keywords in the period (00:56:25,00:56:35), then are retrieved as the keyword First keyword.

Above scheme is illustrated for handmarking's keyword in target article in advance by operation maintenance personnel, optionally, Keyword in above-mentioned target article can also be marked automatically by preparatory trained machine learning model.

Wherein, the duration of above-mentioned specified duration and specified play time section, can be developer or user is preparatory The duration of setting.

Alternatively, the delay that above-mentioned specified duration is also possible between the server that terminal is applied according to talking e-book is true Fixed duration.

Two, terminal can obtain corresponding keyword according to when previous paragraphs.

For example, terminal can determine in the target article, during playing reading audio with broadcasting for the reading audio The corresponding target paragraph of degree of putting into；The keyword for including in the target paragraph is retrieved as first keyword.

In one possible implementation, talking e-book is applied when playing reading audio, if automatic trigger (ratio Such as start the reading audio of one new paragraph of broadcasting), video is played alternatively, being triggered manually by user, then terminal can determine It is currently playing to target article in paragraph, the first keyword is obtained from determining paragraph.

Wherein, which can be the keyword that terminal is extracted from paragraph, be also possible to talking e-book The keyword that the operation maintenance personnel of application marks in the paragraph in advance in advance.

For example, terminal determines the corresponding paragraph of currently playing progress for reading audio in a possible implementation Afterwards, the text in the paragraph is extracted, and above-mentioned first keyword is extracted from the paragraph by keyword extraction algorithm.

Alternatively, can be incited somebody to action when the operation maintenance personnel of talking e-book application marks related keyword in target article in advance The keyword of label and the paragraph mark where keyword are bound, when terminal determines the currently playing progress pair of reading audio It after the paragraph answered, can be identified according to the corresponding paragraph of currently playing progress, inquire first key in local or server Word.

Three, terminal can also determine corresponding keyword depending on the user's operation.

For example, terminal play read audio during, with text exhibition interface, in text interface can include and this Read the corresponding text of playback progress of audio；Receive the video playing touching executed to text shown in text interface When hair operation, first keyword corresponding with the video playing trigger action is obtained.

In one possible implementation, above-mentioned first keyword can voluntarily be selected by user.For example, above-mentioned text In text in interface, the part for being marked as keyword can highlight (ratio is if any underscore or the color that has powerful connections), At this point, user triggers video playing if necessary, then highlighted text can be clicked, terminal is corresponding by user's clicking operation Text be retrieved as the first keyword.

Alternatively, user can directly select text circle by Text Select operation in alternatively possible implementation Text in face, for example, after user chooses the text in text interface, popup menu column may include " search in menu bar Video " option, if user, which clicks, is somebody's turn to do " search video " option, selected text can be retrieved as above-mentioned first and closed by terminal Keyword, alternatively, extracting first keyword from selected text by keyword extraction algorithm.

Step 403, the first play instruction comprising first keyword, first play instruction are sent to the Video Applications The Video Applications are used to indicate to search for video corresponding with first keyword and play.

Wherein, which is the application played in the terminal for reading audio；Alternatively, the Video Applications are mounted in this The application in other terminals except terminal.

In the embodiment of the present application, Video Applications can externally provide calling interface, and talking e-book application can call First keyword is sent to Video Applications by instruction, after Video Applications receive the instruction, according to the by above-mentioned calling interface One keyword is searched for matched video and is played out from the corresponding server of Video Applications.

It is the keyword that backstage marks in advance with each keyword in above-mentioned target article, Video Applications are smart televisions For the Video Applications of middle installation, the software frame of entire video playing may include three parts: there is acoustic-electric on e-book backstage The philosophical works apply and smart television in Video Applications, scheme shown in the application needs to get through the interconnection of above three part.On The function of stating three parts is mainly as follows:

1) e-book backstage: operation maintenance personnel passes through mark that is artificial or automating by machine learning on e-book backstage Remember in target article, user may be interested, and needs to search for the word content of video, it is pre-buried to carry out keyword, for example, generating And store the corresponding relationship between keyword and timestamp/paragraph mark.

2) talking e-book application: talking e-book application receives eBook content (including the mesh that e-book backstage is sent Mark the reading audio of article), and triggering video search is manually operated according to user, alternatively, automatically triggering video search.

3) Video Applications in smart television: the Video Applications can receive text search video instructions, be searched according to execution Suo Bingwei user's playing display video content.

Referring to FIG. 5, it illustrates the invention relates to a kind of video playing flow diagram.As shown in figure 5, Talking e-book application of the e-book backstage into terminal provides the reading audio (S51) of target article.There is acoustic-electric in terminal Philosophical works application starts to play the reading audio (S52).When talking e-book applications trigger video search in terminal, first is obtained Keyword (S53).Talking e-book sends the instruction comprising the first keyword using the Video Applications into smart television (S54), Video Applications play the video (S56) according to the first keyword search video (S55), and when searching video.

Scheme shown in the application also enriches making for the smart television in parlor while improving sound reading experience With scene, new traffic ingress is created for it, i.e., segment is being watched by sound novel pull-up Video Applications, user Afterwards, certain probability just continues to use smart television.

In the embodiment of the present application, the Video Applications in smart television can extend to any Video Applications product, for example, It can be covered from single parlor scene comprising all Video Applications with the Video Applications product of talking e-book interface applications Scene.

It optionally, also include the second keyword in above-mentioned first play instruction, which is first key Keyword where word in the context of paragraph.Video Applications may search for video corresponding with first keyword, obtain Then search result screens at least one video according to second keyword, obtain opposite with first keyword The video answered.

In the embodiment of the present application, since the video arrived according to the first keyword search may include multiple videos, alternatively, The video arrived according to the first keyword search may be only corresponding with the first keyword, but not with the context of target article Match, therefore, in order to improve the accuracy of video search and artistic conception construction, scheme shown in the application can also be sent out to Video Applications It send the context of target article corresponding second keyword, is screened from the search result of the first keyword by the second keyword Suitable video plays out.

Such as, it is assumed that the first keyword is " battlefield ", and the second keyword is " gunbattle ", and Video Applications are according to the first keyword " battlefield " scans for, and includes the video clip 1 and a cold steel war of a modern war in the search result of acquisition Video clip 2, then Video Applications further pass through the second keyword " gunbattle ", filter out video clip 1 be it is above-mentioned with this The corresponding video of one keyword.

Optionally, during the Video Applications play video corresponding with first keyword, pause plays should Read audio.

In the embodiment of the present application, in order to which the artistic conception for improving video builds effect, during playing video, terminal can It is played with pause and reads audio.Alternatively, terminal, which can continue to play, reads audio during playing video.

Wherein, may include whether suspend broadcasting reading when playing video in the set interface of above-mentioned talking e-book application The switch of audio, if the switch is set on by user, during playing video, terminal pause, which plays, reads sound Frequently, conversely, if the switch is set off by user, during playing video, terminal, which continues to play, reads audio.

Optionally, during the Video Applications play video corresponding with first keyword, pause plays should Read audio before, the triggering mode of available first keyword of terminal, the triggering mode include user's operation triggering or Person's automatic trigger；When the triggering mode is that user's operation triggers, executing should play and first keyword in the Video Applications During corresponding video, suspend the step of playing the reading audio.

In alternatively possible implementation, the talking e-book application in terminal can also be according to the touching of video playing Originating party formula automatically selects during playing video, if pause, which plays, reads audio.

In the embodiment of the present application, logical process when video search can be divided into automatic trigger and manually triggering two Class, for the difference of search trigger, subsequent logical process can also have certain difference.

For example, referring to FIG. 6, it illustrates the invention relates to a kind of video and read audio broadcasting logic Schematic diagram.As shown in fig. 6, the reading audio (S61) of the talking e-book application plays target article in terminal.Talking e-book Using user's whether manually triggering search video (S62) is judged, if user triggers search video manually, suspend broadcasting reading sound Frequently (S63), and indicate that Video Applications search for video (S64)；If video is not searched in triggering to user manually, continue to determine whether certainly Dynamic triggering search video (S65), if so, S64 is entered step, otherwise, return step S61.After S64, Video Applications are sentenced Disconnected whether to search video (S66), if searching video, obtaining video playing mode, (i.e. sound broadcasting noiseless is broadcast Put), the video (S67) searched is played according to broadcast mode, and after playing video, return to S61 and continue to start, otherwise Directly return to S61.

In the present solution, going clicking trigger manually for user --- terminal can suspend voice reading.Due to video in Hold primarily to abundant textual products, make the experience of stereoscopic and omnibearing, the video council default searched is noiseless, only plays picture Face, voice parts are then defaulted using the voice artistic conception for reading app.Terminal can also provide for user to be chosen whether to open video sound Sound suspends the option of text-to-speech, user is allowed to make personalized selection when playing video.

Above scheme can not only be applied to sound reading, be also in fact that preferable products scheme is mended for common reading It fills, normal to read, user needs to concentrate one's energy, and consumption is a large amount of in the eyes with mental thinking, this when can also be by mentioning For entrance, allows user efficiently can meet the short-sighted frequency of context by removal search, provide better Product Experience effect for user.

In conclusion terminal is available to read with this when playing reading audio in scheme shown in the embodiment of the present application Corresponding first keyword of the playback progress of pronunciation frequency, and indicate Video Applications according to the first keyword search and play and be somebody's turn to do The corresponding video of first keyword realizes the scene built in target article with visual form, to extend to article The mode built of scene, improve the expression effect to the scene of verbal description.

Fig. 7 is a kind of flow chart of video broadcasting method shown according to an exemplary embodiment, the video broadcasting method It can be executed by computer equipment, for example, this method the terminal (such as first terminal) in system can execute as shown in Figure 1, or Person, this method can be executed by the server of above-mentioned system shown in Figure 1, alternatively, the end that this method can also as shown in Figure 1 in system End and server execute jointly.The embodiment of the present application is executed with above-mentioned video broadcasting method by terminal, and is wherein closed according to first For the process that keyword searches for corresponding video executes except Video Applications, as shown in fig. 7, the video broadcasting method can wrap Include following steps:

Step 701, it plays and reads audio, which is the speech audio that voice reads target article.

Step 702, the first keyword in the target article is obtained, which is the broadcasting with the reading audio The corresponding keyword of progress.

The implementation procedure of above-mentioned steps 701 and step 702 can with reference in above-mentioned embodiment illustrated in fig. 3 step 401 and Description under step 402, details are not described herein again.

Step 703, video corresponding with first keyword is searched for, search result is obtained.

For searching for the process of video by the talking e-book application execution in terminal, in the embodiment of the present application, have The server of acoustic-electric philosophical works application can be set or connect a video database, can collect and deposit in the video database Storage is suitble to the video that triggering plays when talking e-book application plays read audio, for example, being stored with playing duration specified Video within the scope of duration, so that reading in audio in talking e-book application plays, the length of the video of broadcasting both will not be too It is short, will not be too long in order to avoid user can not be by the scene of visual experience to article, it is read in order to avoid influencing article hereafter sound It reads.

It, can be to the corresponding view of server of talking e-book application after talking e-book application gets the first keyword Video corresponding with first keyword is searched in frequency database, obtains search result.

Wherein, it may include the video file searched in mentioned above searching results, alternatively, can also be in mentioned above searching results The mark of video comprising search, alternatively, also may include the network address of the video searched in mentioned above searching results, such as Uniform resource locator (Uniform Resource Locator, URL).

Optionally, video corresponding with first keyword is being searched for, before obtaining search result, terminal can also be obtained The second keyword in the target article is taken, which is the key that in the context of first keyword place paragraph Word.

Video corresponding with first keyword is being searched for, when obtaining search result, terminal is with first keyword Search key scans for, and obtains at least one matched video；According to second keyword at least one video into Row screening, obtains video corresponding with first keyword.

Step 704, the second play instruction comprising the search result is sent to the Video Applications, which uses Video corresponding with first keyword is played according to the search result in the instruction Video Applications.

In the embodiment of the present application, search result can be transmitted directly to Video Applications, video by talking e-book application Video corresponding with first keyword is played using according to the results for video.

Wherein, when in mentioned above searching results including the video that talking e-book application searches arrive, Video Applications can be straight It connects and plays the video.

Alternatively, when in mentioned above searching results including the mark for the video that talking e-book application searches arrive, Video Applications Can be according to the mark of the video, inquiry obtains corresponding with first keyword from the server that talking e-book is applied Video, and play the video got.

Alternatively, Video Applications can when in mentioned above searching results including the URL for the video that talking e-book application searches arrive To pull video corresponding with first keyword from the server that talking e-book is applied according to the URL of the video, and Play the video got.

Wherein, Video Applications play the mode of the corresponding video of the first keyword, can implement with reference to shown in above-mentioned Fig. 4 The description under step 403 in example, details are not described herein again.

For example, be the application in terminal with talking e-book application, for Video Applications are the application in smart television, ask With reference to Fig. 8, it illustrates the invention relates to a kind of video playing flow diagram.As shown in figure 8, e-book backstage Talking e-book application into terminal provides the reading audio (S81) of target article.Talking e-book application in terminal is opened Begin to play the reading audio (S82).Talking e-book using it is determined whether to enable automatic trigger video playing (S83), if so, It in automatic trigger video playing, obtains the first keyword (S84), otherwise, when user triggers video playing manually, obtains the One keyword (S85).Talking e-book application judges whether to search video (S86) corresponding with the first keyword, if so, Then the Video Applications into smart television send the instruction (S87) comprising search result, and Video Applications are broadcast according to the search result The video (S88) is put, S82 is otherwise returned.

In conclusion terminal is available to read with this when playing reading audio in scheme shown in the embodiment of the present application Corresponding first keyword of the playback progress of pronunciation frequency, according to the first keyword search view corresponding with first keyword Frequently, it and indicates that Video Applications play the video, the scene built in target article with visual form is realized, to extend pair The mode that the scene of article is built improves the expression effect to the scene of verbal description.

The application above-mentioned Fig. 2, Fig. 4 or scheme shown in Fig. 7, can reach experience used below: in user's uppick When one section of wonderful, by character search video, is played for user and more accurately describe the short-sighted of text scene at this time Frequently, it allows user that can preferably know from experience content of text, is that user's displaying one is excellent when hearing one section of battle scene such as user It fights short-sighted frequency.The sense organ of user can either be enriched, while the short-sighted frequency in part can attract user to go to watch the complete of the video Collection of drama achievees the purpose that drainage.

By taking user triggers video playing manually as an example, referring to FIG. 9, it is one kind shown according to an exemplary embodiment The audio playing flow schematic diagram of talking e-book application.The audio playing flow can be executed by computer equipment, for example, should Process the terminal (such as first terminal) in system can execute as shown in Figure 1, alternatively, the process can be by above-mentioned system shown in Figure 1 Server execute, alternatively, the process can also the terminal and server as shown in Figure 1 in system execute jointly.The application is real Example is applied so that above-mentioned audio playing flow is executed by terminal as an example, as shown in figure 9, having when playing the reading audio of target article The showing interface of acoustic-electric philosophical works application and operating process can be such that

Step 901, it plays and reads audio, which is the speech audio that voice reads target article.

Step 902, text exhibition interface includes text corresponding with the playback progress of the reading audio in text interface This.

Step 903, when receiving the video playing trigger action to the execution of text shown in text interface, triggering view Frequency application plays video corresponding with the first keyword in the target article, first keyword are and the reading audio The corresponding keyword of playback progress.

Step 904, during the Video Applications play video corresponding with first keyword, pause plays should Read audio.

In application embodiment by taking the scene of the easily perceivable manual triggering video playing of user as an example, talking e-book is answered Interface and operation are introduced.For example, the talking e-book in user mobile phone is applied when playing reading audio, also show that The corresponding text interface of the content of text currently read, when user wants to understand the scene of current text content by video, Corresponding keyword in text interface can be triggered, at this point, talking e-book application pause play read audio, meanwhile, with The Video Applications installed in Video Applications or terminal in the connected parlor smart television of family mobile phone start to play and the pass The corresponding video of keyword, after the video playing, the talking e-book application in mobile phone, which continues to play, reads audio.

Figure 10 is a kind of structural block diagram of video play device shown according to an exemplary embodiment.The video playing Device can be used in computer equipment, to execute all or part of step in the application above method embodiment.Wherein, The video play device can be used in the terminal in system shown in Figure 1 (such as first terminal), alternatively, the video play device It can be used in the server of above-mentioned system shown in Figure 1, alternatively, the video play device can also be distributed in the system shown in Fig. 1 In the terminal and server of system.The video play device may include:

Audio playing module 1001 reads audio for playing, and the audio of reading is the language that voice reads target article Sound audio；

Keyword obtains module 1002, for obtaining the first keyword in the target article, first keyword It is keyword corresponding with the reading playback progress of audio；

Instruction sending module 1003, for sending video playing instruction, institute to Video Applications according to first keyword It states video playing instruction and is used to indicate Video Applications broadcasting video corresponding with first keyword.

Optionally, keyword obtains module 1002, is used for,

Obtain the current play time stamp of the reading audio；

Obtain first keyword corresponding with current play time stamp.

Optionally, when obtaining with the current play time corresponding first keyword of stamp, keyword obtains module 1002, it is used for,

Optionally, keyword obtains module 1002, is used for,

Optionally, the instruction sending module 1003, is used for

Alternatively,

Optionally, video corresponding with first keyword is being searched for, before obtaining search result, which sends mould Block 1003, is also used to,

Video corresponding with first keyword is being searched for, when obtaining search result, which is used In,

Optionally, the device further include:

Optionally, which is the application in the terminal；

Alternatively,

Figure 11 shows the structural block diagram of the computer equipment 1100 of one exemplary embodiment of the application offer.The calculating Machine equipment 1100 can be first terminal, second terminal or server in system shown in Figure 1.

In general, computer equipment 1100 includes: processor 1101 and memory 1102.

Processor 1101 may include one or more processing cores, such as 4 core processors, 8 core processors etc..Place Reason device 1101 can use DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed Logic array) at least one of example, in hardware realize.Processor 1101 also may include primary processor and coprocessor.? In some embodiments, processor 1101 can be integrated with GPU (Graphics Processing Unit, image processor), Processor 1101 can also include AI (Artificial Intelligence, artificial intelligence) processor, which is used for Handle the calculating operation in relation to machine learning.

Memory 1102 may include one or more computer readable storage mediums, which can To be non-transient.Memory 1102 may also include high-speed random access memory and nonvolatile memory, such as one Or multiple disk storage equipments, flash memory device.In some embodiments, the non-transient computer in memory 1102 can Storage medium is read for storing at least one instruction, at least one instruction performed by processor 1101 for realizing this Shen It please all or part of step in above method embodiment.

In some embodiments, computer equipment 1100 is also optional includes: peripheral device interface 1103 and at least one Peripheral equipment.It can be connected by bus or signal wire between processor 1101, memory 1102 and peripheral device interface 1103. Each peripheral equipment can be connected by bus, signal wire or circuit board with peripheral device interface 1103.Specifically, peripheral equipment It include: radio circuit 1104, touch display screen 1105, camera 1106, voicefrequency circuit 1107, positioning component 1108 and power supply At least one of 1109.

Peripheral device interface 1103 can be used for I/O (Input/Output, input/output) is relevant outside at least one Peripheral equipment is connected to processor 1101 and memory 1102.

Radio circuit 1104 is for receiving and emitting RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal. Optionally, radio circuit 1104 includes: antenna system, RF transceiver, one or more amplifiers, tuner, oscillator, number Signal processor, codec chip group, user identity module card etc..Radio circuit 1104 can pass through at least one channel radio Agreement is believed to be communicated with other computer equipments.In some embodiments, radio circuit 1104 can also include NFC (Near Field Communication, wireless near field communication) related circuit, the application are not limited this.

Display screen 1105 is for showing UI (User Interface, user interface).When display screen 1105 is to touch display When screen, display screen 1105 also has acquisition in the ability of the touch signal on the surface or surface of display screen 1105.

CCD camera assembly 1106 is for acquiring image or video.In some embodiments, CCD camera assembly 1106 can be with Including flash lamp.

Voicefrequency circuit 1107 may include microphone and loudspeaker.In some embodiments, voicefrequency circuit 1107 can be with Including earphone jack.

Positioning component 1108 is used for the current geographic position of location Calculation machine equipment 1100, to realize navigation or LBS (Location Based Service, location based service).

Power supply 1109 is used to be powered for the various components in computer equipment 1100.

In some embodiments, computer equipment 1100 further includes having one or more sensors 1110.This or more A sensor 1110 includes but is not limited to: acceleration transducer 1111, pressure sensor 1113, refers to gyro sensor 1112 Line sensor 1114, optical sensor 1115 and proximity sensor 1116.

It will be understood by those skilled in the art that structure shown in Figure 11 does not constitute the limit to computer equipment 1100 It is fixed, it may include perhaps combining certain components than illustrating more or fewer components or being arranged using different components.

In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided It such as include the memory of computer program (instruction), above procedure (instruction) can be executed by the processor of computer equipment to complete All or part of step in each embodiment of the method for the application.For example, the non-transitorycomputer readable storage medium It can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage devices etc..

Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the application Its embodiment.This application is intended to cover any variations, uses, or adaptations of the application, these modifications, purposes or Person's adaptive change follows the general principle of the application and including the undocumented common knowledge in the art of the application Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the application are by following Claim is pointed out.

It should be understood that the application is not limited to the precise structure that has been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.Scope of the present application is only limited by the accompanying claims.

Claims

1. a kind of video broadcasting method, which is characterized in that the method is executed by computer equipment, which comprises

The first keyword in the target article is obtained, first keyword is and the playback progress phase for reading audio Corresponding keyword；

Video playing instruction is sent to Video Applications according to first keyword, the video playing instruction is used to indicate described Video Applications play video corresponding with first keyword.

2. the method according to claim 1, wherein first keyword obtained in the target article, Include:

Obtain the current play time stamp for reading audio；

Obtain first keyword corresponding with current play time stamp.

3. according to the method described in claim 2, it is characterized in that, the acquisition is corresponding with current play time stamp First keyword, comprising:

It is stabbed according to the current play time, obtains specified play time section, the specified play time section is described current After play time stamp, and between current play time stamp when a length of specified duration period；

By in the target article, the keyword that reading time is in the specified play time section is retrieved as described first and closes Keyword.

4. the method according to claim 1, wherein first keyword obtained in the target article, Include:

It determines in the target article, target paragraph corresponding with the reading playback progress of audio；

5. the method according to claim 1, wherein first keyword obtained in the target article, Include:

When receiving the video playing trigger action to the execution of text shown in the text interface, acquisition is broadcast with the video Put corresponding first keyword of trigger action.

6. the method according to claim 1, wherein described send according to first keyword to Video Applications Video playing instruction, comprising:

The first play instruction comprising first keyword is sent to the Video Applications, first play instruction is for referring to Show that the Video Applications are searched for video corresponding with first keyword and played；

Alternatively,

Video corresponding with first keyword is searched for, search result is obtained；It sends to the Video Applications comprising described Second play instruction of search result, second play instruction are used to indicate the Video Applications and are broadcast according to described search result Put video corresponding with first keyword.

7. according to the method described in claim 6, it is characterized in that, described search view corresponding with first keyword Frequently, before acquisition search result, further includes:

The second keyword in the target article is obtained, second keyword is the upper of paragraph where first keyword Keyword hereinafter；

Described search video corresponding with first keyword obtains search result, comprising:

At least one described video is screened according to second keyword, is obtained corresponding with first keyword Video.

8. according to the method described in claim 6, it is characterized in that, also including the second key in first play instruction Word, second keyword are the keywords where first keyword in the context of paragraph.

9. the method according to claim 1, wherein the method also includes:

During the Video Applications play video corresponding with first keyword, pause plays the reading sound Frequently.

10. according to the method described in claim 9, it is characterized in that, described play in the Video Applications is closed with described first During the corresponding video of keyword, pause is played before the reading audio, further includes:

The triggering mode of first keyword is obtained, the triggering mode includes user's operation triggering or automatic trigger；

When the triggering mode is that user's operation triggers, execute described in Video Applications broadcasting and first keyword During corresponding video, suspend the step of playing the reading audio.

11. method according to any one of claims 1 to 10, which is characterized in that the computer equipment is terminal,

The Video Applications are the applications in the terminal；

Alternatively,

12. a kind of video broadcasting method, which is characterized in that the method is executed by computer equipment, which comprises

When receiving the video playing trigger action to the execution of text shown in the text interface, triggering Video Applications are played Video corresponding with the first keyword in the target article, first keyword are and the broadcasting for reading audio The corresponding keyword of progress；

13. a kind of video play device, which is characterized in that described device is in computer equipment, described device to include:

Audio playing module reads audio for playing, and the audio of reading is the speech audio that voice reads target article；

Keyword obtains module, for obtaining the first keyword in the target article, first keyword be with it is described Read the corresponding keyword of playback progress of audio；

Instruction sending module, for sending video playing instruction to Video Applications according to first keyword, the video is broadcast It puts instruction and is used to indicate Video Applications broadcasting video corresponding with first keyword.

14. a kind of computer equipment, which is characterized in that the computer equipment includes processor and memory, the memory In be stored at least one instruction, at least a Duan Chengxu, code set or instruction set, at least one instruction, described at least one Duan Chengxu, the code set or instruction set are loaded by the processor and are executed to realize as described in claim 1 to 12 is any Video broadcasting method.

15. a kind of computer readable storage medium, which is characterized in that be stored at least one instruction, extremely in the storage medium A few Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, the code set or instruction Collection is loaded by processor and is executed to realize the video broadcasting method as described in claim 1 to 12 is any.