CN108696765A - Auxiliary input method in video playing and device - Google Patents

Auxiliary input method in video playing and device Download PDF

Info

Publication number
CN108696765A
CN108696765A CN201710225026.XA CN201710225026A CN108696765A CN 108696765 A CN108696765 A CN 108696765A CN 201710225026 A CN201710225026 A CN 201710225026A CN 108696765 A CN108696765 A CN 108696765A
Authority
CN
China
Prior art keywords
time point
input
video
input data
object time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710225026.XA
Other languages
Chinese (zh)
Other versions
CN108696765B (en
Inventor
刘思明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710225026.XA priority Critical patent/CN108696765B/en
Publication of CN108696765A publication Critical patent/CN108696765A/en
Application granted granted Critical
Publication of CN108696765B publication Critical patent/CN108696765B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4756End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks

Abstract

The embodiment of the invention discloses the auxiliary input methods in a kind of video playing, including:Video flowing is received, obtains the time point information corresponding with the video flowing that server is sent, the time point information includes at least one time point;The video flowing is played, the playing progress rate of the video flowing is detected, judges whether the playing progress rate arrives at the object time point in the time point information, if so, showing input frame in the broadcast interface for playing the video flowing;The input data inputted by the input frame is received, the input data is corresponding with the object time point;Show the input data.In addition, the embodiment of the invention also discloses the auxiliary input devices in a kind of video playing.Interactivity and the spectators' degree of participation in video class program playing process can be improved using the present invention.

Description

Auxiliary input method in video playing and device
Technical field
The present invention relates to the auxiliary input methods and device in field of computer technology more particularly to a kind of video playing.
Background technology
During more and more video frequency programs are in making, in order to improve user's body of user during viewing It tests, interactivity and sense of participation of the user during viewing is can take into account, to improve interest of the user for video frequency program And fancy grade, to improve the broadcasting rate of video frequency program.For example, the intelligence developments class answer section such as " station is on earth ", " millionaire " Mesh, user also may desire to participate in answer link when watching this kind of video frequency program;But current video class Program only allows user oneself to go to learn by heart answer and answer score during viewing, and can not to the answer situation of user into Row record and statistics.That is, in the playing process of traditional video class program, there is no really participate in user In the interaction for stating program, i.e., the interactivity of user is insufficient in the playing process of video frequency program.
Invention content
Based on this, to solve the insufficient technology of interactivity of video class program user during broadcasting in traditional technology Problem, spy propose the auxiliary input method in a kind of video playing.
A kind of auxiliary input method in video playing, including:
Video flowing is received, the time point information corresponding with the video flowing that server is sent, the time point letter are obtained Breath includes at least one time point;
The video flowing is played, the playing progress rate of the video flowing is detected, it is described to judge whether the playing progress rate arrives at Object time point in time point information, if so, showing input frame in the broadcast interface for playing the video flowing;
The input data inputted by the input frame is received, the input data is corresponding with the object time point;
Show the input data.
Further include after the playing progress rate of the detection video flowing in one of the embodiments,:
Judge whether the playing progress rate arrives at the object time point in the time point information, if so, acquisition and institute State the corresponding video interception of object time point;
The method further includes:
The displaying video interception corresponding with object time point.
Video interception corresponding with object time point described in the displaying further includes in one of the embodiments,:
Image recognition is carried out to the video interception and obtains corresponding content of text, the content of text and the video interception Corresponding object time point corresponds to;
Displaying content of text corresponding with the object time point.
The input data inputted by the input frame that receives further includes in one of the embodiments,:
The data of selection operation input of remote controler/mobile terminal of pairing are received as corresponding with the object time point Input data.
The input data inputted by the input frame that receives further includes in one of the embodiments,:
It receives the voice data by microphone input and speech recognition is carried out to the voice data and obtain and the mesh Mark time point corresponding input data;
Or, receiving the voice data of the microphone input of pairing, carrying out speech recognition to the voice data obtains and institute State the corresponding input data of object time point.
The input data inputted by the input frame that receives further includes later in one of the embodiments,:
The input data received is uploaded to the server so that the server by the input data with The corresponding reference data of the video flowing is compared to obtain accuracy corresponding with the input data and return;
Receive the accuracy that the server returns and displaying.
The server is additionally operable to statistics ranking information corresponding with the accuracy in one of the embodiments, if The ranking information is more than preset threshold value, and the ranking information is returned;
It is described to receive accuracy that the server returns and displaying further includes:
The ranking information corresponding with the accuracy that the server returns is received, shows the accuracy and ranking Information.
The displaying input frame in the broadcast interface for playing the video flowing further includes in one of the embodiments,:
Float layer is generated on the broadcast interface, input frame is added on the float layer.
The method further includes in one of the embodiments,:
After receiving the input data inputted by the input frame, the float layer is hidden.
It is described in one of the embodiments, also to be wrapped before displaying input frame in the broadcast interface for playing the video flowing It includes:
Judge whether the playing progress rate arrives at the object time point in the time point information, if arriving at, judgement is It is no to there is input data corresponding with the object time of arrival point;
If being not present, described the step of input frame is shown in the broadcast interface for playing the video flowing is executed.
The input frame has preset displaying duration threshold value in one of the embodiments, described to be regarded described in broadcasting Further include after displaying input frame in the broadcast interface of frequency stream:
The displaying duration of the input frame is detected, if displaying duration is greater than or equal to the displaying duration threshold value, is nullified Or hide the input frame.
In addition, being asked to solve video class program insufficient technology of interactivity of user during broadcasting in traditional technology Topic, spy propose the auxiliary input device in a kind of video playing.
A kind of auxiliary input device in video playing, including:
Time point information acquisition module obtains the corresponding with the video flowing of server transmission for receiving video flowing Time point information, the time point information include at least one time point;
Input frame display module detects the playing progress rate of the video flowing, is broadcast described in judgement for playing the video flowing Whether degree of putting into arrives at the object time point in the time point information, if so, in the broadcast interface for playing the video flowing Middle displaying input frame;
Input data receiving module, for receiving the input data inputted by the input frame, the input data with The object time point corresponds to;
Input data display module, for showing the input data.
Described device further includes video interception acquisition module in one of the embodiments, for judging the broadcasting Whether progress arrives at the object time point in the time point information, if so, obtaining regard corresponding with the object time point Frequency sectional drawing;
The input data display module is additionally operable to the displaying video interception corresponding with object time point.
The input data display module is additionally operable to carry out image knowledge to the video interception in one of the embodiments, Corresponding content of text is not obtained, and content of text object time point corresponding with the video interception is corresponding;Displaying with it is described The corresponding content of text of object time point.
The input data receiving module is additionally operable to receive the remote controler/movement matched eventually in one of the embodiments, The data of the selection operation input at end are as input data corresponding with the object time point.
The input data receiving module is additionally operable to receive the voice by microphone input in one of the embodiments, Data simultaneously obtain input data corresponding with the object time point to voice data progress speech recognition;Match or, receiving To microphone input voice data, to the voice data carry out speech recognition obtain it is corresponding with the object time point Input data.
In one of the embodiments, described device further includes input data uploading module, for being received described Input data is uploaded to the server, so that the server is by input data reference number corresponding with the video flowing According to being compared to obtain accuracy corresponding with the input data and return;
The input data display module is additionally operable to receive accuracy and the displaying that the server returns.
The server is additionally operable to statistics ranking information corresponding with the accuracy in one of the embodiments, if The ranking information is more than preset threshold value, and the ranking information is returned;
The input data display module is additionally operable to receive the ranking corresponding with the accuracy that the server returns Information shows the accuracy and ranking information.
The input frame display module is additionally operable to generate on the broadcast interface and float in one of the embodiments, Layer, input frame is added on the float layer.
Described device further includes input frame hidden module in one of the embodiments, for receiving by described defeated After the input data for entering frame input, the float layer is hidden.
Described device further includes judgment module in one of the embodiments, for judging whether the playing progress rate supports Up to the object time point in the time point information, if arriving at, judge whether and the object time of arrival point pair The input data answered;If being not present, input frame display module is called.
The input frame has preset displaying duration threshold value in one of the embodiments,;Input frame display module is also Displaying duration for detecting the input frame is nullified or hidden if displaying duration is greater than or equal to the displaying duration threshold value Hide the input frame.
Implement the embodiment of the present invention, will have the advantages that:
After using the auxiliary input method and device in above-mentioned video playing, interactive it can be regarded playing answer class etc. When frequency program, it is being played to when being similar to the target informations points such as Reaction time of server statistics, is showing and inputs in broadcast interface Frame is used for receiving user and inputs the input datas such as answer or comment, and shows the input that user inputs in video display process Data.That is, user in video display process can by be illustrated in the input frame of broadcast interface input answer, The data such as Highlight comment, increase user in the watching process of video frequency program can be interactive, increase spectators and watching Sense of participation when video, to improve the audience ratings of video.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with Obtain other attached drawings according to these attached drawings.
Wherein:
Fig. 1 is a kind of flow diagram of the auxiliary input method in video playing in one embodiment;
Fig. 2 is a kind of system composition figure based on the auxiliary input method in video render in one embodiment;
Fig. 3 is a kind of video playing interface schematic diagram in one embodiment;
Fig. 4 is a kind of video playing interface schematic diagram in one embodiment;
Fig. 5 is a kind of video playing interface schematic diagram in one embodiment;
Fig. 6 is a kind of video playing interface schematic diagram in one embodiment;
Fig. 7 is a kind of structural schematic diagram of the auxiliary input device in video playing in one embodiment;
Fig. 8 is that the structure of the computer equipment of the auxiliary input method in the broadcasting of operation aforementioned video in one embodiment is shown It is intended to.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts Embodiment shall fall within the protection scope of the present invention.
To solve video class program insufficient technical problem of the interactivity of user during broadcasting in traditional technology, In the present embodiment, spy proposes the auxiliary input method in a kind of video playing, and the realization of this method can be dependent on computer journey Sequence, the computer program can run on the computer system based on von Neumann system, which can regard Frequency play-back application or the application program for the data input applied based on video playing.The computer system can be operation Above computer program can be set such as TV, smart mobile phone, tablet computer, PC with the terminal of displaying video programs It is standby.
Specifically, as shown in Figure 1, the auxiliary input method in above-mentioned video playing includes the following steps S102-S108:
Step S102:Video flowing is received, the time point information corresponding with the video flowing that server is sent is obtained, it is described Time point information includes at least one time point.
In specific embodiment, user can play video section by terminal devices such as TV, smart mobile phone, PCs Mesh, for example, fetch by smart mobile phone or the corresponding website of PC access or chain and play corresponding video frequency program, Alternatively, accessing the corresponding website links of video frequency program come displaying video programs, alternatively, passing through tune by smart television or set-top box Economize on electricity depending on signal receive frequency range and play video frequency program corresponding with target frequency bands.
When by corresponding terminal device come displaying video programs, it is necessary first to which receiving corresponding video flowing could carry out It plays, for example, when fetching broadcasting video by accessing the corresponding network address of video or chain to be played, needs from corresponding network address Or video data corresponding with video to be played is downloaded in the corresponding server of link and is stored in the buffer, then from caching Middle reading video data plays out;Alternatively, the video flowing for receiving digital television signal transmission by TV or set-top box is right The video flowing received is parsed and played afterwards.
It should be noted that terminal need to establish when playing video flowing it is logical between corresponding with video flowing server Data for receiving the data of server transmission, and are uploaded to server by letter connection.For example, play video flowing terminal with Communication connection between the corresponding server of video flowing of broadcasting is as shown in Figure 2.
In the present embodiment, after receiving the corresponding video flowing of video to be played, acquisition server (for example, with The corresponding data statistics server of video flowing) send time point information corresponding with the video flowing.
It should be noted that containing at least one time point in time point information corresponding with video flowing, server exists When sending time point information corresponding with video flowing, can be by all time point corresponding with current video stream form when Between point information send together, can also be corresponding time point arrive at before, will time point information corresponding with the time point It is sent one by one.
Step S104:The video flowing is played, the playing progress rate of the video flowing is detected, judges whether playing progress rate arrives at Object time point in the time point information, if so, showing input frame in the broadcast interface for playing the video flowing.
The video flowing is played after receiving the corresponding video flowing of video frequency program to be played, in the process of broadcasting In, the playing progress rate of current video stream is detected, and judge whether the playing progress rate of current video stream has arrived in step S102 Object time point in the time point information that server is sent is equivalent to if time-over-target point when triggering with target Between put corresponding trigger event.
It should be noted that terminal judge playing progress rate whether object time point in arrival time point information when, can Sampling obtains system time, if system time is greater than or equal to object time point, all judges playing progress rate arrival time point information In object time point.After terminal determines the object time point in playing progress rate arrival time point information, you can playing Input frame is shown in the broadcast interface of the video flowing.
In the present embodiment, in the playing progress rate time-over-target point of video flowing, the operation of triggering is in video Show that input frame is used for receiving user input data in the broadcast interface of stream.For example, in a specific embodiment, in video Float layer is generated on the broadcast interface of stream, input frame is added on the float layer.That is, by way of float layer come Show input frame, user can in the input frame input data.
For example, in application scenarios shown in Fig. 3, in the broadcast interface of the video frequency program of answer class as shown in Figure 3, When Reaction time (being object time point) reaches, show that input frame as shown in Figure 3, user can lead on broadcast interface Cross input frame input input data.
Further, because the input frame of displaying can block the part picture in video render interface, therefore, in user After input data finishes in the input frame of displaying, that is, need not continue to show corresponding input frame.Specifically, logical receiving The input data for crossing the input frame input, after the input data is corresponding with the object time of arrival point, hides institute Input frame is stated, the corresponding float layer of the input frame is shown for example, hiding.
Step S106:Receive the input data inputted by the input frame, the mesh of the input data and the arrival Mark time point correspondence.
After illustrating input frame in step S104, user can pass through input frame input data;That is, examining When measuring user by input frame input data, the input data that is inputted by input frame of user is obtained, and by the input data It is corresponding with the triggering displaying object time point of input frame.
In a specific embodiment, it is broadcast by terminal devices such as mobile terminal, PC, tablet computers in user When putting video, show that input frame, user can be by corresponding with terminal device outer on the display interface of above-mentioned terminal device Boundary's keyboard or touch display screen are to the input frame input data, then when detecting data input by user, obtain and use The data of family input are as input data corresponding with object time point.
It is whole by mobile terminal, PC, tablet computer, TV etc. in user in another specific embodiment When end equipment plays video, the wheat that either can match or be connected with terminal device by the microphone that is arranged on terminal device Gram wind apparatus input voice data inputs input data corresponding with object time point.
Specifically, receive through the voice data of microphone input and the voice data is carried out speech recognition obtain and The corresponding input data of the object time point, that is to say, that when being provided with microphone on the terminal device for playing video flowing, Receive voice data input by user by the microphone, then, speech recognition carried out to the voice data received, obtain with The corresponding content of text of voice data received is as input data.
It should be noted that if there is no microphone apparatus on the terminal device of broadcasting video flowing, but the terminal device It has carried out matching between external microphone apparatus with some or has established the communication connections such as WIFI, bluetooth, user also may be used Voice data is inputted with the microphone apparatus by the outside, then the microphone apparatus of the outside is receiving voice data The communication connection between the terminal by playing video flowing sends the voice data received later.Then it plays and regards The terminal device of frequency stream after receiving the voice data that external microphone apparatus is sent, to the voice data that receives into Row speech recognition obtains content of text corresponding with the voice data of input as input data.
In another optional embodiment, when showing input frame, corresponding with the input frame at least two are also illustrated A option, user can select one or more options to make when inputting input data directly from least two options of displaying For input content.For example, illustrating tetra- options of A, B, C, D as shown in Figure 4 when showing input frame, user can pass through choosing Extract operation selects at least one option input data as input from above-mentioned 4 options that can only be.Specifically, user can To input selection operation by mobile terminals such as the remote controler matched with the terminal device for playing video flowing or smart mobile phones, And corresponding input data is determined according to the selection operation of user.Alternatively, in the display interface for the terminal device for playing video flowing For touch screen when, user directly can also choose at least one by the clicking operation of touch screen from least two options of displaying A option is as input data.
In another embodiment, when object time point arrives at, displaying can also be and current video stream broadcasting terminal Answer topic and option illustrate the current playing progress rate of answer class video frequency program for example, in application scenarios shown in Fig. 5 Corresponding topic and option, user can be to selecting the input as input of one or more option in the option of displaying Data.
It should be noted that in the present embodiment, because the displaying of input frame is because the playing progress rate of video arrives at What preset object time point just triggered, because being corresponding with the object time point by the input data that the input frame inputs , that is to say, that when being stored the input data after obtaining input data, need the input data and target Time point carries out corresponding storage.
In specific implementation, such as in videos sections such as the marking of the intelligence developments class video frequency program such as answer class or select-elite class program In mesh, if user carries out the viewing video that retracts again in having viewed subsequent video content, then in the broadcasting after rollback The input contents such as input marking or answer, just there is the suspicion of cheating, this original intention that input frame is arranged originally just violated.In order to This kind of situation is avoided, in the present embodiment, in playing progress rate time-over-target point and before showing input frame, it is also necessary to judge User whether has been viewed by subsequent video before or whether user had inputted input data.
Specifically, described further include before displaying input frame in the broadcast interface for playing the video flowing:It is broadcast described When degree of putting into arrives at the object time point in the time point information, judge whether and the object time of arrival point pair The input data answered;If being not present, described the step of input frame is shown in the broadcast interface for playing the video flowing is executed.
That is, in playing progress rate time-over-target point, judge whether to have existed for the target with the arrival Time point corresponding input data, and if it exists, then illustrate that user has been directed to the data of object time point input before, because This, does not need user and inputs again, therefore, there is no need to show input frame again, directly carries out the broadcasting of video flowing;Only In the case where not stored before with the object time corresponding input data of point, just execute above-mentioned in the broadcasting video The step of input frame is shown in the broadcast interface of stream.
Further, in one embodiment, input frame also has preset displaying duration threshold value.And playing video flowing Broadcast interface in after displaying input frame, the displaying duration of the also detectable input frame of terminal, if displaying duration is greater than or equal to It shows duration threshold value, then nullifies or hide the input frame.
That is, for answer class video frequency program, a problem is often shown, then only provide the less time to the user It answers, and counting-down reminding user, allows for user in this way in the answer of welcome guest in seeing video frequency program, input frame is It is canceled or hides, user can not input answer in input frame, and the answer participation process for allowing for user in this way will not be by The interference of welcome guest's answer in video so that user's answer can more meet the true horizon of user, and appraisement system is more fair truer.
Step S108:The displaying input data corresponding with the object time point.
It in the present embodiment, can be input by user before acquisition after the corresponding video program play of video flowing terminates All input datas, and be shown.Display frames can also be set on interface, input data input by user is persistently opened up Show in the display frames.It should be noted that in the present embodiment, when showing input data, the content of displaying further includes Corresponding with input data object time point, that is to say, that corresponding displaying object time point and corresponding with object time point Input data.
In a specific embodiment, the object time point not only one for including in time point information corresponding with video flowing It is a, when each object time point arrives at, it can show input frame, and receive input data input by user;Therefore, it is opening up When showing input data, input data corresponding with all object time points is shown.
When showing input data, the comment of specific answer situation or input is checked in order to facilitate user, When showing input data, specifying information corresponding with object time point is also showed that, for example, video corresponding with object time point Specifying information in sectional drawing or video frame corresponding with the object time.
Specifically, in an alternative embodiment, further including after the playing progress rate of the detection video flowing:Sentence Disconnected playing progress rate whether the object time point in arrival time point information, if so, obtaining video corresponding with object time point Sectional drawing;Displaying can also show video interception corresponding with object time point on interface.
That is, in the playing progress rate time-over-target point of video flowing, the operation of triggering includes not only displaying Input frame receives input data input by user, further comprises acquisition video interception corresponding with object time point.It needs to illustrate , in the present embodiment, the process for obtaining video interception corresponding with object time point can obtain the video flowing played In video frame corresponding with object time point, can also be and corresponding with object time point broadcast during acquisition plays video flowing The sectional drawing at interface is put, it in other embodiments, can also be according to video frame corresponding with object time point or broadcasting in video flowing The sectional drawing at interface records the small screen of one section of preset duration (for example, 10 seconds).Then the object time got point can be corresponded to Video interception stored in preset storage region, for example, video interception is cached.Further, in this implementation It, will object time point and corresponding with the object time point when storage is with the object time corresponding video interception of point in example Video interception corresponds in storage in preset buffer zone.Also, when displaying is with the object time corresponding input data of point, Corresponding with the object time point video interception of displaying, for example, the corresponding object time point, corresponding with the object time point of showing Input data and video interception corresponding with object time point.
In another specific embodiment, displaying can be not only video interception, can also be and the video interception Corresponding particular content, for example, in answer class video frequency program, displaying can be the specific topic for including in video interception Information and answer information.
Specifically, video interception corresponding with object time point and input data described in the displaying further include:To described Video interception carries out image recognition and obtains corresponding content of text, content of text object time corresponding with the video interception Point corresponds to;Displaying content of text corresponding with the object time point and input data.
That is, after obtaining video interception corresponding with object time point, to the video interception that gets into Row image recognition obtains the content of text corresponding with text information in video interception, is cut as with the video of object time point Scheme corresponding content of text.Optionally, can be by text content and corresponding object time point when storing content of text Correspondence be stored in preset buffer zone, also, displaying with object time point corresponding input data when, together displaying and The corresponding content of text of object time point.
For answer class video frequency program, while showing input data, the content of displaying can also include that user inputs Answer (input data) statistical conditions, such as accuracy.
Specifically, the input data inputted by the input frame that receives further includes later:It is received described Input data is uploaded to the server, so that the server is by input data reference number corresponding with the video flowing According to being compared to obtain accuracy corresponding with the input data and return;Receive the accuracy that the server returns and exhibition Show.
In specific implementation, after receiving input data input by user, input data is uploaded to server, by taking Business device judges the correctness of input data according to reference data corresponding with the video flowing, and counts the input of upload The accuracy of data, and obtained accuracy is returned.The playing terminal equipment for playing video flowing is receiving server return Accuracy after, in step S108 show input data when show the accuracy received together.
In general, multiple users can participate in interaction when watching video class program, for example, participating in answer In answer during class video program play, user does not only need to know the answer situation of oneself, it is also desirable to be able to know that The comparative situation of oneself answer situation and other spectators, for example, the ranking in the answer situation of all answer spectators.
Specifically, the server is additionally operable to statistics ranking information corresponding with the accuracy, in the ranking information When more than preset threshold value, the ranking information is returned;The accuracy and displaying that the reception server returns also are wrapped It includes:The ranking information corresponding with the accuracy that the server returns is received, shows the accuracy and ranking information.
That is, server is compared in the input data for receiving upload and by the input data with reference data After obtaining accuracy corresponding with input data, which is compared with the accuracy of other users, is obtained corresponding Ranking information, and the ranking information is returned together with accuracy.Alternatively, the ranking in ranking information is more than preset threshold When value, just the ranking information is returned, and corresponding ranking information is shown together while showing accuracy.
In addition, being asked to solve video class program insufficient technology of interactivity of user during broadcasting in traditional technology Topic, in one embodiment, as shown in Figure 7, it is also proposed that the auxiliary input device in a kind of video playing, including time point letter Acquisition module 102, input frame display module 104, input data receiving module 106 and input data display module 108 are ceased, In:
Time point information acquisition module 102 obtains the corresponding with the video flowing of server transmission for receiving video flowing Time point information, the time point information includes at least one time point;
Input frame display module 104 detects the playing progress rate of the video flowing, judges institute for playing the video flowing The object time point whether playing progress rate arrives in the time point information is stated, if so, in the broadcasting for playing the video flowing Input frame is shown in interface;
Input data receiving module 106, for receiving the input data inputted by the input frame, the input data It is corresponding with the object time point;
Input data display module 108, for showing the input data.
Optionally, in one embodiment, it as shown in fig. 7, above-mentioned apparatus further includes video interception acquisition module 110, uses In judging whether the playing progress rate arrives at the object time point in the time point information, if so, obtaining and the mesh Mark time point corresponding video interception;It is described corresponding with object time point that the input data display module 108 is additionally operable to displaying Video interception.
Optionally, in one embodiment, the input data display module 108 is additionally operable to carry out the video interception Image recognition obtains corresponding content of text, and content of text object time point corresponding with the video interception is corresponding;Displaying Content of text corresponding with the object time point.
Optionally, in one embodiment, the input data receiving module 106 be additionally operable to receive pairing remote controler/ The data of the selection operation input of mobile terminal are as input data corresponding with the object time point.
Optionally, in one embodiment, the input data receiving module 106, which is additionally operable to receive, passes through microphone input Voice data and to the voice data carry out speech recognition obtain input data corresponding with the object time point;Or, The voice data for receiving the microphone input of pairing carries out speech recognition to the voice data and obtains and the object time point Corresponding input data.
Optionally, in one embodiment, it as shown in fig. 7, above-mentioned apparatus further includes input data uploading module 112, uses In the input data received is uploaded to the server, so that the server regards the input data with described Frequency flows corresponding reference data and is compared to obtain accuracy corresponding with the input data and return;The input data exhibition Show that module 108 is additionally operable to receive accuracy and the displaying that the server returns.
Optionally, in one embodiment, the server is additionally operable to statistics ranking information corresponding with the accuracy, If the ranking information is more than preset threshold value, the ranking information is returned;The input data display module 108 is additionally operable to The ranking information corresponding with the accuracy that the server returns is received, shows the accuracy and ranking information.
Optionally, in one embodiment, the input frame display module 108 is additionally operable to generate on the broadcast interface Float layer adds input frame on the float layer.
Optionally, in one embodiment, described device further includes input frame hidden module 114, for passing through in reception After the input data of the input frame input, the float layer is hidden.
Optionally, in one embodiment, as shown in fig. 7, above-mentioned apparatus further includes judgment module 116, for judging The object time point whether playing progress rate arrives in the time point information is stated, if arriving at, judges whether to support with described The corresponding input data of object time point reached;If being not present, input frame display module 104 is called.
Optionally, input frame has preset displaying duration threshold value;Input frame display module 104 is additionally operable to detect described defeated Enter the displaying duration of frame, if displaying duration is greater than or equal to the displaying duration threshold value, nullifies or hide the input frame.
Implement the embodiment of the present invention, will have the advantages that:
After using the auxiliary input method and device in above-mentioned video playing, interactive it can be regarded playing answer class etc. When frequency program, it is being played to when being similar to the target informations points such as Reaction time of server statistics, is showing and inputs in broadcast interface Frame is used for receiving user and inputs the input datas such as answer or comment, and shows the input that user inputs in video display process Data.That is, user in video display process can by be illustrated in the input frame of broadcast interface input answer, The data such as Highlight comment, increase user in the watching process of video frequency program can be interactive, increase spectators and watching Sense of participation when video, to improve the audience ratings of video.
In one embodiment, as shown in figure 8, Fig. 8 illustrates a kind of auxiliary input side run in above-mentioned video playing The terminal of the computer system based on von Neumann system of method.The computer system can be smart mobile phone, tablet computer, the palm The terminal devices such as upper computer, laptop or PC.Specifically, may include the external input connected by system bus Interface 1001, processor 1002, memory 1003 and output interface 1004.Wherein, outer input interface 1001 optionally can be extremely Include network interface 10012 less.Memory 1003 may include external memory 10032 (such as hard disk, CD or floppy disk etc.) and interior Memory 10034.Output interface 1004 can include at least the equipment such as display screen 10042.
In the present embodiment, the operation of this method is based on computer program, and the program file of the computer program is stored in In the external memory 10032 of the aforementioned computer system based on von Neumann system, it is loaded into built-in storage at runtime It in 10034, is then compiled as being transferred in processor 1002 after machine code executing, so that being based on von Neumann system Computer system in form time point information acquisition module 102 in logic, input frame display module 104, input data and connect It is hidden to receive module 106, input data display module 108, frequency sectional drawing acquisition module 110, input data uploading module 112, input frame Hide module 114 and judgment module 116.And in the auxiliary input method implementation procedure in above-mentioned video playing, the ginseng of input Number is received by outer input interface 1001, and is transferred in memory 1003 and is cached, and is then input in processor 1002 It is handled, the result data of processing or be cached in memory 1003 is subsequently handled, or is passed to output interface 1004 are exported.
Specifically, in the present embodiment, network interface 10012 for receiving video flowing, obtain that server sends with institute State the corresponding time point information of video flowing;It is sending with the video to obtain server for receiving video flowing for processor 1002 Corresponding time point information is flowed, the time point information includes at least one time point;The video flowing is played, is regarded described in detection The playing progress rate of frequency stream, judges whether the playing progress rate arrives at the object time point in the time point information, if so, It plays in the broadcast interface of the video flowing and shows input frame;The input data inputted by the input frame is received, it is described defeated It is corresponding with the object time point to enter data;Show the input data.
Optionally, in one embodiment, processor 1002, which is additionally operable to execute, judges whether the playing progress rate arrives at institute The object time point in time point information is stated, if so, obtaining video interception corresponding with the object time point;Output interface 1004 are additionally operable to execute the displaying video interception corresponding with object time point.
Optionally, in one embodiment, processor 1002 is additionally operable to execute carries out image recognition to the video interception Corresponding content of text is obtained, content of text object time point corresponding with the video interception is corresponding;Output interface 1004 It is additionally operable to execute and shows content of text corresponding with the object time point.
Optionally, in one embodiment, outer input interface 1001 is additionally operable to execute the remote controler/movement for receiving pairing The data of the selection operation input of terminal are as input data corresponding with the object time point.
Optionally, in one embodiment, outer input interface 1001 is additionally operable to execute and receive through microphone input Voice data simultaneously obtains input data corresponding with the object time point to voice data progress speech recognition;Or, connecing The voice data for receiving the microphone input of pairing carries out speech recognition to the voice data and obtains and the object time point pair The input data answered.
Optionally, in one embodiment, processor 1002 is additionally operable to execute and uploads the input data received To the server, so that input data reference data corresponding with the video flowing is compared the server To accuracy corresponding with the input data and return;Output interface 1004, which is additionally operable to execute, receives what the server returned Accuracy is simultaneously shown.
Optionally, in one embodiment, processor 1002 be additionally operable to execute receive that the server returns with it is described The corresponding ranking information of accuracy, output interface 1004, which is additionally operable to execute, shows the accuracy and ranking information.
Optionally, in one embodiment, processor 1002 is additionally operable to execute generates float layer on the broadcast interface, Input frame is added on the float layer.
Optionally, in one embodiment, processor 1002 is additionally operable to execute and be inputted by the input frame receiving After input data, the float layer is hidden.
Optionally, in one embodiment, processor 1002, which is additionally operable to execute, judges whether the playing progress rate arrives at institute The object time point in time point information is stated, if arriving at, is judged whether corresponding with the object time of arrival point Input data;If being not present, execution is described to show input frame in the broadcast interface for playing the video flowing.
Optionally, in one embodiment, also there is input frame preset displaying duration threshold value, processor 1002 to be additionally operable to The displaying duration of the input frame is detected, if displaying duration is greater than or equal to the displaying duration threshold value, cancellation or hiding institute State input frame.
The above disclosure is only the preferred embodiments of the present invention, cannot limit the right model of the present invention with this certainly It encloses, therefore equivalent changes made in accordance with the claims of the present invention, is still within the scope of the present invention.

Claims (15)

1. the auxiliary input method in a kind of video playing, which is characterized in that including:
Video flowing is received, the time point information corresponding with the video flowing that server is sent, the time point information packet are obtained Include at least one time point;
The video flowing is played, the playing progress rate of the video flowing is detected, judges whether the playing progress rate arrives at the time Object time point in point information, if so, showing input frame in the broadcast interface for playing the video flowing;
The input data inputted by the input frame is received, the input data is corresponding with the object time point;
Show the input data.
2. the auxiliary input method in video playing according to claim 1, which is characterized in that the detection video Further include after the playing progress rate of stream:
Judge whether the playing progress rate arrives at the object time point in the time point information, if so, obtaining and the mesh Mark time point corresponding video interception;
The method further includes:
The displaying video interception corresponding with object time point.
3. the auxiliary input method in video playing according to claim 2, which is characterized in that described in the displaying and mesh Mark time point, corresponding video interception further included:
Image recognition is carried out to the video interception and obtains corresponding content of text, the content of text is corresponding with the video interception Object time point correspond to;
Displaying content of text corresponding with the object time point.
4. the auxiliary input method in video playing according to claim 1, which is characterized in that described to receive by described Further include after the input data of input frame input:
The input data received is uploaded to the server so that the server by the input data with it is described The corresponding reference data of video flowing is compared to obtain accuracy corresponding with the input data and return;
Receive the accuracy that the server returns and displaying.
5. the auxiliary input method in video playing according to claim 1, which is characterized in that described to be regarded described in broadcasting Displaying input frame further includes in the broadcast interface of frequency stream:
Float layer is generated on the broadcast interface, input frame is added on the float layer.
6. the auxiliary input device in a kind of video playing, which is characterized in that including:
Time point information acquisition module obtains the time corresponding with the video flowing that server is sent for receiving video flowing Point information, the time point information includes at least one time point;
Input frame display module detects the playing progress rate of the video flowing for playing the video flowing, judge it is described play into Whether degree arrives at the object time point in the time point information, if so, being opened up in the broadcast interface for playing the video flowing Show input frame;
Input data receiving module, for receiving the input data inputted by the input frame, the input data with it is described Object time point corresponds to;
Input data display module, for showing the input data.
7. the auxiliary input device in video playing according to claim 6, which is characterized in that described device further includes regarding Frequency sectional drawing acquisition module, for judging whether the playing progress rate arrives at the object time point in the time point information, if It is then to obtain video interception corresponding with the object time point;
The input data display module is additionally operable to the displaying video interception corresponding with object time point.
8. the auxiliary input device in video playing according to claim 7, which is characterized in that the input data displaying Module is additionally operable to obtain corresponding content of text to video interception progress image recognition, and the content of text is cut with the video Scheme corresponding object time point to correspond to;Displaying content of text corresponding with the object time point.
9. the auxiliary input device in video playing according to claim 6, which is characterized in that the input data receives Module be additionally operable to receive pairing remote controler/mobile terminal selection operation input data as with the object time point pair The input data answered.
10. the auxiliary input device in video playing according to claim 6, which is characterized in that the input data connects Module is received to be additionally operable to receive through the voice data of microphone input and obtain voice data progress speech recognition and institute State the corresponding input data of object time point;Or, receive pairing microphone input voice data, to the voice data into Row speech recognition obtains input data corresponding with the object time point.
11. the auxiliary input device in video playing according to claim 6, which is characterized in that described device further includes Input data uploading module, for the input data received to be uploaded to the server, so that the server will The input data and the corresponding reference data of the video flowing are compared to obtain accuracy corresponding with the input data And it returns;
The input data display module is additionally operable to receive accuracy and the displaying that the server returns.
12. the auxiliary input device in video playing according to claim 6, which is characterized in that the input frame displaying Module is additionally operable to generate float layer on the broadcast interface, and input frame is added on the float layer.
13. the auxiliary input device in video playing according to claim 12, which is characterized in that described device further includes Input frame hidden module, for after receiving the input data inputted by the input frame, hiding the float layer.
14. the auxiliary input device in video playing according to claim 6, which is characterized in that described device further includes Judgment module, if arriving at, is sentenced for judging whether the playing progress rate arrives at the object time point in the time point information It is disconnected to whether there is input data corresponding with the object time of arrival point;If being not present, input frame display module is called.
15. the auxiliary input device in video playing according to claim 6, which is characterized in that the input frame has Preset displaying duration threshold value;Input frame display module is additionally operable to detect the displaying duration of the input frame, if growing up when displaying In or equal to the displaying duration threshold value, then the input frame is nullified or hides.
CN201710225026.XA 2017-04-07 2017-04-07 Auxiliary input method and device in video playing Active CN108696765B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710225026.XA CN108696765B (en) 2017-04-07 2017-04-07 Auxiliary input method and device in video playing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710225026.XA CN108696765B (en) 2017-04-07 2017-04-07 Auxiliary input method and device in video playing

Publications (2)

Publication Number Publication Date
CN108696765A true CN108696765A (en) 2018-10-23
CN108696765B CN108696765B (en) 2022-01-28

Family

ID=63842908

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710225026.XA Active CN108696765B (en) 2017-04-07 2017-04-07 Auxiliary input method and device in video playing

Country Status (1)

Country Link
CN (1) CN108696765B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109714626A (en) * 2018-12-26 2019-05-03 北京字节跳动网络技术有限公司 Information interacting method, device, electronic equipment and computer readable storage medium
CN111436006A (en) * 2019-01-12 2020-07-21 北京字节跳动网络技术有限公司 Method, device, equipment and storage medium for displaying information on video
CN113453057A (en) * 2021-06-22 2021-09-28 海信电子科技(深圳)有限公司 Display device and playing progress control method
CN113542797A (en) * 2020-09-18 2021-10-22 腾讯科技(深圳)有限公司 Interaction method and device in video playing and computer readable storage medium
CN113592682A (en) * 2021-07-30 2021-11-02 广东顺德红铅笔信息科技有限公司 Driving test simulation method and system based on WeChat applet
US11526269B2 (en) 2019-01-12 2022-12-13 Shanghai marine diesel engine research institute Video playing control method and apparatus, device, and storage medium
US11550457B2 (en) 2019-01-12 2023-01-10 Beijing Bytedance Network Technology Co., Ltd. Method, device, apparatus and storage medium of displaying information on video

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014132768A (en) * 2014-02-10 2014-07-17 Thomson Licensing Interval based advertisement insertion used for delivery of video streams
KR20150030387A (en) * 2013-09-12 2015-03-20 엠랩 주식회사 Comment tagging system for streaming video and providing method thereof
CN104754419A (en) * 2015-03-13 2015-07-01 腾讯科技(北京)有限公司 Video-based interaction method and device
CN104769656A (en) * 2012-08-17 2015-07-08 香港意学教育科技有限公司 Method and system for classroom active learning
CN104822093A (en) * 2015-04-13 2015-08-05 腾讯科技(北京)有限公司 Comment issuing method and device thereof
CN104967908A (en) * 2014-09-05 2015-10-07 腾讯科技(深圳)有限公司 Video hot spot marking method and apparatus
CN105430509A (en) * 2015-11-27 2016-03-23 北京奇艺世纪科技有限公司 Multimedia file play method and device
US20170048592A1 (en) * 2015-08-13 2017-02-16 International Business Machines Corporation Immersive cognitive reality system with real time surrounding media
CN106454532A (en) * 2016-10-21 2017-02-22 合网络技术(北京)有限公司 Video player and interactive display method thereof

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104769656A (en) * 2012-08-17 2015-07-08 香港意学教育科技有限公司 Method and system for classroom active learning
KR20150030387A (en) * 2013-09-12 2015-03-20 엠랩 주식회사 Comment tagging system for streaming video and providing method thereof
JP2014132768A (en) * 2014-02-10 2014-07-17 Thomson Licensing Interval based advertisement insertion used for delivery of video streams
CN104967908A (en) * 2014-09-05 2015-10-07 腾讯科技(深圳)有限公司 Video hot spot marking method and apparatus
CN104754419A (en) * 2015-03-13 2015-07-01 腾讯科技(北京)有限公司 Video-based interaction method and device
CN104822093A (en) * 2015-04-13 2015-08-05 腾讯科技(北京)有限公司 Comment issuing method and device thereof
US20170048592A1 (en) * 2015-08-13 2017-02-16 International Business Machines Corporation Immersive cognitive reality system with real time surrounding media
CN105430509A (en) * 2015-11-27 2016-03-23 北京奇艺世纪科技有限公司 Multimedia file play method and device
CN106454532A (en) * 2016-10-21 2017-02-22 合网络技术(北京)有限公司 Video player and interactive display method thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MJ.CALLAGHAN等: "Game-based Strategy to Teaching Electronic & Electrical Engineering in Virtual Worlds", 《2010 2ND INTERNATIONAL IEEE CONSUMER ELECTRONICS SOCIETY"S GAMES INNOVATIONS CONFERENCE》 *
庞思睿等: "面向物联网与三维可视化的智能变电站运行辅助管理系统研究与设计", 《2014电力行业信息化年会论文集》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109714626A (en) * 2018-12-26 2019-05-03 北京字节跳动网络技术有限公司 Information interacting method, device, electronic equipment and computer readable storage medium
US11924500B2 (en) 2018-12-26 2024-03-05 Beijing Bytedance Network Technology Co., Ltd. Information interaction method and device, electronic apparatus, and computer readable storage medium
CN111436006A (en) * 2019-01-12 2020-07-21 北京字节跳动网络技术有限公司 Method, device, equipment and storage medium for displaying information on video
CN111436008A (en) * 2019-01-12 2020-07-21 北京字节跳动网络技术有限公司 Method, device, equipment and storage medium for displaying information on video
US11526269B2 (en) 2019-01-12 2022-12-13 Shanghai marine diesel engine research institute Video playing control method and apparatus, device, and storage medium
US11550457B2 (en) 2019-01-12 2023-01-10 Beijing Bytedance Network Technology Co., Ltd. Method, device, apparatus and storage medium of displaying information on video
CN111436006B (en) * 2019-01-12 2023-03-31 北京字节跳动网络技术有限公司 Method, device, equipment and storage medium for displaying information on video
CN113542797A (en) * 2020-09-18 2021-10-22 腾讯科技(深圳)有限公司 Interaction method and device in video playing and computer readable storage medium
CN113453057A (en) * 2021-06-22 2021-09-28 海信电子科技(深圳)有限公司 Display device and playing progress control method
CN113453057B (en) * 2021-06-22 2023-04-14 Vidaa(荷兰)国际控股有限公司 Display device and playing progress control method
CN113592682A (en) * 2021-07-30 2021-11-02 广东顺德红铅笔信息科技有限公司 Driving test simulation method and system based on WeChat applet

Also Published As

Publication number Publication date
CN108696765B (en) 2022-01-28

Similar Documents

Publication Publication Date Title
CN108696765A (en) Auxiliary input method in video playing and device
CN105206260B (en) A kind of terminal speech broadcasting method, device and terminal speech operational approach
CN107995523B (en) Video broadcasting method, device, terminal and storage medium
US10834479B2 (en) Interaction method based on multimedia programs and terminal device
CN108012169B (en) A kind of interactive voice throws screen method, apparatus and server
CN111436006B (en) Method, device, equipment and storage medium for displaying information on video
CN102193794B (en) Link real-time media situation is to relevant application program and service
US20220318306A1 (en) Video-based interaction implementation method and apparatus, device and medium
CN105808182B (en) Display control method and system, advertisement breach judging device and video and audio processing device
CN109729420A (en) Image processing method and device, mobile terminal and computer readable storage medium
CN107155138A (en) Video playback jump method, equipment and computer-readable recording medium
CN108965977B (en) Method, device, storage medium, terminal and system for displaying live gift
CN108259781A (en) image synthesizing method, terminal and computer readable storage medium
CN103338405A (en) Screen capture application method, equipment and system
CN113301358B (en) Content providing and displaying method and device, electronic equipment and storage medium
CN106162357A (en) Obtain the method and device of video content
CN103702222A (en) Interactive information generation method and video file playing method for mobile terminal
CN110503954A (en) Voice technical ability starts method, apparatus, equipment and storage medium
US20150325210A1 (en) Method for real-time multimedia interface management
US20140012792A1 (en) Systems and methods for building a virtual social network
CN108833983A (en) Played data acquisition methods, device, equipment and storage medium
CN109005423A (en) A kind of video broadcasting method and device
CN113727125B (en) Live broadcast room screenshot method, device, system, medium and computer equipment
US11526269B2 (en) Video playing control method and apparatus, device, and storage medium
CN107948571A (en) The method, apparatus and computer-readable recording medium of video record

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant