CN108696765B - Auxiliary input method and device in video playing - Google Patents
Auxiliary input method and device in video playing Download PDFInfo
- Publication number
- CN108696765B CN108696765B CN201710225026.XA CN201710225026A CN108696765B CN 108696765 B CN108696765 B CN 108696765B CN 201710225026 A CN201710225026 A CN 201710225026A CN 108696765 B CN108696765 B CN 108696765B
- Authority
- CN
- China
- Prior art keywords
- time point
- input
- video
- playing
- input data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Abstract
The embodiment of the invention discloses an auxiliary input method in video playing, which comprises the following steps: receiving a video stream, and acquiring time point information which is sent by a server and corresponds to the video stream, wherein the time point information comprises at least one time point; playing the video stream, detecting the playing progress of the video stream, judging whether the playing progress reaches a target time point in the time point information, and if so, displaying an input frame in a playing interface for playing the video stream; receiving input data input through the input box, wherein the input data correspond to the target time point; and displaying the input data. In addition, the embodiment of the invention also discloses an auxiliary input device in video playing. The invention can improve the interactivity and audience participation degree in the video program playing process.
Description
Technical Field
The invention relates to the technical field of computers, in particular to an auxiliary input method and device in video playing.
Background
In the process of making more and more video programs, in order to improve the user experience of the user in the watching process, the interactivity and the participation of the user in the watching process are considered, so that the interest and the preference degree of the user on the video programs are improved, and the playing rate of the video programs is improved. For example, the user may wish to participate in the answering process when watching an educational answering program such as "one-stop", "millionaire" and the like; however, the current video programs only allow the user to silently remember the answers and the answer scores during the watching process, and cannot record and count the answering conditions of the user. That is, in the conventional playing process of video-type programs, the user does not actually participate in the interaction of the programs, that is, the interactivity of the user is insufficient in the playing process of the video programs.
Disclosure of Invention
Therefore, in order to solve the technical problem that the interactivity of the user is insufficient in the process of playing the video program in the traditional technology, an auxiliary input method in video playing is particularly provided.
An auxiliary input method in video playing comprises the following steps:
receiving a video stream, and acquiring time point information which is sent by a server and corresponds to the video stream, wherein the time point information comprises at least one time point;
playing the video stream, detecting the playing progress of the video stream, judging whether the playing progress reaches a target time point in the time point information, and if so, displaying an input frame in a playing interface for playing the video stream;
receiving input data input through the input box, wherein the input data correspond to the target time point;
and displaying the input data.
In one embodiment, after the detecting the progress of the playing of the video stream, the method further includes:
judging whether the playing progress reaches a target time point in the time point information, if so, acquiring a video screenshot corresponding to the target time point;
the method further comprises the following steps:
and displaying the video screenshot corresponding to the target time point.
In one embodiment, the displaying the video screenshot corresponding to the target time point further includes:
carrying out image recognition on the video screenshot to obtain corresponding text content, wherein the text content corresponds to a target time point corresponding to the video screenshot;
and displaying the text content corresponding to the target time point.
In one embodiment, the receiving input data input through the input box further comprises:
and receiving data input by selection operation of the paired remote controller/mobile terminal as input data corresponding to the target time point.
In one embodiment, the receiving input data input through the input box further comprises:
receiving voice data input through a microphone and carrying out voice recognition on the voice data to obtain input data corresponding to the target time point;
or receiving voice data input by the paired microphones, and performing voice recognition on the voice data to obtain input data corresponding to the target time point.
In one embodiment, the receiving input data input through the input box further comprises:
uploading the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data and returns the correct rate;
and receiving and displaying the accuracy returned by the server.
In one embodiment, the server is further configured to count ranking information corresponding to the accuracy, and return the ranking information if the ranking information exceeds a preset threshold;
the receiving and displaying the accuracy returned by the server further comprises:
and receiving ranking information which is returned by the server and corresponds to the accuracy, and displaying the accuracy and the ranking information.
In one embodiment, the displaying an input box in a playback interface for playing back the video stream further includes:
and generating a floating layer on the playing interface, and adding an input box on the floating layer.
In one embodiment, the method further comprises:
hiding the floating layer after receiving input data input through the input box.
In one embodiment, before displaying the input box in the playing interface for playing the video stream, the method further includes:
judging whether the playing progress reaches a target time point in the time point information or not, and if so, judging whether input data corresponding to the reached target time point exists or not;
and if not, executing the step of displaying the input box in the playing interface for playing the video stream.
In one embodiment, the input box has a preset display duration threshold, and after the display of the input box in the playing interface for playing the video stream, the method further includes:
and detecting the display duration of the input frame, and if the display duration is greater than or equal to the display duration threshold, cancelling or hiding the input frame.
In addition, in order to solve the technical problem that the interactivity of the user is insufficient during the playing process of the video program in the traditional technology, an auxiliary input device in video playing is particularly provided.
An auxiliary input device in video playing, comprising:
the system comprises a time point information acquisition module, a time point information acquisition module and a time point information acquisition module, wherein the time point information acquisition module is used for receiving a video stream and acquiring time point information which is sent by a server and corresponds to the video stream, and the time point information comprises at least one time point;
an input frame display module, configured to play the video stream, detect a playing progress of the video stream, and determine whether the playing progress reaches a target time point in the time point information, if yes, display an input frame in a playing interface where the video stream is played;
the input data receiving module is used for receiving input data input through the input frame, and the input data correspond to the target time point;
and the input data display module is used for displaying the input data.
In one embodiment, the apparatus further includes a video screenshot obtaining module, configured to determine whether the playing progress reaches a target time point in the time point information, and if so, obtain a video screenshot corresponding to the target time point;
the input data display module is also used for displaying the video screenshot corresponding to the target time point.
In one embodiment, the input data presentation module is further configured to perform image recognition on the video screenshot to obtain corresponding text content, where the text content corresponds to a target time point corresponding to the video screenshot; and displaying the text content corresponding to the target time point.
In one embodiment, the input data receiving module is further configured to receive data input by a selection operation of the paired remote controller/mobile terminal as input data corresponding to the target time point.
In one embodiment, the input data receiving module is further configured to receive voice data input through a microphone and perform voice recognition on the voice data to obtain input data corresponding to the target time point; or receiving voice data input by the paired microphones, and performing voice recognition on the voice data to obtain input data corresponding to the target time point.
In one embodiment, the apparatus further includes an input data uploading module, configured to upload the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data, and returns the correct rate;
and the input data display module is also used for receiving and displaying the accuracy returned by the server.
In one embodiment, the server is further configured to count ranking information corresponding to the accuracy, and return the ranking information if the ranking information exceeds a preset threshold;
the input data display module is further configured to receive ranking information corresponding to the accuracy returned by the server, and display the accuracy and the ranking information.
In one embodiment, the input box showing module is further configured to generate a floating layer on the playing interface, and add an input box on the floating layer.
In one embodiment, the apparatus further comprises an input box hiding module for hiding the floating layer after receiving input data input through the input box.
In one embodiment, the apparatus further includes a determining module, configured to determine whether the playing schedule reaches a target time point in the time point information, and if so, determine whether there is input data corresponding to the reached target time point; if not, the input box display module is called.
In one embodiment, the input box has a preset display duration threshold; the input frame display module is further used for detecting the display duration of the input frame, and if the display duration is greater than or equal to the display duration threshold, the input frame is cancelled or hidden.
The embodiment of the invention has the following beneficial effects:
after the auxiliary input method and the auxiliary input device in video playing are adopted, when interactive video programs such as answers and the like are played and target information points which are counted by a server and are similar to answer time and the like are played, an input box is displayed on a playing interface to receive input data such as answers or comments input by a user and display the input data input by the user in the video playing process. That is to say, in the video playing process, the user can input data such as answers, highlight comments and the like through the input box displayed on the playing interface, so that the interactivity of the user in the video program watching process is increased, the participation sense of the audience in the video watching process is increased, and the audience rating of the video is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Wherein:
FIG. 1 is a flow chart illustrating an exemplary method for auxiliary input during video playback;
FIG. 2 is a diagram of a system configured to implement an auxiliary input method in video stream playing according to an embodiment;
FIG. 3 is a diagram of a video playback interface in accordance with one embodiment;
FIG. 4 is a diagram of a video playback interface in accordance with one embodiment;
FIG. 5 is a diagram of a video playback interface in accordance with one embodiment;
FIG. 6 is a diagram of a video playback interface in accordance with one embodiment;
FIG. 7 is a diagram illustrating an exemplary auxiliary input device for playing video;
fig. 8 is a schematic structural diagram of a computer device for executing the auxiliary input method in video playing in one embodiment.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to solve the technical problem of insufficient interactivity of users during playing of video programs in the conventional technology, in this embodiment, an auxiliary input method in video playing is specifically proposed, which can be implemented by relying on a computer program that can run on a computer system based on von neumann architecture, where the computer program can be a video playing application program or an application program based on data input of a video playing application. The computer system may be a terminal device, such as a television, a smart phone, a tablet computer, a personal computer, etc., running the computer program, which can play video programs.
Specifically, as shown in fig. 1, the auxiliary input method in video playing includes the following steps S102 to S108:
step S102: receiving a video stream, and acquiring time point information which is sent by a server and corresponds to the video stream, wherein the time point information comprises at least one time point.
In a specific embodiment, a user may play a video program through a terminal device such as a television, a smart phone, a personal computer, and the like, for example, the smart phone or the personal computer accesses a corresponding website or link to play a video program corresponding thereto, or the smart television or the set-top box accesses a website link corresponding to the video program to play the video program, or the signal receiving frequency band of the television is adjusted to play the video program corresponding to the target frequency band.
When a video program is played through corresponding terminal equipment, a corresponding video stream needs to be received first to play, for example, when a video is played by accessing a website or a link corresponding to a video to be played, video data corresponding to the video to be played needs to be downloaded from a server corresponding to the corresponding website or link and stored in a cache, and then the video data is read from the cache to play; or, a video stream transmitted by a digital television signal is received by a television or a set top box, and then the received video stream is analyzed and played.
It should be noted that when playing a video stream, the terminal needs to establish a communication connection between servers corresponding to the video stream, receive data sent by the servers, and upload the data to the servers. For example, a communication connection between a terminal playing a video stream and a server corresponding to the played video stream is shown in fig. 2.
In this embodiment, after receiving a video stream corresponding to a video to be played, time point information corresponding to the video stream sent by a server (e.g., a data statistics server corresponding to the video stream) is acquired.
It should be noted that the time point information corresponding to the video stream includes at least one time point, and when the server transmits the time point information corresponding to the video stream, the server may transmit the time point information composed of all the time points corresponding to the current video stream together, or may transmit the time point information corresponding to the time point one by one before the corresponding time point arrives.
Step S104: and playing the video stream, detecting the playing progress of the video stream, judging whether the playing progress reaches the target time point in the time point information, and if so, displaying an input frame in a playing interface for playing the video stream.
And after receiving the video stream corresponding to the video program to be played, playing the video stream, detecting the playing progress of the current video stream in the playing process, and judging whether the playing progress of the current video stream reaches the target time point in the time point information sent by the server in the step S102, wherein if the playing progress of the current video stream reaches the target time point, triggering a triggering event corresponding to the target time point.
It should be noted that, when determining whether the playing schedule reaches the target time point in the time point information, the terminal may sample and obtain the system time, and if the system time is greater than or equal to the target time point, it is determined that the playing schedule reaches the target time point in the time point information. And when the terminal determines that the playing progress reaches the target time point in the time point information, displaying an input frame in a playing interface for playing the video stream.
In this embodiment, when the playing progress of the video stream reaches the target time point, the triggered operation is to display an input box in the playing interface of the video stream for receiving the user input data. For example, in one particular embodiment, a floating layer is generated on the playback interface of the video stream, and an input box is added to the floating layer. That is, the input box in which the user can input data is presented by way of a floating layer.
For example, in the application scenario shown in fig. 3, in the playing interface of the video program of the answer class shown in fig. 3, when the answer time (i.e. the target time point) is reached, an input box shown in fig. 3 is displayed on the playing interface, and the user can input the input data through the input box.
Furthermore, because the displayed input box can block part of the picture in the video stream playing interface, after the user inputs data in the displayed input box, the corresponding input box does not need to be continuously displayed. Specifically, after receiving input data input through the input frame, the input data corresponding to the target time point of arrival, the input frame is hidden, for example, a floating layer corresponding to the input frame is hidden and displayed.
Step S106: receiving input data input through the input box, the input data corresponding to the target time point of arrival.
After the input box is displayed in step S104, the user can input data through the input box; that is to say, when it is detected that the user inputs data through the input box, the input data input through the input box by the user is acquired, and the input data corresponds to the target time point for triggering the display of the input box.
In a specific embodiment, when a user plays a video through a terminal device such as a mobile terminal, a personal computer, a tablet computer, or the like, an input frame is displayed on a display interface of the terminal device, the user can input data to the input frame through an external keyboard or a touch display screen corresponding to the terminal device, and then when the data input by the user is detected, the data input by the user is acquired as input data corresponding to a target time point.
In another specific embodiment, when the user plays a video through a terminal device such as a mobile terminal, a personal computer, a tablet computer, or a television, the input data corresponding to the target time point may be input by inputting voice data through a microphone provided on the terminal device or a microphone device paired with or connected to the terminal device.
Specifically, the voice data input through the microphone is received and voice recognition is performed on the voice data to obtain input data corresponding to the target time point, that is, when a microphone is arranged on a terminal device playing a video stream, the voice data input by a user is received through the microphone, and then voice recognition is performed on the received voice data to obtain text content corresponding to the received voice data as input data.
It should be noted that, if there is no microphone device on the terminal device playing the video stream, but the terminal device is paired with an external microphone device or a communication connection such as WIFI or bluetooth is established, the user may also input the voice data through the external microphone device, and then the external microphone device transmits the received voice data through the communication connection with the terminal playing the video stream after receiving the voice data. And then after receiving the voice data sent by the external microphone device, the terminal equipment playing the video stream performs voice recognition on the received voice data to obtain text content corresponding to the input voice data as input data.
In another optional embodiment, when the input box is displayed, at least two options corresponding to the input box are also displayed, and the user can directly select one or more options from the displayed at least two options as input content when inputting input data. For example, when the input box is displayed, A, B, C, D four options as shown in fig. 4 are displayed, and the user can select at least one option as input data from the above-mentioned 4 options only by a selection operation. Specifically, the user may input a selection operation through a remote controller paired with a terminal device playing the video stream or a mobile terminal such as a smart phone, and determine corresponding input data according to the selection operation of the user. Or when the display interface of the terminal device playing the video stream is a touch screen, the user can also directly select at least one option from the displayed at least two options as input data through the click operation of the touch screen.
In another embodiment, when the target time point arrives, the presentation may also be questions and options corresponding to the current video stream playing terminal, for example, in the application scenario shown in fig. 5, the questions and options corresponding to the current playing progress of the question answering video program are presented, and the user may select one or more of the presented options as input data.
It should be noted that, in this embodiment, because the display of the input box is triggered when the playing progress of the video reaches the preset target time point, the input data input through the input box corresponds to the target time point, that is, when the input data is stored after being acquired, the input data and the target time point need to be stored correspondingly.
In a specific implementation, for example, in a video program such as an educational video program such as an answer program or a score of a show program, if a user views a video content later and then enters an input content such as a score or an answer during playback after the user has viewed the video content later, the user is suspected of cheating, which is contrary to the original intention of setting an input box. To avoid this, in this embodiment, before the playback progress reaches the target time point and the input box is displayed, it is also necessary to determine whether the user has viewed the next video before or whether the user has input the input data.
Specifically, before displaying the input box in the playing interface for playing the video stream, the method further includes: when the playing progress reaches a target time point in the time point information, judging whether input data corresponding to the reached target time point exists or not; and if not, executing the step of displaying the input box in the playing interface for playing the video stream.
That is to say, when the playing progress reaches the target time point, it is determined whether there is input data corresponding to the reached target time point, and if so, it indicates that the data that the user has input for the target time point before, so that the user does not need to input again, and therefore, the user does not need to display the input frame again, and the video stream can be directly played; and only under the condition that the input data corresponding to the target time point is not stored before, executing the step of displaying the input frame in the playing interface for playing the video stream.
Further, in one embodiment, the input box further has a preset display duration threshold. And after the input frame is displayed in the playing interface for playing the video stream, the terminal can also detect the display duration of the input frame, and if the display duration is greater than or equal to the display duration threshold, the input frame is cancelled or hidden.
That is to say, for the answer video program, only a short time is provided for the user to answer every time a question is displayed, and the countdown reminds the user, so that when the user sees the answer of the guest in the video program, the input frame is cancelled or hidden, the user cannot input the answer in the input frame, the answer participation process of the user is not interfered by the answer of the guest in the video, the answer of the user can be more consistent with the true level of the user, and the evaluation system is fairer and more true.
Step S108: and displaying the input data corresponding to the target time point.
In this embodiment, after the video program corresponding to the video stream is played, all the input data input by the user before can be acquired and displayed. A display frame can also be arranged on the interface, and input data input by a user is continuously displayed in the display frame. It should be noted that, in this embodiment, when the input data is displayed, the displayed content further includes a target time point corresponding to the input data, that is, a corresponding display target time point and the input data corresponding to the target time point.
In a specific embodiment, more than one target time point is included in the time point information corresponding to the video stream, and when each target time point arrives, the input box is displayed and input data input by a user is received; thus, when presenting the input data, the input data corresponding to all the target time points are presented.
When the input data is displayed, specific information corresponding to the target time point, for example, a video screenshot corresponding to the target time point or specific information in a video frame corresponding to the target time, is also displayed in order to facilitate the user to view the specific answer condition or the input comment.
Specifically, in an optional embodiment, after detecting the playing progress of the video stream, the method further includes: judging whether the playing progress reaches a target time point in the time point information, if so, acquiring a video screenshot corresponding to the target time point; and displaying the video screenshot corresponding to the target time point on the display interface.
That is, when the playing progress of the video stream reaches the target time point, the triggered operation includes not only displaying the input box to receive input data input by a user, but also acquiring a video screenshot corresponding to the target time point. It should be noted that, in this embodiment, the process of acquiring the video screenshot corresponding to the target time point may be acquiring a video frame corresponding to the target time point in the played video stream, or may also be acquiring a screenshot of a playing interface corresponding to the target time point in the playing video stream, and in other embodiments, a small screen with a preset duration (for example, 10 seconds) may also be recorded according to the video frame corresponding to the target time point in the video stream or the screenshot of the playing interface. Then, the acquired video screenshot corresponding to the target time point may be stored in a preset storage area, for example, the video screenshot is cached. Further, in this embodiment, when storing the video screenshot corresponding to the target time point, the target time point and the video screenshot corresponding to the target time point are stored in a preset buffer area. When the input data corresponding to the target time point is displayed, the video screenshot corresponding to the target time point is also displayed, for example, the target time point, the input data corresponding to the target time point, and the video screenshot corresponding to the target time point are correspondingly displayed.
In another specific embodiment, not only the video screenshot but also specific content corresponding to the video screenshot may be presented, for example, in an answer-type video program, specific topic information and answer information included in the video screenshot may be presented.
Specifically, the displaying the video screenshot corresponding to the target time point and the input data further includes: carrying out image recognition on the video screenshot to obtain corresponding text content, wherein the text content corresponds to a target time point corresponding to the video screenshot; and displaying the text content and the input data corresponding to the target time point.
That is, after the video screenshot corresponding to the target time point is acquired, image recognition is performed on the acquired video screenshot, and text content corresponding to the text information in the video screenshot is acquired as text content corresponding to the video screenshot at the target time point. Optionally, when storing the text content, the text content and the corresponding target time point may be stored in a preset buffer area, and when displaying the input data corresponding to the target time point, the text content corresponding to the target time point is displayed together.
For the answer-type video program, the displayed content may also include statistics, such as a correct rate, of answers (input data) input by the user while the input data is displayed.
Specifically, after receiving the input data input through the input box, the method further includes: uploading the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data and returns the correct rate; and receiving and displaying the accuracy returned by the server.
In specific implementation, after receiving input data input by a user, the input data is uploaded to a server, the server judges whether the input data is correct or not according to reference data corresponding to the video stream, counts the correct rate of the uploaded input data, and returns the obtained correct rate. After receiving the accuracy returned by the server, the playing terminal device playing the video stream displays the received accuracy when displaying the input data in step S108.
Generally, a plurality of users will participate in interaction when watching a video program, for example, participate in answering during playing of an answering video program, and the users need to know not only their own answering situation but also the comparison between their own answering situation and other viewers, for example, the ranking among the answering situations of all the answering viewers.
Specifically, the server is further configured to count ranking information corresponding to the accuracy, and return the ranking information when the ranking information exceeds a preset threshold; the receiving and displaying the accuracy returned by the server further comprises: and receiving ranking information which is returned by the server and corresponds to the accuracy, and displaying the accuracy and the ranking information.
That is, after receiving the uploaded input data and comparing the input data with the reference data to obtain the accuracy corresponding to the input data, the server compares the accuracy with the accuracy of other users to obtain corresponding ranking information, and returns the ranking information and the accuracy together. Or, when the rank in the ranking information exceeds a preset threshold, returning the ranking information, and simultaneously displaying the corresponding ranking information while displaying the correct rate.
In addition, to solve the technical problem of insufficient interactivity of the user during the playing of the video program in the conventional technology, in an embodiment, as shown in fig. 7, an auxiliary input device in video playing is further provided, which includes a time point information obtaining module 102, an input frame displaying module 104, an input data receiving module 106, and an input data displaying module 108, wherein:
a time point information obtaining module 102, configured to receive a video stream, and obtain time point information corresponding to the video stream and sent by a server, where the time point information includes at least one time point;
an input frame display module 104, configured to play the video stream, detect a playing progress of the video stream, determine whether the playing progress reaches a target time point in the time point information, and if so, display an input frame in a playing interface for playing the video stream;
an input data receiving module 106, configured to receive input data input through the input box, where the input data corresponds to the target time point;
an input data presentation module 108 for presenting the input data.
Optionally, in an embodiment, as shown in fig. 7, the apparatus further includes a video screenshot obtaining module 110, configured to determine whether the playing progress reaches a target time point in the time point information, and if so, obtain a video screenshot corresponding to the target time point; the input data presentation module 108 is further configured to present the video screenshot corresponding to the target time point.
Optionally, in an embodiment, the input data presentation module 108 is further configured to perform image recognition on the video screenshot to obtain corresponding text content, where the text content corresponds to the target time point corresponding to the video screenshot; and displaying the text content corresponding to the target time point.
Optionally, in an embodiment, the input data receiving module 106 is further configured to receive data input by a selection operation of the paired remote controller/mobile terminal as input data corresponding to the target time point.
Optionally, in an embodiment, the input data receiving module 106 is further configured to receive voice data input through a microphone and perform voice recognition on the voice data to obtain input data corresponding to the target time point; or receiving voice data input by the paired microphones, and performing voice recognition on the voice data to obtain input data corresponding to the target time point.
Optionally, in an embodiment, as shown in fig. 7, the apparatus further includes an input data uploading module 112, configured to upload the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data, and returns the correct rate; the input data presentation module 108 is further configured to receive the accuracy returned by the server and present the accuracy.
Optionally, in an embodiment, the server is further configured to count ranking information corresponding to the accuracy, and return the ranking information if the ranking information exceeds a preset threshold; the input data display module 108 is further configured to receive ranking information corresponding to the accuracy returned by the server, and display the accuracy and the ranking information.
Optionally, in an embodiment, the input box display module 108 is further configured to generate a floating layer on the playing interface, and add an input box on the floating layer.
Optionally, in an embodiment, the apparatus further includes an input box hiding module 114 configured to hide the floating layer after receiving input data input through the input box.
Optionally, in an embodiment, as shown in fig. 7, the apparatus further includes a determining module 116, configured to determine whether the playing schedule reaches a target time point in the time point information, and if so, determine whether there is input data corresponding to the reached target time point; if not, the input box presentation module 104 is invoked.
Optionally, the input box has a preset display duration threshold; the input box display module 104 is further configured to detect a display duration of the input box, and if the display duration is greater than or equal to the display duration threshold, cancel or hide the input box.
The embodiment of the invention has the following beneficial effects:
after the auxiliary input method and the auxiliary input device in video playing are adopted, when interactive video programs such as answers and the like are played and target information points which are counted by a server and are similar to answer time and the like are played, an input box is displayed on a playing interface to receive input data such as answers or comments input by a user and display the input data input by the user in the video playing process. That is to say, in the video playing process, the user can input data such as answers, highlight comments and the like through the input box displayed on the playing interface, so that the interactivity of the user in the video program watching process is increased, the participation sense of the audience in the video watching process is increased, and the audience rating of the video is improved.
In one embodiment, as shown in fig. 8, fig. 8 illustrates a terminal of a von neumann-based computer system that runs the auxiliary input method in video playback described above. The computer system can be terminal equipment such as a smart phone, a tablet computer, a palm computer, a notebook computer or a personal computer. Specifically, an external input interface 1001, a processor 1002, a memory 1003, and an output interface 1004 connected through a system bus may be included. The external input interface 1001 may optionally include at least a network interface 10012. Memory 1003 can include external memory 10032 (e.g., a hard disk, optical or floppy disk, etc.) and internal memory 10034. The output interface 1004 may include at least a display 10042 or the like.
In this embodiment, the method is executed based on a computer program, a program file of the computer program is stored in the external memory 10032 of the computer system based on the von neumann system, and the program file is loaded into the internal memory 10034 at the time of execution, then compiled into machine code, and then transferred to the processor 1002 for execution, so that the computer system based on the von neumann system forms a logical time point information obtaining module 102, an input frame displaying module 104, an input data receiving module 106, an input data displaying module 108, a frequency screenshot obtaining module 110, an input data uploading module 112, an input frame hiding module 114, and a determining module 116. In the execution process of the auxiliary input method in the video playing, the input parameters are all received through the external input interface 1001, and are transferred to the memory 1003 for buffering, and then are input into the processor 1002 for processing, and the processed result data is buffered in the memory 1003 for subsequent processing, or is transferred to the output interface 1004 for output.
Specifically, in this embodiment, the network interface 10012 is configured to receive a video stream, and obtain time point information corresponding to the video stream, where the time point information is sent by the server; the processor 1002 is configured to receive a video stream, and acquire time point information corresponding to the video stream, where the time point information includes at least one time point, and is sent by a server; playing the video stream, detecting the playing progress of the video stream, judging whether the playing progress reaches a target time point in the time point information, and if so, displaying an input frame in a playing interface for playing the video stream; receiving input data input through the input box, wherein the input data correspond to the target time point; and displaying the input data.
Optionally, in an embodiment, the processor 1002 is further configured to perform determining whether the playing progress reaches a target time point in the time point information, and if yes, acquiring a video screenshot corresponding to the target time point; the output interface 1004 is further configured to execute displaying the video screenshot corresponding to the target time point.
Optionally, in an embodiment, the processor 1002 is further configured to perform image recognition on the video screenshot to obtain corresponding text content, where the text content corresponds to the target time point corresponding to the video screenshot; the output interface 1004 is further configured to perform displaying the text content corresponding to the target time point.
Optionally, in an embodiment, the external input interface 1001 is further configured to execute receiving data input by a selection operation of the paired remote controller/mobile terminal as input data corresponding to the target time point.
Optionally, in an embodiment, the external input interface 1001 is further configured to receive voice data input through a microphone and perform voice recognition on the voice data to obtain input data corresponding to the target time point; or receiving voice data input by the paired microphones, and performing voice recognition on the voice data to obtain input data corresponding to the target time point.
Optionally, in an embodiment, the processor 1002 is further configured to upload the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data, and returns the correct rate; the output interface 1004 is also used for executing the correct rate returned by the server and displaying the correct rate.
Optionally, in an embodiment, the processor 1002 is further configured to receive ranking information corresponding to the accuracy returned by the server, and the output interface 1004 is further configured to display the accuracy and the ranking information.
Optionally, in an embodiment, the processor 1002 is further configured to generate a floating layer on the playing interface, and add an input box on the floating layer.
Optionally, in an embodiment, the processor 1002 is further configured to perform hiding the floating layer after receiving the input data input through the input box.
Optionally, in an embodiment, the processor 1002 is further configured to determine whether the playing schedule reaches a target time point in the time point information, and if so, determine whether there is input data corresponding to the reached target time point; and if the video stream does not exist, executing the display input box in the playing interface for playing the video stream.
Optionally, in an embodiment, the input box further has a preset display duration threshold, and the processor 1002 is further configured to detect the display duration of the input box, and if the display duration is greater than or equal to the display duration threshold, cancel or hide the input box.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (10)
1. An auxiliary input method in video playing, comprising:
receiving a video stream, and acquiring time point information which is sent by a server and corresponds to the video stream, wherein the time point information comprises at least one time point; the video stream is a video stream corresponding to the answer video program;
playing the video stream, detecting the playing progress of the video stream, judging whether the playing progress reaches a target time point in the time point information, and if so, judging whether corresponding input data exist at the target time point; the target time point is a time point corresponding to the answering time;
if the video stream does not exist, displaying an input frame in a playing interface for playing the video stream, performing countdown prompt on the display duration of the input frame in the process of displaying the input frame, and acquiring a video screenshot corresponding to the target time point;
receiving input data input through the input box, and hiding or cancelling the input box when the display duration of the input box is greater than or equal to a display duration threshold; the input data corresponds to the target time point;
and carrying out image recognition on the video screenshot to obtain text content corresponding to the target time point, and displaying the input data corresponding to the target time point and the text content.
2. An auxiliary input method in video playing according to claim 1, wherein said receiving input data input through said input box further comprises:
uploading the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data and returns the correct rate;
and receiving and displaying the accuracy returned by the server.
3. The auxiliary input method for video playing according to claim 1, wherein said displaying an input box in a playing interface for playing the video stream further comprises:
and generating a floating layer on the playing interface, and adding an input box on the floating layer.
4. An auxiliary input device for playing video, comprising:
the system comprises a time point information acquisition module, a time point information acquisition module and a time point information acquisition module, wherein the time point information acquisition module is used for receiving a video stream and acquiring time point information which is sent by a server and corresponds to the video stream, and the time point information comprises at least one time point; the video stream is a video stream corresponding to the answer video program;
an input box display module, configured to play the video stream, detect a playing progress of the video stream, and determine whether the playing progress reaches a target time point in the time point information, if yes, determine whether corresponding input data exists at the target time point; if not, displaying an input box in a playing interface for playing the video stream, and performing countdown prompt on the display duration of the input box in the process of displaying the input box; the target time point is a time point corresponding to the answering time;
the video screenshot obtaining module is used for judging whether the playing progress reaches a target time point in the time point information or not, and if so, obtaining a video screenshot corresponding to the target time point;
the input data receiving module is used for receiving input data input through the input box and hiding or cancelling the input box when the display duration of the input box is greater than or equal to a display duration threshold; the input data corresponds to the target time point;
and the input data display module is used for carrying out image recognition on the video screenshot to obtain the text content corresponding to the target time point and displaying the input data and the text content corresponding to the target time point.
5. The auxiliary input device for video playing according to claim 4, wherein the input data receiving module is further configured to receive data input by a selection operation of the paired remote controller/mobile terminal as the input data corresponding to the target time point.
6. The auxiliary input device for playing video as claimed in claim 4, wherein the input data receiving module is further configured to receive voice data input through a microphone and perform voice recognition on the voice data to obtain input data corresponding to the target time point; or receiving voice data input by the paired microphones, and performing voice recognition on the voice data to obtain input data corresponding to the target time point.
7. The auxiliary input device for video playing according to claim 4, wherein the device further comprises an input data uploading module, configured to upload the received input data to the server, so that the server compares the input data with reference data corresponding to the video stream to obtain a correct rate corresponding to the input data, and returns the correct rate;
and the input data display module is also used for receiving and displaying the accuracy returned by the server.
8. An auxiliary input device in video playing according to claim 4, wherein the input box showing module is further configured to generate a floating layer on the playing interface, and add an input box on the floating layer.
9. An auxiliary input device as claimed in claim 8, wherein said device further comprises an input box hiding module for hiding said floating layer after receiving input data inputted through said input box.
10. A terminal device, comprising: a processor and a memory; wherein the memory stores a computer program that is loaded by the processor to perform the method of any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710225026.XA CN108696765B (en) | 2017-04-07 | 2017-04-07 | Auxiliary input method and device in video playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710225026.XA CN108696765B (en) | 2017-04-07 | 2017-04-07 | Auxiliary input method and device in video playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108696765A CN108696765A (en) | 2018-10-23 |
| CN108696765B true CN108696765B (en) | 2022-01-28 |
Family
ID=63842908
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710225026.XA Active CN108696765B (en) | 2017-04-07 | 2017-04-07 | Auxiliary input method and device in video playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108696765B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714626B (en) | 2018-12-26 | 2020-11-03 | 北京字节跳动网络技术有限公司 | Information interaction method and device, electronic equipment and computer readable storage medium |
| WO2020143795A1 (en) | 2019-01-12 | 2020-07-16 | 北京字节跳动网络技术有限公司 | Method, device and apparatus for displaying information on video, and storage medium |
| US11526269B2 (en) | 2019-01-12 | 2022-12-13 | Shanghai marine diesel engine research institute | Video playing control method and apparatus, device, and storage medium |
| CN111436000A (en) * | 2019-01-12 | 2020-07-21 | 北京字节跳动网络技术有限公司 | Method, device, equipment and storage medium for displaying information on video |
| CN113542797A (en) * | 2020-09-18 | 2021-10-22 | 腾讯科技（深圳）有限公司 | Interaction method and device in video playing and computer readable storage medium |
| CN113453057B (en) * | 2021-06-22 | 2023-04-14 | Vidaa(荷兰)国际控股有限公司 | Display device and playing progress control method |
| CN113592682A (en) * | 2021-07-30 | 2021-11-02 | 广东顺德红铅笔信息科技有限公司 | Driving test simulation method and system based on WeChat applet |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754419A (en) * | 2015-03-13 | 2015-07-01 | 腾讯科技（北京）有限公司 | Video-based interaction method and device |
| CN104822093A (en) * | 2015-04-13 | 2015-08-05 | 腾讯科技（北京）有限公司 | Comment issuing method and device thereof |
| CN104967908A (en) * | 2014-09-05 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Video hot spot marking method and apparatus |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI511101B (en) * | 2012-08-17 | 2015-12-01 | Active Learning Solutions Ltd | Method and system for classroom active learning |
| KR101587926B1 (en) * | 2013-09-12 | 2016-01-25 | 엠랩 주식회사 | Comment tagging system for streaming video and providing method thereof |
| JP2014132768A (en) * | 2014-02-10 | 2014-07-17 | Thomson Licensing | Interval based advertisement insertion used for delivery of video streams |
| US10609438B2 (en) * | 2015-08-13 | 2020-03-31 | International Business Machines Corporation | Immersive cognitive reality system with real time surrounding media |
| CN105430509B (en) * | 2015-11-27 | 2018-10-30 | 北京奇艺世纪科技有限公司 | A kind of method for broadcasting multimedia file and device |
| CN106454532A (en) * | 2016-10-21 | 2017-02-22 | 合网络技术（北京）有限公司 | Video player and interactive display method thereof |
-
2017
- 2017-04-07 CN CN201710225026.XA patent/CN108696765B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967908A (en) * | 2014-09-05 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Video hot spot marking method and apparatus |
| CN104754419A (en) * | 2015-03-13 | 2015-07-01 | 腾讯科技（北京）有限公司 | Video-based interaction method and device |
| CN104822093A (en) * | 2015-04-13 | 2015-08-05 | 腾讯科技（北京）有限公司 | Comment issuing method and device thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108696765A (en) | 2018-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108696765B (en) | Auxiliary input method and device in video playing | |
| US10834479B2 (en) | Interaction method based on multimedia programs and terminal device | |
| CN107801101B (en) | System and method for optimized and efficient interactive experience | |
| JP6168544B2 (en) | INTERACTION METHOD BASED ON MULTIMEDIA PROGRAM, TERMINAL DEVICE, AND SERVER | |
| US20170311039A1 (en) | Interaction information processing method, client, service platform, and storage medium | |
| US20220318306A1 (en) | Video-based interaction implementation method and apparatus, device and medium | |
| US20220013026A1 (en) | Method for video interaction and electronic device | |
| US10405064B2 (en) | Systems and methods for prompting and incorporating unscripted user content into live broadcast programming | |
| CN102193794B (en) | Link real-time media situation is to relevant application program and service | |
| CN113301358B (en) | Content providing and displaying method and device, electronic equipment and storage medium | |
| WO2021169432A1 (en) | Data processing method and apparatus of live broadcast application, electronic device and storage medium | |
| US20160269510A1 (en) | Content evaluator, content evaluation system, server unit and terminal unit to evaluate content | |
| CN113852767B (en) | Video editing method, device, equipment and medium | |
| JP5225418B2 (en) | Information processing apparatus and method | |
| CN111343508B (en) | Information display control method and device, electronic equipment and storage medium | |
| US11968425B2 (en) | Method and apparatus for shared viewing of media content | |
| CN110417728B (en) | Online interaction method, device, medium and electronic equipment | |
| CN112055258B (en) | Time delay testing method and device for loading live broadcast picture, electronic equipment and storage medium | |
| CN110381359B (en) | Video processing method and device, computer equipment and storage medium | |
| US20170139933A1 (en) | Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments | |
| US20240058709A1 (en) | Method, apparatus and device and storage medium for real-time information interaction | |
| CN113727125B (en) | Live broadcast room screenshot method, device, system, medium and computer equipment | |
| CN112188221B (en) | Play control method, play control device, computer equipment and storage medium | |
| CN109726267B (en) | Story recommendation method and device for story machine | |
| CN114915823B (en) | Video playing control method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |