CN108712667B - Smart television, screen capture application method and device thereof, and readable storage medium - Google Patents
Smart television, screen capture application method and device thereof, and readable storage medium Download PDFInfo
- Publication number
- CN108712667B CN108712667B CN201810475458.0A CN201810475458A CN108712667B CN 108712667 B CN108712667 B CN 108712667B CN 201810475458 A CN201810475458 A CN 201810475458A CN 108712667 B CN108712667 B CN 108712667B
- Authority
- CN
- China
- Prior art keywords
- screen capture
- image
- voice
- instruction
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/4448—Receiver circuitry for the reception of television signals according to analogue transmission standards for frame-grabbing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a smart television, a screen capture application method and device thereof and a readable storage medium, wherein a current display image of a played video is captured and stored by recognizing the moment when a user starts voice input; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice command is an operation command related to screen capture; and when the voice instruction is determined to be the operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction. The method has the advantages that the screen capture operation is carried out at the beginning of voice input of a user by adopting the flow of screen capture and analysis, if the voice instruction of the user is analyzed to relate to the screen capture effect, the stored screen capture image can be directly adopted to carry out corresponding operation, the phenomenon that the voice identification misses the image required by the user is avoided, the screen capture image obtained by adopting the screen capture mode is more in line with the use intention of the user, and the accuracy of obtaining the screen capture image is improved.
Description
Technical Field
The invention relates to the technical field of multimedia, in particular to a smart television, a screen capture application method and device thereof and a readable storage medium.
Background
With the continuous development of the Internet technology, the smart television based on the Internet technology has an open platform, carries an operating system, and can realize the installation and use of various application software besides realizing the playing of common television programs. Especially, after the artificial intelligence technology is rapidly developed, the smart television can recognize the voice command of the user and execute corresponding operation according to the voice command.
In an application scenario, if a user is interested in an article or a person in an image in a video when viewing the image and wants to know related information further, a voice instruction can be directly sent to the smart television to control the smart television to further display the information related to the article or the person in the image. At present, after receiving a voice instruction of a user, a smart television generally performs screenshot operation on a video according to the voice instruction, and then displays information related to the screenshot. The process of inputting voice by a user and recognizing the input voice all needs a period of time, so that the image obtained by the screen capture of the smart television is not always the image required by the user, and further displayed information related to the image is not required by the user, thereby causing poor user experience.
Disclosure of Invention
The invention provides a smart television, a screen capture application method and device thereof and a readable storage medium, which are used for quickly responding to screen capture, improving the accuracy of screen capture application and adapting to the use intention of a user.
In a first aspect, the present invention provides a screen capture application method for a smart television, including:
at the moment that the user starts voice input is identified, a current display image of a played video is subjected to screen capture, and the screen capture image is stored;
when the voice input of the user is finished, converting the input voice into a voice command;
analyzing whether the voice instruction is an operation instruction related to screen capture;
when the voice instruction is determined to be an operation instruction related to screen capture, displaying the screen capture image and determining whether the screen capture image obtains a prompt box successfully;
when receiving an indication for determining that screen capture image acquisition fails, displaying a prompt box for judging whether to enter a backspacing screen capture operation;
when an instruction of entering a backspacing screen capturing operation is received, a current display image is used as a starting image to backspace a playing video;
when a pause operation instruction is received, a current display image is subjected to screen capture;
and executing corresponding operation on the current screen capture image according to the voice instruction.
In an implementable manner, in the method provided by the present invention, when the voice instruction is an operation instruction unrelated to screen capture, the method further includes:
and deleting the stored screen capture image.
In an implementable manner, in the method provided by the present invention, when an indication that the screenshot image acquisition is successful is received, a corresponding operation is performed on the stored screenshot image according to the voice instruction.
In an implementable manner, in the above method provided by the present invention, when the voice instruction is an image recognition instruction, the performing, according to the voice instruction, a corresponding operation on the current screenshot image includes:
identifying image elements contained in the voice command in the current screen capture image;
and searching the information related to the image elements for display.
In an implementable manner, the method provided by the present invention further includes:
when key values used for image recognition and sent by a user through remote control equipment are received, screen capture is carried out on a current display image of a playing video;
and searching information related to each image element contained in the screen capture image for display.
In an implementable manner, the invention provides the above method wherein the image element comprises: characters, articles, two-dimensional codes and station captions.
In a second aspect, the present invention provides a screen capture application device for a smart tv, including:
the screen capture module is used for capturing the screen of the current display image of the played video and storing the captured image when the moment that the user starts voice input is identified;
the conversion module is used for converting the input voice into a voice instruction when the voice input of the user is finished;
the analysis module is used for analyzing whether the voice instruction is an operation instruction related to screen capture;
the judging module is used for displaying the screen capture image and determining whether the screen capture image obtains a prompt box successfully or not when the voice instruction is determined to be the operation instruction related to the screen capture; when receiving an indication for determining that screen capture image acquisition fails, displaying a prompt box for judging whether to enter a backspacing screen capture operation;
the application module is used for backspacing and playing a video by taking a current display image as a starting image when receiving an instruction of entering backspacing screen capturing operation;
the screen capturing module is also used for capturing the screen of the current display image when receiving the pause operation instruction;
the application module is further used for executing corresponding operation on the current screen capture image according to the voice instruction.
In a third aspect, the present invention provides a smart tv, including:
a memory for storing program instructions;
a processor for invoking the program instructions stored in the memory, the program instructions when executed capable of implementing the steps of: at the moment that the user starts voice input is identified, a current display image of a played video is subjected to screen capture, and the screen capture image is stored; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice instruction is an operation instruction related to screen capture; and when the voice instruction is determined to be an operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction.
In a fourth aspect, the present invention provides a readable storage medium, where the readable storage medium stores smart television executable instructions, where the smart television executable instructions are configured to cause a smart television to perform any one of the methods described above.
According to the intelligent television, the screen capture application method and device and the readable storage medium thereof, the current display image of the played video is captured and stored at the moment when the user starts voice input; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice command is an operation command related to screen capture; and when the voice instruction is determined to be the operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction. The screen capture application method provided by the invention adopts the flow of screen capture first and then analysis, the screen capture operation is carried out at the beginning of the voice input of the user, and after the voice input of the user is finished, if the analyzed voice instruction of the user relates to the screen capture effect, the stored screen capture image can be directly adopted to carry out corresponding operation, so that the phenomenon that the image required by the user is missed due to voice recognition is avoided, the screen capture image obtained by adopting the screen capture mode is more suitable for the use intention of the user, and the accuracy of obtaining the screen capture image is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is one of schematic flow charts of a screen capture application method of a smart television according to an embodiment of the present invention;
fig. 2 is a second schematic flowchart of a screen capture application method of a smart television according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a screen capture application device of a smart television according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an intelligent television according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart illustrating a screen capture application method of a smart television according to an embodiment of the present invention, where as shown in fig. 1, the method includes:
s101, at the moment that the user starts voice input, capturing a screen of a current display image of a played video and storing the captured image;
s102, converting the input voice into a voice command when the voice input of the user is finished;
s103, analyzing whether the voice command is an operation command related to screen capture;
and S104, when the voice command is determined to be the operation command related to screen capture, executing corresponding operation on the stored screen capture image according to the voice command.
Aiming at the problem that screen capture is often delayed when a voice instruction controls the screen capture in the prior art, the embodiment of the invention provides a screen capture application method of a smart television. The method and the device have the advantages that the displayed image watched by the user at the beginning of voice input is the image required by the user, and the voice input by the user is also the instruction for carrying out related operation on the image, so that the screenshot image obtained by carrying out screenshot operation at the moment is most in line with the requirements of the user.
In practical application, the smart television can be integrated with a voice recognition related functional module or an application program, and a screen capture instruction is triggered when voice input of a user is recognized, so that the smart television is controlled to execute screen capture operation. Or, a module or a program with a voice recognition function is integrated in the remote control device, and a screen capture control signal is sent to the intelligent television by the remote control device at the beginning of recognizing the voice input so that the intelligent television can execute the screen capture operation. The remote control device may be a smart phone, a tablet computer, a remote controller, etc. which establishes a communication connection with the smart television, and is not limited herein. Determining whether the voice instruction is an operation instruction related to screen capture, which needs to be determined according to the content of the voice instruction, for example, if the voice instruction involves operations such as querying, searching, image sharing, and the like on elements in an image, then the screen capture needs to be performed before the image recognition or image processing, and at this time, it may be determined that the voice instruction is the operation instruction related to screen capture, that is, if the operation indicated by the voice instruction needs to be performed, the voice instruction is the operation instruction related to screen capture; and if the voice command relates to operations such as fast forwarding, channel switching and the like, namely the voice command does not need to be shot to execute the operations, the voice command is an operation command which is not related to the shot.
Further, in specific implementation, if the analyzed voice command is an operation command irrelevant to screen capture after the screen capture operation is performed first, the screen capture image stored in the initial screen capture of the voice input does not have subsequent use, and at this time, the stored screen capture image can be deleted to release the storage space without occupying the memory.
The screen capture application method provided by the embodiment of the invention can effectively improve the matching degree of the screen capture image and the user intention, but can not completely eliminate the possibility of screen capture failure. This is because a time period is required even when the voice input of the user is recognized, and although the time period is short, it is impossible to avoid a screen capture lag caused by the minute time period. Therefore, in the foregoing method provided by the embodiment of the present invention, in step S104, before performing corresponding operations on the stored screenshot image according to the voice instruction, the method may further include the following steps:
and displaying the screen capture image and determining whether the screen capture image is successfully acquired.
In practical application, after the smart television displays the prompt box, a user can select whether the key value indicating that the screen capturing image is successfully acquired or not through the remote control equipment; if the user finds that the screenshot image is really the image which is interested before, the key value which is successful in obtaining the screenshot image can be selected to be sent to the intelligent television, and if the user finds that the screenshot image is not the image which is interested before, the key value which is failed in obtaining the screenshot image can be sent to the intelligent television. The smart television receives the key value of successful acquisition of the screen capture image, namely receives the indication of successful acquisition of the screen capture image, and receives the key value of failed acquisition of the screen capture image, namely receives the indication of failed acquisition of the screen capture image.
Accordingly, in the above step S104, the corresponding operations are performed on the stored screenshot image according to the voice instruction, including:
and when receiving an instruction for determining that the screen capture image is successfully acquired, executing corresponding operation on the screen capture image according to the voice instruction.
By displaying the prompt box, the user confirms whether the screen capture image stored in the screen capture mode before is the image which is interested by the user when the user initiates the voice instruction, and corresponding operation is executed on the screen capture image only when the user confirms that the screen capture image is successful, so that misoperation or useless operation caused by failure in obtaining the screen capture image can be avoided.
Further, if in the above step, the user determines that the screenshot image is not a previous image of interest and selects a key value for which screenshot image acquisition failed to send to the smart television, at this time, the method provided in the embodiment of the present invention may further include the following step:
a prompt box for displaying whether to enter a backspacing screen capturing operation;
when an instruction of entering a backspacing screen capturing operation is received, a current display image is used as a starting image to backspace a playing video;
when a pause operation instruction is received, a current display image is subjected to screen capture;
and executing corresponding operation on the current screen capture image according to the voice instruction.
Specifically, the "rewind screen capture" operation in the embodiment of the present invention refers to playing the currently displayed image of the video as the starting image, and playing the video in the reverse order. For example, the video frames played by the current time sequence are a1, a2, a3, a4, a5 and a6, when the frame image a6 is played, the backspacing screen capture operation is indicated to be entered, and the video frames to be played are a6, a5, a4, a3, a2 and a 1. In the process of playing back the video, if the user finds an image which is interested before but has no screen capture success, the user can trigger an instruction of playing the video pause through the remote control device at the moment, the display image freezes on the display image during the pause, then the screen capture operation is executed at the moment, and the acquired screen capture image is determined to be the frame of display image which is interested before by the user. For example, the displayed image that the user is interested in before is image frame a4, when playing back the video to image frame a4, the user operates the pause key of the remote control device, the video is frozen at image frame a4, and the captured image acquired when the screen capture operation is performed is a4, so that the image that the user is interested in is acquired successfully.
According to the screen capture application method provided by the embodiment of the invention, the screen capture operation at the voice input moment is combined with the screen capture operation of backspacing, so that the screen capture image is more in line with the use intention of the user, and meanwhile, the requirements of the user can be realized in other modes when the screen capture image is failed to be obtained, the normal use of the user is not influenced, and the use experience of the user is improved.
In summary, for various situations that may occur in an application, as shown in fig. 2, the screen capture application method of the smart television provided in the embodiment of the present invention may include the following steps:
s201, at the moment of recognizing the voice input of a user, capturing a screen of a current display image of a played video and storing the captured image;
s202, when the voice input of the user is finished, converting the input voice into a voice command;
s203, analyzing whether the voice command is an operation command related to screen capture, and executing the step S204 when the voice command is the operation command related to screen capture; when the voice instruction is an operation instruction irrelevant to screen capture, executing step S211;
s204, displaying a prompt box for determining whether the acquisition of the screen capture image is successful, and executing the step S205 when receiving an instruction for determining the acquisition success of the screen capture image; executing step S206 upon receiving an instruction to determine that screen capture image acquisition has failed;
s205, corresponding operation is executed on the screen capture image according to the voice instruction;
s206, displaying a prompt box for judging whether to enter the backspacing screen capturing operation, and executing the steps S207-S209 when receiving an instruction for entering the backspacing screen capturing operation; executing step S210 upon receiving an instruction to abort entry into the fallback screen capture operation;
s207, backspacing and playing a video by taking the current display image as a starting image;
s208, when a pause operation instruction is received, screen capturing is carried out on the current display image;
s209, executing corresponding operation on the current screen capture image according to the voice instruction;
s210, continuing to play the current video;
and S211, deleting the screen shot image.
According to the method provided by the embodiment of the invention, the screen capture operation of the intelligent television is optimized by combining the voice instruction screen capture with the backspacing screen capture, so that the method is more suitable for the requirements of users, and ensures that the users can find the interested images to perform corresponding operation.
In practical applications, the voice command may be a screen capture command, or may be another command for performing a related operation on the image based on the screen capture. And when the voice command is a screen capture command, performing screen capture in the manner and storing the screen capture image. And when the voice command is other commands, further corresponding operations need to be carried out on the screen capture image.
Specifically, when the voice instruction is an image recognition instruction, in step S104, performing corresponding operation on the stored screenshot image according to the voice instruction may specifically include:
recognizing image elements contained in the voice command in the screen shot image;
and searching information related to the image elements for display.
In implementation, the voice input by the user usually includes the name of the image element interested in the screenshot image, so that the keyword of the image element can be extracted when the input voice is analyzed, and the image element corresponding to the keyword is identified in the screenshot image. After the image element is analyzed, information related to the image element can be searched for and displayed. The intelligent television can search the information related to the image elements in a database, can also search the related information in the Internet, and then displays the information on the intelligent television. In addition, one or more image elements in the voice command can be provided, meanwhile, the smart television can also realize image recognition of a whole scene, simultaneously recognize different image elements in the same image, and after related information is searched, the image elements can be classified according to the image elements, and the related information of each image element is displayed.
For example, when a user is interested in a certain actor in a currently displayed image when watching a video, and wants to further know the information related to the actor, voice input may be performed, for example, the user inputs a voice "who the person is," when the user starts to perform voice input, a screen capture operation is performed to store a screen capture image of the actor, when an image element interested by the user is analyzed as a person after voice recognition, the person in the screen capture image is recognized, for example, the screen capture image may be subjected to image processing, a face image is extracted, and the face image is matched with a face image in a database or a cloud, so that who the person included in the image is determined, information related to the person is further searched, and the searched person information is displayed.
In addition, a dedicated function key may be set on a remote control device that is configured with the smart television for a function of quickly performing image recognition, and when a user operates the function key, the remote control device sends an image recognition instruction to the smart television, and specifically, for an application scenario in which the dedicated key is set, the method provided in the embodiment of the present invention may further include:
when key values used for image recognition and sent by a user through remote control equipment are received, screen capture is carried out on a current display image of a playing video;
and searching information related to each image element contained in the screen capture image for display.
If the user encounters an interested article, a person and the like in the process of watching the video, the user can directly operate the special function key, and when the intelligent television receives the function key value, the intelligent television can capture the current display image of the played video, search relevant information of each image element in the captured image and display the searched information.
In practical application, the smart television can be provided with the function keys and has a voice recognition function, and the two modes can trigger the function of recognizing the full-scene image of the current display image by the smart television. The user can perform image recognition on the interested image by operating the function key or voice input so as to further acquire related information, interaction between the smart television and the user is enriched, and user experience is improved.
The image elements may include: characters, articles, two-dimensional codes, station logos, and the like. Each image element contained in the screenshot image can be extracted and matched through an image processing technology, and when the image element is identified as a person, information such as basic information of the person and latest information related to the person can be displayed; when the identified image element is an article, information such as the name, performance, purchasing route and the like of the article can be displayed; when the identified image element is a two-dimensional code, the two-dimensional code can be further scanned to enter a link corresponding to the two-dimensional code; when the identified image element is the station caption, a recent playing program list of a television station corresponding to the station caption can be displayed for the user to directly cut in after selection. Besides, other image elements can be included in the screenshot image, which is not listed here, and all modes of image screenshot and image recognition achieved by using the inventive concept belong to the protection scope of the present invention.
Based on the same inventive concept, the embodiment of the invention further provides a screen capture application device of the smart television, the functions realized by the components included in the device can be referred to the screen capture application method of the smart television, and repeated parts are not repeated. Specifically, as shown in fig. 3, the screen capture application apparatus for the smart television provided in the embodiment of the present invention specifically includes:
the screen capture module 31 is used for capturing a screen of a current display image of a played video and storing the captured image when the moment that the user starts voice input is identified;
a conversion module 32, configured to convert an input voice into a voice instruction when the voice input of the user is finished;
the analysis module 33 is used for analyzing whether the voice instruction is an operation instruction related to screen capture;
and the application module 34 is used for executing corresponding operation on the stored screen capture image according to the voice instruction when the voice instruction is determined to be the operation instruction related to the screen capture.
The screen capture application device provided by the invention adopts the flow of screen capture first and then analysis, screen capture operation is carried out at the beginning of voice input of a user, and after the voice input of the user is finished, if the voice instruction of the user is analyzed to relate to the screen capture effect, the stored screen capture image can be directly adopted to carry out corresponding operation, so that the phenomenon that the image required by the user is missed due to voice recognition is avoided, the screen capture image obtained by adopting the screen capture mode is more suitable for the use intention of the user, and the accuracy of obtaining the screen capture image is improved.
Optionally, the application module 34 is further configured to delete the stored screenshot image when the voice instruction is an operation instruction unrelated to the screenshot.
Optionally, the apparatus provided in the embodiment of the present invention further includes a determining module not shown in the figure;
the judging module is used for displaying the screen capture image and determining whether the screen capture image obtains a prompt box successfully or not before corresponding operation is executed on the stored screen capture image according to the voice instruction;
the application module 34 is specifically configured to, when receiving an indication that it is determined that the screen capture image is successfully acquired, perform a corresponding operation on the screen capture image according to the voice instruction.
Optionally, the determining module is further configured to display a prompt box indicating whether to enter a rollback screen capture operation when receiving an indication that it is determined that screen capture image acquisition has failed;
the application module 34 is further configured to, when receiving an instruction to enter a rewind screen capture operation, rewind and play the video by using the current display image as a starting image;
the screen capturing module 31 is further configured to capture a screen of the current display image when the pause operation instruction is received;
and the application module 34 is further configured to perform a corresponding operation on the current screen capture image according to the voice instruction.
Optionally, the application module 34 is specifically configured to, when the voice instruction is an image recognition instruction, recognize an image element included in the voice instruction in the screen capture image; and searching information related to the image elements for display.
Optionally, the application module 34 is further configured to capture a current display image of the playing video when receiving a key value for image recognition sent by a user through a remote control device; and searching information related to each image element contained in the screen capture image for display.
Optionally, the image element comprises: characters, articles, two-dimensional codes and station captions.
On the other hand, an embodiment of the present invention further provides a smart television, as shown in fig. 4, the smart television may include:
a memory 41 for storing program instructions;
a processor 42 for calling the program instructions stored in the memory and executing, according to the obtained program: at the moment that the user starts voice input is identified, a current display image of a played video is subjected to screen capture, and the screen capture image is stored; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice command is an operation command related to screen capture; and when the voice instruction is determined to be the operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction.
In addition, the embodiment of the invention also provides a readable storage medium, wherein the readable storage medium stores an executable instruction of the smart television, and the executable instruction of the smart television is used for enabling the smart television to execute any screen capturing application method.
According to the intelligent television, the screen capture application method and device and the readable storage medium thereof, the current display image of the played video is captured and stored at the moment when the user starts voice input; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice command is an operation command related to screen capture; and when the voice instruction is determined to be the operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction. The screen capture application method provided by the invention adopts the flow of screen capture first and then analysis, the screen capture operation is carried out at the beginning of the voice input of the user, and after the voice input of the user is finished, if the analyzed voice instruction of the user relates to the screen capture effect, the stored screen capture image can be directly adopted to carry out corresponding operation, so that the phenomenon that the image required by the user is missed due to voice recognition is avoided, the screen capture image obtained by adopting the screen capture mode is more suitable for the use intention of the user, and the accuracy of obtaining the screen capture image is improved.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (9)
1. A screen capture application method of a smart television is characterized by comprising the following steps:
at the moment that the user starts voice input is identified, a current display image of a played video is subjected to screen capture, and the screen capture image is stored;
when the voice input of the user is finished, converting the input voice into a voice command;
analyzing whether the voice instruction is an operation instruction related to screen capture;
when the voice instruction is determined to be an operation instruction related to screen capture, displaying the screen capture image and determining whether the screen capture image obtains a prompt box successfully;
when receiving an indication for determining that screen capture image acquisition fails, displaying a prompt box for judging whether to enter a backspacing screen capture operation;
when an instruction of entering a backspacing screen capturing operation is received, a current display image is used as a starting image to backspace a playing video;
when a pause operation instruction is received, a current display image is subjected to screen capture;
and executing corresponding operation on the current screen capture image according to the voice instruction.
2. The method of claim 1, wherein when the voice instruction is an operation instruction not related to screen capture, further comprising:
and deleting the stored screen capture image.
3. The method of claim 1, wherein upon receiving an indication that the screenshot image acquisition is determined to be successful, performing a corresponding operation on the stored screenshot image according to the voice instruction.
4. The method of claim 1, wherein when the voice instruction is an image recognition instruction, the performing corresponding operation on the current screenshot image according to the voice instruction comprises:
identifying image elements contained in the voice command in the current screen capture image;
and searching the information related to the image elements for display.
5. The method of claim 1, further comprising:
when key values used for image recognition and sent by a user through remote control equipment are received, screen capture is carried out on a current display image of a playing video;
and searching information related to each image element contained in the screen capture image for display.
6. The method of claim 4 or 5, wherein the image element comprises: characters, articles, two-dimensional codes and station captions.
7. A screen capture application device of an intelligent television is characterized by comprising:
the screen capture module is used for capturing a screen of a current display image of a playing video and storing the captured image when the moment when the user starts voice input is recognized and before the voice input is finished;
the conversion module is used for converting the input voice into a voice instruction when the voice input of the user is finished;
the analysis module is used for analyzing whether the voice instruction is an operation instruction related to screen capture;
the judging module is used for displaying the screen capture image and determining whether the screen capture image obtains a prompt box successfully or not when the voice instruction is determined to be the operation instruction related to the screen capture; when receiving an indication for determining that screen capture image acquisition fails, displaying a prompt box for judging whether to enter a backspacing screen capture operation;
the application module is used for backspacing and playing a video by taking a current display image as a starting image when receiving an instruction of entering backspacing screen capturing operation;
the screen capturing module is also used for capturing the screen of the current display image when receiving the pause operation instruction;
the application module is further used for executing corresponding operation on the current screen capture image according to the voice instruction.
8. An intelligent television, comprising:
a memory for storing program instructions;
a processor for invoking the program instructions stored in the memory, the program instructions when executed capable of implementing the steps of: at the moment that the user starts voice input and before the voice input is finished, screen capturing is carried out on a current display image of a playing video, and the screen capturing image is stored; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice instruction is an operation instruction related to screen capture; when the voice instruction is determined to be an operation instruction related to screen capture, displaying the screen capture image and determining whether the screen capture image obtains a prompt box successfully; when receiving an indication for determining that screen capture image acquisition fails, displaying a prompt box for judging whether to enter a backspacing screen capture operation; when an instruction of entering a backspacing screen capturing operation is received, a current display image is used as a starting image to backspace a playing video; when a pause operation instruction is received, a current display image is subjected to screen capture; and executing corresponding operation on the current screen capture image according to the voice instruction.
9. A readable storage medium, wherein the readable storage medium stores smart tv executable instructions for causing the smart tv to perform the method of any one of claims 1-6.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810475458.0A CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
| CN202010080099.6A CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
| PCT/CN2018/121061 WO2019218656A1 (en) | 2018-05-17 | 2018-12-14 | Smart television and screenshot-taking application method therefor, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810475458.0A CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010080099.6A Division CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108712667A CN108712667A (en) | 2018-10-26 |
| CN108712667B true CN108712667B (en) | 2020-04-10 |
Family
ID=63869109
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810475458.0A Active CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
| CN202010080099.6A Active CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010080099.6A Active CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN108712667B (en) |
| WO (1) | WO2019218656A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108712667B (en) * | 2018-05-17 | 2020-04-10 | 聚好看科技股份有限公司 | Smart television, screen capture application method and device thereof, and readable storage medium |
| CN109582825B (en) * | 2018-12-07 | 2020-01-17 | 百度在线网络技术（北京）有限公司 | Method and apparatus for generating information |
| CN111372118A (en) * | 2018-12-25 | 2020-07-03 | 深圳Tcl新技术有限公司 | Screen capturing method, intelligent terminal and storage medium |
| CN109979462A (en) * | 2019-03-21 | 2019-07-05 | 广东小天才科技有限公司 | A kind of combination context of co-text obtains the method and system of intention |
| CN111696549A (en) * | 2020-06-02 | 2020-09-22 | 深圳创维－Rgb电子有限公司 | Picture searching method and device, electronic equipment and storage medium |
| CN113438360A (en) * | 2021-06-18 | 2021-09-24 | 当代世界(北京)信息科技研究院 | Screen capturing method of android client based on artificial intelligence and voice recognition |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103747351A (en) * | 2013-12-02 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Smart television screenshot method and device |
| CN104967889A (en) * | 2015-06-30 | 2015-10-07 | 小米科技有限责任公司 | Method used for controlling intelligent television to carry out video information processing and device |
| CN106412708A (en) * | 2016-10-21 | 2017-02-15 | 上海与德信息技术有限公司 | Video screenshot method and video screenshot device |
| CN106604089A (en) * | 2016-10-25 | 2017-04-26 | 北京小米移动软件有限公司 | Intelligent television screenshot sharing method and device |
| CN107105340A (en) * | 2017-03-21 | 2017-08-29 | 百度在线网络技术（北京）有限公司 | People information methods, devices and systems are shown in video based on artificial intelligence |
| CN107480236A (en) * | 2017-08-08 | 2017-12-15 | 深圳创维数字技术有限公司 | A kind of information query method, device, equipment and medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203504698U (en) * | 2013-07-17 | 2014-03-26 | 广州珠江数码集团有限公司 | Television direct broadcast screen capture system |
| CN104837030B (en) * | 2014-02-12 | 2019-04-16 | 中国电信股份有限公司 | A kind of HTTP Streaming Media realizes the method and system of fast forwarding and fast rewinding broadcasting |
| CN106708823A (en) * | 2015-07-20 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Search processing method, apparatus and system |
| CN108712667B (en) * | 2018-05-17 | 2020-04-10 | 聚好看科技股份有限公司 | Smart television, screen capture application method and device thereof, and readable storage medium |
| CN108632662B (en) * | 2018-05-17 | 2020-09-01 | 聚好看科技股份有限公司 | Television screen capturing method and device and equipment comprising television screen capturing device |
-
2018
- 2018-05-17 CN CN201810475458.0A patent/CN108712667B/en active Active
- 2018-05-17 CN CN202010080099.6A patent/CN111010598B/en active Active
- 2018-12-14 WO PCT/CN2018/121061 patent/WO2019218656A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103747351A (en) * | 2013-12-02 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Smart television screenshot method and device |
| CN104967889A (en) * | 2015-06-30 | 2015-10-07 | 小米科技有限责任公司 | Method used for controlling intelligent television to carry out video information processing and device |
| CN106412708A (en) * | 2016-10-21 | 2017-02-15 | 上海与德信息技术有限公司 | Video screenshot method and video screenshot device |
| CN106604089A (en) * | 2016-10-25 | 2017-04-26 | 北京小米移动软件有限公司 | Intelligent television screenshot sharing method and device |
| CN107105340A (en) * | 2017-03-21 | 2017-08-29 | 百度在线网络技术（北京）有限公司 | People information methods, devices and systems are shown in video based on artificial intelligence |
| CN107480236A (en) * | 2017-08-08 | 2017-12-15 | 深圳创维数字技术有限公司 | A kind of information query method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111010598B (en) | 2022-11-11 |
| CN111010598A (en) | 2020-04-14 |
| CN108712667A (en) | 2018-10-26 |
| WO2019218656A1 (en) | 2019-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108712667B (en) | Smart television, screen capture application method and device thereof, and readable storage medium | |
| RU2597232C1 (en) | Method for providing a video in real time and device for its implementation, as well as a server and a terminal device | |
| EP3188034A1 (en) | Display terminal-based data processing method | |
| CN110691281B (en) | Video playing processing method, terminal device, server and storage medium | |
| CN109640129B (en) | Video recommendation method and device, client device, server and storage medium | |
| CN109245997B (en) | Voice message playing method and device | |
| CN106982368B (en) | Video response speed detection method and system | |
| CN111901896A (en) | Information sharing method, information sharing device, electronic equipment and storage medium | |
| CN109766473B (en) | Information interaction method and device, electronic equipment and storage medium | |
| CN114025242A (en) | Video processing method, video processing device and electronic equipment | |
| AU2018432003B2 (en) | Video processing method and device, and terminal and storage medium | |
| CN112948704A (en) | Model training method and device for information recommendation, electronic equipment and medium | |
| CN111629270A (en) | Candidate item determination method and device and machine-readable medium | |
| CN113596574A (en) | Video processing method, video processing apparatus, electronic device, and readable storage medium | |
| CN111698261B (en) | Video playing method, device, equipment and storage medium based on streaming media | |
| CN111274449B (en) | Video playing method, device, electronic equipment and storage medium | |
| CN111897474A (en) | File processing method and electronic equipment | |
| CN107820133B (en) | Method, television and system for providing virtual reality video on television | |
| CN113709300B (en) | Display method and device | |
| CN108632662B (en) | Television screen capturing method and device and equipment comprising television screen capturing device | |
| CN113593614A (en) | Image processing method and device | |
| CN115689642A (en) | Media content recommendation method and device, electronic equipment and storage medium | |
| CN113537127A (en) | Film matching method, device, equipment and storage medium | |
| CN110691256B (en) | Video associated information processing method and device, server and storage medium | |
| CN115103213B (en) | Information processing method, apparatus, device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |