CN111010598B - Screen capture application method and smart television - Google Patents
Screen capture application method and smart television Download PDFInfo
- Publication number
- CN111010598B CN111010598B CN202010080099.6A CN202010080099A CN111010598B CN 111010598 B CN111010598 B CN 111010598B CN 202010080099 A CN202010080099 A CN 202010080099A CN 111010598 B CN111010598 B CN 111010598B
- Authority
- CN
- China
- Prior art keywords
- screen capture
- image
- voice
- instruction
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000006870 function Effects 0.000 claims description 33
- 230000001960 triggered effect Effects 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/4448—Receiver circuitry for the reception of television signals according to analogue transmission standards for frame-grabbing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a screen capture application method and an intelligent television, wherein when screen capture fails, if an operation instruction of backspacing screen capture is received, a video is backspacing played, and a current display image is captured in response to a received pause operation instruction; when screen capture fails, if an instruction of giving up entering a backspacing screen capture operation is received, the video is continuously played, and the image required by the user is avoided from being missed.
Description
The application is a divisional application of a Chinese patent application 201810475458.0 with the invention name of 'an intelligent television, a screen capturing application method and device thereof and a readable storage medium' proposed in 2018, 05, month and 17.
Technical Field
The invention relates to the technical field of multimedia, in particular to a screen capture application method and an intelligent television.
Background
With the continuous development of the Internet technology, the smart television based on the Internet technology has an open platform, carries an operating system, and can realize the installation and use of various application software besides realizing the playing of common television programs. Especially, after the artificial intelligence technology is rapidly developed, the smart television can recognize the voice command of the user and execute corresponding operation according to the voice command.
In an application scenario, if a user is interested in an article or a person in an image in a video when viewing the image and wants to know related information further, a voice instruction can be directly sent to the smart television to control the smart television to further display the information related to the article or the person in the image. At present, after receiving a voice instruction of a user, a smart television generally performs screenshot operation on a video according to the voice instruction, and then displays information related to the screenshot. The process of inputting voice by a user and recognizing the input voice all need a period of time, so that an image obtained by screen capturing of the smart television is often not an image required by the user, and further displayed information related to the image is also not required by the user, thereby causing poor user experience.
Disclosure of Invention
In a first aspect, the present application provides a screen capture application method for a smart television, including: responding to an input screen capture control signal, capturing a screen of a current display image of a playing video and storing a first screen capture image obtained by capturing the screen, wherein the screen capture control signal is sent to the smart television by remote control equipment when voice input is started; displaying the first screenshot image and determining whether the screenshot image is successfully acquired; when a first key value representing that the screen capture image is successfully acquired is received, identifying the person in the first screen capture image according to a voice instruction corresponding to the voice input, and when a second key value representing that the screen capture image is unsuccessfully acquired is received, displaying a prompt box for judging whether to rollback the screen capture operation so as to rollback the played video after the user confirms the rollback; and after the received pause operation instruction; pausing the video and carrying out screen capture on a current display image to obtain a second screen capture image, wherein the second screen capture image is used for identifying a person in the second screen capture image according to a voice instruction corresponding to the voice input.
Further, the voice instruction is generated by converting the input voice of the intelligent television when the voice input of the user is finished.
Further, the method further comprises: and if an instruction of abandoning to enter the backspacing screen capturing operation is received, continuing to play the video.
In a second aspect, the present application provides a screen capture application method for a smart television, including: receiving a screen capture control signal sent by a remote control device when a preset function key is triggered so as to perform screen capture operation on a video to obtain a screen capture image, wherein the preset function key is configured to be used for triggering a screen capture signal and a voice recognition function at the same time, and when the preset function key is operated, the remote control device is enabled to send the screen capture control signal to the smart television when voice input is started; when the voice input through the remote control equipment is finished, converting the received voice into a voice command; deleting the screen capture image when the voice instruction is an operation instruction irrelevant to screen capture; when the voice command is an operation command related to screen capture and the screen capture is successful, responding to the fact that the voice command is an image recognition command, and recognizing an image element corresponding to the voice command in the screen capture image; responding to other instructions except for the image recognition instruction in the operation instruction related to the screen capture with the voice instruction, and executing the operation corresponding to the other instructions based on the screen capture image; when the voice instruction is an operation instruction related to screen capture and screen capture fails, responding to and receiving an operation instruction of backspacing screen capture, backspacing and playing a video, and responding to a received pause operation instruction, and capturing a current display image; and responding to and receiving an instruction of abandoning to enter the backspacing screen capture operation, and continuing to play the video.
In a third aspect, the present application provides a screen capture application method for a smart television, including: receiving a screen capture control signal sent by a remote control device when a preset function key is triggered so as to execute screen capture operation to obtain a screen capture image, wherein the screen capture control signal is sent to the smart television when voice input is started; when the voice input by the remote control equipment is finished, converting the input voice into a voice command; deleting the screen capture image when the voice instruction is an operation instruction irrelevant to screen capture; and when the voice instruction is an operation instruction related to screen capture, executing an operation corresponding to the voice instruction based on the screen capture image.
Further, if the voice instruction is an operation instruction related to screen capture, executing an operation corresponding to the voice instruction based on the screen capture image, including: if the voice instruction is a screen capturing instruction, storing the screen capturing image; and if the voice instruction is other instructions except the screen capturing instruction in the operation instruction related to the screen capturing, executing the operation corresponding to the other instructions based on the screen capturing image.
Further, the preset function key is configured to be used for triggering a screen capture signal and a voice recognition function at the same time, and when the preset function key is operated, the remote control device is enabled to send the screen capture control signal to the smart television when voice input is started, and the voice recognition function is triggered at the same time.
In a fourth aspect, the present application provides a screen capture application method for a smart television, including: when receiving a voice input by the remote control equipment, executing screen capture operation to obtain a screen capture image; when the voice input by the remote control equipment is finished, converting the input voice into a voice command; deleting the screen capture image when the voice instruction is an operation instruction irrelevant to screen capture; and when the voice instruction is an operation instruction related to screen capture, executing an operation corresponding to the voice instruction based on the screen capture image.
In a fifth aspect, the present application provides a smart television, including: a memory for storing program instructions; a processor for invoking the program instructions stored in the memory to perform any of the methods described above.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is one of schematic flow charts of a screen capture application method of a smart television according to an embodiment of the present invention;
fig. 2 is a second schematic flowchart of a screen capture application method of a smart television according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a screen capture application device of a smart television according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an intelligent television according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart illustrating a screen capture application method of a smart television according to an embodiment of the present invention, where as shown in fig. 1, the method includes:
s101, at the moment that the user starts voice input, capturing a screen of a current display image of a played video and storing the captured image;
s102, when the voice input of the user is finished, converting the input voice into a voice command;
s103, analyzing whether the voice command is an operation command related to screen capture;
and S104, when the voice command is determined to be the operation command related to the screen capture, corresponding operation is executed on the stored screen capture image according to the voice command.
Aiming at the problem that screen capture is often delayed by voice command control in the prior art, some embodiments of the invention provide a screen capture application method for a smart television, wherein at the moment when voice input of a user just starts, screen capture operation is performed on a current display image, meanwhile, voice input of the user is still received, after the voice input is finished and converted into a voice command, whether the voice command is an operation command related to screen capture is analyzed, and if the analyzed voice command is the operation command related to screen capture, corresponding operation can be directly performed on a screen capture image obtained by screen capture just before the voice input starts.
In some embodiments, the displayed image that the user is viewing at the beginning of the voice input is the image that the user needs, and the voice input by the user is also an instruction for performing the relevant operation on the image, so the screen capture image obtained by performing the screen capture operation at this moment is most suitable for the user's requirement.
The embodiment of the invention adopts the operation flow of firstly screen capturing and then analyzing, avoids that the time occupied by voice recognition misses the image required by the user, and the screen capturing image obtained by adopting the screen capturing mode is more in line with the use intention of the user, thereby being beneficial to improving the accuracy of obtaining the screen capturing image and improving the use experience of the user.
In some embodiments, the smart television may be integrated with a voice recognition related function module or application program, and a screen capture instruction is triggered when voice input of a user is recognized to control the smart television to perform a screen capture operation.
In some embodiments, a module or program with a voice recognition function is integrated in the remote control device, and a screen capture control signal is transmitted to the smart television by the remote control device at the beginning of recognizing the voice input so as to enable the smart television to perform a screen capture operation.
In some embodiments, the remote control device may be a smart phone, a tablet computer, a remote controller, or the like, which establishes a communication connection with the smart television, and is not limited herein.
In some embodiments, it is determined whether the voice instruction is an operation instruction related to screen capture, and the determination needs to be performed according to the content of the voice instruction, for example, if the voice instruction involves operations such as querying, searching, image sharing, and the like on elements in an image, then the screen capture needs to be performed before the image recognition or image processing is performed on the screen capture image, and at this time, it may be determined that the voice instruction is the operation instruction related to screen capture, that is, if the operation indicated by the voice instruction must be performed by screen capture, the voice instruction is the operation instruction related to screen capture; and if the voice command relates to operations such as fast forwarding, channel switching and the like, namely the voice command does not need to be shot to execute the operations, the voice command is an operation command which is not related to the shot.
In some embodiments, if the parsed voice command is an operation command unrelated to screen capture after the screen capture operation is performed first, the screen capture image saved in the initial screen capture of the voice input has no subsequent use, and at this time, the stored screen capture image may be deleted to release the storage space without occupying the memory.
The screen capture application method provided by the embodiment of the invention can effectively improve the matching degree of the screen capture image and the user intention, but can not completely eliminate the possibility of screen capture failure. This is because a time period is required even when the voice input of the user is recognized, and although the time period is short, it is impossible to avoid a screen capture lag due to the minute time period.
Therefore, in some embodiments, in the foregoing method provided by an embodiment of the present invention, in step S104 described above, before performing corresponding operations on the stored screenshot image according to the voice instruction, the following steps may further be included:
and displaying the screen capture image and determining whether the screen capture image is successfully acquired.
In some embodiments, after the smart television displays the prompt box, a key value indicating whether the captured image is successfully acquired may be selected by the user through the remote control device.
In some embodiments, if the user checks that the screenshot image is really a previous image, the user may select a key value for successful screenshot image acquisition to send to the smart television.
In some embodiments, if the user is viewing that the screenshot image is not a previous image of interest, a key value selecting screenshot image acquisition failure may be sent to the smart television.
In some embodiments, the smart television receives a key value indicating that the screen capture image acquisition is successful when receiving the screen capture image acquisition success, and receives a key value indicating that the screen capture image acquisition is failed when receiving the screen capture image acquisition failure.
Accordingly, in some embodiments, in the step S104, the corresponding operation is performed on the stored screenshot image according to the voice instruction, and includes:
and when receiving an instruction for determining that the screen capture image is successfully acquired, executing corresponding operation on the screen capture image according to the voice instruction.
In some embodiments, by displaying the prompt box, the user confirms whether the screen capture image saved by screen capture is an image which is interested by the user when the user initiates a voice instruction, and only when the user confirms that the screen capture image is successful, the corresponding operation is performed on the screen capture image, so that misoperation or useless operation caused by screen capture image acquisition failure can be avoided.
In some embodiments, if in the above steps, the user confirms that the screenshot image is not a previous image of interest and selects a key value for the screenshot image acquisition failure to send to the smart television, at this time, the method provided in the embodiments of the present invention may further include the following steps:
a prompt box for displaying whether to enter a backspacing screen capturing operation;
when an instruction of entering a backspacing screen capturing operation is received, backspacing and playing a video by taking a current display image as a starting image;
when a pause operation instruction is received, a current display image is subjected to screen capture;
and executing corresponding operation on the current screen capture image according to the voice instruction.
In some embodiments, the "rewind screen capture" operation in the embodiments of the present invention refers to playing the currently displayed image of the video as the starting image, and playing the video in a reverse order.
Illustratively, the video frames played by the current time sequence are a1, a2, a3, a4, a5, a6, and when the frame image a6 is played, the backspacing screen capture operation is instructed to be entered, and the video frames to be played are a6, a5, a4, a3, a2, a1.
In the process of playing back the video, if the user finds an image which is interested before but has no screen capture success, the user can trigger an instruction of playing the video pause through the remote control device at the moment, the display image freezes on the display image during the pause, then the screen capture operation is executed at the moment, and the acquired screen capture image is determined to be the frame of display image which is interested before by the user. For example, the displayed image which is interested by the user before is the image frame a4, when the video is played back to the image frame a4, the user operates a pause key of the remote control device, the video is frozen at the image frame a4, and at this time, the captured image acquired when the screen capturing operation is performed is the image frame a4, so that the image which is interested by the user is acquired successfully.
According to the screen capture application method provided by the embodiment of the invention, the screen capture operation at the voice input moment is combined with the screen capture operation of backspacing, so that the screen capture image is more in line with the use intention of the user, and meanwhile, the requirements of the user can be realized in other modes when the screen capture image is failed to be obtained, the normal use of the user is not influenced, and the use experience of the user is improved.
In summary, for various situations that may occur in an application, as shown in fig. 2, the screen capture application method for a smart television according to an embodiment of the present invention may include the following steps:
s201, at the moment of recognizing the voice input of a user, capturing a screen of a current display image of a played video and storing the captured image;
s202, when the voice input of the user is finished, converting the input voice into a voice command;
s203, analyzing whether the voice command is an operation command related to screen capture, and executing the step S204 when the voice command is the operation command related to screen capture; when the voice instruction is an operation instruction irrelevant to screen capture, executing step S211;
s204, displaying a prompt box for determining whether the acquisition of the screen capture image is successful, and executing the step S205 when receiving an instruction for determining the acquisition success of the screen capture image; executing step S206 upon receiving an instruction to determine that screen capture image acquisition has failed;
s205, corresponding operation is executed on the screen capture image according to the voice instruction;
s206, displaying a prompt box for judging whether to enter the backspacing screen capturing operation, and executing the steps S207-S209 when receiving an instruction for entering the backspacing screen capturing operation; executing step S210 when receiving an instruction to abort entry into the fallback screen capture operation;
s207, backspacing and playing a video by taking the current display image as a starting image;
s208, when a pause operation instruction is received, screen capturing is carried out on the current display image;
s209, executing corresponding operation on the current screen capture image according to the voice instruction;
s210, continuing to play the current video;
and S211, deleting the screen shot image.
According to the method provided by the embodiment of the invention, the screen capture operation of the intelligent television is optimized by combining the voice instruction screen capture with the backspacing screen capture, so that the method is more suitable for the requirements of users, and ensures that the users can find the interested images to perform corresponding operation.
In some embodiments, the voice command may be a screen capture command, or may be another command for performing an operation related to the image on the basis of the screen capture.
In some embodiments, when the voice command is a screen capture command, a screen capture is performed and the captured image is stored in the manner described above. And when the voice command is other commands, further corresponding operations need to be carried out on the screen capture image.
Specifically, when the voice instruction is an image recognition instruction, in step S104, performing corresponding operation on the stored screenshot image according to the voice instruction may specifically include:
recognizing image elements contained in the voice command in the screen shot image;
and searching information related to the image elements for display.
In some embodiments, the voice input by the user usually includes the name of the image element interested in the screenshot image, so that when the input voice is parsed, the keyword of the image element can be extracted, and the image element corresponding to the keyword is identified in the screenshot image.
In some embodiments, after analysis of the image element, information related to the image element may be searched for display.
In some embodiments, the smart television may search for the information related to the image element in a database, or may search for related information on the internet, and then display the information on the smart television.
In some embodiments, one or more image elements in the voice instruction may be provided, and the smart television may also implement image recognition of a whole scene, recognize different image elements in the same image at the same time, and after related information search is performed, may classify according to the image elements, and display information related to each image element.
For example, when a user is interested in a certain actor in a currently displayed image when watching a video, and wants to further know the information related to the actor, voice input may be performed, for example, the user inputs a voice "who the person is," when the user starts to perform voice input, a screen capture operation is performed to store a screen capture image of the actor, when an image element interested by the user is analyzed as a person after voice recognition, the person in the screen capture image is recognized, for example, the screen capture image may be subjected to image processing, a face image is extracted, and the face image is matched with a face image in a database or a cloud, so that who the person included in the image is determined, information related to the person is further searched, and the searched person information is displayed.
In addition, in some embodiments, a dedicated function key may be set on a remote control device associated with the smart television for a function of performing image recognition quickly, and when a user operates the function key, the remote control device sends an image recognition instruction to the smart television.
In some embodiments, for an application scenario in which a dedicated key is set, the method provided in the embodiments of the present invention may further include:
when key values used for image recognition and sent by a user through remote control equipment are received, screen capture is carried out on a current display image of a playing video;
information related to each image element contained in the screen shot image is searched for display.
If the user encounters an interested article, a person and the like in the process of watching the video, the user can directly operate the special function key, and when the intelligent television receives the function key value, the intelligent television can capture the current display image of the played video, search relevant information of each image element in the captured image and display the searched information.
In practical application, the smart television can be provided with the function keys and has a voice recognition function.
In some embodiments, both of the above manners may trigger the function of the smart television to identify the full-scene image of the currently displayed image. The user can perform image recognition on the interested image by operating the function key or voice input so as to further acquire related information, interaction between the smart television and the user is enriched, and user experience is improved.
In some embodiments, the image elements may include: characters, articles, two-dimensional codes, station logos, and the like. Each image element contained in the screenshot image can be extracted and matched through an image processing technology.
In some embodiments, when a picture element is identified as a person, information such as basic information of the person, and latest information related to the person may be displayed.
In some embodiments, when the identified image element is an item, information such as the name, performance, and purchase route of the item may be displayed.
In some embodiments, when the identified image element is a two-dimensional code, the two-dimensional code may be further scanned to enter a link corresponding to the two-dimensional code.
In some embodiments, when the identified image element is a station caption, a recent broadcast program list of a television station corresponding to the station caption may be displayed for direct cut-in after selection by a user.
In some embodiments, other image elements may be included in the screenshot image, which is not listed here, and all ways of image screenshot and image recognition achieved by using the inventive concept belong to the scope of the present invention.
Based on the same inventive concept, the embodiment of the invention further provides a screen capture application device of the smart television, and the functions realized by the components included in the device can be referred to the screen capture application method of the smart television, and repeated parts are not repeated. Specifically, as shown in fig. 3, the screen capture application apparatus for a smart television provided in the embodiment of the present invention specifically includes:
the screen capture module 31 is used for capturing a screen of a current display image of a played video and storing the captured image when the moment that the user starts voice input is identified;
a conversion module 32, configured to convert an input voice into a voice instruction when the voice input of the user is finished;
the analysis module 33 is used for analyzing whether the voice instruction is an operation instruction related to screen capture;
and the application module 34 is used for executing corresponding operation on the stored screen capture image according to the voice instruction when the voice instruction is determined to be the operation instruction related to the screen capture.
The screen capture application device provided by the invention adopts the flow of screen capture first and then analysis, screen capture operation is carried out at the beginning of voice input of a user, and after the voice input of the user is finished, if the voice instruction of the user is analyzed to relate to the screen capture effect, the stored screen capture image can be directly adopted to carry out corresponding operation, so that the phenomenon that the image required by the user is missed due to voice recognition is avoided, the screen capture image obtained by adopting the screen capture mode is more suitable for the use intention of the user, and the accuracy of obtaining the screen capture image is improved.
Optionally, the application module 34 is further configured to delete the stored screenshot image when the voice instruction is an operation instruction unrelated to the screenshot.
Optionally, the apparatus provided in the embodiment of the present invention further includes a determining module not shown in the figure;
the judging module is used for displaying the screen capture image and determining whether the screen capture image obtains a successful prompt box before corresponding operation is executed on the stored screen capture image according to the voice instruction;
the application module 34 is specifically configured to, when receiving an indication that it is determined that the screenshot image is successfully acquired, perform a corresponding operation on the screenshot image according to the voice instruction.
Optionally, the determining module is further configured to display a prompt box indicating whether to enter a rollback screen capturing operation when receiving an indication of determining that screen capturing image acquisition fails;
the application module 34 is further configured to, when receiving an instruction to enter a rollback screen capturing operation, rewind and play a video by using a current display image as a starting image;
the screen capturing module 31 is further configured to capture a screen of the current display image when the pause operation instruction is received;
and the application module 34 is further configured to perform a corresponding operation on the current screen capture image according to the voice instruction.
Optionally, the application module 34 is specifically configured to, when the voice instruction is an image recognition instruction, recognize an image element included in the voice instruction in the screen capture image; and searching information related to the image elements for display.
Optionally, the application module 34 is further configured to capture a current display image of the played video when receiving a key value for image recognition sent by a user through a remote control device; and searching information related to each image element contained in the screen capture image for display.
Optionally, the image element comprises: characters, articles, two-dimensional codes and station captions.
On the other hand, an embodiment of the present invention further provides a smart television, as shown in fig. 4, the smart television may include:
a memory 41 for storing program instructions;
a processor 42 for calling the program instructions stored in the memory and executing, according to the obtained program: at the moment that the user starts voice input is identified, a current display image of a played video is subjected to screen capture, and the screen capture image is stored; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice command is an operation command related to screen capture; and when the voice instruction is determined to be the operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction.
In addition, the embodiment of the invention also provides a readable storage medium, wherein the readable storage medium stores an executable instruction of the smart television, and the executable instruction of the smart television is used for enabling the smart television to execute any screen capturing application method.
According to the intelligent television, the screen capture application method and device and the readable storage medium thereof, the current display image of the played video is captured and stored at the moment when the user starts voice input; when the voice input of the user is finished, converting the input voice into a voice command; analyzing whether the voice command is an operation command related to screen capture; and when the voice instruction is determined to be the operation instruction related to screen capture, corresponding operation is performed on the stored screen capture image according to the voice instruction. The screen capture application method provided by the invention adopts the flow of screen capture first and then analysis, the screen capture operation is carried out at the beginning of the voice input of the user, and after the voice input of the user is finished, if the analyzed voice instruction of the user relates to the screen capture effect, the stored screen capture image can be directly adopted to carry out corresponding operation, so that the phenomenon that the image required by the user is missed due to voice recognition is avoided, the screen capture image obtained by adopting the screen capture mode is more suitable for the use intention of the user, and the accuracy of obtaining the screen capture image is improved.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (9)
1. A screen capture application method of a smart television is characterized by comprising the following steps:
responding to an input screen capture control signal, capturing a screen of a current display image of a playing video and storing a first screen capture image obtained by screen capture, wherein the screen capture control signal is sent to the smart television when the remote control device starts voice input;
displaying the first screenshot image and determining whether the screenshot image is successfully acquired;
when a first key value representing that the screen capture image is successfully acquired is received, identifying the person in the first screen capture image according to a voice instruction corresponding to the voice input,
when a second key value representing screen capture image acquisition failure is received, displaying a prompt box for judging whether to back off screen capture operation so as to back off a played video after a user confirms the back off; and after the received pause operation instruction; pausing the video and capturing a current display image to obtain a second captured image, wherein the second captured image is used for identifying a person in the second captured image according to a voice instruction corresponding to the voice input.
2. The method of claim 1, wherein the voice instruction is generated by the smart television converting an input voice at the end of a user's voice input.
3. The method of claim 1 or 2, further comprising:
and if an instruction of abandoning the backspacing screen capturing operation is received, continuing playing the video.
4. A screen capture application method of a smart television is characterized by comprising the following steps:
receiving a screen capture control signal sent by a remote control device when a preset function key is triggered so as to perform screen capture operation on a video to obtain a screen capture image, wherein the preset function key is configured to be used for triggering a screen capture signal and a voice recognition function at the same time, and when the preset function key is operated, the remote control device is enabled to send the screen capture control signal to the smart television when voice input is started;
when the voice input through the remote control equipment is finished, converting the received voice into a voice command;
deleting the screen capture image when the voice instruction is an operation instruction irrelevant to screen capture;
when the voice instruction is an operation instruction related to screen capture and the screen capture is successful, responding to the fact that the voice instruction is an image recognition instruction, and recognizing an image element corresponding to the voice instruction in the screen capture image; responding to other instructions except for the image recognition instruction in the operation instruction related to the screen capture in the voice instruction, and executing the operation corresponding to the other instructions based on the screen capture image;
when the voice instruction is an operation instruction related to screen capture and screen capture fails, responding to and receiving an operation instruction of backspacing screen capture, backspacing and playing a video, and responding to a received pause operation instruction, and capturing a current display image; and responding to and receiving an instruction of abandoning to enter the backspacing screen capture operation, and continuing to play the video.
5. A screen capture application method of a smart television is characterized by comprising the following steps:
receiving a screen capture control signal sent by a remote control device when a preset function key is triggered so as to execute screen capture operation to obtain a screen capture image, wherein the screen capture control signal is sent to the smart television when voice input is started;
when the voice input by the remote control equipment is finished, converting the input voice into a voice command;
deleting the screen capture image when the voice instruction is an operation instruction irrelevant to screen capture;
and when the voice instruction is an operation instruction related to screen capture, executing an operation corresponding to the voice instruction based on the screen capture image.
6. The method of claim 5, wherein if the voice command is an operation command related to screen capture, performing an operation corresponding to the voice command based on the screen capture image comprises:
if the voice instruction is a screen capturing instruction, storing the screen capturing image;
and if the voice instruction is other instructions except the screen capturing instruction in the operation instruction related to the screen capturing, executing the operation corresponding to the other instructions based on the screen capturing image.
7. The method of claim 5, wherein the preset function key is configured to be used for simultaneously triggering a screen capture signal and a voice recognition function, the preset function key, when operated, causing the remote control device to transmit the screen capture control signal to the smart television upon initiating a voice input.
8. A screen capture application method of a smart television is characterized by comprising the following steps:
when receiving a voice input by the remote control equipment, executing screen capture operation to obtain a screen capture image;
when the voice input by the remote control equipment is finished, converting the input voice into a voice command;
deleting the screen capture image when the voice instruction is an operation instruction irrelevant to screen capture;
and when the voice instruction is an operation instruction related to screen capture, executing an operation corresponding to the voice instruction based on the screen capture image.
9. An intelligent television, comprising:
a memory for storing program instructions;
a processor for invoking the program instructions stored in the memory to perform the method of any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010080099.6A CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010080099.6A CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
| CN201810475458.0A CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810475458.0A Division CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111010598A CN111010598A (en) | 2020-04-14 |
| CN111010598B true CN111010598B (en) | 2022-11-11 |
Family
ID=63869109
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810475458.0A Active CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
| CN202010080099.6A Active CN111010598B (en) | 2018-05-17 | 2018-05-17 | Screen capture application method and smart television |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810475458.0A Active CN108712667B (en) | 2018-05-17 | 2018-05-17 | Smart television, screen capture application method and device thereof, and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN108712667B (en) |
| WO (1) | WO2019218656A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108712667B (en) * | 2018-05-17 | 2020-04-10 | 聚好看科技股份有限公司 | Smart television, screen capture application method and device thereof, and readable storage medium |
| CN109582825B (en) * | 2018-12-07 | 2020-01-17 | 百度在线网络技术（北京）有限公司 | Method and apparatus for generating information |
| CN111372118A (en) * | 2018-12-25 | 2020-07-03 | 深圳Tcl新技术有限公司 | Screen capturing method, intelligent terminal and storage medium |
| CN109979462A (en) * | 2019-03-21 | 2019-07-05 | 广东小天才科技有限公司 | Method and system for obtaining intention by combining context |
| CN111696549A (en) * | 2020-06-02 | 2020-09-22 | 深圳创维－Rgb电子有限公司 | Picture searching method and device, electronic equipment and storage medium |
| CN113438360A (en) * | 2021-06-18 | 2021-09-24 | 当代世界(北京)信息科技研究院 | Screen capturing method of android client based on artificial intelligence and voice recognition |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203504698U (en) * | 2013-07-17 | 2014-03-26 | 广州珠江数码集团有限公司 | Television direct broadcast screen capture system |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103747351A (en) * | 2013-12-02 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Smart television screenshot method and device |
| CN104837030B (en) * | 2014-02-12 | 2019-04-16 | 中国电信股份有限公司 | A kind of HTTP Streaming Media realizes the method and system of fast forwarding and fast rewinding broadcasting |
| CN104967889A (en) * | 2015-06-30 | 2015-10-07 | 小米科技有限责任公司 | Method used for controlling intelligent television to carry out video information processing and device |
| CN106708823A (en) * | 2015-07-20 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Search processing method, apparatus and system |
| CN106412708B (en) * | 2016-10-21 | 2019-07-09 | 上海与德信息技术有限公司 | A kind of video interception method and device |
| CN106604089A (en) * | 2016-10-25 | 2017-04-26 | 北京小米移动软件有限公司 | Intelligent television screenshot sharing method and device |
| CN107105340A (en) * | 2017-03-21 | 2017-08-29 | 百度在线网络技术（北京）有限公司 | People information methods, devices and systems are shown in video based on artificial intelligence |
| CN107480236B (en) * | 2017-08-08 | 2021-03-26 | 深圳创维数字技术有限公司 | Information query method, device, equipment and medium |
| CN108632662B (en) * | 2018-05-17 | 2020-09-01 | 聚好看科技股份有限公司 | Television screen capturing method and device and equipment comprising television screen capturing device |
| CN108712667B (en) * | 2018-05-17 | 2020-04-10 | 聚好看科技股份有限公司 | Smart television, screen capture application method and device thereof, and readable storage medium |
-
2018
- 2018-05-17 CN CN201810475458.0A patent/CN108712667B/en active Active
- 2018-05-17 CN CN202010080099.6A patent/CN111010598B/en active Active
- 2018-12-14 WO PCT/CN2018/121061 patent/WO2019218656A1/en active Application Filing
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203504698U (en) * | 2013-07-17 | 2014-03-26 | 广州珠江数码集团有限公司 | Television direct broadcast screen capture system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108712667B (en) | 2020-04-10 |
| WO2019218656A1 (en) | 2019-11-21 |
| CN108712667A (en) | 2018-10-26 |
| CN111010598A (en) | 2020-04-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111010598B (en) | Screen capture application method and smart television | |
| RU2597232C1 (en) | Method for providing a video in real time and device for its implementation, as well as a server and a terminal device | |
| CN102868934B (en) | Video object information search method and device based on intelligent television | |
| CN110691281B (en) | Video playing processing method, terminal device, server and storage medium | |
| CN109245997B (en) | Voice message playing method and device | |
| US20230401030A1 (en) | Selecting options by uttered speech | |
| CN102917247A (en) | Method for automatically recognizing television channel and television program | |
| CN112528076A (en) | Video recommendation method, device, equipment and storage medium | |
| CN111274449B (en) | Video playing method, device, electronic equipment and storage medium | |
| CN105808231B (en) | System and method for recording and playing script | |
| CN114025242A (en) | Video processing method, video processing device and electronic equipment | |
| AU2018432003B2 (en) | Video processing method and device, and terminal and storage medium | |
| CN111698261B (en) | Video playing method, device, equipment and storage medium based on streaming media | |
| CN107820133B (en) | Method, television and system for providing virtual reality video on television | |
| CN110691256B (en) | Video associated information processing method and device, server and storage medium | |
| JP6219531B2 (en) | Television program image frame capture device, television program image frame acquisition device, system and method | |
| CN108632662B (en) | Television screen capturing method and device and equipment comprising television screen capturing device | |
| WO2017096897A1 (en) | Media content playing method, device and system | |
| CN115103213B (en) | Information processing method, apparatus, device and computer readable storage medium | |
| CN113569085B (en) | Audio and video data display method, device, equipment, storage medium and program product | |
| JP2015099568A (en) | Behavior recording device, behavior recording method, and program | |
| CN115134648A (en) | Video playing method, device, equipment and computer readable storage medium | |
| CN117729371A (en) | Dynamic video target embedding method, device and equipment based on image recognition | |
| CN113741770A (en) | Control method and system based on image recognition, vehicle and storage medium | |
| CN113596602A (en) | Intelligent matching method, television and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240724 Address after: No. 399 Songling Road, Laoshan District, Qingdao City, Shandong Province (A6 3rd Floor) Patentee after: QINGDAO JUKANYUN TECHNOLOGY CO.,LTD. Country or region after: China Address before: 266100 Songling Road, Laoshan District, Qingdao, Shandong Province, No. 399 Patentee before: JUHAOKAN TECHNOLOGY Co.,Ltd. Country or region before: China |