WO2021082639A1 - 操作用户界面的方法、装置、电子设备及存储介质 - Google Patents

操作用户界面的方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2021082639A1
WO2021082639A1 PCT/CN2020/109452 CN2020109452W WO2021082639A1 WO 2021082639 A1 WO2021082639 A1 WO 2021082639A1 CN 2020109452 W CN2020109452 W CN 2020109452W WO 2021082639 A1 WO2021082639 A1 WO 2021082639A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
user interface
screenshot
screenshots
input
Prior art date
Application number
PCT/CN2020/109452
Other languages
English (en)
French (fr)
Inventor
方迟
胡恒一
庄杰
朱海舟
Original Assignee
北京字节跳动网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字节跳动网络技术有限公司 filed Critical 北京字节跳动网络技术有限公司
Priority to US17/753,296 priority Critical patent/US11875023B2/en
Publication of WO2021082639A1 publication Critical patent/WO2021082639A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]

Definitions

  • the present disclosure relates to the technical field of user interface processing, and in particular to a method, device, electronic device, and storage medium for operating an electronic device.
  • the user may wish to perform an operation on the user interface of the electronic device. Screenshots. Although the operations for taking screenshots on the user interface of different electronic devices are not the same, the user's operations for taking screenshots on the user interface of the electronic device may affect the current operation of the user, which may cause inconvenience to the user.
  • a method for operating an electronic device including: determining whether a screenshot start condition is satisfied; in response to determining that the screenshot starting condition is satisfied, performing an automatic screenshot on a user interface of the electronic device, To obtain multiple screenshots associated with the user interface of the electronic device; and in response to determining that the screenshot stop condition is satisfied, stop automatically taking screenshots of the user interface of the electronic device.
  • an apparatus for operating an electronic device including: a determining unit configured to determine whether a screenshot start condition is satisfied; and a screenshot unit configured to automatically perform an automatic operation on a user interface of the electronic device. Taking screenshots to obtain multiple screenshots associated with the user interface of the electronic device; and the stopping unit is configured to stop taking screenshots of the user interface of the electronic device in response to determining that the screenshot stopping condition is satisfied.
  • an electronic device including: a processor; and a memory storing a program, the program including instructions that when executed by the processor cause the processor to execute the present disclosure
  • a computer-readable storage medium storing a program, the program including instructions that, when executed by a processor of an electronic device, cause the electronic device to execute the The method used to operate electronic equipment.
  • a computer program product including a program, the program including code that, when executed by a processor of an electronic device, causes the electronic device to execute the functions described in the disclosure.
  • FIG. 1 is a flowchart showing a method for operating an electronic device according to an exemplary embodiment of the present disclosure
  • FIG. 2 is a schematic diagram showing an example of a user interface for determining whether a screenshot start condition is satisfied according to an exemplary embodiment of the present disclosure
  • FIG. 3 is a schematic diagram showing a user interface of a screen recording window according to an exemplary embodiment of the present disclosure
  • 4A is a schematic diagram showing a user interface of a video and multiple screenshots displayed when the electronic device is in a vertical screen state according to an exemplary embodiment of the present disclosure
  • 4B is a schematic diagram showing a user interface of a video and multiple screenshots displayed when the electronic device is in a landscape state according to an exemplary embodiment of the present disclosure
  • FIG. 5 is a schematic diagram showing a user interface for editing a displayed video and multiple screenshots according to an exemplary embodiment of the present disclosure
  • FIG. 6 is a structural block diagram showing an apparatus for operating an electronic device according to an exemplary embodiment of the present disclosure
  • FIG. 7 is a structural block diagram showing an exemplary electronic device that can be applied to an exemplary embodiment of the present disclosure.
  • first, second, etc. to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of these elements. It is only used to distinguish one element from another.
  • first element and the second element may refer to the same instance of the element, and in some cases, based on the description of the context, they may also refer to different instances.
  • electronic equipment can be any type of electronic equipment, such as but not limited to such as mobile phones, notebook computers, digital broadcast receivers, PDA (personal digital assistant), PAD (tablet computer), PMP ( Portable multimedia players), mobile terminals such as vehicle-mounted terminals (e.g., vehicle navigation terminals), and fixed terminals such as digital TVs, desktop computers, and the like.
  • PDA personal digital assistant
  • PAD tablet computer
  • PMP Portable multimedia players
  • mobile terminals such as vehicle-mounted terminals (e.g., vehicle navigation terminals), and fixed terminals such as digital TVs, desktop computers, and the like.
  • a “window” is a medium in which codes or programs are displayed on the user interface of an electronic device.
  • the "application” is displayed on the user interface of the electronic device through the "application window”.
  • the user may wish to perform an operation on the user interface of the electronic device. Screenshots. Although the operations for taking screenshots on the user interface of different electronic devices are not the same, the user's operations for taking screenshots on the user interface of the electronic device may affect the current operation of the user, which may cause inconvenience to the user.
  • the present disclosure provides a method for operating an electronic device.
  • the method for operating an electronic device according to the present disclosure can automatically take screenshots of the user interface of the electronic device to obtain multiple screenshots associated with the user interface of the electronic device for subsequent operations of the user. This allows the automatic screenshot function to be executed when the screenshot start condition is met, which simplifies the user's operation.
  • the method for operating an electronic device according to the present disclosure can automatically take screenshots of the user interface of the electronic device, without requiring users to manually take screenshots according to the operating specifications of different electronic devices, so that the screenshot process will not be affected. The user's current operation.
  • the first aspect of the present disclosure may include a method for operating an electronic device, and the method may include: determining whether a screenshot start condition is satisfied (S101); in response to determining that the screenshot start condition is satisfied, The user interface of the electronic device performs automatic screenshots to obtain multiple screenshots associated with the user interface of the electronic device (S102); in response to determining that the screenshot stop condition is satisfied, the automatic screenshot of the user interface of the electronic device is stopped (S103).
  • the electronic device may determine whether the screenshot start condition is satisfied.
  • the screenshot start condition may be that the user starts inputting a screenshot of the user interface of the electronic device.
  • the screenshot start condition may be that the user starts inputting a screenshot of a physical button of the electronic device.
  • the screenshot start condition may also be independent of the user's input. The following text will describe in detail how to determine whether the screenshot start condition is met.
  • step S102 automatic screenshots of the user interface of the electronic device (also referred to as screenshots for short) are automatically executed by the electronic device without manual operation by the user.
  • the entire user interface of the electronic device can be automatically captured. According to other embodiments, it is also possible to automatically take a screenshot of a part of the user interface of the electronic device. For example, in the process of taking a screenshot of the video, the black area of the video is automatically filtered out.
  • taking a screenshot of a user interface of an electronic device usually displays a screenshot animation.
  • the screenshot animation when taking automatic screenshots of the user interface of the electronic device, may not be displayed on the user interface of the electronic device.
  • the electronic device when the user interface of the electronic device is automatically captured, the electronic device may not generate a screenshot sound effect.
  • the electronic device may determine whether the screenshot stop condition is satisfied.
  • the screenshot stop condition may be that the user stops inputting a screenshot of the user interface of the electronic device.
  • the screenshot stop condition may be that the user stops inputting a screenshot of a physical button of the electronic device.
  • the screenshot stop condition may also be independent of the user's input. The following text will describe in detail how to determine whether the screenshot stop condition is met.
  • the thumbnails of the multiple screenshots and/or the video may be directly displayed on the user interface of the electronic device.
  • the thumbnails of the multiple screenshots and/or the video may not be directly displayed, but they may be saved in a temporary folder for use. Use for subsequent operations by the user.
  • the user interface of the electronic device may be a touch-sensitive user interface.
  • step S101 The following will describe how to determine whether the screenshot start condition is satisfied in step S101.
  • the determining whether the screenshot start condition is satisfied may include: in response to receiving an automatic screenshot instruction input for the user interface of the electronic device, determining that the screenshot start condition is satisfied.
  • the automatic screenshot indicating input may include a tap input, a press input, a slide input, a lift input, or a combination thereof.
  • the automatic screenshot instruction input may include one input, for example, a click input for a screen capture button, a press input for a certain position on the user interface, and so on.
  • the automatic screenshot indicating input may also include multiple inputs. The automatic screenshot indication input including multiple inputs will be described in detail later.
  • the state of the user interface of the electronic device when the input of the automatic screenshot instruction is received can be determined.
  • the method may further include: receiving an automatic screenshot instruction input for the user interface of the electronic device, wherein the determining whether the screenshot start condition is satisfied includes: determining that the user interface of the electronic device is receiving The automatic screenshot instruction input is an application window; in response to determining that the user interface of the electronic device displays an application window when the automatic screenshot instruction input is received, it is determined whether the application window is allowed Being captured; and in response to determining that the application window is allowed to be captured, determining that the screenshot start condition is satisfied.
  • the user interface of the electronic device may display an application window, a system desktop, a task manager window, etc. when receiving the automatic screenshot instruction input.
  • the user interface of the electronic device displays an application window when receiving the input of the automatic screenshot instruction, it may be further determined whether the application window is allowed to be screenshotted.
  • application windows are allowed to be screenshots.
  • the user interface displays the application window when receiving the input of the automatic screenshot instruction, and it can be determined that the screenshot start condition is met.
  • the application window is not allowed to be screenshots.
  • the developer of the application window may not allow the application window to be screenshotted (for example, for reasons of copyright or privacy, etc.).
  • the user sets the application window to not allow screenshots. The user may set the application window to not allow screenshots due to reasons such as not wanting to be disturbed when operating the application window.
  • the application window that can be set by the user to not allow screenshots may be a game application window. Therefore, when the user interface displays an application window that does not allow screenshots when receiving the automatic screenshot instruction input, it can be determined that the screenshot start condition is not met.
  • the determining whether the screenshot start condition is satisfied further includes: in response to determining that the user interface of the electronic device is not displaying an application window when receiving the automatic screenshot instruction input, determining that the screenshot starting condition is satisfied .
  • the user interface of the electronic device may not be an application window when receiving the automatic screenshot instruction input, for example, may be a desktop window, a task manager window, or the like.
  • the electronic device can directly determine that the screenshot start condition is met, and start automatic screenshot, which simplifies the step of determining whether the screenshot start condition is met.
  • the automatic screenshot indicating input may include a single input or multiple inputs.
  • the receiving automatic screenshot instruction input for the user interface of the electronic device may include: receiving a function menu call-out input for the user interface of the electronic device; in response to receiving the function menu call-out input, A function selection menu is displayed on the user interface of the electronic device, where the function selection menu includes a screen recording and screenshot function option; and a selection for the screen recording and screenshot function option is received.
  • FIG. 2 is a schematic diagram illustrating a user interface 200 according to an example of determining whether a screenshot start condition is satisfied according to an exemplary embodiment of the present disclosure. The following will describe how to determine the screenshot start condition through the function selection menu and the selection of the function options on the function selection menu in conjunction with FIG. 2.
  • the automatic screenshot indication input may include two inputs.
  • the first input of the automatic screenshot instruction input includes a function menu call input for the user interface of the electronic device.
  • the function menu call-out input for example, a click input for a function menu call-out button, a press input for a user interface, a sliding input performed upward from the lower edge of the user interface of the electronic device, etc.
  • a function selection menu 201 is displayed on the user interface of the electronic device.
  • the function selection menu 201 may include multiple function options. According to the example shown in FIG.
  • the function selection menu 201 may include three function options, namely an audio word segmentation function option 202-1, a screen recording function option 202-2, and a picture word segmentation function option 202-3.
  • the function selection menu may include any number of function options.
  • the user can select a function option in the function menu 201.
  • the automatic screenshot instruction input further includes the selection of the screen recording and screenshot function option 202-2 as the second input of the automatic screenshot instruction input.
  • the method may further include: receiving an automatic screenshot instruction input for the user interface of the electronic device, wherein the determining whether the screenshot start condition is satisfied may include: acquiring the automatic screenshot instruction input in the The location on the user interface of the electronic device; determining whether the user interface of the electronic device belongs to the text extractable area at the location; and in response to determining that the user interface of the electronic device does not belong to the text extractable area at the location Area, it is determined that the screenshot start condition is met.
  • the user interface of the electronic device may include text extractable areas and text non-extractable areas.
  • the text extractable area refers to an area where Chinese characters can be input in response to text extraction, for example, the area where the text conversation in the chat application is located, the area where the text text in the mailbox application is located, and so on.
  • the non-extractable text area refers to an area where text cannot be selected in response to text extraction input, for example, the system desktop, the area where the pictures in the photo album application are located, and so on.
  • the text extraction input may include a click input, a pressing input, a sliding input, a lifting input, or a combination thereof for the text extractable area. It can be seen that the text extraction input may overlap with the automatic screenshot instruction input.
  • the screenshot start condition when the position of the automatic screenshot indicating input on the user interface of the electronic device does not belong to the text extractable area, it is determined that the screenshot start condition is met, and the screenshot is taken. In this way, the screenshot start condition can be determined more accurately, and it will not interfere with the text extraction input, which improves the user experience.
  • the acquisition of the automatic screenshot instruction input is The position on the user interface of the electronic device may include: acquiring the position of the call-out input of the function menu on the user interface of the electronic device.
  • it is determined that the function selection menu can be displayed. Then, select the screen recording and screenshot function option in the function selection menu as the second input of the automatic screenshot instruction input.
  • the input can be called out through the function menu of the first input as the automatic screenshot instruction input to eliminate the misoperation of the text extractable area, and at the same time, through the recording of the second input as the automatic screenshot instruction input.
  • the screen capture function option confirms that the user wants to start an automatic screenshot, which further increases the accuracy of the determination of satisfying the screenshot start condition, and improves the user experience.
  • the method may further include: in response to determining that the user interface of the electronic device belongs to the text extractable area at the position, displaying a function selection menu on the user interface of the electronic device, wherein The function selection menu includes a screen recording and screenshot function option; receiving a selection for the screen recording and screenshot function option; in response to receiving a selection for the screen recording and screenshot function option, it is determined that the screenshot start condition is satisfied.
  • a function selection menu may be displayed (for example, pop-up) on the user interface for the user to further confirm the desired execution of the electronic device. operating.
  • the function selection menu may include, for example, a screen capture function option, an audio word segmentation function option, an image word segmentation function option, a text word segmentation function option, a text extraction function option, and the like.
  • the user can select the screen capture function option (for example, click the screen capture function option, press the screen capture function option, slide on the screen capture function option, etc.), and After the user selects the screen recording and screenshot function option, it is determined that the screenshot start condition is met.
  • the screen capture function option for example, click the screen capture function option, press the screen capture function option, slide on the screen capture function option, etc.
  • step S102 an exemplary manner of automatic screenshot in step S102 will be described in detail in conjunction with exemplary embodiments of the present disclosure.
  • the automatic screenshot of the user interface of the electronic device may include: automatic screenshot of the user interface of the electronic device at a preset time interval.
  • the preset time interval may be once every 0.1 seconds, once every 0.2 seconds, once every 0.3 seconds, once every 0.4 seconds, once every 0.8 seconds, or once every 1 second, and so on.
  • the frequency of manual screenshots of the user interface of the electronic device is not stable due to the limitation of control, and the method for operating the electronic device according to the present disclosure can achieve uniform screenshots, and can adjust the automatic screenshots as required.
  • the frequency (will be described in detail below).
  • the automatic screenshot of the user interface of the electronic device may include: real-time acquisition of the elapsed time for the automatic screenshot of the user interface of the electronic device; and based on the elapsed time acquired in real time, dynamically Adjust the time interval for automatically taking screenshots of the user interface of the electronic device.
  • the elapsed time for automatically taking a screenshot of the user interface of the electronic device can be obtained in real time through the timer of the electronic device.
  • the elapsed time may be the time elapsed from the moment when the user interface of the electronic device is automatically captured until the current moment.
  • the time interval of automatic screenshots (ie, the rate of automatic screenshots) can be adjusted according to the elapsed time.
  • automatic screenshots of a user interface of an electronic device according to an exemplary embodiment of the present disclosure are controllable.
  • the user interface of the electronic device when the elapsed time is relatively small, can be automatically captured at a relatively small time interval; and when the elapsed time is relatively large, the user of the electronic device can be captured at a relatively large time interval. Automatic screenshots of the interface.
  • the dynamically adjusting the time interval for automatically taking screenshots of the user interface of the electronic device based on the elapsed time acquired in real time may include: when the elapsed time acquired in real time is in the first range, Automatically screenshot the user interface of the electronic device at the first time interval; and when the elapsed time acquired in real time is in the second range, automatically screenshot the user interface of the electronic device at the second time interval, wherein, The values in the first range are all smaller than the values in the second range, and the first time interval is smaller than the second time interval.
  • the first range may be (0, 15 seconds) (that is, the elapsed time is greater than 0 seconds and less than or equal to 15 seconds), and the second range may be (15 seconds, 30 seconds) (that is, the elapsed time is greater than 15 seconds). Seconds and less than or equal to 30 seconds).
  • the first time interval may be every 0.2 seconds, and the second time interval may be every 0.4 seconds.
  • the dynamically adjusting the time interval for automatically taking screenshots of the user interface of the electronic device based on the elapsed time obtained in real time may further include: when the elapsed time obtained in real time is in the third range, Take automatic screenshots of the user interface of the electronic device at a third time interval, wherein the values in the second range are all smaller than the values in the third range, and the second time interval is smaller than the third time interval.
  • the third range may be (30 seconds, + ⁇ ) (ie, the elapsed time is greater than 30 seconds), and the third time interval may be once every 0.8 seconds.
  • the third time interval may be once every 0.8 seconds.
  • first range the second range, the third range, the first time interval, the second time interval, and the first range can be changed according to actual conditions.
  • Three time intervals and according to exemplary embodiments of the present disclosure, may further include a fourth range, a fifth range, and a fourth time interval, a fifth time interval, and the like.
  • the time interval for taking automatic screenshots of the user interface of the electronic device is also longer. In the case where a long time has elapsed, this can avoid obtaining too many screenshots, and make subsequent operations on these screenshots (for example, filtering the screenshots) more convenient for the user.
  • the multiple screenshots associated with the user interface of the electronic device obtained according to the method of dynamically adjusting the time interval of automatic screenshots described above may be uneven in time.
  • the first range can be (0, 15 seconds) (that is, the elapsed time is greater than 0 seconds and less than or equal to 15 seconds), and the second range can be (15 seconds, 30 seconds) (that is, the elapsed time is 15 seconds, 30 seconds).
  • the time is greater than 15 seconds and less than or equal to 30 seconds)
  • the first time interval can be every 0.2 seconds
  • the second time interval can be every 0.4 seconds
  • the elapsed time obtained in real time is 30 seconds.
  • screenshots associated with the user interface of the electronic device are obtained in a state where the elapsed time has been in the first range (ie, the first 15 seconds).
  • the second time interval is N times the first time interval, and N is a positive integer greater than 1, and the method may further include: when the elapsed time obtained in real time is in the second range When the elapsed time is in the first range, one screenshot is retained for every N screenshots associated with the user interface of the electronic device and the other screenshots are deleted.
  • the second time interval is twice the first time interval. Therefore, it is possible to keep one screenshot from every two screenshots associated with the user interface of the electronic device that have been obtained in the state where the elapsed time was in the first range (for example, the first 15 seconds) and delete the other screenshots.
  • the 75 screenshots associated with the user interface of the electronic device obtained in the first 15 seconds one screenshot is retained for every two screenshots, and the other screenshots are deleted.
  • the 75 screenshots can be labeled in chronological order, and the screenshots with even numbers can be kept, and the screenshots with odd numbers can be deleted.
  • the method according to the exemplary embodiment of the present disclosure can not only adaptively adjust the time interval of the screenshot according to the duration of the automatic screenshot, but also It can maintain the uniformity in time of the multiple screenshots finally obtained and associated with the user interface of the electronic device, greatly enhance the adaptive ability of automatic screenshots, and improve the user experience.
  • the method may further include: in response to determining that the screenshot start condition is satisfied, recording a user interface of the electronic device to obtain a video associated with the user interface of the electronic device; and in response to determining that the screenshot is satisfied
  • the screenshot stop condition stops recording the user interface of the electronic device.
  • recording the user interface of the electronic device refers to recording the content displayed by the user interface of the electronic device in a certain period of time in the form of video, and the obtained video is referred to as the video recording with the electronic device.
  • the video associated with the user interface refers to recording the content displayed by the user interface of the electronic device in a certain period of time in the form of video, and the obtained video is referred to as the video recording with the electronic device.
  • the video associated with the user interface refers to recording the content displayed by the user interface of the electronic device in a certain period of time in the form of video, and the obtained video is referred to as the video recording with the electronic device.
  • the user interface of the recording electronic device is realized by the electronic device itself, instead of being realized by photographing the user interface of the electronic device by an external device (for example, a camera, etc.).
  • the recording time refers to the elapsed time from when the screenshot start condition is determined to be satisfied until the screenshot stop condition is determined to be satisfied.
  • the user interface of the recording electronic device can generally be used to record the video being played by the electronic device, record the teaching demonstration operation of the application, etc.
  • the present disclosure is not limited to these embodiments.
  • the entire user interface of the electronic device can be recorded. According to other embodiments, part of the user interface of the electronic device may also be recorded. For example, during the process of recording the video, the black area of the video is automatically filtered out.
  • FIG. 3 is a schematic diagram showing a user interface of a screen recording window according to an exemplary embodiment of the present disclosure. The following will describe the screen recording window that can be displayed when recording the user interface of the electronic device in conjunction with FIG. 3.
  • the method may further include: in response to determining that the automatic screenshot instruction input satisfies the screenshot start condition, displaying a screen recording window 310 on the user interface 300 of the electronic device, wherein the screen recording The window indicates that the user interface of the electronic device is being recorded.
  • the screen recording animation is not displayed during the process of recording the user interface of the electronic device.
  • the user interface of the electronic device is automatically captured, neither the screenshot animation nor the screenshot sound effect is displayed.
  • the screen recording window 310 is displayed to provide the user with visual feedback that the user interface of the electronic device is being recorded.
  • a text prompt "Screen Recording" may be displayed in the screen recording window 310, so as to provide customers with more intuitive visual feedback.
  • the text prompt is located at the bottom of the screen recording window.
  • the text prompt can also be located at the top or middle of the screen recording window.
  • the elapsed time of recording the user interface of the electronic device may be displayed in the user interface 300 or the screen recording window 310 in real time.
  • the elapsed time displayed in real time may have a certain degree of transparency, such as 60%. In this way, the user can be reminded of the elapsed recording time in real time on the user interface of the recording electronic device.
  • the user may not want the screen recording window to be recorded in the video associated with the user interface of the electronic device, nor does the user want the screen recording window to be automatically captured in the video associated with the user interface of the electronic device.
  • At least one screenshot associated with the user interface of the electronic device At least one screenshot associated with the user interface of the electronic device.
  • the automatic screenshot of the user interface of the electronic device may include: during the automatic screenshot of the user interface of the electronic device, not automatically screenshot the screen recording window; and the recording station
  • the user interface of the electronic device may include: not recording the screen recording window during the recording of the user interface of the electronic device.
  • not recording the screen recording window refers to: during the recording of the user interface of the electronic device, the area of the user interface of the electronic device other than the screen recording window can be recorded and the screen recorded The area occluded by the window makes the screen recording window not exist in the video.
  • not taking automatic screenshots of the screen recording window refers to: during the automatic screenshot of the user interface of the electronic device, the user interface of the electronic device other than the screen recording window can be captured. Automatic screenshots are performed on the area and the area obscured by the screen recording window, so that the screen recording window does not exist in the multiple screenshots.
  • the screen recording window displayed on the user interface is automatically filtered.
  • the following will describe in detail the technology for automatically filtering the screen recording window during the recording process.
  • the not automatically taking a screenshot of the screen recording window and/or the not recording the screen recording window may include: adjusting the capture attribute of the screen recording window to be non-capturable;
  • the user interface of the electronic device performs automatic screenshots and/or starts to record the user interface of the electronic device, it detects and receives the capture attribute of the screen recording window; in response to receiving the capture attribute of the screen recording window as not captureable,
  • the screen recording window is not automatically captured and/or the screen recording window is not recorded during the recording of the user interface of the electronic device.
  • the user interface and the screen recording window of the electronic device may be displayed in different layers.
  • the user interface of the electronic device is displayed in the first layer
  • the screen recording window is displayed in the second layer
  • the second layer is displayed above the first layer.
  • the area in the user interface that is obscured by the screen recording window will not be displayed.
  • the capture attribute of the screen recording window is adjusted to not be captureable.
  • the NOT_CAPTURE attribute value is assigned to the screen recording window.
  • the capture attribute of the screen recording window displayed on the second layer is detected. If the interception attribute is not interceptable, during the recording of the user interface of the electronic device and/or during the automatic screenshot of the user interface of the electronic device, the screen recording window displayed on the second layer is automatically filtered, and the recording window is only recorded on the first layer. The user interface of the electronic device displayed on one layer and/or an automatic screenshot of the user interface of the electronic device displayed on the first layer is taken.
  • the user interface of the electronic device is recorded in the same way as if the screen recording window does not exist, and the user interface is automatically captured in the same way as if the screen recording window does not exist.
  • displaying the screen recording window on the user interface of the electronic device includes: rendering the user interface of the electronic device on a user interface view control in real time; and setting the user interface view control on the screen recording window , To display the thumbnail of the user interface of the electronic device in the screen recording window in real time.
  • the user interface of the electronic device can be rendered on the user interface view control in real time through virtual display technology.
  • the user interface view control may be, for example, a Surface control.
  • the virtual display technology may include, for example, the virtual display technology (Virtual Display) in the Android system.
  • the content displayed in the screen recording window can be synchronized with the content displayed on the user interface of the electronic device.
  • the content 301 being displayed in the user interface 300 is a tree
  • the content 311 displayed in real time in the screen recording window is a thumbnail of the tree, in order to visually show the user
  • the feedback electronic device is indeed recording the currently displayed user interface.
  • the aspect ratio of the screen recording window is the same as the aspect ratio of the user interface of the electronic device.
  • the four vertices of the screen recording window have rounded corners to look more beautiful.
  • part of the user interface of the electronic device can be recorded, or a part of the user interface of the electronic device can be automatically captured. It should be noted that although the following describes in detail the technology of recording a part of the user interface of the electronic device by taking recording as an example, the technology can of course also be used to take a screenshot of a part of the user interface of the electronic device.
  • a part of the user interface of the electronic device may be, for example, a video playing area.
  • the method may further include: during an automatic screenshot of the user interface of the electronic device, determining whether the user interface of the electronic device is displaying a video playback application window corresponding to the video playback application, Wherein the video playback application window includes a video playback area, wherein the automatic screenshot of the user interface of the electronic device includes: in response to determining that the user interface of the electronic device is displaying the video playback application window, Taking a screenshot of only the video playback area, and recording the user interface of the electronic device includes: in response to determining that the user interface of the electronic device is displaying the video playback application window, recording only the video playback area .
  • the application window being displayed is a video playback application window based on the information of the application window being displayed on the current user interface read from the system of the electronic device.
  • the video playback application corresponding to the video playback application window may be Douyin, Volcano Video, etc.
  • the video playback application window may display a video playback area, an advertisement area, a user comment area, a director or actor or voice personnel display area, and the like.
  • the user may only want to record the video playback area that is part of the user interface of the electronic device or to It takes automatic screenshots.
  • the automatic screenshot of the user interface of the electronic device and/or the recording only of the video play area may include: determining the position of the video play area on the user interface of the electronic device And based on the position of the video playing area on the user interface of the electronic device, taking a screenshot of the video playing area and/or recording the video playing area.
  • coordinates may be used to represent the video play area.
  • a coordinate system can be established with the vertex at the lower left corner of the user interface as the origin, the horizontal and right direction of the user interface as the positive x-axis direction, and the vertical upward direction of the user interface as the positive y-axis direction.
  • determining the position of the video playing area on the user interface of the electronic device includes determining the coordinates of the edge of the video playing area in the coordinate system, and taking all the coordinates within the edge as Video playback area.
  • the linear function of the four sides of the video play area on the coordinate system can be determined.
  • the areas in all sides of the four sides are regarded as the video playback area, for example, ⁇ c ⁇ x ⁇ d, and a ⁇ y ⁇ b ⁇ .
  • the left side of the obtained video playing area is corresponding to the pixels constituting the edge of the playing video area, and the content displayed by these pixels can be recorded, thereby realizing recording a part of the user interface of the electronic device. Similarly, only the content displayed by these pixels can be intercepted, so as to realize automatic screenshot of a part of the user interface of the electronic device.
  • the above-mentioned video play area can be further reduced to determine the movie play area.
  • the aspect ratio of the rectangular video playback area is usually 1.85:1, while the aspect ratio of the movie screen is usually 2.35:1. Therefore, the movie play area can be further determined as, for example, ⁇ c ⁇ x ⁇ d, and a+(b-a)/9.4 ⁇ y ⁇ b-(b-a)/9.4 ⁇ .
  • determining the position of the video play area on the user interface of the electronic device includes the following three methods.
  • the edge detection method can be used to determine the video playback area.
  • the determining the position of the video play area on the user interface of the electronic device may include: detecting a frame of the video play area; and based on the frame of the video play area, setting the frame The inner area is determined as the video playing area.
  • the method for detecting the border of the video play area may include: acquiring an image of the current user interface of the electronic device; performing Gaussian smoothing and denoising on the acquired image; using operators (for example, canny operator, lapacian operator) (E.g.) perform a convolution operation on the denoised image to obtain the gradient of each pixel of the acquired image; determine the pixels whose gradient is greater than the gradient threshold (for example, the maximum value of the gradient); connect these pixels to obtain the video playback area frame.
  • operators for example, canny operator, lapacian operator
  • developers of video playback applications usually develop multiple versions of video playback application windows to adapt to different types of electronic devices.
  • the determining the position of the video play area on the user interface of the electronic device may include: obtaining the resolution of the electronic device; determining the video play that is being displayed on the user interface of the electronic device. The video playback application corresponding to the application window; and based on the acquired resolution of the electronic device and the determined video playback application corresponding to the video playback application window being displayed on the user interface of the electronic device, determining The position of the video play area on the user interface of the electronic device.
  • the resolution of the electronic device may include the resolution of the user interface of the electronic device, the resolution of the display screen of the electronic device, and the like.
  • the video playing area when playing a video, may depend on the resolution of the user interface and/or the display screen. Therefore, by determining the resolution of the user interface and/or the display screen, the video playback area can be accurately obtained.
  • the determining the position of the video playing area on the user interface of the electronic device may include: obtaining the model of the electronic device; determining the video playing application that is being displayed on the user interface of the electronic device The video playback application corresponding to the program window; and based on the acquired model of the electronic device and the determined video playback application corresponding to the video playback application window being displayed on the user interface of the electronic device, determining the The position of the video playing area on the user interface of the electronic device.
  • the model of the electronic device includes the manufacturer of the electronic device and the model of the electronic device.
  • the manufacturer of the acquired electronic device is Hammer
  • the model is M1
  • the video playback application corresponding to the currently displayed video playback application window is Douyin. Based on the above information, the video playback area of Douyin on the Hammer M1 phone can be accurately obtained.
  • the video play area can be obtained by directly extracting the video stream from the system of the electronic device.
  • the method may further include: acquiring in real time the elapsed time for recording the user interface of the electronic device; and when the elapsed time acquired in real time is equal to the stop threshold time, determining that the screenshot described in step S103 is satisfied Stop condition.
  • the stop threshold time may be preset by the user or set by default by the system of the electronic device. According to some examples, the stop threshold time may be 20 seconds, 30 seconds, 1 minute, 2 minutes, etc.
  • the stop threshold time can be set to infinity.
  • the stop threshold time may be set to a sufficiently large value. In other words, set the stop threshold time to a value that is almost impossible to reach when using the screen capture function normally.
  • the value of the stop threshold time can be set to 0x7ffffff.
  • the value 0x7ffffffff is actually the maximum value under 32-bit int. If the unit is seconds, the value of 0x7ffffffffff is about 68 years, which can be approximately regarded as setting the stop threshold time to infinity.
  • the available memory of the electronic device can be determined in real time.
  • reserved memory can be allocated for electronic devices.
  • the reserved memory may be the memory required to ensure that the system of the electronic device can operate normally.
  • the elapsed time is determined as the stop threshold time.
  • the remaining space of the cache can also be determined in real time.
  • reserved space may be allocated for the cache of the electronic device.
  • the elapsed time is determined as the stop threshold time.
  • the reserved memory and/or reserved space may be different according to different models of the electronic device. According to some embodiments, the reserved memory and/or reserved space may also be associated according to the application program that the electronic device is running. However, those skilled in the art should understand that the present disclosure is not limited to this, and the reserved memory and/or reserved space may be determined in any manner. Normally, the reserved memory and/or reserved space is not zero. However, in some cases, the reserved memory and/or reserved space may also be zero.
  • the user wishes to independently determine when the automatic screenshot stops.
  • the method may further include: receiving a screenshot stop input for the user interface of the electronic device; and in response to the screenshot stop input, determining that the screenshot stop condition is satisfied.
  • the user can stop input (for example, click input for the screen recording stop button, click input for the screen recording window, press input for the user interface (for example, the user interface 300), etc.) to stop inputting the electronic device by taking a screenshot.
  • Automatic screenshots of the user interface of the user interface which further improves the freedom of user operations and enhances the user experience.
  • the method may further include: after stopping taking screenshots of the user interface of the electronic device and stopping recording the user interface of the electronic device, displaying the plurality of images on the user interface of the electronic device The thumbnail of the screenshot and the thumbnail of the video.
  • FIGS. 4A and 4B are schematic diagram illustrating a user interface 400A of a video and multiple screenshots displayed when the electronic device is in a vertical screen state according to an exemplary embodiment of the present disclosure.
  • FIG. 4B is a schematic diagram illustrating a user interface 400B of a video and multiple screenshots displayed when the electronic device is in a landscape state according to an exemplary embodiment of the present disclosure.
  • the thumbnail of the video and the user interface of the electronic device may be directly displayed on the user interface of the electronic device. Thumbnails of multiple screenshots.
  • FIGS. 4A and 4B after the recording of the user interface of the electronic device is stopped and the screenshot of the user interface of the electronic device is stopped, the user interface 400A, Video screenshot cards 410A, 410B are displayed on 400B, and thumbnails 420A, 420B of the video and thumbnails 430A, 430B of the multiple screenshots are displayed on the video screenshot cards 410A, 410B.
  • the user interface and the display direction of the thumbnails of the video and the thumbnails of the multiple screenshots are defined by the comparison result of the aspect ratio and 1, whether the display direction is a portrait orientation or a landscape orientation.
  • the display direction of the user interface is the portrait orientation. If the aspect ratio of the user interface is greater than 1, the display direction of the user interface is the landscape orientation.
  • the display direction of the thumbnail of the video and the thumbnails of the multiple screenshots For portrait orientation. If the aspect ratio of the thumbnail of the video and the thumbnails of the multiple screenshots is greater than 1, the display direction of the thumbnail of the video and the thumbnails of the multiple screenshots is a landscape orientation.
  • the user may rotate the electronic device (for example, rotate the electronic device from the portrait orientation to the landscape orientation, or change The electronic device is rotated from the landscape orientation to the portrait orientation).
  • the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots may be neither the vertical screen direction nor the horizontal screen direction, but an oblique direction with a certain angle.
  • the thumbnails of the screenshots in the multiple screenshots whose display direction is the portrait orientation or the landscape orientation may be retained and displayed, and the display directions of the multiple screenshots can be deleted. Thumbnails of screenshots that are not in portrait or landscape orientation.
  • the directions of multiple screenshots may also be inconsistent.
  • the display directions of the thumbnail of the video and the thumbnails of the multiple screenshots may be determined based on the orientation of the electronic device at the moment when the screen recording is stopped.
  • the method may further include: determining a screenshot stopping direction, the screenshot stopping direction being the moment when the user interface of the electronic device is stopped and the recording of the user interface of the electronic device is stopped. The orientation of the electronic device; and based on the stop direction of the screenshot, displaying the thumbnails of the multiple screenshots and the thumbnails of the video on the user interface of the electronic device.
  • the screenshot stopping direction includes the vertical screen direction and the horizontal screen direction as defined above.
  • the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are the same as the stop direction of the screenshots.
  • the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are also the portrait orientation.
  • the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are also the landscape orientation.
  • the stopping direction of the screenshot is the horizontal screen direction.
  • the orientation of the electronic device is the vertical screen direction at this time, and the display direction of the user interface 400A is also the vertical screen direction
  • the screenshot stopping direction is the horizontal screen direction
  • the thumbnail 420A of the video and the display direction are horizontal.
  • the display direction of the thumbnail 430A of the multiple screenshots is the horizontal screen direction.
  • the display direction (horizontal screen direction) of the thumbnail 420A of the video and the thumbnail 430A of the multiple screenshots is inconsistent with the display direction (portrait direction) of the user interface 400A, these thumbnails A black border area is displayed above and below each. As shown in FIG.
  • the real-time orientation of the electronic device is the horizontal screen direction
  • the display direction of the user interface 400A is the horizontal screen direction
  • the screenshot stopping direction is the horizontal screen direction
  • the thumbnail 420A of the video and the plurality of The display direction of the thumbnail 430A of the screenshot is the horizontal screen direction.
  • the display direction (horizontal screen direction) of the thumbnail 420B of the video and the thumbnail 430B of the multiple screenshots is consistent with the display direction (portrait direction) of the user interface 400B, these thumbnails Above and below the area with black borders are not displayed.
  • the electronic device is rotated (for example, the electronic device is rotated from the portrait orientation to the landscape orientation, or the electronic device is removed from The horizontal screen direction is rotated to the vertical screen direction), which can still ensure that the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are consistent, so that the user's visual senses are consistent and neat when watching.
  • the method may further include: receiving a display input for the thumbnail of the first screenshot of the plurality of screenshots; and in response to the display input, displaying in full screen on the user interface of the electronic device The first screenshot; receiving a playback input for the thumbnail of the video; and in response to the playback input, playing the video in full screen on a user interface of the electronic device.
  • the play input for the thumbnail of the video may include: click input for the play buttons 422A, 422B (refer to FIG. 4A and FIG. 4B) on the thumbnail of the video, and zoom in on the video. Press input of thumbnails, etc.
  • the display input for the thumbnail of the first screenshot of the plurality of screenshots may include: a click input for a zoom-in button on the thumbnail of the first screenshot, and a zoom-in for the first screenshot. Press input of thumbnails, etc.
  • the video played in full screen is the original video obtained by recording, and its resolution is higher than the thumbnail of the video.
  • the first screenshot displayed in the full screen is the original picture obtained by automatic screenshot, and its resolution is higher than the thumbnail of the first screenshot.
  • the black border areas existing in the multiple screenshots may be removed. In this way, in the operations such as saving and sharing described below, the picture after removing the black border area can be saved and shared.
  • the edge detection method can also be used to determine the black border area, and delete the black border area in the screenshot. The black border area detected.
  • Gaussian smoothing and denoising can be performed on each of the multiple screenshots; operators (for example, canny operator, lapacian operator, etc.) are used to perform convolution operations on the denoised image to obtain each The gradient of each pixel in the screenshot; determine the pixels whose gradient is greater than the gradient threshold (for example, the maximum value of the gradient); connect these pixels to determine the black area in each screenshot (if there is a black area); delete the black area The black bordered area in the screenshot of the bordered area.
  • operators for example, canny operator, lapacian operator, etc.
  • the black border area can still be removed in the multiple screenshots associated with the user interface of the electronic device, which can reduce the number of electronic devices. Memory usage during automatic screenshots.
  • the method may further include: receiving a first save input for the first save buttons 411A, 411B displayed on the user interface of the electronic device; and in response to the first save input, uploading the Multiple screenshots are stored in the screenshot folder, and the video is stored in the video folder.
  • the first save input may be a click input, a press input, etc. for the first save button displayed on the user interface of the electronic device.
  • the video and the multiple screenshots can be saved at the same time.
  • the user does not need to store the video and multiple screenshots separately twice, which simplifies the user's operation.
  • the method may further include: receiving a first sharing input for a first sharing button and a first application option displayed on a user interface of the electronic device, wherein the first application option corresponds to In a first application; and in response to the first sharing input, sharing the multiple screenshots and the video to the first application.
  • the first application option may be directly displayed on the user interface of the electronic device.
  • the first sharing input may be a click input for the first sharing button and a click input for the first application option.
  • the first application option may not be directly displayed on the user interface of the electronic device, and the first sharing input includes the first input and the second input.
  • the first input of the first sharing input includes a click input, a pressing input, a sliding input, etc. for the first sharing button.
  • a list of sharing target applications is displayed on the user interface, and the list of sharing target applications includes a first application option.
  • the second input of the first sharing input includes a click input, a pressing input, a sliding input, etc. for the first application option.
  • sharing the video and the at least one screenshot in the first application corresponding to the first application option In response to a second input of the first sharing input, sharing the video and the at least one screenshot in the first application corresponding to the first application option.
  • the first sharing input before receiving the first input of the first sharing input, there is no need to display the first application option on the user interface of the electronic device, especially in the case of a large number of application options, which makes the user interface more concise.
  • dividing the first sharing input into a first input and a second input can provide users with more opportunities to consider when deciding which application to share the video and multiple screenshots with.
  • FIG. 5 is a schematic diagram illustrating a user interface 500 for editing a displayed video and multiple screenshots according to an exemplary embodiment of the present disclosure.
  • the method may further include: receiving a selection input for one or more of the thumbnail of the video and the thumbnails of the multiple screenshots; in response to the selection input, selecting all The one or more thumbnails; and again in response to the selection input, the one or more thumbnails are no longer selected.
  • the selection input for the thumbnail of the video may include a click input, a press input, etc. for the thumbnail of the video.
  • the selection input for one or more of the thumbnails of the plurality of screenshots may include a click input, a press input, a sliding input, etc., for the one or more thumbnails.
  • the selecting the one or more thumbnails in response to the selected input may include determining a sliding path of the sliding input on the user interface, and determining the sliding The thumbnails passed by the path, and the thumbnails passed by the sliding path are selected as one or more thumbnails.
  • the selected one or more thumbnails may be highlighted.
  • a check mark may be displayed on the selected one or more thumbnails. For example, as shown in FIG. 5, if the thumbnail of screenshot 5 and the thumbnail of screenshot 7 are selected, a check mark is displayed on the thumbnail of screenshot 5 and the thumbnail of screenshot 7 as a check mark 532.
  • a bold border may be displayed around the selected thumbnail or thumbnails.
  • the selected thumbnail or thumbnails may be slightly enlarged. According to some examples, the brightness of the selected one or more thumbnails can be increased.
  • the selected thumbnail or thumbnails may no longer be highlighted.
  • the check mark may no longer be displayed.
  • the check mark as the check mark 532 is no longer displayed.
  • the bold border around the selected thumbnail or thumbnails may no longer be displayed.
  • one or more thumbnails displayed slightly enlarged may be reduced to the size before the enlargement.
  • the brightness of one or more thumbnails whose brightness is increased may be reduced to the brightness before the brightness is increased.
  • the method may further include: when the one or more thumbnails are selected, receiving a second save input for a second save button displayed on the user interface of the electronic device; and responding to The second saving input is to store the screenshots and/or videos corresponding to the selected one or more thumbnails in the multiple screenshots and/or the videos to the screenshot folder and/or video folder .
  • the second save button may be displayed when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed.
  • the second save button cannot receive a second save input.
  • the second save button cannot receive a second save input, and when one or more thumbnails are selected, all The second save button is configured to receive a second save input. For example, when the second save button is in a state where it can receive the second save input, it can be displayed normally; and when the second save button is in a state where it cannot receive the second save input, it can be grayed out.
  • the second save button 548 may be displayed when the one or more thumbnails are selected.
  • an edit frame 540 is displayed on the video screenshot card 510.
  • the upper edge of the edit frame 540 may be located above the top row of thumbnails in the selected one or more thumbnails, and the lower edge of the edit frame 540 may be located at the bottom row of the selected one or more thumbnails Below the thumbnail. In this way, the spatial extent of the selected thumbnail or thumbnails can be better displayed.
  • the second save button 548 is displayed on the upper edge of the edit frame 540, of course, the present disclosure is not limited to this.
  • the second save input for the second save button displayed on the user interface of the electronic device may include a click input, a press input, etc. for the second save button.
  • the user can select his favorite videos and/or screenshots from the thumbnail of the video and the thumbnails of the multiple screenshots, and save these videos and/or screenshots separately To the video folder and/or screenshot folder.
  • the method may further include: when the one or more thumbnails are selected, receiving a second share button 546 and a second application option displayed on the user interface of the electronic device. 2. Sharing input, wherein the second application option corresponds to the second application; in response to the second sharing input, combine the multiple screenshots and/or the video with the selected one or more The screenshots and/or videos corresponding to the two thumbnails are shared to the second application.
  • various display timings of the second share button for example, when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed, when one or more thumbnails are selected, etc.
  • the display position For example, display on the user interface, display on the video screenshot card, display on the edit frame, etc.
  • display method for example, can receive the second sharing input (normal display), not receive the second sharing input (grayed out) Etc.) It can be the same or similar to the second save button that has been described in detail above, and will not be repeated here.
  • the second sharing input for the second sharing button and the second application option displayed on the user interface of the electronic device may include a click input, a press input, etc. for the second sharing button.
  • various input modes of the second sharing input for example, directly displaying the second application option, or in response to the first input of the second sharing input displaying a list of sharing target applications including the second application option, and
  • the screenshot corresponding to the selected one or more thumbnails is shared to the second application corresponding to the second application option) with the first sharing that has been described in detail above
  • the inputs can be the same or similar, so I won’t repeat them here.
  • the user can select their favorite videos and/or screenshots from the thumbnail of the video and the thumbnails of the multiple screenshots, and share these videos and/or screenshots together To the second application.
  • the method may further include: when the one or more thumbnails are selected, receiving a puzzle input 542 for a puzzle button displayed on a user interface of the electronic device; and responding to the puzzle Input to generate a mosaic image of one or more screenshots corresponding to the selected one or more thumbnails among the plurality of screenshots, wherein the mosaic image spatially includes the selected one or the selected one or One or more screenshots corresponding to multiple thumbnails.
  • various display timings of the puzzle button for example, when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed, when one or more thumbnails are selected, etc.
  • the display position for example, , Displayed on the user interface, displayed on the video screenshot card, displayed on the editing frame, etc.
  • display methods for example, can receive puzzle input (normal display), can not receive puzzle input (grayed), etc.
  • the collage button can receive a collage input, and in response to the collage input, the thumbnail of the selected video is ignored , And only generate a mosaic of one or more screenshots corresponding to the selected one or more thumbnails.
  • the puzzle input for the puzzle button displayed on the user interface of the electronic device may include click input, press input, etc. for the puzzle button.
  • the mosaic is a picture, which spatially includes one or more screenshots corresponding to all the selected one or more thumbnails.
  • One or more screenshots can be arranged in the mosaic in any manner.
  • the generating a mosaic of one or more screenshots corresponding to the selected one or more thumbnails among the plurality of screenshots may include: determining the number of selected thumbnails; and if If the number is equal to one, then a screenshot corresponding to a selected thumbnail will be used as the mosaic; if the number is an odd number greater than one, then the images corresponding to the selected multiple thumbnails will be arranged in any row
  • the mosaic image is generated by a screenshot of one of the multiple screenshots and two screenshots of the multiple screenshots corresponding to the selected multiple thumbnails are arranged in each row of the remaining rows; if the number is an even number, it will be based on each row.
  • the mosaic image is generated by arranging two of the multiple screenshots corresponding to the selected multiple thumbnails.
  • the number of selected thumbnails is an odd number greater than 1, one screenshot may be arranged in the first row, and two screenshots may be arranged in each row in the remaining rows.
  • the number of selected thumbnails is three, three screenshots can be arranged in the font of " ⁇ ".
  • the present disclosure is not limited to this.
  • the screenshots corresponding to the selected multiple thumbnails may also be arranged in various shapes such as circles and hearts.
  • the user can select screenshots representing several key steps in the teaching demonstration operation, and stitch these screenshots into a mosaic.
  • the user can show the essence of their teaching demonstration operations without having to watch the entire recorded video in full.
  • the method may further include: when the one or more thumbnails are selected, receiving an animation input for the animation button 544 displayed on the user interface of the electronic device; and responding to the animation button 544 displayed on the user interface of the electronic device;
  • the animation input is used to generate an animation showing one or more screenshots corresponding to the selected one or more thumbnails at a certain frequency, wherein the animation includes the same time as the selected one or more One or more screenshots corresponding to or multiple thumbnails.
  • various display timings for example, when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed, when one or more thumbnails are selected, etc.
  • the display position For example, display on the user interface, display on the video screenshot card, display on the editing frame, etc.
  • display methods for example, can receive animation input (normal display), cannot receive animation input (grayed), etc.
  • the second save button that has been described in detail above is similar and will not be repeated here.
  • the animation button when one or more thumbnails are selected, it is determined whether the selected one or more thumbnails includes a thumbnail of the video. According to some examples, if the selected one or more thumbnails include a video thumbnail, the animation button cannot receive animation input. According to other examples, regardless of whether the selected one or more thumbnails includes a video thumbnail, the animation button can receive animation input, and in response to the animation input, the selected video is ignored Thumbnails, and only one or more screenshots corresponding to the selected one or more thumbnails are generated.
  • the animation input for the animation button displayed on the user interface of the electronic device may include a click input, a press input and the like for the animation button.
  • one or more screenshots corresponding to all selected one or more thumbnails are continuously played at a certain frame rate to generate a moving picture.
  • An animated picture is a picture, which can be a gif format animated picture, which includes one or more screenshots corresponding to all the selected one or more thumbnails in time.
  • a user when a user is recording a movie, he can select multiple screenshots representing key scenes and key plots in the movie, and use these screenshots to generate animations. Through this animated picture with a playing time much shorter than the movie time, the user can show the key scenes and key plots in the movie without having to watch the entire recorded movie in its entirety.
  • the recording time may be relatively long, and the number of screenshots obtained is relatively large. At this time, one or more screenshots can be automatically recommended for the user based on certain criteria.
  • the method may further include: evaluating the plurality of screenshots based on preset rules to obtain a score associated with each of the plurality of screenshots; The associated score is compared with a score threshold; and one or more screenshots of the plurality of screenshots with a score greater than or equal to the score threshold are highlighted on the user interface of the electronic device.
  • the score threshold may be fixed.
  • the score threshold may be set in advance by the user or set by default by the system.
  • the score threshold may be variable.
  • the maximum value of the scores associated with each screenshot is taken, and a certain percentage (less than 1) of the maximum value is used as the score threshold, such as 90%, 95%, 97%, and so on.
  • the scores associated with each screenshot are sorted, and the score with the Nth highest score is used as the score threshold, and N is, for example, 1, 2, 3, 5, and so on.
  • one or more screenshots with a score greater than or equal to the score threshold may be highlighted in various ways. For example, a star mark may be displayed on one or more thumbnails of one or more screenshots with a score greater than or equal to the score threshold. For another example, one or more thumbnails of one or more screenshots with a score greater than or equal to the score threshold may be displayed in blinking.
  • the preset rule may include at least one of the following: whether there is a human face in the screenshot, the completeness of the human face in the screenshot, the resolution of the screenshot, and the sharpness of the screenshot.
  • the score of a screenshot with a human face in the screenshot is higher than a score of a screenshot with no human face in the screenshot.
  • the score of the screenshot with high integrity of the face existing in the screenshot is higher than the score of the screenshot with low integrity of the face existing in the screenshot.
  • a screenshot with a high resolution score is higher than a screenshot with a low resolution score.
  • the score with high sharpness of the screenshot is higher than the score with low sharpness of the screenshot.
  • each item in the preset rule may be assigned an associated specific weight, and the item score of each item may be multiplied by the associated specific weight and summed to obtain the score of the screenshot.
  • buttons on the user interfaces 400A, 400B, and 500 and their corresponding functions will be described in conjunction with FIGS. 4A, 4B, and 5.
  • thumbnails of the multiple screenshots may be selected in response to input to the select all buttons 412A, 412B, 512 (eg, click input, press input, etc.).
  • the thumbnail of the video and the thumbnails of the multiple screenshots may no longer be selected in response to an input to the exit selection button 550 shown in FIG.
  • one or more thumbnails may no longer be selected.
  • the exit screen capture function in response to input (for example, click input, press input, etc.) for the close buttons 413A, 413B, and 513 shown in FIGS. 4A, 4B, and 5, the exit screen capture function may be turned off.
  • audio information associated with the user interface of the electronic device may be recorded synchronously.
  • the method may further include: in response to meeting the recording start condition, during the recording of the user interface of the electronic device, collecting audio information associated with the electronic device, wherein the audio information is at time The axis corresponds to the video.
  • the audio information associated with the electronic device may include audio information externally played through an audio output device of the electronic device.
  • the audio information associated with the electronic device may include audio information acquired through an audio input device (for example, a microphone).
  • the audio information associated with the electronic device may also include audio information directly obtained from the underlying hardware of the electronic device.
  • the audio information associated with the electronic device may also include a combination of two or more of the aforementioned various audio information associated with the electronic device.
  • audio information may be extracted from the obtained video associated with the user interface of the electronic device after stopping the recording of the user interface of the electronic device.
  • the method may further include: recognizing and obtaining text information corresponding to the audio information on a time axis in real time; and adding the text information to the video and/or the video according to the time axis.
  • the text information can be displayed simultaneously with the video and/or the multiple screenshots.
  • the way based on the time axis can make the audio information and the video have a one-to-one correspondence at the same time. For example, if the current user interface is displaying a movie, and audio information can be obtained at the same time when recording the screen. In this way, during playback, the video and audio information can be combined according to the time axis, so that the user can not only watch the screen of the movie displayed on the user interface, but also listen to the sound corresponding to the displayed movie.
  • textual information corresponding to video and audio information on the time axis can be recognized in real time. For example, if the current user interface is displaying a movie, and the audio information is obtained at the same time when the screen is recorded, real-time recognition is performed and text information is obtained. In this way, during playback, the video and text information can be combined according to the time axis, so that when it is inconvenient to make a sound, or when the user is a hearing impaired, the screen of the movie displayed on the user interface can be viewed. , And can display real-time subtitles corresponding to the movie.
  • the time axis-based approach can enable audio information, text information, and video to have a one-to-one correspondence at the same time. For example, if the current user interface is displaying a movie, and the audio information is obtained at the same time when the screen is recorded, real-time recognition is performed and text information is obtained. In this way, when playing, the video, audio information and text information can be combined according to the time axis, so that the user can watch the screen of the movie, the sound corresponding to the screen, and the real-time subtitles corresponding to the sound at the same time.
  • audio information can be obtained at the same time and text information corresponding to the audio information can be recognized in real time.
  • a thumbnail of the audio information corresponding to the audio information may be displayed in the video screenshot card as described above.
  • the audio information in response to a playback input for a thumbnail of the audio information (for example, a click input for a play button displayed on the thumbnail of the audio information, a press input for a thumbnail of the audio information Etc.), the audio information can be played.
  • the audio information in response to the first saving input described above, in addition to saving the video to the video folder and saving the multiple screenshots to the screenshot folder, the audio information may also be saved To the audio folder.
  • the audio information in response to the first sharing input described above, in addition to sharing the video and the multiple screenshots to the first application, the audio information may also be shared to the first application. application.
  • the second aspect of the present disclosure may include an apparatus for operating an electronic device.
  • FIG. 6 is a structural block diagram showing an apparatus for operating an electronic device according to an exemplary embodiment of the present disclosure.
  • the apparatus 600 for operating an electronic device may include: a determining unit 601, configured to determine whether a screenshot start condition is satisfied; and a screenshot unit 602, configured to automatically perform an automatic operation on the user interface of the electronic device. Take screenshots to obtain multiple screenshots associated with the user interface of the electronic device; and the stopping unit 603 is configured to stop taking screenshots of the user interface of the electronic device in response to determining that the screenshot stopping condition is satisfied.
  • the apparatus 600 for operating an electronic device may further include a unit configured to perform other steps of any of the foregoing methods.
  • each unit or each feature of the exemplary apparatus for operating an electronic device in the present disclosure may refer to the specific implementation of the corresponding feature in the foregoing exemplary method for operating an electronic device in the present disclosure. So I won't repeat it.
  • the units involved in describing the exemplary apparatus for operating an electronic device of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Among them, the name of the unit does not constitute a limitation on the unit itself under certain circumstances.
  • each unit of the exemplary apparatus for operating an electronic device of the present disclosure may be at least partially performed by one or more hardware logic components.
  • exemplary types of hardware logic components include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
  • the third aspect of the present disclosure may include an electronic device that may include a processor; and a memory storing a program, the program including instructions that when executed by the processor cause the processor to execute Any of the foregoing methods.
  • the fourth aspect of the present disclosure may include a storage medium storing a program, the program including instructions that, when executed by a processor of an electronic device, cause the electronic device to perform any of the foregoing methods.
  • the fifth aspect of the present disclosure may include a computer program product including a program, the program including code that, when executed by a processor of an electronic device, causes the electronic device to perform any of the foregoing methods.
  • FIG. 7 shows a schematic structural diagram of an electronic device 700 (for example, the electronic device in the present disclosure) suitable for implementing the embodiments of the present disclosure.
  • the electronic device shown in FIG. 7 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
  • the electronic device 700 may include a processing device (such as a central processing unit, a graphics processor, etc.) 701, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 702 or from a storage device 706
  • the program in the memory (RAM) 703 executes various appropriate actions and processing.
  • various programs and data required for the operation of the electronic device 700 are also stored.
  • the processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704.
  • An input/output (I/O) interface 705 is also connected to the bus 704.
  • the following devices can be connected to the I/O interface 705: including input devices 706 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCD), speakers, vibrations
  • input devices 706 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.
  • LCD liquid crystal displays
  • An output device 707 such as a device
  • a storage device 706 such as a magnetic tape, a hard disk, etc.
  • the communication device 709 may allow the electronic device 700 to perform wireless or wired communication with other devices to exchange data.
  • FIG. 7 shows an electronic device 700 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may alternatively be implemented or provided with more or fewer devices.
  • the process described above with reference to the flowchart can be implemented as a computer software program.
  • the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from the network through the communication device 709, or installed from the storage device 706, or installed from the ROM 702.
  • the processing device 701 the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
  • the aforementioned storage medium in the present disclosure may be a computer-readable storage medium.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
  • the computer-readable signal medium may send, propagate or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
  • the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
  • examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any Networks currently known or developed in the future.
  • LAN local area networks
  • WAN wide area networks
  • Internet e.g., the Internet
  • end-to-end networks e.g., ad hoc end-to-end networks
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
  • the aforementioned computer-readable medium carries one or more programs.
  • the electronic device determines whether the screenshot start condition is satisfied; in response to determining that the screenshot start condition is satisfied, recording The user interface of the electronic device to obtain a video associated with the user interface of the electronic device; during the recording of the user interface of the electronic device, an automatic screenshot of the user interface of the electronic device is taken to obtain the video associated with the user interface of the electronic device.
  • the computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or a combination thereof.
  • the above-mentioned programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).
  • LAN local area network
  • WAN wide area network
  • each block in the flowchart or block diagram may represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions.
  • the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.
  • each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.
  • a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • the machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing.
  • machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM compact disk read only memory
  • magnetic storage device or any suitable combination of the foregoing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种用于操作电子设备的方法、装置、终端设备及计算机可读存储介质。所述用于操作电子设备的方法包括：确定是否满足截图开始条件（S101）；响应于确定满足所述截图开始条件，对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图（S102）；以及响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行自动截图（S103）。

Description

操作用户界面的方法、装置、电子设备及存储介质 技术领域
本公开涉及用户界面处理技术领域，特别涉及一种用于操作电子设备的方法、装置、电子设备及存储介质。
背景技术
相关技术中，在用户使用电子设备期间(例如，用户在观看电子设备上播放的视频时或者希望将自己在电子设备上的操作分享给其他人时)，用户可能期望对电子设备的用户界面进行截图。虽然对不同电子设备的用户界面进行截图的操作不尽相同，但是用户对电子设备的用户界面进行截图的操作都可能会影响用户的当前操作，这会给用户的使用带来不便。
在此部分中描述的方法不一定是之前已经设想到或采用的方法。除非另有指明，否则不应假定此部分中描述的任何方法仅因其包括在此部分中就被认为是现有技术。类似地，除非另有指明，否则此部分中提及的问题不应认为在任何现有技术中已被公认。
发明内容
根据本公开的第一方面，提供一种用于操作电子设备的方法，包括：确定是否满足截图开始条件；响应于确定满足所述截图开始条件，对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图；以及响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行自动截图。
根据本公开的第二方面，提供一种用于操作电子设备的装置，包括：确定单元，被配置为确定是否满足截图开始条件；截图单元，被配置为对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图；以及停止单元，被配置为响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行截图。
根据本公开的第三方面，提供一种电子设备，包括：处理器；以及存储程序的存储器，所述程序包括指令，所述指令在由所述处理器执行时使所述处理器执行本公开中所述的用于操作电子设备的方法。
根据本公开的第四方面，提供一种存储程序的计算机可读存储介质，所述程序包括指令，所述指令在由电子设备的处理器执行时，致使所述电子设备执行本公开中所述的用于操作电子设备的方法。
根据本公开的第五方面，提供一种包括程序的计算机程序产品，所述程序包括代码，所述代码在由电子设备的处理器执行时，致使所述电子设备执行本公开中所述的用于操作电子设备的方法。
附图说明
附图示例性地示出了实施例并且构成说明书的一部分，与说明书的文字描述一起用于讲解实施例的示例性实施方式。所示出的实施例仅出于例示的目的，并不限制权利要求的范围。在所有附图中，相同的附图标记指代类似但不一定相同的要素。
图1是示出根据本公开的示例性实施例的用于操作电子设备的方法的流程图；
图2是示出根据本公开的示例性实施例的确定是否满足截图开始条件的一个示例的用户界面的示意图；
图3是示出根据本公开的示例性实施例的录屏窗口的用户界面的示意图；
图4A是示出根据本公开的示例性实施例的在电子设备为竖屏状态下所显示的视频和多个截图的用户界面的示意图；
图4B是示出根据本公开的示例性实施例的在电子设备为横屏状态下所显示的视频和多个截图的用户界面的示意图；
图5是示出根据本公开的示例性实施例的对所显示的视频和多个截图进行编辑操作的用户界面的示意图；
图6是示出根据本公开的示例性实施例的用于操作电子设备的装置的结构框图；
图7是示出能够应用于本公开的示例性实施例的示例性电子设备的结构框图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施 例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，在本公开中，除非另有说明，否则使用术语“第一”、“第二”等来描述各种要素不意图限定这些要素的位置关系、时序关系或重要性关系，这种术语只是用于将一个元件与另一元件区分开。在一些示例中，第一要素和第二要素可以指向该要素的同一实例，而在某些情况下，基于上下文的描述，它们也可以指代不同实例。
另外，在本公开中对各种所述示例的描述中所使用的术语只是为了描述特定示例的目的，而并非旨在进行限制。除非上下文另外明确地表明，如果不特意限定要素的数量，则该要素可以是一个也可以是多个。此外，本公开中所使用的术语“和/或”涵盖所列出的项目中的任何一个以及全部可能的组合方式。
再有，需要注意，本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
在本公开中，“电子设备”可以是任何类型的电子设备，例如可以是但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。
在本公开中，“窗口”是代码或程序在电子设备的用户界面上显示的媒介。特别地，“应用程序”通过“应用程序窗口”显示在电子设备的用户界面上。
相关技术中，在用户使用电子设备期间(例如，用户在观看电子设备上播放的视频时或者希望将自己在电子设备上的操作分享给其他人时)，用户可能期望对电子设备的用户界面进行截图。虽然对不同电子设备的用户界面进行截图的操作不尽相同，但是用户对电子设备的用户界面进行截图的操作都可能会影响用户的当前操作，这会给用户的使用带来不便。
为此，本公开提供了一种用于操作电子设备的方法。根据本公开的用于操作电子设备的方法能够对电子设备的用户界面进行自动截图，以获得供用户后续操作使用的与电子设备的用户界面相关联的多个截图。这使得在满足截图开始条件的情况下，可以执行自动截图的功能，简化了用户的操作。另外，根据本公开的用于操作电子设备的方法能够对电子设备的用户界面进行自动截图，而不必须要求用户根据不同电子设备的操作规范来手动截图，这使得在截图的过程不会影响到用户的当前操作。
以下将结合附图对本公开的用于操作电子设备的方法的示例性实施例进行进一步描述。
参照图1，本公开的第一方面可以包括一种用于操作电子设备的方法，所述方法可以包括：确定是否满足截图开始条件(S101)；响应于确定满足所述截图开始条件，对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图(S102)；响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行自动截图(S103)。
在步骤S101中，根据一些实施例，可以由电子设备确定是否满足截图开始条件。根据一些实施例，截图开始条件可以是用户针对电子设备的用户界面的截图开始输入。根据一些实施例，截图开始条件可以是用户针对电子设备的物理按键的截图开始输入。根据一些实施例，截图开始条件也可以与用户的输入无关。后文中将详细描述如何确定是否满足截图开始条件。
在步骤S102中，根据一些实施例，对电子设备的用户界面进行自动截图(又可以简称为截屏)是电子设备自动执行的，而无需用户手动操作。
根据一些实施例，可以电子设备的用户界面的全部进行自动截图。根据另一些实施例，也可以对电子设备的用户界面的一部分进行自动截图，例如在对视频的截图的过程中，自动过滤掉视频的黑边区域等。
在相关技术中，对电子设备的用户界面进行截图通常会显示截图动画。
根据一些实施例，在对所述电子设备的用户界面进行自动截图时，在所述电子设备的用户界面上可以不显示截图动画。
以这样的方式，在截图期间不会由于截图动画而干扰电子设备的用户界面的当前显示内容，以致影响用户对电子设备的当前操作，这改善了用户的视觉体验。
在相关技术中，在对电子设备的用户界面进行截图通常会产生截图音效。
根据一些实施例，在对所述电子设备的用户界面进行自动截图时，所述电子设备可以不产生截图音效。
以这样的方式，在截图期间不会由于截图音效而干扰电子设备的音频输出设备的当前播放内容，以致影响用户，这改善了用户的听觉体验。
在步骤S103中，根据一些实施例，可以由电子设备确定是否满足截图停止条件。根据一些实施例，截图停止条件可以是用户针对电子设备的用户界面的截图停止输入。根据一些实施例，截图停止条件可以是用户针对电子设备的物理按键的截图停止输入。根 据一些实施例，截图停止条件也可以与用户的输入无关。后文中将详细描述如何确定是否满足截图停止条件。
根据一些实施例，响应于确定满足截图停止条件，可以直接在电子设备的用户界面上显示所述多个截图的缩略图和/或所述视频的缩略图。根据另一些实施例，响应于确定满足录音停止条件，也可以不直接显示所述多个截图的缩略图和/或所述视频的缩略图，而是将其保存在临时文件夹中，以供用户后续的操作使用。
根据一些实施例，所述电子设备的用户界面可以是触敏用户界面。
下文将描述如何在步骤S101中确定是否满足截图开始条件。
根据一些实施例，所述确定是否满足所述截图开始条件可以包括：响应于接收针对所述电子设备的用户界面的自动截图指示输入，确定满足所述截图开始条件。
根据一些实施例，自动截图指示输入可以包括点击输入、按压输入、滑动输入、抬起输入、或其组合。根据一些实施例，自动截图指示输入可以包括一个输入，例如针对录屏截图按钮的点击输入、针对用户界面上的一定位置的按压输入等。根据另一些实施例，自动截图指示输入也可以包括多个输入。后文将详细描述包括多个输入的自动截图指示输入。
在一些情况下，可以判断电子设备的用户界面在接收到所述自动截图指示输入时的状态。
根据一些实施例，所述方法还可以包括：接收针对所述电子设备的用户界面的自动截图指示输入，其中，所述确定是否满足截图开始条件包括：确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是否为应用程序窗口；响应于确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是应用程序窗口，确定所述应用程序窗口是否允许被截图；以及响应于确定所述应用程序窗口允许被截图，确定满足所述截图开始条件。
根据一些实施例，所述电子设备的用户界面在接收到所述自动截图指示输入时显示的可能是应用程序窗口、系统桌面、任务管理器窗口等。
在所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是应用程序窗口的情况下，可以进一步判断该应用程序窗口是否允许被截图。
在一些情况下，应用程序窗口允许被截图。在这些情况下，用户界面在接收到自动截图指示输入时显示的是应用程序窗口，可以确定满足截图开始条件。
在另一些情况下，应用程序窗口不允许被截图。根据一些实施例，应用程序窗口的开发者可能不允许应用程序窗口被截图(例如，出于著作权或隐私权等的原因)。根据一些实施例，用户将应用程序窗口设置为不允许被截图。用户可能因为在操作应用程序窗口时不希望被打扰等原因而将应用程序窗口设置为不允许被截图。例如，可通过用户设置为不允许被截图的应用程序窗口可以是游戏类应用程序窗口。因此，用户界面在接收到自动截图指示输入时显示的是不允许被截图的应用程序窗口的情况下，可以确定不满足截图开始条件。
以这样的方式，可以基于对用户界面在接收到自动截图指示输入时显示的是否为应用程序窗口，确定是否可以进一步判断该应用程序窗口是否允许被截图。对于不允许被截图的应用程序窗口而言，如果在应用程序窗口处接收到自动截图指示输入(例如，用户误操作或者自动截图指示输入的输入方式与显示的应用程序窗口中的某个操作的输入方式相同等)，电子设备不会响应于所述自动截图指示输入而开始截图，这使得对自动截图指示输入的响应更精确，提升了用户体验。
根据一些实施例，所述确定是否满足截图开始条件还包括：响应于确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的不是应用程序窗口，确定满足所述截图开始条件。
根据一些实施例，电子设备的用户界面在接收到所述自动截图指示输入时可以不是应用程序窗口，例如可以是桌面窗口、任务管理器窗口等。在这些情况下，由于可能不存在被打扰的问题，因此电子设备可以直接确定满足截图开始条件，并开始自动截图，简化了确定是否满足截图开始条件的步骤。
如上文所述，所述自动截图指示输入可以包括单个输入也可以包括多个输入。
根据一些实施例，所述接收针对所述电子设备的用户界面的自动截图指示输入可以包括：接收针对所述电子设备的用户界面的功能菜单呼出输入；响应于接收到所述功能菜单呼出输入，在所述电子设备的用户界面上显示功能选择菜单，其中，所述功能选择菜单包括录屏截图功能选项；以及接收针对所述录屏截图功能选项的选择。
图2是示出根据本公开的示例性实施例的确定是否满足截图开始条件的一个示例的用户界面200的示意图。下文将结合图2描述如何通过功能选择菜单和对功能选择菜单上的功能选项的选择来确定截图开始条件。
根据一些实施例，所述自动截图指示输入可以包括两个输入。所述自动截图指示输入的第一输入包括针对所述电子设备的用户界面的功能菜单呼出输入。参照图2，响应于 接收到所述功能菜单呼出输入(例如，针对功能菜单呼出按钮的点击输入、针对用户界面的按压输入、从电子设备的用户界面的下边缘起向上进行的滑动输入等)，在所述电子设备的用户界面上显示功能选择菜单201。根据一些实施例，所述功能选择菜单201可以包括多个功能选项。根据图2所示的示例，所述功能选择菜单201可以包括三个功能选项，分别为音频分词功能选项202-1、录屏截图功能选项202-2和图片分词功能选项202-3。当然，本公开不限于此，所述功能选择菜单可以包括任意数量个功能选项。用户可以选择功能菜单201中的一个功能选项。根据一些实施例，所述自动截图指示输入还包括针对录屏截图功能选项202-2的选择作为所述自动截图指示输入的第二输入。
以这样的方式，可以分两个输入来确定是否满足截图开始条件，这为用户提供了更多的确定机会和更长的考虑时间，能够防止用户因为误操作而非有意地开始自动截图。
根据一些实施例，所述方法还可以包括：接收针对所述电子设备的用户界面的自动截图指示输入，其中，所述确定是否满足截图开始条件可以包括：获取所述自动截图指示输入在所述电子设备的用户界面上的位置；确定所述电子设备的用户界面在所述位置处是否属于文字可提取区域；以及响应于确定所述电子设备的用户界面在所述位置处不属于文字可提取区域，确定满足所述截图开始条件。
根据一些实施例，电子设备的用户界面可以包括文字可提取区域和文字不可提取区域。文字可提取区域是指响应于文字提取输入可选中文字的区域，例如，聊天应用程序中的文字类会话所处的区域、邮箱应用程序中的文字类正文所处的区域等。文字不可提取区域是指响应于文字提取输入不可选中文字的区域，例如，系统桌面、相册应用程序中的图片所处的区域等。所述文字提取输入可以包括针对文字可提取区域的点击输入、按压输入、滑动输入、抬起输入、或其组合。可见，文字提取输入可能会与自动截图指示输入发生重叠。
根据一些实施例，当所述自动截图指示输入在所述电子设备的用户界面上的位置不属于文字可提取区域时，确定满足截图开始条件，并进行截图。以这样的方式，可以更精确地确定截图开始条件，不会与文字提取输入互相干扰，提升了用户体验。
根据一些实施例，在如前所述自动截图指示输入包括多个输入(即功能菜单呼出输入和针对所述录屏截图功能选项的输入)的情况下，所述获取所述自动截图指示输入在所述电子设备的用户界面上的位置可以包括：获取所述功能菜单呼出输入在所述电子设备的用户界面上的位置。根据一些实施例，响应于确定作为所述自动截图指示输入的第一输入的功能菜单呼出输入不属于文字可提取区域，确定可以显示功能选择菜单。然后 进行作为所述自动截图指示输入的第二输入的对所述功能选择菜单中的录屏截图功能选项的选择。
以这样的方式，为了满足截图开始条件，可以通过作为自动截图指示输入的第一输入的功能菜单呼出输入排除针对文字可提取区域的误操作，同时通过作为自动截图指示输入的第二输入的录屏截图功能选项确认用户希望开始自动截图，进一步增加对满足截图开始条件的确定的精确性，提升了用户体验。
根据一些实施例，所述方法还可以包括：响应于确定所述电子设备的用户界面在所述位置处属于文字可提取区域，在所述电子设备的用户界面上显示功能选择菜单，其中，所述功能选择菜单包括录屏截图功能选项；接收针对所述录屏截图功能选项的选择；响应于接收到针对所述录屏截图功能选项的选择，确定满足所述截图开始条件。
根据一些实施例，在确定所述自动截图指示输入(例如，按压输入)的位置是属于文字可提取区域的情况下，无法确定用户是希望进行文字提取还是如本公开所述的自动截图。因此，根据一些实施例，可以在接收到用户对文字可提取区域的一部分或全部进行按压操作时，在用户界面上显示(例如，弹出)功能选择菜单，以供用户进一步确认期望电子设备执行的操作。根据一些实施例，功能选择菜单例如可以包括录屏截图功能选项、音频分词功能选项、图片分词功能选项、文字分词功能选项、文字提取功能选项等。根据一些实施例，用户可以选择所述录屏截图功能选项(例如，点击所述录屏截图功能选项、按压所述录屏截图功能选项、在所述录屏截图功能选项上滑动等)，并且在用户选择所述录屏截图功能选项之后，确定满足截图开始条件。
以这样的方式，即使用户的自动截图指示输入的位置位于文字可提取区域中，也不会完全排除掉用户希望进行自动截图的可能性，而是通过显示功能选择菜单来给予用户进一步选择的可能性。当用户选择与自动截图功能相关联的录屏截图功能选项时，电子设备仍然可以执行自动截图功能。
下文将结合本公开的示例性实施例详细描述步骤S102中的自动截图的示例性方式。
根据一些实施例，所述对所述电子设备的用户界面进行自动截图可以包括：以预设时间间隔对所述电子设备的用户界面进行自动截图。根据一些示例，预设时间间隔可以是每0.1秒一次、每0.2秒一次、每0.3秒一次、每0.4秒一次、每0.8秒一次、或每1秒一次等。
在相关技术中，受限于手速，只能以较低的频率对电子设备的用户界面进行手动截图，而根据本公开的用于操作电子设备的方法能够实现高速自动截图。
此外，相关技术中，受限于控制力，对电子设备的用户界面进行手动截图的频率不稳定，而根据本公开的用于操作电子设备的方法能够实现匀速截图，并且能够根据需要调整自动截图的频率(将在下文详细描述)。
在一些情况下，对电子设备的用户界面进行自动截图的时间可能较长，同时也会得到较多的截图。
根据一些实施例，所述对所述电子设备的用户界面进行自动截图可以包括：实时获取对所述电子设备的用户界面进行自动截图的已经过时间；以及基于实时获取的已经过时间，动态地调整对所述电子设备的用户界面进行自动截图的时间间隔。
根据一些实施例，可以通过电子设备的计时器实时获取对电子设备的用户界面进行自动截图的已经过时间。所述已经过时间可以是从开始对电子设备的用户界面进行自动截图的时刻起直到当前时刻为止之间经过的时间。
以这样的方式，可以根据已经过时间调整自动截图的时间间隔(即，自动截图的速率)。与相关技术中的手动截图相比，根据本公开的示例性实施例的对电子设备的用户界面进行自动截图是可控制的。
根据一些实施例，当已经过时间较小时，可以以较小的时间间隔对电子设备的用户界面进行自动截图；而当已经过时间较大时，可以以较大的时间间隔对电子设备的用户界面进行自动截图。
根据一些实施例，所述基于实时获取的已经过时间，动态地调整对所述电子设备的用户界面进行自动截图的时间间隔可以包括：当实时获取的已经过时间处于第一范围中时，以第一时间间隔对所述电子设备的用户界面进行自动截图；以及当实时获取的已经过时间处于第二范围中时，以第二时间间隔对所述电子设备的用户界面进行自动截图，其中，所述第一范围中的值均小于所述第二范围中的值，所述第一时间间隔小于所述第二时间间隔。
根据一些示例，第一范围可以是(0，15秒](即已经过时间大于0秒且小于或等于15秒)，第二范围可以是(15秒，30秒](即已经过时间大于15秒且小于或等于30秒)。根据一些示例，第一时间间隔可以是每0.2秒一次，第二时间间隔可以是每0.4秒一次。换言之，当对电子设备的用户界面进行自动截图的已经过时间不超过15秒时，可以每0.2秒对电子设备的用户界面进行一次截图；当对电子设备的用户界面进行自动截图的已经过时间超过15秒且不超过30秒时，可以每0.4秒对电子设备的用户界面进行一次截图。
根据一些实施例，所述基于实时获取的已经过时间，动态地调整对所述电子设备的用户界面进行自动截图的时间间隔还可以包括：当实时获取的已经过时间处于第三范围中时，以第三时间间隔对所述电子设备的用户界面进行自动截图，其中，所述第二范围中的值均小于所述第三范围中的值，所述第二时间间隔小于所述第三时间间隔。
根据一些示例，第三范围可以是(30秒，+∞)(即已经过时间大于30秒)，第三时间间隔可以是每0.8秒一次。换言之，当对电子设备的用户界面进行自动截图的已经过时间超过30秒时，可以每0.2秒对电子设备的用户界面进行一次截图。
以上描述了根据本公开的示例性实施例的一些示例，本领域技术人员应当知晓，可以根据实际情况改变第一范围、第二范围、第三范围、第一时间间隔、第二时间间隔、第三时间间隔，并且根据本公开的示例性实施例还可以包括第四范围、第五范围以及第四时间间隔、第五时间间隔等。
以这样的方式，当对电子设备的用户界面进行自动截图的已经过时间越长时，对电子设备的用户界面进行自动截图的时间间隔也越长。在已经过时间较长的情况下，这能够避免获得过多的截图，使得用户后续对这些截图进行的操作(例如，对截图进行筛选)更加便捷。
在一些情况下，根据上文描述的动态调整自动截图的时间间隔的方法得到的与电子设备的用户界面相关联的多个截图在时间上可能是不均匀的。
根据如上所述的示例，第一范围可以是(0，15秒](即已经过时间大于0秒且小于或等于15秒)，第二范围可以是(15秒，30秒](即已经过时间大于15秒且小于或等于30秒)，第一时间间隔可以是每0.2秒一次，第二时间间隔可以是每0.4秒一次，实时获取的已经过时间为30秒。在对电子设备的用户界面进行截图的30秒中，在已经过时间曾处于第一范围的状态下(即，前15秒)获得与电子设备的用户界面相关联的75(＝15秒/0.2秒一次)张截图。在已经过时间曾处于第一范围的状态下(即，前15秒)获得与电子设备的用户界面相关联的37(＝15秒/0.4秒一次并取整)张截图。
根据一些实施例，所述第二时间间隔是所述第一时间间隔的N倍，N是大于1的正整数，并且所述方法还可以包括：当实时获取的已经过时间处于第二范围中时，在已经过时间曾处于第一范围的状态下已获得的与电子设备的用户界面相关联的每N个截图中保留一个截图而删除其他截图。
根据如上所述的一些示例，可以看出，第二时间间隔是第一时间间隔的两倍。因此，可以在已经过时间曾处于第一范围的状态下(例如，前15秒)已获得的与电子设备的用 户界面相关联的每两个截图中保留一个截图而删除其他截图。根据如上所述的一些示例，换言之，在前15秒中获得的与电子设备的用户界面相关联的75个截图中，每两个截图保留一个截图而删除其他截图。根据一些示例，可以对这75个截图按时间顺序进行标号，并保留标号为偶数的截图，而删除标号为奇数的截图。对于后15秒中获得的与电子设备的用户界面相关联的37个截图，则不进行删除操作。这样，最终保留的截图在时间上是均匀的(即，每0.4秒一张)。根据另一些示例，当然也可以保留标号为奇数的截图，而删除标号为偶数的截图。
以这样的方式，在不知道对电子设备的用户界面进行自动截图的时长的情况下，根据本公开的示例性实施例的方法不仅能够根据自动截图的时长自适应地调整截图的时间间隔，还能够保持最终获得的与电子设备的用户界面相关联的多个截图在时间上的均匀性，极大地增强了自动截图的自适应能力，提升用户的使用体验。
根据一些实施例，所述方法还可以包括：响应于确定满足所述截图开始条件，录制所述电子设备的用户界面，以获得与所述电子设备的用户界面相关联的视频；响应于确定满足所述截图停止条件，停止录制所述电子设备的用户界面。
根据一些实施例，录制电子设备的用户界面(又可以简称为录屏)指的是以视频的方式记录电子设备的用户界面在一定时间内显示的内容，并且所获得的视频称为与电子设备的用户界面相关联的视频。
根据一些实施例，可以以帧为单位记录用户界面显示的图片并将这些图片合成视频。
虽然以上仅示例性地列举了录屏的一些实施例，但是应当注意的是，相关技术中所有能够实现录制用户界面(或屏幕)的技术均可以用于本公开中。
在本公开中，录制电子设备的用户界面是通过电子设备自身来实现的，而非通过外部设备(例如，摄像机等)对电子设备的用户界面进行拍摄来实现的。
在本公开中，录制时间是指从确定满足截图开始条件起直到确定满足截图停止条件为止之间经过的时间。
根据一些实施例，录制电子设备的用户界面通常可以用于录制电子设备正在播放的视频、录制对应用程序的教学演示操作等，当然本公开不限于这些实施例。
根据一些实施例，可以录制电子设备的用户界面的全部。根据另一些实施例，也可以录制电子设备的用户界面的一部分，例如在录制视频的过程中，自动过滤掉视频的黑边区域等。
图3是示出根据本公开的示例性实施例的录屏窗口的用户界面的示意图。下文将结合图3描述在录制电子设备的用户界面时可以显示的录屏窗口。
根据一些实施例，所述方法还可以包括：响应于确定所述自动截图指示输入满足所述截图开始条件，在所述电子设备的用户界面300上显示录屏窗口310，其中，所述录屏窗口指示所述电子设备的用户界面正在被录屏。
根据一些实施例，在录制电子设备的用户界面的过程中不显示录屏动画。特别地，在对电子设备的用户界面进行自动截图时，既不显示截图动画也不产生截图音效。这时，在确定满足截图开始条件之后，虽然电子设备确实正在执行录制和自动截图，但用户可能会因为接收不到来自电子设备的任何反馈而怀疑电子设备是否真的在执行录制和自动截图。因此，根据一些实施例，通过显示录屏窗口310为用户提供电子设备的用户界面正在被录屏的视觉反馈。
根据一些实施例，可以在录屏窗口310中显示文字提示“录屏中…”，从而为客户提供更直观地视觉反馈。如图3的示例所示，文字提示位于录屏窗口的底部，当然本公开不限于此，文字提示也可以位于录屏窗口的顶部或中部等位置。
根据一些实施例，可以在用户界面300或录屏窗口310中实时显示录制电子设备的用户界面的已经过时间。根据一些实施例，实时显示的已经过时间可以具有一定的透明度，例如60％等。这样，可以为在录制电子设备的用户界面实时提醒用户已经过的录制时间。
在一些情况下，虽然在用户界面上显示录屏窗口，但用户可能并不希望录屏窗口被录制到与电子设备的用户界面相关联的视频中，也不希望录屏窗口被自动截图到与电子设备的用户界面相关联的至少一个截图中。
根据一些实施例，所述对所述电子设备的用户界面进行自动截图可以包括：在对所述电子设备的用户界面进行自动截图期间，不对所述录屏窗口进行自动截图；并且所述录制所述电子设备的用户界面可以包括：在录制所述电子设备的用户界面期间，不录制所述录屏窗口。
根据一些实施例，不录制录屏窗口是指：在录制所述电子设备的用户界面期间，可以录制所述电子设备的用户界面中除了所述录屏窗口之外的区域和被所述录屏窗口遮挡的区域，使得所述视频中不存在所述录屏窗口。
根据一些实施例，不对所述录屏窗口进行自动截图是指：在对所述电子设备的用户界面进行自动截图期间，可以对所述电子设备的用户界面中除了所述录屏窗口之外的区 域和被所述录屏窗口遮挡的区域进行自动截图，使得所述多个截图中不存在所述录屏窗口。
根据一些实施例，在录制电子设备的用户界面的过程中，自动过滤显示在用户界面上的录屏窗口。以下将详细描述在录制过程中自动过滤录屏窗口的技术。
根据一些实施例，所述不对所述录屏窗口进行自动截图和/或所述不录制所述录屏窗口可以包括：将所述录屏窗口的截取属性调整为不可截取；在开始对所述电子设备的用户界面进行自动截图和/或开始录制电子设备的用户界面时，检测并接收所述录屏窗口的截取属性；响应于接收到所述录屏窗口的截取属性为不可截取，在对所述电子设备的用户界面进行自动截图期间不对所述录屏窗口进行自动截图和/或在录制所述电子设备的用户界面期间不录制所述录屏窗口。
根据一些实施例，电子设备的用户界面和录屏窗口可以在不同的图层中显示。例如，电子设备的用户界面在第一图层中显示，录屏窗口在第二图层中显示，第二图层在第一图层之上显示。根据一些实施例，在显示时，由于录屏窗口在用户界面之上显示，因此用户界面中被录屏窗口遮挡的区域不会被显示。
根据一些实施例，将所述录屏窗口的截取属性调整为不可截取。例如为所述录屏窗口赋予NOT_CAPTURE属性值等。
根据一些实施例，检测在第二图层上显示的录屏窗口的截取属性。如果截取属性为不可截取，则在录制电子设备的用户界面和/或对所述电子设备的用户界面进行自动截图期间，自动过滤在第二图层上显示的录屏窗口，而仅录制在第一图层上显示的电子设备的用户界面和/或对在第一图层上显示的电子设备的用户界面进行自动截图。
换言之，以就好像不存在录屏窗口一样的方式录制电子设备的用户界面，并且以就好像录屏窗口不存在一样的方式对用户界面进行自动截图。
根据一些实施例，在所述电子设备的用户界面上显示录屏窗口包括：将电子设备的用户界面实时渲染在用户界面视图控件上；以及将所述用户界面视图控件设置在所述录屏窗口中，以在所述录屏窗口中实时显示所述电子设备的用户界面的缩略图。
根据一些实施例，可以通过虚拟显示技术将电子设备的用户界面实时渲染在用户界面视图控件上。用户界面视图控件例如可以是Surface控件。虚拟显示技术例如可以包括安卓系统中的虚拟显示器技术(VirtualDisplay)等。
以这样的方式，可以使录屏窗口中显示的内容与电子设备的用户界面显示的内容同步。
如图3的示例所示，在用户界面300中正在显示的内容301是一棵树，而在录屏窗口中实时显示的内容311是所述一棵树的缩略图，以在视觉上向用户反馈电子设备确实正在录制当前显示的用户界面。
根据一些实施例，录屏窗口的宽高比与电子设备的用户界面的宽高比相同。根据一些实施例，录屏窗口的四个顶点处具有圆角，以显得更加美观。
如上文所述，可以录制电子设备的用户界面的一部分，也可以对电子设备的用户界面的一部分进行自动截图。应当注意的是，虽然下文仅以录制为例详细描述了录制电子设备的用户界面的一部分的技术，但是所述技术当然也可以用于对电子设备的用户界面的一部分进行截图。
根据一些实施例，在播放视频的情况下，电子设备的用户界面的一部分例如可以是视频播放区域。
根据一些实施例，所述方法还可以包括：在对所述电子设备的用户界面进行自动截图期间，确定所述电子设备的用户界面是否正在显示与视频播放应用程序对应的视频播放应用程序窗口，其中所述视频播放应用程序窗口包括视频播放区域，其中，所述对所述电子设备的用户界面进行自动截图包括：响应于确定所述电子设备的用户界面正在显示所述视频播放应用程序窗口，仅对所述视频播放区域进行截图，并且所述录制所述电子设备的用户界面包括：响应于确定所述电子设备的用户界面正在显示所述视频播放应用程序窗口，仅录制所述视频播放区域。
根据一些实施例，可以基于从电子设备的系统读取到的当前用户界面正在显示的应用程序窗口的信息来确定正在显示的应用程序窗口是否为视频播放应用程序窗口。根据一些示例，与视频播放应用程序窗口对应的视频播放应用程序可以是抖音、火山小视频等。
根据一些实施例，视频播放应用程序窗口可以显示视频播放区域、广告区域、用户评论区域、导演或演员或配音人员展示区域等。然而，在对视频播放应用程序窗口中播放的视频进行自动截图和/或录制视频播放应用程序窗口中播放的视频时，用户可能仅希望录制作为电子设备的用户界面的一部分的视频播放区域或对其进行自动截图。
根据一些实施例，所述对所述电子设备的用户界面进行自动截图和/或所述仅录制所述视频播放区域可以包括：确定所述视频播放区域在所述电子设备的用户界面上的位置；以及基于所述视频播放区域在所述电子设备的用户界面上的位置，对所述视频播放区域进行截图和/或录制所述视频播放区域。
根据一些实施例，可以使用坐标表示视频播放区域。根据一些示例，可以以用户界面的左下角的顶点为原点，以用户界面的水平向右的方向为x轴正方向，以用户界面的垂直向上的方向为y轴正方向建立坐标系。根据一些实施例，确定所述视频播放区域在所述电子设备的用户界面上的位置包括确定所述视频播放区域的边缘在所述坐标系中的坐标，并且将所述边缘内的所有坐标作为视频播放区域。
根据一些示例，在所述视频播放区域为长方形区域的情况下，可以确定视频播放区域的四条边在所述坐标系上的直线函数。例如，两条横边可以分别为y＝a和y＝b(其中a<b)，两条竖边可以分别为x＝c和x＝d(其中c<d)。然后，将四条边内的所有边内的区域作为视频播放区域，例如{c≤x≤d，且a≤y≤b}。根据一些实施例，将所获得的视频播放区域的左边与构成播放视频区域的边缘的像素对应，可以录制这些像素显示的内容，从而实现录制电子设备的用户界面的一部分。同样地，也可以仅对这些像素显示的内容进行截取，从而实现对电子设备的用户界面的一部分进行自动截图。
以这样的方式，排除了非视频播放区域的干扰，可以使用户后续可以更加纯净地享受仅录制视频播放区域的视频和/或截图，提升了用户的观看体验。
在播放的视频是电影的情况下，还可以进一步缩小上述视频播放区域，以确定电影播放区域。例如，长方形的视频播放区域的宽高比通常为1.85:1，而电影画面的宽高比通常为2.35:1。因此，可以进一步将电影播放区域确定为例如{c≤x≤d，且a+(b-a)/9.4≤y≤b-(b-a)/9.4}。
根据一些实施例，确定所述视频播放区域在所述电子设备的用户界面上的位置包括以下三种方法。
在一些情况下，在视频播放应用程序窗口中，由于视频播放区域与其周围的区域的交界处在灰度上存在显著变化，因此可以使用边缘检测的方法来确定视频播放区域。
根据一些实施例，所述确定所述视频播放区域在所述电子设备的用户界面上的位置可以包括：检测所述视频播放区域的边框；以及基于所述视频播放区域的边框，将所述边框内部的区域确定为所述视频播放区域。
根据一些实施例，检测所述视频播放区域的边框的方法可以包括：获取电子设备的当前用户界面的图像；对获取的图像进行高斯平滑去噪；利用算子(例如，canny算子，lapacian算子等)对去噪的图像进行卷积运算以得到所获取的图像每个像素的梯度；确定梯度大于梯度阈值(例如，梯度的极大值)的像素；连接这些像素以获得视频播放区域的边框。
在一些情况下，视频播放应用程序的开发人员通常开发多个版本的视频播放应用程序窗口以适配不同型号的电子设备。
根据一些实施例，所述确定所述视频播放区域在所述电子设备的用户界面上的位置可以包括：获取所述电子设备的分辨率；确定与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序；以及基于所获取的所述电子设备的分辨率和所确定的与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序，确定所述视频播放区域在所述电子设备的用户界面上的位置。
根据一些实施例，所述电子设备的分辨率可以包括所述电子设备的用户界面的分辨率和所述电子设备的显示屏幕的分辨率等。根据一些实施例，在播放视频时，视频播放区域可以取决于用户界面和/或显示屏幕的分辨率。因此，通过确定用户界面和/或显示屏幕的分辨率，可以精确地获取视频播放区域。
根据一些实施例，所述确定所述视频播放区域在所述电子设备的用户界面上的位置可以包括：获取所述电子设备的型号；确定与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序；以及基于所获取的所述电子设备的型号和所确定的与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序，确定所述视频播放区域在所述电子设备的用户界面上的位置。
根据一些实施例，电子设备的型号包括电子设备的制造商以及该电子设备的机型。例如，获取到的电子设备(手机)的制造商为锤子，机型是M1，当前正在显示的视频播放应用程序窗口对应的视频播放应用程序为抖音。根据以上信息，可以精准地获取抖音在锤子M1手机上的视频播放区域。
在一些情况下，可以通过从电子设备的系统直接提取视频流来获取所述视频播放区域。
根据一些实施例，所述方法还可以包括：实时获取录制所述电子设备的用户界面的已经过时间；以及当实时获取的已经过时间等于停止阈值时间时，确定满足步骤S103中所述的截图停止条件。根据一些实施例，所述停止阈值时间可以由用户预先设置或者由所述电子设备的系统默认设置。根据一些示例，所述停止阈值时间可以为20秒、30秒、1分钟、2分钟等。
根据一些实施例，可以将停止阈值时间设为无穷大。
根据一些实施例，可以将所述停止阈值时间设置为一个足够大的值。换言之，将停止阈值时间设置为在正常使用录屏截图功能时几乎不可能达到的值。根据一些示例，例 如可以将所述停止阈值时间的值设置为0x7fffffff。值0x7fffffff实际上是32-bit int下的最大值。如果以秒为单位，则值0x7fffffff约为68年多，可以近似认为是将所述停止阈值时间设置为无穷大。
根据一些实施例，当将所述多个截图存储在内存中时，可以实时确定电子设备的可用内存。根据一些实施例，可以为电子设备分配预留内存。所述预留内存可是为了确保电子设备的系统能够正常运行所需的内存。根据一些示例，如果实时确定的可用内存为预留内存，则将已经过时间确定为停止阈值时间。
根据另一些实施例，当将所述多个截图存储在缓存的存储区中时，也可以实时确定所述缓存的剩余空间。根据一些实施例，可以为电子设备的所述缓存分配预留空间。根据一些示例，如果实时确定的可用剩余空间为预留空间，则将已经过时间确定为停止阈值时间。
根据一些实施例，预留内存和/或预留空间可以根据电子设备的型号不同而不同。根据一些实施例，预留内存和/或预留空间还可以根据电子设备正在运行的应用程序相关联。然而，本领域技术人员应当理解，本公开不限于此，可以以任何方式确定预留内存和/或预留空间。通常情况下，预留内存和/或预留空间不为零。但在一些情况下，预留内存和/或预留空间也可以为零。
在一些情况下，用户希望自主确定自动截图停止的时间。
根据一些实施例，所述方法还可以包括：接收针对所述电子设备的用户界面的截图停止输入；以及响应于所述截图停止输入，确定满足所述截图停止条件。
以这样的方式，用户可以通过截图停止输入(例如，针对录屏停止按钮的点击输入、针对录屏窗口的点击输入、针对用户界面(例如，用户界面300)的按压输入等)停止对电子设备的用户界面进行自动截图，进一步提高了用户操作的自由度，提升了用户体验。
根据一些实施例，所述方法还可以包括：在停止对所述电子设备的用户界面进行截图并且停止录制所述电子设备的用户界面之后，在所述电子设备的用户界面上显示所述多个截图的缩略图和所述视频的缩略图。
以下将结合图4A和图4B详细描述如何显示录制的与电子设备的用户界面相关联的视频以及自动截图的与电子设备的用户界面相关联的多个截图。图4A是示出根据本公开的示例性实施例的在电子设备为竖屏状态下所显示的视频和多个截图的用户界面400A的示意图。图4B是示出根据本公开的示例性实施例的在电子设备为横屏状态下所显示的视频和多个截图的用户界面400B的示意图。
根据一些实施例，在所述停止录制所述电子设备的用户界面并且停止对所述电子设备的用户界面进行截图之后，可以直接在电子设备的用户界面上显示所述视频的缩略图和所述多个截图的缩略图。
根据另一些实施例，如图4A和图4B所示，在所述停止录制所述电子设备的用户界面并且停止对所述电子设备的用户界面进行截图之后，可以在电子设备的用户界面400A、400B上显示视频截图卡片410A、410B，并且在所述视频截图卡片410A、410B上显示所述视频的缩略图420A、420B和所述多个截图的缩略图430A、430B。
在本公开中，以宽高比与1的比较结果来限定用户界面以及所述视频的缩略图和所述多个截图的缩略图的显示方向是竖屏方向还是横屏方向。
特别地，在本公开中，如果用户界面的宽高比小于1，则用户界面的显示方向为竖屏方向。如果用户界面的宽高比大于1，则用户界面的显示方向为横屏方向。
特别地，在本公开中，如果所述视频的缩略图和所述多个截图的缩略图的宽高比小于1，则所述视频的缩略图和所述多个截图的缩略图的显示方向为竖屏方向。如果所述视频的缩略图和所述多个截图的缩略图的宽高比大于1，则所述视频的缩略图和所述多个截图的缩略图的显示方向为横屏方向。
在一些情况下，在录制电子设备的用户界面以及对电子设备的用户界面进行自动截图的过程中，用户可能会旋转电子设备(例如，将电子设备从竖屏方向旋转到横屏方向，或将电子设备从横屏方向旋转到竖屏方向)。在这些情况下，所述视频的缩略图和所述多个截图的缩略图的显示方向可能既不是竖屏方向也不是横屏方向，而是呈具有某一角度的倾斜方向。
根据一些实施例，响应于所述截图停止条件，可以保留并显示所述多个截图中显示方向为竖屏方向或横屏方向的截图的缩略图，并且删除所述多个截图中显示方向既不是竖屏方向也不是横屏方向的截图的缩略图。
以这样的方式，可以保证保留并显示的截图的整齐性，视觉体验好。
此外，在上述一些情况中，由于在录制电子设备的用户界面以及对电子设备的用户界面进行自动截图的过程中，电子设备的朝向发生变化，因此多个截图的方向也可能不一致。
根据一些实施例，可以基于在停止录屏时刻所述电子设备的朝向确定所述视频的缩略图和所述多个截图的缩略图的显示方向。
根据一些实施例，所述方法还可以包括：确定截图停止方向，所述截图停止方向是在停止对所述电子设备的用户界面进行截图并且停止录制所述电子设备的用户界面的时刻的所述电子设备的朝向；以及基于所述截图停止方向，在所述电子设备的用户界面上显示所述多个截图的缩略图和所述视频的缩略图。
根据一些实施例，截图停止方向包括如上文定义的竖屏方向和横屏方向。
根据一些实施例，所述视频的缩略图和所述多个截图的缩略图的显示方向与截图停止方向相同。根据一些示例，在截图停止方向确定为竖屏方向的情况下，所述视频的缩略图和所述多个截图的缩略图的显示方向也为竖屏方向。根据另一些示例，在截图停止方向确定为横屏方向的情况下，所述视频的缩略图和所述多个截图的缩略图的显示方向也为横屏方向。
例如，截图停止方向为横屏方向。如图4A所示，虽然此时电子设备的朝向为竖屏方向，用户界面400A的显示方向也为竖屏方向，但是由于截图停止方向为横屏方向，因此所述视频的缩略图420A和所述多个截图的缩略图430A的显示方向为横屏方向。继续参照图4A，由于所述视频的缩略图420A和所述多个截图的缩略图430A的显示方向(横屏方向)与用户界面400A的显示方向(竖屏方向)不一致，因此在这些缩略图的上方和下方各显示有一条黑边区域。如图4B所示，电子设备的实时朝向为横屏方向，用户界面400A的显示方向为横屏方向，并且由于截图停止方向为横屏方向，因此所述视频的缩略图420A和所述多个截图的缩略图430A的显示方向为横屏方向。继续参照图4B，由于所述视频的缩略图420B和所述多个截图的缩略图430B的显示方向(横屏方向)与用户界面400B的显示方向(竖屏方向)一致，因此在这些缩略图的上方和下方不显示有黑边区域。
以这样的方式，尽管在录制电子设备的用户界面以及对电子设备的用户界面进行自动截图的过程中，电子设备发生旋转(例如，电子设备从竖屏方向旋转到横屏方向，或电子设备从横屏方向旋转到竖屏方向)，仍能够保证所述视频的缩略图和所述多个截图的缩略图的显示方向一致，使得用户在观看时视觉感官保持一致，且十分整齐。
根据一些实施例，所述方法还可以包括：接收针对所述多个截图中的第一截图的缩略图的显示输入；以及响应于所述显示输入，在所述电子设备的用户界面上全屏显示所述第一截图；接收针对所述视频的缩略图的播放输入；以及响应于所述播放输入，在所述电子设备的用户界面上全屏播放所述视频。
根据一些实施例，针对所述视频的缩略图的播放输入可以包括：针对所述视频的缩略图上的播放按钮422A、422B(参照图4A和图4B)的点击输入、针对所述视频的缩略图的按压输入等。根据一些实施例，针对所述多个截图中的第一截图的缩略图的显示输入可以包括：针对所述第一截图的缩略图上的放大按钮的点击输入、针对所述第一截图的缩略图的按压输入等。
根据一些实施例，全屏播放的视频是录制获得的原始视频，其分辨率高于所述视频的缩略图。全屏显示的第一截图是自动截图获得的原始图片，其分辨率高于所述第一截图的缩略图。
根据一些实施例，可以在显示与电子设备的用户界面相关联的多个截图相关联的多个缩略图之前，去除所述多个截图中存在的黑边区域。这样，在下文描述的保存和分享等操作中，可以保存和分享去除黑边区域之后的图片。
根据一些实施例，由于截图中的黑边区域与除黑边区域以外的其他区域的交界处在灰度上存在显著变化，因此也可以使用边缘检测的方法来确定黑边区域，并且删除截图中检测到的黑边区域。
根据一些示例，可以对所述多个截图中的每个截图进行高斯平滑去噪；利用算子(例如，canny算子，lapacian算子等)对去噪的图像进行卷积运算以得到每个截图中每个像素的梯度；确定梯度大于梯度阈值(例如，梯度的极大值)的像素；连接这些像素以确定每个截图中的黑边区域(如果存在黑边区域的话)；删除存在黑边区域的截图中的黑边区域。
以这样的方式，如果在对电子设备的用户界面进行自动截图期间没有去除黑边区域，仍然可以在得到与电子设备的用户界面相关联的多个截图中去除黑边区域，这样可以减少电子设备在自动截图期间的内存占用。
根据另一些实施例，当然也可以既在对电子设备的用户界面进行自动截图期间去除黑边区域，又在得到与电子设备的用户界面相关联的多个截图中去除黑边区域。
根据一些实施例，所述方法还可以包括：接收针对在所述电子设备的用户界面显示的第一保存按钮411A、411B的第一保存输入；以及响应于所述第一保存输入，将所述多个截图存储至截图文件夹，并且将所述视频存储至视频文件夹。
根据一些实施例，所述第一保存输入可以是针对在所述电子设备的用户界面显示的第一保存按钮的点击输入、按压输入等。
以这样的方式，通过第一保存输入，可以同时保存所述视频和所述多个截图。与相关技术相比，用户无需分两次分别存储视频和多个截图，简化了用户的操作。
根据一些实施例，所述方法还可以包括：接收针对在所述电子设备的用户界面上显示的第一分享按钮和第一应用程序选项的第一分享输入，其中所述第一应用程序选项对应于第一应用程序；以及响应于所述第一分享输入，将所述多个截图和所述视频分享至所述第一应用程序。
根据一些实施例，第一应用程序选项可以直接显示在电子设备的用户界面上。第一分享输入可以是针对第一分享按钮的点击输入以及针对第一应用程序选项的点击输入。
根据另一些实施例，第一应用程序选项可以不直接显示在电子设备的用户界面上，并且第一分享输入包括第一输入和第二输入。第一分享输入的第一输入包括针对第一分享按钮的点击输入、按压输入、滑动输入等。响应于所述第一分享输入的第一输入，在用户界面上显示分享目标应用程序列表，所述分享目标应用程序列表包括第一应用程序选项。第一分享输入的第二输入包括针对所述第一应用程序选项的点击输入、按压输入、滑动输入等。响应于所述第一分享输入的第二输入，将所述视频和所述至少一个截图分享至于所述第一应用程序选项对应的第一应用程序中。
以这样的方式，在接收到第一分享输入的第一输入之前，无需在电子设备的用户界面上显示第一应用程序选项，特别是在具有大量应用程序选项的情况下，这使得用户界面更加简洁。此外，将第一分享输入分为第一输入和第二输入，可以为用户在决策将视频和多个截图分享到哪个应用程序时提供更多的考虑机会。
以下将结合图5描述对视频和多个截图的编辑操作。图5是示出根据本公开的示例性实施例的对所显示的视频和多个截图进行编辑操作的用户界面500的示意图。
根据一些实施例，所述方法还可以包括：接收针对所述视频的缩略图和所述多个截图的缩略图中的一个或多个缩略图的选中输入；响应于所述选中输入，选中所述一个或多个缩略图；以及再次响应于所述选中输入，不再选中所述一个或多个缩略图。
根据一些实施例，针对所述视频的缩略图的选中输入可以包括针对所述视频的缩略图的点击输入、按压输入等。根据一些实施例，针对所述多个截图的缩略图中的一个或多个缩略图的选中输入可以包括针对所述一个或多个缩略图的点击输入、按压输入、滑动输入等。例如，在选中输入是滑动输入的情况下，所述响应于所述选中输入选中所述一个或多个缩略图可以包括确定所述滑动输入在所述用户界面上的滑动路径，确定所述 滑动路径经过的缩略图，以及将被所述滑动路径经过的缩略图作为被选中的一个或多个缩略图。
这样，用户可以根据自己的喜好和希望选择的截图的数量，以各种方式选择与截图对应的缩略图，为用户提供更大的自由度，提升用户体验。
根据一些实施例，响应于所述选中输入，可以突出显示被选中的一个或多个缩略图。根据一些示例，可以在被选中的一个或多个缩略图上显示选中标记。例如，如图5所示，截图5的缩略图和截图7的缩略图被选中，则在所述截图5的缩略图和截图7的缩略图上显示对勾符号以作为选中标记532。根据一些示例，可以在被选中的一个或多个缩略图周围显示加粗边框。根据一些示例，可以略微放大显示被选中的一个或多个缩略图。根据一些示例，可以提高被选中的一个或多个缩略图的亮度。
根据一些实施例，再次响应于所述选中输入，可以不再突出显示被选中的一个或多个缩略图。根据一些示例，可以不再显示选中标记。例如，不再显示作为选中标记532的对勾符号。根据一些示例，可以不再显示位于被选中的一个或多个缩略图周围的加粗边框。根据一些示例，可以将略微放大显示的一个或多个缩略图缩小到放大之前的大小。根据一些示例，可以将亮度提高的一个或多个缩略图的亮度降低到提高亮度之前的亮度。
以这样的方式，可以更清楚地向用户反馈哪些截图已经被选中以及哪些截图被用户放弃选中。
根据一些实施例，所述方法还可以包括：在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的第二保存按钮的第二保存输入；以及响应于所述第二保存输入，将所述多个截图和/或所述视频中与被选中的所述一个或多个缩略图对应的截图和/或视频存储至截图文件夹和/或视频文件夹。
根据一些实施例，可以在显示所述视频的缩略图和所述多个截图的缩略图时，显示第二保存按钮。根据一些示例，在显示所述视频的缩略图和所述多个截图的缩略图时，所述第二保存按钮不可接收第二保存输入。根据另一些示例，在显示所述视频的缩略图和所述多个截图的缩略图时，所述第二保存按钮不可接收第二保存输入，并且在选中一个或多个缩略图时，将所述第二保存按钮配置为可接收第二保存输入。例如，在第二保存按钮处于可接收第二保存输入的状态下，其可以正常显示；而在第二保存按钮处于不可接收第二保存输入的状态下，其可以变灰显示。
根据一些实施例并参照图5，可以在选中所述一个或多个缩略图时，显示第二保存按钮548。根据如图5所示的一些示例，在选中所述一个或多个缩略图时，在所述视频截图 卡片510上显示编辑边框540。所述编辑边框540的上边缘可以位于被选中的一个或多个缩略图中最上一行的缩略图上方，所述编辑边框540的下边缘可以位于被选中的一个或多个缩略图中最下一行的缩略图下方。这样，可以更好地展示被选中的一个或多个缩略图在空间上的范围。根据一些示例，所述第二保存按钮548显示在所述编辑边框540的上边缘上，当然本公开不限于此。
根据一些实施例，针对在所述电子设备的用户界面上显示的第二保存按钮的第二保存输入可以包括针对第二保存按钮的点击输入、按压输入等。
以这样的方式，通过第二保存输入，用户可以从所述视频的缩略图和所述多个截图的缩略图中挑选自己喜爱的视频和/或截图，并将这些视频和/或截图分别保存到视频文件夹和/或截图文件夹中。
根据一些实施例，所述方法还可以包括：在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的第二分享按钮546和第二应用程序选项的第二分享输入，其中所述第二应用程序选项对应于第二应用程序；响应于所述第二分享输入，将所述多个截图和/或所述视频中与被选中的所述一个或多个缩略图对应的截图和/或视频分享至所述第二应用程序。
根据一些实施例，第二分享按钮的各种显示时机(例如，在显示所述视频的缩略图和所述多个截图的缩略图时，在选中一个或多个缩略图时等)、显示位置(例如，在用户界面上显示，在视频截图卡片上显示，在编辑边框上显示等)和显示方式(例如，可接收第二分享输入(正常显示)，不可接收第二分享输入(变灰)等)与上文已经详细描述过的第二保存按钮可以相同或类似，在此不再赘述。
根据一些实施例，针对在所述电子设备的用户界面上显示的第二分享按钮和第二应用程序选项的第二分享输入可以包括针对第二分享按钮的点击输入、按压输入等。
根据一些实施例，第二分享输入的各种输入方式(例如，直接显示第二应用程序选项，或者响应于第二分享输入的第一输入显示包括第二应用程序选项的分享目标应用程序列表并且响应于第二分享输入的第二输入将与选中的一个或多个缩略图对应的截图分享到与第二应用程序选项对应的第二应用程序中)与上文已经详细描述过的第一分享输入可以相同或类似，在此不再赘述。
以这样的方式，通过第二分享输入，用户可以从所述视频的缩略图和所述多个截图的缩略图中挑选自己喜爱的视频和/或截图，并将这些视频和/或截图一同分享到第二应用程序中。
根据一些实施例，所述方法还可以包括：在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的拼图按钮的拼图输入542；以及响应于所述拼图输入，生成所述多个截图中与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图，其中，所述拼接图在空间上包括与被选中的所述一个或多个缩略图对应的一个或多个截图。
根据一些实施例，拼图按钮的各种显示时机(例如，在显示所述视频的缩略图和所述多个截图的缩略图时，在选中一个或多个缩略图时等)、显示位置(例如，在用户界面上显示，在视频截图卡片上显示，在编辑边框上显示等)和显示方式(例如，可接收拼图输入(正常显示)，不可接收拼图输入(变灰)等)与上文已经详细描述过的第二保存按钮类似，在此不再赘述。
根据一些实施例，在选中一个或多个缩略图时，判断被选中的一个或多个缩略图中是否包括视频的缩略图。根据一些示例，如果被选中的一个或多个缩略图中包括视频的缩略图，则所述拼图按钮不可接收拼图输入。根据另一些示例，无论被选中的一个或多个缩略图中是否包括视频的缩略图，所述拼图按钮都可接收拼图输入，并且，响应于所述拼图输入，忽略被选中的视频的缩略图，而仅生成与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图。
根据一些实施例，针对在所述电子设备的用户界面上显示的拼图按钮的拼图输入可以包括针对拼图按钮的点击输入、按压输入等。
根据一些实施例，拼接图是一张图片，其在空间上包括与所有被选中的所述一个或多个缩略图对应的一个或多个截图。可以以任何方式将一个或多个截图布置在所述拼接图中。
根据一些实施例，所述生成所述多个截图中与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图可以包括：确定被选中的缩略图的数量；以及如果所述数量等于一，则将与被选中的一个缩略图对应的一个截图作为所述拼接图；如果所述数量为大于一的奇数，则按照任一行布置与被选中的多个缩略图对应的多个截图中的一个截图且其余行每行布置与被选中的多个缩略图对应的多个截图中的两个截图的方式生成所述拼接图；如果所述数量为偶数，则按照每行布置与被选中的多个缩略图对应的多个截图中的两个截图的方式生成所述拼接图。根据一些示例，如果被选中的缩略图的数量为大于1的奇数，则可以在第一行布置一个截图，并且在其余行中每行布置两个截图。例如，当果被选中的缩略图的数量为三时，可以呈“品”字型排列三个截图。当然，本公开不限 于此，根据另一些示例，也可以将与被选中的多个缩略图对应的截图布置成圆形、心形等各种形状。
例如，在用户录制应用软件的教学演示操作的情况下，可以选择表示教学演示操作中的几个关键步骤的截图，并将这些截图拼接为拼接图。通过这张拼接图，用户就可以展现其教学演示操作中的精华，而无需完整观看录制的整个视频。
根据一些实施例，所述方法还可以包括：在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的动图按钮544的动图输入；以及响应于所述动图输入，生成以一定频率显示与被选中的所述一个或多个缩略图对应的一个或多个截图的动图，其中，所述动图在时间上包括与被选中的所述一个或多个缩略图对应的一个或多个截图。
根据一些实施例，动图按钮的各种显示时机(例如，在显示所述视频的缩略图和所述多个截图的缩略图时，在选中一个或多个缩略图时等)、显示位置(例如，在用户界面上显示，在视频截图卡片上显示，在编辑边框上显示等)和显示方式(例如，可接收动图输入(正常显示)，不可接收动图输入(变灰)等)与上文已经详细描述过的第二保存按钮类似，在此不再赘述。
根据一些实施例，在选中一个或多个缩略图时，判断被选中的一个或多个缩略图中是否包括视频的缩略图。根据一些示例，如果被选中的一个或多个缩略图中包括视频的缩略图，则所述动图按钮不可接收动图输入。根据另一些示例，无论被选中的一个或多个缩略图中是否包括视频的缩略图，所述动图按钮都可接收动图输入，并且，响应于所述动图输入，忽略被选中的视频的缩略图，而仅生成与被选中的所述一个或多个缩略图对应的一个或多个截图的动图。
根据一些实施例，针对在所述电子设备的用户界面上显示的动图按钮的动图输入可以包括针对动图按钮的点击输入、按压输入等。
根据一些实施例，以一定帧率连续播放与所有被选中的一个或多个缩略图对应的一个或多个截图来生成动图。动图是一张图，其可以是gif格式的动图，其在时间上包括所有被选中的一个或多个缩略图对应的一个或多个截图。
例如，在用户在录制电影的情况下，可以选择电影中表示关键场景和关键情节的多个截图，并利用这些截图生成动图。通过这张播放时间远短于电影时间的动图，用户就可以展现该电影中的关键场景和关键情节，而无需完整观看录制的整个电影。
在一些情况下，录制时间可能相对较长，获得的截图的数量也相对较多。这时，可以基于一定标准，自动为用户推荐一个或多个截图。
根据一些实施例，所述方法还可以包括：基于预设规则，对所述多个截图进行评价，以获得与所述多个截图中的每个截图相关联的得分；分别将与每个截图相关联的得分与得分阈值进行比较；以及在所述电子设备的用户界面上突出显示所述多个截图中得分大于或等于所述得分阈值的一个或多个截图。
根据一些实施例，得分阈值可以是固定的。例如，得分阈值可以由用户提前设定或者由系统默认设定。
根据另一些实施例，得分阈值可以是变化的。根据一些示例，取与每个截图相关联的得分中的最大值，并以最大值的一定比例(小于1)为得分阈值，所述一定比例例如为90％、95％、97％等。又例如，对与每个截图相关联的得分进行排序，以得分第N高的得分为得分阈值，N例如为1、2、3、5等。
根据一些实施例，可以以各种方式突出显示得分大于或等于所述得分阈值的一个或多个截图。例如，可以在与得分大于或等于所述得分阈值的一个或多个截图的一个或多个缩略图上显示星标标识。又例如，可以闪烁显示与得分大于或等于所述得分阈值的一个或多个截图的一个或多个缩略图。
根据一些实施例，所述预设规则可以包括以下各项中的至少一个：截图中是否存在人脸、截图中存在的人脸的完整度、截图的分辨率以及截图的锐度。
根据一些实施例，截图中存在人脸的截图的得分高于截图中不存在人脸的截图的得分。截图中存在的人脸的完整度高的截图的得分高于截图中存在的人脸的完整度低的截图的得分。截图的分辨率高的得分高于截图的分辨率低的得分。截图的锐度高的得分高于截图的锐度低的得分。
根据一些实施例，可以为预设规则中的每一项赋予相关联的特定权重，并且将每一项的项得分乘以相关联的特定权重并求和，以得到截图的得分。
以下将结合图4A、图4B和图5描述用户界面400A、400B、500上的其他按钮及其对应的功能。根据一些实施例，响应于针对全选按钮412A、412B、512的输入(例如，点击输入、按压输入等)，可以选中所述多个截图的缩略图。并且，响应于再次针对全选按钮412A、412B、512的输入(例如，点击输入、按压输入等)，可以不再选中所述视频的缩略图和所述多个截图的缩略图。根据一些实施例，响应于针对图5中所示的退出选中按钮550的输入(例如，点击输入、按压输入等)，可以不再选中一个或多个缩略 图。根据一些实施例，响应于针对图4A、图4B和图5中所示的关闭按钮413A、413B、513的输入(例如，点击输入、按压输入等)，可以关闭退出录屏截图功能。
根据一些实施例，在录制电子设备的用户界面期间，可以同步录制与电子设备的用户界面相关联的音频信息。
根据一些实施例，所述方法还可以包括：响应于满足录音开始条件，在录制所述电子设备的用户界面期间，采集与所述电子设备相关联的音频信息，其中，所述音频信息在时间轴上与所述视频对应。
根据一些实施例，与所述电子设备相关联的音频信息可以包括通过所述电子设备的音频输出设备外放的音频信息。根据一些实施例，与所述电子设备相关联的音频信息可以包括通过音频输入设备(例如，麦克风)获取的音频信息。根据一些实施例，与所述电子设备相关联的音频信息还可以包括直接从电子设备的底层硬件获取的音频信息。根据一些实施例，与所述电子设备相关联的音频信息还可以包括上述各种与电子设备相关联的音频信息中的两种或两种以上的组合。
根据一些实施例，可以在停止录制电子设备的用户界面之后，从获得的与电子设备的用户界面相关联的视频中提取音频信息。
根据一些实施例，所述方法还可以包括：实时识别并得到与所述音频信息在时间轴上对应的文字信息；以及按照时间轴将所述文字信息增加到所述视频和/或所述多个截图中，使得所述文字信息能够与所述视频和/或所述多个截图同时显示。
根据一些实施例，基于时间轴的方式可以使得音频信息和视频可以在相同的时间上一一对应。例如，如果当前用户界面正在显示的是电影，并且在录屏的时候可以同时获取音频信息。这样，在播放时，可以按照时间轴将视频和音频信息结合，这样用户既可以观看到用户界面上显示的电影的画面，同时也能收听到与显示的电影对应的声音。
根据一些实施例，可以实时识别出与视频和音频信息在时间轴上对应的文字信息。例如，如果当前用户界面正在显示的是电影，并且在录屏的时候同时获取音频信息且进行实时识别并得到文字信息。这样，在播放时，可以按照时间轴将视频和文字信息结合，这样在不方便发出声音的情况下，或者在用户是听障人士的情况下，可以既观看到用户界面上显示的电影的画面，又能显示与电影对应的实时字幕。
根据一些实施例，基于时间轴的方式可以使得音频信息、文字信息和视频可以在相同的时间上一一对应。例如，如果当前用户界面正在显示的是电影，并且在录屏的时候同时获取音频信息且进行实时识别并得到文字信息。这样，在播放时，可以按照时间轴 将视频、音频信息和文字信息结合，这样用户可以同时观看到电影的画面、与画面对应的声音以及与声音对应的实时字幕。
应当注意，虽然上文仅以电影为例进行了说明，但是本公开不限于，录屏任何画面的过程中均可以同时获取音频信息并且实时识别与所述音频信息对应的文字信息。
根据一些实施例，可以在如上文所述的视频截图卡片中显示与所述音频信息对应的音频信息的缩略图。根据一些实施例，响应于针对所述音频信息的缩略图的播放输入(例如，针对在所述音频信息的缩略图上显示的播放按钮的点击输入、针对所述音频信息的缩略图的按压输入等)，可以播放所述音频信息。根据一些实施例，响应于上文所述的第一保存输入，除了将所述视频保存到视频文件夹并且将所述多个截图保存到截图文件夹之外，还可以将所述音频信息保存到音频文件夹。根据一些实施例，响应于上文所述的第一分享输入，除了将所述视频和所述多个截图分享到第一应用程序之外，还可以将所述音频信息分享到所述第一应用程序。
以上已经结合附图描述了根据本公开的用于操作电子设备的示例性方法。下面将结合附图对本公开的用于操作电子设备的示例性装置、以及电子设备的示例性实施例进行进一步描述。
本公开的第二方面可以包括一种用于操作电子设备的装置。图6是示出根据本公开的示例性实施例的用于操作电子设备的装置的结构框图。如图6所示，所述用于操作电子设备的装置600可以包括：确定单元601，被配置为确定是否满足截图开始条件；截图单元602，被配置为对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图；以及停止单元603，被配置为响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行截图。
根据一些实施例，所述用于操作电子设备的装置600还可以包括被配置为执行前述任何方法的其它步骤的单元。
以上，对本公开的用于操作电子设备的示例性装置进行了简要说明。需要注意的是，本公开的示例性用于操作电子设备的装置的各单元或各特征的具体实施方式可参见本公开前述示例性用于操作电子设备的方法中的相应特征的具体实施方式，因而不再赘述。另外，描述本公开的示例性用于操作电子设备的装置所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定。
另外，本公开的示例性用于操作电子设备的装置的各单元的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
本公开的第三方面可以包括一种电子设备，该电子设备可以包括处理器；以及存储程序的存储器，所述程序包括指令，所述指令在由所述处理器执行时使所述处理器执行前述任何方法。
本公开的第四方面可以包括一种存储程序的存储介质，所述程序包括指令，所述指令在由电子设备的处理器执行时，致使所述电子设备执行前述任何方法。
本公开的第五方面可以包括一种包括程序的计算机程序产品，所述程序包括代码，所述代码在由电子设备的处理器执行时，致使所述电子设备执行前述任何方法。
下面参考图7，其示出了适于用来实现本公开实施例的电子设备700(例如本公开中的电子设备)的结构示意图。图7示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图7所示，电子设备700可以包括处理装置(例如中央处理器、图形处理器等)701，其可以根据存储在只读存储器(ROM)702中的程序或者从存储装置706加载到随机访问存储器(RAM)703中的程序而执行各种适当的动作和处理。在RAM 703中，还存储有电子设备700操作所需的各种程序和数据。处理装置701、ROM 702以及RAM703通过总线704彼此相连。输入/输出(I/O)接口705也连接至总线704。
通常，以下装置可以连接至I/O接口705：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置706；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置707；包括例如磁带、硬盘等的存储装置706；以及通信装置709。通信装置709可以允许电子设备700与其他设备进行无线或有线通信以交换数据。虽然图7示出了具有各种装置的电子设备700，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置709从网络上被下载和安装，或者 从存储装置706被安装，或者从ROM 702被安装。在该计算机程序被处理装置701执行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的存储介质可以是计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，通信网络的示例包括局域网(“LAN”)，广域网(“WAN”)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备：确定是否满足截图开始条件；响应于确定满足所述截图开始条件，录制所述电子设备的用户界面，以获得与所述电子设备的用户界面相关联的视频；在录制所述电子设备的用户界面期间，对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图；以及响应于确定满足截图停止条件，停止录制所述电子设备的用户界面，并且停止对所述电子设备的用户界面进行截图。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、 C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利 的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (47)

  1. 一种用于操作电子设备的方法，包括：
    确定是否满足截图开始条件；
    响应于确定满足所述截图开始条件，对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图；以及
    响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行自动截图。
  2. 根据权利要求1所述的方法，其中，所述确定是否满足所述截图开始条件包括：响应于接收针对所述电子设备的用户界面的自动截图指示输入，确定满足所述截图开始条件。
  3. 根据权利要求1所述的方法，还包括：
    接收针对所述电子设备的用户界面的自动截图指示输入，
    其中，所述确定是否满足截图开始条件包括：
    确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是否为应用程序窗口；
    响应于确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是应用程序窗口，确定所述应用程序窗口是否允许被截图；以及
    响应于确定所述应用程序窗口允许被截图，确定满足所述截图开始条件。
  4. 根据权利要求3所述的方法，其中，所述确定是否满足截图开始条件还包括：
    响应于确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的不是应用程序窗口，确定满足所述截图开始条件。
  5. 根据权利要求2至4中任一项所述的方法，其中，所述接收针对所述电子设备的用户界面的自动截图指示输入包括：
    接收针对所述电子设备的用户界面的功能菜单呼出输入；
    响应于接收到所述功能菜单呼出输入，在所述电子设备的用户界面上显示功能选择菜单，其中，所述功能选择菜单包括录屏截图功能选项；以及
    接收针对所述录屏截图功能选项的选择。
  6. 根据权利要求1所述的方法，还包括：
    接收针对所述电子设备的用户界面的自动截图指示输入，
    其中，所述确定是否满足截图开始条件包括：
    获取所述自动截图指示输入在所述电子设备的用户界面上的位置；
    确定所述电子设备的用户界面在所述位置处是否属于文字可提取区域；以及
    响应于确定所述电子设备的用户界面在所述位置处不属于文字可提取区域，确定满足所述截图开始条件。
  7. 根据权利要求6所述的方法，其中，所述接收针对所述电子设备的用户界面的自动截图指示输入包括：
    接收针对所述电子设备的用户界面的功能菜单呼出输入；
    响应于接收到所述功能菜单呼出输入，在所述电子设备的用户界面上显示功能选择菜单，其中，所述功能选择菜单包括录屏截图功能选项；以及
    接收针对所述录屏截图功能选项的选择。
  8. 根据权利要求7所述的方法，其中，所述获取所述自动截图指示输入在所述电子设备的用户界面上的位置包括：
    获取所述功能菜单呼出输入在所述电子设备的用户界面上的位置。
  9. 根据权利要求6所述的方法，还包括：
    响应于确定所述电子设备的用户界面在所述位置处属于文字可提取区域，在所述电子设备的用户界面上显示功能选择菜单，其中，所述功能选择菜单包括录屏截图功能选项；
    接收针对所述录屏截图功能选项的选择；以及
    响应于接收到针对所述录屏截图功能选项的选择，确定满足所述截图开始条件。
  10. 根据权利要求1所述的方法，其中，所述对所述电子设备的用户界面进行自动截图包括：
    以预设时间间隔对所述电子设备的用户界面进行自动截图。
  11. 根据权利要求1所述的方法，其中，所述对所述电子设备的用户界面进行自动截图包括：
    实时获取对所述电子设备的用户界面进行自动截图的已经过时间；以及
    基于实时获取的已经过时间，动态地调整对所述电子设备的用户界面进行自动截图的时间间隔。
  12. 根据权利要求11所述的方法，其中，所述基于实时获取的已经过时间，动态地调整对所述电子设备的用户界面进行自动截图的时间间隔包括：
    当实时获取的已经过时间处于第一范围中时，以第一时间间隔对所述电子设备的用户界面进行自动截图；以及
    当实时获取的已经过时间处于第二范围中时，以第二时间间隔对所述电子设备的用户界面进行自动截图，其中，所述第一范围中的值均小于所述第二范围中的值，所述第一时间间隔小于所述第二时间间隔。
  13. 根据权利要求12所述的方法，其中，所述第二时间间隔是所述第一时间间隔的N倍，N是大于1的正整数，并且所述方法还包括：
    当实时获取的已经过时间处于第二范围中时，在已经过时间曾处于第一范围的状态下已获得的与电子设备的用户界面相关联的每N个截图中保留一个截图而删除其他截图。
  14. 根据权利要求1所述的方法，还包括：
    响应于确定满足所述截图开始条件，录制所述电子设备的用户界面，以获得与所述电子设备的用户界面相关联的视频；以及
    响应于确定满足所述截图停止条件，停止录制所述电子设备的用户界面。
  15. 根据权利要求14所述的方法，还包括：
    响应于确定所述自动截图指示输入满足所述截图开始条件，在所述电子设备的用户界面上显示录屏窗口，
    其中，所述录屏窗口指示所述电子设备的用户界面正在被录屏。
  16. 根据权利要求14所述的方法，其中，所述对所述电子设备的用户界面进行自动截图包括：
    在对所述电子设备的用户界面进行自动截图期间，不对所述录屏窗口进行自动截图，并且
    所述录制所述电子设备的用户界面包括：
    在录制所述电子设备的用户界面期间，不录制所述录屏窗口。
  17. 根据权利要求16所述的方法，其中，所述不对所述录屏窗口进行自动截图和/或所述不录制所述录屏窗口包括：
    将所述录屏窗口的截取属性调整为不可截取；
    在开始对所述电子设备的用户界面进行自动截图和/或开始录制电子设备的用户界面时，读取并接收所述录屏窗口的截取属性；以及
    响应于接收到所述录屏窗口的截取属性为不可截取，在对所述电子设备的用户界面进行自动截图期间不对所述录屏窗口进行自动截图和/或在录制所述电子设备的用户界面期间不录制所述录屏窗口。
  18. 根据权利要求17所述的方法，其中，在所述电子设备的用户界面上显示录屏窗口包括：
    将电子设备的用户界面实时渲染在用户界面视图控件上；以及
    将所述用户界面视图控件设置在所述录屏窗口中，以在所述录屏窗口中实时显示所述电子设备的用户界面的缩略图。
  19. 根据权利要求14所述的方法，还包括：
    在对所述电子设备的用户界面进行自动截图期间，确定所述电子设备的用户界面是否正在显示与视频播放应用程序对应的视频播放应用程序窗口，其中所述视频播放应用程序窗口包括视频播放区域，
    其中，所述对所述电子设备的用户界面进行自动截图包括：响应于确定所述电子设备的用户界面正在显示所述视频播放应用程序窗口，仅对所述视频播放区域进行截图，并且
    所述录制所述电子设备的用户界面包括：响应于确定所述电子设备的用户界面正在显示所述视频播放应用程序窗口，仅录制所述视频播放区域。
  20. 根据权利要求19所述的方法，其中，所述对所述电子设备的用户界面进行自动截图和/或所述仅录制所述视频播放区域包括：
    确定所述视频播放区域在所述电子设备的用户界面上的位置；以及
    基于所述视频播放区域在所述电子设备的用户界面上的位置，对所述视频播放区域进行截图和/或录制所述视频播放区域。
  21. 根据权利要求20所述的方法，其中，所述确定所述视频播放区域在所述电子设备的用户界面上的位置包括：
    检测所述视频播放区域的边框；以及
    基于所述视频播放区域的边框，将所述边框内部的区域确定为所述视频播放区域。
  22. 根据权利要求20所述的方法，其中，所述确定所述视频播放区域在所述电子设备的用户界面上的位置包括：
    获取所述电子设备的分辨率；
    确定与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序；以及
    基于所获取的所述电子设备的分辨率和所确定的与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序，确定所述视频播放区域在所述电子设备的用户界面上的位置。
  23. 根据权利要求1所述的方法，还包括：
    实时获取对所述电子设备的用户界面进行自动截图的已经过时间；以及
    当实时获取的已经过时间等于停止阈值时间时，确定满足所述截图停止条件。
  24. 根据权利要求23所述的方法，其中，所述停止阈值时间由用户预先设置或者由所述电子设备的系统默认设置。
  25. 根据权利要求1所述的方法，还包括：
    接收针对所述电子设备的用户界面的截图停止输入；以及
    响应于所述截图停止输入，确定满足所述截图停止条件。
  26. 根据权利要求14所述的方法，还包括：
    在停止对所述电子设备的用户界面进行截图并且停止录制所述电子设备的用户界面之后，在所述电子设备的用户界面上显示所述多个截图的缩略图和所述视频的缩略图。
  27. 根据权利要求26所述的方法，还包括：
    确定截图停止方向，所述截图停止方向是在停止对所述电子设备的用户界面进行截图并且停止录制所述电子设备的用户界面的时刻的所述电子设备的朝向；以及
    基于所述截图停止方向，在所述电子设备的用户界面上显示所述多个截图的缩略图和所述视频的缩略图。
  28. 根据权利要求26所述的方法，还包括：
    接收针对所述多个截图中的第一截图的缩略图的显示输入；以及
    响应于所述显示输入，在所述电子设备的用户界面上全屏显示所述第一截图；
    接收针对所述视频的缩略图的播放输入；以及
    响应于所述播放输入，在所述电子设备的用户界面上全屏播放所述视频。
  29. 根据权利要求26所述的方法，还包括：
    接收针对在所述电子设备的用户界面显示的第一保存按钮的第一保存输入；以及
    响应于所述第一保存输入，将所述多个截图存储至截图文件夹，并且将所述视频存储至视频文件夹。
  30. 根据权利要求26所述的方法，还包括：
    接收针对在所述电子设备的用户界面上显示的第一分享按钮和第一应用程序选项的第一分享输入，其中所述第一应用程序选项对应于第一应用程序；以及
    响应于所述第一分享输入，将所述多个截图和所述视频分享至所述第一应用程序。
  31. 根据权利要求26所述的方法，还包括：
    接收针对所述视频的缩略图和所述多个截图的缩略图中的一个或多个缩略图的选中输入；
    响应于所述选中输入，选中所述一个或多个缩略图；以及
    再次响应于所述选中输入，不再选中所述一个或多个缩略图。
  32. 根据权利要求31所述的方法，还包括：
    在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的第二保存按钮的第二保存输入；以及
    响应于所述第二保存输入，将所述多个截图和/或所述视频中与被选中的所述一个或多个缩略图对应的截图和/或视频存储至截图文件夹和/或视频文件夹。
  33. 根据权利要求31所述的方法，还包括：
    在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的第二分享按钮和第二应用程序选项的第二分享输入，其中所述第二应用程序选项对应于第二应用程序；以及
    响应于所述第二分享输入，将所述多个截图和/或所述视频中与被选中的所述一个或多个缩略图对应的截图和/或视频分享至所述第二应用程序。
  34. 根据权利要求31所述的方法，还包括：
    在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的拼图按钮的拼图输入；以及
    响应于所述拼图输入，生成所述多个截图中与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图，
    其中，所述拼接图在空间上包括与被选中的所述一个或多个缩略图对应的一个或多个截图。
  35. 根据权利要求34所述的方法，其中，所述生成所述多个截图中与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图包括：
    确定被选中的缩略图的数量；以及
    如果所述数量等于一，则将与被选中的一个缩略图对应的一个截图作为所述拼接图；
    如果所述数量为大于一的奇数，则按照任一行布置与被选中的多个缩略图对应的多个截图中的一个截图且其余行每行布置与被选中的多个缩略图对应的多个截图中的两个截图的方式生成所述拼接图；
    如果所述数量为偶数，则按照每行布置与被选中的多个缩略图对应的多个截图中的两个截图的方式生成所述拼接图。
  36. 根据权利要求31所述的方法，还包括：
    在选中所述一个或多个缩略图时，接收针对在所述电子设备的用户界面上显示的动图按钮的动图输入；以及
    响应于所述动图输入，生成以一定频率显示与被选中的所述一个或多个缩略图对应的一个或多个截图的动图，
    其中，所述动图在时间上包括与被选中的所述一个或多个缩略图对应的一个或多个截图。
  37. 根据权利要求26所述的方法，还包括：
    基于预设规则，对所述多个截图进行评价，以获得与所述多个截图中的每个截图相关联的得分；
    分别将与每个截图相关联的得分与得分阈值进行比较；以及
    在所述电子设备的用户界面上突出显示所述多个截图中得分大于或等于所述得分阈值的一个或多个截图。
  38. 根据权利要求37所述的方法，其中，所述预设规则包括以下各项中的至少一个：截图中是否存在人脸、截图中存在的人脸的完整度、截图的分辨率以及截图的锐度。
  39. 根据权利要求14所述的方法，还包括：
    响应于满足录音开始条件，在录制所述电子设备的用户界面期间，采集与所述电子设备相关联的音频信息，其中，所述音频信息在时间轴上与所述视频对应。
  40. 根据权利要求39所述的方法，还包括：
    实时识别并得到与所述音频信息在时间轴上对应的文字信息；以及
    按照时间轴将所述文字信息增加到所述视频和/或所述多个截图中，使得所述文字信息能够按照时间轴与所述视频一起播放和/或与所述多个截图一起显示。
  41. 根据权利要求1所述的方法，其中，在对所述电子设备的用户界面进行自动截图时，在所述电子设备的用户界面上不显示截图动画。
  42. 根据权利要求1所述的方法，其中，在对所述电子设备的用户界面进行自动截图时，所述电子设备不产生截图音效。
  43. 根据权利要求1所述的方法，其中，所述电子设备的用户界面是触敏用户界面。
  44. 一种用于操作电子设备的装置，包括：
    确定单元，被配置为确定是否满足截图开始条件；
    截图单元，被配置为对所述电子设备的用户界面进行自动截图，以获得与所述电子设备的用户界面相关联的多个截图；以及
    停止单元，被配置为响应于确定满足截图停止条件，停止对所述电子设备的用户界面进行截图。
  45. 根据权利要求44所述的装置，还包括：
    被配置为执行根据权利要求2至43中任一项所述的方法的步骤的单元。
  46. 一种电子设备，包括：
    处理器；以及
    存储程序的存储器，所述程序包括指令，所述指令在由所述处理器执行时使所述处理器执行根据权利要求1至43中任一项所述的方法。
  47. 一种存储程序的存储介质，所述程序包括指令，所述指令在由电子设备的处理器执行时，致使所述电子设备执行根据权利要求1至43中任一项所述的方法。
PCT/CN2020/109452 2019-10-31 2020-08-17 操作用户界面的方法、装置、电子设备及存储介质 WO2021082639A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/753,296 US11875023B2 (en) 2019-10-31 2020-08-17 Method and apparatus for operating user interface, electronic device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911063011.3A CN110825289A (zh) 2019-10-31 2019-10-31 操作用户界面的方法、装置、电子设备及存储介质
CN201911063011.3 2019-10-31

Publications (1)

Publication Number Publication Date
WO2021082639A1 true WO2021082639A1 (zh) 2021-05-06

Family

ID=69552390

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/109452 WO2021082639A1 (zh) 2019-10-31 2020-08-17 操作用户界面的方法、装置、电子设备及存储介质

Country Status (3)

Country Link
US (1) US11875023B2 (zh)
CN (1) CN110825289A (zh)
WO (1) WO2021082639A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113852756A (zh) * 2021-09-03 2021-12-28 维沃移动通信（杭州）有限公司 图像获取方法、装置、设备和存储介质
CN114257770A (zh) * 2021-11-16 2022-03-29 杭州迈杰教育科技有限公司 对课堂教学录制电脑画面的方法、电子设备和存储介质
EP4345650A4 (en) * 2022-02-28 2024-10-09 Honor Device Co Ltd HUMAN-MACHINE INTERACTION METHOD AND APPARATUS AND ELECTRONIC DEVICE

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825289A (zh) 2019-10-31 2020-02-21 北京字节跳动网络技术有限公司 操作用户界面的方法、装置、电子设备及存储介质
CN111897473A (zh) * 2020-07-28 2020-11-06 惠州Tcl移动通信有限公司 一种终端的信息提取方法、装置、存储介质及终端
CN112162805B (zh) * 2020-09-23 2023-05-19 维沃移动通信有限公司 截图方法、装置和电子设备
CN113726953B (zh) * 2021-08-31 2023-03-14 维沃移动通信有限公司 显示内容获取方法和装置
CN116708888A (zh) * 2022-11-22 2023-09-05 荣耀终端有限公司 视频录制方法及相关装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104820549A (zh) * 2015-04-15 2015-08-05 小米科技有限责任公司 社交应用消息的发送方法、装置及终端
CN105447900A (zh) * 2014-07-04 2016-03-30 北京新媒传信科技有限公司 一种录制动画的方法和装置
CN107168625A (zh) * 2017-06-05 2017-09-15 深圳市金立通信设备有限公司 一种截屏方法及终端
CN107682650A (zh) * 2017-09-30 2018-02-09 咪咕动漫有限公司 一种图像处理方法及装置和存储介质
US20180255341A1 (en) * 2015-11-25 2018-09-06 Le Holdings (Beijing) Co., Ltd. Method and Apparatus for Video Playback
CN110825289A (zh) * 2019-10-31 2020-02-21 北京字节跳动网络技术有限公司 操作用户界面的方法、装置、电子设备及存储介质

Family Cites Families (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6264198B1 (en) * 1999-06-29 2001-07-24 Rare Limited Method, system and computer-readable medium for a moving video image jigsaw puzzle game
JP2004266376A (ja) * 2003-02-25 2004-09-24 Matsushita Electric Ind Co Ltd 映像合成装置
US7590942B2 (en) * 2004-09-16 2009-09-15 Novatech Llc System, method and computer program product for documenting and managing execution of procedures in a graphical interface environment
EP2115628A4 (en) * 2007-01-29 2012-10-17 Sony Online Entertainment Llc SYSTEM AND METHOD FOR CREATING AUTOMATIC INPUTS FOR BLOGS, WEB PAGES OR FILE SHARING SITES BASED ON GAMING EVENTS
WO2008103443A2 (en) * 2007-02-22 2008-08-28 Snipitron, Llc Subject matter resource website
US20090043646A1 (en) * 2007-08-06 2009-02-12 International Business Machines Corporation System and Method for the Automated Capture and Clustering of User Activities
US20120044137A1 (en) * 2009-04-01 2012-02-23 Chandar Kumar Oddiraju Screen capture
US9098313B2 (en) * 2009-08-24 2015-08-04 Kryon Systems Ltd. Recording display-independent computerized guidance
US9405558B2 (en) * 2009-08-24 2016-08-02 Kryon Systems Ltd. Display-independent computerized guidance
US8918739B2 (en) * 2009-08-24 2014-12-23 Kryon Systems Ltd. Display-independent recognition of graphical user interface control
US9554111B2 (en) * 2010-03-08 2017-01-24 Magisto Ltd. System and method for semi-automatic video editing
US8600824B2 (en) * 2010-04-28 2013-12-03 Verizon Patent And Licensing Inc. Image-based product marketing systems and methods
US8856215B2 (en) * 2010-08-17 2014-10-07 Comscore, Inc. Detecting visible display of content
US9141255B2 (en) * 2010-12-21 2015-09-22 Disney Enterprises, Inc. Mosaic generation from user-created content
US8847985B2 (en) * 2010-12-30 2014-09-30 International Business Machines Corporation Protecting screen information
US8874525B2 (en) * 2011-04-19 2014-10-28 Autodesk, Inc. Hierarchical display and navigation of document revision histories
US9606643B2 (en) * 2011-05-02 2017-03-28 Microsoft Technology Licensing, Llc Extended above the lock-screen experience
US20130053007A1 (en) * 2011-08-24 2013-02-28 Microsoft Corporation Gesture-based input mode selection for mobile devices
KR101919008B1 (ko) * 2012-02-24 2018-11-19 삼성전자주식회사 정보 제공 방법 및 이를 위한 이동 단말기
US20130283318A1 (en) * 2012-04-23 2013-10-24 Comcast Cable Communications, LLC. Dynamic Mosaic for Creation of Video Rich User Interfaces
EP2680616A1 (en) * 2012-06-25 2014-01-01 LG Electronics Inc. Mobile terminal and audio zooming method thereof
US20140019865A1 (en) * 2012-07-13 2014-01-16 Whamix Inc. Visual story engine
US20160249106A1 (en) * 2012-09-14 2016-08-25 Appurify, Inc. Remote Control of a Mobile Device
WO2014056122A1 (en) * 2012-10-08 2014-04-17 Intel Corporation Method, apparatus and system of screenshot grabbing and sharing
US9407824B2 (en) * 2012-11-01 2016-08-02 Google Inc. Multi-directional content capture on mobile devices
US9658695B2 (en) * 2012-11-08 2017-05-23 Cuesta Technology Holdings, Llc Systems and methods for alternative control of touch-based devices
US9858271B2 (en) * 2012-11-30 2018-01-02 Ricoh Company, Ltd. System and method for translating content between devices
CN104035684A (zh) * 2013-03-06 2014-09-10 腾讯科技（深圳）有限公司 一种应用于移动终端上的动态截屏方法及系统
US9230191B2 (en) * 2013-03-15 2016-01-05 Dropbox, Inc. Presentation and organization of content
US9495534B2 (en) * 2013-03-26 2016-11-15 International Business Machines Corporation OCR-based single sign-on
US10191964B2 (en) * 2013-05-30 2019-01-29 Microsoft Technology Licensing, Llc Automatic isolation and selection of screenshots from an electronic content repository
US20150106500A1 (en) * 2013-10-14 2015-04-16 Bank Of America Corporation Application provisioning system
US20150128017A1 (en) * 2013-11-06 2015-05-07 International Business Machines Corporation Enabling interactive screenshots within collaborative applications
US10002191B2 (en) * 2013-12-31 2018-06-19 Google Llc Methods, systems, and media for generating search results based on contextual information
US20150278180A1 (en) * 2014-04-01 2015-10-01 Project T, LLC System and method for annotating webpages
CN104978133A (zh) * 2014-04-04 2015-10-14 阿里巴巴集团控股有限公司 一种用于智能终端的截屏方法和装置
US10290133B2 (en) * 2014-09-26 2019-05-14 Oracle International Corporation High fidelity interactive screenshots for mobile applications
US10255754B2 (en) * 2015-01-12 2019-04-09 Puzzup Llc Methods and systems for interactive image sharing
US10275341B2 (en) * 2015-01-21 2019-04-30 Somo Innovations Ltd Mobile application usability testing
US10380657B2 (en) * 2015-03-04 2019-08-13 International Business Machines Corporation Rapid cognitive mobile application review
EP3314482A4 (en) * 2015-09-02 2018-05-23 Samsung Electronics Co., Ltd. Method and device of tagging links included in a screenshot of webpage
US10068071B2 (en) * 2015-09-09 2018-09-04 Airwatch Llc Screen shot marking and identification for device security
US9916155B2 (en) * 2015-12-01 2018-03-13 International Business Machines Corporation Projects browser for development environments
US9699514B2 (en) * 2015-12-02 2017-07-04 Echostar Technologies L.L.C. Apparatus, systems and methods for media mosaic management
CN105549845B (zh) * 2015-12-09 2019-03-26 惠州Tcl移动通信有限公司 一种基于移动终端的页面连续截图方法、系统及移动终端
US10200823B2 (en) * 2015-12-09 2019-02-05 Navico Holding As Methods and apparatus for capturing data using a marine electronics device
CN105653155B (zh) * 2015-12-25 2019-04-26 百度在线网络技术（北京）有限公司 终端设备的控制方法及装置
US10249266B2 (en) * 2016-02-29 2019-04-02 Vmware, Inc. Preserving desktop state across login sessions
US10237621B2 (en) * 2016-03-24 2019-03-19 Dish Technologies Llc Direct capture and sharing of screenshots from video programming
US10463974B2 (en) * 2016-07-07 2019-11-05 Peter Selinger Permutation game
KR20180017746A (ko) * 2016-08-10 2018-02-21 엘지전자 주식회사 이동 단말기 및 그 제어방법
EP3519950B1 (en) * 2017-01-17 2020-11-04 Google LLC Assistive screenshots
CN106970754B (zh) * 2017-03-28 2020-09-08 北京小米移动软件有限公司 截屏处理的方法及装置
CN107247547A (zh) * 2017-05-25 2017-10-13 北京小米移动软件有限公司 截图处理方法及装置
CN107194898A (zh) * 2017-06-23 2017-09-22 携程计算机技术（上海）有限公司 酒店图像的展示方法、存储介质及酒店信息的推送方法
CN109040419B (zh) * 2018-06-11 2021-01-12 Oppo（重庆）智能科技有限公司 录屏方法、装置、移动终端及存储介质
CN110825278A (zh) * 2018-08-07 2020-02-21 深圳富泰宏精密工业有限公司 电子设备及截屏方法
CN109120982A (zh) * 2018-09-27 2019-01-01 惠州Tcl移动通信有限公司 一种视频播放界面图片存储方法、移动终端及存储介质
US10739935B2 (en) * 2018-11-16 2020-08-11 International Business Machines Corporation Review of previously displayed content
CN112292726B (zh) * 2019-05-22 2022-02-22 谷歌有限责任公司 用于沉浸式环境中对象分组和操纵的方法、系统和介质
WO2021044601A1 (ja) * 2019-09-05 2021-03-11 ソニー株式会社 アプリケーション拡張プログラム、情報処理装置、および方法
US11250536B2 (en) * 2019-09-11 2022-02-15 International Business Machines Corporation Image capture prevention

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105447900A (zh) * 2014-07-04 2016-03-30 北京新媒传信科技有限公司 一种录制动画的方法和装置
CN104820549A (zh) * 2015-04-15 2015-08-05 小米科技有限责任公司 社交应用消息的发送方法、装置及终端
US20180255341A1 (en) * 2015-11-25 2018-09-06 Le Holdings (Beijing) Co., Ltd. Method and Apparatus for Video Playback
CN107168625A (zh) * 2017-06-05 2017-09-15 深圳市金立通信设备有限公司 一种截屏方法及终端
CN107682650A (zh) * 2017-09-30 2018-02-09 咪咕动漫有限公司 一种图像处理方法及装置和存储介质
CN110825289A (zh) * 2019-10-31 2020-02-21 北京字节跳动网络技术有限公司 操作用户界面的方法、装置、电子设备及存储介质

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113852756A (zh) * 2021-09-03 2021-12-28 维沃移动通信（杭州）有限公司 图像获取方法、装置、设备和存储介质
CN113852756B (zh) * 2021-09-03 2023-07-28 维沃移动通信（杭州）有限公司 图像获取方法、装置、设备和存储介质
CN114257770A (zh) * 2021-11-16 2022-03-29 杭州迈杰教育科技有限公司 对课堂教学录制电脑画面的方法、电子设备和存储介质
EP4345650A4 (en) * 2022-02-28 2024-10-09 Honor Device Co Ltd HUMAN-MACHINE INTERACTION METHOD AND APPARATUS AND ELECTRONIC DEVICE

Also Published As

Publication number Publication date
US20220326823A1 (en) 2022-10-13
US11875023B2 (en) 2024-01-16
CN110825289A (zh) 2020-02-21

Similar Documents

Publication Publication Date Title
WO2021082639A1 (zh) 操作用户界面的方法、装置、电子设备及存储介质
US11822761B2 (en) Shared-content session user interfaces
US11907605B2 (en) Shared-content session user interfaces
CN110100251B (zh) 用于处理文档的设备、方法和计算机可读存储介质
CN108024079B (zh) 录屏方法、装置、终端及存储介质
CN112165632B (zh) 视频处理方法、装置及设备
JP6400293B2 (ja) 電子装置でコンテンツを制御する装置及びその方法
WO2016192325A1 (zh) 视频文件的标识处理方法及装置
KR20150077774A (ko) 화면 전환 방법 및 그 장치
CN112653920B (zh) 视频处理方法、装置、设备及存储介质
KR20230049691A (ko) 비디오 처리 방법, 단말기 및 저장매체
US20240320256A1 (en) Method, apparatus, device, readable storage medium and product for media content processing
US9325776B2 (en) Mixed media communication
JP4724242B2 (ja) 電子機器および画像表示方法
WO2019095815A1 (zh) 界面展示方法及装置
WO2022127524A1 (zh) 视频会议呈现方法、装置、终端设备和存储介质
CN113766275B (zh) 视频剪辑方法、装置、终端及存储介质
US20210377454A1 (en) Capturing method and device
WO2019095811A1 (zh) 界面展示方法及装置
JP7549162B2 (ja) 共有コンテンツセッションユーザインタフェース
JP7567076B2 (ja) 共有コンテンツセッションユーザインタフェース
CN115348478B (zh) 设备交互显示方法、装置、电子设备及可读存储介质
JP2024054872A (ja) 共有コンテンツセッションユーザインタフェース
CN118741207A (zh) 界面交互方法、装置、电子设备和存储介质和程序产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20883056

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20883056

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.09.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20883056

Country of ref document: EP

Kind code of ref document: A1