WO2021082639A1 - 操作用户界面的方法、装置、电子设备及存储介质 - Google Patents
操作用户界面的方法、装置、电子设备及存储介质 Download PDFInfo
- Publication number
- WO2021082639A1 WO2021082639A1 PCT/CN2020/109452 CN2020109452W WO2021082639A1 WO 2021082639 A1 WO2021082639 A1 WO 2021082639A1 CN 2020109452 W CN2020109452 W CN 2020109452W WO 2021082639 A1 WO2021082639 A1 WO 2021082639A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- user interface
- screenshot
- screenshots
- input
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 123
- 230000004044 response Effects 0.000 claims abstract description 88
- 230000006870 function Effects 0.000 claims description 87
- 230000000717 retained effect Effects 0.000 claims description 6
- 230000000694 effects Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 238000000605 extraction Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000011218 segmentation Effects 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 238000003708 edge detection Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000009499 grossing Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 208000032041 Hearing impaired Diseases 0.000 description 1
- 241000699670 Mus sp. Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- CCEKAJIANROZEO-UHFFFAOYSA-N sulfluramid Chemical group CCNS(=O)(=O)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)F CCEKAJIANROZEO-UHFFFAOYSA-N 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
Definitions
- the present disclosure relates to the technical field of user interface processing, and in particular to a method, device, electronic device, and storage medium for operating an electronic device.
- the user may wish to perform an operation on the user interface of the electronic device. Screenshots. Although the operations for taking screenshots on the user interface of different electronic devices are not the same, the user's operations for taking screenshots on the user interface of the electronic device may affect the current operation of the user, which may cause inconvenience to the user.
- a method for operating an electronic device including: determining whether a screenshot start condition is satisfied; in response to determining that the screenshot starting condition is satisfied, performing an automatic screenshot on a user interface of the electronic device, To obtain multiple screenshots associated with the user interface of the electronic device; and in response to determining that the screenshot stop condition is satisfied, stop automatically taking screenshots of the user interface of the electronic device.
- an apparatus for operating an electronic device including: a determining unit configured to determine whether a screenshot start condition is satisfied; and a screenshot unit configured to automatically perform an automatic operation on a user interface of the electronic device. Taking screenshots to obtain multiple screenshots associated with the user interface of the electronic device; and the stopping unit is configured to stop taking screenshots of the user interface of the electronic device in response to determining that the screenshot stopping condition is satisfied.
- an electronic device including: a processor; and a memory storing a program, the program including instructions that when executed by the processor cause the processor to execute the present disclosure
- a computer-readable storage medium storing a program, the program including instructions that, when executed by a processor of an electronic device, cause the electronic device to execute the The method used to operate electronic equipment.
- a computer program product including a program, the program including code that, when executed by a processor of an electronic device, causes the electronic device to execute the functions described in the disclosure.
- FIG. 1 is a flowchart showing a method for operating an electronic device according to an exemplary embodiment of the present disclosure
- FIG. 2 is a schematic diagram showing an example of a user interface for determining whether a screenshot start condition is satisfied according to an exemplary embodiment of the present disclosure
- FIG. 3 is a schematic diagram showing a user interface of a screen recording window according to an exemplary embodiment of the present disclosure
- 4A is a schematic diagram showing a user interface of a video and multiple screenshots displayed when the electronic device is in a vertical screen state according to an exemplary embodiment of the present disclosure
- 4B is a schematic diagram showing a user interface of a video and multiple screenshots displayed when the electronic device is in a landscape state according to an exemplary embodiment of the present disclosure
- FIG. 5 is a schematic diagram showing a user interface for editing a displayed video and multiple screenshots according to an exemplary embodiment of the present disclosure
- FIG. 6 is a structural block diagram showing an apparatus for operating an electronic device according to an exemplary embodiment of the present disclosure
- FIG. 7 is a structural block diagram showing an exemplary electronic device that can be applied to an exemplary embodiment of the present disclosure.
- first, second, etc. to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of these elements. It is only used to distinguish one element from another.
- first element and the second element may refer to the same instance of the element, and in some cases, based on the description of the context, they may also refer to different instances.
- electronic equipment can be any type of electronic equipment, such as but not limited to such as mobile phones, notebook computers, digital broadcast receivers, PDA (personal digital assistant), PAD (tablet computer), PMP ( Portable multimedia players), mobile terminals such as vehicle-mounted terminals (e.g., vehicle navigation terminals), and fixed terminals such as digital TVs, desktop computers, and the like.
- PDA personal digital assistant
- PAD tablet computer
- PMP Portable multimedia players
- mobile terminals such as vehicle-mounted terminals (e.g., vehicle navigation terminals), and fixed terminals such as digital TVs, desktop computers, and the like.
- a “window” is a medium in which codes or programs are displayed on the user interface of an electronic device.
- the "application” is displayed on the user interface of the electronic device through the "application window”.
- the user may wish to perform an operation on the user interface of the electronic device. Screenshots. Although the operations for taking screenshots on the user interface of different electronic devices are not the same, the user's operations for taking screenshots on the user interface of the electronic device may affect the current operation of the user, which may cause inconvenience to the user.
- the present disclosure provides a method for operating an electronic device.
- the method for operating an electronic device according to the present disclosure can automatically take screenshots of the user interface of the electronic device to obtain multiple screenshots associated with the user interface of the electronic device for subsequent operations of the user. This allows the automatic screenshot function to be executed when the screenshot start condition is met, which simplifies the user's operation.
- the method for operating an electronic device according to the present disclosure can automatically take screenshots of the user interface of the electronic device, without requiring users to manually take screenshots according to the operating specifications of different electronic devices, so that the screenshot process will not be affected. The user's current operation.
- the first aspect of the present disclosure may include a method for operating an electronic device, and the method may include: determining whether a screenshot start condition is satisfied (S101); in response to determining that the screenshot start condition is satisfied, The user interface of the electronic device performs automatic screenshots to obtain multiple screenshots associated with the user interface of the electronic device (S102); in response to determining that the screenshot stop condition is satisfied, the automatic screenshot of the user interface of the electronic device is stopped (S103).
- the electronic device may determine whether the screenshot start condition is satisfied.
- the screenshot start condition may be that the user starts inputting a screenshot of the user interface of the electronic device.
- the screenshot start condition may be that the user starts inputting a screenshot of a physical button of the electronic device.
- the screenshot start condition may also be independent of the user's input. The following text will describe in detail how to determine whether the screenshot start condition is met.
- step S102 automatic screenshots of the user interface of the electronic device (also referred to as screenshots for short) are automatically executed by the electronic device without manual operation by the user.
- the entire user interface of the electronic device can be automatically captured. According to other embodiments, it is also possible to automatically take a screenshot of a part of the user interface of the electronic device. For example, in the process of taking a screenshot of the video, the black area of the video is automatically filtered out.
- taking a screenshot of a user interface of an electronic device usually displays a screenshot animation.
- the screenshot animation when taking automatic screenshots of the user interface of the electronic device, may not be displayed on the user interface of the electronic device.
- the electronic device when the user interface of the electronic device is automatically captured, the electronic device may not generate a screenshot sound effect.
- the electronic device may determine whether the screenshot stop condition is satisfied.
- the screenshot stop condition may be that the user stops inputting a screenshot of the user interface of the electronic device.
- the screenshot stop condition may be that the user stops inputting a screenshot of a physical button of the electronic device.
- the screenshot stop condition may also be independent of the user's input. The following text will describe in detail how to determine whether the screenshot stop condition is met.
- the thumbnails of the multiple screenshots and/or the video may be directly displayed on the user interface of the electronic device.
- the thumbnails of the multiple screenshots and/or the video may not be directly displayed, but they may be saved in a temporary folder for use. Use for subsequent operations by the user.
- the user interface of the electronic device may be a touch-sensitive user interface.
- step S101 The following will describe how to determine whether the screenshot start condition is satisfied in step S101.
- the determining whether the screenshot start condition is satisfied may include: in response to receiving an automatic screenshot instruction input for the user interface of the electronic device, determining that the screenshot start condition is satisfied.
- the automatic screenshot indicating input may include a tap input, a press input, a slide input, a lift input, or a combination thereof.
- the automatic screenshot instruction input may include one input, for example, a click input for a screen capture button, a press input for a certain position on the user interface, and so on.
- the automatic screenshot indicating input may also include multiple inputs. The automatic screenshot indication input including multiple inputs will be described in detail later.
- the state of the user interface of the electronic device when the input of the automatic screenshot instruction is received can be determined.
- the method may further include: receiving an automatic screenshot instruction input for the user interface of the electronic device, wherein the determining whether the screenshot start condition is satisfied includes: determining that the user interface of the electronic device is receiving The automatic screenshot instruction input is an application window; in response to determining that the user interface of the electronic device displays an application window when the automatic screenshot instruction input is received, it is determined whether the application window is allowed Being captured; and in response to determining that the application window is allowed to be captured, determining that the screenshot start condition is satisfied.
- the user interface of the electronic device may display an application window, a system desktop, a task manager window, etc. when receiving the automatic screenshot instruction input.
- the user interface of the electronic device displays an application window when receiving the input of the automatic screenshot instruction, it may be further determined whether the application window is allowed to be screenshotted.
- application windows are allowed to be screenshots.
- the user interface displays the application window when receiving the input of the automatic screenshot instruction, and it can be determined that the screenshot start condition is met.
- the application window is not allowed to be screenshots.
- the developer of the application window may not allow the application window to be screenshotted (for example, for reasons of copyright or privacy, etc.).
- the user sets the application window to not allow screenshots. The user may set the application window to not allow screenshots due to reasons such as not wanting to be disturbed when operating the application window.
- the application window that can be set by the user to not allow screenshots may be a game application window. Therefore, when the user interface displays an application window that does not allow screenshots when receiving the automatic screenshot instruction input, it can be determined that the screenshot start condition is not met.
- the determining whether the screenshot start condition is satisfied further includes: in response to determining that the user interface of the electronic device is not displaying an application window when receiving the automatic screenshot instruction input, determining that the screenshot starting condition is satisfied .
- the user interface of the electronic device may not be an application window when receiving the automatic screenshot instruction input, for example, may be a desktop window, a task manager window, or the like.
- the electronic device can directly determine that the screenshot start condition is met, and start automatic screenshot, which simplifies the step of determining whether the screenshot start condition is met.
- the automatic screenshot indicating input may include a single input or multiple inputs.
- the receiving automatic screenshot instruction input for the user interface of the electronic device may include: receiving a function menu call-out input for the user interface of the electronic device; in response to receiving the function menu call-out input, A function selection menu is displayed on the user interface of the electronic device, where the function selection menu includes a screen recording and screenshot function option; and a selection for the screen recording and screenshot function option is received.
- FIG. 2 is a schematic diagram illustrating a user interface 200 according to an example of determining whether a screenshot start condition is satisfied according to an exemplary embodiment of the present disclosure. The following will describe how to determine the screenshot start condition through the function selection menu and the selection of the function options on the function selection menu in conjunction with FIG. 2.
- the automatic screenshot indication input may include two inputs.
- the first input of the automatic screenshot instruction input includes a function menu call input for the user interface of the electronic device.
- the function menu call-out input for example, a click input for a function menu call-out button, a press input for a user interface, a sliding input performed upward from the lower edge of the user interface of the electronic device, etc.
- a function selection menu 201 is displayed on the user interface of the electronic device.
- the function selection menu 201 may include multiple function options. According to the example shown in FIG.
- the function selection menu 201 may include three function options, namely an audio word segmentation function option 202-1, a screen recording function option 202-2, and a picture word segmentation function option 202-3.
- the function selection menu may include any number of function options.
- the user can select a function option in the function menu 201.
- the automatic screenshot instruction input further includes the selection of the screen recording and screenshot function option 202-2 as the second input of the automatic screenshot instruction input.
- the method may further include: receiving an automatic screenshot instruction input for the user interface of the electronic device, wherein the determining whether the screenshot start condition is satisfied may include: acquiring the automatic screenshot instruction input in the The location on the user interface of the electronic device; determining whether the user interface of the electronic device belongs to the text extractable area at the location; and in response to determining that the user interface of the electronic device does not belong to the text extractable area at the location Area, it is determined that the screenshot start condition is met.
- the user interface of the electronic device may include text extractable areas and text non-extractable areas.
- the text extractable area refers to an area where Chinese characters can be input in response to text extraction, for example, the area where the text conversation in the chat application is located, the area where the text text in the mailbox application is located, and so on.
- the non-extractable text area refers to an area where text cannot be selected in response to text extraction input, for example, the system desktop, the area where the pictures in the photo album application are located, and so on.
- the text extraction input may include a click input, a pressing input, a sliding input, a lifting input, or a combination thereof for the text extractable area. It can be seen that the text extraction input may overlap with the automatic screenshot instruction input.
- the screenshot start condition when the position of the automatic screenshot indicating input on the user interface of the electronic device does not belong to the text extractable area, it is determined that the screenshot start condition is met, and the screenshot is taken. In this way, the screenshot start condition can be determined more accurately, and it will not interfere with the text extraction input, which improves the user experience.
- the acquisition of the automatic screenshot instruction input is The position on the user interface of the electronic device may include: acquiring the position of the call-out input of the function menu on the user interface of the electronic device.
- it is determined that the function selection menu can be displayed. Then, select the screen recording and screenshot function option in the function selection menu as the second input of the automatic screenshot instruction input.
- the input can be called out through the function menu of the first input as the automatic screenshot instruction input to eliminate the misoperation of the text extractable area, and at the same time, through the recording of the second input as the automatic screenshot instruction input.
- the screen capture function option confirms that the user wants to start an automatic screenshot, which further increases the accuracy of the determination of satisfying the screenshot start condition, and improves the user experience.
- the method may further include: in response to determining that the user interface of the electronic device belongs to the text extractable area at the position, displaying a function selection menu on the user interface of the electronic device, wherein The function selection menu includes a screen recording and screenshot function option; receiving a selection for the screen recording and screenshot function option; in response to receiving a selection for the screen recording and screenshot function option, it is determined that the screenshot start condition is satisfied.
- a function selection menu may be displayed (for example, pop-up) on the user interface for the user to further confirm the desired execution of the electronic device. operating.
- the function selection menu may include, for example, a screen capture function option, an audio word segmentation function option, an image word segmentation function option, a text word segmentation function option, a text extraction function option, and the like.
- the user can select the screen capture function option (for example, click the screen capture function option, press the screen capture function option, slide on the screen capture function option, etc.), and After the user selects the screen recording and screenshot function option, it is determined that the screenshot start condition is met.
- the screen capture function option for example, click the screen capture function option, press the screen capture function option, slide on the screen capture function option, etc.
- step S102 an exemplary manner of automatic screenshot in step S102 will be described in detail in conjunction with exemplary embodiments of the present disclosure.
- the automatic screenshot of the user interface of the electronic device may include: automatic screenshot of the user interface of the electronic device at a preset time interval.
- the preset time interval may be once every 0.1 seconds, once every 0.2 seconds, once every 0.3 seconds, once every 0.4 seconds, once every 0.8 seconds, or once every 1 second, and so on.
- the frequency of manual screenshots of the user interface of the electronic device is not stable due to the limitation of control, and the method for operating the electronic device according to the present disclosure can achieve uniform screenshots, and can adjust the automatic screenshots as required.
- the frequency (will be described in detail below).
- the automatic screenshot of the user interface of the electronic device may include: real-time acquisition of the elapsed time for the automatic screenshot of the user interface of the electronic device; and based on the elapsed time acquired in real time, dynamically Adjust the time interval for automatically taking screenshots of the user interface of the electronic device.
- the elapsed time for automatically taking a screenshot of the user interface of the electronic device can be obtained in real time through the timer of the electronic device.
- the elapsed time may be the time elapsed from the moment when the user interface of the electronic device is automatically captured until the current moment.
- the time interval of automatic screenshots (ie, the rate of automatic screenshots) can be adjusted according to the elapsed time.
- automatic screenshots of a user interface of an electronic device according to an exemplary embodiment of the present disclosure are controllable.
- the user interface of the electronic device when the elapsed time is relatively small, can be automatically captured at a relatively small time interval; and when the elapsed time is relatively large, the user of the electronic device can be captured at a relatively large time interval. Automatic screenshots of the interface.
- the dynamically adjusting the time interval for automatically taking screenshots of the user interface of the electronic device based on the elapsed time acquired in real time may include: when the elapsed time acquired in real time is in the first range, Automatically screenshot the user interface of the electronic device at the first time interval; and when the elapsed time acquired in real time is in the second range, automatically screenshot the user interface of the electronic device at the second time interval, wherein, The values in the first range are all smaller than the values in the second range, and the first time interval is smaller than the second time interval.
- the first range may be (0, 15 seconds) (that is, the elapsed time is greater than 0 seconds and less than or equal to 15 seconds), and the second range may be (15 seconds, 30 seconds) (that is, the elapsed time is greater than 15 seconds). Seconds and less than or equal to 30 seconds).
- the first time interval may be every 0.2 seconds, and the second time interval may be every 0.4 seconds.
- the dynamically adjusting the time interval for automatically taking screenshots of the user interface of the electronic device based on the elapsed time obtained in real time may further include: when the elapsed time obtained in real time is in the third range, Take automatic screenshots of the user interface of the electronic device at a third time interval, wherein the values in the second range are all smaller than the values in the third range, and the second time interval is smaller than the third time interval.
- the third range may be (30 seconds, + ⁇ ) (ie, the elapsed time is greater than 30 seconds), and the third time interval may be once every 0.8 seconds.
- the third time interval may be once every 0.8 seconds.
- first range the second range, the third range, the first time interval, the second time interval, and the first range can be changed according to actual conditions.
- Three time intervals and according to exemplary embodiments of the present disclosure, may further include a fourth range, a fifth range, and a fourth time interval, a fifth time interval, and the like.
- the time interval for taking automatic screenshots of the user interface of the electronic device is also longer. In the case where a long time has elapsed, this can avoid obtaining too many screenshots, and make subsequent operations on these screenshots (for example, filtering the screenshots) more convenient for the user.
- the multiple screenshots associated with the user interface of the electronic device obtained according to the method of dynamically adjusting the time interval of automatic screenshots described above may be uneven in time.
- the first range can be (0, 15 seconds) (that is, the elapsed time is greater than 0 seconds and less than or equal to 15 seconds), and the second range can be (15 seconds, 30 seconds) (that is, the elapsed time is 15 seconds, 30 seconds).
- the time is greater than 15 seconds and less than or equal to 30 seconds)
- the first time interval can be every 0.2 seconds
- the second time interval can be every 0.4 seconds
- the elapsed time obtained in real time is 30 seconds.
- screenshots associated with the user interface of the electronic device are obtained in a state where the elapsed time has been in the first range (ie, the first 15 seconds).
- the second time interval is N times the first time interval, and N is a positive integer greater than 1, and the method may further include: when the elapsed time obtained in real time is in the second range When the elapsed time is in the first range, one screenshot is retained for every N screenshots associated with the user interface of the electronic device and the other screenshots are deleted.
- the second time interval is twice the first time interval. Therefore, it is possible to keep one screenshot from every two screenshots associated with the user interface of the electronic device that have been obtained in the state where the elapsed time was in the first range (for example, the first 15 seconds) and delete the other screenshots.
- the 75 screenshots associated with the user interface of the electronic device obtained in the first 15 seconds one screenshot is retained for every two screenshots, and the other screenshots are deleted.
- the 75 screenshots can be labeled in chronological order, and the screenshots with even numbers can be kept, and the screenshots with odd numbers can be deleted.
- the method according to the exemplary embodiment of the present disclosure can not only adaptively adjust the time interval of the screenshot according to the duration of the automatic screenshot, but also It can maintain the uniformity in time of the multiple screenshots finally obtained and associated with the user interface of the electronic device, greatly enhance the adaptive ability of automatic screenshots, and improve the user experience.
- the method may further include: in response to determining that the screenshot start condition is satisfied, recording a user interface of the electronic device to obtain a video associated with the user interface of the electronic device; and in response to determining that the screenshot is satisfied
- the screenshot stop condition stops recording the user interface of the electronic device.
- recording the user interface of the electronic device refers to recording the content displayed by the user interface of the electronic device in a certain period of time in the form of video, and the obtained video is referred to as the video recording with the electronic device.
- the video associated with the user interface refers to recording the content displayed by the user interface of the electronic device in a certain period of time in the form of video, and the obtained video is referred to as the video recording with the electronic device.
- the video associated with the user interface refers to recording the content displayed by the user interface of the electronic device in a certain period of time in the form of video, and the obtained video is referred to as the video recording with the electronic device.
- the user interface of the recording electronic device is realized by the electronic device itself, instead of being realized by photographing the user interface of the electronic device by an external device (for example, a camera, etc.).
- the recording time refers to the elapsed time from when the screenshot start condition is determined to be satisfied until the screenshot stop condition is determined to be satisfied.
- the user interface of the recording electronic device can generally be used to record the video being played by the electronic device, record the teaching demonstration operation of the application, etc.
- the present disclosure is not limited to these embodiments.
- the entire user interface of the electronic device can be recorded. According to other embodiments, part of the user interface of the electronic device may also be recorded. For example, during the process of recording the video, the black area of the video is automatically filtered out.
- FIG. 3 is a schematic diagram showing a user interface of a screen recording window according to an exemplary embodiment of the present disclosure. The following will describe the screen recording window that can be displayed when recording the user interface of the electronic device in conjunction with FIG. 3.
- the method may further include: in response to determining that the automatic screenshot instruction input satisfies the screenshot start condition, displaying a screen recording window 310 on the user interface 300 of the electronic device, wherein the screen recording The window indicates that the user interface of the electronic device is being recorded.
- the screen recording animation is not displayed during the process of recording the user interface of the electronic device.
- the user interface of the electronic device is automatically captured, neither the screenshot animation nor the screenshot sound effect is displayed.
- the screen recording window 310 is displayed to provide the user with visual feedback that the user interface of the electronic device is being recorded.
- a text prompt "Screen Recording" may be displayed in the screen recording window 310, so as to provide customers with more intuitive visual feedback.
- the text prompt is located at the bottom of the screen recording window.
- the text prompt can also be located at the top or middle of the screen recording window.
- the elapsed time of recording the user interface of the electronic device may be displayed in the user interface 300 or the screen recording window 310 in real time.
- the elapsed time displayed in real time may have a certain degree of transparency, such as 60%. In this way, the user can be reminded of the elapsed recording time in real time on the user interface of the recording electronic device.
- the user may not want the screen recording window to be recorded in the video associated with the user interface of the electronic device, nor does the user want the screen recording window to be automatically captured in the video associated with the user interface of the electronic device.
- At least one screenshot associated with the user interface of the electronic device At least one screenshot associated with the user interface of the electronic device.
- the automatic screenshot of the user interface of the electronic device may include: during the automatic screenshot of the user interface of the electronic device, not automatically screenshot the screen recording window; and the recording station
- the user interface of the electronic device may include: not recording the screen recording window during the recording of the user interface of the electronic device.
- not recording the screen recording window refers to: during the recording of the user interface of the electronic device, the area of the user interface of the electronic device other than the screen recording window can be recorded and the screen recorded The area occluded by the window makes the screen recording window not exist in the video.
- not taking automatic screenshots of the screen recording window refers to: during the automatic screenshot of the user interface of the electronic device, the user interface of the electronic device other than the screen recording window can be captured. Automatic screenshots are performed on the area and the area obscured by the screen recording window, so that the screen recording window does not exist in the multiple screenshots.
- the screen recording window displayed on the user interface is automatically filtered.
- the following will describe in detail the technology for automatically filtering the screen recording window during the recording process.
- the not automatically taking a screenshot of the screen recording window and/or the not recording the screen recording window may include: adjusting the capture attribute of the screen recording window to be non-capturable;
- the user interface of the electronic device performs automatic screenshots and/or starts to record the user interface of the electronic device, it detects and receives the capture attribute of the screen recording window; in response to receiving the capture attribute of the screen recording window as not captureable,
- the screen recording window is not automatically captured and/or the screen recording window is not recorded during the recording of the user interface of the electronic device.
- the user interface and the screen recording window of the electronic device may be displayed in different layers.
- the user interface of the electronic device is displayed in the first layer
- the screen recording window is displayed in the second layer
- the second layer is displayed above the first layer.
- the area in the user interface that is obscured by the screen recording window will not be displayed.
- the capture attribute of the screen recording window is adjusted to not be captureable.
- the NOT_CAPTURE attribute value is assigned to the screen recording window.
- the capture attribute of the screen recording window displayed on the second layer is detected. If the interception attribute is not interceptable, during the recording of the user interface of the electronic device and/or during the automatic screenshot of the user interface of the electronic device, the screen recording window displayed on the second layer is automatically filtered, and the recording window is only recorded on the first layer. The user interface of the electronic device displayed on one layer and/or an automatic screenshot of the user interface of the electronic device displayed on the first layer is taken.
- the user interface of the electronic device is recorded in the same way as if the screen recording window does not exist, and the user interface is automatically captured in the same way as if the screen recording window does not exist.
- displaying the screen recording window on the user interface of the electronic device includes: rendering the user interface of the electronic device on a user interface view control in real time; and setting the user interface view control on the screen recording window , To display the thumbnail of the user interface of the electronic device in the screen recording window in real time.
- the user interface of the electronic device can be rendered on the user interface view control in real time through virtual display technology.
- the user interface view control may be, for example, a Surface control.
- the virtual display technology may include, for example, the virtual display technology (Virtual Display) in the Android system.
- the content displayed in the screen recording window can be synchronized with the content displayed on the user interface of the electronic device.
- the content 301 being displayed in the user interface 300 is a tree
- the content 311 displayed in real time in the screen recording window is a thumbnail of the tree, in order to visually show the user
- the feedback electronic device is indeed recording the currently displayed user interface.
- the aspect ratio of the screen recording window is the same as the aspect ratio of the user interface of the electronic device.
- the four vertices of the screen recording window have rounded corners to look more beautiful.
- part of the user interface of the electronic device can be recorded, or a part of the user interface of the electronic device can be automatically captured. It should be noted that although the following describes in detail the technology of recording a part of the user interface of the electronic device by taking recording as an example, the technology can of course also be used to take a screenshot of a part of the user interface of the electronic device.
- a part of the user interface of the electronic device may be, for example, a video playing area.
- the method may further include: during an automatic screenshot of the user interface of the electronic device, determining whether the user interface of the electronic device is displaying a video playback application window corresponding to the video playback application, Wherein the video playback application window includes a video playback area, wherein the automatic screenshot of the user interface of the electronic device includes: in response to determining that the user interface of the electronic device is displaying the video playback application window, Taking a screenshot of only the video playback area, and recording the user interface of the electronic device includes: in response to determining that the user interface of the electronic device is displaying the video playback application window, recording only the video playback area .
- the application window being displayed is a video playback application window based on the information of the application window being displayed on the current user interface read from the system of the electronic device.
- the video playback application corresponding to the video playback application window may be Douyin, Volcano Video, etc.
- the video playback application window may display a video playback area, an advertisement area, a user comment area, a director or actor or voice personnel display area, and the like.
- the user may only want to record the video playback area that is part of the user interface of the electronic device or to It takes automatic screenshots.
- the automatic screenshot of the user interface of the electronic device and/or the recording only of the video play area may include: determining the position of the video play area on the user interface of the electronic device And based on the position of the video playing area on the user interface of the electronic device, taking a screenshot of the video playing area and/or recording the video playing area.
- coordinates may be used to represent the video play area.
- a coordinate system can be established with the vertex at the lower left corner of the user interface as the origin, the horizontal and right direction of the user interface as the positive x-axis direction, and the vertical upward direction of the user interface as the positive y-axis direction.
- determining the position of the video playing area on the user interface of the electronic device includes determining the coordinates of the edge of the video playing area in the coordinate system, and taking all the coordinates within the edge as Video playback area.
- the linear function of the four sides of the video play area on the coordinate system can be determined.
- the areas in all sides of the four sides are regarded as the video playback area, for example, ⁇ c ⁇ x ⁇ d, and a ⁇ y ⁇ b ⁇ .
- the left side of the obtained video playing area is corresponding to the pixels constituting the edge of the playing video area, and the content displayed by these pixels can be recorded, thereby realizing recording a part of the user interface of the electronic device. Similarly, only the content displayed by these pixels can be intercepted, so as to realize automatic screenshot of a part of the user interface of the electronic device.
- the above-mentioned video play area can be further reduced to determine the movie play area.
- the aspect ratio of the rectangular video playback area is usually 1.85:1, while the aspect ratio of the movie screen is usually 2.35:1. Therefore, the movie play area can be further determined as, for example, ⁇ c ⁇ x ⁇ d, and a+(b-a)/9.4 ⁇ y ⁇ b-(b-a)/9.4 ⁇ .
- determining the position of the video play area on the user interface of the electronic device includes the following three methods.
- the edge detection method can be used to determine the video playback area.
- the determining the position of the video play area on the user interface of the electronic device may include: detecting a frame of the video play area; and based on the frame of the video play area, setting the frame The inner area is determined as the video playing area.
- the method for detecting the border of the video play area may include: acquiring an image of the current user interface of the electronic device; performing Gaussian smoothing and denoising on the acquired image; using operators (for example, canny operator, lapacian operator) (E.g.) perform a convolution operation on the denoised image to obtain the gradient of each pixel of the acquired image; determine the pixels whose gradient is greater than the gradient threshold (for example, the maximum value of the gradient); connect these pixels to obtain the video playback area frame.
- operators for example, canny operator, lapacian operator
- developers of video playback applications usually develop multiple versions of video playback application windows to adapt to different types of electronic devices.
- the determining the position of the video play area on the user interface of the electronic device may include: obtaining the resolution of the electronic device; determining the video play that is being displayed on the user interface of the electronic device. The video playback application corresponding to the application window; and based on the acquired resolution of the electronic device and the determined video playback application corresponding to the video playback application window being displayed on the user interface of the electronic device, determining The position of the video play area on the user interface of the electronic device.
- the resolution of the electronic device may include the resolution of the user interface of the electronic device, the resolution of the display screen of the electronic device, and the like.
- the video playing area when playing a video, may depend on the resolution of the user interface and/or the display screen. Therefore, by determining the resolution of the user interface and/or the display screen, the video playback area can be accurately obtained.
- the determining the position of the video playing area on the user interface of the electronic device may include: obtaining the model of the electronic device; determining the video playing application that is being displayed on the user interface of the electronic device The video playback application corresponding to the program window; and based on the acquired model of the electronic device and the determined video playback application corresponding to the video playback application window being displayed on the user interface of the electronic device, determining the The position of the video playing area on the user interface of the electronic device.
- the model of the electronic device includes the manufacturer of the electronic device and the model of the electronic device.
- the manufacturer of the acquired electronic device is Hammer
- the model is M1
- the video playback application corresponding to the currently displayed video playback application window is Douyin. Based on the above information, the video playback area of Douyin on the Hammer M1 phone can be accurately obtained.
- the video play area can be obtained by directly extracting the video stream from the system of the electronic device.
- the method may further include: acquiring in real time the elapsed time for recording the user interface of the electronic device; and when the elapsed time acquired in real time is equal to the stop threshold time, determining that the screenshot described in step S103 is satisfied Stop condition.
- the stop threshold time may be preset by the user or set by default by the system of the electronic device. According to some examples, the stop threshold time may be 20 seconds, 30 seconds, 1 minute, 2 minutes, etc.
- the stop threshold time can be set to infinity.
- the stop threshold time may be set to a sufficiently large value. In other words, set the stop threshold time to a value that is almost impossible to reach when using the screen capture function normally.
- the value of the stop threshold time can be set to 0x7ffffff.
- the value 0x7ffffffff is actually the maximum value under 32-bit int. If the unit is seconds, the value of 0x7ffffffffff is about 68 years, which can be approximately regarded as setting the stop threshold time to infinity.
- the available memory of the electronic device can be determined in real time.
- reserved memory can be allocated for electronic devices.
- the reserved memory may be the memory required to ensure that the system of the electronic device can operate normally.
- the elapsed time is determined as the stop threshold time.
- the remaining space of the cache can also be determined in real time.
- reserved space may be allocated for the cache of the electronic device.
- the elapsed time is determined as the stop threshold time.
- the reserved memory and/or reserved space may be different according to different models of the electronic device. According to some embodiments, the reserved memory and/or reserved space may also be associated according to the application program that the electronic device is running. However, those skilled in the art should understand that the present disclosure is not limited to this, and the reserved memory and/or reserved space may be determined in any manner. Normally, the reserved memory and/or reserved space is not zero. However, in some cases, the reserved memory and/or reserved space may also be zero.
- the user wishes to independently determine when the automatic screenshot stops.
- the method may further include: receiving a screenshot stop input for the user interface of the electronic device; and in response to the screenshot stop input, determining that the screenshot stop condition is satisfied.
- the user can stop input (for example, click input for the screen recording stop button, click input for the screen recording window, press input for the user interface (for example, the user interface 300), etc.) to stop inputting the electronic device by taking a screenshot.
- Automatic screenshots of the user interface of the user interface which further improves the freedom of user operations and enhances the user experience.
- the method may further include: after stopping taking screenshots of the user interface of the electronic device and stopping recording the user interface of the electronic device, displaying the plurality of images on the user interface of the electronic device The thumbnail of the screenshot and the thumbnail of the video.
- FIGS. 4A and 4B are schematic diagram illustrating a user interface 400A of a video and multiple screenshots displayed when the electronic device is in a vertical screen state according to an exemplary embodiment of the present disclosure.
- FIG. 4B is a schematic diagram illustrating a user interface 400B of a video and multiple screenshots displayed when the electronic device is in a landscape state according to an exemplary embodiment of the present disclosure.
- the thumbnail of the video and the user interface of the electronic device may be directly displayed on the user interface of the electronic device. Thumbnails of multiple screenshots.
- FIGS. 4A and 4B after the recording of the user interface of the electronic device is stopped and the screenshot of the user interface of the electronic device is stopped, the user interface 400A, Video screenshot cards 410A, 410B are displayed on 400B, and thumbnails 420A, 420B of the video and thumbnails 430A, 430B of the multiple screenshots are displayed on the video screenshot cards 410A, 410B.
- the user interface and the display direction of the thumbnails of the video and the thumbnails of the multiple screenshots are defined by the comparison result of the aspect ratio and 1, whether the display direction is a portrait orientation or a landscape orientation.
- the display direction of the user interface is the portrait orientation. If the aspect ratio of the user interface is greater than 1, the display direction of the user interface is the landscape orientation.
- the display direction of the thumbnail of the video and the thumbnails of the multiple screenshots For portrait orientation. If the aspect ratio of the thumbnail of the video and the thumbnails of the multiple screenshots is greater than 1, the display direction of the thumbnail of the video and the thumbnails of the multiple screenshots is a landscape orientation.
- the user may rotate the electronic device (for example, rotate the electronic device from the portrait orientation to the landscape orientation, or change The electronic device is rotated from the landscape orientation to the portrait orientation).
- the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots may be neither the vertical screen direction nor the horizontal screen direction, but an oblique direction with a certain angle.
- the thumbnails of the screenshots in the multiple screenshots whose display direction is the portrait orientation or the landscape orientation may be retained and displayed, and the display directions of the multiple screenshots can be deleted. Thumbnails of screenshots that are not in portrait or landscape orientation.
- the directions of multiple screenshots may also be inconsistent.
- the display directions of the thumbnail of the video and the thumbnails of the multiple screenshots may be determined based on the orientation of the electronic device at the moment when the screen recording is stopped.
- the method may further include: determining a screenshot stopping direction, the screenshot stopping direction being the moment when the user interface of the electronic device is stopped and the recording of the user interface of the electronic device is stopped. The orientation of the electronic device; and based on the stop direction of the screenshot, displaying the thumbnails of the multiple screenshots and the thumbnails of the video on the user interface of the electronic device.
- the screenshot stopping direction includes the vertical screen direction and the horizontal screen direction as defined above.
- the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are the same as the stop direction of the screenshots.
- the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are also the portrait orientation.
- the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are also the landscape orientation.
- the stopping direction of the screenshot is the horizontal screen direction.
- the orientation of the electronic device is the vertical screen direction at this time, and the display direction of the user interface 400A is also the vertical screen direction
- the screenshot stopping direction is the horizontal screen direction
- the thumbnail 420A of the video and the display direction are horizontal.
- the display direction of the thumbnail 430A of the multiple screenshots is the horizontal screen direction.
- the display direction (horizontal screen direction) of the thumbnail 420A of the video and the thumbnail 430A of the multiple screenshots is inconsistent with the display direction (portrait direction) of the user interface 400A, these thumbnails A black border area is displayed above and below each. As shown in FIG.
- the real-time orientation of the electronic device is the horizontal screen direction
- the display direction of the user interface 400A is the horizontal screen direction
- the screenshot stopping direction is the horizontal screen direction
- the thumbnail 420A of the video and the plurality of The display direction of the thumbnail 430A of the screenshot is the horizontal screen direction.
- the display direction (horizontal screen direction) of the thumbnail 420B of the video and the thumbnail 430B of the multiple screenshots is consistent with the display direction (portrait direction) of the user interface 400B, these thumbnails Above and below the area with black borders are not displayed.
- the electronic device is rotated (for example, the electronic device is rotated from the portrait orientation to the landscape orientation, or the electronic device is removed from The horizontal screen direction is rotated to the vertical screen direction), which can still ensure that the display directions of the thumbnails of the video and the thumbnails of the multiple screenshots are consistent, so that the user's visual senses are consistent and neat when watching.
- the method may further include: receiving a display input for the thumbnail of the first screenshot of the plurality of screenshots; and in response to the display input, displaying in full screen on the user interface of the electronic device The first screenshot; receiving a playback input for the thumbnail of the video; and in response to the playback input, playing the video in full screen on a user interface of the electronic device.
- the play input for the thumbnail of the video may include: click input for the play buttons 422A, 422B (refer to FIG. 4A and FIG. 4B) on the thumbnail of the video, and zoom in on the video. Press input of thumbnails, etc.
- the display input for the thumbnail of the first screenshot of the plurality of screenshots may include: a click input for a zoom-in button on the thumbnail of the first screenshot, and a zoom-in for the first screenshot. Press input of thumbnails, etc.
- the video played in full screen is the original video obtained by recording, and its resolution is higher than the thumbnail of the video.
- the first screenshot displayed in the full screen is the original picture obtained by automatic screenshot, and its resolution is higher than the thumbnail of the first screenshot.
- the black border areas existing in the multiple screenshots may be removed. In this way, in the operations such as saving and sharing described below, the picture after removing the black border area can be saved and shared.
- the edge detection method can also be used to determine the black border area, and delete the black border area in the screenshot. The black border area detected.
- Gaussian smoothing and denoising can be performed on each of the multiple screenshots; operators (for example, canny operator, lapacian operator, etc.) are used to perform convolution operations on the denoised image to obtain each The gradient of each pixel in the screenshot; determine the pixels whose gradient is greater than the gradient threshold (for example, the maximum value of the gradient); connect these pixels to determine the black area in each screenshot (if there is a black area); delete the black area The black bordered area in the screenshot of the bordered area.
- operators for example, canny operator, lapacian operator, etc.
- the black border area can still be removed in the multiple screenshots associated with the user interface of the electronic device, which can reduce the number of electronic devices. Memory usage during automatic screenshots.
- the method may further include: receiving a first save input for the first save buttons 411A, 411B displayed on the user interface of the electronic device; and in response to the first save input, uploading the Multiple screenshots are stored in the screenshot folder, and the video is stored in the video folder.
- the first save input may be a click input, a press input, etc. for the first save button displayed on the user interface of the electronic device.
- the video and the multiple screenshots can be saved at the same time.
- the user does not need to store the video and multiple screenshots separately twice, which simplifies the user's operation.
- the method may further include: receiving a first sharing input for a first sharing button and a first application option displayed on a user interface of the electronic device, wherein the first application option corresponds to In a first application; and in response to the first sharing input, sharing the multiple screenshots and the video to the first application.
- the first application option may be directly displayed on the user interface of the electronic device.
- the first sharing input may be a click input for the first sharing button and a click input for the first application option.
- the first application option may not be directly displayed on the user interface of the electronic device, and the first sharing input includes the first input and the second input.
- the first input of the first sharing input includes a click input, a pressing input, a sliding input, etc. for the first sharing button.
- a list of sharing target applications is displayed on the user interface, and the list of sharing target applications includes a first application option.
- the second input of the first sharing input includes a click input, a pressing input, a sliding input, etc. for the first application option.
- sharing the video and the at least one screenshot in the first application corresponding to the first application option In response to a second input of the first sharing input, sharing the video and the at least one screenshot in the first application corresponding to the first application option.
- the first sharing input before receiving the first input of the first sharing input, there is no need to display the first application option on the user interface of the electronic device, especially in the case of a large number of application options, which makes the user interface more concise.
- dividing the first sharing input into a first input and a second input can provide users with more opportunities to consider when deciding which application to share the video and multiple screenshots with.
- FIG. 5 is a schematic diagram illustrating a user interface 500 for editing a displayed video and multiple screenshots according to an exemplary embodiment of the present disclosure.
- the method may further include: receiving a selection input for one or more of the thumbnail of the video and the thumbnails of the multiple screenshots; in response to the selection input, selecting all The one or more thumbnails; and again in response to the selection input, the one or more thumbnails are no longer selected.
- the selection input for the thumbnail of the video may include a click input, a press input, etc. for the thumbnail of the video.
- the selection input for one or more of the thumbnails of the plurality of screenshots may include a click input, a press input, a sliding input, etc., for the one or more thumbnails.
- the selecting the one or more thumbnails in response to the selected input may include determining a sliding path of the sliding input on the user interface, and determining the sliding The thumbnails passed by the path, and the thumbnails passed by the sliding path are selected as one or more thumbnails.
- the selected one or more thumbnails may be highlighted.
- a check mark may be displayed on the selected one or more thumbnails. For example, as shown in FIG. 5, if the thumbnail of screenshot 5 and the thumbnail of screenshot 7 are selected, a check mark is displayed on the thumbnail of screenshot 5 and the thumbnail of screenshot 7 as a check mark 532.
- a bold border may be displayed around the selected thumbnail or thumbnails.
- the selected thumbnail or thumbnails may be slightly enlarged. According to some examples, the brightness of the selected one or more thumbnails can be increased.
- the selected thumbnail or thumbnails may no longer be highlighted.
- the check mark may no longer be displayed.
- the check mark as the check mark 532 is no longer displayed.
- the bold border around the selected thumbnail or thumbnails may no longer be displayed.
- one or more thumbnails displayed slightly enlarged may be reduced to the size before the enlargement.
- the brightness of one or more thumbnails whose brightness is increased may be reduced to the brightness before the brightness is increased.
- the method may further include: when the one or more thumbnails are selected, receiving a second save input for a second save button displayed on the user interface of the electronic device; and responding to The second saving input is to store the screenshots and/or videos corresponding to the selected one or more thumbnails in the multiple screenshots and/or the videos to the screenshot folder and/or video folder .
- the second save button may be displayed when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed.
- the second save button cannot receive a second save input.
- the second save button cannot receive a second save input, and when one or more thumbnails are selected, all The second save button is configured to receive a second save input. For example, when the second save button is in a state where it can receive the second save input, it can be displayed normally; and when the second save button is in a state where it cannot receive the second save input, it can be grayed out.
- the second save button 548 may be displayed when the one or more thumbnails are selected.
- an edit frame 540 is displayed on the video screenshot card 510.
- the upper edge of the edit frame 540 may be located above the top row of thumbnails in the selected one or more thumbnails, and the lower edge of the edit frame 540 may be located at the bottom row of the selected one or more thumbnails Below the thumbnail. In this way, the spatial extent of the selected thumbnail or thumbnails can be better displayed.
- the second save button 548 is displayed on the upper edge of the edit frame 540, of course, the present disclosure is not limited to this.
- the second save input for the second save button displayed on the user interface of the electronic device may include a click input, a press input, etc. for the second save button.
- the user can select his favorite videos and/or screenshots from the thumbnail of the video and the thumbnails of the multiple screenshots, and save these videos and/or screenshots separately To the video folder and/or screenshot folder.
- the method may further include: when the one or more thumbnails are selected, receiving a second share button 546 and a second application option displayed on the user interface of the electronic device. 2. Sharing input, wherein the second application option corresponds to the second application; in response to the second sharing input, combine the multiple screenshots and/or the video with the selected one or more The screenshots and/or videos corresponding to the two thumbnails are shared to the second application.
- various display timings of the second share button for example, when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed, when one or more thumbnails are selected, etc.
- the display position For example, display on the user interface, display on the video screenshot card, display on the edit frame, etc.
- display method for example, can receive the second sharing input (normal display), not receive the second sharing input (grayed out) Etc.) It can be the same or similar to the second save button that has been described in detail above, and will not be repeated here.
- the second sharing input for the second sharing button and the second application option displayed on the user interface of the electronic device may include a click input, a press input, etc. for the second sharing button.
- various input modes of the second sharing input for example, directly displaying the second application option, or in response to the first input of the second sharing input displaying a list of sharing target applications including the second application option, and
- the screenshot corresponding to the selected one or more thumbnails is shared to the second application corresponding to the second application option) with the first sharing that has been described in detail above
- the inputs can be the same or similar, so I won’t repeat them here.
- the user can select their favorite videos and/or screenshots from the thumbnail of the video and the thumbnails of the multiple screenshots, and share these videos and/or screenshots together To the second application.
- the method may further include: when the one or more thumbnails are selected, receiving a puzzle input 542 for a puzzle button displayed on a user interface of the electronic device; and responding to the puzzle Input to generate a mosaic image of one or more screenshots corresponding to the selected one or more thumbnails among the plurality of screenshots, wherein the mosaic image spatially includes the selected one or the selected one or One or more screenshots corresponding to multiple thumbnails.
- various display timings of the puzzle button for example, when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed, when one or more thumbnails are selected, etc.
- the display position for example, , Displayed on the user interface, displayed on the video screenshot card, displayed on the editing frame, etc.
- display methods for example, can receive puzzle input (normal display), can not receive puzzle input (grayed), etc.
- the collage button can receive a collage input, and in response to the collage input, the thumbnail of the selected video is ignored , And only generate a mosaic of one or more screenshots corresponding to the selected one or more thumbnails.
- the puzzle input for the puzzle button displayed on the user interface of the electronic device may include click input, press input, etc. for the puzzle button.
- the mosaic is a picture, which spatially includes one or more screenshots corresponding to all the selected one or more thumbnails.
- One or more screenshots can be arranged in the mosaic in any manner.
- the generating a mosaic of one or more screenshots corresponding to the selected one or more thumbnails among the plurality of screenshots may include: determining the number of selected thumbnails; and if If the number is equal to one, then a screenshot corresponding to a selected thumbnail will be used as the mosaic; if the number is an odd number greater than one, then the images corresponding to the selected multiple thumbnails will be arranged in any row
- the mosaic image is generated by a screenshot of one of the multiple screenshots and two screenshots of the multiple screenshots corresponding to the selected multiple thumbnails are arranged in each row of the remaining rows; if the number is an even number, it will be based on each row.
- the mosaic image is generated by arranging two of the multiple screenshots corresponding to the selected multiple thumbnails.
- the number of selected thumbnails is an odd number greater than 1, one screenshot may be arranged in the first row, and two screenshots may be arranged in each row in the remaining rows.
- the number of selected thumbnails is three, three screenshots can be arranged in the font of " ⁇ ".
- the present disclosure is not limited to this.
- the screenshots corresponding to the selected multiple thumbnails may also be arranged in various shapes such as circles and hearts.
- the user can select screenshots representing several key steps in the teaching demonstration operation, and stitch these screenshots into a mosaic.
- the user can show the essence of their teaching demonstration operations without having to watch the entire recorded video in full.
- the method may further include: when the one or more thumbnails are selected, receiving an animation input for the animation button 544 displayed on the user interface of the electronic device; and responding to the animation button 544 displayed on the user interface of the electronic device;
- the animation input is used to generate an animation showing one or more screenshots corresponding to the selected one or more thumbnails at a certain frequency, wherein the animation includes the same time as the selected one or more One or more screenshots corresponding to or multiple thumbnails.
- various display timings for example, when the thumbnail of the video and the thumbnails of the multiple screenshots are displayed, when one or more thumbnails are selected, etc.
- the display position For example, display on the user interface, display on the video screenshot card, display on the editing frame, etc.
- display methods for example, can receive animation input (normal display), cannot receive animation input (grayed), etc.
- the second save button that has been described in detail above is similar and will not be repeated here.
- the animation button when one or more thumbnails are selected, it is determined whether the selected one or more thumbnails includes a thumbnail of the video. According to some examples, if the selected one or more thumbnails include a video thumbnail, the animation button cannot receive animation input. According to other examples, regardless of whether the selected one or more thumbnails includes a video thumbnail, the animation button can receive animation input, and in response to the animation input, the selected video is ignored Thumbnails, and only one or more screenshots corresponding to the selected one or more thumbnails are generated.
- the animation input for the animation button displayed on the user interface of the electronic device may include a click input, a press input and the like for the animation button.
- one or more screenshots corresponding to all selected one or more thumbnails are continuously played at a certain frame rate to generate a moving picture.
- An animated picture is a picture, which can be a gif format animated picture, which includes one or more screenshots corresponding to all the selected one or more thumbnails in time.
- a user when a user is recording a movie, he can select multiple screenshots representing key scenes and key plots in the movie, and use these screenshots to generate animations. Through this animated picture with a playing time much shorter than the movie time, the user can show the key scenes and key plots in the movie without having to watch the entire recorded movie in its entirety.
- the recording time may be relatively long, and the number of screenshots obtained is relatively large. At this time, one or more screenshots can be automatically recommended for the user based on certain criteria.
- the method may further include: evaluating the plurality of screenshots based on preset rules to obtain a score associated with each of the plurality of screenshots; The associated score is compared with a score threshold; and one or more screenshots of the plurality of screenshots with a score greater than or equal to the score threshold are highlighted on the user interface of the electronic device.
- the score threshold may be fixed.
- the score threshold may be set in advance by the user or set by default by the system.
- the score threshold may be variable.
- the maximum value of the scores associated with each screenshot is taken, and a certain percentage (less than 1) of the maximum value is used as the score threshold, such as 90%, 95%, 97%, and so on.
- the scores associated with each screenshot are sorted, and the score with the Nth highest score is used as the score threshold, and N is, for example, 1, 2, 3, 5, and so on.
- one or more screenshots with a score greater than or equal to the score threshold may be highlighted in various ways. For example, a star mark may be displayed on one or more thumbnails of one or more screenshots with a score greater than or equal to the score threshold. For another example, one or more thumbnails of one or more screenshots with a score greater than or equal to the score threshold may be displayed in blinking.
- the preset rule may include at least one of the following: whether there is a human face in the screenshot, the completeness of the human face in the screenshot, the resolution of the screenshot, and the sharpness of the screenshot.
- the score of a screenshot with a human face in the screenshot is higher than a score of a screenshot with no human face in the screenshot.
- the score of the screenshot with high integrity of the face existing in the screenshot is higher than the score of the screenshot with low integrity of the face existing in the screenshot.
- a screenshot with a high resolution score is higher than a screenshot with a low resolution score.
- the score with high sharpness of the screenshot is higher than the score with low sharpness of the screenshot.
- each item in the preset rule may be assigned an associated specific weight, and the item score of each item may be multiplied by the associated specific weight and summed to obtain the score of the screenshot.
- buttons on the user interfaces 400A, 400B, and 500 and their corresponding functions will be described in conjunction with FIGS. 4A, 4B, and 5.
- thumbnails of the multiple screenshots may be selected in response to input to the select all buttons 412A, 412B, 512 (eg, click input, press input, etc.).
- the thumbnail of the video and the thumbnails of the multiple screenshots may no longer be selected in response to an input to the exit selection button 550 shown in FIG.
- one or more thumbnails may no longer be selected.
- the exit screen capture function in response to input (for example, click input, press input, etc.) for the close buttons 413A, 413B, and 513 shown in FIGS. 4A, 4B, and 5, the exit screen capture function may be turned off.
- audio information associated with the user interface of the electronic device may be recorded synchronously.
- the method may further include: in response to meeting the recording start condition, during the recording of the user interface of the electronic device, collecting audio information associated with the electronic device, wherein the audio information is at time The axis corresponds to the video.
- the audio information associated with the electronic device may include audio information externally played through an audio output device of the electronic device.
- the audio information associated with the electronic device may include audio information acquired through an audio input device (for example, a microphone).
- the audio information associated with the electronic device may also include audio information directly obtained from the underlying hardware of the electronic device.
- the audio information associated with the electronic device may also include a combination of two or more of the aforementioned various audio information associated with the electronic device.
- audio information may be extracted from the obtained video associated with the user interface of the electronic device after stopping the recording of the user interface of the electronic device.
- the method may further include: recognizing and obtaining text information corresponding to the audio information on a time axis in real time; and adding the text information to the video and/or the video according to the time axis.
- the text information can be displayed simultaneously with the video and/or the multiple screenshots.
- the way based on the time axis can make the audio information and the video have a one-to-one correspondence at the same time. For example, if the current user interface is displaying a movie, and audio information can be obtained at the same time when recording the screen. In this way, during playback, the video and audio information can be combined according to the time axis, so that the user can not only watch the screen of the movie displayed on the user interface, but also listen to the sound corresponding to the displayed movie.
- textual information corresponding to video and audio information on the time axis can be recognized in real time. For example, if the current user interface is displaying a movie, and the audio information is obtained at the same time when the screen is recorded, real-time recognition is performed and text information is obtained. In this way, during playback, the video and text information can be combined according to the time axis, so that when it is inconvenient to make a sound, or when the user is a hearing impaired, the screen of the movie displayed on the user interface can be viewed. , And can display real-time subtitles corresponding to the movie.
- the time axis-based approach can enable audio information, text information, and video to have a one-to-one correspondence at the same time. For example, if the current user interface is displaying a movie, and the audio information is obtained at the same time when the screen is recorded, real-time recognition is performed and text information is obtained. In this way, when playing, the video, audio information and text information can be combined according to the time axis, so that the user can watch the screen of the movie, the sound corresponding to the screen, and the real-time subtitles corresponding to the sound at the same time.
- audio information can be obtained at the same time and text information corresponding to the audio information can be recognized in real time.
- a thumbnail of the audio information corresponding to the audio information may be displayed in the video screenshot card as described above.
- the audio information in response to a playback input for a thumbnail of the audio information (for example, a click input for a play button displayed on the thumbnail of the audio information, a press input for a thumbnail of the audio information Etc.), the audio information can be played.
- the audio information in response to the first saving input described above, in addition to saving the video to the video folder and saving the multiple screenshots to the screenshot folder, the audio information may also be saved To the audio folder.
- the audio information in response to the first sharing input described above, in addition to sharing the video and the multiple screenshots to the first application, the audio information may also be shared to the first application. application.
- the second aspect of the present disclosure may include an apparatus for operating an electronic device.
- FIG. 6 is a structural block diagram showing an apparatus for operating an electronic device according to an exemplary embodiment of the present disclosure.
- the apparatus 600 for operating an electronic device may include: a determining unit 601, configured to determine whether a screenshot start condition is satisfied; and a screenshot unit 602, configured to automatically perform an automatic operation on the user interface of the electronic device. Take screenshots to obtain multiple screenshots associated with the user interface of the electronic device; and the stopping unit 603 is configured to stop taking screenshots of the user interface of the electronic device in response to determining that the screenshot stopping condition is satisfied.
- the apparatus 600 for operating an electronic device may further include a unit configured to perform other steps of any of the foregoing methods.
- each unit or each feature of the exemplary apparatus for operating an electronic device in the present disclosure may refer to the specific implementation of the corresponding feature in the foregoing exemplary method for operating an electronic device in the present disclosure. So I won't repeat it.
- the units involved in describing the exemplary apparatus for operating an electronic device of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Among them, the name of the unit does not constitute a limitation on the unit itself under certain circumstances.
- each unit of the exemplary apparatus for operating an electronic device of the present disclosure may be at least partially performed by one or more hardware logic components.
- exemplary types of hardware logic components include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
- the third aspect of the present disclosure may include an electronic device that may include a processor; and a memory storing a program, the program including instructions that when executed by the processor cause the processor to execute Any of the foregoing methods.
- the fourth aspect of the present disclosure may include a storage medium storing a program, the program including instructions that, when executed by a processor of an electronic device, cause the electronic device to perform any of the foregoing methods.
- the fifth aspect of the present disclosure may include a computer program product including a program, the program including code that, when executed by a processor of an electronic device, causes the electronic device to perform any of the foregoing methods.
- FIG. 7 shows a schematic structural diagram of an electronic device 700 (for example, the electronic device in the present disclosure) suitable for implementing the embodiments of the present disclosure.
- the electronic device shown in FIG. 7 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
- the electronic device 700 may include a processing device (such as a central processing unit, a graphics processor, etc.) 701, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 702 or from a storage device 706
- the program in the memory (RAM) 703 executes various appropriate actions and processing.
- various programs and data required for the operation of the electronic device 700 are also stored.
- the processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704.
- An input/output (I/O) interface 705 is also connected to the bus 704.
- the following devices can be connected to the I/O interface 705: including input devices 706 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCD), speakers, vibrations
- input devices 706 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.
- LCD liquid crystal displays
- An output device 707 such as a device
- a storage device 706 such as a magnetic tape, a hard disk, etc.
- the communication device 709 may allow the electronic device 700 to perform wireless or wired communication with other devices to exchange data.
- FIG. 7 shows an electronic device 700 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may alternatively be implemented or provided with more or fewer devices.
- the process described above with reference to the flowchart can be implemented as a computer software program.
- the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart.
- the computer program may be downloaded and installed from the network through the communication device 709, or installed from the storage device 706, or installed from the ROM 702.
- the processing device 701 the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
- the aforementioned storage medium in the present disclosure may be a computer-readable storage medium.
- the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
- the computer-readable signal medium may send, propagate or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
- the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
- examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any Networks currently known or developed in the future.
- LAN local area networks
- WAN wide area networks
- Internet e.g., the Internet
- end-to-end networks e.g., ad hoc end-to-end networks
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
- the aforementioned computer-readable medium carries one or more programs.
- the electronic device determines whether the screenshot start condition is satisfied; in response to determining that the screenshot start condition is satisfied, recording The user interface of the electronic device to obtain a video associated with the user interface of the electronic device; during the recording of the user interface of the electronic device, an automatic screenshot of the user interface of the electronic device is taken to obtain the video associated with the user interface of the electronic device.
- the computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or a combination thereof.
- the above-mentioned programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages.
- the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
- the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).
- LAN local area network
- WAN wide area network
- each block in the flowchart or block diagram may represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions.
- the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.
- each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.
- a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device.
- the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- the machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing.
- machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
- RAM random access memory
- ROM read-only memory
- EPROM or flash memory erasable programmable read-only memory
- CD-ROM compact disk read only memory
- magnetic storage device or any suitable combination of the foregoing.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (47)
- 一种用于操作电子设备的方法,包括:确定是否满足截图开始条件;响应于确定满足所述截图开始条件,对所述电子设备的用户界面进行自动截图,以获得与所述电子设备的用户界面相关联的多个截图;以及响应于确定满足截图停止条件,停止对所述电子设备的用户界面进行自动截图。
- 根据权利要求1所述的方法,其中,所述确定是否满足所述截图开始条件包括:响应于接收针对所述电子设备的用户界面的自动截图指示输入,确定满足所述截图开始条件。
- 根据权利要求1所述的方法,还包括:接收针对所述电子设备的用户界面的自动截图指示输入,其中,所述确定是否满足截图开始条件包括:确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是否为应用程序窗口;响应于确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的是应用程序窗口,确定所述应用程序窗口是否允许被截图;以及响应于确定所述应用程序窗口允许被截图,确定满足所述截图开始条件。
- 根据权利要求3所述的方法,其中,所述确定是否满足截图开始条件还包括:响应于确定所述电子设备的用户界面在接收到所述自动截图指示输入时显示的不是应用程序窗口,确定满足所述截图开始条件。
- 根据权利要求2至4中任一项所述的方法,其中,所述接收针对所述电子设备的用户界面的自动截图指示输入包括:接收针对所述电子设备的用户界面的功能菜单呼出输入;响应于接收到所述功能菜单呼出输入,在所述电子设备的用户界面上显示功能选择菜单,其中,所述功能选择菜单包括录屏截图功能选项;以及接收针对所述录屏截图功能选项的选择。
- 根据权利要求1所述的方法,还包括:接收针对所述电子设备的用户界面的自动截图指示输入,其中,所述确定是否满足截图开始条件包括:获取所述自动截图指示输入在所述电子设备的用户界面上的位置;确定所述电子设备的用户界面在所述位置处是否属于文字可提取区域;以及响应于确定所述电子设备的用户界面在所述位置处不属于文字可提取区域,确定满足所述截图开始条件。
- 根据权利要求6所述的方法,其中,所述接收针对所述电子设备的用户界面的自动截图指示输入包括:接收针对所述电子设备的用户界面的功能菜单呼出输入;响应于接收到所述功能菜单呼出输入,在所述电子设备的用户界面上显示功能选择菜单,其中,所述功能选择菜单包括录屏截图功能选项;以及接收针对所述录屏截图功能选项的选择。
- 根据权利要求7所述的方法,其中,所述获取所述自动截图指示输入在所述电子设备的用户界面上的位置包括:获取所述功能菜单呼出输入在所述电子设备的用户界面上的位置。
- 根据权利要求6所述的方法,还包括:响应于确定所述电子设备的用户界面在所述位置处属于文字可提取区域,在所述电子设备的用户界面上显示功能选择菜单,其中,所述功能选择菜单包括录屏截图功能选项;接收针对所述录屏截图功能选项的选择;以及响应于接收到针对所述录屏截图功能选项的选择,确定满足所述截图开始条件。
- 根据权利要求1所述的方法,其中,所述对所述电子设备的用户界面进行自动截图包括:以预设时间间隔对所述电子设备的用户界面进行自动截图。
- 根据权利要求1所述的方法,其中,所述对所述电子设备的用户界面进行自动截图包括:实时获取对所述电子设备的用户界面进行自动截图的已经过时间;以及基于实时获取的已经过时间,动态地调整对所述电子设备的用户界面进行自动截图的时间间隔。
- 根据权利要求11所述的方法,其中,所述基于实时获取的已经过时间,动态地调整对所述电子设备的用户界面进行自动截图的时间间隔包括:当实时获取的已经过时间处于第一范围中时,以第一时间间隔对所述电子设备的用户界面进行自动截图;以及当实时获取的已经过时间处于第二范围中时,以第二时间间隔对所述电子设备的用户界面进行自动截图,其中,所述第一范围中的值均小于所述第二范围中的值,所述第一时间间隔小于所述第二时间间隔。
- 根据权利要求12所述的方法,其中,所述第二时间间隔是所述第一时间间隔的N倍,N是大于1的正整数,并且所述方法还包括:当实时获取的已经过时间处于第二范围中时,在已经过时间曾处于第一范围的状态下已获得的与电子设备的用户界面相关联的每N个截图中保留一个截图而删除其他截图。
- 根据权利要求1所述的方法,还包括:响应于确定满足所述截图开始条件,录制所述电子设备的用户界面,以获得与所述电子设备的用户界面相关联的视频;以及响应于确定满足所述截图停止条件,停止录制所述电子设备的用户界面。
- 根据权利要求14所述的方法,还包括:响应于确定所述自动截图指示输入满足所述截图开始条件,在所述电子设备的用户界面上显示录屏窗口,其中,所述录屏窗口指示所述电子设备的用户界面正在被录屏。
- 根据权利要求14所述的方法,其中,所述对所述电子设备的用户界面进行自动截图包括:在对所述电子设备的用户界面进行自动截图期间,不对所述录屏窗口进行自动截图,并且所述录制所述电子设备的用户界面包括:在录制所述电子设备的用户界面期间,不录制所述录屏窗口。
- 根据权利要求16所述的方法,其中,所述不对所述录屏窗口进行自动截图和/或所述不录制所述录屏窗口包括:将所述录屏窗口的截取属性调整为不可截取;在开始对所述电子设备的用户界面进行自动截图和/或开始录制电子设备的用户界面时,读取并接收所述录屏窗口的截取属性;以及响应于接收到所述录屏窗口的截取属性为不可截取,在对所述电子设备的用户界面进行自动截图期间不对所述录屏窗口进行自动截图和/或在录制所述电子设备的用户界面期间不录制所述录屏窗口。
- 根据权利要求17所述的方法,其中,在所述电子设备的用户界面上显示录屏窗口包括:将电子设备的用户界面实时渲染在用户界面视图控件上;以及将所述用户界面视图控件设置在所述录屏窗口中,以在所述录屏窗口中实时显示所述电子设备的用户界面的缩略图。
- 根据权利要求14所述的方法,还包括:在对所述电子设备的用户界面进行自动截图期间,确定所述电子设备的用户界面是否正在显示与视频播放应用程序对应的视频播放应用程序窗口,其中所述视频播放应用程序窗口包括视频播放区域,其中,所述对所述电子设备的用户界面进行自动截图包括:响应于确定所述电子设备的用户界面正在显示所述视频播放应用程序窗口,仅对所述视频播放区域进行截图,并且所述录制所述电子设备的用户界面包括:响应于确定所述电子设备的用户界面正在显示所述视频播放应用程序窗口,仅录制所述视频播放区域。
- 根据权利要求19所述的方法,其中,所述对所述电子设备的用户界面进行自动截图和/或所述仅录制所述视频播放区域包括:确定所述视频播放区域在所述电子设备的用户界面上的位置;以及基于所述视频播放区域在所述电子设备的用户界面上的位置,对所述视频播放区域进行截图和/或录制所述视频播放区域。
- 根据权利要求20所述的方法,其中,所述确定所述视频播放区域在所述电子设备的用户界面上的位置包括:检测所述视频播放区域的边框;以及基于所述视频播放区域的边框,将所述边框内部的区域确定为所述视频播放区域。
- 根据权利要求20所述的方法,其中,所述确定所述视频播放区域在所述电子设备的用户界面上的位置包括:获取所述电子设备的分辨率;确定与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序;以及基于所获取的所述电子设备的分辨率和所确定的与所述电子设备的用户界面正在显示的视频播放应用程序窗口对应的视频播放应用程序,确定所述视频播放区域在所述电子设备的用户界面上的位置。
- 根据权利要求1所述的方法,还包括:实时获取对所述电子设备的用户界面进行自动截图的已经过时间;以及当实时获取的已经过时间等于停止阈值时间时,确定满足所述截图停止条件。
- 根据权利要求23所述的方法,其中,所述停止阈值时间由用户预先设置或者由所述电子设备的系统默认设置。
- 根据权利要求1所述的方法,还包括:接收针对所述电子设备的用户界面的截图停止输入;以及响应于所述截图停止输入,确定满足所述截图停止条件。
- 根据权利要求14所述的方法,还包括:在停止对所述电子设备的用户界面进行截图并且停止录制所述电子设备的用户界面之后,在所述电子设备的用户界面上显示所述多个截图的缩略图和所述视频的缩略图。
- 根据权利要求26所述的方法,还包括:确定截图停止方向,所述截图停止方向是在停止对所述电子设备的用户界面进行截图并且停止录制所述电子设备的用户界面的时刻的所述电子设备的朝向;以及基于所述截图停止方向,在所述电子设备的用户界面上显示所述多个截图的缩略图和所述视频的缩略图。
- 根据权利要求26所述的方法,还包括:接收针对所述多个截图中的第一截图的缩略图的显示输入;以及响应于所述显示输入,在所述电子设备的用户界面上全屏显示所述第一截图;接收针对所述视频的缩略图的播放输入;以及响应于所述播放输入,在所述电子设备的用户界面上全屏播放所述视频。
- 根据权利要求26所述的方法,还包括:接收针对在所述电子设备的用户界面显示的第一保存按钮的第一保存输入;以及响应于所述第一保存输入,将所述多个截图存储至截图文件夹,并且将所述视频存储至视频文件夹。
- 根据权利要求26所述的方法,还包括:接收针对在所述电子设备的用户界面上显示的第一分享按钮和第一应用程序选项的第一分享输入,其中所述第一应用程序选项对应于第一应用程序;以及响应于所述第一分享输入,将所述多个截图和所述视频分享至所述第一应用程序。
- 根据权利要求26所述的方法,还包括:接收针对所述视频的缩略图和所述多个截图的缩略图中的一个或多个缩略图的选中输入;响应于所述选中输入,选中所述一个或多个缩略图;以及再次响应于所述选中输入,不再选中所述一个或多个缩略图。
- 根据权利要求31所述的方法,还包括:在选中所述一个或多个缩略图时,接收针对在所述电子设备的用户界面上显示的第二保存按钮的第二保存输入;以及响应于所述第二保存输入,将所述多个截图和/或所述视频中与被选中的所述一个或多个缩略图对应的截图和/或视频存储至截图文件夹和/或视频文件夹。
- 根据权利要求31所述的方法,还包括:在选中所述一个或多个缩略图时,接收针对在所述电子设备的用户界面上显示的第二分享按钮和第二应用程序选项的第二分享输入,其中所述第二应用程序选项对应于第二应用程序;以及响应于所述第二分享输入,将所述多个截图和/或所述视频中与被选中的所述一个或多个缩略图对应的截图和/或视频分享至所述第二应用程序。
- 根据权利要求31所述的方法,还包括:在选中所述一个或多个缩略图时,接收针对在所述电子设备的用户界面上显示的拼图按钮的拼图输入;以及响应于所述拼图输入,生成所述多个截图中与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图,其中,所述拼接图在空间上包括与被选中的所述一个或多个缩略图对应的一个或多个截图。
- 根据权利要求34所述的方法,其中,所述生成所述多个截图中与被选中的所述一个或多个缩略图对应的一个或多个截图的拼接图包括:确定被选中的缩略图的数量;以及如果所述数量等于一,则将与被选中的一个缩略图对应的一个截图作为所述拼接图;如果所述数量为大于一的奇数,则按照任一行布置与被选中的多个缩略图对应的多个截图中的一个截图且其余行每行布置与被选中的多个缩略图对应的多个截图中的两个截图的方式生成所述拼接图;如果所述数量为偶数,则按照每行布置与被选中的多个缩略图对应的多个截图中的两个截图的方式生成所述拼接图。
- 根据权利要求31所述的方法,还包括:在选中所述一个或多个缩略图时,接收针对在所述电子设备的用户界面上显示的动图按钮的动图输入;以及响应于所述动图输入,生成以一定频率显示与被选中的所述一个或多个缩略图对应的一个或多个截图的动图,其中,所述动图在时间上包括与被选中的所述一个或多个缩略图对应的一个或多个截图。
- 根据权利要求26所述的方法,还包括:基于预设规则,对所述多个截图进行评价,以获得与所述多个截图中的每个截图相关联的得分;分别将与每个截图相关联的得分与得分阈值进行比较;以及在所述电子设备的用户界面上突出显示所述多个截图中得分大于或等于所述得分阈值的一个或多个截图。
- 根据权利要求37所述的方法,其中,所述预设规则包括以下各项中的至少一个:截图中是否存在人脸、截图中存在的人脸的完整度、截图的分辨率以及截图的锐度。
- 根据权利要求14所述的方法,还包括:响应于满足录音开始条件,在录制所述电子设备的用户界面期间,采集与所述电子设备相关联的音频信息,其中,所述音频信息在时间轴上与所述视频对应。
- 根据权利要求39所述的方法,还包括:实时识别并得到与所述音频信息在时间轴上对应的文字信息;以及按照时间轴将所述文字信息增加到所述视频和/或所述多个截图中,使得所述文字信息能够按照时间轴与所述视频一起播放和/或与所述多个截图一起显示。
- 根据权利要求1所述的方法,其中,在对所述电子设备的用户界面进行自动截图时,在所述电子设备的用户界面上不显示截图动画。
- 根据权利要求1所述的方法,其中,在对所述电子设备的用户界面进行自动截图时,所述电子设备不产生截图音效。
- 根据权利要求1所述的方法,其中,所述电子设备的用户界面是触敏用户界面。
- 一种用于操作电子设备的装置,包括:确定单元,被配置为确定是否满足截图开始条件;截图单元,被配置为对所述电子设备的用户界面进行自动截图,以获得与所述电子设备的用户界面相关联的多个截图;以及停止单元,被配置为响应于确定满足截图停止条件,停止对所述电子设备的用户界面进行截图。
- 根据权利要求44所述的装置,还包括:被配置为执行根据权利要求2至43中任一项所述的方法的步骤的单元。
- 一种电子设备,包括:处理器;以及存储程序的存储器,所述程序包括指令,所述指令在由所述处理器执行时使所述处理器执行根据权利要求1至43中任一项所述的方法。
- 一种存储程序的存储介质,所述程序包括指令,所述指令在由电子设备的处理器执行时,致使所述电子设备执行根据权利要求1至43中任一项所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/753,296 US11875023B2 (en) | 2019-10-31 | 2020-08-17 | Method and apparatus for operating user interface, electronic device, and storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911063011.3A CN110825289A (zh) | 2019-10-31 | 2019-10-31 | 操作用户界面的方法、装置、电子设备及存储介质 |
CN201911063011.3 | 2019-10-31 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021082639A1 true WO2021082639A1 (zh) | 2021-05-06 |
Family
ID=69552390
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/109452 WO2021082639A1 (zh) | 2019-10-31 | 2020-08-17 | 操作用户界面的方法、装置、电子设备及存储介质 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11875023B2 (zh) |
CN (1) | CN110825289A (zh) |
WO (1) | WO2021082639A1 (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113852756A (zh) * | 2021-09-03 | 2021-12-28 | 维沃移动通信(杭州)有限公司 | 图像获取方法、装置、设备和存储介质 |
CN114257770A (zh) * | 2021-11-16 | 2022-03-29 | 杭州迈杰教育科技有限公司 | 对课堂教学录制电脑画面的方法、电子设备和存储介质 |
EP4345650A4 (en) * | 2022-02-28 | 2024-10-09 | Honor Device Co Ltd | HUMAN-MACHINE INTERACTION METHOD AND APPARATUS AND ELECTRONIC DEVICE |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110825289A (zh) | 2019-10-31 | 2020-02-21 | 北京字节跳动网络技术有限公司 | 操作用户界面的方法、装置、电子设备及存储介质 |
CN111897473A (zh) * | 2020-07-28 | 2020-11-06 | 惠州Tcl移动通信有限公司 | 一种终端的信息提取方法、装置、存储介质及终端 |
CN112162805B (zh) * | 2020-09-23 | 2023-05-19 | 维沃移动通信有限公司 | 截图方法、装置和电子设备 |
CN113726953B (zh) * | 2021-08-31 | 2023-03-14 | 维沃移动通信有限公司 | 显示内容获取方法和装置 |
CN116708888A (zh) * | 2022-11-22 | 2023-09-05 | 荣耀终端有限公司 | 视频录制方法及相关装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104820549A (zh) * | 2015-04-15 | 2015-08-05 | 小米科技有限责任公司 | 社交应用消息的发送方法、装置及终端 |
CN105447900A (zh) * | 2014-07-04 | 2016-03-30 | 北京新媒传信科技有限公司 | 一种录制动画的方法和装置 |
CN107168625A (zh) * | 2017-06-05 | 2017-09-15 | 深圳市金立通信设备有限公司 | 一种截屏方法及终端 |
CN107682650A (zh) * | 2017-09-30 | 2018-02-09 | 咪咕动漫有限公司 | 一种图像处理方法及装置和存储介质 |
US20180255341A1 (en) * | 2015-11-25 | 2018-09-06 | Le Holdings (Beijing) Co., Ltd. | Method and Apparatus for Video Playback |
CN110825289A (zh) * | 2019-10-31 | 2020-02-21 | 北京字节跳动网络技术有限公司 | 操作用户界面的方法、装置、电子设备及存储介质 |
Family Cites Families (62)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6264198B1 (en) * | 1999-06-29 | 2001-07-24 | Rare Limited | Method, system and computer-readable medium for a moving video image jigsaw puzzle game |
JP2004266376A (ja) * | 2003-02-25 | 2004-09-24 | Matsushita Electric Ind Co Ltd | 映像合成装置 |
US7590942B2 (en) * | 2004-09-16 | 2009-09-15 | Novatech Llc | System, method and computer program product for documenting and managing execution of procedures in a graphical interface environment |
EP2115628A4 (en) * | 2007-01-29 | 2012-10-17 | Sony Online Entertainment Llc | SYSTEM AND METHOD FOR CREATING AUTOMATIC INPUTS FOR BLOGS, WEB PAGES OR FILE SHARING SITES BASED ON GAMING EVENTS |
WO2008103443A2 (en) * | 2007-02-22 | 2008-08-28 | Snipitron, Llc | Subject matter resource website |
US20090043646A1 (en) * | 2007-08-06 | 2009-02-12 | International Business Machines Corporation | System and Method for the Automated Capture and Clustering of User Activities |
US20120044137A1 (en) * | 2009-04-01 | 2012-02-23 | Chandar Kumar Oddiraju | Screen capture |
US9098313B2 (en) * | 2009-08-24 | 2015-08-04 | Kryon Systems Ltd. | Recording display-independent computerized guidance |
US9405558B2 (en) * | 2009-08-24 | 2016-08-02 | Kryon Systems Ltd. | Display-independent computerized guidance |
US8918739B2 (en) * | 2009-08-24 | 2014-12-23 | Kryon Systems Ltd. | Display-independent recognition of graphical user interface control |
US9554111B2 (en) * | 2010-03-08 | 2017-01-24 | Magisto Ltd. | System and method for semi-automatic video editing |
US8600824B2 (en) * | 2010-04-28 | 2013-12-03 | Verizon Patent And Licensing Inc. | Image-based product marketing systems and methods |
US8856215B2 (en) * | 2010-08-17 | 2014-10-07 | Comscore, Inc. | Detecting visible display of content |
US9141255B2 (en) * | 2010-12-21 | 2015-09-22 | Disney Enterprises, Inc. | Mosaic generation from user-created content |
US8847985B2 (en) * | 2010-12-30 | 2014-09-30 | International Business Machines Corporation | Protecting screen information |
US8874525B2 (en) * | 2011-04-19 | 2014-10-28 | Autodesk, Inc. | Hierarchical display and navigation of document revision histories |
US9606643B2 (en) * | 2011-05-02 | 2017-03-28 | Microsoft Technology Licensing, Llc | Extended above the lock-screen experience |
US20130053007A1 (en) * | 2011-08-24 | 2013-02-28 | Microsoft Corporation | Gesture-based input mode selection for mobile devices |
KR101919008B1 (ko) * | 2012-02-24 | 2018-11-19 | 삼성전자주식회사 | 정보 제공 방법 및 이를 위한 이동 단말기 |
US20130283318A1 (en) * | 2012-04-23 | 2013-10-24 | Comcast Cable Communications, LLC. | Dynamic Mosaic for Creation of Video Rich User Interfaces |
EP2680616A1 (en) * | 2012-06-25 | 2014-01-01 | LG Electronics Inc. | Mobile terminal and audio zooming method thereof |
US20140019865A1 (en) * | 2012-07-13 | 2014-01-16 | Whamix Inc. | Visual story engine |
US20160249106A1 (en) * | 2012-09-14 | 2016-08-25 | Appurify, Inc. | Remote Control of a Mobile Device |
WO2014056122A1 (en) * | 2012-10-08 | 2014-04-17 | Intel Corporation | Method, apparatus and system of screenshot grabbing and sharing |
US9407824B2 (en) * | 2012-11-01 | 2016-08-02 | Google Inc. | Multi-directional content capture on mobile devices |
US9658695B2 (en) * | 2012-11-08 | 2017-05-23 | Cuesta Technology Holdings, Llc | Systems and methods for alternative control of touch-based devices |
US9858271B2 (en) * | 2012-11-30 | 2018-01-02 | Ricoh Company, Ltd. | System and method for translating content between devices |
CN104035684A (zh) * | 2013-03-06 | 2014-09-10 | 腾讯科技(深圳)有限公司 | 一种应用于移动终端上的动态截屏方法及系统 |
US9230191B2 (en) * | 2013-03-15 | 2016-01-05 | Dropbox, Inc. | Presentation and organization of content |
US9495534B2 (en) * | 2013-03-26 | 2016-11-15 | International Business Machines Corporation | OCR-based single sign-on |
US10191964B2 (en) * | 2013-05-30 | 2019-01-29 | Microsoft Technology Licensing, Llc | Automatic isolation and selection of screenshots from an electronic content repository |
US20150106500A1 (en) * | 2013-10-14 | 2015-04-16 | Bank Of America Corporation | Application provisioning system |
US20150128017A1 (en) * | 2013-11-06 | 2015-05-07 | International Business Machines Corporation | Enabling interactive screenshots within collaborative applications |
US10002191B2 (en) * | 2013-12-31 | 2018-06-19 | Google Llc | Methods, systems, and media for generating search results based on contextual information |
US20150278180A1 (en) * | 2014-04-01 | 2015-10-01 | Project T, LLC | System and method for annotating webpages |
CN104978133A (zh) * | 2014-04-04 | 2015-10-14 | 阿里巴巴集团控股有限公司 | 一种用于智能终端的截屏方法和装置 |
US10290133B2 (en) * | 2014-09-26 | 2019-05-14 | Oracle International Corporation | High fidelity interactive screenshots for mobile applications |
US10255754B2 (en) * | 2015-01-12 | 2019-04-09 | Puzzup Llc | Methods and systems for interactive image sharing |
US10275341B2 (en) * | 2015-01-21 | 2019-04-30 | Somo Innovations Ltd | Mobile application usability testing |
US10380657B2 (en) * | 2015-03-04 | 2019-08-13 | International Business Machines Corporation | Rapid cognitive mobile application review |
EP3314482A4 (en) * | 2015-09-02 | 2018-05-23 | Samsung Electronics Co., Ltd. | Method and device of tagging links included in a screenshot of webpage |
US10068071B2 (en) * | 2015-09-09 | 2018-09-04 | Airwatch Llc | Screen shot marking and identification for device security |
US9916155B2 (en) * | 2015-12-01 | 2018-03-13 | International Business Machines Corporation | Projects browser for development environments |
US9699514B2 (en) * | 2015-12-02 | 2017-07-04 | Echostar Technologies L.L.C. | Apparatus, systems and methods for media mosaic management |
CN105549845B (zh) * | 2015-12-09 | 2019-03-26 | 惠州Tcl移动通信有限公司 | 一种基于移动终端的页面连续截图方法、系统及移动终端 |
US10200823B2 (en) * | 2015-12-09 | 2019-02-05 | Navico Holding As | Methods and apparatus for capturing data using a marine electronics device |
CN105653155B (zh) * | 2015-12-25 | 2019-04-26 | 百度在线网络技术(北京)有限公司 | 终端设备的控制方法及装置 |
US10249266B2 (en) * | 2016-02-29 | 2019-04-02 | Vmware, Inc. | Preserving desktop state across login sessions |
US10237621B2 (en) * | 2016-03-24 | 2019-03-19 | Dish Technologies Llc | Direct capture and sharing of screenshots from video programming |
US10463974B2 (en) * | 2016-07-07 | 2019-11-05 | Peter Selinger | Permutation game |
KR20180017746A (ko) * | 2016-08-10 | 2018-02-21 | 엘지전자 주식회사 | 이동 단말기 및 그 제어방법 |
EP3519950B1 (en) * | 2017-01-17 | 2020-11-04 | Google LLC | Assistive screenshots |
CN106970754B (zh) * | 2017-03-28 | 2020-09-08 | 北京小米移动软件有限公司 | 截屏处理的方法及装置 |
CN107247547A (zh) * | 2017-05-25 | 2017-10-13 | 北京小米移动软件有限公司 | 截图处理方法及装置 |
CN107194898A (zh) * | 2017-06-23 | 2017-09-22 | 携程计算机技术(上海)有限公司 | 酒店图像的展示方法、存储介质及酒店信息的推送方法 |
CN109040419B (zh) * | 2018-06-11 | 2021-01-12 | Oppo(重庆)智能科技有限公司 | 录屏方法、装置、移动终端及存储介质 |
CN110825278A (zh) * | 2018-08-07 | 2020-02-21 | 深圳富泰宏精密工业有限公司 | 电子设备及截屏方法 |
CN109120982A (zh) * | 2018-09-27 | 2019-01-01 | 惠州Tcl移动通信有限公司 | 一种视频播放界面图片存储方法、移动终端及存储介质 |
US10739935B2 (en) * | 2018-11-16 | 2020-08-11 | International Business Machines Corporation | Review of previously displayed content |
CN112292726B (zh) * | 2019-05-22 | 2022-02-22 | 谷歌有限责任公司 | 用于沉浸式环境中对象分组和操纵的方法、系统和介质 |
WO2021044601A1 (ja) * | 2019-09-05 | 2021-03-11 | ソニー株式会社 | アプリケーション拡張プログラム、情報処理装置、および方法 |
US11250536B2 (en) * | 2019-09-11 | 2022-02-15 | International Business Machines Corporation | Image capture prevention |
-
2019
- 2019-10-31 CN CN201911063011.3A patent/CN110825289A/zh active Pending
-
2020
- 2020-08-17 US US17/753,296 patent/US11875023B2/en active Active
- 2020-08-17 WO PCT/CN2020/109452 patent/WO2021082639A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105447900A (zh) * | 2014-07-04 | 2016-03-30 | 北京新媒传信科技有限公司 | 一种录制动画的方法和装置 |
CN104820549A (zh) * | 2015-04-15 | 2015-08-05 | 小米科技有限责任公司 | 社交应用消息的发送方法、装置及终端 |
US20180255341A1 (en) * | 2015-11-25 | 2018-09-06 | Le Holdings (Beijing) Co., Ltd. | Method and Apparatus for Video Playback |
CN107168625A (zh) * | 2017-06-05 | 2017-09-15 | 深圳市金立通信设备有限公司 | 一种截屏方法及终端 |
CN107682650A (zh) * | 2017-09-30 | 2018-02-09 | 咪咕动漫有限公司 | 一种图像处理方法及装置和存储介质 |
CN110825289A (zh) * | 2019-10-31 | 2020-02-21 | 北京字节跳动网络技术有限公司 | 操作用户界面的方法、装置、电子设备及存储介质 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113852756A (zh) * | 2021-09-03 | 2021-12-28 | 维沃移动通信(杭州)有限公司 | 图像获取方法、装置、设备和存储介质 |
CN113852756B (zh) * | 2021-09-03 | 2023-07-28 | 维沃移动通信(杭州)有限公司 | 图像获取方法、装置、设备和存储介质 |
CN114257770A (zh) * | 2021-11-16 | 2022-03-29 | 杭州迈杰教育科技有限公司 | 对课堂教学录制电脑画面的方法、电子设备和存储介质 |
EP4345650A4 (en) * | 2022-02-28 | 2024-10-09 | Honor Device Co Ltd | HUMAN-MACHINE INTERACTION METHOD AND APPARATUS AND ELECTRONIC DEVICE |
Also Published As
Publication number | Publication date |
---|---|
US20220326823A1 (en) | 2022-10-13 |
US11875023B2 (en) | 2024-01-16 |
CN110825289A (zh) | 2020-02-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021082639A1 (zh) | 操作用户界面的方法、装置、电子设备及存储介质 | |
US11822761B2 (en) | Shared-content session user interfaces | |
US11907605B2 (en) | Shared-content session user interfaces | |
CN110100251B (zh) | 用于处理文档的设备、方法和计算机可读存储介质 | |
CN108024079B (zh) | 录屏方法、装置、终端及存储介质 | |
CN112165632B (zh) | 视频处理方法、装置及设备 | |
JP6400293B2 (ja) | 電子装置でコンテンツを制御する装置及びその方法 | |
WO2016192325A1 (zh) | 视频文件的标识处理方法及装置 | |
KR20150077774A (ko) | 화면 전환 방법 및 그 장치 | |
CN112653920B (zh) | 视频处理方法、装置、设备及存储介质 | |
KR20230049691A (ko) | 비디오 처리 방법, 단말기 및 저장매체 | |
US20240320256A1 (en) | Method, apparatus, device, readable storage medium and product for media content processing | |
US9325776B2 (en) | Mixed media communication | |
JP4724242B2 (ja) | 電子機器および画像表示方法 | |
WO2019095815A1 (zh) | 界面展示方法及装置 | |
WO2022127524A1 (zh) | 视频会议呈现方法、装置、终端设备和存储介质 | |
CN113766275B (zh) | 视频剪辑方法、装置、终端及存储介质 | |
US20210377454A1 (en) | Capturing method and device | |
WO2019095811A1 (zh) | 界面展示方法及装置 | |
JP7549162B2 (ja) | 共有コンテンツセッションユーザインタフェース | |
JP7567076B2 (ja) | 共有コンテンツセッションユーザインタフェース | |
CN115348478B (zh) | 设备交互显示方法、装置、电子设备及可读存储介质 | |
JP2024054872A (ja) | 共有コンテンツセッションユーザインタフェース | |
CN118741207A (zh) | 界面交互方法、装置、电子设备和存储介质和程序产品 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20883056 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20883056 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.09.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20883056 Country of ref document: EP Kind code of ref document: A1 |