CN113938731A

CN113938731A - Screen recording method and display device

Info

Publication number: CN113938731A
Application number: CN202110534539.5A
Authority: CN
Inventors: 李玉倩; 付延松; 江新顺; 陈俊宁; 孟亚州
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-07-14
Filing date: 2021-05-17
Publication date: 2022-01-14
Also published as: CN113938724A

Abstract

The invention discloses a screen recording method and display equipment.A screen recording operation is not executed and video data played by a video playing interface is acquired if the current displayed interface type of a display is detected to be the video playing interface when a screen recording starting instruction is received; when a screen recording ending instruction is received, displaying first prompt information, wherein the first prompt information is used for prompting a user to execute target operation to edit a file generated by screen recording; displaying a time input box when a target operation is received; receiving a target time length input by a user in a time input bullet frame, and moving a screen recording starting time node forward by the length of the target time length on a playing time axis to obtain a target starting recording node; and intercepting the video data according to the target screen recording starting node and the screen recording ending time node to obtain a first target screen recording file. The method and the device can ensure the integrity of the screen recording file, enable the screen recording file to better meet the expectation of a user, avoid the repeated screen recording operation, and improve the accuracy and efficiency of screen recording.

Description

Screen recording method and display device

The present application claims priority of chinese patent application having application number 202010673819.X entitled "display device and screen recording sharing method" filed by chinese patent office on 14/07/2020, the entire contents of which are incorporated herein by reference.

Technical Field

The invention relates to the field of display equipment, in particular to a screen recording method and display equipment.

Background

In some application scenarios, a user may have a screen recording requirement when using a display device, for example, the user records a screen while performing a designated operation on the display device, so as to record an operation guide video, and for example, when the display device plays a video, the user may also record a part of highlights in the video through the screen recording, and share the recorded video file with a social application or send the video file to a friend.

However, the recorded video may not meet the user's expectations, for example, when the user watches the video, the user cannot pre-judge the highlight, the idea of generating a screen recording by the user in this scene is often random, and when the user watches a highlight, the user operates the remote controller to start the screen recording, and as a result, the recorded video may miss the initial highlight moment, so that the screen recording does not record the complete highlight, and the user experience is poor.

Disclosure of Invention

In order to solve the problems in the background art, the invention provides a screen recording method and a display device, wherein a screen recording start time node is moved forward by a target time length set by a user on a playing time axis, so that the starting time of recording is advanced, and the situation that a certain part of clips are missed to be recorded due to delay in starting the screen recording by the user is avoided.

A first aspect provides a display device comprising:

a display for displaying a user interface and playing a video;

a controller configured to perform:

when a screen recording starting instruction is received, if the interface type currently displayed by a display is detected to be a video playing interface, screen recording operation is not executed, and video data played by the video playing interface are acquired;

when a screen recording ending instruction is received, displaying first prompt information, wherein the first prompt information is used for prompting a user to execute target operation to edit a file generated by screen recording;

displaying a time input box when the target operation is received;

receiving a target time length input by a user in the time input bullet frame, and moving a screen recording starting time node forward by the length of the target time length on a playing time axis to obtain a target starting recording node;

and intercepting the video data according to the target screen recording starting node and the screen recording ending time node to obtain a first target screen recording file.

The screen recording method provided by the second aspect comprises the following steps:

displaying a time input box when the target operation is received;

According to the technical scheme, when the display device receives a screen recording starting instruction input by a user, a screen recording starting time node is recorded, the interface type currently displayed by the display is detected, wherein the interface type is a video playing interface, an application program interface, a homepage and the like, if the current interface type is detected to be the video playing interface, the video data currently played is obtained in advance according to a specified path/path, and the screen recording operation does not need to be executed because the video data is obtained in advance. When a screen recording ending instruction input by a user is received, recording a screen recording ending time node, displaying first prompt information on an interface to prompt the user to edit a file generated by a screen recording by executing target operation, inputting a popup frame at display time if the user inputs the target operation, and enabling the user to input target time length in the target input popup frame, wherein the target time length is the time length for moving the screen recording starting time node forwards. After receiving the target time length, the display device moves a screen recording start time node forward by the length of the target time length on a playing time axis of the current video data so as to locate a target screen recording start node adjusted by a user, then intercepts the video data according to the target screen recording start node and a screen recording end time node, an intercepted video clip is a first target screen recording file, and the first target screen recording file can be shared with social applications, friends and group chats after being generated.

According to the method and the device, the length of the target time length for moving the screen recording starting point forward can be set according to the target time length defined by the user, and the video clip which is possibly missed due to the delay of the operation of starting the screen recording by the user is contained in the time interval corresponding to the target time length, so that the completeness of the screen recording file is ensured, the screen recording file is more in line with the expectation of the user, the repeated screen recording operation is avoided, and the accuracy and the efficiency of the screen recording are improved.

Drawings

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

fig. 5 is a view schematically showing a display interface of a first generation screen recording file;

fig. 6 is a diagram illustrating an exemplary display interface of a second generation screen recording file;

fig. 7 is a diagram illustrating a display interface of a third generation screen recording file;

FIG. 8 is a diagram illustrating an exemplary display interface for generating a rejected screen-recorded file;

FIG. 9 is a diagram illustrating an exemplary display interface for a display pop-up float;

FIG. 10 illustrates an interface diagram showing a function menu;

FIG. 11 is an interface diagram illustrating screen recording time prompts;

FIG. 12 illustrates an interface diagram for screen saving/deleting;

FIG. 13 is a diagram illustrating a display interface with full memory;

FIG. 14 is a diagram illustrating a first preview interface;

FIG. 15 is a diagram illustrating a display interface of a time input bullet box;

FIG. 16 is a diagram illustrating an example of a play timeline;

FIG. 17 is a diagram illustrating a second preview interface;

FIG. 18 illustrates a UI change diagram after clicking on the finish control at the second preview interface;

FIG. 19 illustrates a change diagram of the UI after clicking on the re-edit control at the second preview interface;

FIG. 20 is a diagram illustrating an example of a target time period t when a user inputs_mGreater than a time threshold t_sDisplaying a UI interface schematic diagram of the fourth prompt message;

FIG. 21 is a diagram illustrating a UI for modifying the target duration after the user views the fourth prompting message;

FIG. 22 is a diagram illustrating a third preview interface;

FIG. 23 is a diagram illustrating a fourth preview interface;

fig. 24(a) is a UI diagram exemplarily showing a sharing screen file;

FIG. 24(b) is a schematic diagram illustrating a UI change after clicking on the share control of FIG. 24 (a);

fig. 25 illustrates a flow chart of a screen recording method.

Detailed Description

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data. .

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some application scenarios, a user may perform a screen recording operation on a display device, and the display device records and generates a video file with a certain duration, that is, a screen recording file, in response to a screen recording start instruction and a screen recording end instruction. The user can record the video clips interested by the user randomly when the display device plays the video, or record the operation video and the like when the application program (APP) installed in the display device is used, so that the interface types displayed by the display when the user records the screen are diversified and unlimited, and the interface types comprise a video playing interface, an application program interface, a homepage and the like.

In some embodiments, the display device may set and display a first screen recording control at a designated position of the interface, and a user performs a first preset operation on the first screen recording control through a remote controller to control the start and the end of screen recording. The first preset operation is not limited, for example, the first screen recording control is clicked to input a screen recording starting instruction, the first screen recording control is clicked again to input a screen recording ending instruction, for example, the first screen recording control is pressed for a long time to start screen recording, and screen recording is stopped after the first screen recording control is released.

In some embodiments, a user may input an operation instruction in a voice form through a voice control arranged on a display device, for example, the user may click the voice control and then speak "start recording screen", a sound collector collects the first voice information and then performs processing such as voice recognition and semantic analysis, and it is obtained that the user operation intention is to start recording screen, that is, the instruction to start recording screen is received; similarly, the user clicks the voice control and then speaks 'screen recording ending', the sound collector collects the second voice information and then carries out processing such as voice recognition and semantic analysis, the user operation intention is to record the screen finishing, and the user operation intention is to receive a screen recording ending instruction.

In some embodiments, a screen recording key may be set on the remote controller, where the screen recording key is equivalent to a shortcut key for a screen recording operation, and the user performs a second preset operation on the screen recording key, and the display device end receives the second preset operation, so as to trigger the screen recording program. The second preset operation is not limited, for example, the screen recording key is clicked to input a screen recording starting instruction, and the screen recording key is clicked again to input a screen recording ending instruction; for another example, if the display device receives a long-time pressing operation of the user on the screen recording key, the display device receives a screen recording starting instruction, the display device can be started to record the screen, and if the user looses his hand, the display device responds to a releasing operation of the user on the screen recording key, the display device receives a screen recording ending instruction, and the like. It should be noted that the input modes of the start screen recording instruction and the end screen recording instruction are not limited to those described in the embodiments of the present application.

In some embodiments, the display device 200 generally has a screenshot function, and a still picture can be obtained through a specific screenshot button. Optionally, a screenshot key is arranged on the remote controller, or a screenshot function is bound to a specific key in the remote controller, for example, a favorite key or a live key is bound to the screenshot function. When the display device 200 is normally turned on, the user may send a start instruction by pressing the screenshot button at any time, and the controller 250 performs screenshot or screen recording accordingly after receiving the start instruction.

In some embodiments, a preset start duration is set in the display device 200, and after the display device receives a start instruction sent by a user by pressing a screenshot button on a remote controller, the display device determines whether to perform screenshot according to the start instruction or to record a screen according to the start instruction by comparing the pressing duration of the screenshot button with the preset start duration. The pressing duration of the screenshot button refers to the duration between the time when the user presses the screenshot button and the time when the screenshot button is released.

In some embodiments, when the pressing duration of the screenshot button does not exceed the preset starting duration, a screenshot is generated for a display interface displayed by the display according to the starting instruction. For example, when the preset activation time is set to 300 ms, if the user wants to save the content currently displayed on the display 275 while watching a video through the display 275, the screenshot button can be pressed through the remote controller. When the user starts to press the screenshot button, a start instruction is already sent to the display device 200, and when the controller 250 determines that the pressing duration of the controller 250 does not exceed 300 milliseconds, that is, the user presses the screenshot button and releases the screenshot button within 300 milliseconds, it may be considered that the user only wants to keep the current display interface of the display 275, and at this time, the controller 250 captures the display interface displayed by the display 275 according to the start instruction and generates a screenshot image.

In some embodiments, when the pressing time of the screenshot button exceeds the preset starting time, the display interface displayed by the display is recorded according to the starting instruction and a screen recording file is generated. For example, when the preset activation time is set to 300 ms, when the user is watching a video through the display 275, if the user wants to record the currently played content, the screenshot button may be pressed and continuously pressed. When a user starts to press a screenshot button, a start instruction is already sent to the display device 200, after the controller 250 receives the start instruction, a screenshot is first taken on a display interface displayed by the display 275 and a screenshot image is generated, if the controller 250 judges that the pressing time exceeds 300 milliseconds, the user can be considered as that the user wants to record a screen, and at the moment, the controller 250 records the display interface displayed by the display 275 and generates a screen recording file.

In some embodiments, the controller 250 is further configured to obtain a person recognition result in the screen shot image, and control the display to display the person recognition result on the display interface.

In some embodiments, the display device 200 may generate a screen capture image first, and if the screen capture image is the screen capture image, continue to record the display interface based on the screen capture image, thereby generating a screen capture file. After receiving the start instruction input by the user, the display device 200 needs to feed back a part of data to the user, and the data is displayed through the display 275, so that the user can know that the display device 200 performs screen capture or screen recording.

In some embodiments, the controller 250 uploads the screen capture image to the server 400 after the screen capture image is acquired, and the server 400 responds to the screen capture image uploaded by the controller 250 and performs person identification on the screen capture image based on an image identification technology. The server 400 acquires the avatar thumbnail and the corresponding person identifier of the person in the image based on the screenshot image. For example, for the celebrity character of the movie star in the screenshot, the character identifier is the name of the character, such as wangkai, guo jingfei, etc. For the video recorded by the user, the character identification of the ordinary people in the screenshot can be the corresponding handsome boy, beautiful girl, grandmother, elementary school students and the like. The server 400 feeds back the acquired person recognition result, i.e., the avatar thumbnail of the person and the corresponding person identifier, to the display device 200, and the controller 250 controls the display 275 to show the corresponding person recognition result on the floating layer of the display interface.

In some embodiments, when the user presses the screenshot button, that is, sends a start instruction to the display device 200, the controller 250 first performs screenshot on the display interface currently displayed by the display according to the start instruction, and generates a screenshot image. The controller 250 starts timing while performing the screen capture operation, and determines the duration of pressing the screen capture button by the user. When the pressing time of the screenshot button exceeds the preset starting time, the controller 250 starts to record the display interface with the starting time of the received starting instruction as the starting point, that is, the controller 250 starts to record the display interface with the screenshot image as the starting frame.

In some embodiments, when the controller 250 starts recording the display interface with the start time when the start instruction is received as a start point, the display interface is controlled to display the second screen recording control.

Optionally, the user is prompted through the second screen recording control as to how long the recording is. Fig. 5 exemplarily shows a display interface diagram of the first generation of the screen recording file, and the upper left corner shows "00: 05 in screen recording", which means that the screen recording file has been recorded for 5 seconds.

Optionally, the user is prompted through a second screen recording control that the display device 200 is now in screen recording. Fig. 6 illustrates a display interface diagram of a second generated screen recording file, and fig. 7 illustrates a display interface diagram of a third generated screen recording file. The difference between the second screen recording control in fig. 6 and fig. 7 is that the screen recording control displayed in the upper left corner is "screen recording", and the user is prompted by the alternate appearance of the second screen recording control in two states, that is, by the alternate flashing of the second screen recording control in two states, that is, the display device 200 is currently in screen recording.

In some embodiments, the user records the screen by continuously pressing the screenshot button, and in the recording process, if the user finds that the recording of the clip that the user wants to record is completed, the user can stop recording the screen by releasing the screenshot button, that is, the user releases the screenshot button, which is equivalent to sending a screen recording ending instruction to the controller 250, and the controller 250 stops recording the current display interface of the display 275 after receiving the screen recording ending instruction, and generates a screen recording file.

In some embodiments, the user records the screen by continuously pressing the screenshot button, the controller 250 keeps timing during the recording process, and when the pressing duration of the screenshot button, that is, the recording duration of the screen recording file exceeds the preset upper limit, the controller 250 stops recording the current display interface of the display 275 and generates the screen recording file. The preset upper limit duration may be set to 60 seconds, for example, and may be set according to the size of the storage space of the display device, which is not limited herein.

In some embodiments, after the controller 250 starts recording the display interface with the start time when the start instruction is received as the start point, according to the timing of the controller 250, when the pressing duration does not exceed the preset lower limit duration, the recording of the display interface is stopped and an unqualified screen recording file is generated, where the unqualified screen recording file is a screen recording file generated in the pressing duration that does not exceed the preset lower limit duration. That is, after the user presses the screenshot button, the pressing time length exceeds the preset starting time length, the controller 250 starts to record the file, but the user releases the screenshot button later, the time length from the time when the screenshot button is pressed to the time when the screenshot button is released does not reach the preset lower limit time length, so that the recording time of the screen recording file is short, and the controller 250 generates an unqualified screen recording file after the recording of the display interface is stopped. For example, if the user presses the screen capture button for more than 300 milliseconds, the controller 250 starts recording the screen recording file, and when the pressing time reaches 2 seconds, the user releases the screen capture button, the controller stops recording the screen recording file at this time, and the generated screen recording file is regarded as an unqualified screen recording file.

In some embodiments, after the unqualified screen recording file is generated, the controller controls the display interface to display a first prompt box, and the first prompt box is used for indicating that the screen recording file is unqualified. Fig. 8 exemplarily shows a display interface diagram for generating a unqualified screen recording file, and optionally, a prompt message "recording screen cannot be played in a short time and needs to be recorded again" may be set in the first prompt box. Since the unqualified screen recording file cannot be played and has no reserved value, the controller 250 may delete the unqualified screen recording file to avoid occupying a storage space.

Above, through presetting time length of lower limit can avoid the user to want to carry out the screenshot originally, press the condition that time length has slightly exceeded the time length of presetting the start-up and carry out the mistake and record as a result. In addition, the situation that even if the user originally wants to record the screen, the screen recording file flashes once due to short screen recording time when the recording file is played at the later stage, so that the user mistakenly thinks that the display equipment has a playing fault can be avoided.

In some embodiments, in order to prevent that there is not enough storage space in the display apparatus 200 to store the screen recording file after the screen recording file is generated, the controller 250 needs to detect the storage space margin before starting screen recording. The display device 200 stores a preset margin, and the preset margin is greater than or equal to the size of the screen recording file generated under the preset upper limit duration. After detecting the storage space margin in the disk, the controller 250 compares the storage space margin with a preset margin. When the storage space allowance exceeds the preset allowance, namely the storage space allowance can also store at least one screen recording file generated under the preset upper limit duration, at the moment, recording a display interface according to the starting instruction and generating the screen recording file.

In some embodiments, when the margin of the storage space does not exceed the preset margin, if a history screen recording file is stored in the storage space, the history screen recording file is deleted, and the display interface is recorded according to the starting instruction and a screen recording file is generated. That is to say, when the controller 250 detects that the margin of the storage space is not enough to store a screen recording file generated under the preset upper limit duration, the controller 250 needs to further check the file stored in the storage space, and for a history screen recording file generated before, a user may already share the file and the meaning of continuing to store the history screen recording file is not great, so the controller 250 may delete the history screen recording file, so that the storage space in the disk is enough to store a new screen recording file. It should be noted that, when deleting the history screen recording file, the file may be deleted according to the chronological order, for example, the history screen recording file with the earliest recording time is deleted first.

In some embodiments, when the margin of the storage space does not exceed the preset margin, if the storage space does not store the history screen recording file, which indicates that the storage space cannot be released by deleting the history screen recording file, a second prompt box pops up, where the second prompt box is used to prompt a user that the storage space is full and the screen cannot be recorded. That is to say, when the controller 250 checks that the margin of the storage space cannot store one screen recording file generated under the preset upper limit duration, the controller 250 needs to further check the file stored in the storage space, if the storage space does not have a history screen recording file, the newly generated screen recording file cannot be stored in the display device 200, and the controller 250 prompts the user that the storage space is full and the screen recording cannot be performed through the second prompt box.

In some embodiments, after the controller 250 generates the screen recording file, the screen recording file is saved to a local storage space, i.e., a local disk. After the screen recording file is saved, a sharing control is generated according to a saving path of the screen recording file, and the sharing control is used for sharing the screen recording file.

In some embodiments, the controller 250 generates a character string according to the saving path of the screen recording file and the domain name of the display device, and further generates a two-dimensional code according to the character string, where the two-dimensional code serves as a sharing control for sharing the screen recording file. When a user wants to acquire the screen recording file from the display device 200, the user can scan the two-dimensional code through a mobile terminal with a camera, such as a mobile phone, an iPad, a notebook, and the like, and the controller 250 determines whether the display device 200 and the mobile terminal are located in the same local area network, and if the display device 200 and the mobile terminal are located in the same local area network, the controller 250 directly transmits the screen recording file to the mobile terminal through communication modes, such as MQTT (Message queue Telemetry transmission), bluetooth, and the like. If the display device 200 and the mobile terminal are not in the same lan, the controller 250 pops up a third prompt box through the display 275, so as to prompt the user that the mobile terminal needs to be connected to the lan where the display device 200 is located, and then obtains the screen recording file. The sharing mode belongs to sharing of screen recording files in a local area network, and can be understood that a mobile terminal is connected with a display device 200 through a network cable, if the mobile terminal wants to acquire the screen recording files stored on the display device 200, the current domain name of the display device and the storage path of the screen recording files need to be acquired through two-dimensional codes, and when the mobile terminal wants to read the files, the screen recording files only need to be transmitted in the same local area network.

In other embodiments, after the controller 250 generates the screen recording file according to the start instruction, the screen recording file is uploaded to the server 400, so that the server 400 stores the screen recording file in the database. After storing the screen recording file, the server 400 feeds back the storage address of the screen recording file to the display apparatus 200. The controller 250 extracts a character string based on the timestamp for generating the screen capture image, the server domain name, the display device identifier, and the storage address, and generates a two-dimensional code serving as a sharing control according to the character string. When a user wants to acquire the screen recording file from the display device 200, the two-dimensional code can be scanned by a mobile terminal with a camera, such as a mobile phone, an iPad, a notebook, and the like, and the server 400 acquires the corresponding screen recording file based on a request of the mobile terminal and feeds the screen recording file back to the mobile terminal, so that the screen recording file is shared. The sharing mode belongs to sharing of screen recording files in a non-local area network, if a mobile terminal wants to acquire the screen recording files stored in a server 400, a time point when the screen recording files are just started to be generated needs to be acquired through a timestamp for generating screen capture images, a server to be accessed is acquired through a server domain name, the screen recording files generated by which display equipment are specifically identified through the display equipment, specific screen recording files are acquired through storage addresses, and when the mobile terminal wants to read the files, two-dimensional codes can be scanned to request the server to acquire the screen recording files. It should be noted that the sharing method of the screen recording file is not limited to that described in the embodiment of the present application.

In some embodiments, after the sharing control is generated, the display is controlled to display the sharing control on the display interface, so that a user can conveniently obtain the corresponding screen recording file according to the sharing control. The screen recording file generated by the display device 200 can support local playing of the display device 200, can be shared by scanning a sharing control through the mobile terminal, and can be shared to a social platform, an address book friend or a group chat after the screen recording file is acquired by the mobile terminal. When the display device 200 generates the screen capture image or the screen recording file, the display device 200 does not interfere with the playing of the content of the display device 200, and the user does not interfere with other operations of the display device 200. When the user operates the display apparatus 200, the display apparatus 200 may be controlled by voice or the like.

In some embodiments, fig. 9 exemplarily shows a display interface diagram of a display pop-up floating layer, in the process of playing content, if the sharing control has been generated, the display device 200 controls the display 275 to pop-up the floating layer on the current display interface, a sharing area is provided in the floating layer, a two-dimensional code is displayed in the sharing area, and a background of the sharing area in fig. 9 may adopt a screenshot image, and the two-dimensional code is floated on an upper layer of the screenshot image. In addition, prompt information of ' scanning a code to acquire a screen recording file ' is arranged beside the two-dimensional code, and a character prompt of ' OK ' amplified screenshot ' is arranged, so that when a user wants to amplify the screenshot image in the sharing area, the user can press an ' OK ' button on a remote controller.

In some embodiments, the floating layer further comprises a content identification area, and the character identification result is displayed through the content identification area. As shown in fig. 9, avatar thumbnails of persons and corresponding person identifications are revealed through the content recognition area. When the user enlarges the screenshot image through the 'OK' key, the user can know the screenshot from which the character recognition result is obtained, and can see the character corresponding to the avatar thumbnail clearly.

In some embodiments, the manner of starting the screen recording may be realized by a control in a user interface, and an interface diagram for displaying a function menu is exemplarily shown in fig. 10, and a user may send a display function menu instruction to the display device through a specific key of the remote controller, for example, a menu key or a voice key, and the display device receives and responds to the instruction to present the function menu on the user interface. For example, in fig. 10, the function menu is displayed at the lower left of the interface, and includes a second screen recording control 1301, a screen capture control 1302, a view control 1303, and the like. When the user moves the focus to the second screen recording control 1301 through the direction keys of the remote controller and presses the enter key, the controller 250 receives a screen recording start instruction, records the display interface displayed by the display, and generates a screen recording file.

In some embodiments, the manner of starting the screen recording may also be that the user starts the screen recording program and performs the screen recording operation after receiving a voice instruction, for example, the user inputs a "start screen recording" voice instruction.

In some embodiments, when the user manipulates the focus to select the second screen recording control 1301, a time prompt message is generated above the control, for example, an interface diagram of the screen recording time prompt is exemplarily shown in fig. 11, which shows a time 00:05, which represents that the screen recording operation is being performed, and the execution time is 00: 05. The position and the form of the time for prompting recording are not limited in the present application, and the forms can be given in fig. 5 to 7, and of course, a person skilled in the art can give other forms according to the design requirement, and the present application is not limited.

In some embodiments, the user manipulates the focus again to select the second screen recording control 1301, and the controller 250 receives the instruction to control the display device to stop the screen recording operation, and generate and store the screen recording file. At this time, fig. 12 exemplarily shows an interface diagram of screen recording saving/deleting, in which a display interface may prompt a user whether to save or delete the screen recording file, and when the user operates a focus and clicks a "yes" control, the screen recording file is saved; and otherwise, when the user operates the focus and clicks the 'no' control, deleting the screen recording file.

In some embodiments, the user may also input a voice command of "ending screen recording", and the display device stops performing the screen recording operation after receiving the voice command.

In some embodiments, the manner in which the screen recording is started/ended may be implemented by a "start"/"end" control in the user interface, and an example diagram is not given here.

In some embodiments, referring to FIGS. 10-12, a screenshot control 1302 is used to screenshot a current display interface. After the user operates the focus and clicks the screenshot control 1302, the controller 250 executes screenshot operation, and then controls the display interface to prompt whether to save the screenshot file, and in the screenshot saving/deleting interface diagram, the user executes the saving/deleting operation by selecting the yes/no control. And will not be described further herein.

In some embodiments, the user may also wake up the screen capture function by voice, for example, the display device receives and recognizes a voice command of "screen capture", and the controller controls the screen capture operation.

In some embodiments, the view control 1303 is used to view files saved by the display device, including screen-recorded files, screen-shot files, and the like. The user can click the view control 1303 through the focal point of the remote controller, the interface jumps to a file view interface, the files can be presented in a thumbnail mode, and the sorting mode can be time or name. The screen recording file and the screen capturing file can be displayed in a mixed mode or can be displayed separately according to categories. The present application does not limit the display mode of the document.

In some embodiments, the user may also perform viewing of the file through voice execution, e.g., the display device receives and recognizes voice execution of "view file" and the controller controls the UI to jump to the file viewing interface.

No matter whether screen recording is carried out or not, the display equipment can generate a screen capture image firstly, and if screen recording is carried out, a display interface is continuously recorded on the basis of the screen capture image, so that a screen recording file is generated. The controller uploads the screen capture image to the server after the screen capture image is acquired, and the server responds to the screen capture image uploaded by the controller and carries out character recognition on the screen capture image based on an image recognition technology. For a detailed description, reference is made to the foregoing.

In some embodiments, before recording or capturing a screen, the controller detects the remaining amount of the storage space of the disk, and if the remaining amount of the storage space does not exceed a preset remaining amount, if no history screen recording file is stored in the storage space, referring to a display interface diagram shown in fig. 13 that the storage space is full, pops up a second prompt box, where the second prompt box is used to prompt a user that the storage space is full and a screen cannot be recorded.

In this application, no matter the content that the display shows is static picture or dynamic picture, the controller all can record the screen based on the discernment instruction that the user sent to record the screen file and not only can carry out local broadcast on display device, can also share to other equipment through sharing the controlling part, greatly increased the user experience and experience to display device's use.

In some embodiments, the screen recording may also be initiated by other means, for example, the user clicks a screen recording button on a remote controller or a multiplexing button assigned with a screen recording function, or clicks a first screen recording control preset on the display device, or inputs a voice command to "start screen recording", or the like. The display device receives the screen recording starting instruction, records a display interface displayed by the display according to the screen recording starting instruction, generates a screen recording file, and generates and displays a sharing control according to a storage path of the screen recording file after the screen recording file is stored, so that the screen recording file can be shared.

The above details describe the whole process of screen recording and screen recording file sharing of the display device. When a user inputs a screen recording starting instruction, an interface displayed by the display device at this time may be a homepage, an application page, a video playing interface, and the like, wherein for a screen recording in a video playing scene, for example, the user watches a locally stored video file, or requests a film source in a video application (such as youth, love art, and the like), or watches a short video in a social application (such as tremble, fast hand, and the like), or loads and watches a network video resource through a browser, or watches a live program, and the like, since the user cannot predict a highlight segment in a video in advance, that is, cannot predict that the user is interested in that part of the segment in advance, after the user checks the highlight segment and clearly determines that the user wants to record the screen, the user needs to input a screen recording starting instruction through a screen recording button or voice of operating a remote controller, and the like, and operation delay is inevitable, when the display device receives a screen recording starting instruction, the picture of the wonderful moment or highlight moment which is interested by the user may be played already, so that the part of the segment which is interested by the user is missed and recorded.

For a scene of screen recording when the display device plays a video, in some embodiments, the display device detects a current interface type displayed by the display device when receiving a screen recording starting instruction. In the application, the interface types are respectively two types, one type belongs to a video playing interface, and the other type is a non-video playing interface. The non-video playing interface is, for example, an application page, a homepage, or other related interface that is not in a video playing state.

In some embodiments, if it is detected that the interface type is a video playing interface, the currently played video data may be obtained in advance according to the specified path/route. Since the video data has been acquired in advance, the display device does not need to perform the screen recording operation any more.

In some embodiments, if the video playing interface currently plays local video data, the storage path/storage address of the video data in the local video playing interface may be queried according to the video ID, and the video data may be obtained according to the storage path/storage address.

In some embodiments, if the video playing interface currently plays a film source in a video application, a web video in a browser, or a short video in a social application, the URL of the video resource may be obtained according to the video ID, and the corresponding video data may be cached locally according to the URL.

In some embodiments, if a live program is currently played on the video playing interface, a live video stream is acquired, the video stream data of the played part is locally cached, after a screen recording starting instruction and a screen recording ending instruction are received respectively, a screen recording starting time node and a screen recording ending time node are marked in the video stream data, so that a screen recording segment specified by a user is positioned, and a screen recording file can be obtained by subsequently intercepting the screen recording segment.

In some embodiments, if the video playing interface currently plays a live interface, the display device may generate a data acquisition request according to the screen recording start time node and the screen recording end time node, and send the data acquisition request to a live server; the live broadcast server responds to the data acquisition request, analyzes the screen recording start and stop time node carried in the request, and can send a section of video data corresponding to the screen recording start and stop time node to the display device.

It should be noted that, when the interface type is a video playing interface, the video data acquisition mode may be adaptively determined and set according to factors such as a video source, a video type, a video transmission form, and the like, so as to ensure that the video data can be normally acquired and analyzed, and that the video data can be intercepted according to a specified time interval and generated into a screen recording file. The manner of acquiring video data in advance is not limited to that described in the embodiments of the present application.

In some embodiments, a user may define a screen recording duration and a screen recording start/stop time node, record the screen recording start time node when the display device receives a screen recording start instruction, and record the screen recording end time node when the display device receives a screen recording end instruction, where the duration of the generated screen recording file is the screen recording end time node — the screen recording start time node. The screen recording start time node corresponds to the playing progress of the video data when the display device receives a screen recording starting instruction, and the screen recording end time node corresponds to the playing progress of the video data when the display device receives a screen recording ending instruction, for example, a user starts to record the screen when the video data is played to the 5 th minute 25 seconds, and stops recording the screen when the video data is played to the 5 th minute 40 seconds, so that the time length of the generated screen recording file is 15 seconds.

In some embodiments, when a screen recording ending instruction is received, video data may be intercepted according to a screen recording starting time node and a screen recording ending time node, and a screen recording file is generated according to an intercepted section of video, where the generated screen recording file is named as a first screen recording file, and the first screen recording file is a screen recording file that is not edited and has duration adjusted.

In some embodiments, the corresponding first preview interface and the first two-dimensional code image may be generated according to the first screen recording file, and one frame may be selected from the first screen recording file as the first preview image. As shown in the first preview interface shown in fig. 14, a first preview image, video duration of a first screen recording file (named as first duration in this application), a first playing control, first prompt information, a first two-dimensional code image, and second prompt information are displayed in the first preview interface.

In some embodiments, the first preview image is an optional frame in the first screen file, such as a first frame image of the selectable first screen file. Marking a first duration under a first preview image, e.g.In fig. 14, the first screen recording file is from 00:00 to 00:15, that is, the first time length is 15 seconds, so that the user can clearly know the recorded video time length. Wherein, the first duration is equal to screen recording end time node T_stop-screen recording start time node T_start。

In some embodiments, when the user triggers the first playing control, the first screen recording file can be played in a full-screen mode, so that the user can preview the recording effect of the first screen recording file, and thus whether the screen recording file needs to be edited or not is determined.

In some embodiments, the first two-dimensional code image may be generated by associating information such as URL of the first screen recording file with two-dimensional code image data, and the second prompt information is used to prompt a user to scan the first two-dimensional code image using a terminal device, so that the terminal device obtains and downloads the first screen recording file. The user clicks the first playing control, after the video preview of the screen recording is checked, if the screen recording effect is satisfied, the user directly uses an application program with a two-dimensional code scanning function and a data sharing function in the terminal device to scan codes, and after the codes are scanned, the URL of the first screen recording file is obtained, so that the first screen recording file can be downloaded, and the first screen recording file is shared to a social platform, friends and group chats. For example, in fig. 14, the second prompt message is "scan the screen by using the WeChat", and after the user scans the first two-dimensional code image by using the WeChat "scan", the acquired first screen recording file can be shared to a friend circle, group chat, or shared to at least one contact in the address book.

In some embodiments, the first prompt message is used to prompt the user to perform a target operation to edit the file generated by the screen, such as "edit the screen file by menu key" in fig. 14, i.e., the target operation is to press a menu key on the remote controller. It should be noted that the target operation is not limited, and may also be in the form of, for example, pressing another key (e.g., an OK key) on the remote controller, or inputting a password on the edit screen through a voice control, or clicking a designated control (e.g., double-clicking a screen control) on the UI interface. And after the user clicks the first playing control, after the video preview of the recording screen is checked, if the beginning of the first recording screen file misses the interesting segment, inputting target operation after the guidance of the first prompt message is checked.

In some embodiments, the screen recording editing logic is executed only when the target operation is input on the interface with the first prompt message, and the target operation is executed or not responded according to the conventional logic when the target operation is input in other interfaces without the first prompt message. Taking the target operation as pressing a return key on the remote controller as an example, the screen recording editing logic is started when the first preview interface is input, and the previous page is returned when the application program interface is input.

In some embodiments, when the display device receives the target operation, as shown in fig. 15, the first prompt information, the first two-dimensional code image, and the second prompt information are canceled from being displayed on the first preview interface, and a time input box is displayed on an upper layer of the first preview interface, where the time input box includes a time input field, a confirmation control, and a cancellation control, and an operation guidance information for prompting a user to input a target time length in the time input field, where the target time length is a time length for moving a screen recording start time node forward, such as "please input advance time", may also be displayed in the time input box. After looking up the operation prompt information in the time input popup box, a user clicks the time input field, the cursor is in place, the numeric keyboard is popped up automatically, the user clicks the numbers on the keyboard, the expected target duration is input in the time input field, or the number corresponding to the target duration can be shout through voice through the voice control, and the unit of the target duration can be real to second (S), such as 5S.

In some embodiments, if the user clicks the cancel control in the time input box, indicating that the user cancels editing the screen file, the time input box is closed regardless of whether the user inputs the target duration in the time input field, and the first preview interface shown in fig. 15 is still displayed.

In some embodiments, since the target duration is the length of time for moving the screen recording start time node forward, the target duration has a constraint of an upper limit value, and the target duration t is set by the application_mIs named as the time threshold t_s. Referring to the playback time axis, T, shown in FIG. 16₀For the start-of-play time node, T, of the video data₁For the end of the playback of video data, T_startFor recording the start time node of the screen, T_stopFor recording screen end time node, T_start' to record screen start time node T on play time axis_startMoving forward the target duration t_mThen obtain the target entry node, i.e. T_start′＝T_start-t_m。

In some embodiments, referring to FIG. 16, the time threshold t_sFor the start-of-play time node T of video data₀And record screen start time node T_startTime difference of, i.e. t_s＝T_start-T₀I.e. allowing recording of the start time node T_startFarthest forward moving to broadcast starting time node T₀At the position of (1), when the target duration t is_mTime threshold t ≦ time_sAnd then, the condition of adjusting the starting point of the screen recording by shifting forwards is met. On the play time axis, T is satisfied₀≤T_start′≤T_start＜T_stop≤T₁。

In some embodiments, if the user clicks the confirmation control after inputting the target duration in the time input field, the display device needs to compare the target duration t input by the user this time_mAnd a time threshold t_sAnd according to the target duration t_mAnd a time threshold t_sAdopting different editing strategies and UI flows.

In some embodiments, if the target duration t_mLess than or equal to a time threshold t_sIf the video is recorded on the playing time axis, the screen recording start time node T is recorded on the playing time axis_startMoving forward the target duration t_mLength of, locate to target start recording node T_start'. If the video data originates from a local storage or a source of an application program (including a video application and a browser), the node T can be recorded according to the target_start' and record Screen end time node T_stopIntercepting pre-acquired video data, and generating a first target screen recording file according to the intercepted video clip, wherein the first target screen recording file is a file obtained by performing time-shifting editing on the screen recording file in a video playing scene.

In some embodiments, if the video playing interface plays a live program, if a mode of pulling a live stream and caching played data is adopted, recording the node T according to the target start point_start' and record Screen end time node T_stopIntercepting the cached played data, and generating a first target screen recording file according to the intercepted video clip; or, according to the target start recording node T_start' and record Screen end time node T_stopGenerating a data acquisition request and sending the data acquisition request to a live broadcast server, wherein the live broadcast server responds to the data acquisition request and transmits a time interval [ T_start′，T_stop]And the display equipment receives the live broadcast data and generates a first target screen recording file. It should be noted that the generation manner of the first target screen recording file is not limited to that described in the embodiment of the present application, and may be adaptively set according to factors such as a video source, a video type/attribute, and a video transmission manner.

In some embodiments, after the first target screen recording file is generated, a corresponding second preview interface is generated according to the first target screen recording file, and one frame is selected from the first target screen recording file optionally as a second preview image. As shown in the second preview interface of fig. 17, a second preview image, a video duration (named as a second duration in this application) of the first target screen recording file, and a second play control are displayed in the second preview interface. Wherein, the second duration is equal to screen recording end time node T_stopTarget originating node T_startFirst duration + target duration t_m. The time length of the preview image and the screen recording file is updated in the second preview interface, namely the first preview image is switched into the second preview image, and the first time length is switched into the second time length. When the display device receives the clicking operation of the user on the second playing control, the first target screen recording file can be played in a full-screen mode, and the user can determine whether the screen recording file subjected to time-shifting editing meets the requirement by previewing and watching the first target screen recording file.

In some embodiments, referring to fig. 17, an editing prompt pop-up box is displayed on the upper layer of the second preview interface, and the editing prompt pop-up box is used to inquire whether the user completes editing the screen recording file this time. The edit prompt pop includes a re-edit control and a complete control.

In some embodiments, if the user clicks the second play control, and after previewing and viewing the first target screen recording file, the screen recording effect after the current time-shift editing is satisfied, the user may click the completion control. If the display device receives the click operation of the user on the finished control in the editing prompt bullet frame, the current screen recording editing process is exited, the editing prompt bullet frame is closed, a second two-dimensional code image is generated according to the final first target screen recording file, and as shown in fig. 18, first prompt information, the second two-dimensional code image and third prompt information are additionally displayed on a second preview interface. And the user can check the first prompt information on the second preview interface, input the target operation again and start and execute the screen recording editing process. The second two-dimensional code image can be generated according to information correlation of the two-dimensional code image data and the URL of the first target screen recording file, third prompt information is used for prompting a user to use the terminal to scan the second two-dimensional code image, the terminal obtains the URL of the first target screen recording file after scanning the second two-dimensional code image, the first target screen recording file is downloaded to a local memory of the terminal according to the URL, and then the user can share the first target screen recording file to a social platform, address book friends and group chat.

In some embodiments, if the user clicks the second playing control and previews and views the first target screen recording file, and the screen recording effect after the current time-shift editing is still unsatisfactory, the re-editing control may be clicked. When the display device receives the click operation of the re-edit control by the user, as shown in fig. 19, the edit prompt pop-up box is closed, and the time input pop-up box is displayed on the upper layer of the second preview interface. The user can re-input the target duration in the time input bullet box, and so on, the user executes time-shift editing once or circularly for many times until a satisfactory recording effect is achieved, then the user can click the completion control, and the change of the UI is adjusted according to the previous embodiment.

In some embodiments, the user enters the target duration t in the time input bullet box of the interface of FIG. 15_mAnd after the confirmation control is clicked on,if the target time length t is judged_mGreater than a time threshold t_sThen, as shown in fig. 20, a fourth prompt message for prompting the user that the maximum value of the allowable input target time duration in the time input bullet box is equal to the time threshold t is displayed on the display interface of the time input bullet box_sFor example, in fig. 20, the fourth prompt message is "the maximum time length can be input for 36S", that is, the target time length input by the user exceeds 36S, the fourth prompt message is displayed, if the target time length input by the user does not exceed 36S, the fourth prompt message is not displayed, and the target time length t is obtained according to the above-mentioned target time length t_mLess than or equal to a time threshold t_sAnd (5) processing the screen recording editing flow. When the target time length t_mGreater than a time threshold t_sThen, the user checks the fourth prompt message, deletes the number of the current target duration in the time input field, and re-inputs the modified target duration t as shown in fig. 21_m' and let the modified target duration t_m' less than or equal to time threshold t_s。

In some embodiments, the display device receives the user's input of the target duration t_m' after the click operation of the confirmation control in the time input bullet frame, the screen recording starting time node T is recorded on the playing time axis_startMoving forward the target duration t_m' Length, i.e. can locate the updated target entry node T_start", i.e. T_start″＝T_start-t_m′。

In some embodiments, the node T may be recorded according to the target if the video data originates from a local storage or a source of an application program (including a video application and a browser)_start"and record screen end time node T_stopAnd intercepting the pre-acquired video data, and generating an updated first target screen recording file' according to the intercepted video clip.

In some embodiments, if the video playing interface plays a live program, if a mode of pulling a live stream and caching played data is adopted, recording the node T according to the target start point_start"and record screen end time node T_stopIntercepting the cached played data, and generating a first target screen recording according to the intercepted video clipA file'; or, according to the target start recording node T_start"and record screen end time node T_stopGenerating a data acquisition request and sending the data acquisition request to a live broadcast server, wherein the live broadcast server responds to the data acquisition request and transmits a time interval [ T_start″，T_stop]And sending the corresponding live broadcast data to the display equipment, and generating a first target screen recording file' after the display equipment receives the live broadcast data. It should be noted that the generation manner of the first target screen recording file' is not limited to that described in the embodiment of the present application, and may be adaptively set according to factors such as a video source, a video type/attribute, and a video transmission manner.

In some embodiments, after the first target screen recording file ' is generated, a corresponding third preview interface may be generated according to the first target screen recording file ', and one frame may be selected from the first target screen recording file ' as a third preview image. As shown in the third preview interface in fig. 13, the third preview interface displays a third preview image, a video duration (named as a third duration in this application) of the first target screen recording file' and a third play control, and displays an edit prompt pop-up box on an upper layer of the third preview interface. Wherein, the third duration is equal to screen recording end time node T_stopTarget originating node T_startFirst duration + modified target duration t_m'. And updating the time lengths of the preview image and the screen recording file in the third preview interface, namely switching from the first preview image to the third preview image and switching from the first time length to the third time length. The display device receives the click operation of the user on the third playing control, the first target screen recording file 'can be played in a full-screen mode, the user can determine whether the screen recording file after the current time-shifting editing meets the requirement by previewing the first target screen recording file', and the user clicks a re-editing control or a completion control in the editing prompt pop-up box according to the satisfaction or not. Referring to the description of the similar embodiment, if the user clicks the re-editing control, the screen recording editing process is repeated again, so that the user re-inputs the value of the target duration; or, if the user clicks the completion control, the current screen recording editing process is completed and exited, and a UI interface similar to that shown in fig. 18 is displayedAnd the user can acquire and download the first target screen recording file 'by scanning the code by using the terminal, and shares the first target screen recording file' to the social platform, the contact persons in the address list and the group chat.

The foregoing embodiments correspond to scenes where the display is playing video pictures during screen recording. In some embodiments, when the display device receives a screen recording starting instruction, if it is detected that the interface type currently displayed by the display is not a video playing interface, and video data cannot be acquired in advance, the display device is normally started and performs a screen recording operation. And when receiving a screen recording ending instruction, stopping continuously recording the screen, and generating a second target screen recording file, wherein the second target screen recording file is a video file recorded in a non-video playing scene, namely time-shifting editing of the screen recording file is not executed, and the second target screen recording file is obtained through a conventional screen recording process.

In some embodiments, after the second target screen recording file is generated, a corresponding fourth preview interface and a corresponding third two-dimensional code image are generated according to the second target screen recording file, and one frame is selected from the second target screen recording file as a fourth preview image. Alternatively, a third two-dimensional code image may be generated according to the association of the two-dimensional code image data and the URL of the second target screen recording file.

In some embodiments, as shown in the fourth preview interface shown in fig. 23, the fourth preview interface displays the fourth preview image, the video duration of the second target screen recording file (named as the fourth duration in this application), the fourth playing control, the third two-dimensional code image, and the fifth prompt information, and since the second target screen recording file is a video file recorded in a non-video playing scene, the fourth preview interface does not need to display the first prompt information. And the fourth time length is the time difference between the display equipment receiving the screen recording starting instruction and the screen recording finishing instruction. When the display device receives the click operation of the user on the fourth playing control, the second target screen recording file can be played in a full-screen mode, and the user can make a decision on the satisfaction degree of the screen recording by previewing and watching the second target screen recording file.

In some embodiments, the fifth prompt message is used to prompt the user to scan the third two-dimensional code image by using the terminal device, so that the terminal device obtains a URL of the second target screen recording file, downloads the second target screen recording file to the local memory of the terminal according to the URL, and can share the second target screen recording file with the social platform, the contact applying the address book, and the group chat. If the user is satisfied with the screen recording effect after clicking the fourth play control to preview the second target screen recording file, scanning a third two-dimensional code image by using a code scanning window of an application program with code scanning and sharing functions in the terminal; if the user is not satisfied with the recording effect of the second target screen recording file, the screen recording starting instruction can be input again, and screen recording can be carried out again until a satisfactory video is recorded.

In the above embodiments, after the screen recording is finished, the two-dimensional code image associated with the screen recording file is displayed on the preview interface, and the screen recording file recorded by the display device is synchronously shared to the terminal device by means of the code scanning capability of the terminal device, so that the user can share the screen recording at the terminal device, and the terminal device includes but is not limited to a smart phone, a tablet computer, and the like. It should be noted that, the present application mainly focuses on the time-shift editing process when the display device records the screen in the video playing scene, and as for the subsequent sharing form of the screen recording file, the present application is not limited, nor limited to the form of the aforementioned code scanning sharing screen recording.

In some embodiments, fig. 24(a) shows another UI interface for sharing a recording screen, taking the second preview interface as an example, the second preview interface may display a sharing prompt bullet frame instead of displaying the second two-dimensional code image and the third prompt information, where information for asking a user whether to share the recording screen is displayed in the sharing prompt bullet frame, and the sharing prompt bullet frame is further provided with a sharing control and a cancellation control. And if the user clicks a cancel control in the sharing prompt pop-up box, the sharing prompt pop-up box is controlled to be closed, and the display equipment can not respond and execute the sharing process any more.

In some embodiments, if the display device receives a click operation of a user on the sharing control, target applications with video publishing, video sharing and data transmission sharing capabilities are screened from application programs installed in a display device local machine, and the target applications are aggregated into an application list.

In some embodiments, it is detected whether the application list is empty. If the application list is empty, closing the sharing prompt bullet frame, and displaying prompt information of no application program which can be used for sharing the recording screen in the current preview interface, such as 'an APP without the sharing screen is installed in the television', namely, the recording screen cannot be shared at the display equipment end, in this situation, a two-dimensional code image associated with the recording screen file can be displayed in the current preview interface, and a user is prompted to acquire prompt information of the recording screen file by scanning the code through a terminal, so that the terminal equipment is switched to share the recording screen.

In some embodiments, if the application list is not empty, that is, the application list at least includes one target application, as shown in fig. 24(b), the sharing prompt pop-up box is closed, and the application list pop-up box is displayed, a name of each target application in the application list is displayed in the application list pop-up box, each target application has a corresponding selection control, and the application list pop-up box is further provided with a determination control. For example, the application list in fig. 24(b) includes a QQ and a Youtube, after the user clicks a selection control corresponding to the QQ, the QQ application is selected, and after the user clicks a determination control, the display device automatically starts the QQ application, and after the user logs in the QQ, the user may share the screen recording file to a friend in the QQ address book, a group chat, or share the QQ space.

The foregoing embodiments describe the screen recording process of the display device from the UI perspective, and with reference to the UI screen recording process, the screen recording method is described below from the program execution perspective of the controller 250 of the display device, and the screen recording method shown in fig. 25 includes the following program steps:

and step S1, when receiving the screen recording starting instruction, detecting the interface type currently displayed by the display.

The interface types are wholly divided into a video playing interface and a non-video playing interface, the non-video playing interface can be further refined into other types, such as an application program page, a setting menu page, a homepage and the like, the application is not particularly limited, and the essence of the scheme of the application is not influenced by the specific type of the non-video playing interface.

In some embodiments, the Android system may obtain a target package name of a current foreground interface application through an interface provided by the PackageManager or the accessibility service, then compare the target package name with a package name list, and detect whether a package name list includes the target package name, where the package name list includes M preset package names, M is greater than or equal to 1, the preset package name is an application package name possessed by the display device in a video playing state, the preset package name is, for example, in a form of com.jamdeo.tv.vod, com.hisense.media, and the like, and the preset package name may be set according to information of a specific model, a configuration, an installed video application, and the like of the display device, which is not limited in this embodiment. If the packet name list comprises the target packet name, namely a preset packet name matched with the target packet name exists in the packet name list, determining that the interface type is a video playing interface; otherwise, if the target package name is not included in the package name list, determining that the interface type is a non-video playing interface. It should be noted that the manner of detecting the interface type is not limited to that described in the embodiments of the present application.

And step S2, judging whether the interface type is a video playing interface. If the interface type is the video playing interface, step S3 is executed, otherwise, if the interface type is not the video playing interface, step S13 and step S14 are executed.

And step S3, the screen recording operation is not executed, and the video data played by the video playing interface is obtained.

In some embodiments, some of the film sources may not be directly available, and video data that has been encrypted or stored using a special format may not be directly available, due to the protection of the system security policy and the protection policy of the film source of some applications; even in a live television scene, since the code stream is transmitted directly through the signal line in real time, complete live video data cannot be acquired in advance. Therefore, for video data in these special situations, the acquisition mode can be well defined with the specific application program to ensure that the video data can be normally acquired and analyzed.

In some embodiments, since the live broadcast data cannot be obtained into a complete video in advance, the live broadcast data can be stored in a display device side in a mode of viewing and caching, so that the live broadcast data can be called later to intercept video segments; or, a data acquisition request may be generated according to the target start-up node/screen recording start time node and the screen recording end time node, and the data acquisition request is sent to the live broadcast server, and the live broadcast server responds to the data acquisition request and sends live broadcast data in a time interval matched with the data acquisition request to the display device. In an actual application scenario, the manner of acquiring video data in advance may be adaptively set according to factors such as a video source, a video type, and a video transmission manner, and is not limited to that described in the embodiment of the present application.

Step S4, when the instruction of ending screen recording is received, displaying a first prompt message.

The first prompt message is used for prompting a user to execute a target operation to edit a file generated by screen recording, where the file generated by screen recording includes the first screen recording file, the first target screen recording file and the first target screen recording file' recorded and generated in the video playing scene. The second target screen recording file is generated by recording in a non-video playing scene, so that the first prompt information does not need to be displayed on a preview interface of the second target screen recording file, and the second target screen recording file cannot execute time-shifting editing operation.

In some embodiments, when the display device receives the instruction to end the screen recording, the first prompt information may be directly displayed on the video playing interface, or the first prompt information may be displayed on the preview interface of the generated screen recording file with reference to the UI process. And inputting a target operation on the interface for displaying the first prompt message, and starting and executing a time-shifting editing process according to the following steps.

In step S5, it is detected whether a target operation is received. If the target operation is received, executing step S6; otherwise, if not, step S12 is executed.

Step S6, displaying the time input box, receiving the target time length t input by the user in the time input box_m。

In some embodiments, UI design of the time entry bullet box, including the information prompting the user to enter the target length of time, the time entry field to receive and display the target length of time, the confirmation control, and the cancel control, may refer to the example of fig. 15.

Step S7, detecting whether a click operation on the confirmation control in the time input popup box is received. If the click operation on the confirmation control is received, executing step S8; if the user clicks the cancel control in the time input box, step S12 is executed.

Step s8, judging the target time length t_mWhether or not it is greater than a time threshold t_s. If the target duration t_mLess than or equal to a time threshold t_sThen, step S9 and step S10 are executed; if the target duration t_mGreater than a time threshold t_sThen step S11 is executed. Wherein, the time threshold ts is the broadcast starting time node T of the video data₀And record screen start time node T_startTime difference of, i.e. t_s＝T_start-T₀。

Step S9, recording screen start time node T on playing time axis_startMoving forward the target duration t_mTo obtain a target start recording node T_start'. I.e. target originating node T_start′＝T_start-t_m。

Step S10, recording node T according to the target_start' and record Screen end time node T_stopAnd intercepting the video data to obtain a first target screen recording file.

Step s11, displaying a fourth prompt message, wherein the fourth prompt message is used for prompting the user to input the maximum value t of the target duration allowed to be input in the time input bullet box_m-maxIs equal to the time threshold t_s。

After the fourth prompt message is displayed, returning to step S6, receiving the target time length input by the user again in the time input bullet after the user views the fourth prompt message, comparing the target time length with the time threshold value, and after the time threshold value condition is met, recording the screen start time node T on the playing time axis_startAnd (5) the length of the target time length after forward movement modification is carried out, and then video data are intercepted to obtain a first target screen recording file'.

Step S12, according to the screen recording start time node T_startAnd recordingScreen end time node T_stopAnd intercepting the video data to obtain a first screen recording file.

In step S13, a screen recording operation is started and executed.

And step S14, stopping screen recording operation and generating a second target screen recording file when receiving the screen recording ending instruction.

In some embodiments, after the screen recording file (including the first screen recording file, the first target screen recording file', and the second target screen recording file) is generated, a two-dimensional code image associated with the screen recording file may be generated and UI-displayed, so that a user scans the screen recording file using a terminal to obtain the screen recording file, and shares the screen recording file to a social platform, a friend in an address book, a group chat, or the like. The sharing and transmission mode of the screen recording file is not limited.

The method and the device for editing the screen recording file in the front time shifting mode are provided aiming at the screen recording scene when the display device plays the video, namely the screen recording starting point is moved forward by the length of the target time according to the target time length set by a user in a self-defined mode, and the video clip which is possibly missed due to the delay of the operation of starting the screen recording by the user is contained in the time interval corresponding to the target time length, so that the completeness of the screen recording file is ensured, the screen recording file is more in line with the expectation of the user, the repeated screen recording operation is avoided, and the accuracy and the efficiency of the screen recording are improved.

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. In a specific implementation, the invention also provides a computer storage medium, which can store a program. When the computer storage medium is located in the display apparatus 200, the program may be executed to include the aforementioned screen recording method that the controller 250 is configured to perform. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM) or a Random Access Memory (RAM).

In this specification, the same and similar parts among the display device embodiment, the UI embodiment, and the method embodiment may be referred to each other, and related contents are not described again. The UI provided in the present application is only exemplary, and the UI screen recording process does not limit the protection scope of the present application, particularly based on actual design and application.

Claims

1. A display device, comprising:

a display for displaying a user interface and playing a video;

a controller configured to perform:

displaying a time input box when the target operation is received;

2. The display device according to claim 1, wherein the controller is further configured to perform:

when a screen recording ending instruction is received, intercepting the video data according to the screen recording starting time node and the screen recording ending time node to obtain a first screen recording file;

generating a first preview interface and a first two-dimensional code image according to the first screen recording file, and selecting one frame from the first screen recording file as a first preview image;

displaying the first preview image, the first duration of the first screen recording file, a first playing control, the first prompt information, the first two-dimensional code image and the second prompt information on the first preview interface; the first playing control is used for playing the first screen recording file when being triggered, and the second prompt message is used for prompting a user to use the terminal equipment to scan the first two-dimensional code image, so that the terminal equipment can obtain the first screen recording file.

3. The display device according to claim 1 or 2, wherein the time input box comprises a confirmation control, and after receiving the target duration input by the user in the time input box, the controller is further configured to perform:

when the clicking operation of the confirmation control is received, determining whether the target duration is greater than a time threshold; the time threshold is the time difference between the starting time node of the video data and the screen recording starting time node;

if the target duration is less than or equal to the time threshold, generating the first target screen recording file, generating a second preview interface according to the first target screen recording file, and selecting one frame from the first target screen recording file as a second preview image;

displaying the second preview image, the second duration of the first target screen recording file and a second playing control on the second preview interface; and the second playing control is used for playing the first target screen recording file when being triggered.

4. The display device according to claim 3, wherein the controller is further configured to perform:

displaying an editing prompt bullet box on the upper layer of the second preview interface, wherein the editing prompt bullet box comprises a re-editing control and a completion control;

if the click operation on the completion control is received, closing the editing prompt pop-up box, and generating a second two-dimensional code image according to the first target screen recording file; additionally displaying the first prompt information, the second two-dimensional code image and third prompt information on the second preview interface; and the third prompt information is used for prompting a user to use terminal equipment to scan the second two-dimensional code image, so that the terminal equipment obtains the first target screen recording file.

5. The display device according to claim 4, wherein the controller is further configured to perform:

and if the click operation on the re-editing control is received, closing the editing prompt pop-up box, and displaying the time input pop-up box on the upper layer of the second preview interface.

6. The display device according to claim 4 or 5, wherein the controller is further configured to perform:

if the target duration is greater than the time threshold, displaying fourth prompt information, wherein the fourth prompt information is used for prompting a user that the maximum value of the target duration allowed to be input in the time input bullet box is equal to the time threshold;

receiving the clicking operation of a user on the confirmation control after inputting the modified target time length, and moving the screen recording starting time node forward on the playing time axis by the length of the modified target time length to obtain an updated target starting recording node;

intercepting the video data according to the updated target screen recording starting node and the screen recording ending time node to obtain an updated first target screen recording file;

generating a third preview interface according to the updated first target screen recording file, and selecting one frame from the updated first target screen recording file as a third preview image;

displaying the third preview image, a third duration of the updated first target screen recording file and a third playing control on the third preview interface, wherein the third playing control is used for playing the updated first target screen recording file when being triggered;

and displaying the editing prompt bullet frame on the upper layer of the third preview interface.

7. The display device according to claim 1, wherein the controller is further configured to perform:

when a screen recording starting instruction is received, if the interface type currently displayed by the display is detected not to be a video playing interface, starting and executing screen recording operation;

generating a second target screen recording file when a screen recording ending instruction is received;

generating a fourth preview interface and a third two-dimensional code image according to the second target screen recording file, and selecting one frame from the second target screen recording file as a fourth preview image;

displaying the fourth preview image, a fourth time length of the second target screen recording file, a fourth playing control, the third two-dimensional code image and fifth prompt information on the fourth preview interface; the fourth playing control is used for playing the second target screen recording file when being triggered, and the fifth prompting information is used for prompting a user to use a terminal device to scan the third two-dimensional code image, so that the terminal device obtains the second target screen recording file.

8. The display device of claim 2, wherein the time input box further comprises a cancel control, and after receiving a target duration input by a user in the time input box, the controller is further configured to perform:

and when the click operation of the cancel control is received, closing the time input bullet box and controlling a display to display the first preview interface.

9. The display device according to claim 1 or 7, wherein the controller is further configured to perform:

acquiring a target package name of the current interface application;

if the package name list is detected to comprise the target package name, determining that the interface type currently displayed by the display is a video playing interface; otherwise, if the packet name list is detected not to include the target packet name, determining that the interface type currently displayed by the display is not a video playing interface; wherein, the package name list comprises at least one preset package name.

10. A screen recording method is characterized by comprising the following steps:

displaying a time input box when the target operation is received;