CN116939277A - Screen recording processing method and electronic equipment - Google Patents

Screen recording processing method and electronic equipment Download PDF

Info

Publication number
CN116939277A
CN116939277A CN202210334286.1A CN202210334286A CN116939277A CN 116939277 A CN116939277 A CN 116939277A CN 202210334286 A CN202210334286 A CN 202210334286A CN 116939277 A CN116939277 A CN 116939277A
Authority
CN
China
Prior art keywords
electronic device
video
video clip
screen
recording
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210334286.1A
Other languages
Chinese (zh)
Inventor
唐柔
叶立芬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202210334286.1A priority Critical patent/CN116939277A/en
Publication of CN116939277A publication Critical patent/CN116939277A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • H04W8/005Discovery of network devices, e.g. terminals

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application provides a screen recording processing method and electronic equipment, and relates to the technical field of communication. According to the scheme provided by the application, the electronic equipment (such as a smart screen or a smart television) can record the video clips in the background automatically (for example, the user considers the highlight moment) without interrupting the video watching, and can automatically sense nearby available equipment such as a mobile phone or a tablet computer and transmit the recorded video clips to the nearby available equipment, and further the video clips can be stored locally or shared to other users through the nearby available equipment. According to the method and the device, after the user triggers, the screen recording process is automatically completed in the background, the user viewing experience is not interrupted, and the user operation steps are reduced, so that the convenience of screen recording operation is improved.

Description

Screen recording processing method and electronic equipment
Technical Field
The present application relates to the field of communications technologies, and in particular, to a screen recording processing method and an electronic device.
Background
When a user views a video through a smart television (or smart screen), for highlight clips in the video (e.g., highlight clips of a football goal, or highlight episodes of a television show, etc.), the user may have a need to store or share these highlight clips with other users.
The user can use the screen recording function of the intelligent television, and return to the content highlight for recording by looking back or backing back. However, this screen recording method has the following disadvantages: the user viewing experience is interrupted; recording is performed through operation review or fast-backing, so that the operation is complex, the time consumption is long, and the recording is inconvenient for users. And when sharing demands exist, users are required to manually transmit video clips recorded by the intelligent television to other devices such as a mobile phone, and then share the video clips to other users through the mobile phone, so that the operation is inconvenient.
Disclosure of Invention
The application provides a screen recording processing method and electronic equipment, so as to improve the convenience of screen recording operation.
In order to achieve the above purpose, the application adopts the following technical scheme:
in a first aspect, the present application provides a screen recording processing method, which includes: in the process that the first electronic equipment plays the first video stream, the first electronic equipment receives a first operation of a user, wherein the first operation is used for triggering recording of video clips with preset duration; responding to a first operation, the first electronic equipment acquires a first video clip with preset duration from a first video stream, wherein the first video clip is a video stream before and/or after a first moment in the first video stream; the first electronic device automatically performs a close range device scan; the first electronic device searches for the second electronic device; the first electronic device sends the first video clip to the second electronic device.
According to the scheme provided by the application, the electronic equipment (such as a smart screen or a smart television) can record the video clips in the background automatically (such as the highlight moment considered by a user) without interrupting the video watching, and can automatically sense nearby available equipment such as a mobile phone or a tablet computer and transmit the recorded video clips to the nearby available equipment so as to store the video clips locally or share the video clips to other users through the nearby available equipment. According to the method and the device, after the user triggers, the screen recording process is automatically completed in the background, the user viewing experience is not interrupted, and the user operation steps are reduced, so that the convenience of screen recording operation is improved.
In some possible implementations, the first electronic device is a smart screen and the second electronic device is a cell phone or tablet computer. According to the scheme, when a user uses the intelligent screen to watch the video, the intelligent screen can record the video highlight at any time according to the user indication and automatically transmit the video highlight to the mobile phone and other devices in the trusted environment, so that the user can share in real time.
It will be appreciated that during recording of video, the playing of the first video stream is not interrupted.
In some possible implementations, the first time is a time when the first electronic device receives the first operation.
In some possible implementations, the preset duration is 15 seconds.
In some possible implementations, after the first electronic device sends the first video clip to the second electronic device, the screen recording processing method may further include: the second electronic device receives and stores the first video clip.
The second electronic device may store the received first video clip locally, e.g., may store the received first video clip to an album of the second electronic device.
In some possible implementations, after the first electronic device sends the first video clip to the second electronic device, the screen recording processing method may further include: the second electronic device automatically pops up a file sharing interface to prompt whether to share the first video clip.
In some possible implementations, after the second electronic device automatically pops up the file sharing interface, the screen recording processing method may further include: the second electronic device receives a second operation of a user on the file sharing interface, wherein the second operation is used for confirming that the first video clip is shared to the third electronic device; in response to the second operation, the second electronic device transmits the first video clip to the third electronic device.
In some possible implementations, after the first electronic device searches for the second electronic device, the screen recording processing method may further include: the first electronic device sends a first prompt message to the second electronic device, the first prompt message being used to prompt whether to agree to receive the first video clip.
In some possible implementations, after the first electronic device sends the first prompt message to the second electronic device, the screen recording processing method may further include: the second electronic equipment receives and displays a first prompt message sent by the first electronic equipment; the second electronic device receives a third operation of the user, wherein the third operation is used for confirming the receiving of the first video clip; in response to the third operation, the second electronic device sends a first response message to the first electronic device, the first response message prompting that the first video clip agrees to be received.
In some possible implementations, the screen recording processing method may further include: the first electronic device receives a first response message sent by the second electronic device.
In some possible implementations, the screen recording processing method may further include: the first electronic device establishes a wireless channel with the second electronic device.
According to the scheme of the application, after the first electronic equipment knows that the second electronic equipment agrees to receive the first video clip, the first electronic equipment can establish wireless connection with the second electronic equipment, so that the safety and reliability of data transmission can be ensured.
The first electronic device sends a first video clip to a second electronic device, including: the first electronic device transmits the first video clip to the second electronic device over the wireless channel.
In some possible implementations, the wireless channel is a wireless fidelity Wi-Fi channel or a bluetooth channel.
In some possible implementations, before the first electronic device establishes the wireless channel with the second electronic device, the screen recording processing method may further include: the first electronic device stores historical connection data for a plurality of electronic devices that were successfully connected to the first electronic device, including the second electronic device.
In some possible implementations, the first electronic device establishes a wireless channel with a second electronic device, including: when the first electronic equipment initiates connection with the second electronic equipment, the first electronic equipment directly establishes wireless connection with the second electronic equipment according to the historical connection data.
In some possible implementations, after the first electronic device sends the first video clip to the second electronic device, the screen recording processing method may further include: the first electronic device receives a second response message sent by the second electronic device, where the second response message is used to indicate that the first video segment has been successfully received.
In some possible implementations, the first electronic device searching for the second electronic device includes: the first electronic device searches for the second electronic device through a Bluetooth scanning mode or a Wi-Fi scanning mode.
In some possible implementations, the screen recording processing method may further include: the first electronic device also searches for a fourth electronic device; the first electronic device sends a first prompt message to the fourth electronic device, where the first prompt message is used to prompt whether to receive the first video clip.
In some possible implementations, after the first electronic device sends the first prompting message to the fourth electronic device, the screen recording processing method may further include: the fourth electronic device receives and displays the first prompting message.
In some possible implementations, the screen recording processing method may further include:
the first electronic equipment is in wireless connection with the remote control device; the remote control device is provided with a first control used for triggering video recording;
And responding to the operation of the user on the first control of the remote control device, and sending a video recording instruction to the first electronic equipment by the remote control device, wherein the video recording instruction is used for triggering the recording of the video clips with preset duration.
In some possible implementations, the first electronic device receives a first operation of a user, including: the first electronic equipment receives a video recording instruction sent by the remote control device. The first electronic device, in response to the first operation, obtains a first video clip from a first video stream, including: and responding to the video recording instruction, and acquiring the first video clip from the first video stream by the first electronic equipment.
In some possible implementations, the first electronic device obtains a first video clip from a first video stream, including:
the method comprises the steps that first electronic equipment obtains and stores first video data in a preset time period from a first video stream, wherein the first video data comprise multi-frame images;
the first electronic equipment acquires and stores first audio data in a preset time period from a first video stream;
and the first electronic equipment synchronously processes and synthesizes the first video data and the first audio data to obtain a first video clip.
In some possible implementations, the screen recording processing method may further include: the first electronic device uses the first frame image in the first video data as a preview cover image of the first video clip.
In some possible implementations, the screen recording processing method may further include: after the second electronic device receives the first video clip, the second electronic device displays the preview cover image.
In a second aspect, the present application provides a recording processing apparatus comprising means for performing the method of the first aspect described above. The apparatus may correspond to performing the method described in the first aspect, and the relevant descriptions of the units in the apparatus are referred to the description of the first aspect, which is omitted herein for brevity.
The method described in the first aspect may be implemented by hardware, or may be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules or units corresponding to the functions described above. Such as a processing module or unit, a display module or unit, etc.
In a third aspect, the application provides an electronic device comprising a processor coupled to a memory, the memory for storing computer programs or instructions, the processor for executing the computer programs or instructions stored by the memory, such that the method of the first aspect is performed. For example, a processor is configured to execute a computer program or instructions stored in a memory, to cause the apparatus to perform the method in the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program (also referred to as instructions or code) for implementing the method in the first aspect. For example, the computer program, when executed by a computer, causes the computer to perform the method of the first aspect.
In a fifth aspect, the present application provides a chip comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the first aspect and any possible implementation thereof. Optionally, the chip further comprises a memory, and the memory is connected with the processor through a circuit or a wire.
In a sixth aspect, the present application provides a system-on-a-chip, comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the first aspect and any possible implementation thereof. Optionally, the chip system further comprises a memory, and the memory is connected with the processor through a circuit or a wire.
In a seventh aspect, the application provides a computer program product comprising a computer program (which may also be referred to as instructions or code) which, when executed by a computer, causes the computer to carry out the method of the first aspect.
It will be appreciated that the advantages of the second to seventh aspects may be found in the relevant description of the first aspect, and are not described here again.
Drawings
Fig. 1 is a scene structure diagram of a screen recording processing method according to an embodiment of the present application;
FIG. 2 is a schematic general flow chart of a screen recording processing method according to an embodiment of the present application;
FIG. 3 is a schematic flow chart of a screen recording processing method according to an embodiment of the present application;
FIG. 4A is a schematic diagram of device interaction when a screen recording processing method according to an embodiment of the present application is applied;
FIG. 4B is a second schematic diagram of device interaction when the method for processing a video recording according to the embodiment of the present application is applied;
FIG. 4C is a third schematic diagram illustrating device interaction when a screen recording processing method according to an embodiment of the present application is applied;
FIG. 4D is a schematic diagram illustrating interaction between devices when a screen recording processing method according to an embodiment of the present application is applied;
FIG. 5 is a flowchart of another screen recording processing method according to an embodiment of the present application;
FIG. 6 is a schematic diagram of device interaction when another method for processing a video recording according to an embodiment of the present application is applied;
FIG. 7 is a second schematic diagram of device interaction when another method for processing a video recording according to an embodiment of the present application is applied;
FIG. 8 is a schematic diagram of an intelligent screen according to an embodiment of the present application;
FIG. 9 is a schematic diagram of an operating system to which the method for processing a video recording according to an embodiment of the present application is applied;
fig. 10 is a schematic flow chart of video stream playing in the recording processing method according to the embodiment of the present application;
fig. 11 is a schematic flow chart of completing screen recording for a video stream in the screen recording processing method provided by the embodiment of the application;
fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 13 is a schematic structural diagram of a recording processing device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The term "and/or" herein is an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. The symbol "/" herein indicates that the associated object is or is a relationship, e.g., A/B indicates A or B.
The terms "first" and "second" and the like in the description and in the claims are used for distinguishing between different objects and not for describing a particular sequential order of objects. For example, a first operation and a second operation, etc. are used to distinguish between different operations and are not used to describe a particular sequence of operations.
In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
In the description of the embodiments of the present application, unless otherwise specified, the meaning of "plurality" means two or more, for example, the meaning of a plurality of processing units means two or more, or the like; the plurality of elements means two or more elements and the like.
When a user views a video through a smart television (or smart screen), for highlight clips in the video (e.g., highlight clips of a football goal, or highlight episodes of a television show, etc.), the user may have a need to store or share these highlight clips with other users. At present, there are two screen recording modes:
A screen recording mode is as follows: the user can use the screen recording function of the intelligent television, and return to the content highlight for recording by looking back or backing back. The screen recording mode has the following defects: the user viewing experience is interrupted; recording is carried out by operation review or fast-backing, so that the operation is complicated, the time consumption is long, and the recording is inconvenient for users; and when sharing demands exist, users are required to manually transmit video clips recorded by the intelligent television to other devices such as a mobile phone, and then share the video clips to other users through the mobile phone, so that the operation is inconvenient.
Another screen recording mode is as follows: the user shoots the intelligent television screen by using the video recording function of the mobile phone, so that video recording is realized, and the shot video clips are shared with other users when needed. Because video pictures recorded on a screen through a mobile phone can be influenced by moire and the like, the recorded video pictures have poor effects, and thus the watching experience of a user can be influenced.
In view of the above problems, the present application aims to provide a screen recording processing method, which is applied to an electronic device (such as a smart screen or a smart television), and can automatically record video clips (such as a highlight moment considered by a user) in the background while watching a video without interruption, and can automatically sense nearby available devices such as a mobile phone or a tablet computer, and transmit the recorded video clips to the nearby available devices, and further can store the video clips locally or share the video clips to other users through the nearby available devices.
According to the scheme, the user actively triggers the screen recording, the intelligent screen background automatically records, nearby available equipment is automatically perceived, and the file transmission technology is adopted, so that the user viewing experience is not interrupted, recorded video clips are automatically transmitted between trusted equipment, and the user can use the screen recording method more conveniently and rapidly by reducing the operation steps of the user in the whole screen recording process.
Fig. 1 shows a schematic diagram of a system architecture according to various exemplary embodiments of the present application. As shown in fig. 1, the system architecture may include an electronic device 1, an electronic device 2, and an electronic device 3. The electronic device 1 may be a smart screen device, a smart Television (TV), or other electronic devices with video playing function. The electronic device 2 may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), a personal computer (personal computer, PC), etc., and the embodiment of the present application is not limited specifically. Likewise, the electronic device 3 may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, or a wearable device, which is not particularly limited in the embodiment of the present application. As shown in fig. 1, in the embodiment of the present application, the electronic device 1 is taken as an intelligent screen, and the electronic device 2 and the electronic device 3 are taken as mobile phones for example.
In some embodiments, the system architecture shown in fig. 1 may also include a remote control (also referred to as a remote control device) that maintains a wireless connection with the electronic device 1. In response to a user's operation on the remote control, the remote control may wirelessly control the electronic device 1 to turn on, off, fast forward, fast reverse, pause, increase volume, or decrease volume. In addition, in the process of playing the video by the electronic device 1, in response to the pressing operation of the user on the remote controller, the remote controller may also send a screen recording command to the electronic device 1 to trigger the electronic device 1 to record the screen. The electronic device 1 may record a video clip according to the recording command.
In other embodiments, in addition to triggering the electronic device 1 to record a screen through the remote controller during the process of playing the video by the electronic device 1, the electronic device 1 may be triggered to record a screen in other manners. For example, in the process of playing video by the electronic device 1, in response to a screen recording command sent by the user voice, the electronic device 1 may record a screen according to the voice command to obtain a video clip.
In some embodiments, the electronic device 1 and the electronic device 2 are intelligent electronic devices in a trusted environment. In actual implementation, both the electronic device 1 and the electronic device 2 are connected to the same Wi-Fi network, and share the same wireless local area network, i.e. in a trusted environment. In a trusted environment, the electronic device 1 and the electronic device 2 can directly establish wireless connection, identity authentication is not required when the connection is established, for example, different devices can be connected without inputting passwords by a user, and the method is convenient, quick, safe and reliable.
In actual implementation, the electronic apparatus 1 may store historical connection data of a plurality of electronic apparatuses including the electronic apparatus 2, which are successfully connected with the electronic apparatus 1. When the electronic device 1 initiates the establishment of a connection with the electronic device 2, the electronic device 1 may directly establish a wireless connection with the electronic device 2 according to the historical connection data.
In some embodiments, multi-device collaboration may be performed between the electronic device 1 and the electronic device 2. For example, the electronic device 1 may transmit the recorded video clip to the electronic device 2 via a wireless connection. Alternatively, the electronic device 2 may store the video clip locally. Alternatively, the electronic device 2 may share the video clip to the electronic device 3 in response to a user operation. Alternatively, the electronic device 3 may be an electronic device outside the trusted environment, but may also be an electronic device in a trusted environment.
In some embodiments, after the recording is completed, the electronic device 1 may send a prompt message to the electronic device 2 to prompt whether to receive the video clip. Accordingly, the electronic device 2 will display the alert message. After the user confirms the reception of the video clip on the electronic device 2, the electronic device 1 may transmit the recorded video clip to the electronic device 2 via a wireless connection.
In another embodiment, in a trusted environment, other trusted electronic devices (not shown in fig. 1) may be included in addition to electronic device 1 and electronic device 2. In a multi-device collaboration scenario, all electronic devices in a trusted environment may establish wireless connections directly with each other.
Illustratively, after the recording is finished, the electronic device 1 sends a prompt message to the electronic device 2 and other trusted electronic devices to prompt whether to receive the video clip. Accordingly, the electronic device 2 as well as other trusted electronic devices will display the alert message. After the user confirms the reception of the video clip on the electronic device 2, the electronic device 1 may transmit the recorded video clip to the electronic device 2 via a wireless connection. In this case, the other trusted electronic device no longer displays the hint message.
The execution body of the screen recording processing method provided by the embodiment of the application can be the electronic device 1 (such as an intelligent screen) or a functional module and/or a functional entity capable of implementing the screen recording processing method in the electronic device 1, and the scheme of the application can be implemented in a hardware and/or software mode, and can be specifically determined according to actual use requirements, and the embodiment of the application is not limited. The method for processing a screen recording according to the embodiment of the present application will be described below by taking the electronic device 1 as an example with reference to the accompanying drawings.
First, based on fig. 1, a basic overall flow of the screen recording processing method provided by the embodiment of the present application is exemplarily described with reference to fig. 2. The detailed flow of the screen recording processing method is further described in detail with reference to fig. 3 to 7. The flowchart shown in fig. 3 specifically illustrates a scenario in which the smart screen searches for a nearby available device and a corresponding processing policy, and the flowchart shown in fig. 5 specifically illustrates a scenario in which the smart screen searches for a plurality of nearby available devices and a corresponding processing policy, based on the basic flow shown in fig. 2.
As shown in fig. 2, the screen recording processing method may include steps S101 to S115. The screen recording processing method comprises the steps of obtaining video clips, transmitting the video clips and sharing the video clips.
First, the following S101 to S103 illustrate a process in which the smart screen acquires a video clip.
S101, the electronic device 1 plays the first video stream.
The embodiment of the application does not limit the way in which the electronic device 1 plays the first video stream. Alternatively, the electronic device 1 may play the first video stream in a live manner, or may play the first video stream in a replay manner.
In addition, the embodiment of the application does not limit the video format of the first video stream.
In the embodiment of the present application, when the electronic device 1 plays the first video stream, the video segments with a preset duration (for example, 15 seconds) may be periodically cached, so as to provide the video segments more conveniently when the user triggers the screen recording.
For example, when the electronic device 1 starts playing the first video stream, the electronic device 1 may buffer 15 seconds of video clips first, and in the case that no user-triggered recording operation is received, the electronic device 1 deletes the recorded 15 seconds of video clips, thereby freeing up memory space. The electronic device 1 then continues to buffer the next 15 seconds of video clip. By analogy, the electronic device 1 may continuously and periodically cache 15 seconds of video clips, and delete recorded 15 seconds of video clips without receiving a user-triggered screen recording operation, so that it does not occupy too much memory (e.g., occupies memory space for recording 15 seconds of video clips at most), and may ensure that the last recorded first 15 seconds of video clips may be provided quickly when the user triggers the screen recording.
Alternatively, in some embodiments, the electronic device 1 may provide an option to turn on or off the screen recording function, and the electronic device 1 may turn on or off the screen recording function in response to an operation by the user. On the one hand, in the case that the electronic device 1 has turned on the screen recording function, when it is detected that the electronic device 1 starts playing video, the electronic device 1 periodically caches video clips for a preset period of time (for example, 15 seconds), so as to provide the video clips more conveniently when the user triggers the screen recording. On the other hand, in the case where the electronic apparatus 1 has turned off the screen recording function, when it is detected that the electronic apparatus 1 starts playing video, the electronic apparatus 1 does not cache the video clip any more.
Alternatively, in other embodiments, the electronic device 1 may default to the on-screen function at factory settings. In this case, when it is detected that the electronic device 1 starts playing video, the electronic device 1 periodically buffers video clips for a preset period of time (for example, 15 seconds) so as to provide video clips more conveniently when the user triggers the screen recording.
In some embodiments, the electronic device 1 may acquire and store first video data from the first video stream for a preset period of time, the first video data including a plurality of frames of images. Meanwhile, the electronic device 1 acquires and stores the first audio data within a preset period from the first video stream. Then, the electronic device 1 performs synchronization processing on the first video data and the first audio data and synthesizes the first video data and the first audio data to obtain a first video clip.
In some embodiments, the electronic device 1 may use the first frame image in the first video data as a preview cover image of the first video clip.
S102, in the video playing process, the electronic equipment 1 receives the operation of triggering the video recording by the user.
Wherein the operation of the user triggering the recording of the video (also called recording) is called a first operation. The first operation may be an operation of triggering the screen recording on the remote controller by the user, and the first operation may also be an operation of outputting a preset screen recording command by the user through voice, specifically may be determined according to actual use requirements, and the embodiment of the present application is not limited.
Optionally, after receiving the screen recording command, the smart screen may identify the scene first, and then determine whether to execute the screen recording process according to the scene. Specifically, the recording process is started when the smart screen is identified as playing video, and the recording is not performed when the smart screen is identified as being in a screen-off state.
S103, in response to the user operation, the electronic device 1 obtains a first video clip of a preset duration from the first video stream, where the first video clip is a video stream before and/or after the first time in the first video stream.
For example, in some embodiments, if the recording strategy adopted by the electronic device 1 is recording the video clip 15 seconds before recording, the electronic device 1 may periodically buffer the video clip 15 seconds when playing the first video stream, so as to provide the video clip more conveniently when the user triggers the recording.
It will be appreciated that during the playing of the first video stream, the electronic device 1 may continuously and periodically buffer 15 seconds of video clips, and delete the recorded 15 seconds of video clips without receiving the user-triggered recording operation until the electronic device 1 receives the user-triggered recording operation, and the electronic device 1 obtains the last recorded 15 seconds of video clips. That is, once the electronic device 1 receives the screen recording command, the electronic device 1 obtains the last recorded video clip of 15 seconds from the buffer space, i.e. the video clip of the first 15 seconds.
For example, in other embodiments, if the recording strategy adopted by the electronic device 1 is 15 seconds after recording, when the electronic device 1 plays the first video stream, the electronic device 1 records 15 seconds of video clips on site once receiving the recording command, that is, the 15 seconds after recording. In this case the electronic device 1 does not need to buffer video clips for a preset duration.
Wherein the first video stream comprises a video code stream and an audio code stream. Accordingly, a video stream may be understood as an audio code stream and a video code stream.
It can be understood that the process of recording the screen of the electronic device 1 is completed in the background. During the video recording process, the first video stream is normally played and is not interrupted. Optionally, after the screen recording is completed, the electronic device 1 may display a message that the screen recording is completed.
Optionally, in the embodiment of the present application, the preset time period may be 15 seconds, or may be other time periods, which may specifically be determined according to actual use requirements, and the embodiment of the present application is not limited. For convenience of explanation, the embodiment of the present application is exemplified by a preset duration of 15 seconds.
In some embodiments, the first video clip may be a video stream within a preset time period (e.g., 15 seconds) before the first time in the first video stream. In other embodiments, the first video clip may be a video stream within a preset time period (e.g., 15 seconds) after the first time in the first video stream. In other embodiments, the first video clip may also be a video stream within a first preset time period (e.g., 5 seconds) before the first time point and a video stream within a second preset time period (e.g., 10 seconds) after the first time point in the first video stream; wherein the sum of the first preset time period (e.g., 5 seconds) and the second preset time period (e.g., 10 seconds) is equal to the preset time period (e.g., 15 seconds).
Illustratively, the moment when the screen recording instruction is received is taken as a screen recording time node. An exemplary explanation will be given below taking 15 seconds as an example of the preset time period. For example, a 15 second video stream before the recording time node may be selected as the first video clip. Alternatively, a 15 second video stream after the recording time node may be selected as the first video clip. Alternatively, a 5 second video stream before the recording time node and a 10 second video stream after the recording time node may be selected as the first video clip. Alternatively, a 10 second video stream before the recording time node and a 5 second video stream after the recording time node may be selected as the first video clip. It will be appreciated that, for exemplary purposes, the preset duration and the recording period may be specifically set according to actual use requirements, which is not limited by the embodiment of the present application.
In some embodiments, the first time may be the time at which the first operation is received by the electronic device 1. That is, when the electronic device 1 receives the first operation, the electronic device 1 starts the screen recording. The time when the electronic device 1 starts the screen recording is the time when the electronic device 1 receives the first operation.
In other embodiments, the first moment in time may be a moment in time (referred to as a second moment in time) before the moment in time when the first operation is received by the electronic device 1. It will be appreciated that in this case, the moment at which the electronic device 1 starts the screen recording is not the moment at which the electronic device 1 receives the first operation. Here, a certain time before the time when the screen recording command is received is taken as a screen recording time node.
Illustratively, the second time instant is 5 seconds earlier than the time instant at which the first operation is received by the electronic device 1. For example, the electronic device 1 may start recording the video from 5 seconds before receiving the first operation after receiving the first operation, and end recording the video after the recording time reaches 15 seconds, so as to record a video clip with 15 seconds.
In further embodiments, the first time may be a time (referred to as a third time) after the time at which the first operation is received by the electronic device 1. It will be appreciated that, here, a time point after the time point when the screen recording command is received is taken as a screen recording time node.
Illustratively, the second time instant is 5 seconds later than the time instant at which the first operation is received by the electronic device 1. For example, the electronic device 1 may wait 5 seconds to restart the recording after receiving the first operation, and end the recording after the recording time reaches 15 seconds, so as to record a video clip with 15 seconds.
Then, the following S104 to S112 illustrate a procedure of transmitting a video clip by the electronic apparatus 1.
S104, the electronic apparatus 1 scans through the short-range apparatus to search for nearby available apparatuses including the electronic apparatus 2.
Illustratively, the electronic device 1 may search for nearby available devices, i.e. find electronic devices in a trusted environment, by bluetooth scanning or Wi-Fi scanning. It can be appreciated that the searched electronic device is in a power-on state.
It should be noted that, after the electronic device 1 completes the screen recording, the electronic device 1 automatically performs the close-range device scanning to send the video clip obtained by the screen recording to the nearby available devices, so as to realize the cooperative work of multiple devices. Illustratively, after the electronic device 1 completes the screen recording, the electronic device 1 automatically performs a close range device scan to discover the electronic device 2 and the electronic device 4, the electronic device 2 and the electronic device 4 being in a trusted environment with the electronic device 1.
S105, the electronic device 1 transmits a first prompt message to the electronic device 2 after discovering the electronic device 2.
S106, the electronic device 2 receives and displays the first prompting message to prompt whether to receive the first video clip.
Note that, when the electronic device 1 searches for a plurality of electronic devices, the electronic device 1 may send the first alert message to each of the plurality of electronic devices. The plurality of electronic devices each receive and display a first prompting message to prompt whether to receive the first video clip.
S107, the electronic apparatus 2 receives an operation (referred to as a third operation) in which the user agrees to receive the first video clip.
In this case, among the plurality of electronic devices that received the first hint message, the electronic device that did not receive the third operation may cancel the display of the first hint message.
S108, the electronic device 2 sends a first response message to the electronic device 1 to indicate that the first video clip agrees to be received.
S109, the electronic apparatus 1 and the electronic apparatus 2 establish wireless connection.
After the electronic device 1 knows that the electronic device 2 agrees to receive the first video clip, the electronic device 1 will establish a wireless connection with the electronic device 2, so that the security and reliability of data transmission can be ensured.
Wherein the wireless connection is also referred to as a wireless channel. The wireless channel may be a Wi-Fi channel or a bluetooth channel, for example.
In some embodiments, the electronic device 1 stores historical connection data for a plurality of electronic devices that were successfully connected to the electronic device 1, including the electronic device 2. When the electronic device 1 initiates the establishment of a connection with the electronic device 2, the electronic device 1 may directly establish a wireless connection with the electronic device 2 according to the historical connection data.
S110, the electronic device 1 sends the first video clip to the electronic device 2 through the wireless connection.
S111, the electronic device 2 receives the first video clip.
Wherein the electronic device 2 may store the received first video clip locally, e.g., the electronic device 2 may store the received first video clip to an album.
In some embodiments, when electronic device 2 may store the received first video clip to the album, electronic device 2 may display a preview cover image of the first video clip.
After S111, the electronic apparatus 2 may continue to perform S112, or directly perform S113 without performing S112.
S112, the electronic device 2 sends a second response message to the electronic device 1 to indicate that the first video clip was successfully received.
Wherein S112 is an optional step, the electronic device 2 may send the second response message to the electronic device 1, or may not send the second response message to the electronic device 1.
Then, the following S113-S115 illustrate the process of sharing video clips by a cell phone.
In S113, the electronic device 2 displays a file sharing interface to prompt whether to share the first video clip.
The electronic device 2 invokes a mobile phone system sharing function, and pops up a file sharing interface to prompt whether to share the first video clip.
S114, the electronic device 2 receives a sharing operation of the user, where the sharing operation includes selecting a sharing object (e.g. the electronic device 3) and selecting a sharing control.
Wherein the sharing operation is also referred to as a second operation.
S115, in response to the sharing operation of the user, the electronic device 2 sends the first video clip to the electronic device 3.
In some embodiments, the electronic device 2 first sends a message to the electronic device 3 to indicate whether the first video clip was received. After the electronic device 3 acknowledges the reception, the electronic device 2 sends the first video clip to the electronic device 3 again. In some embodiments, when the electronic device 3 receives the first video clip, the electronic device 3 may display a preview cover image of the first video clip.
In some embodiments, the electronic device 1 automatically forms a highlight in the video clip 15 seconds before the background recording and buffers in the electronic device 1. Then, after the electronic device 1 transmits the video clip to the electronic device 2, the electronic device 1 may delete the video clip.
In some embodiments, in the event that the electronic device 1 (smart screen) does not search for (i.e., does not perceive) nearby available devices, the electronic device 1 may display a prompt that the nearby available devices are not searched for.
In some embodiments, in case of a recording failure of the electronic device 1 (smart screen), the electronic device 1 may display a notification of the recording failure.
According to the scheme, in the process of playing the video by the electronic equipment 1 (such as a smart screen), when the electronic equipment 1 receives a screen recording operation of a user or a screen recording instruction sent by a remote controller, the electronic equipment 1 acquires audio and video data of a video picture being presented in real time, records the video picture to obtain a video clip with preset duration, then the electronic equipment 1 automatically senses available nearby equipment (such as the electronic equipment in a trusted environment), and then the electronic equipment 1 sends the video clip to available nearby equipment (such as the electronic equipment 2). The electronic device 2 receives and stores the video clip, and the electronic device 2 also automatically pops up a file sharing window or interface to prompt the user whether to share the video clip. Further, the electronic device 2 may share the video clip to other users according to the user's usage requirement. According to the method and the device, after the user triggers, the screen recording process is automatically completed in the background, the user viewing experience is not interrupted, and the user operation steps are reduced, so that the convenience of screen recording operation is improved.
The screen recording processing method provided by the embodiment of the application is described below with reference to the following first embodiment and second embodiment. The first embodiment and the second embodiment are the same in that the electronic device 1 is an intelligent screen, the electronic device 2 is a mobile phone, and the intelligent screen is controlled by a remote controller to record; the first embodiment is different in that the first embodiment provides a scenario in which an intelligent screen searches for an available device through short-distance device scanning, and a processing strategy corresponding to the scenario; while the second embodiment provides that the smart screen searches for scenes of two or more available devices through the short-range device scan, and processing strategies corresponding to the scenes.
First embodiment
As shown in fig. 3, the screen recording processing method provided in the first embodiment includes steps S201 to S216. It should be noted that, some steps in the first embodiment are similar to those in fig. 2, and the detailed description of the related embodiments may refer to the detailed description in fig. 2, which is not repeated herein.
First, the following S201-S204 illustrate the process of controlling the smart screen recording and how the smart screen recording is performed by the remote controller.
S201, the intelligent screen plays the first video stream.
S202, responding to the operation of triggering the screen recording on the remote controller by a user, and sending a screen recording command to the intelligent screen by the remote controller.
It will be appreciated that the remote control is in wireless connection with the smart screen saver. The user can trigger the intelligent screen to record by operating on the remote controller.
In some embodiments, the remote control is provided with a shortcut key for triggering the recording, for example, some combination keys of the remote control may be used as the shortcut key for triggering the recording. The combination key may be a power key and a volume up key, or may be a menu key and a confirm key. It can be understood that the setting of the shortcut key can be set according to actual use requirements, and the embodiment of the application is not limited.
Illustratively, when the user views live/on-demand video on the smart screen and sees a highlight, the user can press both the menu key and the confirm key simultaneously to trigger the smart screen to record.
In other embodiments, a screen recording key (referred to as a first control) for triggering screen recording may be provided on the operation panel of the remote controller. In response to a user's operation of the first control, the remote control may send a screen recording command to the smart screen, the screen recording command being used to trigger recording of a video clip for a preset duration (e.g., 15 seconds).
For example, as shown in fig. 1, a screen recording key may be disposed on an operation panel of the remote controller, and the user may press the screen recording key to trigger the smart screen to record.
As another example, as shown in fig. 4A, a screen recording key 11 and a screen recording key 12 may be disposed on an operation panel of the remote controller, where the screen recording key 11 is used to trigger 15 seconds(s) before the smart screen recording, and the screen recording key 12 is used to trigger 15 seconds(s) after the smart screen recording. As shown in fig. 4A, the user may press the screen-recording key 11 to trigger the smart screen to record a 15s video clip before the moment the smart screen receives the screen-recording command. Alternatively, the user may press the screen key 12 to trigger the smart screen to screen a 15s video clip after the time of receipt of the screen command.
S203, in the video playing process, the intelligent screen receives a screen recording command.
S204, responding to the screen recording command, and acquiring a first video clip with preset duration (for example, 15 seconds) from the first video stream by the intelligent screen.
Here, an example of acquiring a video clip of the first 15 seconds is exemplified. In actual implementation, the first video clip may be a video stream of a preset duration played by the smart screen before and/or after receiving the screen recording command. In some embodiments, the first video clip may be a first 15 second video clip. In other embodiments, the first video clip may be a last 15 seconds video clip.
It can be understood that the intelligent screen recording process is completed in the background. During the video recording process, the first video stream is normally played and is not interrupted.
Alternatively, as shown in fig. 4A, during the recording process, the smart screen may display a prompt 13 of "recording" the screen.
Alternatively, as shown in FIG. 4B, after the recording is completed, the intelligent screen may display a prompt 14 for "completed recording".
It should be noted that, the setting of the preset duration and the obtaining of the first video segment may refer to the related description of the setting of the preset duration and the obtaining of the first video segment in the above embodiment, which is not described herein.
Then, the following S205-S213 illustrate a process in which the smart screen transmits video clips to nearby available devices (e.g., cell phones).
S205, the intelligent screen scans through the short-distance equipment to search for nearby available equipment, such as finding a mobile phone.
After the intelligent screen is successfully recorded, the intelligent screen automatically senses whether a trusted device exists nearby through a sensing technology.
Illustratively, the smart screen may search for available devices in a trusted environment in the vicinity by bluetooth scanning or Wi-Fi scanning.
It will be appreciated that after the smart screen completes the recording, the smart screen automatically performs a close range device scan to send the video clip obtained by the recording to the electronic device in the trusted environment. Illustratively, as shown in FIG. 4B, after the smart screen completes the recording, the smart screen automatically performs a close range device scan to search for available devices in a trusted environment with the smart screen, here exemplified by the smart screen searching for a cell phone.
In some embodiments, as shown in fig. 4C, the smart screen may display "find available device" after finding the handset: a reminder 15 for handset ".
S206, after the smart screen discovers the mobile phone, the smart screen sends a first prompt message to the mobile phone.
After the intelligent screen end senses that the mobile phone and other trusted devices exist in the background, the intelligent screen end prepares to share files to the trusted devices through a file transmission technology and sends file transmission reminding to the trusted devices.
S207, the mobile phone receives and displays a first prompt message to prompt whether to receive the first video clip.
Illustratively, as shown in fig. 4C, after searching for the handset, the smart screen sends a first alert message to the handset, which receives and displays a first alert message 16, e.g. "smart screen sends a recorded video clip to the local, is it received? Receive option 17 and reject option 18".
S208, the mobile phone receives the operation that the user agrees to receive the first video clip.
Illustratively, as shown in FIG. 4C, a user's click on the receive option 17 indicates agreement to receive the first video clip. Accordingly, the mobile phone receives the operation that the user agrees to receive the first video clip.
S209, the mobile phone sends a first response message to the intelligent screen to indicate that the first video clip agrees to be received.
S210, the intelligent screen and the mobile phone establish wireless connection.
After the smart screen knows that the mobile phone agrees to receive the first video clip, the smart screen can establish wireless connection with the mobile phone, so that the safety and reliability of data transmission can be guaranteed.
In some embodiments, the smart screen stores historical connection data for a plurality of electronic devices, including a cell phone, that were successfully connected to the smart screen. When the intelligent screen initiates connection with the mobile phone, the intelligent screen can directly establish wireless connection with the mobile phone according to the historical connection data.
S211, the intelligent screen sends a first video clip to the mobile phone through wireless connection.
In some embodiments, as shown in fig. 4D, the smart screen establishes a wireless connection with the handset, and the smart screen may send the first video clip to the handset over the wireless connection.
In some embodiments, the smart screen may display a "send video to cell phone" prompt 20 when the smart screen sends the first video clip to the cell phone.
S212, the mobile phone receives the first video clip.
The mobile phone may store the received first video clip locally, for example, the mobile phone may store the received first video clip in an album.
After S212, the handset may continue to perform S213 or directly perform S214 without performing S213.
S213, the mobile phone sends a second response message to the intelligent screen to indicate that the first video clip is successfully received.
The step S213 is an optional step, where the mobile phone may send the second response message to the smart screen, or may not send the second response message to the smart screen, and may specifically be determined according to the actual use requirement, which is not limited by the embodiment of the present application.
Then, the following S213-S316 illustrate a process of sharing video clips to other electronic devices through a cellular phone.
S214, the mobile phone displays a file sharing interface to prompt whether to share the first video clip.
In some embodiments, after the mobile phone receives the first video clip, the mobile phone may directly pop up the file sharing interface to prompt the user whether to share the first video clip, and the file sharing interface may display one or more sharing objects for the user to select.
In other embodiments, the phone may display the album interface after the phone receives the first video clip and stores the first video clip to the album application. When a user clicks a sharing control in the album interface, the mobile phone can jump from the album interface to a file sharing interface, and the file sharing interface prompts the user to select a sharing object so as to share the first video clip.
Illustratively, as shown in fig. 4D, a preview cover image of the first video clip and a plurality of sharing objects are displayed in the file sharing interface 21 for the user to select. Optionally, the file sharing interface 21 may include a sharing control, where the sharing control is used to trigger sending the currently received file to other electronic devices for sharing. Optionally, the file sharing interface 21 may further include a move-to control, where the move-to control is used to trigger moving the currently received file to a certain storage path of the mobile phone for storage.
S215, the mobile phone receives a sharing operation of the user, where the sharing operation includes selecting a sharing object (called other electronic devices) and selecting a sharing control.
Wherein the sharing object is presented to the user in the form of an icon. Illustratively, as shown in fig. 4D, the sharing object may be a save, a smart screen, a printer, a my computer, a sms, a mail, or an instant messaging, etc. If the user selects the sharing form such as short message, mail or instant messaging, the mobile phone further displays a contact list for the user to select the sharing object.
It should be noted that, the sharing objects shown in fig. 4D are exemplary, and the file sharing interface 21 may specifically display icons of a plurality of sharing objects meeting the actual use requirement according to the actual use requirement, which is not limited in the embodiment of the present application.
S216, responding to the sharing operation of the user, and sending the first video clip to other electronic equipment by the mobile phone.
For example, as shown in fig. 4D, the mobile phone may send the first video clip to other electronic devices, so that the wonderful video clip may be quickly shared, and user experience is improved.
According to the scheme, when the intelligent screen receives the screen recording instruction sent by the remote controller in the process of playing the video, the intelligent screen collects audio and video data of the video picture being displayed in real time, video clips with preset duration are recorded, then the intelligent screen automatically senses nearby available equipment, for example, the intelligent screen automatically senses a mobile phone in a trusted environment, and then the intelligent screen sends the video clips to the mobile phone. The mobile phone receives and stores the video clip, and the mobile phone also automatically pops up a file sharing window or interface to prompt a user whether the video clip needs to be shared. Further, the mobile phone can share the video clip to other users according to the user requirement. According to the method and the device, after the user triggers, the screen recording process is automatically completed in the background, the user viewing experience is not interrupted, and the user operation steps are reduced, so that the convenience of screen recording operation is improved.
Second embodiment
As shown in fig. 5, the screen recording processing method provided in the second embodiment includes steps S301 to S316. It should be noted that, some steps in the second embodiment are similar to those in fig. 3, and the detailed description of the second embodiment may refer to the detailed description in fig. 3, which is not repeated here.
First, the following S301-S304 illustrate the process of controlling the smart screen recording and how the smart screen recording is performed by the remote controller.
S301, the intelligent screen plays the first video stream.
S302, responding to the operation of triggering the screen recording on the remote controller by a user, and sending a screen recording command to the intelligent screen by the remote controller.
The remote controller is in wireless connection with the intelligent screen protector. The user can trigger the intelligent screen to record by operating on the remote controller.
S303, in the video playing process, the intelligent screen receives a screen recording command.
S304, responding to the screen recording command, the intelligent screen acquires a first video clip of 15 seconds from the first video stream.
Here, an example of acquiring a video clip of the first 15 seconds is exemplified. In actual implementation, the first video clip may be a video stream of a preset duration played by the smart screen before and/or after receiving the screen recording command. In some embodiments, the first video clip may be a first 15 second video clip. In other embodiments, the first video clip may be a last 15 seconds video clip.
It can be understood that the intelligent screen recording process is completed in the background. During the video recording process, the first video stream is normally played and is not interrupted. It should be noted that, the setting of the preset duration and the obtaining of the first video segment may refer to the related description of the setting of the preset duration and the obtaining of the first video segment in the above embodiment, which is not described herein.
Then, the following S305-S313 illustrate the process of the smart screen transmitting video clips to nearby available devices (e.g., cell phones). The steps shown in the dashed box in fig. 5 in the second embodiment are different from those in the first embodiment.
S305A, the smart screen scans through the short-range device to search for nearby available devices, such as mobile phones.
S305B, the smart screen scans through the short-range device to search for nearby available devices, such as a tablet computer.
The intelligent screen can scan the device in a short distance in a Bluetooth scanning mode or a Wi-Fi scanning mode, so that the intelligent screen can search available devices in a trusted environment nearby.
It will be appreciated that after the smart screen completes the recording, the smart screen automatically performs a close range device scan to send the video clip obtained by the recording to the electronic device in the trusted environment. Illustratively, as shown in FIG. 6, after the smart screen has completed the recording, the smart screen automatically performs a close range device scan, searching for available devices in a trusted environment with the smart screen, here exemplified by smart screen search for cell phones and tablet computers.
In some embodiments, as shown in fig. 6, the smart screen, after discovering the cell phone and tablet, may display "discover available devices: a mobile phone and tablet computer'.
The embodiment of the application does not limit the execution sequence of the S305A and the S305B.
S306A, after finding the mobile phone, the intelligent screen sends a first prompt message to the mobile phone.
S306B, after the intelligent screen discovers the tablet personal computer, the intelligent screen sends a first prompt message to the tablet personal computer.
Because the intelligent screen automatically senses nearby devices with the same account number in the scheme of the application, a step of manually initiating sharing from the intelligent screen to other devices is not required.
According to the scheme, the intelligent screen can send the video clips to the mobile phone, and sharing is directly achieved from the mobile phone side, so that convenience in video sharing can be improved. The intelligent screen side does not need to install social application, and video can be shared rapidly and conveniently.
The embodiment of the application does not limit the execution sequence of S306A and S306B.
S307A, the mobile phone receives and displays a first prompt message to prompt whether to receive the first video clip.
S307B, the tablet computer receives and displays the first prompting message to prompt whether to receive the first video clip.
The embodiment of the present application does not limit the order of execution of S307A and S307B.
When the intelligent screen searches a plurality of electronic devices, the intelligent screen can send first prompt messages to the plurality of electronic devices. The plurality of electronic devices each receive and display a first prompting message to prompt whether to receive the first video clip.
Illustratively, as shown in fig. 6, after searching for the mobile phone, the smart screen sends a first alert message to the mobile phone, and the mobile phone receives and displays a first alert message 23, e.g. "smart screen sends a recorded video clip to the local, is it received? A receive option and a reject option. Likewise, after searching for the tablet, the smart screen sends a first alert message to the tablet, which receives and displays the first alert message 24, e.g. "smart screen sends a recorded video clip to the local, is it received? A receive option and a reject option.
Therefore, the mobile phone and the tablet personal computer can receive the prompt message of whether to receive the video clip, and the user can select to receive the video clip on the mobile phone or the tablet personal computer according to the actual use requirement. For convenience of explanation, the second embodiment will be exemplified by taking an example in which a user selects to receive a video clip on a mobile phone.
S308, the mobile phone receives the operation that the user agrees to receive the first video clip.
Illustratively, as shown in FIG. 6, the user clicks on the receive option on the cell phone, indicating consent to receive the first video clip. Accordingly, the mobile phone receives the operation that the user agrees to receive the first video clip.
In some embodiments, as shown in fig. 7, the tablet cancels the display of the first alert message because the tablet does not receive the user operation.
In other embodiments, the tablet may still display the first alert message when the user clicks the receive option on the cell phone. Alternatively, in the case where the user operation is not received within, for example, 20 seconds, the tablet computer may cancel the display of the first hint message. Or, in response to the user triggering the operation of closing the first alert message, the tablet computer may cancel displaying the first alert message.
S309, the mobile phone sends a first response message to the smart screen to indicate that the first video clip agrees to be received.
S310, the intelligent screen and the mobile phone establish wireless connection.
After the smart screen knows that the mobile phone agrees to receive the first video clip, the smart screen can establish wireless connection with the mobile phone, so that the safety and reliability of data transmission can be guaranteed.
In some embodiments, the smart screen stores historical connection data for a plurality of electronic devices, including a cell phone, that were successfully connected to the smart screen. When the intelligent screen initiates connection with the mobile phone, the intelligent screen can directly establish wireless connection with the mobile phone according to the historical connection data.
S311, the intelligent screen sends the first video clip to the mobile phone through wireless connection.
In some embodiments, as shown in fig. 7, the smart screen establishes a wireless connection with the handset, and the smart screen may send the first video clip to the handset over the wireless connection.
In some embodiments, as shown in fig. 7, when the smart screen sends the first video clip to the cell phone, the smart screen may display a prompt message "sent video to cell phone".
S312, the mobile phone receives the first video clip.
The mobile phone may store the received first video clip locally, for example, the mobile phone may store the received first video clip in an album.
After S312, the handset may continue to perform S313, or directly perform S314 without performing S313.
S313, the mobile phone sends a second response message to the intelligent screen to indicate that the first video clip is successfully received.
Then, the following S313-S316 illustrate a process of sharing video clips to other electronic devices through a mobile phone.
S314, the mobile phone displays a file sharing interface to prompt whether to share the first video clip.
S315, the mobile phone receives a sharing operation of the user, where the sharing operation includes selecting a sharing object (called other electronic devices) and selecting a sharing control.
S316, responding to the sharing operation of the user, and sending the first video clip to other electronic equipment by the mobile phone.
In some embodiments, the mobile phone and the tablet respectively may receive an operation that the user agrees to receive the first video clip. Accordingly, the first video clip can be shared with other electronic devices through the mobile phone and the tablet computer respectively.
Illustratively, during the execution of steps S308 to S316 described above, the following steps may also be performed: after the tablet computer receives the operation that the user agrees to receive the first video clip, the tablet computer sends a first response message to the smart screen to indicate that the first video clip agrees to be received. The intelligent screen and the tablet computer establish wireless connection. The intelligent screen sends a first video clip to the tablet computer through wireless connection. The tablet computer receives a first video clip. The tablet computer displays a file sharing interface to prompt whether to share the first video clip. The tablet computer receives a sharing operation of a user, wherein the sharing operation comprises a selected sharing object (called other electronic devices) and a selected sharing control. And responding to the sharing operation of the user, and sending the first video clip to other electronic equipment by the tablet personal computer.
The above describes in detail the possible implementation manner of the screen recording processing method provided by the embodiment of the present application through the first embodiment and the second embodiment, and the hardware application environment and the software application environment of the screen recording processing method provided by the embodiment of the present application are described below.
According to the scheme, when the intelligent screen receives the screen recording instruction sent by the remote controller in the video playing process, the intelligent screen collects audio and video data of the video picture being displayed in real time, video clips with preset duration are recorded, then the intelligent screen automatically senses nearby available equipment, such as a mobile phone and a tablet computer in a trusted environment, and then the intelligent screen sends the video clips to the mobile phone and the tablet computer respectively. After the user confirms that the video clip is received by the mobile phone, the mobile phone receives and stores the video clip, and the mobile phone also automatically pops up a file sharing window or interface to prompt the user whether the video clip needs to be shared. Further, the mobile phone can share the video clip to other users according to the user requirement. According to the method and the device, after the user triggers, the screen recording process is automatically completed in the background, the user viewing experience is not interrupted, and the user operation steps are reduced, so that the convenience of screen recording operation is improved.
The screen recording processing method provided by the embodiment of the application can be applied to intelligent screens or other electronic equipment with video playing function, such as PC; it should be noted that, when the screen recording processing method is applied to the intelligent screen, the intelligent screen can be triggered to record by pressing the remote controller; when the screen recording processing method is applied to the electronic equipment such as a PC, the intelligent screen can be triggered to record by pressing a shortcut key or a combined key on a keyboard.
The hardware structure of the electronic device 1 (i.e. the first electronic device, here taking a smart screen as an example) according to the embodiment of the present application is exemplarily described below with reference to fig. 8.
Fig. 8 shows a functional block diagram of an intelligent screen provided by an embodiment of the present application. As shown in fig. 8, the smart screen 400 may include: processor 401, memory 402, communication interface 403, audio circuit 404, speaker 405, microphone 406, power supply 407, display 408, etc., which may communicate via one or more communication buses or signal lines (not shown). The following describes the components of the intelligent screen in detail with reference to fig. 8.
The processor 401 is a control center of the smart screen, connects respective portions of the smart screen using various interfaces and lines, and performs various functions of the smart screen and processes data by running or executing an application program stored in the memory 402 and calling data stored in the memory 402. In some embodiments, the processor 401 may include one or more processing units.
The memory 402 is used to store application programs and data, and the processor 401 performs various functions of the smart screen and data processing by running the application programs and data stored in the memory 402. The memory 402 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system, at least one application program required by a function (such as a video playing function, a voice collecting function, etc.); the storage data area may store data (such as video data, audio data, etc.) created according to the use of the smart screen. In addition, the memory 402 may include high-speed random access memory (random access memory, RAM), and may also include non-volatile memory, such as a magnetic disk storage device, flash memory device, or other volatile solid-state storage device, and the like. The memory 402 may store various operating systems. The memory 402 may be independent of the processor 401 and connected to the processor 401 through the communication bus; alternatively, the memory 402 may be integrated with the processor 401.
The smart screen is connected to other devices such as a cell phone or tablet computer through a communication interface 403. By way of example, the communication interface 403 may be a radio frequency circuit, a bluetooth device, a Wi-Fi device, or a signal transmission line interface, for example, for a smart screen to communicate with a cell phone, or a smart screen to communicate with a server, or a smart screen to communicate with a remote control.
The audio circuit 404 is connected to the speaker 405 and the microphone 406, and on the one hand, the audio circuit 404 may transmit the electrical signal after the received audio data is converted to the speaker 405, and the electrical signal is converted to a sound signal by the speaker 405 and output; on the other hand, the microphone 406 converts the collected sound signal (e.g., voice uttered by the user) into an electrical signal, which is received by the audio circuit 404 and converted into audio data (or voice data), and outputs the audio data, e.g., the smart screen sends the voice data to the smart screen, or the smart screen sends the voice data to a server or the like, or the voice data is output to the memory 402 for further processing.
The power supply device 407 may supply power to various components, for example, the power supply device 407 includes a battery and a power management chip, and the battery may be logically connected to the processor 401 through the power management chip, so that functions of managing charging, discharging, power consumption management, and the like are implemented through the power supply device 407.
The display 408 is also referred to as a display. The display may be used to play live video or video-on-demand, etc. The display includes a display panel, which may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, a touch sensor may be disposed in the display to form a touch screen, and embodiments of the present application are not limited. The touch sensor is used to detect a touch operation acting on or near it. The touch sensor may communicate the detected touch operation to the processor 401 to determine the type of touch event. The processor 401 may provide visual output related to the touch operation through the display.
In some embodiments, the smart screen 400 may further include more devices, such as a USB interface, etc., which is not described in detail in the embodiments of the present application. It will be appreciated that the components shown in fig. 8 are not intended to be limiting in detail, and that the smart screen may also include more or fewer components than shown, or may be a combination of certain components, or may be a split of certain components, or may be a different arrangement of components.
In an embodiment of the present application, the smart screen 400 has video playback capabilities, recording capabilities, wireless communication capabilities (e.g., the ability to automatically perceive nearby available devices), and the ability to transmit recorded video clips to other electronic devices.
The methods of the above embodiments may be implemented in a smart screen having the hardware configuration shown in fig. 8. Based on the components shown in fig. 8, an operating system is running. Such as iOS operating systems, android open source operating systems, windows operating systems, and the like. An operating application may be installed on the operating system.
Fig. 9 is a schematic block diagram of a software architecture employed by a first electronic device (e.g., a smart screen) according to an embodiment of the present application. The smart screen provided by the embodiment of the present application is described below with reference to the software architecture shown in fig. 9.
It will be appreciated that the layered architecture divides the software into several layers, each with a clear role and division. The layers communicate with each other through a software interface. In some embodiments, the Android system may include an application layer (APP), a framework layer (FWK), a hardware abstraction layer (hardware abstraction layer, HAL), and a kernel layer (kernel).
The application layers may include a User Interface (UI) layer and a logic layer. As shown in fig. 9, the UI layer includes a video APP, and the logic layer includes a Television (TV) player (TvPlayer), a TV service module (TvService), and a highlight processing module.
In some embodiments, corresponding to the method embodiments described above, the smart screen may play the first video stream through the video APP.
The application framework layer provides application programming interfaces (application programming interface, APIs) and programming services for application programs of the application program layer. The framework layer includes some predefined functions. The framework layer provides programming services to application layer calls through the API interface. It should be noted that, in the embodiment of the present application, the framework layer includes a surfeflinger service module and a media playing service module (MediaPlayer).
The interface element issued by the video APP can be received by the SurfaceFinger service module and subjected to layer composition processing. The media playing service module can carry out audio and video decomposition on the first video stream and then send the first video stream to the decoding module of the hardware abstraction layer.
The hardware abstraction layer plays a role of a bridge between software and hardware, and can be used for abstracting the hardware and providing a virtual hardware use platform for an operating system.
The kernel layer provides the bottom layer driver for various hardware of the intelligent screen. Illustratively, as shown in fig. 9, the kernel layer includes an audio driver module (AudioDriver) and a display driver (not shown).
It will be appreciated that the smart screen also includes a hardware layer based on the software architecture application described above, the hardware layer including various hardware.
Illustratively, as shown in fig. 9, the hardware layer may include a display for implementing a video playback function, e.g., the display is used to play the first video stream. The hardware layer may also include a bluetooth chip or Wi-Fi chip for searching for nearby available devices. The hardware layer may further comprise a speaker for outputting an audio signal of the first video stream, i.e. video sound. The hardware layer may also include a hardware audio-video interface, such as a high definition multimedia interface (high definition multimedia interface, HDMI) or the like.
The scheme of the application can comprise the following steps: the method comprises the steps of collecting an audio code stream and a video code stream in the video playing process, obtaining video clips with preset duration after a user triggers a screen recording, sensing nearby available equipment and transmitting the video clips to the nearby available equipment. Optionally, the video clip is stored by a nearby available device. Optionally, a nearby available device pops up a file sharing interface to prompt the user whether to share the video clip to other users. The implementation of the solution of the present application is exemplarily described below with reference to each functional module in the architecture of fig. 9.
In some embodiments, as shown in fig. 9, the hardware abstraction layer may include a video decoder and an audio decoder. The video decoder receives the video code stream issued by the media playing service module in the application framework layer, and then the video decoder can decode the video code stream. The audio decoder receives an audio code stream issued by the media play service module in the application framework layer, and then the audio decoder can decode the audio code stream.
In some embodiments, as shown in fig. 9, the hardware abstraction layer may further include an on-screen display (on screen display, OSD), a Video Object (VO), and a video synthesizer (VideoMix). The OSD can acquire the layer processed by the SurfaceFlinger service module. The video object obtains a video bitstream from a video decoder. The video synthesizer can synthesize the processed image layer issued by the OSD and the video code stream at the VO of the video object to obtain the video stream to be displayed. The video synthesizer can send the video stream to be sent to a display of the hardware layer, and the display finishes video stream playing.
In some embodiments, as shown in FIG. 9, the hardware abstraction layer includes an audio-video interface. When a TV player of the application program layer starts to play an input source (such as a video stream resource from a video APP), an audio-video interface can be called to trigger the acquisition of a video code stream from a video decoder and the acquisition of an audio code stream from the audio decoder to realize video play. Alternatively, the TV player may initiate the input source to play the video stream asset in accordance with the play command.
In some embodiments, as shown in fig. 9, the hardware abstraction layer includes an audio acquisition module (AudioCapture) and a video acquisition module (screencapture h). The audio acquisition module (AudioCapture) and the video acquisition module (screencapture h) are collectively called as a screen recording service (ScreenRecord).
The screen recording processing method provided by the application comprises an audio acquisition channel and a video acquisition channel. The audio acquisition channel involves an audio decoder, an audio driver (AudioDriver) and an audio acquisition module (AudioCapture). The video acquisition channel involves a video compositor (VideoMix) and a video acquisition module (ScreenCaptureH).
In the audio acquisition channel, an audio acquisition module (AudioCapture) acquires audio data from an audio decoder in real time through an audio driver (AudioDriver) during video playing. Then, an audio acquisition module (AudioCapture) reports the audio data (also referred to as an audio code stream) acquired in real time to a TV service module. The audio data may be buffered and encoded to obtain a pulse code modulated (pulse code modulation, PCM) audio code stream.
In the video acquisition channel, a video acquisition module (ScreenCaptureH) acquires video data from a video synthesizer (VideoMix) in real time in the video playing process, and then reports the video data (also called video code stream) acquired in real time to a TV service module.
Accordingly, the TV service module may receive the audio code stream reported by the audio acquisition module and the video code stream reported by the video acquisition module. The TV service module can also perform audio and video synchronization processing on the audio code stream and the video code stream to obtain a video stream after audio and video synchronization. The TV service module can realize sound and picture synchronization through timestamp synchronization calculation.
The highlight moment processing module can sense the screen recording command and perform recording processing on video resources (including video data and audio data) being played according to the screen recording command. Specifically, when the highlight moment processing module receives the screen recording instruction, the highlight moment processing module obtains a video stream with a preset duration (for example, 15 seconds) from the TV service module, that is, the first video clip, according to a preset screen recording strategy.
Illustratively, the preset recording strategy may include any of the following: selecting a 15-second video stream before a screen recording time node (for example, at the moment of receiving a screen recording instruction) as a first video segment; and selecting a 15-second video stream before the recording time node as a first video clip. Or a 5-second video stream before the screen recording time node and a 10-second video stream after the screen recording time node can be selected as the first video clip; and selecting the 10-second video stream before the recording time node and the 5-second video stream after the recording time node as the first video clip.
It will be appreciated that, for exemplary purposes, the preset duration and the recording period may be specifically set according to actual use requirements, which is not limited by the embodiment of the present application.
Optionally, the highlight moment processing module may further add a watermark to the first video segment. Illustratively, when watermarking, the video may be fetched frame by frame and subjected to a series of steps of decoding, watermark synthesis, encoding, etc.
Optionally, the highlight processing module may further generate a preview cover of the first video segment according to the first frame image of the video.
In the case where the highlight-time processing module acquires a first video clip of a preset duration (e.g., 15 seconds), the highlight-time processing module instructs a wireless communication service module (not shown in fig. 9) to perform a close-range device scan and transmit the first video clip to the searched available device. Further, the wireless communication service module issues a message for scanning the short-range device to wireless communication hardware such as a Bluetooth BT or Wi-Fi module according to the instruction of the highlight processing module.
Further, wireless communication hardware such as bluetooth BT or Wi-Fi modules scans devices in a trusted environment for close range devices to perceive available devices in the vicinity. After sensing a nearby available device (e.g., a cell phone), wireless communication hardware such as a bluetooth BT or Wi-Fi module establishes a wireless communication connection with the nearby available device.
Further, the highlight moment processing module transmits the first video clip obtained by screen recording to nearby available equipment through the wireless communication connection, so that a user can store the first video clip and/or share the first video clip to other users through the nearby available equipment.
The hardware architecture and the software architecture of the intelligent screen provided by the embodiment of the application are respectively described above with reference to fig. 8 and 9. The following describes the principle and process of playing video by the smart screen in conjunction with fig. 10, and describes the principle and process of recording video when playing video by the smart screen in conjunction with fig. 11.
As shown in fig. 10, when the user triggers the smart screen to play the video, the smart screen first obtains the video file and puts the video file into the memory buffer. These video files are encapsulated format data, including audio and video streams. The package format may be AVI, MOV, MP4, etc. and the video file may be visually understood as a container containing various encoded data. After the video file is obtained, the intelligent screen performs unpacking format processing on the video file, and separates the video code stream from the audio code stream to obtain audio compression data and video compression data. Further, the intelligent screen decodes the audio compressed data to obtain audio sampling data, and decodes the video compressed data to obtain video pixel data. And then the intelligent screen synchronously processes the audio sampling data and the video pixel data to obtain video data to be played. Finally, based on the video data to be played, a video picture is displayed on the display and video sound is output through the speaker.
As shown in fig. 11, the first video stream generates audio sample data after audio decoding and generates video pixel data after video decoding, i.e., the first video stream includes the audio sample data and the video pixel data. During the process of playing the first video stream by the smart screen, when the smart screen receives the screen recording command, audio data with a preset duration (for example, 15 seconds before receiving the screen recording command) can be obtained from the audio sampling data, and video data with the same preset duration (for example, 15 seconds before receiving the screen recording command) can be obtained from the video pixel data. And then, carrying out synchronous processing on the audio data and the video data to obtain the video data to be played, namely a first video clip.
According to the scheme, when a user uses the intelligent screen to watch the video, the intelligent screen can record the video highlight at any time according to the user indication and automatically transmit the video highlight to the mobile phone and other devices in the trusted environment, so that the user can share in real time.
The screen recording processing method provided by the embodiment of the application can be applied to the electronic device 2 (namely, the second electronic device, such as a mobile phone or a tablet personal computer) shown in fig. 12. Fig. 12 is a schematic structural view of the electronic device 2. Among other things, the electronic device 500 may include: processor 510, external memory interface 520, internal memory 521, universal serial bus (universal serial bus, USB) interface 530, charge management module 540, power management module 541, battery 542, antenna 1, antenna 2, mobile communication module 550, wireless communication module 560, audio module 570, speaker 570A, receiver 570B, microphone 570C, headset interface 570D, sensor module 580, keys 590, motor 591, indicator 592, camera 593, display 594, and subscriber identity module (subscriber identification module, SIM) card interface 595, among others.
It is to be understood that the configuration illustrated in this embodiment does not constitute a specific limitation on the electronic apparatus. In other embodiments, the electronic device may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 510 may include one or more processing units, such as: processor 510 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The controller may be a neural hub and command center of the electronic device. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 510 for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. The memory may hold instructions or data that has just been used or recycled by the processor 510. If the processor 510 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 510 is reduced, thereby improving the efficiency of the system.
In some embodiments, processor 510 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others. For example, in the embodiment of the present application, the processor may be configured to execute any of the screen recording processing methods proposed in the present application.
It should be understood that the connection relationship between the modules illustrated in this embodiment is only illustrative, and does not limit the structure of the electronic device. In other embodiments, the electronic device may also use different interfacing manners in the foregoing embodiments, or a combination of multiple interfacing manners.
The electronic device implements display functions through a GPU, a display screen 594, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 510 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 594 is used to display images, videos, and the like. The display screen 594 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-LED, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like.
Video codecs are used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent cognition of electronic devices can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.
The external memory interface 520 may be used to connect external memory cards, such as Micro SD cards, to enable expansion of the memory capabilities of the electronic device. The external memory card communicates with the processor 510 via an external memory interface 520 to implement data storage functions. For example, a file such as a recorded video is stored in an external memory card.
The internal memory 521 may be used to store computer-executable program code that includes instructions. The processor 510 executes various functional applications of the electronic device and data processing by executing instructions stored in the internal memory 521. For example, in an embodiment of the present application, the processor 510 may be configured to execute instructions stored in the internal memory 521, and the internal memory 521 may include a stored program area and a stored data area.
The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device (e.g., audio data, phonebook, etc.), and so forth. In addition, the internal memory 521 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.
The wireless communication function of the electronic device 500 may be implemented by the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in electronic device 500 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 550 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 500. The mobile communication module 550 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 550 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 550 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 550 may be disposed in the processor 510. In some embodiments, at least some of the functional modules of the mobile communication module 550 may be disposed in the same device as at least some of the modules of the processor 510.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 570A, receiver 570B, etc.) or displays images or video through display screen 594. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 550 or other functional module, independent of the processor 510.
The wireless communication module 560 may provide solutions for wireless communication including WLAN (e.g., wi-Fi), BT, global navigation satellite system (global navigation satellite system, GNSS), FM, NFC, IR, or general 2.4G/5G wireless communication technology, etc., as applied on the electronic device 500. The wireless communication module 560 may be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 510. The wireless communication module 560 may also receive a signal to be transmitted from the processor 510, frequency modulate and amplify the signal, and convert the signal to electromagnetic waves through the antenna 2 for radiation.
In some embodiments, the wireless communication module 560 may be a Wi-Fi and/or bluetooth chip. The electronic device 500 may establish a connection with the chip of the smart screen through the chip to enable wireless communication and service processing between the electronic device 500 and other electronic devices through the connection. Among other things, bluetooth chips can typically support BR/EDR bluetooth and BLE.
In the embodiment of the present application, the electronic device 500 may be a mobile phone or a tablet computer. The electronic device 500 has wireless communication capabilities and data transmission capabilities.
It should also be noted that, in the embodiment of the present application, "greater than" may be replaced with "greater than or equal to", "less than or equal to" may be replaced with "less than", or "greater than or equal to" may be replaced with "greater than", "less than" may be replaced with "less than or equal to".
The various embodiments described herein may be separate solutions or may be combined according to inherent logic, which fall within the scope of the present application.
It will be appreciated that the methods and operations described above as being performed by an electronic device in various method embodiments may also be performed by components (e.g., chips or circuits) that may be used in an electronic device.
The method embodiments provided by the present application are described above, and the device embodiments provided by the present application will be described below. It should be understood that the descriptions of the apparatus embodiments and the descriptions of the method embodiments correspond to each other, and thus, descriptions of details not described may be referred to the above method embodiments, which are not repeated herein for brevity.
The foregoing describes the solution provided by the embodiments of the present application primarily from the perspective of method steps. It will be appreciated that, in order to implement the above-described functions, an electronic device implementing the method includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The embodiment of the application can divide the functional modules of the electronic device according to the method example, for example, each functional module can be divided corresponding to each function, or two or more functions can be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other possible division manners may be implemented in practice. The following description will take an example of dividing each functional module into corresponding functions.
Fig. 13 is a schematic block diagram of a recording processing apparatus 600 according to an embodiment of the present application. The apparatus 600 may be used to perform the actions performed by the first electronic device (i.e., the electronic device 1) in the above method embodiments. The apparatus 600 includes a video playing unit 610, a receiving unit 620, a recording processing unit 630, and a wireless communication unit 640.
The receiving unit 620 receives a first operation of a user during the process of playing the first video stream by the video playing unit 810, where the first operation is used to trigger recording of a video clip with a preset duration;
The screen recording processing unit 630 is configured to obtain, in response to a first operation, a first video segment of a preset duration from a first video stream, where the first video segment is a video stream before and/or after a first time in the first video stream;
and a wireless communication unit 640 for automatically performing a short-range device scan and transmitting the first video clip to the nearby available device when the nearby available device is searched.
According to the scheme provided by the application, the screen recording processing device 600 (such as a smart screen or a smart television) can automatically record video clips (such as highlight time considered by a user) in the background without interrupting the video watching, and can automatically sense nearby available devices such as a mobile phone or a tablet computer and transmit the recorded video clips to the nearby available devices so as to store the video clips locally or share the video clips to other users through the nearby available devices. According to the method and the device, after the user triggers, the screen recording process is automatically completed in the background, the user viewing experience is not interrupted, and the user operation steps are reduced, so that the convenience of screen recording operation is improved.
In some possible implementations, the screen recording processing device 600 is a smart screen, and the nearby available devices are mobile phones or tablet computers. According to the scheme, when a user uses the intelligent screen to watch the video, the intelligent screen can record the video highlight at any time according to the user indication and automatically transmit the video highlight to the mobile phone and other devices in the trusted environment, so that the user can share in real time.
It will be appreciated that during recording of video, the playing of the first video stream is not interrupted.
In some possible implementations, the first time is a time when the first operation is received by the recording processing device 600.
In some possible implementations, the preset duration is 15 seconds.
In some possible implementations, after the recording processing apparatus 600 sends the first video clip to the nearby available device, the nearby available device receives and stores the first video clip.
In some possible implementations, after the recording processing apparatus 600 sends the first video clip to the available nearby device, the available nearby device automatically pops up the file sharing interface to prompt whether to share the first video clip.
In some possible implementations, after the nearby available device automatically pops up the file sharing interface, the nearby available device receives a second operation of the user on the file sharing interface, where the second operation is used to confirm sharing the first video clip to other electronic devices; in response to the second operation, the nearby available device transmits the first video clip to the other electronic device.
The apparatus 600 according to the embodiment of the present application may correspond to performing the method described in the embodiment of the present application, and the above and other operations and/or functions of the units in the apparatus 600 are respectively for implementing the corresponding flows of the method, which are not described herein for brevity.
Optionally, in some embodiments, the present application provides a chip coupled to a memory, the chip being for reading and executing a computer program or instructions stored in the memory to perform the methods of the embodiments described above.
Optionally, in some embodiments, the present application provides an electronic device comprising a chip for reading and executing a computer program or instructions stored in a memory, such that the method in the embodiments is performed.
Optionally, in some embodiments, the present application further provides a computer readable storage medium storing a program code, which when run on a computer, causes the computer to perform the method in the above embodiments.
Optionally, in some embodiments, the present application also provides a computer program product comprising computer program code for causing a computer to perform the method of the embodiments described above when the computer program code is run on the computer.
Those of ordinary skill in the art will appreciate that the elements and steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (27)

1. A screen recording processing method is characterized by comprising the following steps:
in the process that a first electronic device plays a first video stream, the first electronic device receives a first operation of a user, wherein the first operation is used for triggering recording of video clips with preset duration;
Responding to a first operation, the first electronic device obtains a first video clip of the preset duration from the first video stream, wherein the first video clip is a video stream before and/or after a first moment in the first video stream;
the first electronic device automatically performs short-range device scanning;
the first electronic device searches for a second electronic device;
the first electronic device sends the first video clip to the second electronic device.
2. The method of claim 1, wherein the playing of the first video stream is uninterrupted during the recording of the video.
3. The method according to claim 1 or 2, wherein the first time is a time when the first operation is received by the first electronic device, and the preset duration is 15 seconds.
4. A method according to any one of claims 1 to 3, wherein the first video clip is a video stream of the first video stream of the preset duration before a first time;
the method further comprises the steps of:
in the process that the first electronic equipment plays the first video stream, the first electronic equipment caches video clips once every the preset duration;
After each time the video clip is cached, the first electronic device deletes the cached video clip under the condition that the first electronic device does not receive the first operation.
5. The method of any of claims 1-4, wherein after the first electronic device transmits the first video clip to the second electronic device, the method further comprises:
the second electronic device receives and stores the first video clip.
6. The method of any of claims 1-5, wherein after the first electronic device transmits the first video clip to the second electronic device, the method further comprises:
and the second electronic equipment automatically pops up a file sharing interface to prompt whether to share the first video clip.
7. The method of any of claims 1-6, wherein after the second electronic device automatically pops up a file sharing interface, the method further comprises:
the second electronic device receives a second operation of a user on the file sharing interface, wherein the second operation is used for confirming that the first video clip is shared to a third electronic device;
In response to the second operation, the second electronic device sends the first video clip to the third electronic device.
8. The method of any of claims 1-7, wherein after the first electronic device searches for a second electronic device, the method further comprises:
the first electronic device sends a first prompt message to the second electronic device, wherein the first prompt message is used for prompting whether to agree to receive the first video clip.
9. The method of claim 8, wherein after the first electronic device sends a first alert message to the second electronic device, the method further comprises:
the second electronic equipment receives and displays the first prompt message sent by the first electronic equipment;
the second electronic device receives a third operation of a user, wherein the third operation is used for confirming the receiving of the first video clip;
in response to the third operation, the second electronic device sends a first response message to the first electronic device, the first response message being used to prompt that the first video clip agrees to be received.
10. The method according to claim 9, wherein the method further comprises:
The first electronic device receives the first response message sent by the second electronic device.
11. The method according to any one of claims 1 to 10, further comprising:
the first electronic device establishes a wireless channel with the second electronic device;
wherein the first electronic device sending the first video clip to the second electronic device, comprising: and the first electronic equipment sends the first video clip to the second electronic equipment through the wireless channel.
12. The method of claim 11, wherein the wireless channel is a Wi-Fi channel or a bluetooth channel.
13. The method of any of claims 1-12, wherein prior to the first electronic device establishing a wireless channel with the second electronic device, the method further comprises:
the first electronic device stores historical connection data of a plurality of electronic devices successfully connected with the first electronic device, and the plurality of electronic devices comprise the second electronic device.
14. The method of claim 13, wherein the first electronic device establishes a wireless channel with the second electronic device, comprising:
When the first electronic equipment initiates connection with the second electronic equipment, the first electronic equipment directly establishes wireless connection with the second electronic equipment according to the historical connection data.
15. The method of any of claims 1-14, wherein after the first electronic device transmits the first video clip to the second electronic device, the method further comprises:
the first electronic device receives a second response message sent by the second electronic device, where the second response message is used to indicate that the first video segment has been successfully received.
16. The method of any one of claims 1 to 15, wherein the first electronic device searches for a second electronic device, comprising:
the first electronic device searches the second electronic device through a Bluetooth scanning mode or a Wi-Fi scanning mode.
17. The method according to any one of claims 1 to 16, further comprising:
the first electronic device also searches for a fourth electronic device;
the first electronic device sends a first prompt message to the fourth electronic device, wherein the first prompt message is used for prompting whether to receive the first video clip.
18. The method of claim 17, wherein after the first electronic device sends a first alert message to the fourth electronic device, the method further comprises:
the fourth electronic device receives and displays the first prompt message.
19. The method according to any one of claims 1 to 18, further comprising:
the first electronic equipment is in wireless connection with the remote control device; the remote control device is provided with a first control used for triggering video recording;
and responding to the operation of the user on the first control of the remote control device, and sending a video recording instruction to the first electronic equipment by the remote control device, wherein the video recording instruction is used for triggering the recording of the video clips with the preset duration.
20. The method of claim 19, wherein the step of determining the position of the probe comprises,
the first electronic device receives a first operation of a user, including: the first electronic equipment receives the video recording instruction sent by the remote control device;
the first electronic device, in response to a first operation, obtains a first video clip from the first video stream, comprising: and responding to the video recording instruction, and acquiring the first video clip from the first video stream by the first electronic equipment.
21. The method of any of claims 1-20, wherein the first electronic device obtaining a first video clip from the first video stream comprises:
the first electronic device acquires and stores first video data in the preset duration from the first video stream, wherein the first video data comprises multi-frame images;
the first electronic device acquires and stores first audio data in the preset duration from the first video stream;
and the first electronic equipment synchronously processes and synthesizes the first video data and the first audio data to obtain the first video clip.
22. The method of claim 21, wherein the method further comprises:
the first electronic device uses the first frame image in the first video data as a preview cover image of the first video clip.
23. The method of claim 22, wherein the method further comprises:
after the second electronic device receives the first video clip, the second electronic device displays the preview cover image.
24. The method of any one of claims 1 to 23, wherein the first electronic device is a smart screen and the second electronic device is a cell phone or tablet.
25. An electronic device comprising a processor coupled to a memory, the processor for executing a computer program or instructions stored in the memory to cause the electronic device to implement the method of any one of claims 1-24.
26. A chip comprising a processor coupled to a memory, the processor for executing a computer program or instructions stored in the memory to cause the chip to implement the method of any one of claims 1 to 24.
27. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when run on an electronic device, causes the electronic device to perform the method of any one of claims 1 to 24.
CN202210334286.1A 2022-03-31 2022-03-31 Screen recording processing method and electronic equipment Pending CN116939277A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210334286.1A CN116939277A (en) 2022-03-31 2022-03-31 Screen recording processing method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210334286.1A CN116939277A (en) 2022-03-31 2022-03-31 Screen recording processing method and electronic equipment

Publications (1)

Publication Number Publication Date
CN116939277A true CN116939277A (en) 2023-10-24

Family

ID=88392879

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210334286.1A Pending CN116939277A (en) 2022-03-31 2022-03-31 Screen recording processing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN116939277A (en)

Similar Documents

Publication Publication Date Title
CN110109636B (en) Screen projection method, electronic device and system
US20230094272A1 (en) Notification Processing System, Method, and Electronic Device
US11669242B2 (en) Screenshot method and electronic device
CN113542839B (en) Screen projection method of electronic equipment and electronic equipment
CN114040242B (en) Screen projection method, electronic equipment and storage medium
CN113556479B (en) Method for sharing camera by multiple applications and electronic equipment
CN114185503B (en) Multi-screen interaction system, method, device and medium
CN112615960A (en) Equipment capacity scheduling method and electronic equipment
CN114691059B (en) Screen-throwing display method and electronic equipment
CN114173193A (en) Multimedia stream playing method and electronic equipment
CN115756270B (en) Content sharing method, device and system
CN114063951B (en) Screen projection abnormity processing method and electronic equipment
CN116170629A (en) Method for transmitting code stream, electronic equipment and computer readable storage medium
CN115686401A (en) Screen projection method, electronic equipment and system
CN113946302B (en) Method and device for opening file
US20230350629A1 (en) Double-Channel Screen Mirroring Method and Electronic Device
CN115119048B (en) Video stream processing method and electronic equipment
CN112351411B (en) Information transmission method and electronic equipment
CN116033342B (en) Geofence processing method, equipment and storage medium
CN117873367A (en) Split screen display method and related device
CN116939277A (en) Screen recording processing method and electronic equipment
CN116033204B (en) Screen recording method, electronic equipment and storage medium
CN116055613B (en) Screen projection method and device
CN115460445B (en) Screen projection method of electronic equipment and electronic equipment
CN117135385A (en) Multi-device collaborative screen recording and sharing method, electronic device and communication system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination