CN117135385A - Multi-device collaborative screen recording and sharing method, electronic device and communication system - Google Patents

Multi-device collaborative screen recording and sharing method, electronic device and communication system Download PDF

Info

Publication number
CN117135385A
CN117135385A CN202310356443.3A CN202310356443A CN117135385A CN 117135385 A CN117135385 A CN 117135385A CN 202310356443 A CN202310356443 A CN 202310356443A CN 117135385 A CN117135385 A CN 117135385A
Authority
CN
China
Prior art keywords
video
screen
electronic device
electronic equipment
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310356443.3A
Other languages
Chinese (zh)
Inventor
何小涛
张剑
王飞
李金鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202310356443.3A priority Critical patent/CN117135385A/en
Publication of CN117135385A publication Critical patent/CN117135385A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Abstract

The application provides a method for collaborative recording and sharing of multiple devices, electronic devices and a communication system, and relates to the technical field of electronics. According to the scheme, in the process of playing the video by the first electronic equipment (such as the intelligent screen), a user operates on the remote controller, the intelligent screen can be triggered to automatically record video clips (such as 15 seconds highlight time) with a first preset time length in the background, the user is prompted to share by automatically popup windows after recording is completed, and after the user selects a certain equipment, the intelligent screen automatically transmits the video to the equipment; the user can operate on a third electronic device (such as a mobile phone), and the intelligent screen can be triggered to automatically record the video clips in the background, and automatically transmit the video to the mobile phone after the video clips are recorded, so that the user does not need to operate. When video is recorded and shared, the intelligent screen continuously plays the live program, and the live program is not affected, so that the video recording and sharing can be realized without interrupting the playing of the live program, the operation of a user is convenient and quick, and the use experience of the user can be improved.

Description

Multi-device collaborative screen recording and sharing method, electronic device and communication system
Technical Field
The present application relates to the field of electronic technologies, and in particular, to a method for collaborative recording and sharing of multiple devices, an electronic device, a communication system, and a storage medium.
Background
When a user views a video through a smart screen, the user may have a need to store highlight clips in the video (e.g., highlight clips of a football goal, or highlight episodes of a television show, etc.), or share the highlight clips with other users.
The user can use the smart screen with the screen recording function to return to the content highlight for recording by looking back or backing back. However, this screen recording method has the following disadvantages: the user viewing experience is interrupted; recording is performed through operation review or fast-backing, so that the operation is complex, the time consumption is long, and the recording is inconvenient for users. And when sharing demands exist, users are required to manually transmit video clips recorded by the intelligent screen to other devices such as a mobile phone, and then share the video clips to other users through the mobile phone, so that the operation is inconvenient.
Disclosure of Invention
The application provides a multi-device collaborative screen recording and sharing method, electronic equipment, a communication system and a storage medium, so as to improve the convenience of intelligent screen recording and sharing.
In order to achieve the above purpose, the application adopts the following technical scheme:
in a first aspect, the present application provides a method for collaborative recording and sharing of multiple devices, where the method includes:
At a first moment, a first electronic device receives a first screen recording command sent by a remote controller, wherein the first screen recording command is generated after a user operates a first key of the remote controller;
responding to the first screen recording command, and the first electronic equipment acquires a first video clip with a first preset duration before the first moment from a video picture being played;
the first electronic device hovers over a video picture being played to display an identification of one or more nearby available devices;
in response to a user selecting an identification of a second electronic device via the remote control, the first electronic device transmitting the first video clip to the second electronic device, the second electronic device being any one of the one or more nearby available devices;
at a second moment, the first electronic equipment receives a second screen recording command sent by the third electronic equipment, wherein the second screen recording command is generated after a user operates a first control in an interface of a first application, and the first application is an application program installed by the third electronic equipment;
responding to the second screen recording command, and the first electronic equipment acquires a second video clip with the first preset duration before the second moment from a video picture being played;
The first electronic device sends the second video clip to the third electronic device.
According to the multi-device collaborative recording and sharing method provided by the embodiment of the application, in the process of playing video by a first electronic device (such as a smart screen), a user can operate on a remote controller, the smart screen can be triggered to automatically record video clips (such as 15 seconds highlight time) with a first preset duration in the background, and after recording is completed, the user is prompted to share by automatically popup windows, and after the user selects a certain device, the smart screen automatically transmits the video to the device; the user can operate on a third electronic device (such as a mobile phone), and the intelligent screen can be triggered to automatically record the video clips in the background, and automatically transmit the video to the mobile phone after the video clips are recorded, so that the user does not need to operate. When video is recorded and shared, the intelligent screen continuously plays the live program, and the live program is not affected, so that the video recording and sharing can be realized without interrupting the playing of the live program, the operation of a user is convenient and quick, and the use experience of the user can be improved.
The remote controller and the first electronic equipment are in wireless connection through infrared rays.
The first preset duration may be 15 seconds, and the smart screen may record 15 seconds of highlight video.
The third electronic device and the second electronic device may be the same or different. The first electronic device may be an intelligent screen, the second electronic device may be a smart device such as a mobile phone, a tablet or an intelligent screen, and the third electronic device may be a mobile phone or a tablet.
The first application is an application program for multi-device collaborative processing of services. The first application may also be referred to as a smart space application. For example, after the smart space application is installed on the mobile phone and the mobile phone is bound with the smart screen through the smart space application, the mobile phone has the basic function of the remote controller, and can control the smart screen to play, pause, fast forward or fast backward video, and control the smart screen to run the highlight time recording function, i.e. to record highlight time. Thus, the cell phone may also be referred to as a "cell phone remote control".
The embodiment of the application provides two ways for realizing the recording and sharing of the wonderful time of the intelligent screen, and the remote controller and the smart space application of the mobile phone can trigger the wonderful time recording function of the intelligent screen. On one hand, the user triggers the intelligent screen after pressing the OK key of the remote controller for a long time, and the intelligent screen stores the video 15 seconds before receiving the triggering and displays the sharing interface; the user selects the sharing control by operating on the remote controller; the intelligent screen pops up the equipment selection interface; the user selects one device by operating on the remote controller, so that video sharing is realized. On the other hand, the user triggers through the mobile phone remote controller, the intelligent screen stores the video 15 seconds before after receiving the triggering, displays the sharing interface, sends the video to the mobile phone, pops up a receiving frame on the mobile phone, and the user confirms the receiving; the mobile phone receives the video and jumps to the gallery, so that the video can be further shared. For a user, the intelligent screen recording can be triggered through the remote controller, and the intelligent screen recording can be triggered through the application on the mobile phone, so that the video recording and sharing operation is convenient and quick, and the user experience can be improved.
In a possible implementation manner of the first aspect, the first electronic device and the third electronic device are two devices that log in to the same wireless local area network using the same account number.
Before the first electronic device receives the second screen recording command sent by the third electronic device, the method further comprises the following steps: in response to a first operation by a user, the first electronic device establishes a wireless local area network, WLAN, connection with a third electronic device.
In a possible implementation manner of the first aspect, the sending, by the first electronic device, the first video clip to the second electronic device includes: the first electronic device judges whether the second electronic device is the device with the same account as the first electronic device; when the second electronic equipment is equipment with the same account number as the first electronic equipment, the first electronic equipment sends a first video clip to the second electronic equipment; when the second electronic equipment is equipment with different account numbers with the first electronic equipment, the first electronic equipment sends a first request message to the second electronic equipment, the first electronic equipment receives a first response message sent by the second electronic equipment, and the first electronic equipment responds to the first response message and sends a first video clip to the second electronic equipment. The first request message is a message for requesting the second electronic device to receive the first video clip, and the first response message is a message for the second electronic device to confirm to receive the first video clip.
Through the scheme, in some embodiments, when the mobile phone with the same account number as the smart screen is used as a 'mobile phone remote controller', the mobile phone pops up a receiving prompt box, and after the user confirms the receiving, the mobile phone receives the video. In other embodiments, when the mobile phone with the same account number as the smart screen is used as the "mobile phone remote controller", the mobile phone may not pop up the prompt box, and the mobile phone side directly receives the video. The realization of video recording and sharing can not interrupt the playing of the live program, so that the user operation is convenient and fast, and the user experience can be improved.
In a possible implementation manner of the first aspect, the first electronic device obtains a first video clip of a first preset duration before a first time from a video frame being played, including: when the first electronic equipment meets the preset condition, the first electronic equipment acquires a first video clip from a video picture being played.
In a possible implementation manner of the first aspect, the first electronic device obtains, from a video frame being played, a second video segment of a first preset duration before a second time, including: when the first electronic equipment meets the preset condition, the first electronic equipment acquires a second video clip from the video picture being played;
Wherein, the preset conditions include: the first electronic equipment starts a first function, the first electronic equipment plays a video picture, the playing time of the first electronic equipment is longer than or equal to a first preset time, and the number of times that the first electronic equipment is triggered to record a screen in a second preset time is smaller than a preset time threshold. The first function is a function of recording back video, and may also be referred to as a highlight instant recording function.
In a possible implementation manner of the first aspect, the obtaining, by the first electronic device, a second video segment of a first preset duration before a second moment from a video frame being played includes: when the first electronic equipment does not start the first function, the first electronic equipment suspends and displays a first window on a video picture being played, wherein the first window contains a message for prompting a user to start the first function; in response to a user confirming an operation of turning on the first function, the first electronic device acquires a second video clip from a video picture being played.
In a possible implementation manner of the first aspect, the method further includes: and responding to the first screen recording command or the second screen recording command, and when the picture displayed by the first electronic equipment is not a video picture, prompting that the current interface does not support recording by the first electronic equipment.
In a possible implementation manner of the first aspect, the method further includes: responding to a first screen recording command or a second screen recording command, when the played time length of the first electronic equipment is smaller than a first preset time length, prompting the first electronic equipment to trigger screen recording after the time length delta T, and sending a message requesting to trigger screen recording again later to the third electronic equipment. Wherein, Δt is the difference between the first preset duration and the played duration.
In a possible implementation manner of the first aspect, the method further includes: responding to the first screen recording command, when the number of times that the first electronic equipment is triggered to record the screen in the second preset time length is greater than or equal to a preset number of times threshold, prompting the first electronic equipment to trigger the screen recording after the time length X, and sending a message requesting to trigger the screen recording again later to the third electronic equipment.
Illustratively, the second preset duration is 10 minutes and the preset number of times threshold may be 8 times.
In a possible implementation manner of the first aspect, the method further includes: when the first electronic equipment receives a screen recording command for the first time, the first electronic equipment starts a timer and starts a counter, the counter is added with one, and the timer starts to count from zero; the screen recording command is a first screen recording command or a second screen recording command; every time the first electronic equipment receives a screen recording command, the counter is added one in an accumulated way; and when the timer is greater than or equal to the second preset time length, the first electronic equipment resets the timer and resets the counter.
When the number of times that the first electronic device is triggered to record a screen in a second preset time period is greater than or equal to a preset number of times threshold, the first electronic device prompts that the screen is triggered again after the time period X, and the method comprises the following steps: when the timer is smaller than the second preset time length and the cumulative value of the counter is larger than or equal to the preset time threshold, the first electronic device prompts that the screen recording is triggered after the time length X is the difference value between the second preset time length and the time length of the timer.
In a possible implementation manner of the first aspect, the first electronic device sends the second video clip to the third electronic device, including: when the network of the first electronic equipment is switched, the first electronic equipment prompts that the video transmission is stopped due to the network change and prompts a user to perform network switching, and sends a message of stopping the video transmission due to the network change to the third electronic equipment; in the event that the network of the first electronic device adjusts to be consistent with the network of the third electronic device, the first electronic device continues to send the second video clip to the third electronic device.
In a possible implementation manner of the first aspect, when the first electronic device sends the second video clip to the third electronic device, the method further includes: the first electronic device receives a stop receiving message sent by the third electronic device; the first electronic device stops sending the second video clip to the third electronic device in response to stopping receiving the message.
In a possible implementation manner of the first aspect, before the first electronic device hovers over a video screen being played to display an identification of one or more nearby available devices, the method further includes: the first electronic equipment suspends and displays a second window and first prompt information on a video picture being played, wherein the second window displays a first frame image of a first video clip, and the first prompt information is used for prompting whether the first video clip is shared or not; the first electronic equipment receives a confirmation command sent by the remote controller, wherein the confirmation command is a command generated after a user operates on the remote controller.
Wherein the first electronic device hovers over the video picture being played to display an identification of one or more nearby available devices, comprising: in response to the confirmation command, the first electronic device hovers over the video picture being played with an identification of one or more nearby available devices.
Through the scheme, in the video playing process, the user is responded to trigger the screen recording operation, the first electronic equipment (such as the intelligent screen) automatically records video clips in the background, the user is prompted whether to share by the automatic popup window after recording, the user confirms to share the nearby available equipment in the intelligent screen automatic search and displays the searched equipment for user selection, after the user selects a certain equipment, the intelligent screen automatically transmits the video to the equipment, the intelligent screen continuously plays live programs in the process, the live programs cannot be influenced, and therefore the video recording and sharing can not interrupt the playing of the live programs, and the user experience is improved.
In a possible implementation manner of the first aspect, before the first electronic device hovers over a video screen being played to display an identification of one or more nearby available devices, the method further includes: the first electronic device searches for one or more nearby available devices via bluetooth technology. Wherein each of the one or more nearby available devices is in a bright screen state.
In a possible implementation manner of the first aspect, the method further includes: in the process that the first electronic equipment plays the video picture, the first electronic equipment periodically caches video clips, and the first video clips and the second video clips are respectively obtained based on the cached video clips; if the first electronic equipment does not receive the screen recording command in the first period, the first electronic equipment deletes the video clips cached in the second period, and the second period is earlier than the first period.
In a possible implementation manner of the first aspect, the method further includes: after the first electronic device acquires a first video clip of a first preset duration before a first moment from a video picture being played, the first electronic device stores the first video clip into a gallery of the first electronic device; after the first electronic device acquires the second video clip of the first preset duration before the second moment from the video picture being played, the first electronic device stores the second video clip in a gallery of the first electronic device.
Through the scheme, after 15 seconds of wonderful video is recorded back on the intelligent screen, the intelligent screen can automatically save the 15 seconds of wonderful video to the intelligent screen gallery besides prompting the user to share the video.
In a second aspect, the present application provides a method for collaborative recording and sharing of multiple devices, including: the third electronic equipment displays an interface of a first application, wherein the interface of the first application comprises a first control, and the first application is an application program installed on the third electronic equipment; responding to the operation of the user on the first control at the second moment, and transmitting a screen recording command to the first electronic equipment by the third electronic equipment; and the third electronic equipment receives the recorded video sent by the first electronic equipment, wherein the recorded video is a video clip which is recorded based on a screen recording command and is of a first preset duration before the second moment.
According to the multi-device collaborative recording and sharing method provided by the embodiment of the application, in the process of playing video by the first electronic device (such as the intelligent screen), a user can operate on the third electronic device (such as the mobile phone), the intelligent screen can be triggered to automatically record video clips (such as 15 seconds wonderful time) in the background, and the video is automatically transmitted to the mobile phone after recording is completed without user operation. When video is recorded and shared, the intelligent screen continuously plays the live program, and the live program is not affected, so that the video recording and sharing can be realized without interrupting the playing of the live program, the operation of a user is convenient and quick, and the use experience of the user can be improved.
In some embodiments, the third electronic device installs the first application, and an icon of the first application is displayed in a desktop of the third electronic device. The third electronic device displays an interface of the first application, including: and responding to the operation of the user on the icon of the first application, and displaying an interface of the first application by the third electronic equipment.
The third electronic device may be a mobile phone or a tablet, and the first electronic device may be an intelligent screen.
The first preset duration may be 15 seconds, and the smart screen may record 15 seconds of highlight video.
The first application is an application program for multi-device collaborative processing of services. The first application may also be referred to as a smart space application. For example, after the smart space application is installed on the mobile phone and the mobile phone is bound with the smart screen through the smart space application, the mobile phone has the basic function of the remote controller, and can control the smart screen to play, pause, fast forward or fast backward video, and control the smart screen to run the highlight time recording function, i.e. to record highlight time. Thus, the cell phone may also be referred to as a "cell phone remote control".
In a possible implementation manner of the second aspect, the method further includes: and in the process that the third electronic equipment receives the recorded video sent by the first electronic equipment, the third electronic equipment displays video receiving information, wherein the video receiving information comprises video receiving progress information and the size of occupied space of the video to be received.
In a possible implementation manner of the second aspect, the video receiving information further includes a stop control, and the method further includes: and responding to the operation of the user on the stop control, and stopping receiving the recorded video by the third electronic equipment.
In a possible implementation manner of the second aspect, after the third electronic device receives the recorded video sent by the first electronic device, the method further includes: the third electronic equipment pulls up the gallery application and jumps to the gallery interface; the third electronic equipment displays the recorded video in a gallery interface; and responding to the user operation, and processing the recorded video by the third electronic equipment according to a first mode, wherein the first mode is playing, editing, sharing or deleting.
In a possible implementation manner of the second aspect, after the third electronic device receives the recorded video sent by the first electronic device, the method further includes: the third electronic device displays video processing options; and responding to the operation of the user on the video processing options, and processing the recorded video by the third electronic equipment according to a mode corresponding to the operation of the user. The video processing options include at least one of play items, edit items, share items, delete items.
Wherein, the play item may include one or more applications supporting video play, the edit item may include an application supporting video editing, and the share item may include an application supporting video sharing.
In a possible implementation manner of the second aspect, the method further includes: when the network of the third electronic equipment is switched, the third electronic equipment prompts that the video transmission is stopped due to the network change and prompts a user to perform network switching, and sends a message of stopping the video transmission due to the network change to the first electronic equipment; and under the condition that the network of the third electronic equipment is adjusted to be consistent with the network of the first electronic equipment, the third electronic equipment continuously receives the recorded video sent by the first electronic equipment.
In a third aspect, the present application provides a device for collaborative recording and sharing of multiple devices, where the device includes a unit for performing the method in the first aspect. The apparatus may correspond to performing the method described in the first aspect, and the relevant descriptions of the units in the apparatus are referred to the description of the first aspect, which is omitted herein for brevity.
In a fourth aspect, the present application provides a multi-device collaborative screen recording and sharing apparatus, where the apparatus includes a unit for performing the method in the second aspect. The apparatus may correspond to performing the method described in the second aspect, and the relevant descriptions of the units in the apparatus are referred to the description of the second aspect, which is not repeated herein for brevity.
The methods described in the first aspect and the second aspect may be implemented by hardware, or may be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules or units corresponding to the functions described above. Such as a processing module or unit, a display module or unit, etc.
In a fifth aspect, the application provides an electronic device comprising a processor, a computer program or instructions stored in the processor and in a memory, the processor being for executing the computer program or instructions such that the method of the first aspect is performed.
In a sixth aspect, the application provides an electronic device comprising a processor, a computer program or instructions stored in the processor and a memory, the processor being for executing the computer program or instructions such that the method of the second aspect is performed.
In a seventh aspect, the present application provides a computer-readable storage medium having stored thereon a computer program (which may also be referred to as instructions or code) for implementing the method in the first aspect. For example, the computer program, when executed by a computer, causes the computer to perform the method of the first or second aspect.
In an eighth aspect, the present application provides a chip comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the first or second aspect and any possible implementation thereof. Optionally, the chip further comprises a memory, and the memory is connected with the processor through a circuit or a wire.
In a ninth aspect, the present application provides a system-on-a-chip, comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the first or second aspect and any possible implementation thereof. Optionally, the chip system further comprises a memory, and the memory is connected with the processor through a circuit or a wire.
In a tenth aspect, the application provides a computer program product comprising a computer program (which may also be referred to as instructions or code) which, when executed by an electronic device, causes the electronic device to carry out the method of the first or second aspect.
It is to be understood that the advantages of the third aspect to the tenth aspect may be referred to the relevant descriptions of the first aspect and the second aspect, and are not repeated herein.
Drawings
FIG. 1 is a schematic view of a related art scenario in which a smart screen retains highlight when playing video;
FIG. 2 is a schematic diagram of capturing and sharing a highlight when a video is played by a smart screen in the related art, and a schematic diagram of capturing and sharing a highlight when a video is played by a smart screen in an embodiment of the present application;
fig. 3 is a schematic view of a scene of highlight sharing in the related art and a schematic view of a scene of highlight sharing in the embodiment of the application;
fig. 4 is an application scenario schematic diagram of a method for collaborative recording and sharing of multiple devices provided in an embodiment of the present application;
FIG. 5 is a timing diagram of a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application;
FIG. 6 is a timing diagram II of a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application;
FIG. 7 is a timing diagram III of a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application;
fig. 8A and fig. 8B are schematic diagrams of an interface of a smart screen opening highlight time service according to an embodiment of the present application;
FIG. 9 is a schematic diagram of an interface for recommending use of a highlight service by a smart screen according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a scenario in which an intelligent screen is triggered by a remote controller or a mobile phone in an embodiment of the present application;
FIGS. 11A, 11B and 11C are schematic views of a smart screen and a shared video according to an embodiment of the present application;
FIG. 12 is a schematic diagram of a special scene that appears when the intelligent screen is recorded in the embodiment of the application;
fig. 13A, fig. 13B, and fig. 13C are schematic views of interfaces of a mobile phone receiving video clips shared by smart screens according to an embodiment of the present application;
FIG. 14 is a timing diagram of a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application;
fig. 15A to 15C are schematic views of an interface for binding a smart screen with a smart space application of a mobile phone according to an embodiment of the present application;
fig. 16A to 16E are schematic views of an interface for collaborative recording of a mobile phone and a smart screen and sharing video according to an embodiment of the present application;
FIG. 17 is a diagram illustrating an interface between a mobile phone and a smart screen in accordance with an embodiment of the present application;
FIG. 18 is a diagram showing a second interface between a mobile phone and a smart screen in accordance with an embodiment of the present application;
FIG. 19 is a third diagram illustrating an interface between a mobile phone and a smart screen in accordance with an embodiment of the present application;
FIG. 20 is a diagram showing a fourth interface of a mobile phone and a smart screen collaborative screen according to an embodiment of the present application;
FIG. 21 is a diagram showing an interface of a mobile phone and a smart screen collaborative screen according to an embodiment of the present application;
FIG. 22 is a diagram showing a sixth interface of a mobile phone and a smart screen collaborative screen according to an embodiment of the present application;
FIG. 23 is a diagram of an interface seventh of a mobile phone and a smart screen collaborative screen recording according to an embodiment of the present application;
FIG. 24 is a schematic diagram of an intelligent screen according to an embodiment of the present application;
FIG. 25 is a schematic diagram of an operating system of a multi-device collaborative screen recording and sharing method application according to an embodiment of the present application;
fig. 26 is a schematic flow chart of video stream playing in a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application;
fig. 27 is a schematic flow chart of completing recording for video streaming in the method for collaborative recording and sharing of multiple devices according to an embodiment of the present application;
fig. 28 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The term "and/or" herein is an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. The symbol "/" herein indicates that the associated object is or is a relationship, e.g., A/B indicates A or B.
The terms "first" and "second" and the like in the description and in the claims are used for distinguishing between different objects and not for describing a particular sequential order of objects. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "plurality" means two or more, for example, the meaning of a plurality of processing units means two or more, or the like; the plurality of elements means two or more elements and the like.
In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
In order to facilitate understanding of the embodiments of the present application, some terms of the embodiments of the present application are explained below to facilitate understanding by those skilled in the art.
When a user views a video such as a ball game, a live broadcast, a television show, or a movie through a smart screen (also called a smart television or TV), the user may have a need to store or share the highlight in the video (e.g., a highlight of a football goal, or a highlight of a television show, etc.). At present, there are two screen recording modes:
the first screen recording mode is as follows: as shown in fig. 1, the user may use the TV screen recording function of the smart screen, and if the user clicks on the TV screen recording function at time 1, the smart screen starts recording from time 1, and the user cannot capture the wonderful moment due to the lag of the reaction. Alternatively, the recording may be performed by looking back or rewinding back to the highlight of the content. The screen recording mode has the following defects: the user viewing experience is interrupted; recording is carried out by operation review or fast-backing, so that the operation is complicated, the time consumption is long, and the recording is inconvenient for users; when the user has the sharing requirement, the user is required to manually transmit the video clips recorded by the intelligent screen to other devices such as a mobile phone, and then share the video clips to other users through the mobile phone, so that the operation is inconvenient.
The second screen recording mode is as follows: as shown in fig. 1, the user uses the video recording function of the mobile phone to shoot the smart screen, so as to record video, and share the shot video clips to other users when needed. Because video pictures recorded on a screen through a mobile phone can be influenced by moire and the like, the recorded video pictures have poor effects, and the watching experience of a user can be influenced, so that the mode is rarely used by the user.
Fig. 2 (a) shows a schematic diagram of the realization of the recording and sharing by the TV recording function. As shown in fig. 2 (a), in the video playing process, after the user sees the highlight in the video, the user triggers the recording at this time (denoted as time 1), and the smart screen starts recording the video from time 1, and the user operation or reaction is delayed, so that time 1 is later than the highlight, resulting in missing the highlight. When a user needs to share videos, the intelligent screen needs to exit the current video playing interface and then switch to a gallery to finish sharing operation, or the two-dimensional code provided by the intelligent screen is scanned by a mobile phone to finish sharing operation, so that the sharing mode is complex, and the user viewing is affected.
In view of the above problems, the present application aims to provide a method for collaborative recording and sharing of multiple devices, which is applied to intelligent electronic devices such as smart screens, and the scheme of the present application not only supports video recording by controlling the smart screen through a remote controller, but also supports video recording by controlling the smart screen through a mobile phone, after the recording function of the smart screen is triggered through the remote controller or the mobile phone, the smart screen can automatically record a video clip of a first preset duration before the triggering time in the background without interrupting the user's viewing, and the smart screen can automatically sense available devices nearby such as the mobile phone or a tablet computer and transmit the recorded video clip to the available devices nearby, and further the available devices nearby can store the video clip locally or share the video clip to other users.
Fig. 2 (b) shows a schematic diagram of recording and sharing by the multi-device collaborative recording and sharing method provided by the embodiment of the application. As shown in fig. 2 (b), during the video playing process, after the user sees the highlight in the video, the user triggers the recording at time 1, and the smart screen records the video 15 seconds before time 1, i.e. 15 seconds back. In this way, the inventive solution is able to obtain a highlight moment even if the user operation or reaction is lagging behind the moment 1. When the user needs to share the video, the intelligent screen can conveniently complete the sharing operation without exiting the current video playing interface.
As can be seen from comparing (a) and (b) in fig. 2, in the method for collaborative recording and sharing of multiple devices provided by the embodiment of the present application, after a user triggers the intelligent screen recording, the intelligent screen acquires a video clip with a first preset duration before the triggering time, so that the situation that the user misses the recording wonderful time due to operation lag or response lag can be avoided.
Fig. 3 shows a process of sharing video after intelligent screen recording in the related art and a process of sharing video after intelligent screen recording in the embodiment of the application, respectively. As shown in fig. 3 (a), one sharing method is: responding to user operation, the intelligent screen exits from the current video playing interface and then switches to the gallery, and after receiving the operation of the user on the sharing button in the gallery interface, the intelligent screen sends the recorded video clips to other electronic equipment to complete the sharing operation; another way is: and responding to the user operation, the intelligent screen exits the current video playing interface and then switches to the video sharing interface, wherein the video sharing interface is displayed with the two-dimensional code, and if the user scans the two-dimensional code provided by the intelligent screen through the mobile phone, the intelligent screen sends the recorded video clip to the mobile phone to complete the sharing operation. As shown in fig. 3 (b), the smart screen may automatically record the video clip of the first preset duration before the trigger time in the background while the user is not interrupted from watching the video, and the smart screen may automatically sense available nearby devices such as a mobile phone or a tablet computer and transmit the recorded video clip to the available nearby devices.
As can be seen from comparing (a) and (b) in fig. 3, the method of code scanning sharing/gallery sharing in the related art is cumbersome in steps and breaks the user's viewing experience. In the scheme of the application, the intelligent screen does not need to exit the video playing interface when the video is shared, so that the quick sharing can be realized, and the video watching experience of a user is improved.
According to the scheme, the user actively triggers the recording screen, the intelligent screen background automatically records, automatically perceives nearby available equipment and file transmission technologies are adopted, the intelligent screen supports video sharing during video playing, and after the video is shared to mobile equipment such as a mobile phone, the mobile equipment such as the mobile phone can be triggered to quickly pull up a gallery. Therefore, the scheme of the application can help the user to capture the high-quality TV-end highlight video, and can also meet the user requirement of convenient sharing after capturing.
The embodiment of the application provides two ways for realizing the recording and sharing of the wonderful time of the intelligent screen, and the remote controller and the smart space application of the mobile phone can trigger the wonderful time recording function of the intelligent screen. Specifically, in the process of playing video on the intelligent screen, a user operates the remote controller, the intelligent screen can be triggered to automatically record video clips with a first preset duration (for example, 15 seconds) in the background, the user is prompted to share the video clips by automatically popup windows after the video clips are recorded, and after the user selects a certain device, the intelligent screen automatically transmits the video to the device; the user can operate on the mobile phone, the intelligent screen can be triggered to automatically record the video clips in the background, and the video is automatically transmitted to the mobile phone after the video is recorded, so that the user does not need to operate. When video is recorded and shared, the intelligent screen continuously plays the live program, and the live program is not affected, so that the video recording and sharing can be realized without interrupting the playing of the live program, the operation of a user is convenient and quick, and the use experience of the user can be improved.
The execution main body of the multi-device collaborative screen recording and sharing method provided by the embodiment of the application can be an intelligent screen, and also can be a functional module and/or a functional entity which can realize the multi-device collaborative screen recording and sharing method in the intelligent screen. An example of a method for collaborative recording and sharing of multiple devices provided by the embodiment of the application is described below by taking an intelligent screen as an example and combining with the accompanying drawings.
First, a method for collaborative recording and sharing of multiple devices provided by an embodiment of the present application will be briefly described from an overall perspective with reference to fig. 4. As shown in fig. 4, the use process of the smart screen highlight instant replay function may include five stages:
(1) Opening: and starting a highlight time recording function.
(2) Prompting: prompting a highlight instant recording function.
(3) Triggering: triggering the application highlight instant recording function.
(4) Recording: 15 seconds of highlight video is recorded back.
(5) Sharing: and sharing the recorded highlight video to other electronic equipment.
In actual implementation, the smart screen sequentially completes the five stages, so that recording and sharing of the wonderful video can be realized. It should be noted that, when recording and sharing the highlight video are implemented, the embodiments of the present application provide two implementation manners as follows:
The implementation mode is as follows: (1) the user triggers the smart screen to run the wonderful time recording function by operating on the remote controller; (2) the intelligent screen receives a screen recording command sent by the remote controller, and the intelligent screen records 15 seconds of video clips (also called 15 seconds of highlight video); (3) the intelligent screen automatically pops up the identification of at least one nearby available device such as a mobile phone/tablet computer after video recording is completed, then the intelligent screen responds to the operation of a user on a remote controller to select the identification of the at least one nearby available device, and then the intelligent screen transmits the recorded 15-second video clip to the at least one nearby available device to realize quick sharing.
The implementation mode II is as follows: taking a mobile phone as an example, under the condition that the mobile phone is in wireless connection with the smart screen, (1) a user triggers the smart screen to operate a wonderful time recording function through operation of the mobile phone (smart space application); (2) the intelligent screen receives a screen recording command sent by the mobile phone, and the intelligent screen records 15 seconds of highlight video; (3) the intelligent screen transmits the recorded 15-second video clips to the mobile phone after completing video recording, so that quick sharing is realized.
In some embodiments, after the smart screen records 15 seconds of the highlight video, the smart screen prompts the user whether to share the video by means of a message box. The message box remains displayed and automatically disappears after a certain period of time (10 seconds). And responding to the operation of the user for confirming the sharing of the video, the intelligent screen starts searching for nearby available equipment, and then the intelligent screen displays the identification of the searched nearby available equipment in a message box-flicking mode for the user to select.
In some embodiments, after the smart screen is finished recording 15 seconds of the highlight video, the smart screen can automatically save the 15 seconds of the highlight video to the smart screen gallery in addition to prompting the user to share the video.
The following describes a specific implementation manner of the multi-device collaborative screen recording and sharing method provided by the embodiment of the application by combining an interaction flow diagram and an interface diagram of the multi-device collaborative screen recording.
Implementation 1: controlling intelligent screen recording and sharing video among devices with the same account through remote controller
In implementation 1, the user can control the smart screen to record the highlight video clip by operating on the remote control. In response to a user's operation on the remote control, the remote control may wirelessly control the smart screen to turn on the system, turn off the system, fast forward video, fast reverse video, pause video, increase volume, or decrease volume. In addition, in the process of playing the video on the intelligent screen, the remote controller can also send a screen recording command to the intelligent screen in response to long-press operation of the user on an OK key of the remote controller so as to trigger the intelligent screen to record the screen. The intelligent screen can obtain video clips according to the screen recording command.
Fig. 5 is a flowchart of a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application. Referring to fig. 5, the method includes steps S101 to S113 described below.
S101, the intelligent screen plays the first video stream.
The first video stream may be a video program such as a ball game, a television play or a movie, which is played in a live broadcast or on demand mode, and may specifically be set according to actual use requirements, which is not limited by the embodiment of the present application.
It should be noted that, when the smart screen plays the video program, the smart screen supports the use of the highlight recording function. When the smart screen displays a main page, a setup page or other static pages, the smart screen disables the highlight instant callback function.
S102, the remote controller receives screen recording operation of a user at a first moment.
It should be noted that, the screen recording operation may be: the user directs the remote control to the intelligent screen, presses the OK key of the remote control and presses the remote control for a period of time longer than or equal to a certain period of time (i.e. long press). The certain time period can be set manually or set by a terminal, for example, the certain time period can be 1 second or 2 seconds.
S103, responding to the screen recording operation of the user at the first moment, and sending a screen recording command to the intelligent screen by the remote controller.
Wherein, the remote controller and the intelligent screen are in wireless connection through infrared rays. After a user presses a certain key of the remote controller, the remote controller transmits an infrared key value to the intelligent screen infrared receiving head through the infrared transmitting head, after the intelligent screen receives the infrared key value, the intelligent screen can recognize a command or instruction corresponding to the infrared key value according to the infrared key value, and then the intelligent screen executes the command or instruction.
Specifically, after the user presses the OK key of the remote controller for a long time, the remote controller responds to the screen recording operation of the user and transmits an infrared key value to the intelligent screen, and the infrared key value corresponds to the screen recording command, so that the remote controller can be considered to transmit the screen recording command to the intelligent screen. After the intelligent screen acquires the screen recording command, the intelligent screen executes the screen recording command.
S104, in the video playing process, the intelligent screen receives a screen recording command.
In some embodiments, when the smart screen is in the video playing state, if the smart screen receives the video recording command, the smart screen executes the video recording command, i.e. automatically recording the video clip in the background.
In other embodiments, if the smart screen receives the video recording command while the smart screen is in the video pause state, the smart screen may also execute the video recording command, i.e., automatically record the video clip in the background.
S105, responding to the screen recording command, and acquiring the video clips with the first preset duration before the first moment from the first video stream by the intelligent screen.
The value of the first preset duration may be specifically set according to actual use requirements, which is not limited by the embodiment of the present application. Illustratively, the first preset duration may take 15 seconds.
For example, when the user presses the OK key of the remote controller for a long time at the first time, the remote controller sends a screen recording command to the smart screen, and the screen recording command includes trigger time information, i.e. the first time. In response to the screen recording command, the smart screen obtains 15 video clips from the first video stream before the first time.
In another embodiment, the remote controller sends a screen recording command to the smart screen after the user presses the OK key of the remote controller for a long time at the first time. The intelligent screen receives a screen recording command at the second moment. In response to the screen recording command, the smart screen acquires 15 video clips from the first video stream before the second moment. Wherein the second time is later than the first time. The difference between the second time and the first time is small and can be ignored.
S106, the intelligent screen searches nearby available devices through Bluetooth, such as finding out a mobile phone.
It should be noted that, the nearby available devices may include devices with the same account number as the smart screen, or devices with different account numbers than the smart screen. In fig. 5, it is assumed that the mobile phone and the smart screen log in the same account, and the mobile phone and the smart screen are the same account equipment. S106-113 in fig. 5 mainly illustrate the process of the smart screen sharing video clips to devices with the same account.
S107, the intelligent screen displays a list of available devices, for example, the list comprises the identification of the mobile phone.
In some embodiments, after the video recording is completed, the smart screen automatically pops up the identifiers of the searched nearby available devices, then the smart screen responds to the operation of the user on the remote controller to select the identifier of one nearby available device, and then the smart screen transmits the recorded 15-second video clip to the nearby available device, so that quick sharing is realized.
S108, receiving the operation of selecting the identification of the mobile phone by the user on the intelligent screen, and responding to the operation of the user, and confirming the video sharing to the mobile phone by the intelligent screen.
In other embodiments, after the smart screen completes video recording, the smart screen may automatically send the recorded 15 second video clip to the same account device searched in the trusted environment, without user selection or confirmation, to achieve fast sharing.
S109, establishing a WLAN connection channel between the intelligent screen and the mobile phone.
The wireless local area network (wireless local area network, WLAN) connection channel may be a Wi-Fi connection channel.
In an embodiment of the application, the smart screen and the mobile phone are intelligent electronic devices in a trusted environment. In actual implementation, the smart screen and the mobile phone are both connected to the same Wi-Fi network and share the same wireless local area network, i.e. in a trusted environment. In a trusted environment, the intelligent screen and the mobile phone can directly establish wireless local area network connection, identity authentication is not required when the connection is established, for example, different devices can be connected without inputting passwords by a user, and the intelligent screen and the mobile phone are convenient, quick, safe and reliable.
In actual implementation, the smart screen may store historical connection data for a plurality of electronic devices, including a cell phone, that are successfully connected to the smart screen. When the intelligent screen initiates connection with the mobile phone, the intelligent screen can directly establish wireless connection with the intelligent screen according to the historical connection data.
S110, the smart screen sends a 15-second video clip to the mobile phone through the WLAN connection channel.
S111, the mobile phone receives the 15-second video clip.
And S112, after the mobile phone finishes receiving the 15-second video clip, the mobile phone sends a message of successful video clip receiving to the intelligent screen.
S113, after the mobile phone receives the 15-second video clip, the mobile phone automatically jumps to the gallery and plays the 15-second video clip.
In some embodiments, after the mobile phone receives the 15 second video clip, the mobile phone automatically jumps to the gallery and automatically plays the 15 second video clip, thereby realizing the purpose of video preview. The gallery includes editing, sharing, saving, deleting, etc. options. The mobile phone can respond to the user operation and store the 15-second video clip to the local; alternatively, the cell phone may share the video clip to other electronic devices in response to user operation.
In other embodiments, after the mobile phone receives the 15 second video clip, the mobile phone may pop-up the window to display the video processing options for the user to select. For example, the video processing options may include at least one of video playing software, editing, sharing, saving, deleting, moving to. For example, in response to a user selecting an operation of the video playing software, the video playing software is pulled up, and a 15-second video clip is played by the video playing software.
In the implementation manner, the user triggers the smart screen to operate the wonderful time recording function by operating on the remote controller, after the smart screen receives a screen recording command sent by the remote controller, the smart screen records a wonderful video for 15 seconds, after the smart screen finishes video recording, the smart screen automatically pops up the identification of at least one nearby available device such as a mobile phone/a tablet personal computer and the like, then the smart screen responds to the operation of the user on the remote controller to select the identification of the same account device, and then the smart screen transmits the recorded 15-second video clip to the same account device, so that quick sharing is realized.
Implementation 2: controlling intelligent screen recording and sharing video among different account devices through remote controller
In implementation 2, the user may control the smart screen to record the highlight video clip by operating on the remote control. The difference between implementation 1 and implementation 2 is that in implementation 1, the process of controlling the smart screen recording and sharing video by the smart screen to the device with the same account by the remote controller is mainly described with reference to fig. 5, and in implementation 2, the process of controlling the smart screen recording and sharing video by the smart screen to the device with different account by the remote controller is mainly described with reference to fig. 6. Referring to fig. 6, the method includes steps S201 to S217 described below.
S201, the intelligent screen plays the first video stream.
S202, the remote controller receives screen recording operation of a user at a first moment.
S203, responding to the screen recording operation of the user at the first moment, and sending a screen recording command to the intelligent screen by the remote controller.
S204, in the video playing process, the intelligent screen receives a screen recording command.
S205, responding to a screen recording command, and acquiring a video clip with a first preset duration before a first moment from a first video stream by the intelligent screen.
The implementation process of S201 to S205 is the same as the implementation process of S101 to S105, and will not be described here again.
S206, searching nearby available devices, such as a tablet computer, through Bluetooth by the intelligent screen.
It should be noted that, the nearby available devices may include devices with the same account number as the smart screen, and may also include devices with different account numbers than the smart screen. In fig. 6, it is assumed that the tablet pc and the smart screen register different accounts, which are different account devices. S206-217 in fig. 6 mainly illustrates the process of the smart screen sharing video clips to the devices with the same account.
S207, the intelligent screen displays a list of available devices, for example, the list comprises the identification of the tablet computer.
S208, receiving the operation of selecting the identification of the tablet personal computer by the user on the intelligent screen, and responding to the user operation, and confirming the video sharing to the tablet personal computer by the intelligent screen.
In order to ensure privacy security of users, the process of sharing videos to different account devices by the intelligent screen is different from the process of sharing videos to the same account devices, and the specific difference is as follows in S209-S212.
S209, the intelligent screen sends a first prompt message to the tablet computer.
S210, the tablet personal computer receives and displays a first prompt message for prompting whether to receive the 15 second video clip.
S211, the tablet personal computer receives confirmation operation of the user.
S212, the tablet personal computer sends a message to the intelligent screen, wherein the message is a message that the tablet personal computer agrees to receive 15 seconds of video clips.
For the smart screen, the tablet computer is a heterogeneous account device, and the smart screen establishes a WLAN connection channel with the tablet computer under the condition that the tablet computer agrees to receive the video clip, and then sends the video clip to the tablet computer, see, in particular, S213-S217 described below.
S213, establishing a WLAN connection channel between the intelligent screen and the tablet personal computer.
S214, the intelligent screen sends a 15-second video clip to the tablet computer through the WLAN connection channel.
S215, the tablet receives the 15 second video clip.
S216, after the tablet personal computer finishes receiving the 15-second video clip, the tablet personal computer sends a message that the 15-second video clip is successfully received to the intelligent screen.
S217, after the tablet personal computer finishes receiving the 15-second video clips, the tablet personal computer automatically jumps to a gallery and plays the 15-second video clips.
The implementation process of S213 to S217 is the same as the implementation process of S109 to S113, and will not be described here again.
In the above implementation mode 2, the user triggers the smart screen to operate the wonderful time recording function by operating on the remote controller, after the smart screen receives the screen recording command sent by the remote controller, the smart screen records the wonderful video for 15 seconds, the smart screen automatically pops up the identifier of at least one nearby available device such as a mobile phone/tablet computer after completing video recording, then the smart screen responds to the operation of the user on the remote controller to select the identifier of the different account number device, then the smart screen performs information interaction with the different account number device, and under the condition that the different account number device confirms to receive the video clip, the smart screen transmits the recorded video clip for 15 seconds to the different account number device, so that quick sharing is realized, and the information security of the user is ensured.
It should be noted that, the above processes of sharing video from the smart screen to the same account device (such as a mobile phone) and the process of sharing video from the smart screen to the different account device (such as a tablet computer) are respectively illustrated by fig. 5 and 6, and the difference is that: when sharing video to the same account equipment side, the intelligent screen can directly transmit the recorded 15-second video clip to the same account equipment so as to realize quick sharing; when the intelligent screen shares the video to the different account equipment side, the intelligent screen needs to interact with the different account equipment first, and under the condition that the different account equipment confirms to receive the video clips, the intelligent screen transmits the recorded 15-second video clips to the same account equipment, so that the quick sharing is realized.
Implementation 3: controlling intelligent screen recording and sharing video among devices with same account through mobile phone
In implementation 3, the user can control the smart screen to record the highlight video clip by operating on the cell phone. A multi-device collaborative application (also referred to as a smart space application) installed in a cell phone may provide functionality similar to a remote control, embodied as various functionality controls in an interface, such as a smart space application providing a copy back control. The smart screen and the mobile phone are bound together through the smart space application, so that a user can record the highlight video clips by operating the record control provided by the smart space application of the mobile phone and wirelessly controlling the smart screen.
It should be noted that, when the mobile phone and the smart screen are located in a trusted environment and the mobile phone and the smart screen log in the same account, the mobile phone and the smart screen can be bound. In implementation 3, the mobile phone and the smart screen are the same account number device.
It should be further noted that the mobile phone and the smart screen are commonly connected to the same Wi-Fi network, and it can be understood that a WLAN connection channel is already established between the smart screen and the mobile phone.
Fig. 7 is a flowchart of a method for collaborative recording and sharing of multiple devices according to an embodiment of the present application. Referring to fig. 7, the method includes steps S301 to S309 described below.
S301, the intelligent screen plays the first video stream.
S302, the mobile phone receives the screen recording operation of the user at the first moment.
It should be noted that, the screen recording operation may be: the user clicks a copy back control in the cell phone interface.
S303, responding to the screen recording operation of the user at the first moment, and sending a screen recording command to the intelligent screen by the mobile phone.
S304, in the video playing process, the intelligent screen receives a screen recording command.
S305, responding to the screen recording command, and acquiring the video clips with the first preset duration before the first moment from the first video stream by the intelligent screen.
The implementation process of S301-S305 is similar to the implementation process of S101-S105, and will not be repeated here.
S306, the intelligent screen sends 15 seconds of video clips to the mobile phone through the WLAN connection channel.
S307, the mobile phone receives the 15 second video clip.
S308, after the mobile phone receives the 15-second video clip, the mobile phone feeds back a message of successful video reception to the intelligent screen.
After S308, S309A and S309B are alternatively executed.
S309A, after the mobile phone receives the 15 second video clip, the mobile phone automatically jumps to the gallery to play the 15 second video clip.
In some embodiments, after the mobile phone receives the 15 second video clip, the mobile phone automatically jumps to the gallery and automatically plays the 15 second video clip, thereby realizing the purpose of video preview. The gallery includes editing, sharing, saving, deleting, etc. options. The mobile phone can respond to the user operation and store the 15-second video clip to the local; alternatively, the cell phone may share the video clip to other electronic devices in response to user operation.
And S309B, after the mobile phone receives the 15-second video clip, the mobile phone popup displays video processing options, wherein the video processing options comprise playing video, sharing video, editing video, storing video and the like.
In other embodiments, after the mobile phone receives the 15 second video clip, the mobile phone may pop-up the window to display the video processing options for the user to select. For example, in response to a user selecting an operation of playing a video option, a 15 second video clip is played by default video playing software.
In the above implementation 3, in the case that the mobile phone and the smart screen are connected to the same Wi-Fi network and are bound to each other, the user may operate on a copy-back control provided by a smart space application of the mobile phone, trigger the smart screen to operate a highlight time copy-back function, after the smart screen receives a copy-back command sent by the mobile phone, the smart screen copies back a highlight video for 15 seconds, and after completing video recording, the smart screen automatically pops up an identifier of one or more nearby available devices (including the mobile phone), and then the smart screen responds to the operation of the user on the mobile phone to select one or more nearby available devices, and then the smart screen transmits the recorded video clip for 15 seconds to the one or more nearby available devices, so as to realize quick sharing.
The specific implementation manner of the multi-device collaborative screen recording and sharing method provided by the embodiment of the application is described above by combining the interactive flow diagram among the devices during the multi-device collaborative screen recording. The specific implementation manner of the multi-device collaborative screen recording and sharing method provided by the embodiment of the application is described below by combining with an interface schematic diagram of the intelligent screen during the multi-device collaborative screen recording.
As described above, the use process of the smart screen highlight instant callback function may include five phases: (1) opening: and starting a highlight time recording function. (2) prompting: prompting a highlight instant recording function. (3) triggering: triggering the application highlight instant recording function. (4) recording: 15 seconds of highlight video is recorded back. (5) sharing: and sharing the recorded highlight video to other electronic equipment. In actual implementation, the smart screen sequentially completes the five stages, so that recording and sharing of the wonderful video can be realized. The implementation manner of each stage of opening, prompting, triggering, recording and sharing is described below.
(1) Opening the valve
Mode one: FIG. 8A is a schematic diagram of an implementation of the smart screen on highlight service and highlight recording function according to an embodiment of the present application. The smart screen defaults to enable the wonderful time service after the smart screen is started for the first time, and guides a user to use the wonderful time recording function. As shown in FIG. 8A, the smart screen displays the enhanced services page when the system setup is performed after the first power-on. In the enhanced services page, the default highlight service will be enabled and the user clicks the next button, indicating confirmation that the highlight service is enabled and the highlight copy-back function is enabled.
The highlight moment is an application for helping a user to record highlight pictures when watching programs and share the highlight pictures to other devices. The application records the content currently played by the intelligent screen and stores the content when the user is actively triggered. Of course, the user can also turn off the highlight instant service and highlight instant recording function in the application setting interface of the smart screen.
In order to ensure the experience of the user on the wonderful moment, the enhanced service page enables the wonderful moment service for the default check of the user.
Mode two: FIG. 8B is a schematic diagram of another implementation of the smart screen on highlight service and highlight recording function according to the embodiment of the present application. As shown in (a) of fig. 8B, the smart screen displays an application setting interface in which a plurality of general function setting items including a highlight setting item are displayed. After the user clicks the highlight setting item, as shown in (B) of fig. 8B, the smart screen display interface jumps to the highlight setting interface, and the highlight setting interface includes a highlight switch, a hint information of the highlight switch, and a use hint information of the highlight. Wherein, the highlight moment switch is the off state, and the suggestion information of highlight moment switch is: the highlight switch is turned on to record highlight and share the highlight to nearby glory equipment very fast. The using prompt information of the wonderful time is as follows: after the wonderful moment is started, the OK key of the remote controller is pressed for a long time, so that the wonderful video picture 15 seconds before the key is recorded, after the recording is finished, the source file is automatically stored in the gallery, if the source file needs to be shared, the wonderful sharing button can be clicked, and the source file can be shared to nearby wonderful equipment very fast.
After the user clicks the highlight switch, the highlight switch changes from the off state to the on state as shown in (c) in fig. 8B. After the highlight switch is turned on, the smart screen display automatically jumps to the enhanced services page as shown in fig. 8B (d). In the enhanced services page, the default highlight service will be enabled and the user clicks the next button, indicating confirmation that the highlight service is enabled and the highlight copy-back function is enabled. Thus, if the user triggers the smart screen to operate the highlight recording function, the smart screen can record highlight pictures and can share nearby glowing equipment very fast.
(2) Prompt for
Further, in the embodiment of the application, after the highlight time recording function is started, a suspension notice can be added when the smart screen plays the video, so that the user is guided to find and use the highlight time recording function. When the smart screen plays the video for the first time, after the time length of playing the video by the smart screen is greater than or equal to 15 seconds, the prompt information of how to use the wonderful time recording function can be popped up in the video playing interface of the smart screen: by pressing the OK key of the remote control for 1 second. The prompt message disappears after a certain period of stay. For example, the prompt box can stay for 10 seconds, and automatically disappear after 10 seconds, and the prompt information can be checked at a control center of the intelligent screen.
Illustratively, as shown in (a) of fig. 9, the content of the prompt box displayed by the smart screen may be: newly add the experience of 'highlight moment': when watching the program, long pressing the remote control OK key can record 15 seconds of wonderful video. Accordingly, the user can trigger the smart screen to record back 15 seconds of highlight video by pressing the OK key of the remote controller for 1 second.
As another example, as shown in (b) of fig. 9, the content of the prompt box displayed by the smart screen may be: newly add the experience of 'highlight moment': when watching the program, clicking the recording control of the smart space APP of the mobile phone can record 15 seconds of highlight video. Accordingly, the user can trigger the smart screen to record 15 seconds of highlight video by clicking the record control of the smart space of the mobile phone.
Note that, the smart screen may display the prompt information shown in (a) in fig. 9 alone, or display the prompt information shown in (b) in fig. 9 alone, or alternatively display the prompt information shown in (a) and (b) in fig. 9 separately. Therefore, the intelligent screen adds suspension notification on the video playing interface, so that the user is guided to find and use the wonderful time recording function, and the user experience is improved.
(3) Triggering
The embodiment of the application provides the following two ways for triggering the intelligent screen to record:
In a first mode, as shown in fig. 10 (a), when the user views a program, the user can press the OK key of the remote controller for 1 second for a long time, trigger the smart screen to operate the highlight recording function, and obtain a 15 second highlight video.
In a second mode, as shown in fig. 10 (b), when the user views the program, the user may click on a recording control in an intelligent space Application (APP) interface of the mobile phone, and trigger the intelligent screen to operate a highlight time recording function, and obtain a 15 second highlight video.
In the embodiment of the application, after the smart screen recommends the user to use the highlight recording function, the user can choose to control the smart screen to record the highlight video clips by operating on a remote controller or choose to control the smart screen to record the highlight video clips by operating on a mobile phone according to actual use requirements.
(4) Recording screen and (5) sharing
The above description is made of two ways of triggering the intelligent screen recording, and the following description is made of the intelligent screen recording and sharing process in combination with the accompanying drawings.
In the embodiment of the application, when the user triggers the intelligent screen recording by the key in the process of continuously playing the video, the intelligent screen foreground continuously plays the video, the background automatically records the highlight video clips 15 seconds before the key, and the sharing button is automatically popped up after the recording is completed for the user to confirm. And under the condition that the user confirms sharing, searching available nearby equipment by the intelligent screen, and displaying equipment identification for the user to select. Since the video play is not interrupted, the user's viewing is not affected.
In some embodiments, after the smart screen records 15 seconds of the highlight video, the smart screen prompts the user whether to share the video by means of a message box. The message box remains displayed and automatically disappears after a certain period of time (10 seconds). And responding to the operation of the user for confirming the sharing of the video, the intelligent screen starts searching for nearby available equipment, and then the intelligent screen displays the identification of the searched nearby available equipment in a message box-flicking mode for the user to select.
In some embodiments, after the smart screen is finished recording 15 seconds of the highlight video, the smart screen can automatically save the 15 seconds of the highlight video to the smart screen gallery in addition to prompting the user to share the video.
Four scenarios for video recording and sharing are given below by way of example.
Scene 1: the highlight time is started and the glory sharing is started
In some embodiments, when the smart screen recording is triggered by the user in the case that the recording function is turned on at the highlight time of the smart screen and the glowing sharing of the smart screen is turned on, the smart screen directly automatically records the video, and prompts the smart screen to share the video through the glowing sharing function after the recording is completed, and the video recording and sharing process is shown in fig. 11A.
As shown in fig. 11A (a), when the smart screen plays a video (e.g., a live program), in response to the user triggering the operation of the smart screen recording, the smart screen background runs a highlight-in-time recording function, and the smart screen displays an icon "in-recording", for example, a red-dot blinking prompt, in such a manner as to prompt the user that "the smart screen background is recording a video clip 15 seconds before the triggering time". After the intelligent screen recording is finished, the intelligent screen stores 15 video clips obtained through the recording back into a gallery of the intelligent screen. As shown in fig. 11A (b), the smart screen does not display the "in-return" icon any more, but displays a prompt card for prompting that the "video has been saved to the gallery" and the "cancel" control and "glory share" control for the user to select. In some embodiments, cursor focus by default remains on the "glory sharing" control. In some embodiments, the cue card automatically disappears after a dwell of 10 seconds. In other embodiments, the smart screen hides the reminder card in response to the user clicking a back key of the remote control or clicking a "cancel" control. It should be noted that, the first frame picture of the video clip obtained by the recording can be displayed in the prompt card as the cover picture. When the first frame of the video fails to be acquired, a certain frame of picture behind the first frame of the video can be acquired, and if the decoded picture is still not available, a default background picture is displayed in the prompt card.
On the one hand, if the user clicks the cancel control to cancel the sharing, the intelligent screen cancels the sharing of the video obtained by the recording to other electronic devices.
On the other hand, if the user clicks the "glory sharing" control to confirm sharing, as shown in (c) of fig. 11A, the smart screen pulls up the glory sharing page in the current live screen, for example, displays the "glory sharing" icon and the prompt information: the flow-free extremely fast file sharing is carried out on nearby equipment, and a receiver needs to start 'glory sharing' to discover. If the user needs to share the video clip obtained by the recording to the mobile phone 1, it needs to be ensured that the mobile phone 1 is turned on for "glory sharing". It should be noted that, the "glory sharing" function depends on the implementation of the device connection service, and bluetooth is used to scan the device, WLAN is used to transmit data, NFC is used to touch the device, and the storage authority is called to read or store the shared file, picture, audio, video, etc. The glowing sharing may continue to use the capabilities of bluetooth, WLAN, NFC functionality even if bluetooth, WLAN, NFC are turned off.
The smart screen scans and discovers nearby available devices through bluetooth functionality. As shown in (d) of fig. 11A, the smart screen displays the identification of the discovered nearby available devices, such as the identification of the cell phone 1, the identification of the glowing smart screen, the identification of the notebook computer, and the identification of the cell phone 2. And, the wisdom screen still shows prompt message: please keep the other device on screen. Wherein the counterpart device comprises a nearby available device discovered by the smart screen.
It should be noted that, the electronic device can be scanned by the smart screen when the screen is on. That is, if the handset is off, the smart screen will not scan the handset.
And responding to the operation of clicking the identification of the mobile phone 1 by the user, establishing WLAN connection between the intelligent screen and the mobile phone 1 after authentication and negotiation are completed, and sharing the video clips obtained by the recording to the mobile phone by the intelligent screen. Accordingly, the smart screen may prompt each stage of video sharing, as shown in (d) of fig. 11A, and the smart screen prompt may "click to send" any one of the identifiers to trigger video sharing; as shown in (e) of fig. 11A, the smart screen prompts to "ready to send" the video clip obtained by the recording to the mobile phone 1; as shown in fig. 11A (f), the smart screen prompts that the video clip obtained by the recording has been "successfully transmitted" to the mobile phone 1.
It should be noted that when the cursor focus stays on a certain identifier of a nearby available device, a "click send" prompt is displayed at the identifier. When the cursor focus moves from the identity of device 1 to the identity of device 2, the identity of device 2 will display a "click send" prompt, and the identity of device 1 will no longer display a "click send" prompt.
In the video transmission process, the intelligent screen can display the ready-to-transmit state, the waiting-to-receive state and the receiving state, so that the user can more clearly determine the progress of video transmission. The smart screen may also display the results of the video transmission, such as transmission success, transmission cancellation, or transmission failure.
Scene 2: the wonderful time is opened and the glory sharing is not opened
In some embodiments, when the smart screen recording is triggered by the user, the smart screen directly automatically records the smart screen when the smart screen recording function is turned on and the smart screen is not turned on at the highlight time of the smart screen, and prompts the user to turn on the smart screen for sharing after the recording is completed, and then video sharing is performed through the "sharing with glowing" function, and the smart screen recording and sharing process is shown in fig. 11B.
As shown in fig. 11B (a), when the smart screen plays a video (e.g., a live program), in response to the user triggering the operation of the smart screen recording, the smart screen background runs the highlight recording function, and the smart screen displays an "in-recording" icon in a certain area of the screen, in such a way as to prompt the user that the smart screen is in the background recording. After the intelligent screen recording is finished, the intelligent screen stores 15 video clips obtained through the recording back into a gallery of the intelligent screen. As shown in fig. 11B, (B), the smart screen displays a highlight card in another area of the screen, which is used to prompt "the recorded video is saved to the gallery" and whether to cancel the sharing or confirm the sharing for the user to select.
If the user clicks the "glory sharing" control, then the smart screen pulls up the glory sharing open popup to prompt the user if the "glory sharing" function is open, as shown in (c) of FIG. 11B: after the device is started, nearby glowing devices are allowed to find out the local device so as to receive the file sent by the device, and the file is transmitted at zero-flow extremely-fast speed. Is this function required to use WLAN and bluetooth, on? A "cancel" control and an "open" control. The glowing sharing open popup window is consistent with the popup window when the glowing sharing switch is opened in the setting page.
If the user clicks the "open" control, the smart screen displays the "glory share" icon and the prompt as shown in (d) of FIG. 11B. The smart screen scans and discovers nearby available devices through bluetooth functionality. As shown in fig. 11B (e), the smart screen displays the identification of the discovered nearby available devices, such as the identification of the cell phone 1, the identification of the glowing smart screen, the identification of the notebook computer, and the identification of the cell phone 2. The intelligent screen prompts the user to click to send any one of the identifiers to trigger video sharing, and the intelligent screen also displays prompt information: please keep the other device on screen.
If the user needs to share the video clip obtained by the recording to the mobile phone 1, the mobile phone 1 is ensured to be opened for 'glowing sharing', and the mobile phone 1 needs to keep a bright screen.
When the cursor focus stays above the identification of the mobile phone 1, responding to the operation of clicking the identification of the mobile phone 1 by a user, establishing WLAN connection between the intelligent screen and the mobile phone 1, and sharing 15 seconds of video clips obtained by the recording to the mobile phone by the intelligent screen. Accordingly, the smart screen may prompt each stage of video sharing, as shown in (f) of fig. 11B, where the smart screen prompts that a 15 second video clip is "ready to be sent" to the mobile phone 1; as shown in (g) in fig. 11B, the intelligent screen prompts "waiting for reception"; as shown in (h) of fig. 11B, the smart screen prompts to "send" a 15 second video clip to the handset 1; or the smart screen prompts the handset 1 to "receive" a 15 second video clip.
It should be noted that, in the case where the smart screen and the mobile phone 1 belong to different account devices, before the smart screen needs to share the video with the mobile phone, the smart screen sends a message requesting to share the video to the mobile phone, and the mobile phone 1 needs to confirm whether to receive the video. The intelligent screen is now in the "waiting to receive" phase. Then, under the condition that the mobile phone 1 confirms that the video clip is received, the intelligent screen shares the video clip with the mobile phone 1.
Scene 3: the wonderful time is not started and the glory sharing is started
In some embodiments, when the smart screen recording function is not turned on and the smart screen glowing sharing is turned on, the smart screen directly pulls up the highlight to open the pop window after the user triggers the smart screen recording, so as to prompt the user to open the highlight. Clicking the "open" control by the user may agree to the agreement and turn on the "highlight" switch. The intelligent screen automatically records after the highlight moment is started, and prompts the intelligent screen to share the video through the glowing sharing function after the recording is completed, and the video recording and sharing process is shown in fig. 11C.
As shown in fig. 11C (a), when the smart screen plays a video (e.g., a live program), in response to the user triggering the smart screen recording operation, the smart screen popup prompts: turn on "highlight moment", you are about to turn on "highlight moment", click on "turn on", i.e. indicate you have agreed to the following protocol. Ask whether to turn on? The highlight moment serves the user protocol. "cancel" or "on".
In response to the user selecting "on", the smart screen background runs the highlight recording function, and as shown in (b) in fig. 11C, the smart screen displays an "in-recording" icon in such a manner as to prompt the user that "the smart screen is in the background for recording". After the intelligent screen recording is finished, the intelligent screen stores 15 video clips obtained through the recording back into a gallery of the intelligent screen. As shown in fig. 11C (C), the smart screen displays a highlight card to prompt the user if sharing is required.
After the user clicks the "glory sharing" control to confirm the sharing, the intelligent screen displays the "glory sharing" icon and the prompt message as shown in fig. 11C (d). The smart screen scans and discovers nearby available devices through bluetooth functionality. As shown in fig. 11C (e), the smart screen displays the identification of the discovered nearby available devices, such as the identification of the cell phone 1, the identification of the glowing smart screen, the identification of the notebook computer, and the identification of the cell phone 2. And, the wisdom screen still shows prompt message: please keep the other device on screen.
In response to the user clicking the identity of the handset 1, the smart screen establishes a WLAN connection with the handset 1, and then the smart screen shares the 15 second video clip to the handset. Accordingly, the smart screen may prompt each stage of video sharing, as shown in (e) of fig. 11C, the smart screen prompts "click to send"; as shown in (f) in fig. 11C, the intelligent screen prompts "transmission success".
It should be noted that, in the process of playing video on the intelligent screen, the user triggers the operation of recording the screen, the intelligent screen automatically records the video clip in the background, and after recording, the intelligent screen automatically pops the window to prompt whether the user shares, confirm to share the equipment available nearby and show the equipment searched for the user, after selecting a certain equipment by the user, the intelligent screen automatically transmits the video to the equipment, the in-process intelligent screen continuously plays the live program, the video recording and sharing realization can not interrupt the playing of the live program, and the user experience is improved.
Special scenario of trigger failure:
the following describes special scenarios that may occur when the smart screen is triggered by a remote control.
In some embodiments, as shown in fig. 12 (a), in the case where the smart screen starts playing the video for less than 15 seconds, if the user triggers the highlight recording function to run at this time, the smart screen prompts "highlight preparation, please retry after Δt seconds", where Δt=15-T1, T1 represents the video playing time.
For example, assuming t1=8 seconds, when the smart screen starts playing the video for 8 seconds, if the user is now triggered to run the highlight reel function, the smart screen may prompt "please trigger after 7 seconds".
In other embodiments, as shown in fig. 12 (b), when the smart screen is recording, if the user triggers the running highlight recording function again at this time, the smart screen prompts "highlight recording is in progress, try again after completion".
In still other embodiments, as shown in (c) of fig. 12, if the user frequently triggers the run highlight reel-back function within a second preset time period, the intelligent screen prompts "you operate too frequently, please try again after X minutes". X represents the acquired remaining operable time.
When the intelligent screen receives the screen recording command, the intelligent screen starts a counter, the counter is increased by 1, and a timer is started, wherein the duration of the timer is a second preset duration, such as 10 minutes. Then, every time the smart screen receives a screen recording command, the counter is incremented by 1. When the timer is greater than or equal to the second preset time length, resetting the timer and re-timing; and the counter is cleared and recounting is performed. If the timer is less than the second preset time period and the accumulated count value of the counter is greater than the trigger number threshold, the user can be considered to operate too frequently, and the intelligent screen can prompt "please retry after X minutes" for your operation too frequently.
For example, assuming that the second preset duration is 10 minutes, the trigger number threshold is 8 times, if the timer is 6 minutes and the cumulative count of the counter is 8 times, the remaining operable time x=10-6=4 minutes is indicated by calculation, and the intelligent screen may prompt "your operation is too frequent, please retry after 4 minutes".
In still other embodiments, as shown in fig. 12 (d), the smart screen prompts "highlight recording failed, please retry" after the user triggers the highlight recording function to run due to some uncertainty factor causing recording failure.
The above embodiments describe the video recording and sharing process from the smart screen side, and the following describes the video sharing process from the mobile phone side. The video sharing comprises sharing with an account number and sharing with a different account number. The sharing with the account indicates that the smart screen shares the video with the electronic device 1, and the smart screen and the electronic device 1 log in the same account. The sharing of different accounts means that the intelligent screen shares videos with the electronic device 1, and the intelligent screen logs in different accounts with the electronic device 1. The process of sharing the same account number and the different account number is described in detail below with reference to the accompanying drawings. The electronic device 1 is exemplified as a mobile phone.
Sharing with account numbers: automatic receiving video clip shared by smart screen when mobile phone is on screen
Fig. 13A shows a schematic diagram of an application interface shared with an account according to an embodiment of the present application. As shown in (a) in fig. 13A, when the smart screen sends a 15 second video clip to the mobile phone, the mobile phone directly receives the video clip and displays a glowing sharing message in the screen locking interface: the smart screen is sharing you with highlight video 1.mp4, receiving progress values and progress bars. As shown in (b) in fig. 13A, the mobile phone completes video reception and displays a file received by the glory sharing message: highlight video 1.mp4, click view ", which is automatically saved to gallery.
In some embodiments, after (b) in fig. 13A, the mobile phone receives an operation of unlocking the screen by the user through a fingerprint or a face, and as shown in (c) in fig. 13A, the desktop is displayed after the mobile phone unlocks the screen. As shown in (d) of fig. 13A, the mobile phone receives a pull-down operation of the user in the arrow direction at the upper end of the screen. As shown in (e) of fig. 13A, the mobile phone responds to the pull-down operation to display a message notification bar, wherein the message notification bar contains a glowing sharing message, the mobile phone receives the operation of clicking a viewing inlet in the glowing sharing message from a user, and as shown in (f) of fig. 13A, the mobile phone pulls up a gallery, automatically plays a highlight video 1.mp4, or responds to the user triggering operation to play the highlight video 1.mp4, and sharing, collecting, editing, deleting and other processing buttons are displayed in a gallery interface, so that the user can share, collect, edit or delete the highlight video 1.mp4 according to actual requirements.
In other embodiments, after (b) in fig. 13A, the handset receives an operation of the user on clicking the view portal, and an operation of unlocking the screen through a fingerprint or a face. As shown in (f) of fig. 13A, the mobile phone pulls up the gallery in response to a user operation, automatically plays the highlight video 1.mp4, or plays the highlight video 1.mp4 after the user-triggered operation.
Fig. 13B illustrates an application interface diagram shared with an account according to another embodiment of the present application. As shown in (a) in fig. 13B, when the smart screen transmits a 15 second video clip to the mobile phone, the mobile phone directly receives the video clip and displays a glory sharing message in the interface: the smart screen is sharing you with highlight video 1.mp4, receiving progress values and progress bars. As shown in (B) of fig. 13B, the mobile phone receives a pull-down operation of the user in the arrow direction at the upper end of the screen. As shown in (c) of fig. 13B, the mobile phone displays a message notification bar including a glowing sharing message, a reception progress value, and a progress bar in response to a pull-down operation. As shown in (d) of fig. 13B, the mobile phone completes video reception and displays a file received by the glory sharing message: highlight video 1.mp4, click view ", which is automatically saved to gallery. And the mobile phone receives the operation of clicking and viewing the entry in the glory sharing message from the user. As shown in (e) of fig. 13B, the handset pulls up the gallery, automatically plays the highlight video 1.mp4, or plays the highlight video 1.mp4 in response to a user-triggered operation.
Sharing of different account numbers: the smart screen is used for displaying a popup window prompt when the mobile phone is on, and the mobile phone receives video clips shared by the smart screen after confirmation of a user
Fig. 13C illustrates an application interface schematic diagram of heterogeneous account sharing according to an embodiment of the present application.
In some embodiments, as shown in (a) of fig. 13C, the mobile phone is in a lock screen state, and when the smart screen sends a 15 second video clip to the mobile phone, the mobile phone displays a glowing sharing message in the lock screen interface: someone would like to share the highlight video and video size to you. The mobile phone receives the operation that the user unlocks the screen through the fingerprint or the face, and as shown in (b) in fig. 13C, the desktop is displayed after the mobile phone unlocks the screen, and a popup window appears in the desktop to prompt the user: the glory wisdom screen wants to share 1 file (5 MB) to you, is it received? Reject control and receive control. If the user clicks the reject control, the mobile phone refuses to receive the video sent by the intelligent screen. If the user clicks the receiving control, the mobile phone receives the video sent by the intelligent screen. As shown in (C) of fig. 13C, in response to the user's operation of the receiving control, the prompt information in the popup is changed to: in one video reception, 5MB total, the progress value is received, and the control and the hidden control are cancelled. If the user clicks the cancel control, the mobile phone cancels the video reception. If the user clicks the hiding control, the mobile phone hides the prompt information. As shown in (d) of fig. 13C, the cell phone pulls up the gallery after the reception is completed, automatically plays the video, or plays the video in response to a user-triggered operation.
The above implementation 3 is described with reference to fig. 7, in which the smart screen is controlled by the mobile phone and the video is shared between the devices with the same account, and the following detailed description is given of the implementation of controlling the smart screen by the mobile phone and sharing the video between the devices with the same account.
Referring to fig. 7, as shown in fig. 14, before S301, the method for collaborative recording and sharing of multiple devices provided in the embodiment of the present application further includes S401-406.
S401, the mobile phone receives the operation of opening the intelligent space application by the user, and responds to the operation of the user, the mobile phone opens the intelligent space application and displays an intelligent space interface.
S402, the mobile phone receives an operation of triggering the device adding by a user, and searches nearby available devices through Bluetooth in response to the operation of the user.
S403, the mobile phone discovers the intelligent screen through Bluetooth.
S404, the mobile phone establishes WLAN connection with the smart screen.
S405, the mobile phone displays an added device list in the smart space interface, wherein the added device list comprises a smart screen identifier.
S406, the mobile phone receives the operation of clicking the intelligent screen identifier by the user, and responds to the user operation, the mobile phone displays a remote control interface, and the remote control interface comprises a recording control for controlling the intelligent screen to record video. At this time, the mobile phone can realize the basic function of the remote controller, which is equivalent to one remote controller, so the mobile phone can also be called a mobile phone remote controller.
After S406, the respective steps in fig. 7 are continuously performed. That is, the mobile phone receives the operation of clicking the record control by the user, and responds to the operation of the user, the mobile phone sends a record command to the intelligent screen.
FIG. 15A shows an interface diagram for binding a cell phone and a smart screen to each other through a smart space application. As shown in (a) of fig. 15A, the smart space application is installed in the mobile phone, and icons of the smart space application are displayed in the desktop. The mobile phone receives the operation of clicking the icon of the smart space application by the user, and as shown in (b) of fig. 15A, the mobile phone jumps to the main interface of the smart space application, and the interface displays the "add device" control. The mobile phone receives the operation that the user clicks the add device control, and as shown in (c) in fig. 15A, the mobile phone jumps to an add device interface, the mobile phone provides a scan add mode and a manual add mode, and the add device interface shows that the mobile phone is scanning for available devices nearby through bluetooth. After the user confirms the addition, the handset can bind the smart screen to the handset and display the smart card in the main interface of the smart space application, as shown in (d) of fig. 15A. Then, the mobile phone receives the operation of clicking the smart card by the user, and as shown in (f) in fig. 15A, the mobile phone jumps to the smart control interface, and the copy-back control is displayed in the smart control interface.
Further, the user clicks the callback control, so that the smart screen can be triggered to run the highlight time callback function. After the intelligent screen finishes the recording, the recorded 15-second video clips are sent to the mobile phone, the mobile phone receives the 15-second video clips, and prompts the user to process the received video clips. The embodiment of the application provides two prompting modes:
in the first mode, after the mobile phone receives the drawing library, the drawing library is pulled up
As shown in (a), (B), (c) and (d) in fig. 15B, the mobile phone receives the operation of clicking the callback control by the user, and in response to the user operation, the mobile phone sends a screen recording command to the smart screen, the smart screen starts the callback after receiving the screen recording command, and after the smart screen is completed in the callback, the smart screen directly sends the video clip obtained by the callback to the mobile phone, and accordingly, the mobile phone updates the display state of the callback control in the smart screen control interface: recording is started, recording is in progress (such as red spot flashing), and video is in progress (such as circle rotation).
During the video receiving process, an interface as shown in (e) in fig. 15B may also be displayed, which displays a prompt message: in one video reception, 5MB total, progress bar, cancel control and stop control. In the video receiving process, the user clicking the stop control can trigger the mobile phone to stop receiving videos, or the user clicking the progress bar can trigger the mobile phone to stop receiving videos. If the user does not click the stop control or the progress bar, the mobile phone continuously receives the video.
When the mobile phone reception is completed, as shown in (f) in fig. 15B, the mobile phone pulls up the gallery, automatically plays the video, or plays the video after responding to a user trigger operation.
In the second mode, after the mobile phone receives the video processing options, the popup window displays the video processing options
As shown in (a), (b), (C) and (d) in fig. 15C, the mobile phone receives the operation of clicking the callback control by the user, and in response to the user operation, the mobile phone sends a screen recording command to the smart screen, the smart screen starts the callback after receiving the screen recording command, and after the smart screen is completed in the callback, the smart screen directly sends the video clip obtained by the callback to the mobile phone, and accordingly, the mobile phone updates the display state of the callback control in the smart screen control interface: recording is started, recording is in progress (such as red spot flashing), and video is in progress (such as circle rotation). After the mobile phone receives the video, as shown in (e) in fig. 15C, the mobile phone popup displays a video processing option, where the video processing option includes a video opening mode, and the user selects default video playing software or other available video playing software to trigger the mobile phone to play the video through the video playing software. The video processing options may also include "move video to," "share video to," and other applications or portals that process video.
The above description is that the mobile phone controls the smart screen to record the screen under the condition that the mobile phone and the smart screen are the same account, and then the mobile phone receives the recorded video sent by the smart screen. Besides the fact that the same account electronic equipment can control the intelligent screen recording, the embodiment of the application further provides an implementation mode of controlling the intelligent screen recording by the different account electronic equipment. The embodiment of the application also provides an implementation mode for sharing the intelligent screen among the devices. The following describes an implementation manner of sharing and using the smart screen between devices and an implementation manner of controlling the smart screen recording by the heterogeneous account electronic device in conjunction with fig. 16A to 16E.
An exemplary illustration of the sharing of the smart screen with the device 2 by the device 1 is described below. The device 1 and the device 2 are devices with different accounts, and the account of the device 1 is assumed to be white while the account of the device 2 is assumed to be bright.
Here, assuming that the device 1 has bound the smart screen, the binding process may be as shown in fig. 15A described above, and the user completes binding the device between the device 1 and the smart screen by operating on the smart space application interface of the device 1, in which case the device 1 may control the smart screen. For example, in response to a user's operation on a record control in the smart space application interface of device 1, device 1 sends a record command to the smart screen to trigger the smart screen record.
The embodiment of the application provides various implementation modes for sharing and using the intelligent screen among devices.
In one implementation, a user may access an entry for device sharing by operating on a card and implement device sharing by scanning a code. Specifically, as shown in fig. 16A (a), the device 1 (account number is white) displays a main interface of the smart space application, in which a card 1 is displayed, and the card 1 is used to indicate that the device 1 has bound a smart screen. As shown in (b) in fig. 16A, in response to an operation (e.g., a long press operation) of the card 1 by the user, the device 1 pops up a menu bar including shared device options. In response to an operation (e.g., a click operation) of the user to share the device option, as shown in (c) in fig. 16A, the device 1 jumps to the interface 1, and the interface 1 includes a code-scanning sharing column, a member column added by glowing account, and a WeChat TM A member column is added. Wherein, the code scanning sharing column displays prompt information: the two-dimensional code of the other party 'glory wisdom space' is scanned. In response to a user operation (e.g., a click operation) to scan the code sharing bar, as shown in (d) of fig. 16A, the device 1 jumps to the interface 2, and a scan window is displayed in the interface 2, and a prompt message is displayed: go to "glory wisdom space" > "my two-dimensional code" scan two-dimensional code. When the device 1 (account number is white) collects the two-dimensional code in the "glory smart space" of the device 2 (account number is small) through the scanning window, as shown in (e) in fig. 16A, the device 1 returns to the interface 1, and at this time, the prompt information is displayed in the interface 1: sharing is successful. That is, device 1 successfully shared the smart screen with device 2.
In this case, the same-account multi-device collaborative screen recording can be realized between the device 1 and the intelligent screen, and the different-account multi-device collaborative screen recording can also be realized between the device 2 and the intelligent screen. Fig. 16B shows a schematic diagram of an interface for multi-device collaborative recording and sharing between device 2 and the smart screen.
As shown in fig. 16B (a), the device 2 (account number is small) displays a main interface of the smart space application, in which a card 2 corresponding to a common device "camera" is displayed. After the device 1 successfully shares the smart screen with the device 2, as shown in (B) of fig. 16B, the card 1 corresponding to "smart screen" is displayed in the smart space application main interface of the device 2. In this case, the device 2 may cooperate with the smart screen in multiple devices, as shown in (B), (c), (d), (e) and (f) in fig. 16B, and the user may trigger the smart screen to record the screen by operating on the device 2, and the specific implementation process may refer to the implementation process in fig. 15B, which is not repeated herein.
In another implementation, the user may implement device sharing by operating an entry into the device sharing on the card and adding members through the glowing account. Specifically, as shown in (a) of fig. 16C, the device 1 (account number is white) displays a main interface of the smart space application, in which a card 1 is displayed, and the card 1 is used to indicate that the device 1 has bound a smart screen. In response to an operation (e.g., a long press operation) of the card 1 by the user, the device 1 pops up a menu bar including shared device options. In response to an operation (e.g., a click operation) of the user on the shared device option, as shown in (b) in fig. 16C, the device 1 jumps to the interface 1, and the interface 1 includes a code-scanning shared field, a member field added by glowing account number, and a WeChat TM A member column is added. Wherein, through glowing the account and adding the prompt message to show in the member column: entering a glory account number or adding from a contact. In response to a user operation (e.g., a click operation) to add a member bar by glowing an account number, as shown in (C) of fig. 16C, the apparatus 1 jumps to the interface 3, has an input bar in the interface 3, and displays a prompt message: please input the glory account number. And the input field displays a contact entry. When the user inputs an account number (e.g., small brightness) in the input field, the device 1 (the account number is large white) obtains the account number (the account number is small brightness) of the device 2, as shown in (d) in fig. 16C, the device 1 returns to the interface 1, at this time, other user account number fields are displayed in the interface 1, and if the user selects other user account number fields and then selects the confirmation control "∈", then, as shown in (e) in fig. 16C, the device 2 displays a prompt message: whether or not the selected device is shared, is the information counterpart used by "glowing wisdom space? Cancel control and determine control. As shown in (f) in fig. 16C, in response to the user's operation of the determination control, the device 2 returns to the main interface of the glowing smart space application, in which the hint information is displayed: sharing is successful. That is, device 1 successfully shared the smart screen with device 2 。
In yet another implementation, the user may implement device sharing by operating an entry into the device sharing on more controls "+", and then adding members by scanning for codes or glowing account numbers. Specifically, as shown in (a) of fig. 16D, the device 1 (account number is white) displays a main interface of the smart space application, in which a card 1 is displayed, and the card 1 is used to indicate that the device 1 has bound a smart screen. As shown in (b) in fig. 16D, in response to a user operation (e.g., a click operation) of more controls "+", the device 1 pops up a menu bar including shared device options. As shown in fig. 16D (c), in response to a user operation (e.g., a click operation) of the shared device option, the device 1 jumps to the interface 4, and a smart screen device bar is included in the interface 4. If the user selects the smart screen device bar and then selects the confirm control ". V" as shown in (c) and (D) of fig. 16D, then the device 1 jumps to the interface 1 as shown in (e) of fig. 16D, where the interface 1 includes a swipe code sharing bar, a member bar added by glowing an account number, and a WeChat TM A member column is added. The following steps for sharing the smart screen with the device 2 by the device 1 may be referred to the above implementation manner, and will not be described herein.
In yet another implementation, a user may implement device sharing by operating an entry into the device sharing on a "my" control, and then adding members by scanning a code or glowing an account number. Specifically, as shown in fig. 16E (a), the device 1 (account number is white) displays a main interface of the smart space application, in which a card 1 is displayed, and the card 1 is used to indicate that the device 1 has bound a smart screen. In response to a user operation (e.g., a clicking operation) of the "my" control, the device 1 pops up the my menu bar, which includes the sharing device option. As shown in fig. 16E (b), in response to a user operation (e.g., a click operation) on a shared device option, the device 1 jumps to a "my share" interface in which an add share control is included. As shown in fig. 16E (c), in response to a user operation (e.g., a click operation) to add a sharing control, the device 1 jumps to the interface 4, and a smart screen device bar is included in the interface 4. As shown in (d) and (E) of FIG. 16E, asIf the user selects the smart screen device bar and then selects the confirm control "v", then as shown in (f) of fig. 16E, the device 1 jumps to the interface 1, where the interface 1 includes a code scanning sharing bar, a member bar added by glowing account number, and a WeChat TM A member column is added. The following steps for sharing the smart screen with the device 2 by the device 1 may be referred to the above implementation manner, and will not be described herein.
According to the scheme, the intelligent screen can be operated on the same account equipment to trigger the intelligent screen to automatically record the video clips in the background; the intelligent screen can be triggered to automatically record video clips in the background by operating on the different account number equipment, and multiple realization modes of multi-equipment collaboration are also provided, so that user operation is faster when the intelligent screen is triggered to record, and user experience can be improved.
The process of triggering the smart screen recording is described above from the mobile phone side, and the scenes and prompts which may occur when the smart screen recording is triggered by the mobile phone are described below from both sides of the mobile phone and the smart screen.
Scene one: when the smart screen side 'highlight time' is not started, the user triggers and sends a record back on the mobile phone side
Illustratively, as shown in fig. 17, if the user clicks the copy back control on the mobile phone side at the first moment, the mobile phone sends a screen recording command to the smart screen in response to the user operation. After the intelligent screen receives the screen recording command, the intelligent screen detects whether the 'highlight moment' recording function is started, if the 'highlight moment' recording function is not started, the intelligent screen can prompt a user to start the 'highlight moment', the cursor focus is defaulted to stay on the starting control, and the user clicks the starting control to trigger the intelligent screen to start the 'highlight moment' recording function.
Accordingly, the mobile phone side and the intelligent screen side keep synchronous prompt. As shown in fig. 17, the mobile phone side displays a prompt message "wonderful time is not started, and tries again after starting.
When the cursor focus stays on the opening control, the user can click an OK key in the intelligent screen control interface of the mobile phone, and can click an OK key on the remote controller, so that the intelligent screen is triggered to open a 'wonderful moment' recording function. The smart screen records a video clip 15 seconds before the first time after turning on the "highlight" copy back function.
Scene II: when the intelligent screen starts playing the video for less than 15 seconds, the user triggers and sends a return record at the mobile phone side
Illustratively, as shown in fig. 18, if the user clicks the copy-back control on the mobile phone side, the mobile phone sends a screen-recording command to the smart screen in response to the user operation. After the smart screen receives the screen recording command, the smart screen detects whether the ' highlight moment ' recording function is started, and under the condition that the ' highlight moment ' recording function is started, the smart screen detects whether the video is being played again, and whether the video playing time is longer than or equal to 15 seconds, if the smart screen is playing the video and the video playing time (such as 10 seconds) is shorter than 15 seconds, the smart screen can prompt the ' highlight moment preparation, please try again after 5 seconds).
Accordingly, the mobile phone side and the intelligent screen side keep synchronous prompt. As shown in fig. 18, the mobile phone side displays a prompt message "in preparation for a wonderful time, please try again later".
Scene III: the user triggers the record at the mobile phone side, but the current interface at the intelligent screen side does not support the record
Illustratively, as shown in fig. 19, if the user clicks the copy-back control on the mobile phone side, the mobile phone sends a screen-recording command to the smart screen in response to the user operation. After the intelligent screen receives the screen recording command, the intelligent screen detects whether the 'highlight moment' recording function is started, and under the condition that the 'highlight moment' recording function is started, the intelligent screen detects whether the video is being played again, and whether the video playing duration is greater than or equal to 15 seconds, if the intelligent screen does not play the video currently, the intelligent screen can prompt that the 'highlight moment recording is not supported by the current interface'.
Accordingly, the mobile phone side and the intelligent screen side keep synchronous prompt. As shown in fig. 19, the mobile phone side displays a prompt message "the current interface does not support recording of a wonderful time".
Illustratively, the scenes that support highlight recording are: video resources of a media center, video resources of a video APP, video streams played by a media player in a three-party APP, and all resources accessed by an input source.
Scene four: the user frequently triggers the return record at the mobile phone side, for example, 8 times within 10 minutes
Whenever the user clicks the one-time copy-back control on the mobile phone side, the mobile phone responds to the user operation and sends one-time screen-recording command to the intelligent screen, and accordingly the intelligent screen receives one-time screen-recording command. When the intelligent screen receives the screen recording command, the intelligent screen starts a counter, the counter is increased by 1, and a timer is started, wherein the duration of the timer is a second preset duration, such as 10 minutes. Then, the counter is incremented by 1 each time the smart screen receives a user's entry. When the timer is greater than or equal to the second preset time length, resetting the timer and re-timing; and the counter is cleared and recounting is performed. If the timer is less than the second preset time period and the cumulative count value of the counter is greater than or equal to the trigger number threshold, the user may be deemed to operate too frequently.
For example, as shown in fig. 20, when the user clicks the copy-back control on the mobile phone side, the mobile phone responds to the user operation and sends a copy-back command to the smart screen, after the smart screen receives the copy-back command, the smart screen detects whether the copy-back function at the "wonderful time" is turned on, and in the case that the copy-back function at the "wonderful time" is turned on, the smart screen detects whether the video is being played again, and whether the video playing duration is greater than or equal to 15 seconds, and if the smart screen is playing the video, and the video playing duration is greater than or equal to 15 seconds, the smart screen detects whether the triggering number is less than the triggering number threshold (e.g. 8 times) within the second preset duration (e.g. 10 minutes).
In one aspect, if the smart screen detects that the number of triggers is less than the threshold number of triggers (e.g., 8) within a second predetermined time period (e.g., 10 minutes), the smart screen performs the recording.
On the other hand, if the intelligent screen detects that the trigger number is greater than or equal to the trigger number threshold (e.g., 8 times) within the second preset time period (e.g., 10 minutes), that is, the user operates too frequently, the intelligent screen may not execute the screen recording, and the intelligent screen may prompt "you operate too frequently, please try again after X minutes. For example, if the timer is 6 minutes and the cumulative count of the counter is 8 times, the triggering times within 10 minutes can be judged to be 8 times, which is equal to the triggering times threshold value, and by calculating, the indication x=10-6=4 minutes, the intelligent screen can prompt "you operate too frequently, please try again after 4 minutes".
Accordingly, the mobile phone side and the intelligent screen side keep synchronous prompt. As shown in fig. 20, the mobile phone side displays a prompt message "you operate too frequently, please try again later".
Scene five: due to the network change of the intelligent screen side, the network of the intelligent screen side is inconsistent with the network of the mobile phone side, so that transmission is interrupted
Illustratively, if the user clicks the record control on the handset side, the handset sends a record command to the smart screen in response to the user operation. After the smart screen receives the screen recording command, the smart screen detects whether the 'highlight moment' recording function is on, video is being played, and the video playing time is longer than or equal to 15 seconds, in which case the smart screen records 15 seconds of video clips. In the recording process, the intelligent screen side network changes from the network 1 to the network 2, and at the moment, the mobile phone side network is the network 1, and the transmission is interrupted due to the fact that the intelligent screen side network is inconsistent with the mobile phone side network.
As shown in (a) of fig. 21, the smart screen popup prompts: the highlight sending stops, the network change is detected to be 'network 2', whether the network is switched between the setting-network and the connection-network, and the control is canceled and the network is switched between the setting-network and the connection-network. Correspondingly, the mobile phone popup prompts: the highlight reception stops, and the intelligent screen network is detected to be changed into 'network 2', and the intelligent screen 'set-network and connection-network' is switched. That is, the network on the smart screen side changes, and the user is required to switch the network on the smart screen to ensure that the network on the smart screen side is consistent with the network on the mobile phone side.
As shown in fig. 21 (b), in response to the user's operation of the go-to control of the smart screen, the smart screen jumps to the network setting interface in which the currently connected network is displayed as network 2. In response to the user selecting the network 1 in the network setting interface in which the smart screen side is displayed as the network 1, the smart screen disconnects the network 2 and reconnects to the network 1 as shown in (c) of fig. 21. Thus, the intelligent screen side and the mobile phone side are connected with the same network at present and are both networks 1.
And under the condition that the current connected networks of the intelligent screen side and the mobile phone side are the same, the intelligent screen continuously sends 15 seconds of video clips to the mobile phone. As shown in fig. 21 (d), the smart-screen side prompt "highlight-time-continue-send", and the mobile-phone side prompt "highlight-time-continue-receive".
In another embodiment, in case the smart-screen-side network changes, the smart-screen-side network is inconsistent with the mobile-phone-side network, resulting in transmission interruption, the smart-screen-side may pop-up the window prompt: the transmission of the wonderful time is stopped, whether the intelligent screen side network is changed into the network 2 or not is detected, the network 1 is switched back, the intelligent screen side network is consistent with the mobile phone side network, the wonderful time is continuously transmitted, and the control and the confirmation control are cancelled. In response to the user's operation of the confirmation control, the smart screen side switches from being connected to the network 2 to being connected to the network 1. Thus, the intelligent screen side and the mobile phone side are connected with the same network at present and are both networks 1. And under the condition that the current connected networks of the intelligent screen side and the mobile phone side are the same, the intelligent screen continuously sends 15 seconds of video clips to the mobile phone.
Scene six: because of the network change of the mobile phone side, the network of the mobile phone side is inconsistent with the network of the intelligent screen side, so that transmission is interrupted
Illustratively, if the user clicks the record control on the handset side, the handset sends a record command to the smart screen in response to the user operation. After the smart screen receives the screen recording command, the smart screen detects whether the 'highlight moment' recording function is on, video is being played, and the video playing time is longer than or equal to 15 seconds, in which case the smart screen records 15 seconds of video clips. In the smart screen recording process, the mobile phone side network changes from the network 1 to the network 2, and at this time, the smart screen side network is the network 1, and the transmission is interrupted due to the inconsistency between the mobile phone side network and the smart screen side network.
As shown in (a) of fig. 22, the mobile phone popup prompts: the highlight time is received and stopped, the network change is detected to be 'network 2', whether the WLAN is switched, and the control is canceled and the control is switched. Correspondingly, intelligent screen popup prompts: the transmission stops at the highlight moment, the mobile phone network is detected to be changed into the network 2, and the mobile phone WLAN is requested to be switched. That is, the network of the mobile phone side changes, and the user is required to switch the network on the mobile phone so as to ensure that the network of the mobile phone side is consistent with the network of the intelligent screen side.
As shown in fig. 22 (b), in response to the user's operation of the go-to control of the handset, the handset jumps to the WLAN setup interface where the currently connected WLAN is displayed as network 2. In response to the user's operation of selecting the network 1 in the WLAN setup interface in which the currently connected network is displayed as the network 1, the smart screen disconnects the network 2 and reconnects to the network 1 as shown in (c) of fig. 22. Thus, the mobile phone side and the smart screen side are the same as the network to which they are currently connected, which is the network 1.
In the case where the current connected networks of the mobile phone side and the smart screen side are the same, the smart screen continues to send 15 seconds video clips to the mobile phone. As shown in fig. 22 (d), the smart-screen side prompt "highlight-time-continue-send", and the mobile-phone side prompt "highlight-time-continue-receive".
In another embodiment, in the case that the mobile phone side network changes and the mobile phone side network is inconsistent with the smart screen side network, and transmission is interrupted, the mobile phone side may pop a window prompt: the transmission of the wonderful time stops, whether the mobile phone side network is changed into the network 2 or not is detected, the network 1 is switched back, the network is consistent with the intelligent screen side network, the wonderful time is continuously received, and the control is cancelled and the control is confirmed. In response to the user's operation of the confirmation control, the mobile phone side switches from being connected to the network 2 to being connected to the network 1. Thus, the mobile phone side and the smart screen side are the same as the network to which they are currently connected, which is the network 1. Under the condition that the current connected networks of the mobile phone side and the intelligent screen side are the same, the intelligent screen continuously sends 15 seconds of video clips to the mobile phone, and the mobile phone continuously receives the 15 seconds of video clips sent by the intelligent screen.
Scene seven: network changes on the smart screen side or the mobile phone side, resulting in transmission interruption
In the smart screen recording process, the smart screen side network may change, or the mobile phone side network may change, resulting in transmission interruption. As shown in fig. 23, the smart screen prompts: the "highlight" transmission fails and please check the network status. The mobile phone prompts that the reception of the wonderful moment fails and please check the network state.
The embodiment of the application provides an implementation mode for recording and sharing wonderful moments by an intelligent screen. The remote controller and the smart space APP of the mobile phone can trigger the wonderful time recording function of the smart screen. The following flow 1 illustrates the process of triggering the recording and sharing the video by the remote controller, and the following flow two illustrates the process of triggering the recording and sharing the video by the mobile phone.
The process is as follows: 1) Triggering after the user presses the OK key of the remote controller for a long time, storing the video for 15 seconds after the intelligent screen receives the triggering, and displaying a sharing interface; 2) The user selects the sharing control by operating on the remote controller; 3) The intelligent screen pops up the equipment selection interface; 4) The user selects the equipment by operating on the remote controller, so that video sharing is realized.
A second flow: 1) Triggering by a user through a mobile phone remote controller, storing the video 15 seconds before the intelligent screen receives the triggering, displaying a sharing interface, sending the video to the mobile phone, 2) popping up a receiving frame on the mobile phone, and confirming the video receiving by the user; 3) The mobile phone receives the video and jumps to the gallery, so that the video can be further shared.
In some embodiments, when a mobile phone with a different account number from the smart screen is used as a "mobile phone remote controller", the mobile phone pops up a receiving prompt box, and after the user confirms the receiving, the mobile phone receives the video. In other embodiments, when the mobile phone with the same account number as the smart screen is used as the "mobile phone remote controller", the mobile phone may not pop up the prompt box, and the mobile phone side directly receives the video.
The following exemplarily illustrates a hardware structure of a smart screen according to an embodiment of the present application with reference to fig. 24.
Fig. 24 shows a functional block diagram of an intelligent screen provided by an embodiment of the present application. As shown in fig. 24, the smart screen 400 may include: processor 401, memory 402, communication interface 403, audio circuit 404, speaker 405, microphone 406, power supply 407, display 408, etc., which may communicate via one or more communication buses or signal lines (not shown). The following describes the components of the intelligent screen in detail with reference to fig. 24.
The processor 401 is a control center of the smart screen, connects respective portions of the smart screen using various interfaces and lines, and performs various functions of the smart screen and processes data by running or executing an application program stored in the memory 402 and calling data stored in the memory 402. In some embodiments, the processor 401 may include one or more processing units.
The processor 401 is specifically configured to:
at a first moment, a first screen recording command sent by a remote controller is received, wherein the first screen recording command is generated after a user operates a first key of the remote controller;
responding to the first screen recording command, and acquiring a first video clip with a first preset duration before the first moment from a video picture being played;
Suspending display of identifications of one or more nearby available devices on a video picture being played;
transmitting the first video clip to a second electronic device, which is any one of the one or more nearby available devices, in response to a user selecting an identification of the second electronic device via the remote control;
at a second moment, receiving a second screen recording command sent by third electronic equipment, wherein the second screen recording command is generated after a user operates on a first control in an interface of a first application, and the first application is an application program installed on the third electronic equipment;
responding to the second screen recording command, and acquiring a second video clip of the first preset duration before the second moment from the video picture being played;
and sending the second video clip to the third electronic device.
The third electronic device is a mobile phone or a tablet computer. The second electronic device is a mobile phone, a tablet computer or an intelligent screen.
The memory 402 is used to store application programs and data, and the processor 401 performs various functions of the smart screen and data processing by running the application programs and data stored in the memory 402. The memory 402 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system, at least one application program required by a function (such as a video playing function, a voice collecting function, etc.); the storage data area may store data (such as video data, audio data, etc.) created according to the use of the smart screen. In addition, the memory 402 may include high-speed random access memory (random access memory, RAM), and may also include non-volatile memory, such as a magnetic disk storage device, flash memory device, or other volatile solid-state storage device, and the like. The memory 402 may store various operating systems. The memory 402 may be independent of the processor 401 and connected to the processor 401 through the communication bus; alternatively, the memory 402 may be integrated with the processor 401.
The smart screen is connected to other devices such as a cell phone or tablet computer through a communication interface 403. By way of example, the communication interface 403 may be a radio frequency circuit, a bluetooth device, a Wi-Fi device, or a signal transmission line interface, for example, for a smart screen to communicate with a cell phone, or a smart screen to communicate with a server, or a smart screen to communicate with a remote control.
The audio circuit 404 is connected to the speaker 405 and the microphone 406, and on the one hand, the audio circuit 404 may transmit the electrical signal after the received audio data is converted to the speaker 405, and the electrical signal is converted to a sound signal by the speaker 405 and output; on the other hand, the microphone 406 converts the collected sound signal (e.g., voice uttered by the user) into an electrical signal, which is received by the audio circuit 404 and converted into audio data (or voice data), and outputs the audio data, e.g., the smart screen sends the voice data to the smart screen, or the smart screen sends the voice data to a server or the like, or the voice data is output to the memory 402 for further processing.
The power supply device 407 may supply power to various components, for example, the power supply device 407 includes a battery and a power management chip, and the battery may be logically connected to the processor 401 through the power management chip, so that functions of managing charging, discharging, power consumption management, and the like are implemented through the power supply device 407.
The display 408 is also referred to as a display. The display may be used to play live video or video-on-demand, etc. The display includes a display panel, which may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, a touch sensor may be disposed in the display to form a touch screen, and embodiments of the present application are not limited. The touch sensor is used to detect a touch operation acting on or near it. The touch sensor may communicate the detected touch operation to the processor 401 to determine the type of touch event. The processor 401 may provide visual output related to the touch operation through the display.
In some embodiments, the smart screen 400 may further include more devices, such as a USB interface, etc., which is not described in detail in the embodiments of the present application. It will be appreciated that the components shown in fig. 24 are not intended to be limiting in detail, and that the smart screen may include more or less components than shown, or may be a combination of certain components, or may be a split of certain components, or may be a different arrangement of components.
In an embodiment of the present application, the smart screen 400 has video playback capabilities, recording capabilities, wireless communication capabilities (e.g., the ability to automatically perceive nearby available devices), and the ability to transmit recorded video clips to other electronic devices.
The methods of the above embodiments may be implemented in a smart screen having the hardware configuration shown in fig. 24. Based on the components shown in fig. 24, an operating system is running. Such as iOS operating systems, android open source operating systems, windows operating systems, and the like. An operating application may be installed on the operating system.
Fig. 25 is a schematic block diagram of a software architecture employed by a first electronic device (e.g., a smart screen) according to an embodiment of the present application. The smart screen provided by the embodiment of the present application is described below with reference to the software architecture shown in fig. 25.
It will be appreciated that the layered architecture divides the software into several layers, each with a clear role and division. The layers communicate with each other through a software interface. In some embodiments, the Android system may include an application layer (APP), a framework layer (FWK), a hardware abstraction layer (hardware abstraction layer, HAL), and a kernel layer (kernel).
The application layers may include a User Interface (UI) layer and a logic layer. As shown in fig. 25, the UI layer includes a video APP, and the logic layer includes a Television (TV) player (TvPlayer), a TV service module (TvService), and a highlight processing module.
In some embodiments, corresponding to the method embodiments described above, the smart screen may play the first video stream through the video APP.
The application framework layer provides application programming interfaces (application programming interface, APIs) and programming services for application programs of the application program layer. The framework layer includes some predefined functions. The framework layer provides programming services to application layer calls through the API interface. It should be noted that, in the embodiment of the present application, the framework layer includes a surfeflinger service module and a media playing service module (MediaPlayer).
The interface element issued by the video APP can be received by the SurfaceFinger service module and subjected to layer composition processing. The media playing service module can carry out audio and video decomposition on the first video stream and then send the first video stream to the decoding module of the hardware abstraction layer.
The hardware abstraction layer plays a role of a bridge between software and hardware, and can be used for abstracting the hardware and providing a virtual hardware use platform for an operating system.
The kernel layer provides the bottom layer driver for various hardware of the intelligent screen. Illustratively, as shown in fig. 25, the kernel layer includes an audio driver module (AudioDriver) and a display driver (not shown).
It will be appreciated that the smart screen also includes a hardware layer based on the software architecture application described above, the hardware layer including various hardware.
Illustratively, as shown in fig. 25, the hardware layer may include a display for implementing a video playback function, e.g., the display is used to play the first video stream. The hardware layer may also include a bluetooth chip or Wi-Fi chip for searching for nearby available devices. The hardware layer may further comprise a speaker for outputting an audio signal of the first video stream, i.e. video sound. The hardware layer may also include a hardware audio-video interface, such as a high definition multimedia interface (high definition multimedia interface, HDMI) or the like.
The scheme of the application can comprise the following steps: the method comprises the steps of collecting an audio code stream and a video code stream in a video playing process, obtaining a video fragment with a first preset duration after a user triggers a screen recording, sensing nearby available equipment and transmitting the video fragment to the nearby available equipment. Optionally, the video clip is stored by a nearby available device. Optionally, a nearby available device pops up a file sharing interface to prompt the user whether to share the video clip to other users. The implementation of the solution of the present application will be exemplarily described with reference to each functional module in the architecture of fig. 25.
In some embodiments, as shown in fig. 25, the hardware abstraction layer may include a video decoder and an audio decoder. The video decoder receives the video code stream issued by the media playing service module in the application framework layer, and then the video decoder can decode the video code stream. The audio decoder receives an audio code stream issued by the media play service module in the application framework layer, and then the audio decoder can decode the audio code stream.
In some embodiments, as shown in fig. 25, the hardware abstraction layer may further include an on-screen display (on screen display, OSD), a Video Object (VO), and a video synthesizer (VideoMix). The OSD can acquire the layer processed by the SurfaceFlinger service module. The video object obtains a video bitstream from a video decoder. The video synthesizer can synthesize the processed image layer issued by the OSD and the video code stream at the VO of the video object to obtain the video stream to be displayed. The video synthesizer can send the video stream to be sent to a display of the hardware layer, and the display finishes video stream playing.
In some embodiments, as shown in FIG. 25, the hardware abstraction layer includes an audio-video interface. When a TV player of the application program layer starts to play an input source (such as a video stream resource from a video APP), an audio-video interface can be called to trigger the acquisition of a video code stream from a video decoder and the acquisition of an audio code stream from the audio decoder to realize video play. Alternatively, the TV player may initiate the input source to play the video stream asset in accordance with the play command.
In some embodiments, as shown in fig. 25, the hardware abstraction layer includes an audio acquisition module (AudioCapture) and a video acquisition module (screencapture h). The audio acquisition module (AudioCapture) and the video acquisition module (screencapture h) are collectively called as a screen recording service (ScreenRecord).
The multi-device collaborative screen recording and sharing method provided by the application comprises an audio acquisition channel and a video acquisition channel. The audio acquisition channel involves an audio decoder, an audio driver (AudioDriver) and an audio acquisition module (AudioCapture). The video acquisition channel involves a video compositor (VideoMix) and a video acquisition module (ScreenCaptureH).
In the audio acquisition channel, an audio acquisition module (AudioCapture) acquires audio data from an audio decoder in real time through an audio driver (AudioDriver) during video playing. Then, an audio acquisition module (AudioCapture) reports the audio data (also referred to as an audio code stream) acquired in real time to a TV service module. The audio data may be buffered and encoded to obtain a pulse code modulated (pulse code modulation, PCM) audio code stream.
In the video acquisition channel, a video acquisition module (ScreenCaptureH) acquires video data from a video synthesizer (VideoMix) in real time in the video playing process, and then reports the video data (also called video code stream) acquired in real time to a TV service module.
Accordingly, the TV service module may receive the audio code stream reported by the audio acquisition module and the video code stream reported by the video acquisition module. The TV service module can also perform audio and video synchronization processing on the audio code stream and the video code stream to obtain a video stream after audio and video synchronization. The TV service module can realize sound and picture synchronization through timestamp synchronization calculation.
The highlight moment processing module can sense the screen recording command and perform recording processing on video resources (including video data and audio data) being played according to the screen recording command. Specifically, when the highlight moment processing module receives the screen recording command, the highlight moment processing module obtains a video stream of a first preset duration (for example, 15 seconds) from the TV service module according to a preset screen recording strategy, that is, the first video clip.
Illustratively, the preset recording strategy may include any of the following: selecting a 15-second video stream before a screen recording time node (for example, at the moment of receiving a screen recording command) as a first video segment; selecting a 5-second video stream before the screen recording time node and a 10-second video stream after the screen recording time node as a first video segment; and selecting the 10-second video stream before the recording time node and the 5-second video stream after the recording time node as the first video clip.
It will be appreciated that, for exemplary illustration, the first preset duration and the recording period may be specifically set according to actual use requirements, which is not limited by the embodiment of the present application.
Optionally, the highlight moment processing module may further add a watermark to the first video segment. Illustratively, when watermarking, the video may be fetched frame by frame and subjected to a series of steps of decoding, watermark synthesis, encoding, etc.
Optionally, the highlight processing module may further generate a preview cover of the first video segment according to the first frame image of the video.
In the case where the highlight reel processing module obtains a first video segment of a first preset duration (e.g., 15 seconds), the highlight reel processing module instructs a wireless communication service module (not shown in fig. 25) to perform a close range device scan and send the first video segment to the searched available device. Further, the wireless communication service module issues a message for scanning the short-range device to wireless communication hardware such as a Bluetooth BT or Wi-Fi module according to the instruction of the highlight processing module.
Further, wireless communication hardware such as bluetooth BT or Wi-Fi modules scans devices in a trusted environment for close range devices to perceive available devices in the vicinity. After sensing a nearby available device (e.g., a cell phone), wireless communication hardware such as a bluetooth BT or Wi-Fi module establishes a wireless communication connection with the nearby available device.
Further, the highlight moment processing module transmits the first video clip obtained by screen recording to nearby available equipment through the wireless communication connection, so that a user can store the first video clip and/or share the first video clip to other users through the nearby available equipment.
The hardware architecture and the software architecture of the intelligent screen provided by the embodiment of the application are described above with reference to fig. 24 and 25, respectively. The principle and process of playing video by the smart screen will be described with reference to fig. 26, and the principle and process of recording video when playing video by the smart screen will be described with reference to fig. 27.
As shown in fig. 26, when the user triggers the smart screen to play the video, the smart screen first obtains the video file and puts the video file into the memory buffer. These video files are encapsulated format data, including audio and video streams. The package format may be AVI, MOV, MP4, etc. and the video file may be visually understood as a container containing various encoded data. After the video file is obtained, the intelligent screen performs unpacking format processing on the video file, and separates the video code stream from the audio code stream to obtain audio compression data and video compression data. Further, the intelligent screen decodes the audio compressed data to obtain audio sampling data, and decodes the video compressed data to obtain video pixel data. And then the intelligent screen synchronously processes the audio sampling data and the video pixel data to obtain video data to be played. Finally, based on the video data to be played, a video picture is displayed on the display and video sound is output through the speaker.
As shown in fig. 27, the first video stream generates audio sample data after audio decoding and generates video pixel data after video decoding, i.e., the first video stream includes the audio sample data and the video pixel data. During the process of playing the first video stream by the smart screen, when the smart screen receives the screen recording command, audio data of a first preset duration (for example, 15 seconds before receiving the screen recording command) can be obtained from the audio sampling data, and video data of the same first preset duration (for example, 15 seconds before receiving the screen recording command) can be obtained from the video pixel data. And then, carrying out synchronous processing on the audio data and the video data to obtain the video data to be played, namely a first video clip.
According to the scheme, when a user uses the intelligent screen to watch the video, the intelligent screen can record the video highlight at any time according to the user indication and automatically transmit the video highlight to the mobile phone and other devices in the trusted environment, so that the user can share in real time.
The method for collaborative recording and sharing of multiple devices provided by the embodiment of the application can be applied to the electronic device 500 (a third electronic device, such as a mobile phone or a tablet computer). As shown in fig. 28, the electronic device 500 may include: processor 510, external memory interface 520, internal memory 521, universal serial bus (universal serial bus, USB) interface 530, charge management module 540, power management module 541, battery 542, antenna 1, antenna 2, mobile communication module 550, wireless communication module 560, audio module 570, speaker 570A, receiver 570B, microphone 570C, headset interface 570D, sensor module 580, keys 590, motor 591, indicator 592, camera 593, display 594, and subscriber identity module (subscriber identification module, SIM) card interface 595, among others.
It is to be understood that the configuration illustrated in this embodiment does not constitute a specific limitation on the electronic apparatus. In other embodiments, the electronic device may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 510 may include one or more processing units, such as: processor 510 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The processor 510 is specifically configured to:
receiving operation of a first control in an interface of a first application, which is an application program installed on the electronic device 500, by a user at a second moment;
Responding to the operation of the user on the first control at the second moment, and sending a screen recording command to the intelligent screen;
and receiving a recorded video sent by the intelligent screen, wherein the recorded video is a video clip which is recorded by the intelligent screen based on a screen recording command and is of a first preset duration before the second moment.
The controller may be a neural hub and command center of the electronic device. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 510 for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. The memory may hold instructions or data that has just been used or recycled by the processor 510. If the processor 510 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 510 is reduced, thereby improving the efficiency of the system.
In some embodiments, processor 510 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others. For example, in the embodiment of the present application, the processor may be configured to execute any of the methods for collaborative recording and sharing of multiple devices provided in the present application.
It should be understood that the connection relationship between the modules illustrated in this embodiment is only illustrative, and does not limit the structure of the electronic device. In other embodiments, the electronic device may also use different interfacing manners in the foregoing embodiments, or a combination of multiple interfacing manners.
The electronic device implements display functions through a GPU, a display screen 594, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 510 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 594 is used to display images, videos, and the like. The display screen 594 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-LED, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like.
Video codecs are used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent cognition of electronic devices can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.
The external memory interface 520 may be used to connect external memory cards, such as Micro SD cards, to enable expansion of the memory capabilities of the electronic device. The external memory card communicates with the processor 510 via an external memory interface 520 to implement data storage functions. For example, a file such as a recorded video is stored in an external memory card.
The internal memory 521 may be used to store computer-executable program code that includes instructions. The processor 510 executes various functional applications of the electronic device and data processing by executing instructions stored in the internal memory 521. For example, in an embodiment of the present application, the processor 510 may be configured to execute instructions stored in the internal memory 521, and the internal memory 521 may include a stored program area and a stored data area.
The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device (e.g., audio data, phonebook, etc.), and so forth. In addition, the internal memory 521 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.
The wireless communication function of the electronic device 500 may be implemented by the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in electronic device 500 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 550 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 500. The mobile communication module 550 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 550 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 550 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 550 may be disposed in the processor 510. In some embodiments, at least some of the functional modules of the mobile communication module 550 may be disposed in the same device as at least some of the modules of the processor 510.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 570A, receiver 570B, etc.) or displays images or video through display screen 594. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 550 or other functional module, independent of the processor 510.
The wireless communication module 560 may provide solutions for wireless communication including WLAN (e.g., wi-Fi), BT, global navigation satellite system (global navigation satellite system, GNSS), FM, NFC, IR, or general 2.4G/5G wireless communication technology, etc., as applied on the electronic device 500. The wireless communication module 560 may be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 510. The wireless communication module 560 may also receive a signal to be transmitted from the processor 510, frequency modulate and amplify the signal, and convert the signal to electromagnetic waves through the antenna 2 for radiation.
In some embodiments, the wireless communication module 560 may be a Wi-Fi and/or bluetooth chip. The electronic device 500 may establish a connection with the chip of the smart screen through the chip to enable wireless communication and service processing between the electronic device 500 and other electronic devices through the connection. Among other things, bluetooth chips can typically support BR/EDR bluetooth and BLE.
In the embodiment of the present application, the electronic device 500 may be a mobile phone or a tablet computer. The electronic device 500 has wireless communication capabilities and data transmission capabilities.
In the embodiment of the present application, "greater than" may be replaced with "greater than or equal to", "less than or equal to" may be replaced with "less than", or "greater than or equal to" may be replaced with "greater than", "less than" may be replaced with "less than or equal to".
The various embodiments described herein may be separate solutions or may be combined according to inherent logic, which fall within the scope of the present application.
The foregoing describes the solution provided by the embodiments of the present application primarily from the perspective of method steps. It will be appreciated that, in order to implement the above-described functions, an electronic device implementing the method includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The embodiment of the application can divide the functional modules of the electronic device according to the method example, for example, each functional module can be divided corresponding to each function, or two or more functions can be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other possible division manners may be implemented in practice.
The present application also provides a chip coupled to a memory for reading and executing a computer program or instructions stored in the memory to perform the methods of the embodiments described above.
The application also provides an electronic device comprising a chip for reading and executing a computer program or instructions stored in a memory, such that the method in the embodiments is performed.
The embodiment also provides a computer readable storage medium, in which computer instructions are stored, and when the computer instructions run on the electronic device, the electronic device is caused to execute the related method steps to implement the method for collaborative screen recording and sharing of multiple devices in the embodiment.
The present embodiment also provides a computer program product, where the computer readable storage medium stores program codes, and when the computer program product runs on a computer, the computer is caused to perform the related steps, so as to implement the method of multi-device collaborative screen recording and sharing in the foregoing embodiment.
In addition, embodiments of the present application also provide an apparatus, which may be embodied as a chip, component or module, which may include a processor and a memory coupled to each other; the memory is used for storing computer executing instructions, and when the device runs, the processor can execute the computer executing instructions stored in the memory, so that the chip executes the multi-device collaborative screen recording and sharing method in the method embodiments.
The electronic device, the computer readable storage medium, the computer program product or the chip provided in this embodiment are used to execute the corresponding method provided above, so that the beneficial effects thereof can be referred to the beneficial effects in the corresponding method provided above, and will not be described herein.
In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (25)

1. A method for collaborative recording and sharing of multiple devices is characterized by comprising the following steps:
at a first moment, a first electronic device receives a first screen recording command sent by a remote controller, wherein the first screen recording command is generated after a user operates a first key of the remote controller;
responding to the first screen recording command, and acquiring a first video clip with a first preset duration before the first moment from a video picture being played by the first electronic equipment;
the first electronic device suspends and displays the identification of one or more nearby available devices on the video picture being played;
in response to a user selecting an identification of a second electronic device through the remote control, the first electronic device transmitting the first video clip to the second electronic device, the second electronic device being any one of the one or more nearby available devices;
At a second moment, the first electronic device receives a second screen recording command sent by a third electronic device, wherein the second screen recording command is generated after a user operates a first control in an interface of a first application, and the first application is an application program installed by the third electronic device;
responding to the second screen recording command, and acquiring a second video clip with the first preset duration before the second moment from a video picture being played by the first electronic equipment;
the first electronic device sends the second video clip to the third electronic device.
2. The method of claim 1, wherein the first electronic device and the third electronic device are two devices that have logged into the same wireless local area network using the same account number;
before the first electronic device receives the second screen recording command sent by the third electronic device, the method further comprises the following steps:
and responding to a first operation of a user, and establishing Wireless Local Area Network (WLAN) connection between the first electronic equipment and the third electronic equipment by the first electronic equipment.
3. The method of claim 1 or 2, wherein the first electronic device transmitting the first video clip to the second electronic device comprises:
The first electronic device judges whether the second electronic device is the device with the same account as the first electronic device;
when the second electronic equipment is equipment with the same account number as the first electronic equipment, the first electronic equipment sends the first video clip to the second electronic equipment;
when the second electronic device is a device different from the first electronic device in account, the first electronic device sends a first request message to the second electronic device, the first electronic device receives a first response message sent by the second electronic device, and the first electronic device responds to the first response message and sends the first video clip to the second electronic device;
the first request message is a message for requesting the second electronic device to receive the first video segment, and the first response message is a message for the second electronic device to confirm receiving the first video segment.
4. A method according to any one of claim 1 to 3, wherein,
the first electronic device obtains a first video clip of the first preset duration before the first moment from a video picture being played, and the first video clip comprises: when the first electronic equipment meets a preset condition, the first electronic equipment acquires the first video clip from a video picture being played;
The first electronic device obtains a second video clip of the first preset duration before the second moment from the video picture being played, and the second video clip comprises: when the first electronic equipment meets the preset condition, the first electronic equipment acquires the second video clip from the video picture being played;
wherein, the preset conditions include: the first electronic equipment starts a first function, the first electronic equipment plays a video picture, the playing time of the first electronic equipment is longer than or equal to the first preset time, the number of times that the first electronic equipment is triggered to record a screen in the second preset time is smaller than a preset number of times threshold, and the first function is a function of recording a video.
5. A method according to any one of claims 1 to 3, wherein the first electronic device obtaining a second video clip of the first preset duration before the second moment from a video picture being played, comprising:
when the first electronic equipment does not start the first function, the first electronic equipment suspends and displays a first window on a video picture being played, wherein the first window contains a message for prompting a user to start the first function;
And responding to the operation of confirming to start the first function by a user, and acquiring the second video clip from the video picture being played by the first electronic equipment.
6. A method according to any one of claims 1 to 3, further comprising:
and responding to the first screen recording command or the second screen recording command, and when the picture displayed by the first electronic equipment is not a video picture, prompting that the current interface does not support recording by the first electronic equipment.
7. A method according to any one of claims 1 to 3, further comprising:
responding to the first screen recording command or the second screen recording command, when the played time length of the first electronic equipment is smaller than the first preset time length, prompting the first electronic equipment to trigger screen recording after the time length delta T, and sending a message requesting to trigger screen recording again later to the third electronic equipment;
wherein Δt is a difference between the first preset duration and the played duration.
8. A method according to any one of claims 1 to 3, further comprising:
responding to the first screen recording command, when the number of times that the first electronic equipment is triggered to record the screen in a second preset time length is greater than or equal to the preset time number threshold, prompting the first electronic equipment to trigger the screen recording again after the time length X, and sending a message requesting to trigger the screen recording again later to the third electronic equipment.
9. The method of claim 8, wherein the method further comprises:
when the first electronic equipment receives a screen recording command for the first time, the first electronic equipment starts a timer and starts a counter, the counter is increased by one, and the timer starts to count from zero; the screen recording command is the first screen recording command or the second screen recording command;
every time the first electronic equipment receives a screen recording command, the counter is added one in an accumulated way;
when the timer is greater than or equal to the second preset duration, the first electronic device resets the timer and resets the counter;
when the number of times that the first electronic device is triggered to record a screen in the second preset time period is greater than or equal to the preset time period threshold, the first electronic device prompts that the screen is triggered again after the time period X, and the method comprises the following steps:
when the timer is smaller than the second preset time length and the accumulated count value of the counter is larger than or equal to the preset time threshold, the first electronic device prompts that the screen recording is triggered after the time length X is the difference value between the second preset time length and the time length of the timer.
10. The method of any of claims 1-9, wherein the first electronic device sending the second video clip to the third electronic device comprises:
when the network of the first electronic equipment is switched, the first electronic equipment prompts that video transmission is stopped due to network change and prompts a user to switch the network, and sends a message that video transmission is stopped due to network change to the third electronic equipment;
and if the network of the first electronic device is adjusted to be consistent with the network of the third electronic device, the first electronic device continuously sends the second video clip to the third electronic device.
11. The method of any of claims 1-9, wherein when the first electronic device sends the second video clip to the third electronic device, the method further comprises:
the first electronic equipment receives a stop receiving message sent by the third electronic equipment;
and the first electronic device responds to the stop receiving message and stops sending the second video clip to the third electronic device.
12. The method of any of claims 1-11, wherein prior to the first electronic device hovering over the video picture being played to display an identification of one or more nearby available devices, the method further comprises:
The first electronic device suspends and displays a second window and first prompt information on a video picture being played, wherein the second window displays a first frame image of the first video segment, and the first prompt information is used for prompting whether the first video segment is shared;
the first electronic equipment receives a confirmation command sent by the remote controller, wherein the confirmation command is generated after a user operates on the remote controller;
wherein the first electronic device hovers over a video picture being played to display an identification of one or more nearby available devices, comprising:
in response to the confirmation command, the first electronic device hovers over the video picture being played with an identification of one or more nearby available devices.
13. The method of any of claims 1-12, wherein prior to the first electronic device hovering over the video picture being played to display an identification of one or more nearby available devices, the method further comprises:
the first electronic device searches one or more nearby available devices through Bluetooth technology;
wherein each of the one or more nearby available devices is in a bright screen state.
14. The method according to any one of claims 1 to 13, further comprising:
in the process that the first electronic equipment plays video pictures, the first electronic equipment periodically caches video clips, and the first video clips and the second video clips are acquired based on the cached video clips respectively;
if the first electronic equipment does not receive the screen recording command in the first period, the first electronic equipment deletes the video clip cached in the second period, wherein the second period is earlier than the first period.
15. The method according to any one of claims 1 to 14, further comprising:
after the first electronic device acquires a first video clip of a first preset duration before the first moment from a video picture being played, the first electronic device stores the first video clip into a gallery of the first electronic device;
after the first electronic device acquires a second video clip of the first preset duration before the second moment from the video picture being played, the first electronic device stores the second video clip in a gallery of the first electronic device.
16. A method for collaborative recording and sharing of multiple devices is characterized by comprising the following steps:
the method comprises the steps that a third electronic device displays an interface of a first application, wherein the interface of the first application comprises a first control, and the first application is an application program installed on the third electronic device;
responding to the operation of the user on the first control at the second moment, and sending a screen recording command to the first electronic equipment by the third electronic equipment;
and the third electronic equipment receives the recorded video sent by the first electronic equipment, wherein the recorded video is a video clip which is recorded based on the screen recording command and is of a first preset duration before the second moment.
17. The method of claim 16, wherein the method further comprises:
in the process that the third electronic equipment receives the recorded video sent by the first electronic equipment, the third electronic equipment displays video receiving information, wherein the video receiving information comprises video receiving progress information and the size of occupied space of the video to be received.
18. The method of claim 16 or 17, wherein the video reception information further comprises a stop control, the method further comprising:
And responding to the operation of the stopping control by the user, and stopping receiving the recorded video by the third electronic equipment.
19. The method of any of claims 16-18, wherein after the third electronic device receives the recorded video sent by the first electronic device, the method further comprises:
the third electronic equipment displays video processing options, wherein the video processing options comprise at least one of play items, edit items, share items and delete items;
and responding to the operation of the user on the video processing options, and processing the recorded video by the third electronic equipment according to a mode corresponding to the operation of the user.
20. The method of any of claims 16-18, wherein after the third electronic device receives the recorded video sent by the first electronic device, the method further comprises:
the third electronic equipment pulls up the gallery application and jumps to a gallery interface;
the third electronic device displays the recorded video in the gallery interface;
and responding to the user operation, the third electronic equipment processes the recorded video according to a first mode, wherein the first mode is playing, editing, sharing or deleting.
21. The method according to any one of claims 16 to 20, further comprising:
when the network of the third electronic equipment is switched, the third electronic equipment prompts that the video transmission is stopped due to the network change and prompts a user to perform network switching, and sends a message of stopping the video transmission due to the network change to the first electronic equipment;
and under the condition that the network of the third electronic equipment is adjusted to be consistent with the network of the first electronic equipment, the third electronic equipment continuously receives the recorded video sent by the first electronic equipment.
22. An electronic device comprising a processor, a memory, and a computer program stored on the memory, the processor being configured to execute the computer program to cause the electronic device to implement the method of any one of claims 1-15.
23. An electronic device comprising a processor, a memory, and a computer program stored on the memory, the processor configured to execute the computer program to cause the electronic device to implement the method of any one of claims 16-21.
24. A communication system comprising an electronic device according to claim 22 and an electronic device according to claim 23.
25. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when run on an electronic device, causes the electronic device to perform the method of any one of claims 1 to 15 and/or the method of any one of claims 16 to 21.
CN202310356443.3A 2023-03-23 2023-03-23 Multi-device collaborative screen recording and sharing method, electronic device and communication system Pending CN117135385A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310356443.3A CN117135385A (en) 2023-03-23 2023-03-23 Multi-device collaborative screen recording and sharing method, electronic device and communication system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310356443.3A CN117135385A (en) 2023-03-23 2023-03-23 Multi-device collaborative screen recording and sharing method, electronic device and communication system

Publications (1)

Publication Number Publication Date
CN117135385A true CN117135385A (en) 2023-11-28

Family

ID=88855297

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310356443.3A Pending CN117135385A (en) 2023-03-23 2023-03-23 Multi-device collaborative screen recording and sharing method, electronic device and communication system

Country Status (1)

Country Link
CN (1) CN117135385A (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105578257A (en) * 2014-10-08 2016-05-11 深圳Tcl新技术有限公司 Multimedia information sharing method, multimedia information sharing system, and television set
CN105704539A (en) * 2016-02-15 2016-06-22 努比亚技术有限公司 Video sharing device and video sharing method
CN107124573A (en) * 2016-02-25 2017-09-01 掌赢信息科技(上海)有限公司 Screen recording method and electronic equipment in a kind of video calling
CN107566883A (en) * 2017-08-11 2018-01-09 中广热点云科技有限公司 A kind of method using recorded broadcast equipment recorded broadcast TV programme
US20180242037A1 (en) * 2016-02-26 2018-08-23 Ring Inc. Sharing Video Footage from Audio/Video Recording and Communication Devices to Smart TV Devices
CN110324698A (en) * 2018-03-28 2019-10-11 努比亚技术有限公司 A kind of video recording method, terminal and computer readable storage medium
CN112738616A (en) * 2020-12-28 2021-04-30 深圳佳力拓科技有限公司 Program sharing method based on set top box and related equipment
CN112788268A (en) * 2020-12-29 2021-05-11 深圳Tcl数字技术有限公司 Information pushing method based on video recording, smart television and storage medium
CN113438539A (en) * 2021-06-17 2021-09-24 海信电子科技(深圳)有限公司 Digital television program recording method and display equipment
CN114095776A (en) * 2021-10-18 2022-02-25 荣耀终端有限公司 Screen recording method and electronic equipment
CN114356187A (en) * 2020-09-29 2022-04-15 华为技术有限公司 Content acquisition method and device
WO2022078061A1 (en) * 2020-10-15 2022-04-21 Oppo广东移动通信有限公司 Video communication method and apparatus, electronic device and computer readable storage medium
CN114979753A (en) * 2022-05-18 2022-08-30 青岛海信移动通信技术股份有限公司 Screen recording method, device, equipment and medium
CN115002340A (en) * 2021-10-22 2022-09-02 荣耀终端有限公司 Video processing method and electronic equipment

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105578257A (en) * 2014-10-08 2016-05-11 深圳Tcl新技术有限公司 Multimedia information sharing method, multimedia information sharing system, and television set
CN105704539A (en) * 2016-02-15 2016-06-22 努比亚技术有限公司 Video sharing device and video sharing method
CN107124573A (en) * 2016-02-25 2017-09-01 掌赢信息科技(上海)有限公司 Screen recording method and electronic equipment in a kind of video calling
US20180242037A1 (en) * 2016-02-26 2018-08-23 Ring Inc. Sharing Video Footage from Audio/Video Recording and Communication Devices to Smart TV Devices
CN107566883A (en) * 2017-08-11 2018-01-09 中广热点云科技有限公司 A kind of method using recorded broadcast equipment recorded broadcast TV programme
CN110324698A (en) * 2018-03-28 2019-10-11 努比亚技术有限公司 A kind of video recording method, terminal and computer readable storage medium
CN114356187A (en) * 2020-09-29 2022-04-15 华为技术有限公司 Content acquisition method and device
WO2022078061A1 (en) * 2020-10-15 2022-04-21 Oppo广东移动通信有限公司 Video communication method and apparatus, electronic device and computer readable storage medium
CN112738616A (en) * 2020-12-28 2021-04-30 深圳佳力拓科技有限公司 Program sharing method based on set top box and related equipment
CN112788268A (en) * 2020-12-29 2021-05-11 深圳Tcl数字技术有限公司 Information pushing method based on video recording, smart television and storage medium
CN113438539A (en) * 2021-06-17 2021-09-24 海信电子科技(深圳)有限公司 Digital television program recording method and display equipment
CN114095776A (en) * 2021-10-18 2022-02-25 荣耀终端有限公司 Screen recording method and electronic equipment
CN115002340A (en) * 2021-10-22 2022-09-02 荣耀终端有限公司 Video processing method and electronic equipment
CN114979753A (en) * 2022-05-18 2022-08-30 青岛海信移动通信技术股份有限公司 Screen recording method, device, equipment and medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
姚翌: "精彩瞬间永收藏 P2P网络电视截屏录像全功略", 计算机与网络, no. 23, 12 December 2006 (2006-12-12) *

Similar Documents

Publication Publication Date Title
CN110109636B (en) Screen projection method, electronic device and system
CN111316598B (en) Multi-screen interaction method and equipment
CN102640081B (en) By detecting the Poewr control method of the gesture recognition device of the existence of user
CN113542839B (en) Screen projection method of electronic equipment and electronic equipment
CN113556479B (en) Method for sharing camera by multiple applications and electronic equipment
EP4113415A1 (en) Service recommending method, electronic device, and system
CN112367543B (en) Display device, mobile terminal, screen projection method and screen projection system
WO2023040636A1 (en) Collaboration window processing method and system, and electronic device
CN114040242B (en) Screen projection method, electronic equipment and storage medium
CN111726678B (en) Method for continuously playing multimedia content between devices
US20110085046A1 (en) Data communication method and system using mobile terminal
WO2022121775A1 (en) Screen projection method, and device
JP2009130816A (en) Portable terminal device, screen display switching method, program, and computer readable recording medium
CN113946302B (en) Method and device for opening file
CN114915834A (en) Screen projection method and electronic equipment
US20230350629A1 (en) Double-Channel Screen Mirroring Method and Electronic Device
CN117135385A (en) Multi-device collaborative screen recording and sharing method, electronic device and communication system
CN115550559B (en) Video picture display method, device, equipment and storage medium
US11301197B2 (en) Display apparatus, method for controlling display apparatus and recording media thereof
CN114466131B (en) Cross-device shooting method and related device
CN116939277A (en) Screen recording processing method and electronic equipment
CN116033204B (en) Screen recording method, electronic equipment and storage medium
CN114020198B (en) Display method and electronic equipment
CN116668762B (en) Screen recording method and device
WO2024022307A1 (en) Screen mirroring method and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination