WO2022193994A1 - 基于多设备的在线互动方法、芯片、电子设备及存储介质 - Google Patents

基于多设备的在线互动方法、芯片、电子设备及存储介质 Download PDF

Info

Publication number
WO2022193994A1
WO2022193994A1 PCT/CN2022/079770 CN2022079770W WO2022193994A1 WO 2022193994 A1 WO2022193994 A1 WO 2022193994A1 CN 2022079770 W CN2022079770 W CN 2022079770W WO 2022193994 A1 WO2022193994 A1 WO 2022193994A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
interaction method
online interaction
playback
control
Prior art date
Application number
PCT/CN2022/079770
Other languages
English (en)
French (fr)
Inventor
王永德
景思源
王健
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP22770349.3A priority Critical patent/EP4296844A4/en
Priority to US18/282,038 priority patent/US20240152310A1/en
Publication of WO2022193994A1 publication Critical patent/WO2022193994A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/06Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks

Definitions

  • the present application relates to the field of terminals, and in particular, to a multi-device-based online interaction method, chip, electronic device, and computer-readable storage medium.
  • Online learning breaks the time and space limitations of traditional classrooms, making cross-regional learning, long-distance communication, and personalized teaching more convenient.
  • offline teaching method in the actual online learning experience, there will be a series of problems such as the lack of interaction in the teaching process, the small screen of the terminal equipment of the online course, and the short sight distance affecting the eyesight, which makes the actual online learning experience. not effectively.
  • the multi-device collaboration in the existing online course learning scheme generally only uses the Digital Living Network Alliance (DLNA) protocol or the Miracast protocol to simply put the content displayed on the tablet, mobile phone and other handheld terminals into the large computer. on the screen.
  • DLNA Digital Living Network Alliance
  • Miracast Miracast protocol
  • a first aspect of the embodiments of the present application discloses an online interaction method based on multiple devices, including: a first electronic device starts a first application, and the first electronic device plays the first playback content through the first application; When the device receives a control instruction for streaming the first playback content of the first application to the second electronic device, the first electronic device sends a streaming message to the second electronic device, so that the second electronic device continues to play the first playback content; The first electronic device receives the control opening instruction sent by the content provider server or the second electronic device; the first electronic device responds to the control opening instruction and opens the interactive control; the first electronic device obtains the interactive information of the interactive control, and sends the interactive information to the content merchant server.
  • the first playing content can be streamed and played between the first electronic device and the second electronic device, and the first electronic device can be used for interaction, and the interactive information can be sent to the Content provider server.
  • the online interaction method further includes: when the first electronic device receives a streaming success message sent by the second electronic device, the first electronic device stops playing the first playback content.
  • the first electronic device stops playing the first playback content.
  • the online interaction method further includes: when the first electronic device receives a control instruction to stop streaming the first playback content, the first electronic device sends a stop message to the second electronic device.
  • the first playback content can be streamed from the second electronic device back to the first electronic device for playback.
  • the online interaction method further includes: when the first electronic device receives a streaming stop message sent by the second electronic device, the first electronic device continues to play the first playback content.
  • the first electronic device when the first playback content is streamed back to the first electronic device for playback, the first electronic device can continue the playback progress of the second electronic device to play the first playback content.
  • the online interaction method further includes: the first electronic device sends a device control instruction to the second electronic device, so as to control the second electronic device to perform a preset function.
  • the first electronic device includes a first distributed soft bus
  • the second electronic device includes a second distributed soft bus
  • sending the device control instruction to the second electronic device includes: a first The electronic device sends the device control instruction to the second electronic device by using the first distributed soft bus and the second distributed soft bus.
  • the device control instruction is a screenshot instruction
  • the online interaction method further includes: the first electronic device receives a screenshot image sent by the second electronic device, and stores the screenshot image.
  • the first electronic device can control the second electronic device to take a screenshot, and the first electronic device can receive and save the screenshot image of the second electronic device.
  • the online interaction method further includes: the first electronic device receives feedback information on the interaction information from the content provider server, and displays the feedback information.
  • the first electronic device can display the feedback information of the interactive information, thereby increasing the interactive effect.
  • the interactive control is associated with the playback progress of the first playback content.
  • the interactive control can be enabled when the playback progress of the first playback content reaches a specific node.
  • a second aspect of the embodiments of the present application discloses an online interaction method based on multiple devices, including: a first electronic device starts a first application program, and the first electronic device plays the first playback content through the first application program; When the device receives the control instruction for streaming the first playback content of the first application to the second electronic device, the first electronic device sends a streaming message to the second electronic device; when the second electronic device receives the streaming message, the second electronic device sends the streaming message to the second electronic device.
  • the electronic device continues to play the first playback content; the first electronic device enables the interactive control; the first electronic device obtains the interactive information of the interactive control, and sends the interactive information to the content provider server; the first electronic device receives the content provider server's response to the interactive information. feedback information, and display the feedback information; the second electronic device receives the feedback information from the content provider server for the interactive information, and displays the feedback information.
  • the first playing content can be streamed and played between the first electronic device and the second electronic device, and the first electronic device can be used for interaction, and the interactive information can be sent to the
  • the content provider server can enable both the first electronic device and the second electronic device to display the feedback information of the interactive information, thereby increasing the interactive effect.
  • the online interaction method further includes: when the second electronic device continues to play the first broadcast content, the second electronic device sends a streaming success message to the first electronic device; when the first electronic device receives the streaming When the success message is received, the first electronic device stops playing the first playing content.
  • the second electronic device can notify the first electronic device to stop playing the first playback content.
  • the online interaction method further includes: when the first electronic device receives a control instruction to stop streaming the first playback content, the first electronic device sends a stop message to the second electronic device; The device receives the stop message, and the second electronic device stops playing the first playing content.
  • the first playback content can be streamed from the second electronic device back to the first electronic device for playback.
  • the online interaction method further includes: when the second electronic device stops playing the first playing content, the second electronic device sends a streaming stop message to the first electronic device; when the first electronic device receives the streaming When the message is stopped, the first electronic device continues to play the first playback content.
  • the first electronic device when the first playback content is streamed back to the first electronic device for playback, the first electronic device can continue the playback progress of the second electronic device to play the first playback content.
  • the online interaction method further includes: the first electronic device sends a device control instruction to the second electronic device; and the second electronic device executes a preset function according to the device control instruction.
  • the first electronic device includes a first distributed soft bus
  • the second electronic device includes a second distributed soft bus
  • sending the device control instruction to the second electronic device includes: a first The electronic device sends the device control instruction to the second electronic device by using the first distributed soft bus and the second distributed soft bus.
  • the device control instruction is a screenshot instruction
  • the online interaction method further includes: the second electronic device sends the screenshot image to the first electronic device; the first electronic device receives and stores the screenshot image.
  • the first electronic device can control the second electronic device to take a screenshot, and the first electronic device can receive and save the screenshot image sent by the second electronic device.
  • enabling the interactive control by the first electronic device includes: the first electronic device receives a control opening instruction transmitted by the content provider server or the second electronic device; and the first electronic device responds to the control opening instruction to enable the interactive control.
  • the interactive control can be enabled when the first electronic device receives the control opening instruction transmitted by the content provider server or the second electronic device.
  • the interactive control is associated with the playback progress of the first playback content.
  • the interactive control can be enabled when the playback progress of the first playback content reaches a specific node.
  • the online interaction method further includes: when the interactive control is turned on, the second electronic device displays prompt information associated with the interactive control.
  • the second electronic device can display prompt information associated with the interactive control to remind the user to perform an interactive operation on the interactive control.
  • embodiments of the present application provide a computer-readable storage medium, including computer instructions, which, when the computer instructions are executed on an electronic device, cause the electronic device to execute the multi-device-based online interaction method described in the first aspect.
  • an embodiment of the present application provides an electronic device, the electronic device includes a processor and a memory, the memory is used for storing instructions, and the processor is used for invoking the instructions in the memory, so that the electronic device executes the multi-based method described in the first aspect.
  • the online interaction method of the device is used for invoking the instructions in the memory, so that the electronic device executes the multi-based method described in the first aspect.
  • embodiments of the present application provide a computer program product, which, when the computer program product runs on a computer, enables the computer to execute the multi-device-based online interaction method described in the first aspect.
  • an apparatus in a sixth aspect, has the function of implementing the behavior of the first electronic device in the method provided in the above-mentioned first aspect.
  • the functions can be implemented by hardware, or by executing corresponding software by hardware.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • the computer-readable storage medium described in the third aspect, the electronic device described in the fourth aspect, the computer program product described in the fifth aspect, and the device described in the sixth aspect are all the same as the above-mentioned first aspect.
  • the method of the aspect corresponds to, therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, which will not be repeated here.
  • FIG. 1 is a schematic diagram of a multi-device interaction scenario provided by an embodiment of the present application
  • FIG. 2 is an application scenario diagram of a multi-device-based online interaction method provided by an embodiment of the present application
  • FIG. 3 is a schematic structural diagram of interaction between a first electronic device and a second electronic device according to an embodiment of the present application
  • 4a-4g are schematic diagrams of interaction between a first electronic device and a second electronic device according to an embodiment of the application;
  • FIG. 5 is a data interaction diagram between a first electronic device and a second electronic device according to an embodiment of the present application
  • FIG. 6 is a data interaction diagram between a first electronic device and a second electronic device provided by another embodiment of the present application.
  • FIG. 7a is a schematic diagram of a software architecture of a first electronic device and a second electronic device according to an embodiment of the present application
  • 7b-7f are schematic diagrams of interaction between a first electronic device and a second electronic device according to another embodiment of the present application.
  • FIG. 8 is a schematic diagram of interaction between a first electronic device and a second electronic device according to another embodiment of the present application.
  • FIG. 9 is a schematic flowchart of a method for online interaction based on multiple devices provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of a software architecture of a first electronic device and a second electronic device according to another embodiment of the present application;
  • FIG. 11 is a schematic flowchart of a multi-device-based online interaction method provided by another embodiment of the present application.
  • FIG. 12 is a schematic flowchart of a multi-device-based online interaction method provided by another embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of a possible first electronic device provided by an embodiment of the present application.
  • FIG. 14 is a schematic structural diagram of a possible second electronic device provided by an embodiment of the present application.
  • Electronic devices such as personal computers, handheld devices (such as mobile phones, tablet computers), and televisions may be connected for communication through a wireless local area network (Wireless Local Area Network, WLAN).
  • WLAN Wireless Local Area Network
  • An application can have multiple capabilities (Ability), that is, an APP can contain multiple capabilities.
  • Ability is the abstraction of the capabilities of APP, and it is also an important part of APP. HarmonyOS supports application deployment in units of Ability.
  • Ability can be divided into two types: Feature Ability (FA) and Particle Ability (PA). Each type provides different templates for developers to realize different business functions.
  • FA supports page templates (Page Ability), which can provide page capabilities to interact with users.
  • a Page instance can contain a set of related pages, and each page is represented by a AbilitySlice instance.
  • PA can support service templates (Service Ability) and data templates (Data Ability).
  • the service template has no user interface.
  • the service template can be a background service, which can be used to provide the ability to run tasks in the background.
  • Data templates can provide data access abstractions.
  • the service features of the APP can be carried by the FA, and the FA can use various meta-capabilities through the PA.
  • the following describes a schematic diagram of a multi-device interaction scenario provided by an embodiment of the present invention with reference to FIG. 1 .
  • the first electronic device 100 and the second electronic device 200 may be in the same local area network, and the first electronic device 100 and the second electronic device 200 may implement communication connection through an interconnection protocol, a distributed soft bus, or the like.
  • the screen size of the second electronic device 200 may be larger than the screen size of the first electronic device 100 .
  • the first electronic device 100 may be a small-screen electronic device, for example, the first electronic device 100 is a handheld device such as a mobile phone and a tablet computer.
  • the second electronic device 200 may be a large-screen electronic device, for example, the second electronic device 200 is a liquid crystal television.
  • the first electronic device 100 is installed with a first application (Application, APP) 400, and the first APP 400 can be selected according to actual needs, which is not limited herein.
  • the first APP 400 may be an APP with interactive functions and video/image playback functions.
  • the first APP 400 is a live class APP, a game live broadcast APP, a video website APP, a short video APP, an e-commerce live broadcast APP, and an online conference APP. Wait.
  • the user can perform interactive operations on the small-screen device (the first electronic device 100 ), and the video playback content or images can be played on the large-screen device (the second electronic device 200 ).
  • the interactive operation can be set according to actual needs, which is not limited here.
  • the interactive operation can be a control command to adjust the volume of the large-screen device and the playback progress, or to write and submit the problem-solving steps, submit the answer to the question, conduct an interactive chat, send a bullet screen, and so on.
  • the first electronic device 100 When the user opens the first APP 400 on the first electronic device 100, the first electronic device 100 enters the playback interface of the first APP 400 to play content.
  • the user chooses to stream the content to the second electronic device 200 for playback, the currently playing content of the first electronic device 100 is streamed to the second electronic device 200 for continuous playback.
  • the user can perform an interactive operation on the first electronic device 100 , and the playing content is switched to the second electronic device 200 for playing.
  • An application scenario diagram of the multi-device-based online interaction method provided by the embodiment of the present invention is exemplarily introduced below with reference to FIG. 2 .
  • the first electronic device 100 may be installed with a live class APP 110, and the live class APP 110 may be selected according to actual needs, which is not limited herein.
  • the first electronic device 100 and the second electronic device 200 can implement large and small screen migration through the ContinueAbility interface and the ReverseAbility interface.
  • the user can find the second electronic device that can play and stream on the live class APP 110 of the first electronic device 100 Device 200, when the user chooses to stream the first broadcast content of the live class APP 110 to the second electronic device 200, the second electronic device 200 can enter the corresponding playback progress, and the first electronic device 100 can output "In class, please see big screen" message.
  • the user can learn online lessons through the screen, camera, microphone and speaker of the second electronic device 200 , so as to obtain a better audio-visual experience by means of the hardware device of the second electronic device 200 .
  • Entering the corresponding playback progress of the second electronic device 200 may refer to: when the user chooses to stream the first playback content of the live class APP 110 to the second electronic device 200, the second electronic device 200 continues the playback progress of the first electronic device 100 to play.
  • FIG. 3 is a schematic structural diagram of the interaction between the first electronic device 100 and the second electronic device 200 according to an embodiment of the present application.
  • the first electronic device 100 is installed with a live class APP 110, and the live class APP 110 may include a first live class FA1101, a first playback control PA 1102, a device management unit 1103 and an interactive interface 1104.
  • the interactive interface 1104 can realize live class interaction.
  • the interactive interface 1104 can be an answer board, a handwriting board, a playback control board, etc., and the user can use a stylus to write and submit answers on the answer board or handwriting board.
  • the live class APP 110 can communicate with the online class service server 301 to realize the broadcast of the live class.
  • the second electronic device 200 can communicate with the FA server 302, so as to download and install the second live class FA 1105 from the FA server 302.
  • the second live class FA 1105 can also communicate with the online class service server 301 to realize the broadcast of the live class.
  • the first electronic device 100 and the second electronic device 200 may have some of the same system capabilities, and the system capabilities may include distributed soft bus, device management capability, playback migration capability, and the like.
  • Distributed soft bus can provide unified distributed communication capability for interconnection between devices.
  • the first electronic device 100 is a mobile phone
  • the second electronic device 200 is a TV.
  • the user can search for the electronic device that can play and stream through the device management unit 1103 and the device management capability of the mobile phone system on the live class APP 110 of the mobile phone. It is also possible to select a device from the list of devices that can play and transfer the stream returned by the device management unit 1103 to perform the broadcast and transfer of the live class FA.
  • the device management capability of the TV system can be notified of the streaming message through the playback migration capability of the mobile phone system.
  • the TV receives the streaming message and has installed the second live class FA 1101 and the second play control PA 1106, the TV can directly start the second live class FA 1105 and enter the corresponding playback progress, and the first electronic device 100 can exit In the first live class FA 1101, the first electronic device 100 can open the interactive interface 1104.
  • the user can perform online class interaction or playback control on the interactive interface 1104, such as volume adjustment, pause/play control, screen capture, and answering questions.
  • the user's control information on the mobile phone can be synchronized to the second live class FA 1105 on the TV and/or through the distributed soft bus of the mobile phone and the distributed soft bus of the TV.
  • the second playback controls the PA 1106.
  • the device control instructions are volume adjustment instructions, playback progress adjustment instructions, screen capture instructions, etc.
  • the device control instructions can be synchronized to the second playback control PA 1106 on the TV through the distributed soft bus of the mobile phone and the distributed soft bus of the TV. Remotely control the TV on the mobile phone.
  • the interactive information for online course interaction on the interactive interface 1104 may be problem-solving content, question answers, etc., and the interactive information may be directly sent from the first electronic device 100 to the online course service server 301 to realize the interaction on the mobile phone. Answering questions, submitting answers, etc.
  • the TV can automatically download the second live class FA 1105 and the second play control PA 1106 from the FA server 302, and enable the second live class after the download is complete. Live class FA 1105, so that the TV enters the corresponding playback progress.
  • the TV can download the second live class FA 1105 and the second play control PA 1106 from the FA server 302, for example, the TV can adopt a silent download In this way, the relevant FA and PA can be downloaded.
  • the first electronic device 100 and the second electronic device 200 may have some of the same hardware modules.
  • the first electronic device 100 includes a first screen 1001, a first camera 1002, a first microphone 1003, and a first speaker 1004, and the second electronic device 200 includes a second screen 2001, a second camera 2002, a second microphone 2003, a first Two Speakers 2004.
  • the size of the first screen 1001 is smaller than the size of the second screen 2001, so that the user can learn online courses through the second electronic device 200, and can obtain a better audio-visual experience and a more panoramic camera angle.
  • the live class APP 110 on the first electronic device 100 can automatically open the interactive interface 1104, and the user can interact with the class through the interactive interface 1104.
  • the content of the answer is written, the answer is submitted, and the like.
  • the user can also manually open the interactive interface 1104 on the live class APP 110 of the first electronic device 100, or when the online course content is played to some specific nodes (for example, a node that requires the user to answer a question), the interactive interface 1104 is automatically opened.
  • the online course service server 301 or the second electronic device 200 can transmit a control opening instruction to the first electronic device 100, and the first electronic device 100 responds to the control opening instruction and opens the interactive interface 1104 .
  • the user can choose to stop streaming the live class on the live class APP 110 of the first electronic device 100 (ie, transfer the online class back to the first electronic device 100).
  • Play for example, after the online course broadcast is transferred to the second electronic device 200, the live class APP 110 of the first electronic device 100 displays a stop playing and streaming icon, which can realize the transfer of the online course back to the first electronic device 100 for playback function.
  • the stop playing streaming icon the online course can be transferred back to the first electronic device 100 for playing, and the second electronic device 200 stops playing the online course.
  • the user can exit the second live class FA 1105 on the second electronic device 200 through the play migration capability of the second electronic device 200, and exit the interactive interface through the play migration capability of the first electronic device 100 1104, open the first live class FA 1101 on the first electronic device 100, so that the first electronic device 100 continues to play from the corresponding playback progress, and realizes that the online class stream of the second electronic device 200 is transferred back to the first electronic device 100 for playback .
  • the user can also use the camera of the first electronic device 100 to record video, and the video content can be sent by the first electronic device 100 to the online class service server 301, it is convenient for the back-end online class teacher to check the learning results, such as checking whether the pronunciation and pronunciation are accurate.
  • the first electronic device 100 is a mobile phone and the second electronic device 200 is a television for illustration.
  • the first electronic device 100 enters the online class playing interface, and the first playing content is the content of the chemistry class.
  • the play streaming icon 1107 can be evoked.
  • a device list 1108 that can perform play streaming pops up.
  • the device list 1108 includes device ID1 and device ID2.
  • the second electronic device 200 when the user selects the device ID1 as the playback streaming device in the device list 1108, the second electronic device 200 can be controlled to open the second live class FA 1105, and enter the corresponding and the user can learn the online course through the second electronic device 200.
  • the interactive interface 1104 is opened, and the interactive interface 1104 may be provided with a stop playing streaming icon 1109.
  • the stop playing streaming icon 1109 when the user clicks the stop playing streaming icon 1109, the second electronic device 200 exits the second live class FA 1105, and the first electronic device 100 opens the first live class FA 1101, so as to transfer the live class stream back to The first electronic device 100 performs playback.
  • the stop playing streaming icon 1109 when the interactive interface 1104 is not displayed in a full-screen manner, the stop playing streaming icon 1109 may also be displayed outside the area of the interactive interface 1104 .
  • the play stream icon 1107 and the stop play stream icon 1109 may also use the same icon, and are distinguished by icon colors (such as color shades, different colors).
  • the play streaming icon 1107 and the stop playing streaming icon 1109 may not be set, and specific gestures may be defined to realize streaming the first playback content from the first electronic device 100 to the second electronic device 200 for playback, and stop Stream the first playback content (that is, stream the first playback content from the second electronic device 200 back to the first electronic device 100 for playback).
  • specific gestures may be defined to realize streaming the first playback content from the first electronic device 100 to the second electronic device 200 for playback
  • stop Stream the first playback content that is, stream the first playback content from the second electronic device 200 back to the first electronic device 100 for playback.
  • the user opens the live class APP 110 on the first electronic device 100 and detects an upward swipe gesture on the playback interface of the live class APP 110, the first playback content is transferred from the first electronic device 100 to the second electronic device 200 to play, and when a downward sliding gesture is detected, the first playback content is streamed from the second electronic device 200 back to the first electronic device 100 for playback.
  • the first electronic device 100 is pre-installed with the live class APP 110, the first electronic device 100 is a small-screen electronic device, the second electronic device 200 is a large-screen electronic device, and the first electronic device 100 is a small-screen electronic device.
  • An electronic device 100 and a second electronic device 200 are under the same local area network.
  • the process of the interaction between the first electronic device 100 and the second electronic device 200 may specifically include:
  • Online course playback may refer to live broadcast course playback, recorded and broadcast course playback, etc., which is not limited here.
  • the user selects streaming on the first electronic device 100 to play on a large screen, and selects the second electronic device 200 as the streaming device for playback.
  • the first electronic device 100 sends a streaming message to notify the second electronic device 200.
  • the circulation message contains the identity document (ID) of the live class FA.
  • the second electronic device 200 downloads the second live class FA 1105 from the FA server 302 according to the ID of the live class FA.
  • the second electronic device 200 installs the second live class FA 1105, and opens the second live class FA 1105 to enter the corresponding playback progress, so that the user can use the software and hardware modules of the second electronic device 200 to conduct online class learning.
  • the second electronic device 200 sends a transfer success message to the first electronic device 100.
  • the first electronic device 100 exits the first live class FA 1101, and the first electronic device 100 can also open the interactive interface 1104, so that the user can use the interactive interface 1104 for class interaction.
  • the live class APP 110 on the first electronic device 100 can automatically open the interactive interface 1104, and the user can interact with the class through the interactive interface 1104.
  • the content of the answer is written, the answer is submitted, and the like.
  • the user when the streaming of the online class is transferred to the second electronic device 200, the user can also manually open the interactive interface 1104 on the live class APP 110 of the first electronic device 100, or when the content of the online class is played to some specific nodes (for example, a node that requires the user to answer a question), the first electronic device automatically opens the interactive interface 1104 .
  • the user selects on the first electronic device 100 to stop streaming to the large screen, and the first electronic device 100 sends a stop message to notify the second electronic device 200.
  • the second electronic device 200 exits the second live class FA 1105.
  • the second electronic device 200 sends a flow stop message to the first electronic device 100.
  • the first electronic device 100 exits the interactive interface 1104 and starts the first live class FA 1101, so that the user can continue to use the software and hardware modules of the first electronic device 100 for online class learning.
  • the first electronic device 100 is pre-installed with the live class APP 110
  • the second electronic device 200 is pre-installed with the second live class FA 1105.
  • the user can pre-control the second electronic device
  • the device 200 downloads and installs the second live class FA 1105 from the FA server 302.
  • the first electronic device 100 is a small-screen electronic device
  • the second electronic device 200 is a large-screen electronic device
  • the first electronic device 100 and the second electronic device 200 are under the same local area network.
  • the process of the interaction between the first electronic device 100 and the second electronic device 200 may specifically include:
  • the user opens the live class APP 110, and the first electronic device 100 enters the online class playing interface, so that the user can use the hardware modules of the first electronic device 100 (such as a microphone, a speaker, a camera, etc.) to conduct online class learning.
  • the hardware modules of the first electronic device 100 such as a microphone, a speaker, a camera, etc.
  • the user selects streaming on the first electronic device 100 to play on a large screen, and selects the second electronic device 200 as the streaming device for playback.
  • the first electronic device 100 sends a streaming message to notify the second electronic device 200.
  • the second electronic device 200 starts the second live class FA 1105 and enters the corresponding playback progress, so that the user can use the hardware module of the second electronic device 200 to conduct online class learning.
  • the second electronic device 200 sends a transfer success message to the first electronic device 100.
  • the first electronic device 100 exits the first live class FA 1101, and the first electronic device 100 can also open the interactive interface 1104, so that the user can use the interactive interface 1104 for class interaction.
  • the user selects on the first electronic device 100 to stop streaming to the large screen, and the first electronic device 100 sends a stop message to notify the second electronic device 200.
  • the second electronic device 200 exits the second live class FA 1105.
  • the second electronic device 200 sends a flow stop message to the first electronic device 100.
  • the first electronic device 100 exits the interactive interface 1104, and starts the first live class FA 1101, so that the user can continue to use the hardware module of the first electronic device 100 for online class learning.
  • This application can perform cross-device migration of live class FA between large-screen electronic devices and small-screen electronic devices, and can be combined with a stylus to complete large-screen lectures and small-screen interaction scenarios.
  • the terminal screen is too small, which is easy to hurt the eyes, and the teaching interaction is weak.
  • the first electronic device 100 is a mobile phone
  • the second electronic device 200 is a television.
  • a first APP 400 is installed in the mobile phone
  • the first APP 400 includes a first FA 401, a first PA 402 and an interactive window 403, and a second FA 404 and a second PA 405 corresponding to the first APP 400 are installed on the TV.
  • the first APP 400 can be selected according to actual usage requirements, which is not limited here.
  • the first embodiment can realize the linked playback of the mobile phone and the TV, including, but not limited to: the mobile phone playback is streamed to the TV, the mobile phone controls the TV playback volume, adjusts the playback progress, pauses/resumes the playback, and plays screenshots, the TV playback is streamed back to the mobile phone, and Conversational chat, question answer submission, etc. on the mobile phone.
  • the process of performing linked playback between the mobile phone and the TV may include:
  • the mobile phone and the TV are under the same local area network, the user opens the first APP 400, the mobile phone enters the application program interface to play the first playback content, and the user can use the first APP 400 through the hardware module of the mobile phone.
  • the camera is used for video recording, the sound is played through the speaker of the mobile phone, and the sound is picked up by the microphone of the mobile phone.
  • the user selects streaming to the big screen on the first APP 400, and selects the TV as the streaming device, and the mobile phone sends a streaming message to notify the TV.
  • the TV turns on the second FA 404 and enters the corresponding playback progress, and continues to play the first playback content.
  • the user can use the first APP 400 through the hardware module of the TV. For example, video is captured through a TV camera, sound is played through TV speakers, and sound is picked up through TV microphones.
  • the mobile phone exits the first FA 401, and the mobile phone can also open the interactive window 403, and the user can use the interactive window 403 to interact.
  • the user can use the interactive window 403 to adjust the playback volume of the second FA 404, take a screenshot of the playback content of the second FA 404, and stop streaming the first playback content (that is, the first playback content is streamed back to the mobile phone for playback).
  • the mobile phone can exit the first FA 401 when the first playback content is successfully streamed to the TV for playback.
  • the first electronic device 100 can automatically open the interactive window 403 .
  • the user when the first playback content is successfully streamed to the TV, the user can also manually open the interactive window 403, or when the first playback content is played to some specific nodes (for example, a node that requires the user to answer a question), the first An electronic device automatically opens the interactive window 403 .
  • the online course service server 301 or the TV may send a window opening instruction, so that the first electronic device opens the interactive window 403 .
  • the mobile phone when the mobile phone plays an offline course, when the mobile phone detects that the first playback content is played to some specific nodes, the mobile phone can automatically open the interactive window 403, or when the TV detects that the first playback content is played to some specific nodes, the TV can Send a window opening command to the mobile phone, and control the mobile phone to open the interactive window 403 .
  • the user can use the interactive window 403 to adjust the playback volume of the second FA 404.
  • the user performs a volume adjustment operation on the interactive window 403, the volume adjustment instruction is transmitted from the mobile phone to the TV, and the TV receives the volume adjustment instruction and executes the volume adjustment.
  • the user can use the interactive window 403 to control the TV to take screenshots, the image Image_1 generated by the TV screenshot can be sent to the mobile phone for saving, and the mobile phone can store the image in a preset area, such as classifying it as a study note.
  • the user performs a screen capture operation on the interactive window 403, the screen capture command is transmitted from the mobile phone to the TV, and the TV receives the screen capture command and executes the screen capture operation.
  • the image I1 generated by the TV screen capture can be transmitted to the mobile phone through an interconnection protocol, a distributed soft bus, and the like.
  • the user can also use the interactive window 403 to answer the question.
  • the prompt message "Please answer the question on the mobile phone" is output in the second FA 404, and the user uses the interactive window 403 to submit the answer.
  • the interactive window 403 can display multiple answer options, and the user can select one of the answer options in the interactive window 403.
  • both the interactive window 403 and the second FA 404 can output a prompt indicating whether the answer is correct information.
  • FIG. 7e if the answering option selected by the user is the correct option, both the interactive window 403 and the second FA 404 can display the prompt information of “you answered correctly”.
  • both the interactive window 403 and the second FA 404 may display a prompt message of “Wrong answer”.
  • the user chooses to stop the playback on the mobile phone and transfer it to the big screen, and the mobile phone sends a stop message to notify the TV.
  • the TV exits the second FA 404.
  • the mobile phone exits the interactive window 403, opens the first FA 401, and the user continues to use the first APP 400 through the hardware module of the mobile phone.
  • the first electronic device 100 is a tablet computer
  • the second electronic device 200 is a TV.
  • a first APP 400 is installed in the tablet computer
  • the first APP 400 includes a first FA 401, a first PA 402 and an interactive window 403, and a second FA 404 and a second PA 405 corresponding to the first APP 400 are installed on the TV.
  • the first APP 400 can be selected according to actual usage requirements, which is not limited here.
  • the second embodiment can realize the linked playback between the tablet computer and the TV, including, but not limited to: the tablet computer is streamed to the TV, the tablet computer controls the TV playback volume, adjusts the playback progress, pauses/continues playback, plays screenshots, and the TV playback streams back to the tablet.
  • Computers, tablet computers, etc. the process of performing linked playback between the tablet computer and the TV may include:
  • the tablet computer and the TV are under the same local area network, the user opens the first APP 400, the tablet computer enters the application program interface to play the first playback content, and the user can use the first APP 400 through the hardware module of the tablet computer. For example, video is captured through the tablet camera, sound is played through the tablet speakers, and sound is picked up through the tablet microphone.
  • the user selects streaming to the big screen on the first APP 400, and selects the TV as the streaming device, and the tablet computer sends a streaming message to notify the TV.
  • the TV turns on the second FA 404 and enters the playback progress corresponding to the tablet computer playback, and continues to play the first playback content.
  • the user can use the first APP 400 through the hardware module of the TV. For example, video is captured through a TV camera, sound is played through TV speakers, and sound is picked up through TV microphones.
  • the tablet computer exits the first FA 401, and the tablet computer can also open the interactive window 403, and the user can use the interactive window 403 to interact.
  • the user can use the interactive window 403 to adjust the playback volume of the second FA 404, take a screenshot of the playback content of the second FA 404, and stream the playback content back to the tablet computer.
  • the user can also use the stylus 50 to write the chemical formula of water on the interactive window 403 and submit it, and the tablet computer can transmit the writing content on the interactive window 403 to the online course service server 301 for the teacher to consult.
  • the tablet computer when the first playback content is successfully streamed to the TV, the tablet computer exits the first FA 401, and when the online course content of the second FA 404 is played to some specific nodes (such as nodes that require users to answer questions) , the tablet computer automatically opens the interactive window 403, and the user can use the interactive window 403 to interactively answer questions.
  • some specific nodes such as nodes that require users to answer questions
  • the user chooses to stop the playback on the tablet computer and transfer it to the large screen, and the tablet computer sends a stop message to notify the TV.
  • the TV exits the second FA 404.
  • the tablet computer exits the interactive window 403, opens the first FA 401, and the user continues to use the first APP 400 through the hardware module of the tablet computer.
  • an online interaction method based on multiple devices provided by an embodiment of the present application is applied to the first electronic device 100 .
  • the first electronic device 100 and the second electronic device 200 are under the same local area network, and both the first electronic device 100 and the second electronic device 200 may be connected to the content provider server 303 in communication.
  • the content provider server 303 is an online course service server 301 that provides an online course service.
  • the first electronic device 100 is installed with a second APP 500, and the second APP 500 may include a playback control 501 and an interactive control 502.
  • the playback control 501 may have a screen playback function
  • the interactive control 502 may be a control that recognizes user operation content and/or receives user input instructions
  • the interactive control 502 may have UI elements that can accept user touch/click.
  • the second APP 500 can be selected according to actual application requirements, for example, the second APP 500 is an online course learning APP.
  • the online interaction method based on multiple devices includes:
  • the first electronic device 100 starts the second APP 500, and the first electronic device 100 plays the first playback content.
  • the first electronic device 100 when the user opens the second APP 500 on the first electronic device 100 , the first electronic device 100 can enter the online lesson playing interface of the second APP 500 , and the user can use the hardware module of the first electronic device 100 to perform Online learning. For example, when the first electronic device 100 opens the second APP 500, the first electronic device 100 can receive the first playback content from the online course service server 301 and play it.
  • the first electronic device 100 receives a control instruction for streaming the first playback content to the second electronic device 200, send a streaming message to the second electronic device 200.
  • the play streaming icon 1107 can be evoked.
  • FIG. 4c when the user clicks the play streaming icon 1107, a list 1108 of devices that can perform streaming streaming will pop up.
  • FIG. 4d assuming that the device ID1 is the second electronic device 200, when the user selects the device ID1 as the playback streaming device in the device list 1108, that is, the first electronic device 100 receives the streaming of the first playback content to the second electronic device According to the control instruction of the device 200 , the first electronic device 100 sends a flow message to the second electronic device 200 .
  • the first electronic device 100 When the first electronic device 100 receives the streaming success message sent by the second electronic device 200, the first electronic device 100 exits the playback control 501.
  • the second electronic device 200 may also be installed with the second APP 500 or the play control 501 of the second APP 500. As shown in FIG. 4d , when the second electronic device 200 receives the streaming message sent by the first electronic device 100, the second electronic device 200 can open the second APP 500 or the playback control 501 of the second APP 500 to realize the continuity of the first The playback progress of the electronic device 100 is performed, that is, the first playback content is continuously played.
  • the second electronic device 200 may send a streaming success message To the first electronic device 100 , when receiving the streaming success message sent by the second electronic device 200 , the first electronic device 100 exits the playback control 501 .
  • the first electronic device 100 enables the interactive control 502.
  • the first electronic device 100 when the first electronic device 100 exits the play control 501 , the first electronic device 100 can automatically turn on the interactive control 502 , so that the user can interact with the class through the interactive control 502 .
  • the interactive control 502 may be associated with the playback progress of the first playing content.
  • the online course content played on the second electronic device 200 is played to some specific nodes (such as a node that requires the user to answer a question)
  • the first An electronic device 100 can automatically turn on the interactive control 502 .
  • the interaction control 502 being associated with the playback progress of the first playback content may mean that the interaction control 502 is associated with the playback time node of the first playback content, or is associated with the playback screen content of the first playback content.
  • the first electronic device 100 acquires the interaction information of the interaction control 502 , and sends the interaction information to the content provider server 303 .
  • the first electronic device 100 can acquire the interactive information of the user in real time, and send the interactive information to the online course service server 301 .
  • the interactive information is answering options and question-solving content
  • the first electronic device 100 can send the answering options and question-solving content to the online course service server 301, so that the back-end online course teacher can check the learning results, or the online course service server can 301 Determine whether the answer options and the content of the solution are correct.
  • an electronic device 100 can send device control instructions to the second electronic device 200 .
  • the first electronic device 100 receives the control instruction to stop the playback and transfer to the second electronic device 200 , send a stop message to the second electronic device 200 .
  • the first electronic device 100 when the user clicks the stop playing streaming icon 1109, that is, the first electronic device 100 receives a control instruction to stop streaming to the second electronic device 200, the first electronic device 100 sends a stop message to the second electronic device 200 .
  • the second electronic device 200 receives the stop message sent by the first electronic device 100, the second electronic device 200 exits the second APP 500 or the play control 501 of the second APP 500.
  • the first electronic device 100 When the first electronic device 100 receives the flow stop message sent by the second electronic device 200, the first electronic device 100 exits the interactive control 502 and starts the playback control 501.
  • the second electronic device 200 may send a streaming stop message to the first electronic device 100, when the first electronic device When the 100 receives the flow stop message sent by the second electronic device 200, the first electronic device 100 exits the interactive control 502 and starts the playback control 501, so as to continue the playback progress of the second electronic device 200 for playback, that is, continue to play the first playback content. .
  • the first electronic device 100 when the first electronic device 100 receives a streaming stop message sent by the second electronic device 200 and the interactive control 502 is not in an open state, the first electronic device 100 may only open the playback control 501 to realize the second The electronic device 200 plays the first playback content.
  • an online interaction method based on multiple devices is applied to a second electronic device 200 .
  • the second electronic device 200 and the first electronic device 100 are in the same local area network, and the first electronic device 200 Both the device 100 and the second electronic device 200 may be in communication connection with the content provider server 303 .
  • the content provider server 303 is an online course service server 301 .
  • the first electronic device 100 is installed with a second APP 500, and the second APP 500 may include a playback control 501 and an interactive control 502.
  • the second APP 500 can be for online courses.
  • the second electronic device 200 may be installed with a second APP 500 or a playback control 501 of the second APP 500 may be installed.
  • the online interaction method based on multiple devices includes:
  • the second electronic device 200 when the second electronic device 200 receives the streaming message sent by the first electronic device 100, the second electronic device 200 can open the second APP 500 or the playback control 501 of the second APP 500, so as to continue the first
  • the playback progress of the electronic device 100 is played, for example, the first electronic device 100 is currently playing the first playback content, and the second electronic device 200 opens the second APP 500 or the playback control 501 of the second APP 500 to continue playing the first playback content.
  • the second electronic device 200 may, when receiving the streaming message, start the The application market is downloaded and installed, and after the installation is completed, the second APP 500 or the playback control 501 of the second APP 500 is opened, and the playback progress of the first electronic device 100 is realized to be played, such as the playback of the first electronic device 100. a playback content.
  • the second electronic device 200 sends a streaming success message to the first electronic device 100 .
  • the first electronic device The device 100 may send the device control instruction to the second electronic device 200 .
  • the second electronic device 200 receives the device control instruction, it can control the second APP 500 or the playback control 501 of the second APP 500 according to the device control instruction, such as volume adjustment, playback progress adjustment, and screenshots.
  • the second electronic device 200 When the second electronic device 200 receives the stop message sent by the first electronic device 100, the second electronic device 200 exits the second APP 500 or exits the playback control 501 of the second APP 500, and sends a streaming stop message to the first electronic device. device 100.
  • the first electronic device 100 may send a stop message to the second electronic device 200 .
  • the second electronic device 200 receives the stop message sent by the first electronic device 100, the second electronic device 200 exits the second APP 500 or the play control 501 of the second APP 500.
  • the second electronic device 200 may send a streaming stop message to the first electronic device 100.
  • an online interaction method based on multiple devices is applied to the first electronic device 100 and the second electronic device 200 .
  • the first electronic device 100 and the second electronic device 200 are under the same local area network, and both the first electronic device 100 and the second electronic device 200 may be connected to the content provider server 303 in communication.
  • the first electronic device 100 is installed with a second APP 500, and the second APP 500 may include interactive controls 502.
  • the online interaction method based on multiple devices includes:
  • the first electronic device 100 starts the second APP 500, and the first electronic device 100 plays the first playback content through the second APP 500.
  • the first electronic device 100 when the user opens the second APP 500 on the first electronic device 100, the first electronic device 100 can enter the content playing interface of the second APP 500, and the first electronic device 100 can receive the first electronic device from the content provider server 303. Once the content is played and played.
  • the first electronic device 100 When the first electronic device 100 receives a control instruction for streaming the first playback content of the second APP 500 to the second electronic device 200, the first electronic device 100 sends a streaming message to the second electronic device 200.
  • the playback stream icon 1107 when the user performs a manipulation operation on the content playback interface, the playback stream icon 1107 can be evoked.
  • FIG. 4c when the user clicks the play streaming icon 1107, a list 1108 of devices that can perform streaming streaming will pop up.
  • FIG. 4d assuming that the device ID1 is the second electronic device 200, when the user selects the device ID1 as the playback streaming device in the device list 1108, that is, the first electronic device 100 receives the streaming of the first playback content to the second electronic device According to the control instruction of the device 200 , the first electronic device 100 sends a flow message to the second electronic device 200 .
  • the second electronic device 200 When the second electronic device 200 receives the streaming message, the second electronic device 200 continues to play the first playback content.
  • the second electronic device 200 when the second electronic device 200 receives the streaming message sent by the first electronic device 100, the second electronic device 200 may continue to play the first playback content, that is, continue to play the playback progress of the first electronic device 100 .
  • the first electronic device 100 enables the interactive control 502.
  • the first electronic device 100 can automatically enable the interactive control 502 to facilitate the user to interact through the interactive control 502 .
  • the first electronic device 100 can automatically enable the interactive control 502 .
  • the second electronic device 200 may display prompt information associated with the interactive control 502 to remind the user to perform an interactive operation on the interactive control 502 .
  • the first electronic device 100 is a mobile phone
  • the interactive control 502 is a question answering interface.
  • the second electronic device 200 can display a prompt message "Please answer the question on the mobile phone", and the prompt information can be submitted by the user.
  • the prompt information can be submitted by the user.
  • the first electronic device 100 acquires the interaction information of the interaction control 502 , and sends the interaction information to the content provider server 303 .
  • the first electronic device 100 can acquire the interactive information of the user in real time, and send the interactive information to the content provider server 303.
  • an electronic device 100 can send device control instructions to the second electronic device 200 .
  • the first electronic device 100 and the second electronic device 200 receive feedback information from the content provider server 303 for the interactive information, and display the feedback information.
  • the content provider server 303 when the content provider server 303 receives the interactive information sent by the first electronic device 100, it can output corresponding feedback information according to the interactive information, and the content provider server 303 can send the feedback information to the first electronic device respectively 100 and the second electronic device 200, so that both the first electronic device 100 and the second electronic device 200 can display the feedback information.
  • the user uses the interactive control 502 to answer a question
  • both the first electronic device 100 and the second electronic device 200 may display a prompt message of "you're right”
  • the answer option selected by the user is the correct option
  • both the first electronic device 100 and the second electronic device 200 may display a prompt message of "wrong answer”.
  • the first electronic device 100 may include a first screen 1001 , a first camera 1002 , a first microphone 1003 , a first speaker 1004 , a first processor 1005 , a first memory 1006 and a first communication bus 1007 .
  • the first memory 1006 is used to store one or more first computer programs 1008 .
  • One or more first computer programs 1008 are configured to be executed by the first processor 1005 .
  • the one or more first computer programs 1008 include instructions that can be used to implement the multi-device-based online interaction method described in FIG. 9 in the first electronic device 10 .
  • the structure illustrated in this embodiment does not constitute a specific limitation on the first electronic device 100 .
  • the first electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or different component arrangements.
  • the second electronic device 200 may include a second screen 2001 , a second camera 2002 , a second microphone 2003 , a second speaker 2004 , a second processor 2005 , a second memory 2006 and a second communication bus 2007 .
  • the second memory 2006 is used to store one or more second computer programs 2008 .
  • One or more second computer programs 2008 are configured to be executed by the second processor 2005 .
  • the one or more second computer programs 2008 include instructions that can be used to implement the multi-device-based online interaction method described in FIG. 11 in the second electronic device 200 .
  • the structure illustrated in this embodiment does not constitute a specific limitation on the second electronic device 200 .
  • the second electronic device 200 may include more or less components than shown, or combine some components, or separate some components, or different component arrangements.
  • Both the first processor 1005 and the second processor 2005 may include one or more processing units, for example, the first processor 1005 may include an application processor (application processor, AP), a modem, a graphics processor (graphics processing unit, GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processor processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor
  • AP application processor
  • modem graphics processor
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural-network processor processing unit
  • Both the first processor 1005 and the second processor 2005 may also be provided with a memory for storing instructions and data.
  • the memory in the first processor 1005 and the second processor 2005 is a cache memory.
  • the memory may hold instructions or data that have just been used or recycled by the first processor 1005 (the second processor 2005). If the first processor 1005 (second processor 2005) needs to use the instruction or data again, it can be called directly from this memory. Repeated access is avoided, and the waiting time of the first processor 1005 (the second processor 2005 ) is reduced, thereby improving the efficiency of the system.
  • both the first processor 1005 and the second processor 2005 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM interface, and/or USB interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • both the first memory 1006 and the second storage area 2006 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, internal memory, plug-in hard disk, smart memory card (Smart Media) Card, SMC), Secure Digital (SD) card, Flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
  • non-volatile memory such as hard disk, internal memory, plug-in hard disk, smart memory card (Smart Media) Card, SMC), Secure Digital (SD) card, Flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
  • This embodiment also provides a computer storage medium, where computer instructions are stored in the computer storage medium, and when the computer instructions are executed on the electronic device, the electronic device executes the above-mentioned related method steps to realize the multi-device-based Online interactive methods.
  • This embodiment also provides a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the above-mentioned relevant steps, so as to realize the multi-device-based online interaction method in the above-mentioned embodiment.
  • the embodiments of the present application also provide an apparatus, which may specifically be a chip, a component or a module, and the apparatus may include a connected processor and a memory; wherein, the memory is used for storing computer execution instructions, and when the apparatus is running, The processor can execute the computer-executed instructions stored in the memory, so that the chip executes the online interaction method based on multiple devices in the foregoing method embodiments.
  • the first electronic device, the second electronic device, the computer storage medium, the computer program product or the chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to The beneficial effects in the corresponding methods provided above will not be repeated here.
  • the disclosed apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are illustrative, for example, the division of the modules or units is a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed to multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software functional units.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a readable storage medium.
  • a readable storage medium including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请实施例提供了一种基于多设备的在线互动方法,涉及终端领域。第一电子设备开启第一应用程序播放第一播放内容,当第一电子设备接收到将第一应用程序的第一播放内容流转至第二电子设备的控制指令时,第一电子设备发送流转消息至第二电子设备,当第二电子设备接收到流转消息时,第二电子设备接续播放第一播放内容,第一电子设备响应内容商服务器传送的控件开启指令,开启互动控件,第一电子设备获取互动控件的互动信息,并将互动信息发送至内容商服务器。本申请实施例还提供了一种电子设备、芯片及计算机可读存储介质。本申请可以实现将播放内容在第一电子设备和第二电子设备之间进行跨设备迁移,并可结合互动控件完成互动。

Description

基于多设备的在线互动方法、芯片、电子设备及存储介质
本申请要求于2021年03月15日提交中国专利局,申请号为202110275341.X、申请名称为“基于多设备的在线互动方法、芯片、电子设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端领域,尤其涉及一种基于多设备的在线互动方法、芯片、电子设备及计算机可读存储介质。
背景技术
在线学习打破了传统课堂的时空限制,让跨区域学习、远距离交流、个性化教学更为便捷。但是,相比于线下教学的方式,在实际的线上学习体验中会产生教学过程互动性不足,网课终端设备屏幕小、视距短而影响视力等一系列问题,让在线学习的实际效果不佳。
现有的网课学习方案中多设备的协同,一般只是通过数字生活网络联盟(Digital Living Network Alliance、DLNA)协议,或者Miracast协议,单纯的将平板、手机等手持终端中显示的内容投放到大屏幕上。两个设备显示的内容是一样的,并没有将手持终端屏幕和大屏有效的结合起来,发挥各自所长,没有解决用户在上网课过程中的互动弱的痛点。
发明内容
有鉴于此,有必要提供一种基于多设备的在线互动方法,其可实现小屏设备与大屏设备有效结合起来,实现大屏播放、小屏互动。
本申请实施例第一方面公开了一种基于多设备的在线互动方法,包括:第一电子设备开启第一应用程序,第一电子设备通过第一应用程序播放第一播放内容;当第一电子设备接收到将第一应用程序的第一播放内容流转至第二电子设备的控制指令时,第一电子设备发送流转消息至第二电子设备,以使得第二电子设备接续播放第一播放内容;第一电子设备接收内容商服务器或第二电子设备传送的控件开启指令;第一电子设备响应控件开启指令,开启互动控件;第一电子设备获取互动控件的互动信息,并将互动信息发送至内容商服务器。
通过采用该技术方案,可实现将第一播放内容在第一电子设备与第二电子设备之间进行流转播放,并可使用第一电子设备来进行互动,互动信息可以通过第一电子设备发送至内容商服务器。
在一种可能的实现方式中,在线互动方法还包括:当第一电子设备接收到第二电子设备发送的流转成功消息时,第一电子设备停止播放所述第一播放内容。
通过采用该技术方案,可实现在将第一播放内容成功流转至第二电子设备进行播放时,第一电子设备停止播放第一播放内容。
在一种可能的实现方式中,在线互动方法还包括:当第一电子设备接收到停止流转第 一播放内容的控制指令时,第一电子设备发送停止消息至第二电子设备。
通过采用该技术方案,可实现将第一播放内容从第二电子设备流转回第一电子设备进行播放。
在一种可能的实现方式中,在线互动方法还包括:当第一电子设备接收到第二电子设备发送的流转停止消息时,第一电子设备接续播放第一播放内容。
通过采用该技术方案,可实现在将第一播放内容流转回至第一电子设备进行播放时,第一电子设备可接续第二电子设备的播放进度播放第一播放内容。
在一种可能的实现方式中,在线互动方法还包括:第一电子设备将设备控制指令发送至第二电子设备,以控制第二电子设备执行预设功能。
通过采用该技术方案,可实现通过第一电子设备控制第二电子设备执行预设功能。
在一种可能的实现方式中,第一电子设备包括第一分布式软总线,第二电子设备包括第二分布式软总线,将所述设备控制指令发送至第二电子设备,包括:第一电子设备利用第一分布式软总线与第二分布式软总线将设备控制指令发送至第二电子设备。
通过采用该技术方案,可实现通过分布式软总线进行控制指令传输,以使得第一电子设备可以控制第二电子设备执行预设功能。
在一种可能的实现方式中,设备控制指令为截屏指令,在线互动方法还包括:第一电子设备接收第二电子设备发送的截屏图像,并存储截屏图像。
通过采用该技术方案,可实现通过第一电子设备控制第二电子设备进行截屏,第一电子设备可接收并保存第二电子设备的截屏图像。
在一种可能的实现方式中,在线互动方法还包括:第一电子设备接收内容商服务器针对互动信息的反馈信息,并显示反馈信息。
通过采用该技术方案,可使得第一电子设备显示互动信息的反馈信息,增加互动效果。
在一种可能的实现方式中,互动控件与第一播放内容的播放进度相关联。
通过采用该技术方案,可实现当第一播放内容的播放进度至特定节点时,开启互动控件。
本申请实施例第二方面公开了一种基于多设备的在线互动方法,包括:第一电子设备开启第一应用程序,第一电子设备通过第一应用程序播放第一播放内容;当第一电子设备接收到将第一应用程序的第一播放内容流转至第二电子设备的控制指令时,第一电子设备发送流转消息至第二电子设备;当第二电子设备接收到流转消息时,第二电子设备接续播放第一播放内容;第一电子设备开启互动控件;第一电子设备获取互动控件的互动信息,并将互动信息发送至内容商服务器;第一电子设备接收内容商服务器针对互动信息的反馈信息,并显示反馈信息;第二电子设备接收内容商服务器针对互动信息的反馈信息,并显示反馈信息。
通过采用该技术方案,可实现将第一播放内容在第一电子设备与第二电子设备之间进行流转播放,并可使用第一电子设备来进行互动,互动信息可以通过第一电子设备发送至内容商服务器,且可使得第一电子设备与第二电子设备均可显示互动信息的反馈信息,增加互动效果。
在一种可能的实现方式中,在线互动方法还包括:当第二电子设备接续播放第一播放内容时,第二电子设备发送流转成功消息至第一电子设备;当第一电子设备接收到流转成功消息时,第一电子设备停止播放第一播放内容。
通过采用该技术方案,可实现在将第一播放内容成功流转至第二电子设备进行播放时, 第二电子设备可以通知第一电子设备停止播放第一播放内容。
在一种可能的实现方式中,在线互动方法还包括:当第一电子设备接收到停止流转第一播放内容的控制指令时,第一电子设备发送停止消息至第二电子设备;当第二电子设备接收到停止消息,第二电子设备停止播放第一播放内容。
通过采用该技术方案,可实现将第一播放内容从第二电子设备流转回第一电子设备进行播放。
在一种可能的实现方式中,在线互动方法还包括:当第二电子设备停止播放第一播放内容时,第二电子设备发送流转停止消息至第一电子设备;当第一电子设备接收到流转停止消息时,第一电子设备接续播放第一播放内容。
通过采用该技术方案,可实现在将第一播放内容流转回至第一电子设备进行播放时,第一电子设备可接续第二电子设备的播放进度播放第一播放内容。
在一种可能的实现方式中,在线互动方法还包括:第一电子设备将设备控制指令发送至第二电子设备;第二电子设备根据设备控制指令执行预设功能。
通过采用该技术方案,可实现通过第一电子设备控制第二电子设备执行预设功能。
在一种可能的实现方式中,第一电子设备包括第一分布式软总线,第二电子设备包括第二分布式软总线,将所述设备控制指令发送至第二电子设备,包括:第一电子设备利用第一分布式软总线与第二分布式软总线将设备控制指令发送至第二电子设备。
通过采用该技术方案,可实现通过分布式软总线进行控制指令传输,以使得第一电子设备可以控制第二电子设备执行预设功能。
在一种可能的实现方式中,设备控制指令为截屏指令,在线互动方法还包括:第二电子设备发送截屏图像至第一电子设备;第一电子设备接收并存储截屏图像。
通过采用该技术方案,可实现通过第一电子设备控制第二电子设备进行截屏,第一电子设备可接收并保存第二电子设备发送的截屏图像。
在一种可能的实现方式中,第一电子设备开启互动控件包括:第一电子设备接收内容商服务器或第二电子设备传送的控件开启指令;第一电子设备响应控件开启指令,开启互动控件。
通过采用该技术方案,可实现在第一电子设备接收到内容商服务器或第二电子设备传送的控件开启指令,开启互动控件。
在一种可能的实现方式中,互动控件与第一播放内容的播放进度相关联。
通过采用该技术方案,可实现当第一播放内容的播放进度至特定节点时,开启互动控件。
在一种可能的实现方式中,在线互动方法还包括:当互动控件开启时,第二电子设备显示与互动控件关联的提示信息。
通过采用该技术方案,当第一电子设备开启互动控件时,第二电子设备可以显示与互动控件关联的提示信息,提醒用户在互动控件进行互动操作。
第三方面,本申请实施例提供一种计算机可读存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得电子设备执行如第一方面所述的基于多设备的在线互动方法。
第四方面,本申请实施例提供一种电子设备,电子设备包括处理器和存储器,存储器用于存储指令,处理器用于调用存储器中的指令,使得电子设备执行如第一方面所述的基于 多设备的在线互动方法。
第五方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第一方面所述的基于多设备的在线互动方法。
第六方面,提供一种装置,该装置具有实现上述第一方面所提供的方法中第一电子设备行为的功能。功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块。
可以理解地,上述提供的第三方面所述的计算机可读存储介质,第四方面所述的电子设备,第五方面所述的计算机程序产品,第六方面所述的装置均与上述第一方面的方法对应,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
附图说明
图1为本申请一实施例提供的多设备互动场景示意图;
图2为本申请一实施例提供的基于多设备的在线互动方法的应用场景图;
图3为本申请一实施例提供的第一电子设备与第二电子设备进行交互的架构示意图;
图4a-4g为本申请一实施例提供的第一电子设备与第二电子设备的交互示意图;
图5为本申请一实施例提供的第一电子设备与第二电子设备的数据交互图;
图6为本申请另一实施例提供的第一电子设备与第二电子设备的数据交互图;
图7a为本申请一实施例提供的第一电子设备与第二电子设备的软件架构示意图;
图7b-7f为本申请另一实施例提供的第一电子设备与第二电子设备的交互示意图;
图8为本申请又一实施例提供的第一电子设备与第二电子设备的交互示意图;
图9为本申请一实施例提供的基于多设备的在线互动方法的流程示意图;
图10为本申请另一实施例提供的第一电子设备与第二电子设备的软件架构示意图;
图11为本申请另一实施例提供的基于多设备的在线互动方法的流程示意图;
图12为本申请又一实施例提供的基于多设备的在线互动方法的流程示意图;
图13为本申请实施例提供的一种可能的第一电子设备的结构示意图;
图14为本申请实施例提供的一种可能的第二电子设备的结构示意图。
具体实施方式
需要说明的是,本申请中“至少一个”是指一个或者多个,“多个”是指两个或多于两个。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。本申请的说明书和权利要求书及附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不是用于描述特定的顺序或先后次序。
为了便于理解,示例性的给出了部分与本申请实施例相关概念的说明以供参考。
个人电脑、手持设备(如手机、平板电脑)、电视等电子设备可以通过无线局域网络(Wireless Local Area Network,WLAN)进行通信连接,例如,本申请实施例中的无线局域网络可以是Wi-Fi。应用程序(Application,APP)可以具备多种能力(Ability),即一个APP可以包含多个Ability。Ability是APP所具备能力的抽象,也是APP的重要 组成部分。鸿蒙系统(HarmonyOS)支持应用以Ability为单位进行部署。Ability可以分为功能能力(Feature Ability,FA)和颗粒能力(Particle Ability,PA)两种类型,每种类型为开发者提供了不同的模板,以便实现不同的业务功能。FA支持页面模板(Page Ability),可以提供与用户交互的页面能力,一个Page实例可以包含一组相关页面,每个页面用一个AbilitySlice实例表示。PA可以支持服务模板(Service Ability)和数据模板(Data Ability),服务模板没有用户界面,服务模板可以是一个后台服务,可用于提供后台运行任务的能力。数据模板可以提供数据访问抽象。APP的业务特性可由FA承载,FA可以通过PA使用各种元能力。
下面结合图1示例性的介绍本发明实施例提供的多设备互动场景示意图。
第一电子设备100与第二电子设备200可以处于同一局域网下,第一电子设备100与第二电子设备200可以通过互联互通协议、分布式软总线等实现通信连接。第二电子设备200的屏幕尺寸可以大于第一电子设备100的屏幕尺寸,第一电子设备100可以是小屏电子设备,例如,第一电子设备100为手机、平板电脑等手持设备。第二电子设备200可以是大屏电子设备,例如,第二电子设备200为液晶电视。第一电子设备100安装有第一应用程序(Application,APP)400,第一APP 400可以根据实际需求进行选择,在此不作限定。比如,第一APP 400可以是具有互动功能及视频/图像播放功能的APP,如第一APP 400为直播课APP、游戏直播APP、视频网站APP、短视频APP、电商直播APP、在线会议APP等。
在一些实施例中,用户可以在小屏设备(第一电子设备100)上进行互动操作,视频播放内容或者图像可以放在大屏设备(第二电子设备200)上进行播放。互动操作可以根据实际需求进行设定,在此不作限定。比如,互动操作可以是调节大屏设备的音量、播放进度的控制指令,还可以是进行解题步骤书写与提交、提交答题答案、进行互动聊天、发送弹幕等。
当用户在第一电子设备100上打开第一APP 400时,第一电子设备100进入第一APP400的播放界面进行内容播放。当用户选择将内容流转至第二电子设备200进行播放时,第一电子设备100的当前播放内容被流转至第二电子设备200进行接续播放。用户可以在第一电子设备100上进行互动操作,播放内容被切换至第二电子设备200播放。
下面结合图2示例性的介绍本发明实施例提供的基于多设备的在线互动方法的应用场景图。
第一电子设备100可以安装有直播课APP 110,直播课APP 110可以根据实际需求进行选择,在此不作限定。第一电子设备100与第二电子设备200可以通过ContinueAbility接口和ReverseAbility接口实现大小屏迁移。
在一些实施例中,当第一电子设备100与第二电子设备200处于同一Wi-Fi网络下,用户可以在第一电子设备100的直播课APP 110上查找到可以进行播放流转的第二电子设备200,当用户选择将直播课APP 110的第一播放内容流转至第二电子设备200时,第二电子设备200可以进入相应的播放进度,第一电子设备100可以输出“上课中,请看大屏幕”的提示信息。用户可以通过第二电子设备200的屏幕、摄像头、麦克风和扬声器进行网课学习,从而借助第二电子设备200的硬件设备获得更好的视听体验。第二电子设备200进入相应的播放进度可以是指:当用户选择将直播课APP 110的第一播放内容流转至第二电子设备200时,第二电子设备200接续第一电子设备100的播放进度进行 播放。
请参考图3,为本申请一实施例提供的第一电子设备100与第二电子设备200进行交互的架构示意图。
第一电子设备100安装有直播课APP 110,直播课APP 110可以包括第一直播课FA1101、第一播放控制PA 1102、设备管理单元1103及互动界面1104。互动界面1104可以实现直播课互动,例如互动界面1104可以是答题板、手写板、播放控制板等,用户可以使用手写笔来在答题板或手写板上进行答题书写、提交答题内容等操作。直播课APP110可以与网课业务服务器301进行通信,实现直播课的播放。第二电子设备200可以与FA服务器302进行通信,实现从FA服务器302下载第二直播课FA 1105并进行安装。第二直播课FA 1105同样可以与网课业务服务器301进行通信,实现直播课的播放。
第一电子设备100与第二电子设备200可以具有一些相同的系统能力,系统能力可以包括分布式软总线、设备管理能力、播放迁移能力等。分布式软总线可为设备之间的互联互通提供统一的分布式通信能力。例如第一电子设备100为手机、第二电子设备200为电视,用户可以在手机的直播课APP 110上,通过设备管理单元1103和手机系统的设备管理能力查找可进行播放流转的电子设备,用户还可以从设备管理单元1103返回的可播放转流的设备列表中选择一设备进行直播课FA播放流转。当用户选择电视进行直播课FA播放流转时,可以通过手机系统的播放迁移能力将流转消息通知电视系统的设备管理能力。当电视接收到该流转消息且已经安装有第二直播课FA 1101和第二播放控制PA1106时,电视可以直接开启第二直播课FA 1105,并进入相应的播放进度,第一电子设备100可以退出第一直播课FA 1101,第一电子设备100可以开启互动界面1104,此时用户可以在互动界面1104上进行网课互动或播放控制,比如调节音量、暂停/播放控制、截屏、答题等。用户在手机上的控制信息(用于控制第二电子设备200的设备控制指令)可以通过手机的分布式软总线、电视的分布式软总线同步到电视上的第二直播课FA 1105和/或第二播放控制PA 1106。比如,设备控制指令为音量调节指令、播放进度调节指令、截屏指令等,设备控制指令可以通过手机的分布式软总线、电视的分布式软总线同步到电视上的第二播放控制PA 1106,实现在手机端远程控制电视。
在一些实施中,在互动界面1104进行网课互动的互动信息可以为解题内容、题目答案等,互动信息可以直接由第一电子设备100发送给网课业务服务器301,实现在手机端进行互动答题、答题内容提交等操作。
当电视接收到该流转消息通知且未安装有第二直播课FA 1105时,电视可以自动从FA服务器302下载第二直播课FA 1105和第二播放控制PA 1106,并在下载完成后开启第二直播课FA 1105,使得电视进入相应的播放进度。例如,当电视接收到该流转消息通知且未安装有第二直播课FA 1105时,电视可以从FA服务器302下载第二直播课FA1105和第二播放控制PA 1106,例如,电视可以采取静默下载的方式实现对相关的FA与PA进行下载。
在一些实施例中,第一电子设备100与第二电子设备200可以具有一些相同的硬件模块。例如,第一电子设备100包括第一屏幕1001、第一摄像头1002、第一麦克风1003、第一扬声器1004,第二电子设备200包括第二屏幕2001、第二摄像头2002、第二麦克风2003、第二扬声器2004。第一屏幕1001的尺寸小于第二屏幕2001的尺寸,使得用户通过第二电子设备200进行网课学习,可以获得更好的视听体验,更全景的摄像角度。
在一些实施例中,当网课播放流转到第二电子设备200时,第一电子设备100上的直播课APP 110可以自动开启互动界面1104,用户可以通过互动界面1104进行上课互动,例如用户在互动界面1104上进行答题内容书写、提交答案等。在其他实施例中,当网课播放流转到第二电子设备200时,用户也可以在第一电子设备100的直播课APP 110上手动开启互动界面1104,或者当网课内容播放到一些特定节点(比如需要用户进行答题的节点)时,自动开启互动界面1104。例如,当网课内容播放到一些特定节点,网课业务服务器301或第二电子设备200可以传送控件开启指令至第一电子设备100,第一电子设备100响应该控件开启指令,开启互动界面1104。
在一些实施例中,当网课播放流转到第二电子设备200之后,用户可以在第一电子设备100的直播课APP 110上选择停止流转播放直播课(即将网课流转回第一电子设备100进行播放),例如,当网课播放流转至第二电子设备200之后,第一电子设备100的直播课APP 110上显示有一停止播放流转图标,可以实现将网课流转回第一电子设备100进行播放的功能。当用户点击该停止播放流转图标时,可以将网课流转回第一电子设备100进行播放,第二电子设备200停止播放该网课。当用户点击该停止播放流转图标时,可以通过第二电子设备200的播放迁移能力退出第二电子设备200上的第二直播课FA 1105,通过第一电子设备100的播放迁移能力,退出互动界面1104,开启第一电子设备100上的第一直播课FA 1101,使得第一电子设备100从相应的播放进度继续播放,实现将第二电子设备200的网课流转回第一电子设备100进行播放。
在一些实施例中,当网课流转至第二电子设备200进行播放之后,用户还可以使用第一电子设备100的摄像头进行视频录像,录像内容可以由第一电子设备100发送至网课业务服务器301,便于后端网课老师检验学习成果,比如检验发音、读音是否准确。
如图4a-4g所示,以第一电子设备100为手机、第二电子设备200为电视进行举例说明。如图4a所示,用户在第一电子设备100上打开直播课APP 110后,第一电子设备100进入网课播放界面,第一播放内容为化学课内容。如图4b所示,当用户对该网课播放界面进行操控操作(比如对网课播放界面任意区域进行一次触控操作)时,可以唤起播放流转图标1107。如图4c所示,当用户点击播放流转图标1107时,弹出可以进行播放流转的设备列表1108,比如该设备列表1108中包括设备ID1、设备ID2。如图4d所示,假设设备ID1为第二电子设备200,当用户在设备列表1108中选择设备ID1作为播放流转设备时,可以控制第二电子设备200开启第二直播课FA 1105,并进入相应的播放进度,进而用户可以通过第二电子设备200进行网课学习。
如图4e所示,当网课播放流转到第二电子设备200之后,互动界面1104被开启,互动界面1104可以设置有停止播放流转图标1109。如图4f-4g所示,当用户点击停止播放流转图标1109时,第二电子设备200退出第二直播课FA 1105,第一电子设备100开启第一直播课FA 1101,实现将直播课流转回第一电子设备100进行播放。在其他实施例中,当互动界面1104不是以全屏方式显示时,也可以在互动界面1104区域外显示停止播放流转图标1109。
在一些实施例中,播放流转图标1107与停止播放流转图标1109还可以采用相同的图标,通过图标颜色(比如颜色深浅、不同颜色)来区分。
在一些实施例中,还可以不设置播放流转图标1107与停止播放流转图标1109,定义特定的手势来实现将第一播放内容从第一电子设备100流转至第二电子设备200进行 播放,以及停止流转第一播放内容(即将第一播放内容从第二电子设备200流转回第一电子设备100进行播放)。比如,当用户在第一电子设备100上打开直播课APP 110且在直播课APP 110的播放界面侦测到向上的滑动手势,将第一播放内容从第一电子设备100流转至第二电子设备200进行播放,当侦测到向下的滑动手势,将第一播放内容从第二电子设备200流转回第一电子设备100进行播放。
下面结合图5-6示例性的介绍本发明实施例提供的第一电子设备100与第二电子设备200的交互示意图。
为便于下文描述,在下文所述的应用场景中,第一电子设备100预先安装有直播课APP 110,第一电子设备100为小屏电子设备,第二电子设备200为大屏电子设备,第一电子设备100与第二电子设备200处于同一局域网下。如图5所示,第一电子设备100与第二电子设备200进行交互的过程具体可包括:
50、用户打开直播课APP 110,第一电子设备100进入网课播放界面,以使得用户可使用第一电子设备100的硬件模块(麦克风、扬声器、摄像头等)进行网课学习。网课播放可以是指直播课播放、录播课播放等,在此不作限定。
51、用户在第一电子设备100上选择流转至大屏播放,并选定第二电子设备200作为播放流转设备,第一电子设备100发送流转消息通知第二电子设备200。流转消息包含有直播课FA的身份标识号(Identity Document,ID)。
52、第二电子设备200根据直播课FA的ID从FA服务器302下载第二直播课FA 1105。
53、第二电子设备200安装第二直播课FA 1105,并开启第二直播课FA 1105进入相应的播放进度,以使得用户可使用第二电子设备200的软硬件模块进行网课学习。
54、第二电子设备200发送流转成功消息至第一电子设备100。
55、第一电子设备100退出第一直播课FA 1101,第一电子设备100还可以开启互动界面1104,以使得用户可以使用互动界面1104进行上课互动。
在一些实施例中,当网课播放流转到第二电子设备200时,第一电子设备100上的直播课APP 110可以自动开启互动界面1104,用户可以通过互动界面1104进行上课互动,例如用户在互动界面1104上进行答题内容书写、提交答案等。
在一些实施例中,当网课播放流转到第二电子设备200时,用户也可以在第一电子设备100的直播课APP 110上手动开启互动界面1104,或者当网课内容播放到一些特定节点(比如需要用户进行答题的节点)时,第一电子设备自动开启互动界面1104。
56、用户在第一电子设备100上选择停止流转至大屏,第一电子设备100发送停止消息通知第二电子设备200。
57、第二电子设备200退出第二直播课FA 1105。
58、第二电子设备200发送流转停止消息至第一电子设备100。
59、第一电子设备100退出互动界面1104,开启第一直播课FA 1101,以使得用户可继续使用第一电子设备100的软硬件模块进行网课学习。
在另一种场景下,第一电子设备100预先安装有直播课APP 110,第二电子设备200预先安装有第二直播课FA 1105,比如,在进行播放流转前,用户可以预先控制第二电子设备200从FA服务器302下载并安装第二直播课FA 1105。第一电子设备100为小屏电子设备,第二电子设备200为大屏电子设备,第一电子设备100与第二电子设备200 处于同一局域网下。如图6所示,第一电子设备100与第二电子设备200进行交互的过程具体可包括:
60、用户打开直播课APP 110,第一电子设备100进入网课播放界面,以使得用户可使用第一电子设备100的硬件模块(如麦克风、扬声器、摄像头等)进行网课学习。
61、用户在第一电子设备100上选择流转至大屏播放,并选定第二电子设备200作为播放流转设备,第一电子设备100发送流转消息通知第二电子设备200。
62、第二电子设备200开启第二直播课FA 1105并进入相应的播放进度,以使得用户可使用第二电子设备200的硬件模块进行网课学习。
63、第二电子设备200发送流转成功消息至第一电子设备100。
64、第一电子设备100退出第一直播课FA 1101,第一电子设备100还可以开启互动界面1104,以使得用户可以使用互动界面1104进行上课互动。
65、用户在第一电子设备100上选择停止流转至大屏,第一电子设备100发送停止消息通知第二电子设备200。
66、第二电子设备200退出第二直播课FA 1105。
67、第二电子设备200发送流转停止消息至第一电子设备100。
68、第一电子设备100退出互动界面1104,开启第一直播课FA 1101,以使得用户可继续使用第一电子设备100的硬件模块进行网课学习。
本申请可以将直播课FA在大屏电子设备和小屏电子设备之间进行跨设备迁移,并可结合手写笔完成大屏听课、小屏互动的场景,可以解决现有教育直播课场景中手持终端屏幕过小而易伤眼睛、教学互动弱等难题。
实施例一
在实施例一中,如图7a与7f所示,第一电子设备100为手机,第二电子设备200为电视。手机中安装有第一APP 400,第一APP 400包括第一FA 401、第一PA 402及互动窗口403,电视安装有与第一APP 400对应的第二FA 404及第二PA 405。第一APP 400可以根据实际使用需求进行选定,在此不作限定。实施例一可以实现手机与电视的联动播放,包括,但不限于:手机播放流转至电视,手机控制电视播放音量、调整播放进度、播放暂停/继续播放、播放截图,电视播放流转回手机、在手机端进行会话聊天、题目答案提交等。具体地,手机与电视进行联动播放的过程可以包括:
70、手机与电视处于同一局域网下,用户打开第一APP 400,手机进入应用程序界面播放第一播放内容,用户可以通过手机的硬件模块使用第一APP 400。例如,通过手机摄像头进行摄像,通过手机扬声器播放声音,通过手机麦克风进行拾音。
71、用户在第一APP 400上选择流转至大屏播放,并选定电视作为播放流转设备,手机发送流转消息通知电视。
72、电视开启第二FA 404并进入相应的播放进度,接续播放第一播放内容,用户可以通过电视的硬件模块使用第一APP 400。例如,通过电视摄像头进行摄像,通过电视扬声器播放声音,通过电视麦克风进行拾音。
73、当第一播放内容成功流转至电视时,手机退出第一FA 401,手机还可以开启互动窗口403,用户可以使用互动窗口403进行互动。
例如,用户可以使用互动窗口403调整第二FA 404的播放音量、对第二FA 404的 播放内容进行截屏、停止流转第一播放内容(即将第一播放内容流转回手机播放)。
在一些实施例中,当第一播放内容成功流转至电视播放时,手机可以退出第一FA 401。
在一些实施例中,当第一播放内容成功流转至电视播放时,第一电子设备100可以自动开启互动窗口403。
在一些实施例中,当第一播放内容成功流转至电视播放时,用户也可以手动开启互动窗口403,或者当第一播放内容播放到一些特定节点(比如需要用户进行答题的节点)时,第一电子设备自动开启互动窗口403。
例如,当第一播放内容播放到一些特定节点,可以由网课业务服务器301或电视发送窗口开启指令,以使得第一电子设备开启互动窗口403。
例如,手机播放离线课程,当手机侦测到第一播放内容播放到一些特定节点时,手机可以自动开启互动窗口403,或者当电视侦测到第一播放内容播放到一些特定节点时,电视可以发送窗口开启指令至手机,控制手机开启互动窗口403。
如图7b所示,用户可以使用互动窗口403来实现调整第二FA 404的播放音量。用户在互动窗口403上进行音量调节操作,音量调节指令由手机传送至电视,电视接收音量调节指令并执行音量调节。
如图7c所示,用户可以使用互动窗口403来实现控制电视进行截屏,电视截屏生成的图像Image_1可以传送给手机进行保存,手机可以将该图像存储至预设区域,比如归类为学习笔记。用户在互动窗口403上进行截屏操作,截屏指令由手机传送至电视,电视接收截屏指令并执行截屏操作。电视截屏生成的图像I1可以通过互联互通协议、分布式软总线等传送给手机。
如图7d所示,用户还可以使用互动窗口403进行答题,例如,在第二FA 404输出“请在手机上进行答题”的提示信息,用户使用互动窗口403进行答案提交。互动窗口403可以显示多个答题选项,用户可以在互动窗口403选择其中一个答题选项,当用户使用互动窗口403选中一个答题选项后,互动窗口403与第二FA 404均可以输出答案是否正确的提示信息。例如,如图7e所示,若用户选择的答题选项为正确选项时,互动窗口403与第二FA 404均可以显示“答对啦”的提示信息。如图7f所示,若用户选择的答题选项为错误选项时,互动窗口403与第二FA 404均可以显示“答错啦”的提示信息。
74、用户在手机上选择停止播放流转至大屏,手机发送停止消息通知电视。
75、电视退出第二FA 404。
76、手机退出互动窗口403,开启第一FA 401,用户通过手机的硬件模块继续使用第一APP 400。
实施例二
在实施例二中,如图8所示,第一电子设备100为平板电脑,第二电子设备200为电视。平板电脑中安装有第一APP 400,第一APP 400包括第一FA 401、第一PA 402及互动窗口403,电视安装有与第一APP 400对应的第二FA 404及第二PA 405。第一APP 400可以根据实际使用需求进行选定,在此不作限定。实施例二可以实现平板电脑与电视的联动播放,包括,但不限于:平板电脑流转至电视,平板电脑控制电视播放音量、调整播放进度、播放暂停/继续播放、播放截图,电视播放流转回平板电脑、在平板电脑端进行答题提交等。具体地,平板电脑与电视进行联动播放的过程可以包括:
80、平板电脑与电视处于同一局域网下,用户打开第一APP 400,平板电脑进入应用程序界面播放第一播放内容,用户可以通过平板电脑的硬件模块使用第一APP 400。例如,通过平板电脑摄像头进行摄像,通过平板电脑扬声器播放声音,通过平板电脑麦克风进行拾音。
81、用户在第一APP 400上选择流转至大屏播放,并选定电视作为播放流转设备,平板电脑发送流转消息通知电视。
82、电视开启第二FA 404并进入与平板电脑播放相对应的播放进度,接续播放第一播放内容,用户可以通过电视的硬件模块使用第一APP 400。例如,通过电视摄像头进行摄像,通过电视扬声器播放声音,通过电视麦克风进行拾音。
83、当第一播放内容成功流转至电视时,平板电脑退出第一FA 401,平板电脑还可以开启互动窗口403,用户可以使用互动窗口403进行互动。
例如,用户可以使用互动窗口403调整第二FA 404的播放音量、对第二FA 404的播放内容进行截屏、将播放内容流转回平板电脑。如图8所示,当授课老师提问生成水的化学式是什么时,用户还可以使用手写笔50在互动窗口403上书写生成水的化学式并提交,平板电脑可以将互动窗口403上的书写内容传送至网课业务服务器301,供授课老师查阅。
在一些实施例中,当第一播放内容成功流转至电视播放时,平板电脑退出第一FA 401,当第二FA 404的网课内容播放到一些特定节点(比如需要用户进行答题的节点)时,平板电脑自动开启互动窗口403,用户可以使用互动窗口403进行互动答题。
84、用户在平板电脑上选择停止播放流转至大屏,平板电脑发送停止消息通知电视。
85、电视退出第二FA 404。
86、平板电脑退出互动窗口403,开启第一FA 401,用户通过平板电脑的硬件模块继续使用第一APP 400。
参照图9所示,本申请实施例提供的一种基于多设备的在线互动方法,应用于第一电子设备100中。如图10所示,第一电子设备100与第二电子设备200处于同一局域网下,第一电子设备100与第二电子设备200可以均与内容商服务器303通信连接。比如,该内容商服务器303为提供网课业务的网课业务服务器301。第一电子设备100安装有第二APP 500,第二APP 500可以包括播放控件501及互动控件502。播放控件501可以具有画面播放功能的控件,互动控件502可以是具备识别用户操作内容和/或接收用户输入指令的控件,互动控件502可以具备UI元素,可接受用户触控/点击。第二APP 500可以根据实际应用需求进行选定,例如第二APP 500为网课学习类APP。本实施例中,基于多设备的在线互动方法包括:
901、第一电子设备100开启第二APP 500,第一电子设备100进行第一播放内容播放。
在一些实施例中,当用户在第一电子设备100开启第二APP 500时,第一电子设备100可以进入第二APP 500的网课播放界面,用户可以通过第一电子设备100的硬件模块进行网课学习。比如,第一电子设备100开启第二APP 500,第一电子设备100可以从网课业务服务器301接收第一播放内容并进行播放。
902、当第一电子设备100接收到将第一播放内容流转至第二电子设备200的控制指令时,发送流转消息至第二电子设备200。
在一些实施例中,如图4b所示,当用户对该网课播放界面进行操控操作时,可以唤起播放流转图标1107。如图4c所示,当用户点击播放流转图标1107时,弹出可以进行播放流转的设备列表1108。如图4d所示,假设设备ID1为第二电子设备200,当用户在设备列表1108中选择设备ID1作为播放流转设备时,即第一电子设备100接收到将第一播放内容流转至第二电子设备200的控制指令,第一电子设备100发送流转消息至第二电子设备200。
903、当第一电子设备100接收到第二电子设备200发送的流转成功消息时,第一电子设备100退出播放控件501。
在一些实施例中,第二电子设备200同样可以安装有第二APP 500或第二APP 500的播放控件501。如图4d所示,当第二电子设备200接收到第一电子设备100发送的流转消息时,第二电子设备200可以开启第二APP 500或第二APP 500的播放控件501,实现接续第一电子设备100的播放进度进行播放,即接续播放第一播放内容。当第二电子设备200上的第二APP 500,或第二APP 500的播放控件501正常启动,或第一播放内容成功流转至第二电子设备200时,第二电子设备200可以发送流转成功消息至第一电子设备100,当接收到第二电子设备200发送的流转成功消息时,第一电子设备100退出播放控件501。
904、第一电子设备100开启互动控件502。
在一些实施例中,当第一电子设备100退出播放控件501时,第一电子设备100可以自动开启互动控件502,便于用户通过互动控件502进行上课互动。
在一些实施例中,互动控件502可以与第一播放内容的播放进度相关联,当第二电子设备200上播放的网课内容播放到一些特定节点(比如需要用户进行答题的节点)时,第一电子设备100可以自动开启互动控件502。例如,互动控件502与第一播放内容的播放进度相关联可以是指互动控件502与第一播放内容的播放时间节点相关联,或者与第一播放内容的播放画面内容相关联。
905、第一电子设备100获取互动控件502的互动信息,并将互动信息发送至内容商服务器303。
在一些实施例中,当互动控件502被开启后,第一电子设备100可以实时获取用户的互动信息,并将互动信息发送至网课业务服务器301。比如,互动信息为答题选项、为解题内容,第一电子设备100可以将答题选项、解题内容发送至网课业务服务器301,便于后端网课老师检验学习成果,或者由网课业务服务器301判断答题选项、解题内容是否正确。
在一些实施例中,当用户通过互动控件502生成针对第二电子设备200的设备控制指令时,如调节第二电子设备200的播放音量、播放进度、控制第二电子设备200进行截屏等,第一电子设备100可以将设备控制指令发送至第二电子设备200。
906、当第一电子设备100接收到停止播放流转至至第二电子设备200的控制指令时,发送停止消息至第二电子设备200。
在一些实施例中,如图4f所示,当用户点击停止播放流转图标1109时,即第一电子设备100接收到停止流转至第二电子设备200的控制指令,第一电子设备100发送停止消息至第二电子设备200。当第二电子设备200接收到第一电子设备100发送的停止消息时,第二电子设备200退出第二APP 500或第二APP 500的播放控件501。
907、当第一电子设备100接收到第二电子设备200发送的流转停止消息时,第一电子设备100退出互动控件502,开启播放控件501。
在一些实施例中,当第二电子设备200退出第二APP 500或第二APP 500的播放控件501时,第二电子设备200可以发送流转停止消息至第一电子设备100,当第一电子设备100接收到第二电子设备200发送的流转停止消息时,第一电子设备100退出互动控件502,开启播放控件501,实现接续第二电子设备200的播放进度进行播放,即接续播放第一播放内容。
在一些实施例中,当第一电子设备100接收到第二电子设备200发送的流转停止消息且互动控件502未处于开启状态时,第一电子设备100可以只开启播放控件501,实现接续第二电子设备200播放第一播放内容。
参照图11所示,本申请实施例提供的一种基于多设备的在线互动方法,应用于第二电子设备200中,第二电子设备200与第一电子设备100处于同一局域网下,第一电子设备100与第二电子设备200可以均与内容商服务器303通信连接。比如,该内容商服务器303为网课业务服务器301。第一电子设备100安装有第二APP 500,第二APP 500可以包括播放控件501及互动控件502。第二APP 500可以为网课学习类。第二电子设备200可以安装有第二APP 500或安装有第二APP 500的播放控件501。本实施例中,基于多设备的在线互动方法包括:
1101、当第二电子设备200接收到第一电子设备100发送的流转消息时,开启第二APP 500或第二APP 500的播放控件501。
在一些实施例中,当第二电子设备200接收到第一电子设备100发送的流转消息时,第二电子设备200可以开启第二APP 500或第二APP 500的播放控件501,实现接续第一电子设备100的播放进度进行播放,比如第一电子设备100当前在播放第一播放内容,第二电子设备200开启第二APP 500或第二APP 500的播放控件501接续播放第一播放内容。当第二电子设备200未预先安装有第二APP 500或安装有第二APP 500的播放控件501时,第二电子设备200可以在接收到流转消息时,根据流转消息中所包含的APP ID从应用市场进行下载与安装,并在安装完成后开启第二APP 500或第二APP 500的播放控件501,实现接续第一电子设备100的播放进度进行播放,比如接续播放第一电子设备100的第一播放内容。
1102、当第二电子设备200接续播放第一播放内容时,第二电子设备200发送流转成功消息至第一电子设备100。
1103、当第二电子设备200接收到设备控制指令时,根据设备控制指令控制第二APP 500或第二APP 500的播放控件501。
在一些实施例中,当互动控件502产生针对第二电子设备200的设备控制指令时,如调节第二电子设备200的播放音量、播放进度、控制第二电子设备200进行截屏等,第一电子设备100可以将设备控制指令发送至第二电子设备200。当第二电子设备200接收到设备控制指令时,可以根据设备控制指令控制第二APP 500或第二APP 500的播放控件501,实现诸如音量调节、播放进度调节、截屏等。
1104、当第二电子设备200接收到第一电子设备100发送的停止消息时,第二电子设备200退出第二APP 500或退出第二APP 500的播放控件501,发送流转停止消息至第一电子设备100。
在一些实施例中,如图4f所示,当用户点击停止播放流转图标1109时,第一电子设备100可以发送停止消息至第二电子设备200。当第二电子设备200接收到第一电子设备100发送的停止消息时,第二电子设备200退出第二APP 500或第二APP 500的播放控件501。当第二电子设备200退出第二APP 500或第二APP 500的播放控件501时,第二电子设备200可以发送流转停止消息至第一电子设备100。
参照图12所示,本申请实施例提供的一种基于多设备的在线互动方法,应用于第一电子设备100与第二电子设备200。第一电子设备100与第二电子设备200处于同一局域网下,第一电子设备100与第二电子设备200可以均与内容商服务器303通信连接。第一电子设备100安装有第二APP 500,第二APP 500可以包括互动控件502。本实施例中,基于多设备的在线互动方法包括:
1201、第一电子设备100开启第二APP 500,第一电子设备100通过第二APP 500播放第一播放内容。
在一些实施例中,当用户在第一电子设备100开启第二APP 500时,第一电子设备100可以进入第二APP 500的内容播放界面,第一电子设备100可以从内容商服务器303接收第一播放内容并进行播放。
1202、当第一电子设备100接收到将第二APP 500的第一播放内容流转至第二电子设备200的控制指令时,第一电子设备100发送流转消息至第二电子设备200。
在一些实施例中,如图4b所示,当用户对内容播放界面进行操控操作时,可以唤起播放流转图标1107。如图4c所示,当用户点击播放流转图标1107时,弹出可以进行播放流转的设备列表1108。如图4d所示,假设设备ID1为第二电子设备200,当用户在设备列表1108中选择设备ID1作为播放流转设备时,即第一电子设备100接收到将第一播放内容流转至第二电子设备200的控制指令,第一电子设备100发送流转消息至第二电子设备200。
1203、当第二电子设备200接收到流转消息时,第二电子设备200接续播放第一播放内容。
在一些实施例中,当第二电子设备200接收到第一电子设备100发送的流转消息时,第二电子设备200可以接续播放第一播放内容,即接续第一电子设备100的播放进度进行播放。
1204、第一电子设备100开启互动控件502。
在一些实施例中,当第一播放内容成功流转至第二电子设备200进行播放时,第一电子设备100可以自动开启互动控件502,便于用户通过互动控件502进行互动。
在一些实施例中,当第二电子设备200上播放的第一播放内容播放到一些特定节点(比如需要用户进行答题的节点)时,第一电子设备100可以自动开启互动控件502。
在一些实施例中,当第一电子设备100开启互动控件502时,第二电子设备200可以显示与互动控件502关联的提示信息,提醒用户在互动控件502进行互动操作。例如,第一电子设备100为手机,互动控件502为答题界面,当互动控件502开启时,第二电子设备200可以显示“请在手机上进行答题”的提示信息,该提示信息可以在用户提交答题答案时,停止显示。
1205、第一电子设备100获取互动控件502的互动信息,并将互动信息发送至内容商服务器303。
在一些实施例中,当互动控件502被开启后,第一电子设备100可以实时获取用户 的互动信息,并将互动信息发送至内容商服务器303。
在一些实施例中,当用户通过互动控件502生成针对第二电子设备200的设备控制指令时,如调节第二电子设备200的播放音量、播放进度、控制第二电子设备200进行截屏等,第一电子设备100可以将设备控制指令发送至第二电子设备200。
1206、第一电子设备100与第二电子设备200接收内容商服务器303针对互动信息的反馈信息,并显示反馈信息。
在一些实施例中,当内容商服务器303接收到第一电子设备100发送的互动信息时,可以根据该互动信息输出对应的反馈信息,内容商服务器303可以将反馈信息分别发送至第一电子设备100与第二电子设备200,使得第一电子设备100与第二电子设备200均可以显示该反馈信息。例如,用户使用互动控件502进行答题时,若用户选择的答题选项为正确选项时,第一电子设备100与第二电子设备200均可以显示“答对啦”的提示信息,若用户选择的答题选项为错误选项时,第一电子设备100与第二电子设备200均可以显示“答错啦”的提示信息。
参考图13,为本申请实施例提供的第一电子设备100的硬件结构示意图。如图13所示,第一电子设备100可以包括第一屏幕1001、第一摄像头1002、第一麦克风1003、第一扬声器1004、第一处理器1005、第一存储器1006及第一通信总线1007。第一存储器1006用于存储一个或多个第一计算机程序1008。一个或多个第一计算机程序1008被配置为被该第一处理器1005执行。该一个或多个第一计算机程序1008包括指令,上述指令可以用于实现在第一电子设备10中执行如图9所述的基于多设备的在线互动方法。
可以理解的是,本实施例示意的结构并不构成对第一电子设备100的具体限定。在另一些实施例中,第一电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。
参考图14,为本申请实施例提供的第二电子设备200的硬件结构示意图。如图14所示,第二电子设备200可以包括第二屏幕2001、第二摄像头2002、第二麦克风2003、第二扬声器2004、第二处理器2005、第二存储器2006及第二通信总线2007。第二存储器2006用于存储一个或多个第二计算机程序2008。一个或多个第二计算机程序2008被配置为被该第二处理器2005执行。该一个或多个第二计算机程序2008包括指令,上述指令可以用于实现在第二电子设备200中执行如图11所述的基于多设备的在线互动方法。
可以理解的是,本实施例示意的结构并不构成对第二电子设备200的具体限定。在另一些实施例中,第二电子设备200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。
第一处理器1005与第二处理器2005均可以包括一个或多个处理单元,例如:第一处理器1005可以包括应用处理器(application processor,AP),调制解调器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
第一处理器1005、第二处理器2005中均还可以设置有存储器,用于存储指令和数据。在一些实施例中,第一处理器1005与第二处理器2005中的存储器为高速缓冲存储器。该存储器可以保存第一处理器1005(第二处理器2005)刚用过或循环使用的指令或数据。如果第 一处理器1005(第二处理器2005)需要再次使用该指令或数据,可从该存储器中直接调用。避免了重复存取,减少了第一处理器1005(第二处理器2005)的等待时间,因而提高了系统的效率。
在一些实施例中,第一处理器1005与第二处理器2005均可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,SIM接口,和/或USB接口等。
在一些实施例中,第一存储器1006与第二存储区2006均可以包括高速随机存取存储器,还可以包括非易失性存储器,例如硬盘、内存、插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
本实施例还提供一种计算机存储介质,该计算机存储介质中存储有计算机指令,当该计算机指令在电子设备上运行时,使得电子设备执行上述相关方法步骤实现上述实施例中的基于多设备的在线互动方法。
本实施例还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述相关步骤,以实现上述实施例中的基于多设备的在线互动方法。
另外,本申请的实施例还提供一种装置,这个装置具体可以是芯片,组件或模块,该装置可包括相连的处理器和存储器;其中,存储器用于存储计算机执行指令,当装置运行时,处理器可执行存储器存储的计算机执行指令,以使芯片执行上述各方法实施例中的基于多设备的在线互动方法。
其中,本实施例提供的第一电子设备、第二电子设备、计算机存储介质、计算机程序产品或芯片均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例是示意性的,例如,该模块或单元的划分,为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
该作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以 采用硬件的形式实现,也可以采用软件功能单元的形式实现。
该集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。

Claims (22)

  1. 一种基于多设备的在线互动方法,其特征在于,所述在线互动方法包括:
    第一电子设备开启第一应用程序,所述第一电子设备通过所述第一应用程序播放第一播放内容;
    当所述第一电子设备接收到将所述第一应用程序的第一播放内容流转至第二电子设备的控制指令时,所述第一电子设备发送流转消息至所述第二电子设备,以使得所述第二电子设备接续播放所述第一播放内容;
    所述第一电子设备接收内容商服务器传送的控件开启指令;
    所述第一电子设备响应所述控件开启指令,开启互动控件;
    所述第一电子设备获取所述互动控件的互动信息,并将所述互动信息发送至所述内容商服务器。
  2. 如权利要求1所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述第一电子设备接收到所述第二电子设备发送的流转成功消息时,所述第一电子设备停止播放所述第一播放内容。
  3. 如权利要求1所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述第一电子设备接收到停止流转所述第一播放内容的控制指令时,所述第一电子设备发送停止消息至所述第二电子设备。
  4. 如权利要求3所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述第一电子设备接收到所述第二电子设备发送的流转停止消息时,所述第一电子设备接续播放所述第一播放内容。
  5. 如权利要求1所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    所述第一电子设备将设备控制指令发送至所述第二电子设备,以控制所述第二电子设备执行预设功能。
  6. 如权利要求5所述的基于多设备的在线互动方法,其特征在于,所述第一电子设备包括第一分布式软总线,所述第二电子设备包括第二分布式软总线,所述将所述设备控制指令发送至所述第二电子设备,包括:
    所述第一电子设备利用所述第一分布式软总线与所述第二分布式软总线将所述设备控制指令发送至所述第二电子设备。
  7. 如权利要求5所述的基于多设备的在线互动方法,其特征在于,所述设备控制指令为截屏指令,所述在线互动方法还包括:
    所述第一电子设备接收所述第二电子设备发送的截屏图像,并存储所述截屏图像。
  8. 如权利要求1至7中任意一项所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    所述第一电子设备接收所述内容商服务器针对所述互动信息的反馈信息,并显示所述反 馈信息。
  9. 如权利要求1至7中任意一项所述的基于多设备的在线互动方法,其特征在于,所述互动控件与所述第一播放内容的播放进度相关联。
  10. 一种基于多设备的在线互动方法,其特征在于,所述在线互动方法包括:
    第一电子设备开启第一应用程序,所述第一电子设备通过所述第一应用程序播放第一播放内容;
    当所述第一电子设备接收到将所述第一应用程序的第一播放内容流转至第二电子设备的控制指令时,所述第一电子设备发送流转消息至所述第二电子设备;
    当所述第二电子设备接收到所述流转消息时,所述第二电子设备接续播放所述第一播放内容;
    所述第一电子设备开启互动控件;
    所述第一电子设备获取所述互动控件的互动信息,并将所述互动信息发送至内容商服务器;
    所述第一电子设备接收所述内容商服务器针对所述互动信息的反馈信息,并显示所述反馈信息;
    所述第二电子设备接收所述内容商服务器针对所述互动信息的反馈信息,并显示所述反馈信息。
  11. 如权利要求10所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述第二电子设备接续播放所述第一播放内容时,所述第二电子设备发送流转成功消息至所述第一电子设备;
    当所述第一电子设备接收到所述流转成功消息时,所述第一电子设备停止播放所述第一播放内容。
  12. 如权利要求10所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述第一电子设备接收到停止流转所述第一播放内容的控制指令时,所述第一电子设备发送停止消息至所述第二电子设备;
    当所述第二电子设备接收到所述停止消息,所述第二电子设备停止播放所述第一播放内容。
  13. 如权利要求12所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述第二电子设备停止播放所述第一播放内容时,所述第二电子设备发送流转停止消息至所述第一电子设备;
    当所述第一电子设备接收到所述流转停止消息时,所述第一电子设备接续播放所述第一播放内容。
  14. 如权利要求10所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    所述第一电子设备将设备控制指令发送至所述第二电子设备;
    所述第二电子设备根据所述设备控制指令执行预设功能。
  15. 如权利要求14所述的基于多设备的在线互动方法,其特征在于,所述第一电子设备 包括第一分布式软总线,所述第二电子设备包括第二分布式软总线,所述将所述设备控制指令发送至所述第二电子设备,包括:
    所述第一电子设备利用所述第一分布式软总线与所述第二分布式软总线将所述设备控制指令发送至所述第二电子设备。
  16. 如权利要求14所述的基于多设备的在线互动方法,其特征在于,所述设备控制指令为截屏指令,所述在线互动方法还包括:
    所述第二电子设备发送截屏图像至所述第一电子设备;
    所述第一电子设备接收并存储所述截屏图像。
  17. 如权利要求9所述的基于多设备的在线互动方法,其特征在于,所述第一电子设备开启互动控件,包括:
    所述第一电子设备接收所述内容商服务器传送的控件开启指令;
    所述第一电子设备响应所述控件开启指令,开启所示互动控件。
  18. 如权利要求10至17中任意一项所述的基于多设备的在线互动方法,其特征在于,所述互动控件与所述第一播放内容的播放进度相关联。
  19. 如权利要求10至17中任意一项所述的基于多设备的在线互动方法,其特征在于,所述在线互动方法还包括:
    当所述互动控件开启时,所述第二电子设备显示与所述互动控件关联的提示信息。
  20. 一种计算机可读存储介质,其特征在于,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1至权利要求9中任一项所述的基于多设备的在线互动方法。
  21. 一种电子设备,其特征在于,所述电子设备包括处理器和存储器,所述存储器用于存储指令,所述处理器用于调用所述存储器中的指令,使得所述电子设备执行权利要求1至权利要求9中任一项所述的基于多设备的在线互动方法。
  22. 一种芯片,与电子设备中的存储器耦合,其特征在于,所述芯片用于控制所述电子设备执行权利要求1至权利要求9中任一项所述的基于多设备的在线互动方法。
PCT/CN2022/079770 2021-03-15 2022-03-08 基于多设备的在线互动方法、芯片、电子设备及存储介质 WO2022193994A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP22770349.3A EP4296844A4 (en) 2021-03-15 2022-03-08 MULTI-DEVICE BASED ONLINE INTERACTION METHOD, CHIP, ELECTRONIC DEVICE AND STORAGE MEDIUM
US18/282,038 US20240152310A1 (en) 2021-03-15 2022-03-08 Multi-device-based online interaction method, chip, electronic device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110275341.XA CN115145507A (zh) 2021-03-15 2021-03-15 基于多设备的在线互动方法、芯片、电子设备及存储介质
CN202110275341.X 2021-03-15

Publications (1)

Publication Number Publication Date
WO2022193994A1 true WO2022193994A1 (zh) 2022-09-22

Family

ID=83321550

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/079770 WO2022193994A1 (zh) 2021-03-15 2022-03-08 基于多设备的在线互动方法、芯片、电子设备及存储介质

Country Status (4)

Country Link
US (1) US20240152310A1 (zh)
EP (1) EP4296844A4 (zh)
CN (1) CN115145507A (zh)
WO (1) WO2022193994A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118113305A (zh) * 2022-11-29 2024-05-31 华为技术有限公司 应用跨设备流转方法、相关装置及通信系统
CN116074571A (zh) * 2023-04-06 2023-05-05 深圳开鸿数字产业发展有限公司 音视频系统的控制方法、计算机设备及存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170109122A1 (en) * 2015-10-14 2017-04-20 Google Inc. User Interface for Screencast Applications
CN108769814A (zh) * 2018-06-01 2018-11-06 腾讯科技(深圳)有限公司 视频互动方法、装置及可读介质
CN110109636A (zh) * 2019-04-28 2019-08-09 华为技术有限公司 投屏方法、电子设备以及系统
CN111309279A (zh) * 2020-05-06 2020-06-19 上海幻电信息科技有限公司 多屏互动显示方法及装置
CN111435999A (zh) * 2019-01-12 2020-07-21 北京字节跳动网络技术有限公司 一种视频上展示信息的方法、装置、设备和存储介质
CN111901674A (zh) * 2020-07-13 2020-11-06 腾讯科技(深圳)有限公司 一种视频播放控制及装置
CN112218103A (zh) * 2020-09-02 2021-01-12 北京达佳互联信息技术有限公司 直播间互动方法、装置、电子设备和存储介质
CN112732212A (zh) * 2020-12-31 2021-04-30 咪咕音乐有限公司 显示方法、电子设备及存储介质
CN113835649A (zh) * 2020-06-08 2021-12-24 华为技术有限公司 一种投屏方法和终端

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5194673B2 (ja) * 2007-09-26 2013-05-08 株式会社日立製作所 携帯端末、及び情報の送受信方法
US20110239142A1 (en) * 2010-03-25 2011-09-29 Nokia Corporation Method and apparatus for providing content over multiple displays
CN103716709B (zh) * 2013-12-23 2017-02-01 乐视致新电子科技(天津)有限公司 一种同屏互动方法以及装置
CN110519230A (zh) * 2019-07-23 2019-11-29 晶晨半导体(深圳)有限公司 一种智能电视的监控系统
US11128636B1 (en) * 2020-05-13 2021-09-21 Science House LLC Systems, methods, and apparatus for enhanced headsets

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170109122A1 (en) * 2015-10-14 2017-04-20 Google Inc. User Interface for Screencast Applications
CN108769814A (zh) * 2018-06-01 2018-11-06 腾讯科技(深圳)有限公司 视频互动方法、装置及可读介质
CN111435999A (zh) * 2019-01-12 2020-07-21 北京字节跳动网络技术有限公司 一种视频上展示信息的方法、装置、设备和存储介质
CN110109636A (zh) * 2019-04-28 2019-08-09 华为技术有限公司 投屏方法、电子设备以及系统
CN111309279A (zh) * 2020-05-06 2020-06-19 上海幻电信息科技有限公司 多屏互动显示方法及装置
CN113835649A (zh) * 2020-06-08 2021-12-24 华为技术有限公司 一种投屏方法和终端
CN111901674A (zh) * 2020-07-13 2020-11-06 腾讯科技(深圳)有限公司 一种视频播放控制及装置
CN112218103A (zh) * 2020-09-02 2021-01-12 北京达佳互联信息技术有限公司 直播间互动方法、装置、电子设备和存储介质
CN112732212A (zh) * 2020-12-31 2021-04-30 咪咕音乐有限公司 显示方法、电子设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4296844A4

Also Published As

Publication number Publication date
EP4296844A4 (en) 2024-07-31
US20240152310A1 (en) 2024-05-09
CN115145507A (zh) 2022-10-04
EP4296844A1 (en) 2023-12-27

Similar Documents

Publication Publication Date Title
WO2022193994A1 (zh) 基于多设备的在线互动方法、芯片、电子设备及存储介质
CN112866734B (zh) 一种自动展示手写输入功能的控制方法及显示设备
CN110874959B (zh) 一种多终端同屏教学系统及教学方法
US20240053879A1 (en) Object Drag Method and Device
US20210208831A1 (en) Electronic Device Operation Method and Electronic Device
CN109348160B (zh) 用于会议的电子工具和方法
US20150067536A1 (en) Gesture-based Content Sharing Between Devices
WO2017211020A1 (zh) 一种电视操控方法及装置
CN104182224A (zh) 一种无线ppt控制系统及其控制方法
TW201537979A (zh) 自動化相機選擇
TWI444044B (zh) 遠距應用中傳輸資料之裝置、方法與電腦程式產品
US20160094355A1 (en) Automatically transferring presentation control
KR102031739B1 (ko) 디스플레이 화면과 별도로 수업 진행모드에 따른 강의화면을 구성하여 실시간 인터넷 방송을 지원하는 인터랙티브 화이트보드
Saraubon Learning media repository and delivery system for smart classroom using IoT and mobile technologies
JP2021513768A (ja) ミーティングの参加者が機能デバイスを利用できるようにするための方法およびシステム
CN114071425B (zh) 电子设备间的协同方法、协同系统和电子设备
US20230275985A1 (en) Dual-Display Electronic Device Operation During Incoming Call
TW201541993A (zh) 互連視訊的播放
US11647060B1 (en) Use of audio and image data of video conference to dynamically generate interactive graphical elements
CN110768961A (zh) 用于计算和娱乐装置的移动播放接收器
CN108391152A (zh) 显示控制方法和显示控制装置
US11656834B2 (en) Information processing device, non-transitory recording medium, and information processing system
EP4345592A1 (en) Processing method, processing device, and readable storage medium
CN111309657B (zh) 电子设备及其控制方法、智能教室系统
CN209980227U (zh) 一种智能显示系统及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22770349

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18282038

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2022770349

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022770349

Country of ref document: EP

Effective date: 20230918

NENP Non-entry into the national phase

Ref country code: DE