WO2016173422A1 - 多屏互动方法及系统 - Google Patents

多屏互动方法及系统 Download PDF

Info

Publication number
WO2016173422A1
WO2016173422A1 PCT/CN2016/079589 CN2016079589W WO2016173422A1 WO 2016173422 A1 WO2016173422 A1 WO 2016173422A1 CN 2016079589 W CN2016079589 W CN 2016079589W WO 2016173422 A1 WO2016173422 A1 WO 2016173422A1
Authority
WO
WIPO (PCT)
Prior art keywords
window
sharing window
display
terminal
sharing
Prior art date
Application number
PCT/CN2016/079589
Other languages
English (en)
French (fr)
Inventor
李平
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2016173422A1 publication Critical patent/WO2016173422A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones

Definitions

  • This application relates to, but is not limited to, the field of terminal technology.
  • the user can make a one-to-one or one-to-many active projection by means of terminal projection.
  • the user first opens the projected content on the first terminal, and then connects to the other terminal through the specific device.
  • the terminal can automatically determine whether the content currently displayed by the first terminal meets the set condition. And if and only if the currently displayed content satisfies the set condition, the currently displayed content is displayed at the other terminal to which it is connected. In turn, intelligently realize the interaction of multiple screens.
  • This article provides a multi-screen interaction method that can solve the interaction information of multi-screen interaction.
  • User requirements are customized, the real-time nature of interactive information is poor, and there is a risk of privacy leakage when interacting.
  • a multi-screen interaction method includes: generating a sharing window in a first terminal according to a first control instruction of a user; and sending the sharing window and its content Display to the second terminal.
  • the method before the generating the sharing window, the method further includes: acquiring display cache information, and pre-processing the display cache information, where the pre-processing comprises decomposing the display cache information according to the data channel.
  • the method further includes: displaying, according to the second control instruction of the user, the pre-processed display cache information in the sharing window and changing the content displayed in the sharing window, where The change includes adding, deleting, and/or modifying the content of the sharing window.
  • the generating the sharing window includes splitting the first terminal, generating a fixed window and the sharing window, where the fixed window displays a current interface of the first terminal.
  • the second control instruction of the user further includes: switching the fixed window and the sharing window.
  • a multi-screen interactive system includes a first sharing window generating module and a first sending module, where:
  • a first sharing window generating module configured to: generate a sharing window
  • the first sending module is configured to: send the sharing window and its content to the second terminal for display.
  • the multi-screen interaction system further includes a first processing module, where the first processing module includes a first acquiring unit and a first decomposing unit, where the first acquiring unit is configured to: acquire a display cache of the first terminal Information, the first decomposition unit is configured to: decompose the display cache information according to a data channel.
  • the first processing module includes a first acquiring unit and a first decomposing unit, where the first acquiring unit is configured to: acquire a display cache of the first terminal Information, the first decomposition unit is configured to: decompose the display cache information according to a data channel.
  • the multi-screen interactive system further includes a second processing module, where the second processing module includes a first display unit and a first changing unit, where the first display unit is configured to: the displayed display after being decomposed Cache information is displayed in the sharing window, and the first changing unit is configured to: change content displayed in the sharing window, the change includes adding content of the sharing window Add, delete, and/or modify.
  • the second processing module includes a first display unit and a first changing unit
  • the first display unit is configured to: the displayed display after being decomposed Cache information is displayed in the sharing window
  • the first changing unit is configured to: change content displayed in the sharing window, the change includes adding content of the sharing window Add, delete, and/or modify.
  • the first sharing window generating module includes a first split screen unit, and the first split screen unit is configured to: split the first terminal, generate a fixed window, and share the window, The fixed window displays the current interface of the first terminal.
  • the second processing module further includes a first switching unit, where the first switching unit is configured to: switch the fixed window and the sharing window according to a control instruction of the user.
  • a multi-screen interaction method including:
  • the method before the sending the sharing window and the content thereof to the second terminal for display, the method further includes:
  • Adjust the resolution and image quality of the sharing window match the resolution of the second terminal and adjust the image quality.
  • the pre-processing comprises decomposing the display cache information according to a data channel, and decomposing into an audio data stream, a video data stream, and/or an image data stream.
  • the changing includes adding, deleting, and/or modifying the content of the sharing window.
  • the second control instruction of the user further includes: switching the fixed window and the sharing window.
  • a multi-screen interactive system includes: a third processing module, a second sharing window generating module, a fourth processing module, and a second sending module, wherein: the third processing Module. Set to: obtain display cache information, and preprocess the display cache information;
  • the second sharing window generating module is configured to: first, according to a first control instruction of the user The terminal performs a split screen to generate a fixed window and the sharing window, where the fixed window displays a current interface of the first terminal;
  • the fourth processing module is configured to display the pre-processed display cache information in the sharing window according to a second control instruction of the user, and change the content displayed in the sharing window;
  • the second sending module is configured to: send the sharing window and its content to the second terminal for display.
  • the multi-screen interactive system further includes an adjusting unit, where the adjusting unit is configured to: before the second sending module sends the sharing window and the content thereof to the second terminal for display, adjusting the sharing window Resolution and picture quality, matching the resolution of the second terminal and adjusting the picture quality.
  • the third processing module includes a second obtaining unit and a second decomposing unit, where the second acquiring unit is configured to: obtain display cache information of the first terminal, where the second decomposing unit is configured to: follow the data
  • the channel decomposes the display buffer information into audio data streams, video data streams, and/or image data streams.
  • the fourth processing module includes a second display unit and a second change unit, where the second display unit is configured to: display the decomposed display cache information in the sharing window, the second The change unit is configured to: change the content displayed in the sharing window, the change including adding, deleting, and/or modifying the content of the sharing window.
  • the fourth processing module further includes a second switching unit, where the second switching unit is configured to: switch the fixed window and the sharing window according to a control instruction of the user.
  • a computer readable storage medium storing computer executable instructions for performing the multi-screen interaction method described above is provided.
  • the multi-screen interaction method and system can improve the real-time of the interactive information by generating a sharing window and the content of the application therein can be changed; avoiding the transmission of the privacy content in the interaction , the security of the interaction is improved; in addition, by splitting the first terminal, the pre-processed display cache information is displayed in the sharing window, and the sharing window is displayed.
  • the content can be added, modified or deleted according to the user's change instruction, realizing the custom sending of the sharing window and its content; and the switching operation can be performed on the sharing window and the fixed window, so that the multi-screen interaction, the interactive screen Different content can be displayed separately, which increases the efficiency of multi-screen interaction.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal that implements an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1.
  • FIG. 3 is a flowchart of a multi-screen interaction method according to Embodiment 1 of the present invention.
  • FIG. 4 is a block diagram of a multi-screen interactive system according to Embodiment 2 of the present invention.
  • FIG. 5 is a flowchart of another multi-screen interaction method according to Embodiment 3 of the present invention.
  • FIG. 6 is a block diagram of another multi-screen interactive system according to Embodiment 4 of the present invention.
  • FIG. 7 is a block diagram of a first processing module in a multi-screen interactive system according to Embodiment 4 of the present invention.
  • FIG. 8 is a block diagram of a second shared window generating module in a multi-screen interactive system according to Embodiment 4 of the present invention.
  • FIG. 9 is a block diagram of a second processing module in a multi-screen interactive system according to Embodiment 4 of the present invention.
  • FIG. 11 is a user interaction diagram of a multi-screen interaction method according to Embodiment 6 of the present invention.
  • the mobile terminal can be implemented in a variety of forms.
  • the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like.
  • PDA Personal Digital Assistant
  • PAD Tablett
  • PMP Portable Multimedia Player
  • a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal that implements an embodiment of the present invention.
  • the mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more.
  • Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.
  • Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network.
  • the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
  • the broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel.
  • the broadcast channel can include a satellite channel and/or a terrestrial channel.
  • the broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal.
  • the broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like.
  • the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal.
  • the broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112.
  • the broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like.
  • the broadcast receiving module 111 can receive a signal broadcast by using a plurality of types of broadcast systems.
  • the broadcast receiving module 111 can use, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital view A digital broadcasting system such as a frequency broadcast-handheld (DVB-H), forward link media (MediaFLO) data broadcasting system, terrestrial digital broadcasting integrated service (ISDB-T), or the like receives digital broadcasting.
  • DMB-T multimedia broadcast-terrestrial
  • DMB-S digital multimedia broadcast-satellite
  • Digital broadcasting system such as a frequency broadcast-handheld (DVB-H), forward link media (MediaFLO) data broadcasting system, terrestrial digital broadcasting integrated service (ISDB-T),
  • the broadcast receiving module 111 can be constructed as a broadcast system suitable for providing a broadcast signal as well as the above-described digital broadcast system.
  • the broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).
  • the mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server.
  • a base station e.g., an access point, a Node B, etc.
  • Such radio signals may include voice call signals, video call signals, or multiple types of data transmitted and/or received in accordance with text and/or multimedia messages.
  • the wireless internet module 113 supports wireless internet access of the mobile terminal.
  • the module can be internally or externally coupled to the terminal.
  • the wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .
  • the short range communication module 114 is configured to support short range communication.
  • Some examples of short-range communication technologies include BluetoothTM, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), ZigbeeTM, and the like.
  • the location information module 115 is configured to check or obtain location information of the mobile terminal.
  • a typical example of a location information module is GPS (Global Positioning System).
  • GPS Global Positioning System
  • the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude.
  • the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite.
  • the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.
  • the A/V input unit 120 is arranged to receive an audio or video signal.
  • the A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode.
  • the processed image frame can be displayed on the display unit 151.
  • the image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal.
  • the microphone 122 can be in a phone call mode, Sound (audio data) is received via a microphone in a recording mode, a voice recognition mode, and the like, and such sound can be processed as audio data.
  • the processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode.
  • the microphone 122 may pass noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.
  • the user input unit 130 may generate key input data according to a command input by the user to control the operation of the mobile terminal.
  • the user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc.
  • a touch screen can be formed.
  • the sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal.
  • the sensing unit 140 can sense whether the slide type phone is turned on or off.
  • the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.
  • Sensing unit 140 may include proximity sensor 141 which will be described below in connection with a touch screen.
  • the interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100.
  • the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more.
  • the identification module may be stored to verify a variety of information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identification Module (USIM), and the like.
  • UIM User Identification Module
  • SIM Customer Identification Module
  • USB Universal Customer Identification Module
  • the device having the identification module may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device.
  • the interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.
  • the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a plurality of command signals allowed to be input from the base to be transmitted to the mobile The path to the terminal.
  • a variety of command signals or power input from the base can be used as a signal for identifying whether the mobile terminal is accurately mounted on the base.
  • Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner.
  • the output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
  • the display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.
  • UI user interface
  • GUI graphical user interface
  • the display unit 151 can function as an input device and an output device.
  • the display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • OLED organic light emitting diode
  • a flexible display a three-dimensional (3D) display, and the like.
  • 3D three-dimensional
  • Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like.
  • TOLED Transparent Organic Light Emitting Diode
  • the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) .
  • the touch screen can be set to detect touch input pressure as well as touch input position and touch input area.
  • the audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like.
  • the audio signal is output as sound.
  • the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100.
  • the audio output module 152 can include a speaker, a buzzer, and the like.
  • the alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of an event even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.
  • the memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 may store data regarding vibration and audio signals of various manners that are output when a touch is applied to the touch screen.
  • the memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like.
  • the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
  • the controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like.
  • the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180.
  • the controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
  • the power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate each component and component.
  • the embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof.
  • the embodiments described herein can be used Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Units (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), Processors, Controllers, Microcontrollers
  • ASICs Application Specific Integrated Circuits
  • DSPs Digital Signal Processors
  • DSPDs Digital Signal Processing Units
  • PLDs Programmable Logic Devices
  • FPGAs Field Programmable Gate Arrays
  • Processors Controllers
  • Microcontrollers The microprocessor, the at least one of the electronic units designed to perform the functions described herein, is implemented, and in some cases, such an embodiment may be implemented in the controller 180.
  • implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation.
  • the software code can be implemented by
  • the mobile terminal has been described in terms of its function.
  • a slide type mobile terminal among a plurality of types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the embodiment of the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
  • the mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system in which a mobile terminal is operable according to an embodiment of the present invention will now be described with reference to FIG.
  • Such communication systems may use different air interfaces and/or physical layers.
  • air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc.
  • FDMA Frequency Division Multiple Access
  • TDMA Time Division Multiple Access
  • CDMA Code Division Multiple Access
  • UMTS Universal Mobile Telecommunications System
  • LTE Long Term Evolution
  • GSM Global System for Mobile Communications
  • the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
  • a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280.
  • the MSC 280 is configured to interface with a public switched telephone network (PSTN) 290.
  • PSTN public switched telephone network
  • the MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line.
  • the backhaul line can be constructed in accordance with any of a number of known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 can include multiple BSCs 275.
  • Each BS 270 can serve one or more partitions (or regions), by a multi-directional antenna or pointing to a specific Each of the sections covered by the directional antenna is radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).
  • BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology.
  • BTS Base Transceiver Subsystem
  • the term "base station” can be used to generally refer to a single BSC 275 and at least one BS 270.
  • a base station can also be referred to as a "cell station.”
  • multiple partitions of a particular BS 270 may be referred to as multiple cellular stations.
  • a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system.
  • a broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295.
  • GPS Global Positioning System
  • the satellite 300 helps locate at least one of the plurality of mobile terminals 100.
  • a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites.
  • the GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.
  • the BS 270 receives a reverse link signal from the mobile terminal 100.
  • Mobile terminal 100 typically participates in calls, messaging, and other types of communications.
  • Each reverse link signal received by a particular base station 270 is processed within a particular BS 270.
  • the obtained data is forwarded to the relevant BSC 275.
  • the BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270.
  • the BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290.
  • PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.
  • FIG. 3 is a flowchart of a multi-screen interaction method according to Embodiment 1 of the present invention.
  • the main body of the multi-screen interaction method of the embodiment of the present invention comprises a first terminal and a second terminal
  • the first terminal can be a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer)
  • Mobile terminals such as PMPs (portable multimedia players), navigation devices, and the like, and fixed terminals such as digital TVs, desktop computers, and the like.
  • PMPs portable multimedia players
  • navigation devices and the like
  • fixed terminals such as digital TVs, desktop computers, and the like.
  • the following embodiments are exemplified by mobile terminals. However, those skilled in the art will appreciate that the configuration according to embodiments of the present invention can be applied to a fixed type of terminal, and the second terminal can be displayed for a display, a projector, etc., in addition to components specifically for mobile purposes. device.
  • the user finds the information that he wants to share, for example, the MMS message on the mobile phone, and presses the MMS for 3 seconds to display the function menu.
  • the function menu includes the sharing option, and the sharing option is the sharing command.
  • the mobile phone After receiving the sharing instruction of the user, the mobile phone generates a sharing window on the display screen of the mobile phone, and the content of the MMS message can be automatically placed in the sharing window through the program, or only the sharing window without content is generated, and the user's instruction is placed to place the MMS message. Share the window.
  • the content of the sharing window includes but is not limited to games, videos, pictures, web pages, and news. It can also be a combination of any two or more of games, videos, images, web pages and news.
  • the user can delete and add a cursor to the MMS in the sharing window.
  • the first terminal may compress the data information corresponding to the content in the sharing window and the sharing window that meets the user's requirements at the time, and send the data information to the second terminal through the communication connection.
  • the second terminal receives and displays.
  • the content of the MMS message on the mobile phone is placed in the sharing window and deleted by the user, and then the user sends a command to send the MMS content data of the deleted picture part, and then passes the MHL (Mobile High-Definition Link, The mobile terminal high-definition video and audio standard interface) is transmitted to the display terminal via MHL.
  • MHL Mobile High-Definition Link
  • the embodiment of the invention further provides a computer readable storage medium storing computer executable instructions for executing the multi-screen interaction method described above.
  • the multi-screen interaction method can operate the content of the application in the sharing window, and can display the customized interface; improve the real-time information of the multi-screen interaction; avoid the transmission of the privacy content in the interaction, improve The security of interaction.
  • FIG. 4 is a block diagram of a multi-screen interactive system according to Embodiment 2 of the present invention.
  • a first multi-screen interaction system S10 includes a first sharing window generating module S11 and a first sending module S12.
  • the first sharing window generating module S11 is configured to: generate a sharing window according to the user's generated sharing window instruction. After the user presses the selected MMS for 3 seconds, the function menu appears, and the user selects the option of multi-screen sharing again, the first sharing window generating module S11 generates a sharing window. It can be understood that the sharing window can also be generated by other customized triggering methods, for example, setting a multi-screen interactive icon on the display interface, and clicking the icon to generate a sharing window.
  • the first sending module S12 includes a transmitting end and a transmitting end, and the generated sharing window and its content are compressed, and after being compressed, are sent to the transmitting end connected thereto through the transmitting driver of the transmitting end.
  • the transmission end is an MHL interface.
  • the sharing window and the MMS data of the deleted part of the content are compressed, and then transmitted and displayed by the MHL transmission driver via the MHL transmission to the MHL receiving driver in the display.
  • the multi-screen interaction system S10 may further include a first processing module, where the first processing module includes a first obtaining unit and a first decomposing unit, and the first acquiring unit is configured to: obtain display cache information of the first terminal, The first decomposition unit is configured to: decompose the display cache information according to a data channel.
  • the first processing module includes a first obtaining unit and a first decomposing unit
  • the first acquiring unit is configured to: obtain display cache information of the first terminal
  • the first decomposition unit is configured to: decompose the display cache information according to a data channel.
  • the multi-screen interactive system S10 may further include a second processing module, where the second processing module includes a first display unit and a first change unit, the first display unit is configured to: display the decomposed display cache information in the sharing window, and the first changing unit is configured to: in the sharing window The displayed content is changed, the change including adding, deleting, and/or modifying the content of the sharing window.
  • the second processing module includes a first display unit and a first change unit
  • the first display unit is configured to: display the decomposed display cache information in the sharing window
  • the first changing unit is configured to: in the sharing window
  • the displayed content is changed, the change including adding, deleting, and/or modifying the content of the sharing window.
  • the second processing module may further include a first switching unit, the first switching unit configured to: switch the fixed window and the sharing window according to a control instruction of the user.
  • the first sharing window generating module may include a first split screen unit, and the first split screen unit is configured to: split the first terminal, generate a fixed window and the sharing window, and the fixed window displays The current interface of the first terminal.
  • the first multi-screen interaction system S10 generates a sharing window by the first sharing window generating module S11 by receiving an instruction for generating a sharing window sent by the user, so that the selected data to be shared can be displayed in the sharing window.
  • the data to be shared in the sharing window can be deleted and the like, and the real-time information of the multi-screen interaction is improved; the privacy-related content is prevented from being transmitted in the interaction, and the security during interaction is improved.
  • FIG. 5 is a flowchart of another multi-screen interaction method according to Embodiment 3 of the present invention.
  • Step S1001 Acquire display cache information, and preprocess the display cache information.
  • the multi-screen interactive system automatically obtains the display cache information corresponding to the MMS, and then decomposes the acquired display cache information according to the data channel, and decomposes it into an audio data stream.
  • the image data stream includes interface display information and the like.
  • a multi-screen sharing icon can also be set on the interface, and the user obtains the display cache information when the icon is clicked, and preprocesses the display cache information.
  • Step S1002 Perform splitting on the first terminal to generate a fixed window and the sharing window, where the fixed window displays a current interface of the first terminal.
  • the function menu when the user presses the selected MMS for 3 seconds, the function menu will appear on the interface.
  • the function menu can include options such as SMS sending, WeChat sharing, opening and split screen display.
  • the multi-screen interactive system splits the interface to generate a fixed window and a sharing window.
  • the fixed window displays the interface content of the original interface, and there is no content in the sharing window, that is, an empty window.
  • the interface of the first terminal can be split by setting a sharing icon on the interface and clicking the sharing icon.
  • a window floating above the original interface may also be generated, and the window may be dragged on the original interface.
  • Step S1003 Adjust the resolution and image quality of the sharing window, match the resolution of the second terminal, and adjust the image quality.
  • the method before the sharing window and the content thereof are sent to the second terminal for display, the method further includes: adjusting the resolution and the image quality of the sharing window.
  • a selection dialog box is popped up, and the content of the selection dialog is to ask whether to send the sharing window and its content, and if so, adjust the resolution and image quality of the sharing window, so that the sharing window is
  • the content resolution and image quality are improved to match the second terminal. For example, if the second terminal is a 4K display, the content of the sharing window can be adjusted to a resolution of 4K.
  • Step S1004 Display the pre-processed display cache information in the sharing window according to the second control instruction of the user, and change the content displayed in the sharing window.
  • the user can select the MMS to be shared in the fixed window, and after dragging the MMS to the sharing window after finding the MMS, the preprocessed MMS can be mapped to Share in the window and display.
  • the MMS to be shared may be long pressed in the fixed window for 3 seconds, and the option of sending to the sharing window may appear, and the option is pre-processed.
  • the subsequent MMS can be mapped to the sharing window and displayed.
  • the user can add, delete, and/or modify the MMS according to his or her own needs.
  • To delete the text portion of the MMS content in the sharing window That is, select the text portion and delete it.
  • the above operation on the MMS in the sharing window does not affect the contents of the fixed window.
  • the sharing window is a window floating on the interface
  • the way to add the MMS to the sharing window is consistent with the above. That is, you can drag and drop on the interface, or you can press and hold the selected MMS 3S to select the option to send the sharing window.
  • Step S1005 Send the sharing window and its content to the second terminal for display.
  • the user can determine to send the sharing window and its content to the second terminal for display.
  • the sharing window and its content are compressed and transmitted to the MHL dongle device via the MHL transmission driver, and then transmitted by the MHL dongle device to the MHL receiving driver of the display terminal and displayed on the display.
  • the first terminal can also transmit and display the sharing window and its content to the display terminal through wifi display.
  • the first terminal can also display the sharing window and its content through the projector.
  • the embodiment of the invention further provides a computer readable storage medium storing computer executable instructions for executing the multi-screen interaction method described above.
  • the user can delete, add, and modify the display cache information, and the content in the sharing window is the selected information in the mapping fixed window, and the corresponding sharing window.
  • the content displayed in the content can also be deleted, added, and modified, and has no effect on the content in the original interface; in this embodiment, the user can also switch between the fixed window and the sharing window to realize switching between windows and sharing on multiple screens.
  • step S1002 can also be replaced by generating a floating window on the interface of the first terminal, and the user can issue a control instruction to switch the interface between the floating window and the first terminal, thus making the user
  • the switch can be switched The interface of the terminal is switched to the floating window, so that the user can operate the interface of the first terminal through the first terminal and simultaneously display the sharing window and its content in the second terminal, thereby realizing multi-screen interaction without affecting the use of the first terminal;
  • the sharing window can transmit the resolution matching the second terminal through the MHLdongle device, thereby realizing high-resolution image transmission between multiple screens and improving the user experience.
  • the content of the sharing window in step S1004 can be deleted, added and modified, and does not affect the content of the fixed window, thereby improving the real-time of the interactive information; avoiding the transmission of the private content in the interaction Improve the security of interaction; replace the MHLdongle device with wifi display to improve the portability of the multi-screen interactive system; replace the display with a projector, realize customized multi-screen interaction without specific display device, and improve User experience.
  • FIG. 6 is a block diagram of another multi-screen interactive system according to Embodiment 4 of the present invention
  • FIG. 7 is a first processing of a multi-screen interactive system according to Embodiment 4 of the present invention
  • FIG. 8 is a block diagram of a second shared window generating module in a multi-screen interactive system according to Embodiment 4 of the present invention
  • FIG. 9 is a multi-screen interactive system according to Embodiment 4 of the present invention
  • the block diagram of the second processing module includes a third processing module S21, a second sharing window generating module S22, a fourth processing module S23, an adjusting unit S24, and a second sending module S25.
  • the second sharing window generating module S22 and the second sending module S25 are basically the same as the first sharing window generating module S11 and the first sending module S12, and the third processing module S21 and the fourth processing module S23 are the same.
  • a processing module and a second processing module are substantially identical.
  • the third processing module S21 is configured to: obtain display cache information, and perform pre-processing on the display cache information;
  • the second sharing window generating module S22 is configured to: split the first terminal according to the first control instruction of the user, generate a fixed window and the sharing window, and the fixed window displays a current interface of the first terminal ;
  • the fourth processing module S23 is configured to: display the pre-processed display cache information in the sharing window according to a second control instruction of the user, and change the content displayed in the sharing window;
  • the second sending module S25 is configured to: send the sharing window and its content to the second terminal for display.
  • the adjusting unit S24 is configured to: before the second sending module S25 sends the sharing window and its content to the second terminal for display, adjust the resolution and image quality of the sharing window, and match the resolution of the second terminal. And adjust the picture quality.
  • the third processing module S21 includes a second obtaining unit S211 and a second splitting unit S212
  • the second sharing window generating module S22 includes a second splitting unit S221
  • the fourth processing module S23 includes a second display unit S231 and a second change Unit S232.
  • the second obtaining unit S211 is configured to: obtain display cache information of the first terminal
  • the second decomposition unit S212 is configured to: decompose the display cache information according to the data channel, and may be decomposed into an audio data stream, a video data stream, and/or Image data stream.
  • the image data stream is an interface display or the like. For example, a user uses a mobile phone and wants to share a multimedia message with picture and text information.
  • the MMS 3S can be long pressed, and then the function option is popped up.
  • the second obtaining unit S211 obtains the display buffer information of the MMS
  • the second decomposing unit S212 decomposes the display buffer information into the audio data stream and the video. Data stream, image data stream. It can be understood that an icon can also be set on the interface of the first terminal, and clicking the icon can cause the second obtaining unit S211 to obtain display cache information of the selected multimedia message.
  • the second sharing window generating module S22 includes a second split screen unit S221, and the second split screen unit S221 is configured to: split the first terminal to generate a fixed window and a sharing window.
  • the mobile phone interface is split into a fixed window and a sharing window, wherein the current interface of the first terminal is displayed in the fixed window, and there is no content in the sharing window. It can be understood that it is also possible to generate a window floating on the mobile phone interface without performing a split screen.
  • the second display unit S231 is configured to display the decomposed display cache information in the sharing window, and the second changing unit S232 is configured to: change the content displayed in the sharing window, and the adding includes adding and deleting the content of the sharing window. , and / or modify.
  • the display cache information corresponding to the pre-processed MMS can be mapped into the sharing window for display, so that the display cache information in the sharing window and the pre-processing in the fixed window are performed.
  • the display cache information corresponding to the subsequent MMS is consistent.
  • the second changing unit S232 adds, deletes, and/or modifies the display cache information corresponding to the MMS, but The operation of sharing the MMS in the window will not It affects the content of the fixed window.
  • the fourth processing module S23 further includes a second switching unit S233.
  • the second switching unit S233 is configured to switch the fixed window and the sharing window according to a user's control instruction. It can be understood that when the split screen is not generated, but the floating sharing window is generated, the switching unit can also switch the mobile phone interface and the floating sharing window.
  • the fixed window and the sharing window can be switched by pressing the "HOME” button on the mobile phone.
  • the mobile interface and the floating sharing window are switched by the "HOME" button on the phone.
  • the multi-screen interactive system further includes an adjusting unit configured to: adjust the resolution and the image quality of the sharing window before transmitting the changed sharing window and the content thereof to the second terminal for display.
  • an adjusting unit configured to: adjust the resolution and the image quality of the sharing window before transmitting the changed sharing window and the content thereof to the second terminal for display.
  • a selection dialog box is popped up, and the content of the selection dialog is to ask whether to send the sharing window and its content, and if so, adjust the resolution and image quality of the sharing window, so that the sharing window is The content resolution and image quality are improved to match the second terminal. For example, if the second terminal is a 4K display, the content of the sharing window can be adjusted to a resolution of 4K.
  • the information to be shared is pre-processed by setting the second obtaining unit S211 and the second decomposing unit S212, and then the pre-processed information is mapped into the sharing window, so that the content of the sharing window can pass through the second changing unit S232.
  • Delete, add and modify, the MMS information in the sharing window can be changed and can be transmitted to the display through MHLgongle, so that the user can browse the webpage or the TV end through a fixed window, and simultaneously transfer the video to the display through the sharing window and play.
  • the method of multi-screen sharing is enriched, and the user experience is improved;
  • the split screen function of the second split screen unit S221 facilitates the user to drag the information to the sharing window, thereby improving the user experience;
  • the unit S233 enables the fourth processing module S22 to switch between the fixed window and the sharing window, and achieves the experience of not interfering with each screen during the multi-screen sharing process, thereby improving the user experience; and simultaneously changing the content of the sharing window. It can effectively protect the privacy of the interaction process.
  • FIG. 10 is a flowchart of still another multi-screen interaction method according to Embodiment 5 of the present invention.
  • step S401 the user selects an application opened in the first terminal.
  • the user can select the MMS to share on the mobile phone, and long press the MMS 3S, and select the multi-screen interaction in the selected selection menu.
  • the mobile phone preprocesses the selected MMS, and decomposes the MMS according to the data channel and decomposes it into an audio data stream, a video data stream, and an image data stream.
  • the image data stream includes interface display information and the like.
  • Step S402 performing a split screen display on the selected application, and generating a fixed window and a sharing window on the first terminal.
  • the fixed window displays the current interface of the first terminal.
  • the mobile phone can display the MMS selected by the user in a split screen, that is, display a fixed window and a sharing window on the mobile phone display interface.
  • the fixed window displays the current interface of the first terminal, and there is no content in the sharing window.
  • the sharing window can add MMS to the user's control command and change the content of the MMS.
  • Step S403 checking whether the first terminal and the second terminal are connected normally.
  • step S404 Check if the communication connection between the phone and the monitor is normal. If not, the process goes to step S404, and if it is normal, the process goes to step S406.
  • step S404 the connection is abnormal.
  • the mobile phone detects that there is an abnormality in communication with the display, it proceeds to step S405.
  • step S405 it is checked again, and if yes, the process goes to step S403.
  • a pop-up dialog box prompts whether to re-verify, so that the user can check whether the external connection is loose or the display is turned on, and after confirming that the above-mentioned common problem does not exist, click the confirmation button on the dialog box again. So that the phone can check again if the connection between the phone and the monitor is normal.
  • Step S406 whether to send the content of the application in the sharing window.
  • the mobile phone interface will display information and options prompting the user whether to send the sharing window.
  • the process goes to step S407.
  • Step S407 adjusting the resolution and image quality of the sharing window.
  • the rate and image quality adjust the MMS in the sharing window, so that the display resolution and image quality of the MMS match the display.
  • the mobile phone and the display are connected by the MHLdongle device, and thus the picture of 4K image quality can be output.
  • step S408 is the content of the sharing window changed?
  • a pop-up dialog box prompts the user to change the content of the MMS in the sharing window. If no, the process goes to step S409, and if yes, the process goes to step S410.
  • the display cache information corresponding to the MMS in the sharing window is the display cache information of the MMS mapped to the sharing window in the fixed window, and the display cache information can be added, deleted, and/or modified without affecting the content of the fixed window.
  • Step S409 the content of the sharing window that has not been changed is sent to the second terminal.
  • the content of the MMS in the shared window adjusted in step S407 is directly sent to the display through the MHLdongle device, so that the display displays the content of the MMS according to the adjusted resolution and image quality.
  • step S410 the user performs a change operation on the content of the sharing window.
  • the user can operate the content of the application.
  • the content of the application is a multimedia message with pictures and text, and the user can delete the picture and/or text, add text or modify the text. Change the content of the original MMS; also drag the picture in the fixed window to the sharing window, but the MMS content in the fixed window does not change.
  • the display cache data corresponding to the content of the modified MMS is also changed correspondingly.
  • Step S411 the content of the changed sharing window is sent to the second terminal.
  • the MMS content changed in step S410 is compressed and transmitted to the display via the MHLdongle device and displayed.
  • a process of detecting whether the first terminal and the second terminal are connected normally is added, and a process of re-detection is performed when the interface is abnormal, and the process of multi-screen interaction is optimized, and the problem is refined.
  • the node is convenient for quickly determining the problem and solving the problem, improving the user experience; adding a process of whether to send the content of the application in the sharing window and whether to change the content of the application in the sharing window, so that the user can select according to the actual situation, further Improved user experience Degree; increased the process of adjusting the resolution and image quality of the application in the sharing window, thereby increasing the support for high-resolution display output, further improving the user experience.
  • FIG. 11 is a user interaction diagram of a multi-screen interaction method according to Embodiment 6 of the present invention, which includes the following steps:
  • step S501 the user selects an application opened in the first terminal, and selects multi-screen interaction.
  • the user can select the MMS to share on the mobile phone, and long press the MMS 3S, and select the multi-screen interaction in the selected selection menu.
  • the mobile phone preprocesses the selected MMS, and decomposes the MMS according to the data channel and decomposes it into an audio data stream, a video data stream, and an image data stream.
  • the image data stream includes interface display information and the like.
  • Step S502 the first terminal generates a fixed window and a sharing window.
  • the fixed window displays the current interface of the first terminal.
  • the mobile phone can display the MMS selected by the user in a split screen, that is, display a fixed window and a sharing window on the mobile phone display interface.
  • the fixed window displays the current interface of the first terminal, and there is no content in the sharing window.
  • the sharing window can add MMS to the user's control command and change the content of the MMS.
  • step S503 the user performs a change operation on the content in the sharing window.
  • the change operation may include: adding, deleting, and/or modifying, and the like.
  • the content of the application is a multimedia message with pictures and texts, and the user can delete the picture and/or text, add text or modify the text, etc. to change the content of the original MMS message; and also drag the picture in the fixed window to the sharing window. Inside, but the content of the MMS in the fixed window does not change. You can also switch between the fixed window and the sharing window by pressing the "HOME" button on your phone.
  • Step S504 the first terminal sends the content of the changed sharing window to the second terminal.
  • Step S505 the second terminal displays the content of the sharing window sent by the first terminal.
  • the sharing window and its content are compressed and transmitted to the MHL dongle device via the MHL transmission driver, and then transmitted by the MHL donggle device to the MHL receiving driver of the display terminal and displayed on the display.
  • the first terminal may further adjust the resolution and image quality of the sharing window to match the resolution of the second terminal and adjust the image quality.
  • the real-time of the interactive information is improved; the privacy content is prevented from being transmitted in the interaction, and the security during the interaction is improved;
  • the user can also switch between the fixed window and the sharing window to realize the switching between the windows.
  • each screen does not interfere with each other, and the use efficiency of multi-screen interaction is increased.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better.
  • Implementation Based on such understanding, the technical solution of the present invention in essence or the contribution to the related art can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM).
  • the method includes a plurality of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present invention.
  • the multi-screen interaction method and system provided by the embodiments of the present invention generate a sharing window and
  • the content used can be changed to improve the real-time of the interactive information; avoid the privacy content involved in the interaction, improve the security of the interaction; in addition, by splitting the first terminal, the pre-processed display
  • the cache information is displayed in the sharing window, and the content displayed in the sharing window can be added, modified or deleted according to the user's change instruction, realizing the custom sending of the sharing window and its content; and the sharing window and the fixed window can be performed. Switching operations, when multi-screen interaction, interactive screens can display different content, which increases the efficiency of multi-screen interaction.

Abstract

本公布一种多屏互动方法及系统，其中，该多屏互动方法包括：根据用户的第一控制指令在第一终端生成分享窗口；将所述分享窗口及其内容发送到第二终端上进行显示。

Description

多屏互动方法及系统 技术领域
本申请涉及但不限于终端技术领域。
背景技术
随着社会的进步和科学技术的不断发展，越来越多的智能终端开始普及到用户家里，进而用户对智能终端之间多屏互动方面的需求越来越大。在早期，关于智能终端之间的多屏互动仅局限于通过HDMI(High Definition Multimedia Interface，高清晰度多媒体接口)高清线将手机中的画面显示在显示器上，如此并不能控制显示在显示器上的画面内容，隐私性差。
相关技术中，用户可以通过终端投影的方式，使得一对一或一对多的主动式投影。在这种方式中，用户将投影的内容在第一终端上先打开，然后通过特定设备连接到其他终端上，在这个过程中终端可以自动判断第一终端当前显示的内容是否满足设定的条件，并当且仅当当前显示的内容满足设定的条件时，将当前显示的内容在与之连接的其他终端显示。进而智能的实现了多屏的互动。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
在上述相关技术的多屏的互动中并不能实现定制化的多屏互动，即无法将第一终端显示的画面中任意选取部分信息并将且只将选取的部分信息传输至与之连接的其他终端上。例如，用户想将手机上的某个图片传输至与之连接的显示器上，但是该图片在彩信中且用户不想让人知道彩信中的文字内容。上述方案无法实现，不能满足人们对互动信息实时性的要求及对自身隐私的保护要求。
本文提供一种多屏互动方法，可以解决多屏互动时互动的信息不能根据 用户需求自定义，互动信息的实时性差且互动时具有隐私泄露风险的问题。
根据本发明实施例的一个方面，提供的一种多屏互动方法，所述多屏互动方法包括：根据用户的第一控制指令在第一终端生成分享窗口；将所述分享窗口及其内容发送到第二终端上进行显示。
可选的，在所述生成分享窗口之前还包括获取显示缓存信息，并对所述显示缓存信息进行预处理，所述预处理包括按照数据通道对所述显示缓存信息进行分解。
可选的，在所述生成分享窗口之后还包括根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
可选的，所述生成分享窗口包括对所述第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面。
可选的，所述用户的第二控制指令还包括：切换所述固定窗口和所述分享窗口。
根据本发明实施例的再一个方面，提供一种多屏互动系统，所述多屏互动系统包括第一分享窗口生成模块及第一发送模块，其中：
第一分享窗口生成模块，设置为：生成分享窗口；
第一发送模块，设置为：将所述分享窗口及其内容发送到第二终端上进行显示。
可选的，所述多屏互动系统还包括第一处理模块，所述第一处理模块包括第一获取单元和第一分解单元，所述第一获取单元设置为：获取第一终端的显示缓存信息，所述第一分解单元设置为：按照数据通道对所述显示缓存信息进行分解。
可选的，所述多屏互动系统还包括第二处理模块，所述第二处理模块包括第一显示单元和第一变更单元，所述第一显示单元设置为：将分解后的所述显示缓存信息在所述分享窗口显示，所述第一变更单元设置为：对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添 加、删除、和/或修改。
可选的，所述第一分享窗口生成模块包括第一分屏单元，所述第一分屏单元设置为：对所述第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面。
可选的，所述第二处理模块还包括第一切换单元，所述第一切换单元设置为：根据所述用户的控制指令切换所述固定窗口和所述分享窗口。
根据本发明实施例的另一个方面，提供一种多屏互动方法，包括：
获取显示缓存信息，并对所述显示缓存信息进行预处理；
根据用户的第一控制指令对第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面；
根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更；
将所述分享窗口及其内容发送至第二终端上进行显示。
可选的，所述将所述分享窗口及其内容发送至第二终端上进行显示之前，还包括：
调整分享窗口的分辨率及画质，匹配第二终端的分辨率及调节画质。
可选的，所述预处理包括按照数据通道对所述显示缓存信息进行分解，分解为音频数据流、视频数据流和/或图像数据流。
可选的，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
可选的，所述用户的第二控制指令还包括：切换所述固定窗口和所述分享窗口。
根据本发明实施例的另一个方面，提供一种多屏互动系统，包括：第三处理模块、第二分享窗口生成模块、第四处理模块、和第二发送模块，其中：所述第三处理模块。设置为：获取显示缓存信息，并对所述显示缓存信息进行预处理；
所述第二分享窗口生成模块，设置为：根据用户的第一控制指令对第一 终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面；
所述第四处理模块，设置为：根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更；
所述第二发送模块，设置为：将所述分享窗口及其内容发送至第二终端上进行显示。
可选的，所述多屏互动系统还包括调整单元，所述调整单元设置为：所述第二发送模块将所述分享窗口及其内容发送至第二终端上进行显示之前，调整分享窗口的分辨率及画质，匹配第二终端的分辨率及调节画质。
可选的，所述第三处理模块包括第二获取单元和第二分解单元，所述第二获取单元设置为：获取第一终端的显示缓存信息，所述第二分解单元设置为：按照数据通道对所述显示缓存信息进行分解，分解为音频数据流、视频数据流和/或图像数据流。
可选的，所述第四处理模块包括第二显示单元和第二变更单元，所述第二显示单元设置为：将分解后的所述显示缓存信息在所述分享窗口显示，所述第二变更单元设置为：对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
可选的，所述第四处理模块还包括第二切换单元，所述第二切换单元设置为：根据所述用户的控制指令切换所述固定窗口和所述分享窗口。
根据本发明实施例的另一个方面，提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述多屏互动方法。
与相关技术相比，本发明实施例提供的多屏互动方法及系统，通过生成分享窗口且其内应用的内容可进行变更，提高了互动信息的实时性；避免涉及隐私内容在互动中传出，提高了互动时的安全性；此外，通过对第一终端进行分屏，将预处理后的显示缓存信息在分享窗口中显示，且分享窗口显示 的内容可以依据用户的变更指令进行添加、修改或删除的操作，实现了分享窗口及其内容的自定义发送；且可以对分享窗口和固定窗口进行切换操作，使得多屏互动时，互动的屏幕可以分别显示不同的内容，进而增加了多屏互动时的使用效率。
在阅读并理解了附图和详细描述后，可以明白其他方面。
附图概述
图1为实现本发明实施例的移动终端的硬件结构示意图。
图2为如图1所示的移动终端的无线通信系统示意图。
图3为本发明实施例一提供的一种多屏互动方法的流程图。
图4为本发明实施例二提供的一种多屏互动系统的模块结构图。
图5为本发明实施例三提供的另一种多屏互动方法的流程图。
图6为本发明实施例四提供的另一种多屏互动系统的模块结构图。
图7为本发明实施例四提供的一种多屏互动系统中第一处理模块的模块结果图。
图8为本发明实施例四提供的一种多屏互动系统中第二分享窗口生成模块的模块结构图。
图9为本发明实施例四提供的一种多屏互动系统中第二处理模块的模块结构图。
图10为本发明实施例五提供的还一种多屏互动方法的流程图；
图11为本发明实施例六提供的一种多屏互动方法的用户交互图。
本发明的实施方式
现在将参考附图描述实现本发明实施例的移动终端。在后续的描述中，使用用于表示元件的诸如"模块"、"部件"或"单元"的后缀仅为了有利于本发明实施例的说明，其本身并没有特定的意义。因此，"模块"与"部件"可以混合地使用。
移动终端可以以多种形式来实施。例如，本发明实施例中描述的终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面，假设终端是移动终端。然而，本领域技术人员将理解的是，除了特别用于移动目的的元件之外，根据本发明的实施方式的构造也能够应用于固定类型的终端。
图1为实现本发明实施例的移动终端的硬件结构示意图。
移动终端100可以包括无线通信单元110、A/V(音频/视频)输入单元120、用户输入单元130、感测单元140、输出单元150、存储器160、接口单元170、控制器180和电源单元190等等。图1示出了具有多种组件的移动终端，但是应理解的是，并不要求实施所有示出的组件。可以替代地实施更多或更少的组件。将在下面详细描述移动终端的元件。
无线通信单元110通常包括一个或多个组件，其允许移动终端100与无线通信系统或网络之间的无线电通信。例如，无线通信单元可以包括广播接收模块111、移动通信模块112、无线互联网模块113、短程通信模块114和位置信息模块115中的至少一个。
广播接收模块111经由广播信道从外部广播管理服务器接收广播信号和/或广播相关信息。广播信道可以包括卫星信道和/或地面信道。广播管理服务器可以是生成并发送广播信号和/或广播相关信息的服务器或者接收之前生成的广播信号和/或广播相关信息并且将其发送给终端的服务器。广播信号可以包括TV广播信号、无线电广播信号、数据广播信号等等。而且，广播信号可以进一步包括与TV或无线电广播信号组合的广播信号。广播相关信息也可以经由移动通信网络提供，并且在该情况下，广播相关信息可以由移动通信模块112来接收。广播信号可以以多种形式存在，例如，其可以以数字多媒体广播(DMB)的电子节目指南(EPG)、数字视频广播手持(DVB-H)的电子服务指南(ESG)等等的形式而存在。广播接收模块111可以通过使用多种类型的广播系统接收信号广播。特别地，广播接收模块111可以通过使用诸如多媒体广播-地面(DMB-T)、数字多媒体广播-卫星(DMB-S)、数字视 频广播-手持(DVB-H)，前向链路媒体(MediaFLO)的数据广播系统、地面数字广播综合服务(ISDB-T)等等的数字广播系统接收数字广播。广播接收模块111可以被构造为适合提供广播信号的广播系统以及上述数字广播系统。经由广播接收模块111接收的广播信号和/或广播相关信息可以存储在存储器160(或者其它类型的存储介质)中。
移动通信模块112将无线电信号发送到基站(例如，接入点、节点B等等)、外部终端以及服务器中的至少一个和/或从其接收无线电信号。这样的无线电信号可以包括语音通话信号、视频通话信号、或者根据文本和/或多媒体消息发送和/或接收的多种类型的数据。
无线互联网模块113支持移动终端的无线互联网接入。该模块可以内部或外部地耦接到终端。该模块所涉及的无线互联网接入技术可以包括WLAN(无线LAN)(Wi-Fi)、Wibro(无线宽带)、Wimax(全球微波互联接入)、HSDPA(高速下行链路分组接入)等等。
短程通信模块114设置为支持短程通信。短程通信技术的一些示例包括蓝牙TM、射频识别(RFID)、红外数据协会(IrDA)、超宽带(UWB)、紫蜂TM等等。
位置信息模块115设置为检查或获取移动终端的位置信息。位置信息模块的典型示例是GPS(全球定位系统)。根据当前的技术，GPS模块115计算来自三个或更多卫星的距离信息和准确的时间信息并且对于计算的信息应用三角测量法，从而根据经度、纬度和高度准确地计算三维当前位置信息。当前，用于计算位置和时间信息的方法使用三颗卫星并且通过使用另外的一颗卫星校正计算出的位置和时间信息的误差。此外，GPS模块115能够通过实时地连续计算当前位置信息来计算速度信息。
A/V输入单元120设置为接收音频或视频信号。A/V输入单元120可以包括相机121和麦克风122，相机121对在视频捕获模式或图像捕获模式中由图像捕获装置获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元151上。经相机121处理后的图像帧可以存储在存储器160(或其它存储介质)中或者经由无线通信单元110进行发送，可以根据移动终端的构造提供两个或更多相机121。麦克风122可以在电话通话模式、 记录模式、语音识别模式等等运行模式中经由麦克风接收声音(音频数据)，并且能够将这样的声音处理为音频数据。处理后的音频(语音)数据可以在电话通话模式的情况下转换为可经由移动通信模块112发送到移动通信基站的格式输出。麦克风122可以通过噪声消除(或抑制)算法以消除(或抑制)在接收和发送音频信号的过程中产生的噪声或者干扰。
用户输入单元130可以根据用户输入的命令生成键输入数据以控制移动终端的操作。用户输入单元130允许用户输入多种类型的信息，并且可以包括键盘、锅仔片、触摸板(例如，检测由于被接触而导致的电阻、压力、电容等等的变化的触敏组件)、滚轮、摇杆等等。特别地，当触摸板以层的形式叠加在显示单元151上时，可以形成触摸屏。
感测单元140检测移动终端100的当前状态，(例如，移动终端100的打开或关闭状态)、移动终端100的位置、用户对于移动终端100的接触(即，触摸输入)的有无、移动终端100的取向、移动终端100的加速或减速移动和方向等等，并且生成用于控制移动终端100的操作的命令或信号。例如，当移动终端100实施为滑动型移动电话时，感测单元140可以感测该滑动型电话是打开还是关闭。另外，感测单元140能够检测电源单元190是否提供电力或者接口单元170是否与外部装置耦接。感测单元140可以包括接近传感器141将在下面结合触摸屏来对此进行描述。
接口单元170用作至少一个外部装置与移动终端100连接可以通过的接口。例如，外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。识别模块可以是存储用于验证用户使用移动终端100的多种信息并且可以包括用户识别模块(UIM)、客户识别模块(SIM)、通用客户识别模块(USIM)等等。另外，具有识别模块的装置(下面称为"识别装置")可以采取智能卡的形式，因此，识别装置可以经由端口或其它连接装置与移动终端100连接。接口单元170可以用于接收来自外部装置的输入(例如，数据信息、电力等等)并且将接收到的输入传输到移动终端100内的一个或多个元件或者可以用于在移动终端和外部装置之间传输数据。
另外，当移动终端100与外部底座连接时，接口单元170可以用作允许通过其将电力从底座提供到移动终端100的路径或者可以用作允许从底座输入的多种命令信号通过其传输到移动终端的路径。从底座输入的多种命令信号或电力可以用作用于识别移动终端是否准确地安装在底座上的信号。
输出单元150被构造为以视觉、音频和/或触觉方式提供输出信号(例如，音频信号、视频信号、警报信号、振动信号等等)。输出单元150可以包括显示单元151、音频输出模块152、警报单元153等等。
显示单元151可以显示在移动终端100中处理的信息。例如，当移动终端100处于电话通话模式时，显示单元151可以显示与通话或其它通信(例如，文本消息收发、多媒体文件下载等等)相关的用户界面(UI)或图形用户界面(GUI)。当移动终端100处于视频通话模式或者图像捕获模式时，显示单元151可以显示捕获的图像和/或接收的图像、示出视频或图像以及相关功能的UI或GUI等等。
同时，当显示单元151和触摸板以层的形式彼此叠加以形成触摸屏时，显示单元151可以用作输入装置和输出装置。显示单元151可以包括液晶显示器(LCD)、薄膜晶体管LCD(TFT-LCD)、有机发光二极管(OLED)显示器、柔性显示器、三维(3D)显示器等等中的至少一种。这些显示器中的一些可以被构造为透明状以允许用户从外部观看，这可以称为透明显示器，典型的透明显示器可以例如为TOLED(透明有机发光二极管)显示器等等。根据特定想要的实施方式，移动终端100可以包括两个或更多显示单元(或其它显示装置)，例如，移动终端可以包括外部显示单元(未示出)和内部显示单元(未示出)。触摸屏可设置为检测触摸输入压力以及触摸输入位置和触摸输入面积。
音频输出模块152可以在移动终端处于呼叫信号接收模式、通话模式、记录模式、语音识别模式、广播接收模式等等模式下时，将无线通信单元110接收的或者在存储器160中存储的音频数据转换音频信号并且输出为声音。而且，音频输出模块152可以提供与移动终端100执行的特定功能相关的音频输出(例如，呼叫信号接收声音、消息接收声音等等)。音频输出模块152可以包括扬声器、蜂鸣器等等。
警报单元153可以提供输出以将事件的发生通知给移动终端100。典型的事件可以包括呼叫接收、消息接收、键信号输入、触摸输入等等。除了音频或视频输出之外，警报单元153可以以不同的方式提供输出以通知事件的发生。例如，警报单元153可以以振动的形式提供输出，当接收到呼叫、消息或一些其它进入通信(incomingcommunication)时，警报单元153可以提供触觉输出(即，振动)以将其通知给用户。通过提供这样的触觉输出，即使在用户的移动电话处于用户的口袋中时，用户也能够识别出事件的发生。警报单元153也可以经由显示单元151或音频输出模块152提供通知事件的发生的输出。
存储器160可以存储由控制器180执行的处理和控制操作的软件程序等等，或者可以暂时地存储己经输出或将要输出的数据(例如，电话簿、消息、静态图像、视频等等)。而且，存储器160可以存储关于当触摸施加到触摸屏时输出的多种方式的振动和音频信号的数据。
存储器160可以包括至少一种类型的存储介质，所述存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如，SD或DX存储器等等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等等。而且，移动终端100可以与通过网络连接执行存储器160的存储功能的网络存储装置协作。
控制器180通常控制移动终端的总体操作。例如，控制器180执行与语音通话、数据通信、视频通话等等相关的控制和处理。另外，控制器180可以包括用于再现(或回放)多媒体数据的多媒体模块181，多媒体模块181可以构造在控制器180内，或者可以构造为与控制器180分离。控制器180可以执行模式识别处理，以将在触摸屏上执行的手写输入或者图片绘制输入识别为字符或图像。
电源单元190在控制器180的控制下接收外部电力或内部电力并且提供操作每个元件和组件所需的适当的电力。
这里描述的实施方式可以以使用例如计算机软件、硬件或其任何组合的计算机可读介质来实施。对于硬件实施，这里描述的实施方式可以通过使用 特定用途集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理装置(DSPD)、可编程逻辑装置(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、被设计为执行这里描述的功能的电子单元中的至少一种来实施，在一些情况下，这样的实施方式可以在控制器180中实施。对于软件实施，诸如过程或功能的实施方式可以与允许执行至少一种功能或操作的单独的软件模块来实施。软件代码可以由以任何适当的编程语言编写的软件应用程序(或程序)来实施，软件代码可以存储在存储器160中并且由控制器180执行。
至此，己经按照其功能描述了移动终端。下面，为了简要起见，将描述诸如折叠型、直板型、摆动型、滑动型移动终端等等的多种类型的移动终端中的滑动型移动终端作为示例。因此，本发明实施例能够应用于任何类型的移动终端，并且不限于滑动型移动终端。
如图1中所示的移动终端100可以被构造为利用经由帧或分组发送数据的诸如有线和无线通信系统以及基于卫星的通信系统来操作。
现在将参考图2描述其中根据本发明实施例的移动终端能够操作的通信系统。
这样的通信系统可以使用不同的空中接口和/或物理层。例如，由通信系统使用的空中接口包括例如频分多址(FDMA)、时分多址(TDMA)、码分多址(CDMA)和通用移动通信系统(UMTS)(特别地，长期演进(LTE))、全球移动通信系统(GSM)等等。作为非限制性示例，下面的描述涉及CDMA通信系统，但是这样的教导同样适用于其它类型的系统。
参考图2，CDMA无线通信系统可以包括多个移动终端100、多个基站(BS)270、基站控制器(BSC)275和移动交换中心(MSC)280。MSC280被构造为与公共电话交换网络(PSTN)290形成接口。MSC280还被构造为与可以经由回程线路耦接到基站270的BSC275形成接口。回程线路可以根据多个己知的接口中的任一种来构造，所述接口包括例如E1/T1、ATM，IP、PPP、帧中继、HDSL、ADSL或xDSL。将理解的是，如图2中所示的系统可以包括多个BSC275。
每个BS270可以服务一个或多个分区(或区域)，由多向天线或指向特定 方向的天线覆盖的每个分区放射状地远离BS270。或者，每个分区可以由用于分集接收的两个或更多天线覆盖。每个BS270可以被构造为支持多个频率分配，并且每个频率分配具有特定频谱(例如，1.25MHz,5MHz等等)。
分区与频率分配的交叉可以被称为CDMA信道。BS270也可以被称为基站收发器子系统(BTS)或者其它等效术语。在这样的情况下，术语"基站"可以用于笼统地表示单个BSC275和至少一个BS270。基站也可以被称为"蜂窝站"。或者，特定BS270的多个分区可以被称为多个蜂窝站。
如图2中所示，广播发射器(BT)295将广播信号发送给在系统内操作的移动终端100。如图1中所示的广播接收模块111被设置在移动终端100处以接收由BT295发送的广播信号。在图2中，示出了几个全球定位系统(GPS)卫星300。卫星300帮助定位多个移动终端100中的至少一个。
在图2中，描绘了多个卫星300，但是理解的是，可以利用任何数目的卫星获得有用的定位信息。如图1中所示的GPS模块115通常被构造为与卫星300配合以获得想要的定位信息。替代GPS跟踪技术或者在GPS跟踪技术之外，可以使用可以跟踪移动终端的位置的其它技术。另外，至少一个GPS卫星300可以选择性地或者额外地处理卫星DMB传输。
作为无线通信系统的一个典型操作，BS270接收来自移动终端100的反向链路信号。移动终端100通常参与通话、消息收发和其它类型的通信。特定基站270接收的每个反向链路信号被在特定BS270内进行处理。获得的数据被转发给相关的BSC275。BSC提供通话资源分配和包括BS270之间的软切换过程的协调的移动管理功能。BSC275还将接收到的数据路由到MSC280，其提供用于与PSTN290形成接口的额外的路由服务。类似地，PSTN290与MSC280形成接口，MSC与BSC275形成接口，并且BSC275相应地控制BS270以将正向链路信号发送到移动终端100。
基于上述移动终端硬件结构以及通信系统，提出本发明实施例方法实施例。
以下结合附图和实施例，对本发明的实施方式进行说明。
实施例一
如图3所示，图3为本发明实施例一提供的一种多屏互动方法的流程图，本实施例提供的一种多屏互动方法，包括：
S101、根据用户的第一控制指令在第一终端生成分享窗口。
执行本发明实施例多屏互动方法的主体包括第一终端和第二终端，第一终端可以为移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面实施例以移动终端进行举例。然而，本领域技术人员将理解的是，除了特别用于移动目的的元件之外，根据本发明的实施方式的构造也能够应用于固定类型的终端，第二终端可以为显示器、投影仪等显示设备。
举例来说，用户找到想要分享的信息，例如为手机上的彩信，长按彩信3秒钟出现功能菜单，该功能菜单包括分享选项，选择分享选项即为发出分享指令。手机接收到用户的分享指令后，在手机的显示屏上生成分享窗口，彩信的内容可以通过程序自动放置于分享窗口内，也可以只生成没有内容的分享窗口，等待用户的指令将彩信放置于分享窗口内。
可以理解的是，本实施例中，还可以通过其他常规自定义的用于生成分享窗口的触发条件。
S102、将所述分享窗口及其内容发送到第二终端上进行显示。
其中分享窗口的内容包括但不限于游戏、视频、图片、网页和新闻等。也可以为游戏、视频、图片、网页和新闻中任意两项以上的结合。
通过步骤S101后，选中的彩信显示在分享窗口内后，用户可以对分享窗口内的彩信进行删除和增添光标等操作。并在分享窗口内的内容符合发送要求后发出发送指令，第一终端可以将符合用户当时要求的分享窗口及分享窗口内的内容对应的数据信息进行压缩并通过通讯连接发送至第二终端上，第二终端接收并进行显示。例如，手机上的彩信内容被放入分享窗口并被用户将其中的图片部分删除，然后用户发出发送的指令，被删除图片部分的彩信内容数据被压缩，然后通过MHL(Mobile High-Definition Link，移动终端高清影音标准接口)驱动经MHL传输至显示器端。
如此，在实际应用中，当用户需要临时进行讲解，发现手机上需要分享的PPT有几处明显的错误或者可以改进的地方，可以在分享时进行实时的删除，提高了用户的体验度。
本发明实施例还提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述多屏互动方法。
本实施例中，多屏互动方法能对分享窗口内应用的内容进行操作，进而可以显示定制化的界面；提高了多屏互动时信息的实时性；避免涉及隐私内容在互动中传出，提高了互动时的安全性。
实施例二
如图4所示，图4为本发明实施例二提供的一种多屏互动系统的模块结构图。
本发明实施例提供的一种第一多屏互动系统S10包括第一分享窗口生成模块S11及第一发送模块S12。
其中，第一分享窗口生成模块S11设置为：根据用户的生成分享窗口指令生成分享窗口。当用户长按选定的彩信3秒后，出现功能菜单，用户再次选择了多屏分享的选项，则第一分享窗口生成模块S11生成分享窗口。可以理解的是，还可以通过其他自定义的触发方式生成分享窗口，例如，在显示界面设置多屏互动的图标，点击图标即可生成分享窗口。
第一发送模块S12包括发射端和传输端，生成的分享窗口及其内容经过压缩，并在压缩后通过发射端的发送驱动将其发送至与之连接的传输端。在本实施例中，传输端为MHL接口。将分享窗口及其中删除部分内容的彩信数据进行压缩，然后通过MHL发送驱动经MHL传输至显示器内的MHL接收驱动并显示。
所述多屏互动系统S10还可包括第一处理模块，所述第一处理模块包括第一获取单元和第一分解单元，所述第一获取单元设置为：获取第一终端的显示缓存信息，所述第一分解单元设置为：按照数据通道对所述显示缓存信息进行分解。
所述多屏互动系统S10还可包括第二处理模块，所述第二处理模块包括 第一显示单元和第一变更单元，所述第一显示单元设置为：将分解后的所述显示缓存信息在所述分享窗口显示，所述第一变更单元设置为：对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
所述第二处理模块还可包括第一切换单元，所述第一切换单元设置为：根据所述用户的控制指令切换所述固定窗口和所述分享窗口。
所述第一分享窗口生成模块可包括第一分屏单元，所述第一分屏单元设置为：对所述第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面。
本实施例中，第一多屏互动系统S10通过接收用户发出的生成分享窗口的指令由第一分享窗口生成模块S11生成分享窗口，进而可以将选定的待分享数据信息在分享窗口内显示并可以对分享窗口内的待分享数据信息进行删除等处理，提高了多屏互动时信息的实时性；避免涉及隐私内容在互动中传出，提高了互动时的安全性。
实施例三
再看图5，图5为本发明实施例三提供的另一种多屏互动方法的流程图。
本发明实施例提供的一种多屏互动方法，包括：
步骤S1001：获取显示缓存信息，并对所述显示缓存信息进行预处理。
举例来说，当用户长按选定的彩信3秒后，多屏互动系统自动获取该彩信对应的显示缓存信息，然后对获取的显示缓存信息按照数据通道进行分解，并分解为音频数据流、视频数据流和/或图像数据流。在本实施例中，图像数据流包括界面显示信息等。
可以理解的是，也可以在界面上设置多屏分享图标，用户点击图标时获取显示缓存信息，并对显示缓存信息进行预处理。
步骤S1002：对所述第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面。
举例来说，当用户长按选定的彩信3秒后，界面会出现功能菜单，该功能菜单可以包括短信发送、微信分享、打开及分屏显示等选项。当用户选择分屏显示的选项后，多屏互动系统对界面进行分屏，生成固定窗口和分享窗口。在本实施例中，固定窗口显示原界面的界面内容，分享窗口内无任何内容，即为空窗口。
可以理解的是，还可以通过在界面上设置分享图标，点击该分享图标即可对第一终端的界面进行分屏。
可以理解的是，在一些实施例中，当用户选择分屏显示的选项或者点击分享图标之后，还可以生成一个浮动在原界面之上的窗口，该窗口可以在原界面上进行拖动。
步骤S1003：调整分享窗口的分辨率及画质，匹配第二终端的分辨率及调节画质。
在本实施例中，将分享窗口及其内容发送到第二终端上进行显示之前还包括：调整分享窗口的分辨率及画质。
当第一终端的界面分屏完成后，会弹出选择对话框，该选择对话框的内容是询问是否发送分享窗口及其内容，若是则调整分享窗口的分辨率及画质，使得分享窗口内的内容分辨率及画质提高至与第二终端相匹配，例如第二终端为4K显示器，则可以将分享窗口的内容调整至4K的分辨率。
步骤S1004：根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更。
当匹配第二终端的分辨率及调节画质之后，用户可以在固定窗口内选择需要分享的彩信，在找到该彩信后将该彩信拖拉至分享窗口，即可将经过预处理后的彩信映射至分享窗口内并显示。
可以理解的是，在一些情况下，在第一终端进行分屏之后，也可以在固定窗口中长按待分享的彩信3秒，即可出现发送至分享窗口的选项，选择该选项后预处理后的彩信即可映射至分享窗口内并显示。
在分享窗口内显示待分享的彩信之后，用户可以根据自己的需求对彩信进行添加、删除、和/或修改的操作。当用户只想发送彩信中的图片时，可 以在分享窗口中对其中彩信内容中的文字部分进行删除操作。即选定文字部分，然后删除。也可以将其他文件或图片库中的图片添加进分享窗口的彩信中，例如，选定图片库中的图片，然后将其拖拉至分享窗口中，然后再在分享窗口中对该图片进行位置编辑。另外，还可以对添加进分享窗口中的图片进行文字说明，也可以对原彩信中的文字进行修改。但上述对分享窗口中彩信的操作不会影响固定窗口中的内容。
可以理解的是，若分享窗口为浮动在界面上的窗口时，将彩信添加进分享窗口的方式与上述一致。即可以通过在界面上进行拖拉动作，也可以长按选定的彩信3S，在选择发送分享窗口的选项。
步骤S1005：将所述分享窗口及其内容发送至第二终端上进行显示。
对分享窗口内的内容按照步骤S1004进行变更后，用户可以确定将分享窗口及其内容发送至第二终端上进行显示。在本实施例中，分享窗口及其内容在压缩后经MHL发送驱动传至MHL dongle(软件保护器)设备，再由MHL dongle设备传至显示器端的MHL接收驱动中并在显示器上显示。
可以理解的是，第一终端还可以通过wifi display(无线视频显示)将分享窗口及其内容传输至显示器端并进行显示。
可以理解的是，第一终端还可以通过投影仪将分享窗口及其内容显示出来。
本发明实施例还提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述多屏互动方法。
在本实施例中，通过获取显示缓存信息并对其进行预处理，使得用户可以对显示缓存信息进行删除、添加及修改，分享窗口中内容为映射固定窗口中选定的信息，对应的分享窗口内显示的内容也可以进行删除、添加及修改，且对原界面中的内容没有影响；在本实施例中用户还可以切换固定窗口和分享窗口，实现了视窗之间的切换，在多屏分享的同时，每个屏幕互不干扰；可以理解的是，步骤S1002还可以替换为在第一终端的界面上生成浮动窗口，用户可以发出控制指令切换浮动窗口和第一终端的界面，如此使得用户在将分享窗口及其内容发送至第二终端进行显示的同时可以通过切换将第 一终端的界面切换至浮动窗口之上，进而用户可以通过第一终端操作第一终端的界面同时在第二终端显示分享窗口及其内容，实现多屏互动的同时不影响第一终端的使用；通过匹配第二终端的分辨率及调节画质，使得分享窗口可以通过MHLdongle设备发送与第二终端匹配的分辨率，进而实现了多屏之间的高分辨率画面传输，提升了用户的体验度；通过步骤S1001和步骤S1002，使得步骤S1004中分享窗口的内容可以进行删除、添加及修改，且不会影响固定窗口的内容，提高了互动信息的实时性；避免涉及隐私内容在互动中传出，提高了互动时的安全性；通过wifi display替代MHLdongle设备，提升多屏互动系统的便携性；通过投影仪替代显示器，实现了无需特定的显示设备即可实现定制化的多屏互动，提高了用户体验度。
实施例四
如图6至9所示，图6为本发明实施例四提供的另一种多屏互动系统的模块结构图；图7为本发明实施例四提供的一种多屏互动系统中第一处理模块的模块结果图；图8为本发明实施例四提供的一种多屏互动系统中第二分享窗口生成模块的模块结构图；图9为本发明实施例四提供的一种多屏互动系统中第二处理模块的模块结构图。本发明实施例提供的一种第二多屏互动系统S20包括第三处理模块S21、第二分享窗口生成模块S22、第四处理模块S23、调整单元S24及第二发送模块S25。相对于实施例二，第二分享窗口生成模块S22和第二发送模块S25同第一分享窗口生成模块S11及第一发送模块S12功能基本一致，第三处理模块S21和第四处理模块S23同第一处理模块和第二处理模块基本一致。
其中，所述第三处理模块S21，设置为：获取显示缓存信息，并对所述显示缓存信息进行预处理；
所述第二分享窗口生成模块S22，设置为：根据用户的第一控制指令对第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面；
所述第四处理模块S23，设置为：根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更；
所述第二发送模块S25，设置为：将所述分享窗口及其内容发送至第二终端上进行显示。
所述调整单元S24设置为：所述第二发送模块S25将所述分享窗口及其内容发送至第二终端上进行显示之前，调整分享窗口的分辨率及画质，匹配第二终端的分辨率及调节画质。
且其中第三处理模块S21包括第二获取单元S211和第二分解单元S212，第二分享窗口生成模块S22包括第二分屏单元S221，第四处理模块S23包括第二显示单元S231和第二变更单元S232。其中，第二获取单元S211设置为：获取第一终端的显示缓存信息，第二分解单元S212设置为：按照数据通道对显示缓存信息进行分解，可以分解为音频数据流，视频数据流和/或图像数据流。其中，图像数据流为界面显示等。例如，用户使用手机，想分享其中具有图片和文字信息的彩信。进而可以长按彩信3S，之后弹出功能选项，用户选择其中的多屏互动选项后，第二获取单元S211获取彩信的显示缓存信息，第二分解单元S212将显示缓存信息分解为音频数据流，视频数据流，图像数据流。可以理解的是，还可以在第一终端的界面上设置图标，点击该图标即可令第二获取单元S211获取被选中的彩信的显示缓存信息。第二分享窗口生成模块S22包括第二分屏单元S221，第二分屏单元S221设置为：对第一终端进行分屏，生成固定窗口和分享窗口。例如，彩信被分解单元S212处理之后，手机界面被分屏为固定窗口和分享窗口，其中在固定窗口显示第一终端的当前界面，分享窗口内无内容。可以理解的是，还可以不进行分屏，而是生成浮动在手机界面的窗口。第二显示单元S231设置为：将分解后的显示缓存信息在分享窗口中显示，第二变更单元S232设置为：对分享窗口内显示的内容进行变更，变更包括对分享窗口的内容进行添加、删除、和/或修改。例如，经过用户将彩信从固定窗口拖拉至分享窗口中，即可将预处理后的彩信对应的显示缓存信息映射至分享窗口内进行显示，使得分享窗口内的显示缓存信息与固定窗口中预处理后的彩信对应的显示缓存信息一致。当用户对分享窗口内的彩信进行添加、删除、和/或修改彩信的内容的操作时，第二变更单元S232对彩信对应的显示缓存信息进行相应的添加、删除、和/或修改，但是对分享窗口内的彩信进行的操作不会 对固定窗口的内容造成影响。
在本实施例中，第四处理模块S23还包括第二切换单元S233。第二切换单元S233设置为：根据用户的控制指令切换固定窗口和分享窗口。可以理解的是，当不进行分屏，而是生成浮动的分享窗口时，切换单元也可以切换手机界面和浮动的分享窗口。
在本实施例中，可以通过按手机上的“HOME”键，对固定窗口和分享窗口进行切换。在一些实施例中，通过手机上的“HOME”键切换手机界面和浮动的分享窗口。
在本实施例中，多屏互动系统还包括调整单元，设置为：在将变更后分享窗口及其内容发送到第二终端上进行显示之前调整分享窗口的分辨率及画质。当第一终端的界面分屏完成后，会弹出选择对话框，该选择对话框的内容是询问是否发送分享窗口及其内容，若是则调整分享窗口的分辨率及画质，使得分享窗口内的内容分辨率及画质提高至与第二终端相匹配，例如第二终端为4K显示器，则可以将分享窗口的内容调整至4K的分辨率。
本实施例通过设置第二获取单元S211和第二分解单元S212，对待分享的信息进行预处理，然后将预处理后的信息映射至分享窗口中，使得分享窗口的内容可以通过第二变更单元S232进行删除、添加及修改，分享窗口内彩信信息可以进行变更且可以通过MHLgongle传输至显示器端，进而使得用户可以一边通过固定窗口浏览网页或电视端等，同时通过分享窗口向显示器端传输视屏并播放，丰富了多屏分享的方式，提升了用户的体验度；通过第二分屏单元S221的分屏功能，方便了用户将信息拖拉至分享窗口的动作，提高了用户体验度；通过第二切换单元S233使得第四处理模块S22可以对固定窗口和分享窗口进行切换，达到了多屏分享的过程中，每个屏互不干扰的体验效果，提高了用户体验度；同时变更分享窗口的内容也可以有效的保护互动过程中的隐私。
实施例五
如图10所示，图10为本发明实施例五提供的还一种多屏互动方法的流程图。
本发明实施例提供的一种多屏互动方法，包括以下步骤：
步骤S401，用户选定第一终端中开启的应用。
举例来说，用户可以在手机上选定需要分享的彩信，并长按该彩信3S，并在探出的选择菜单中选择多屏互动。此时，手机对选定的彩信进行预处理，将彩信按照数据通道进行分解并分解为音频数据流、视频数据流及图像数据流。在本实施例中，图像数据流包括界面显示信息等。
步骤S402，对选定的应用进行分屏显示，并在第一终端上生成一个固定窗口和一个分享窗口。其中固定窗口显示第一终端的当前界面。
手机可以对用户选定的彩信进行分屏显示，即在手机显示界面显示一个固定窗口和一个分享窗口。其中固定窗口显示第一终端的当前界面，分享窗口内无内容。分享窗口可以根据用户的控制指令将彩信添加进来并对彩信的内容进行变更。
步骤S403，检查第一终端和第二终端是否连接正常。
检测手机与显示器的通讯连接是否正常。若不正常，则转至步骤S404，若正常，则转至步骤S406。
步骤S404，提示连接异常。手机检测其与显示器通讯连接有异常则转至步骤S405。
步骤S405，是否重新检验，若是则转至步骤S403。
若手机的检测结果为异常，则弹出对话框提示是否重新检验，以便用户检查外部连接是否松动或者显示器是否处于开机状态等，并在确认上述常见问题点不存在后再次点击对话框上的确认键，以便手机再次检查手机与显示器之间是否连接正常。
步骤S406，是否发送分享窗口中应用的内容。
若检测的结果为手机与显示器连接正常，则手机界面会出现提示用户是否发送分享窗口的信息和选项。当用户选择是时，转至步骤S407。
步骤S407，调整分享窗口的分辨率和画质。
在确认发送分享窗口内的彩信后，根据与手机通讯连接的显示器的分辨 率和画质对分享窗口内的彩信进行调整，使得彩信的显示分辨率和画质与显示器相匹配。在本实施例中，手机与显示器通过MHLdongle装置连接，进而可以输出4K画质的画面。
步骤S408，是否变更分享窗口的内容？
当分享窗口内的彩信的显示分辨率和画质均调整好后，弹出对话框提示用户是否变更分享窗口内彩信的内容。若否，则转至步骤S409，若是则转至步骤S410。分享窗口内的彩信对应的显示缓存信息为固定窗口内彩信映射至分享窗口的显示缓存信息，该显示缓存信息可以进行添加、删除、和/或修改，而不会影响固定窗口的内容。
步骤S409，将未做更改的分享窗口的内容发送至第二终端。
直接将步骤S407中调整好的分享窗口中彩信的内容通过MHLdongle装置发送至显示器，使得显示器根据调整后的分辨率和画质显示彩信的内容。
步骤S410，用户对分享窗口的内容进行变更操作。
用户确认变更分享窗口内的内容时，用户可以对应用的内容进行操作，例如，该应用的内容为具有图片和文字的彩信，用户可以删除其中的图片和/或文字、增加文字或修改文字等改变原彩信的内容；同时也可以将固定窗口内的图片拖至分享窗口内，但固定窗口内的彩信内容不改变。此时，修改后的彩信的内容对应的显示缓存数据也对应的改变。
步骤S411，将更改后的分享窗口的内容发送至第二终端。
将经步骤S410中变更后的彩信内容压缩并经MHLdongle装置发送至显示器并显示。
需要说明的是，上述实施例三的技术特征，在本实施例中同样对应适用，这里不再重述。
本实施例中，相对于实施例三，增加了检测第一终端和第二终端是否连接正常的过程并在不正常时具有重新检测的流程，优化了多屏互动的过程，细化了问题的节点，便于快速确定问题并解决问题，提高了用户体验度；增加了对是否发送分享窗口内应用的内容和是否变更分享窗口内应用的内容的过程，使得用户可以根据实际情况进行选择，进一步的提升了用户的体验 度；增加了对分享窗口内应用的分辨率和画质进行调整的过程，进而增加了对高分辨率显示输出的支持，进一步提高用户的体验度。
实施例六
如图11所示，图11为本发明实施例六提供的多屏互动方法的用户交互图，包括以下步骤：
步骤S501，用户选定第一终端中开启的应用，选择多屏互动。
举例来说，用户可以在手机上选定需要分享的彩信，并长按该彩信3S，并在探出的选择菜单中选择多屏互动。此时，手机对选定的彩信进行预处理，将彩信按照数据通道进行分解并分解为音频数据流、视频数据流及图像数据流。在本实施例中，图像数据流包括界面显示信息等。
步骤S502，第一终端生成固定窗口和分享窗口。其中固定窗口显示第一终端的当前界面。
手机可以对用户选定的彩信进行分屏显示，即在手机显示界面显示一个固定窗口和一个分享窗口。其中固定窗口显示第一终端的当前界面，分享窗口内无内容。分享窗口可以根据用户的控制指令将彩信添加进来并对彩信的内容进行变更。
步骤S503，用户对分享窗口中的内容进行变更操作。该变更操作可包括：添加、删除、和/或修改等。
例如，该应用的内容为具有图片和文字的彩信，用户可以删除其中的图片和/或文字、增加文字或修改文字等改变原彩信的内容；同时也可以将固定窗口内的图片拖至分享窗口内，但固定窗口内的彩信内容不改变。还可以通过按手机上的“HOME”键，对固定窗口和分享窗口进行切换。
步骤S504，第一终端将更改后的分享窗口的内容发送至第二终端。
步骤S505，第二终端显示第一终端发送的分享窗口的内容。
在本实施例中，分享窗口及其内容在压缩后经MHL发送驱动传至MHL dongle设备，再由MHL dongle设备传至显示器端的MHL接收驱动中并在显示器上显示。
另外，在步骤S504之前，第一终端还可以调整分享窗口的分辨率及画质，以匹配第二终端的分辨率及调节画质。
在本实施例中，通过生成分享窗口且其内应用的内容可进行变更，提高了互动信息的实时性；避免涉及隐私内容在互动中传出，提高了互动时的安全性；在本实施例中用户还可以切换固定窗口和分享窗口，实现了视窗之间的切换，在多屏分享的同时，每个屏幕互不干扰，增加了多屏互动时的使用效率。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括多个指令用以使得一台终端设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明实施例所述的方法。
以上仅为本发明的可选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。
工业实用性
本发明实施例提供的多屏互动方法及系统，通过生成分享窗口且其内应 用的内容可进行变更，提高了互动信息的实时性；避免涉及隐私内容在互动中传出，提高了互动时的安全性；此外，通过对第一终端进行分屏，将预处理后的显示缓存信息在分享窗口中显示，且分享窗口显示的内容可以依据用户的变更指令进行添加、修改或删除的操作，实现了分享窗口及其内容的自定义发送；且可以对分享窗口和固定窗口进行切换操作，使得多屏互动时，互动的屏幕可以分别显示不同的内容，进而增加了多屏互动时的使用效率。

Claims (20)

  1. 一种多屏互动方法，包括：
    根据用户的第一控制指令在第一终端生成分享窗口；
    将所述分享窗口及其内容发送到第二终端上进行显示。
  2. 根据权利要求1所述的多屏互动方法，其中，在所述生成分享窗口之前还包括获取显示缓存信息，并对所述显示缓存信息进行预处理，所述预处理包括按照数据通道对所述显示缓存信息进行分解。
  3. 根据权利要求2所述的多屏互动方法，其中，在所述生成分享窗口之后还包括根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
  4. 根据权利要求3所述的多屏互动方法，其中，所述生成分享窗口包括对所述第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面。
  5. 根据权利要求4所述的多屏互动方法，其中，所述用户的第二控制指令还包括：切换所述固定窗口和所述分享窗口。
  6. 一种多屏互动系统，包括：第一分享窗口生成模块及第一发送模块，其中：
    第一分享窗口生成模块，设置为：生成分享窗口；
    第一发送模块，设置为：将所述分享窗口及其内容发送到第二终端上进行显示。
  7. 如权利要求6所述的多屏互动系统，所述多屏互动系统还包括第一处理模块，所述第一处理模块包括第一获取单元和第一分解单元，所述第一获取单元设置为：获取第一终端的显示缓存信息，所述第一分解单元设置为：按照数据通道对所述显示缓存信息进行分解。
  8. 如权利要求7所述的多屏互动系统，所述多屏互动系统还包括第二处理模块，所述第二处理模块包括第一显示单元和第一变更单元，所述第一显 示单元设置为：将分解后的所述显示缓存信息在所述分享窗口显示，所述第一变更单元设置为：对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
  9. 如权利要求8所述的多屏互动系统，其中，所述第一分享窗口生成模块包括第一分屏单元，所述第一分屏单元设置为：对所述第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面。
  10. 根据权利要求9所述的多屏互动系统，其中，所述第二处理模块还包括第一切换单元，所述第一切换单元设置为：根据所述用户的控制指令切换所述固定窗口和所述分享窗口。
  11. 一种多屏互动方法，包括：
    获取显示缓存信息，并对所述显示缓存信息进行预处理；
    根据用户的第一控制指令对第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面；
    根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更；
    将所述分享窗口及其内容发送至第二终端上进行显示。
  12. 如权利要求11所述的多屏互动方法，其中，所述将所述分享窗口及其内容发送至第二终端上进行显示之前，还包括：
    调整分享窗口的分辨率及画质，匹配第二终端的分辨率及调节画质。
  13. 如权利要求11所述的多屏互动方法，其中，
    所述预处理包括按照数据通道对所述显示缓存信息进行分解，分解为音频数据流、视频数据流和/或图像数据流。
  14. 如权利要求11所述的多屏互动方法，其中，
    所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
  15. 如权利要求14所述的多屏互动方法，其中，所述用户的第二控制指令还包括：切换所述固定窗口和所述分享窗口。
  16. 一种多屏互动系统，包括：第三处理模块、第二分享窗口生成模块、第四处理模块、和第二发送模块，其中：所述第三处理模块，设置为：获取显示缓存信息，并对所述显示缓存信息进行预处理；
    所述第二分享窗口生成模块，设置为：根据用户的第一控制指令对第一终端进行分屏，生成固定窗口和所述分享窗口，所述固定窗口显示所述第一终端的当前界面；
    所述第四处理模块，设置为：根据用户的第二控制指令将预处理后的所述显示缓存信息在所述分享窗口显示并对所述分享窗口内显示的内容进行变更；
    所述第二发送模块，设置为：将所述分享窗口及其内容发送至第二终端上进行显示。
  17. 如权利要求16所述的多屏互动系统，所述多屏互动系统还包括调整单元，所述调整单元设置为：所述第二发送模块将所述分享窗口及其内容发送至第二终端上进行显示之前，调整分享窗口的分辨率及画质，匹配第二终端的分辨率及调节画质。
  18. 如权利要求16所述的多屏互动系统，其中，
    所述第三处理模块包括第二获取单元和第二分解单元，所述第二获取单元设置为：获取第一终端的显示缓存信息，所述第二分解单元设置为：按照数据通道对所述显示缓存信息进行分解，分解为音频数据流、视频数据流和/或图像数据流。
  19. 如权利要求16所述的多屏互动系统，其中，
    所述第四处理模块包括第二显示单元和第二变更单元，所述第二显示单元设置为：将分解后的所述显示缓存信息在所述分享窗口显示，所述第二变更单元设置为：对所述分享窗口内显示的内容进行变更，所述变更包括对所述分享窗口的内容进行添加、删除、和/或修改。
  20. 如权利要求19所述的多屏互动系统，其中，
    所述第四处理模块还包括第二切换单元，所述第二切换单元设置为：根据所述用户的控制指令切换所述固定窗口和所述分享窗口。
PCT/CN2016/079589 2015-04-29 2016-04-18 多屏互动方法及系统 WO2016173422A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510209422.4A CN104902075B (zh) 2015-04-29 2015-04-29 多屏互动方法及系统
CN201510209422.4 2015-04-29

Publications (1)

Publication Number Publication Date
WO2016173422A1 true WO2016173422A1 (zh) 2016-11-03

Family

ID=54034466

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/079589 WO2016173422A1 (zh) 2015-04-29 2016-04-18 多屏互动方法及系统

Country Status (2)

Country Link
CN (1) CN104902075B (zh)
WO (1) WO2016173422A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110730102A (zh) * 2019-10-23 2020-01-24 腾讯科技（深圳）有限公司 一种网络加速方法及装置、存储介质
CN111263218A (zh) * 2020-02-24 2020-06-09 卓望数码技术（深圳）有限公司 一种实现多设备同步交互的方法及系统
CN111381993A (zh) * 2020-03-12 2020-07-07 北京字节跳动网络技术有限公司 数据包的处理方法、装置以及电子设备
CN112882634A (zh) * 2021-02-10 2021-06-01 维沃移动通信有限公司 控件参数的调整方法及装置
CN113891146A (zh) * 2021-09-23 2022-01-04 中汽创智科技有限公司 一种多屏互动系统、方法、驾驶设备及存储介质
CN114185503A (zh) * 2020-08-24 2022-03-15 荣耀终端有限公司 多屏交互的系统、方法、装置和介质

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104902075B (zh) * 2015-04-29 2017-02-22 努比亚技术有限公司 多屏互动方法及系统
CN106933523A (zh) * 2015-12-30 2017-07-07 阿里巴巴集团控股有限公司 一种多屏互动方法及装置
CN105681166B (zh) * 2016-01-27 2019-01-18 网易传媒科技（北京）有限公司 一种信息分享方法和装置
CN107277598A (zh) * 2016-04-07 2017-10-20 北京文香信息技术有限公司 针对教学的视频直播点播系统
CN105892976B (zh) * 2016-04-29 2019-02-01 广州视睿电子科技有限公司 实现多屏互动的方法及装置
CN105892977A (zh) * 2016-05-30 2016-08-24 乐视控股（北京）有限公司 一种多屏系统交互方法、装置及智能电视
CN107479798A (zh) * 2016-06-08 2017-12-15 中兴通讯股份有限公司 多屏互动方法及装置
CN106293711B (zh) * 2016-07-29 2019-10-22 宇龙计算机通信科技(深圳)有限公司 一种推送消息的显示方法、装置及终端
CN107801064B (zh) * 2016-09-05 2020-08-18 中国移动通信集团公司 一种多屏互动系统的自修复的方法及装置
CN106528021A (zh) * 2016-10-27 2017-03-22 三星电子（中国）研发中心 屏幕内容共享方法及装置
CN113157368B (zh) 2017-06-16 2023-04-28 华为技术有限公司 一种屏幕锁定方法及装置
CN109491558A (zh) * 2017-09-11 2019-03-19 上海博泰悦臻网络技术服务有限公司 车载系统的屏间应用交互方法及装置、存储介质和车机
CN112130794B8 (zh) * 2018-02-05 2022-12-30 陕西精诚展览装饰有限公司 多屏幕拼接标牌的数据交互方法
CN110879683A (zh) * 2018-09-05 2020-03-13 上海博泰悦臻网络技术服务有限公司 屏幕信息共享的方法、终端及车辆
WO2020206654A1 (zh) * 2019-04-11 2020-10-15 深圳市柔宇科技有限公司 交互方法、柔性电子装置及可读存储介质
CN110995923B (zh) * 2019-11-22 2021-08-20 维沃移动通信（杭州）有限公司 一种投屏控制方法及电子设备
CN111198668B (zh) * 2019-12-26 2023-06-16 成都中科合迅科技有限公司 一种基于浏览器的多屏系统和多屏交互方法
CN111367486B (zh) * 2020-05-26 2020-09-08 北京小米移动软件有限公司 一种来电隐私保护方法及系统
CN112511601B (zh) * 2020-11-16 2021-12-07 北京仁光科技有限公司 多屏幕数据交互系统和多屏幕数据交互方法
CN113179383B (zh) * 2021-03-03 2024-01-26 深圳市玄关健康医疗互联网有限公司 一种企业办公远程会议系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101232680A (zh) * 2008-02-20 2008-07-30 宇龙计算机通信科技(深圳)有限公司 一种移动终端发送信息的方法及移动终端
US20110202854A1 (en) * 2010-02-17 2011-08-18 International Business Machines Corporation Metadata Capture for Screen Sharing
CN103677727A (zh) * 2013-12-05 2014-03-26 深圳市中兴移动通信有限公司 移动终端和音频控制方法
CN104217028A (zh) * 2014-09-26 2014-12-17 广州创维平面显示科技有限公司 网络内容分发方法和装置
CN104238986A (zh) * 2014-09-26 2014-12-24 深圳市中兴移动通信有限公司 传屏显示方法和装置
CN104902075A (zh) * 2015-04-29 2015-09-09 努比亚技术有限公司 多屏互动方法及系统

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101163118B (zh) * 2007-11-30 2011-04-20 腾讯科技（深圳）有限公司 一种多个im用户实时共享对象的方法和装置
US8436887B2 (en) * 2009-11-13 2013-05-07 Samsung Electronics Co., Ltd. Mobile terminal, display apparatus and control method thereof
CN103248947A (zh) * 2012-02-08 2013-08-14 海尔集团公司 一种视频多屏共享方法及实现该方法的系统
CN102857885A (zh) * 2012-08-17 2013-01-02 东莞宇龙通信科技有限公司 分享信息的方法及其通信终端
CN103369048B (zh) * 2013-07-19 2016-08-17 广州市幸福网络技术有限公司 基于拖拽操作的内容分享方法及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101232680A (zh) * 2008-02-20 2008-07-30 宇龙计算机通信科技(深圳)有限公司 一种移动终端发送信息的方法及移动终端
US20110202854A1 (en) * 2010-02-17 2011-08-18 International Business Machines Corporation Metadata Capture for Screen Sharing
CN103677727A (zh) * 2013-12-05 2014-03-26 深圳市中兴移动通信有限公司 移动终端和音频控制方法
CN104217028A (zh) * 2014-09-26 2014-12-17 广州创维平面显示科技有限公司 网络内容分发方法和装置
CN104238986A (zh) * 2014-09-26 2014-12-24 深圳市中兴移动通信有限公司 传屏显示方法和装置
CN104902075A (zh) * 2015-04-29 2015-09-09 努比亚技术有限公司 多屏互动方法及系统

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110730102A (zh) * 2019-10-23 2020-01-24 腾讯科技（深圳）有限公司 一种网络加速方法及装置、存储介质
CN110730102B (zh) * 2019-10-23 2022-09-20 腾讯科技（深圳）有限公司 一种网络加速方法及装置、存储介质
CN111263218A (zh) * 2020-02-24 2020-06-09 卓望数码技术（深圳）有限公司 一种实现多设备同步交互的方法及系统
CN111381993A (zh) * 2020-03-12 2020-07-07 北京字节跳动网络技术有限公司 数据包的处理方法、装置以及电子设备
CN114185503A (zh) * 2020-08-24 2022-03-15 荣耀终端有限公司 多屏交互的系统、方法、装置和介质
CN114185503B (zh) * 2020-08-24 2023-09-08 荣耀终端有限公司 多屏交互的系统、方法、装置和介质
CN112882634A (zh) * 2021-02-10 2021-06-01 维沃移动通信有限公司 控件参数的调整方法及装置
CN113891146A (zh) * 2021-09-23 2022-01-04 中汽创智科技有限公司 一种多屏互动系统、方法、驾驶设备及存储介质
CN113891146B (zh) * 2021-09-23 2023-08-22 中汽创智科技有限公司 一种多屏互动系统、方法、驾驶设备及存储介质

Also Published As

Publication number Publication date
CN104902075A (zh) 2015-09-09
CN104902075B (zh) 2017-02-22

Similar Documents

Publication Publication Date Title
WO2016173422A1 (zh) 多屏互动方法及系统
WO2017071424A1 (zh) 一种移动终端和分享文件的方法
WO2017008592A1 (zh) 实现终端设备控制的方法、智能设备及系统
WO2016029766A1 (zh) 移动终端及其操作方法和计算机存储介质
WO2016173468A1 (zh) 组合操作方法和装置、触摸屏操作方法及电子设备
WO2017143855A1 (zh) 具有截屏功能的装置和截屏方法
WO2016173467A1 (zh) 虚拟卡信息的处理方法及系统
WO2017071599A1 (zh) 一种分屏大小实时调整方法、分屏装置及计算机存储介质
WO2016155431A1 (zh) 终端及其触控操作方法和装置、存储介质
WO2017032217A1 (zh) 多点触控装置及方法
WO2016161986A1 (zh) 操作识别方法、装置、移动终端及计算机存储介质
WO2016155509A1 (zh) 移动终端的握持方式判断方法及装置
WO2017008722A1 (zh) 一种基于内外网分离的通信方法、服务器及系统
CN106201395A (zh) 一种显示方法及移动终端
CN105933452B (zh) 一种信息推送、显示方法和装置
WO2017148211A1 (zh) 移动终端及网页截图方法
CN106789589B (zh) 一种分享处理方法、装置及终端
AU2018414730B2 (en) Application window display method and terminal
CN106453939B (zh) 一种流媒体接入方法及装置
WO2017012385A1 (zh) 快速启动应用的方法、装置和终端
WO2017128912A1 (zh) 移动终端及其触控操作方法
WO2017128898A1 (zh) 移动终端及移动终端的触控操作方法
WO2017020828A1 (zh) 移动终端及其操控方法
WO2016155425A1 (zh) 数据发送操作撤销方法、装置及计算机存储介质
CN105227771B (zh) 图片传输方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16785853

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 26.04.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16785853

Country of ref document: EP

Kind code of ref document: A1