WO2016070305A1 - 分享屏幕的方法、分享设备及接收设备 - Google Patents

分享屏幕的方法、分享设备及接收设备 Download PDF

Info

Publication number
WO2016070305A1
WO2016070305A1 PCT/CN2014/090155 CN2014090155W WO2016070305A1 WO 2016070305 A1 WO2016070305 A1 WO 2016070305A1 CN 2014090155 W CN2014090155 W CN 2014090155W WO 2016070305 A1 WO2016070305 A1 WO 2016070305A1
Authority
WO
WIPO (PCT)
Prior art keywords
image data
area
display object
user interface
sharing
Prior art date
Application number
PCT/CN2014/090155
Other languages
English (en)
French (fr)
Inventor
李小仙
丁志明
刘铸
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2014/090155 priority Critical patent/WO2016070305A1/zh
Priority to CN201480073784.9A priority patent/CN106416170A/zh
Priority to US15/518,667 priority patent/US20170257403A1/en
Priority to EP14905383.7A priority patent/EP3190763B1/en
Publication of WO2016070305A1 publication Critical patent/WO2016070305A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G06F3/1462—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay with means for detecting differences between the image stored in the host and the images displayed on the remote displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload

Definitions

  • the present invention relates to the field of intelligent terminals, and in particular, to a method for sharing a screen, a sharing device, and a receiving device.
  • the screen sharing of a wireless device also referred to as screen mirroring, refers to an electronic device transmitting image data of its screen to the screen of the remaining electronic device connected thereto after establishing wireless connection between two or more electronic devices. So that the remaining devices connected to the communication can also perform image display according to the image data sent by the device in real time, wherein the device sharing the image data of the own screen is called a sharing device, receives the image data and performs the image data according to the received image data.
  • the device shown is called the receiving device.
  • Wi-Fi Alliance Wi-Fi Display protocol
  • Miracast Wi-Fi Display protocol
  • the sharing device encodes the screen image data in the video memory into a video stream in real time, and then sends the data to the receiving device. After receiving the video stream, the receiving device generates a receiving image according to the video stream, and performs on the screen. Display, so that the receiving device and the sharing device can present the same picture.
  • the receiving device can also control the sharing device.
  • the touch event is converted into a control command and transmitted back to the sharing device.
  • the sharing device responds to the control command and projects the screen to the receiving device in real time, so that the user of the receiving device can see the execution of the touch event, for example, the data of the application can be seen.
  • the inventor has studied the prior art and found that the screen sharing is performed by using the prior art, and the sharing device needs to send the original image data corresponding to the user interface of the application menu to the receiving device, so that the user interface of the application menu is completely displayed in each On a receiving device, and the user can operate the sharing device through any one of the receiving devices, the screen sharing mode is relatively simple.
  • the embodiment of the invention provides a method for sharing a screen, a sharing device and a receiving device, so that the sharing of the user interface of the application menu is more flexible and diverse.
  • an embodiment of the present invention provides a method for sharing a screen, which is used for sharing a screen between a sharing device and a receiving device, where the method includes:
  • the method further includes: determining, according to a preset area or a setting operation of the user, a secret area in the user interface, where the secret area is a part of the user interface; the determining is shareable
  • the image data includes: determining image data corresponding to the non-secure area as the shareable image data, and the non-secure area is an area other than the secret area in the user interface.
  • the method further includes: determining, according to a preset area or a setting operation of the user, a non-secure area in the user interface, where the non-secure area is a part of the user interface; the determining The shareable image data includes: determining image data corresponding to the non-secure area as the shareable image data.
  • the user interface includes at least two display objects.
  • the determining, before the image data can be shared further includes: determining a secret display object in the user interface according to a preset display object or a setting operation of the user, the secret display object Displaying an object for a part of the at least two display objects; determining the shareable image data includes: determining image data corresponding to the non-secure display object as the shareable image data, the non-secure display object being at least two A display object other than the secret display object in the display object.
  • the user interface includes at least two display objects.
  • the determining, before the image data can be shared further includes: determining a non-secure display object in the user interface according to a preset display object or a setting operation of the user, where the non-secure display object is The display object is a part of the at least two display objects; the determining the shareable image data comprises: determining that the image data corresponding to the non-secure display object is the shareable image data.
  • the method further includes at least one of: receiving a trigger instruction input by the user, the triggering instruction is used to trigger execution of the determining shareable image data; determining that user input is not received within a predetermined time period An operation instruction; determining that the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • the method further includes: receiving the setting operation of the user; determining the privacy zone of the user interface according to the setting operation of the user, including: operating by using the setting a rectangular area that is diagonally connected between the operation start point and the operation end point as the secret area; or a closed area formed by the trajectory of the setting operation is used as the secret area; or, the setting is displayed The area of the corresponding operation object is operated as the secret area.
  • the method further includes: receiving the setting operation of the user; determining the secret display object in the user interface, comprising: between an operation start point and an operation end point to be operated by the setting a display object in a rectangular area connected by a diagonal line as the security display object; or a display object in a closed area formed by the trajectory of the setting operation as the secret display object; or, An operation object corresponding to the setting operation is displayed as the secret display object.
  • the method further includes: acquiring a control instruction sent by the receiving device by using the connection; determining an operation area corresponding to the control instruction; if the operation area is The security zone has a coincidence that does not respond to the control command; and if the operation zone does not coincide with the privacy zone, responds to the control command.
  • the method further includes: acquiring a control instruction sent by the receiving device by using the connection; determining a display object corresponding to the control instruction; if the control instruction is corresponding to The display object includes the secret display object, and does not respond to the control instruction; and if the display object corresponding to the control instruction does not include the secret display object, responding to the control instruction.
  • the embodiment of the present invention provides a method for sharing a screen, which is used to receive control of a sharing device by a device, where the method includes:
  • the receiving device displays a user interface of the application menu according to the all image data; acquires a control instruction sent by the receiving device through the connection; and responds to the control instruction when the control instruction satisfies a predetermined confidential condition.
  • the satisfying the predetermined security condition includes: determining a secret area in the user interface according to a preset operation of a preset area or a user, where the secret area is a part of the user interface, and the operation corresponding to the control instruction The area and the security area are not coincident, wherein the security area is a part of the user interface; or the display object corresponding to the control instruction does not include a security display object, wherein the security display object is the sharing device A portion of at least two display objects in the user interface of the application menu display objects.
  • the method also includes not responding to the control command when the control command does not satisfy the predetermined privacy condition.
  • an embodiment of the present invention provides a method for sharing a screen, which is used to receive control of a sharing device by a device, where the method includes:
  • Establishing a connection for sharing a screen with the sharing device receiving image data sent by the sharing device, the image data corresponding to part or all of a user interface of an application menu displayed by the sharing device; displaying the image data Corresponding user interface; receiving an operation instruction input by the user; generating a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition; and transmitting a control instruction to the sharing device, so that the receiving device responds The control command.
  • the image data corresponds to the user interface of the application menu displayed by the sharing device; the control instruction satisfies the predetermined security condition, and the operation area corresponding to the operation instruction is in the non-secure area, wherein the non-secure a part of the user interface of the application menu displayed by the sharing device; or
  • the operation object of the operation instruction is a non-secure display object, wherein the non-secure display object is a part of the at least two display objects included in the user interface of the application menu displayed by the sharing device.
  • the image data corresponds to a part of the user interface of the application menu displayed by the sharing device, and a part of the user interface of the application menu displayed by the sharing device is a shareable interface; and the control instruction satisfies a predetermined confidentiality condition, including: The operation area corresponding to the operation instruction is in the shareable interface, or the operation object of the operation instruction is a display object in the shareable interface.
  • the method also includes ignoring the operational command when the operational command does not satisfy the predetermined privacy condition, and/or prompting the operational command to be erroneous.
  • an embodiment of the present invention provides a sharing device, configured to share a screen with a receiving device, where the sharing device includes:
  • a display unit configured to display a user interface of the application menu
  • a connection unit configured to establish a connection with the receiving device for sharing a screen
  • a generating unit configured to determine shareable image data, the shareable image data
  • a sending unit configured to send, by the connection, the shareable image data to the receiving device, so that the receiving device displays according to the shareable image data.
  • a determining unit configured to determine a secret area in the user interface according to a preset area or a setting operation of the user, where the secret area is a part of the user interface; and the generating unit is specifically configured to determine a non-secure area Corresponding image data is the shareable image data, and the non-secure area is an area of the user interface other than the secret area.
  • a determining unit configured to determine, according to a preset area or a setting operation of the user, a non-secure area in the user interface, where the non-secure area is a part of the user interface; and the generating unit is specifically configured to determine a non-secure area
  • the image data corresponding to the secret area is the shareable image data.
  • the user interface includes at least two display objects.
  • the device further includes: a determining unit, configured to determine a secure display object in the user interface according to a preset display object or a setting operation of the user, where the secret display object is And displaying, by the generating unit, the image data corresponding to the non-secure display object is the shareable image data, and the non-secure display object is at least two display objects.
  • the user interface includes at least two display objects.
  • the device further includes: a determining unit, configured to determine, according to a preset display object or a setting operation of the user, a non-secure display object in the user interface, the non-secure display The object is a part of the at least two display objects, and the generating unit is configured to determine that the image data corresponding to the non-secure display object is the shareable image data.
  • the generating unit is configured to determine shareable image data when a predetermined trigger condition is met, where the predetermined trigger condition includes: receiving a trigger instruction input by a user, where the trigger instruction is used to trigger execution of the determining shareable image data Or, determining that an operation instruction input by the user is not received within a predetermined period of time; or determining that the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • a receiving unit configured to receive the setting operation of the user; the determining unit is specifically configured to use, as the secret area, a rectangular area that is a diagonal line connecting the operation starting point and the operation end point of the setting operation; Alternatively, the closed area formed by the trajectory of the setting operation is taken as the secret area; or the area in which the operation object corresponding to the setting operation is displayed is taken as the secret area.
  • a receiving unit configured to receive the setting operation of the user, where the determining unit is specifically configured to display a display object in a rectangular area connecting the operation starting point and the operation end point of the setting operation as a diagonal line
  • the security display object or, the display object in the closed area formed by the trajectory of the setting operation is used as the security display object; or the operation object corresponding to the setting operation is displayed as the security display object .
  • the device further includes: an obtaining unit, configured to acquire a control instruction sent by the receiving device by using the connection; a positioning unit, configured to determine an operation area corresponding to the control instruction; and a response unit, configured to: when the operation area and the When the secret area overlaps, the control command is not responded; when the operation area does not coincide with the secret area, the control command is responded to.
  • the device further includes: an acquiring unit, configured to acquire a control instruction sent by the receiving device by using the connection; and a positioning unit, configured to determine that the control instruction corresponds to a display unit, configured to: when the display object corresponding to the control instruction includes the secret display object, does not respond to the control instruction; when the display object corresponding to the control instruction does not include the secret display object Responding to the control command.
  • an acquiring unit configured to acquire a control instruction sent by the receiving device by using the connection
  • a positioning unit configured to determine that the control instruction corresponds to a display unit, configured to: when the display object corresponding to the control instruction includes the secret display object, does not respond to the control instruction; when the display object corresponding to the control instruction does not include the secret display object Responding to the control command.
  • an embodiment of the present invention provides a sharing device, configured to share a screen with a receiving device, where the sharing device includes:
  • a display unit configured to display a user interface of the application menu
  • a connection unit configured to establish a connection with the receiving device for sharing a screen
  • a sending unit configured to send, by the connection, to the receiving device All the image data corresponding to the user interface of the application menu, so that the receiving device displays the user interface of the application menu according to the image data
  • the obtaining unit is configured to acquire a control instruction sent by the receiving device through the connection
  • a response unit configured to respond to the control instruction when the control instruction satisfies a predetermined privacy condition.
  • the predetermined security condition includes: the operation area corresponding to the control instruction does not coincide with the security area determined according to the preset area or the setting operation of the user, wherein the security area is a part of the user interface; or
  • the display object corresponding to the control instruction does not include a security display object, wherein the security display object is a part of the display object of at least two display objects in the user interface of the sharing device application menu.
  • the embodiment of the present invention provides a receiving device, configured to share a screen with a sharing device, where the receiving device includes:
  • connection unit configured to establish a connection with the sharing device for sharing a screen
  • a receiving unit configured to receive image data sent by the sharing device, where the image data corresponds to a user interface of an application menu displayed by the sharing device a part or all of
  • a display unit for displaying a user interface corresponding to the image data
  • an input unit for receiving an operation instruction input by the user
  • a generating unit configured to satisfy the predetermined operation command
  • a control unit corresponding to the operation instruction and a sending unit, configured to send a control instruction to the sharing device, so that the receiving device responds to the control instruction.
  • the receiving unit is configured to receive image data sent by the sharing device, where the image data corresponds to all of a user interface of an application menu displayed by the sharing device; and the generating unit is specifically configured to be in the operation instruction
  • a control instruction corresponding to the operation instruction is generated, where the predetermined security condition includes: the operation area corresponding to the operation instruction is in a non-secure area, wherein the sharing device displays the non-secure area a part of the user interface of the application menu; or the operation object of the operation instruction is a non-secure display object, wherein the non-secure display object is at least two included in the user interface of the application menu displayed by the sharing device A part of the display object in the display object.
  • the receiving unit is configured to receive, by the sharing device, image data corresponding to a part of a user interface of the application menu displayed by the sharing device, where the image data is displayed, and the user interface of the application menu displayed by the sharing device
  • the part is a shareable interface
  • the predetermined security condition includes: an operation area corresponding to the operation instruction is in the shareable interface, or an operation object of the operation instruction is a display object in the shareable interface.
  • the embodiment of the present invention provides a sharing device, configured to share a screen with a receiving device, where the sharing device includes:
  • An image output device a communication interface, a processor, the image output device, a user interface for displaying an application menu, the communication interface, configured to establish a connection with the receiving device for sharing a screen; a processor, configured to determine shareable image data, the shareable image data is a part of data in the image data corresponding to the user interface; the communication interface is further configured to send, by the connection, to the receiving device The shareable image data is such that the receiving device displays a user interface of the application menu according to the shareable image data.
  • the processor is further configured to: before determining the shareable image data, determine a secret area in the user interface according to a preset area or a setting operation of the user, where the secret area is a part of the user interface;
  • the process of determining the shareable image data includes: determining that the image data corresponding to the non-secure area is the shareable image data, and the non-secure area is an area of the user interface other than the secret area.
  • the processor is further configured to determine a non-secure area in the user interface according to a preset area or a setting operation of the user, where the non-secure area is a part of the user interface, before determining the shareable image data. And the determining the process of sharing the image data, comprising: determining that the image data corresponding to the non-secure area is the shareable image data.
  • the user interface includes at least two display objects
  • the processor is further configured to determine, according to a preset display object or a setting operation of the user, a secure display object in the user interface, before determining the shareable image data
  • the security display object is a part of the at least two display objects; the process of determining the shareable image data includes: determining that the image data corresponding to the non-secure display object is the shareable image data, the non- The secret display object is a display object other than the secret display object among at least two display objects.
  • the user interface includes at least two display objects; the processor is further configured to determine, according to a preset display object or a setting operation of the user, a non-secure display object in the user interface, before determining the shareable image data,
  • the non-secure display object is a part of the at least two display objects; the process of determining the shareable image data includes: determining that the image data corresponding to the non-secure display object is the shareable image data.
  • the predetermined triggering condition includes: receiving a triggering instruction input by the user, the triggering instruction is used to trigger execution of the determining shareable image data; or determining an operation instruction that the user input is not received within a predetermined time period; or It is determined that the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • the input device is configured to receive the setting operation of the user; the processor is specifically configured to use, as the secret area, a rectangular area that is a diagonal line connecting the operation starting point and the operation end point of the setting operation; Alternatively, the closed area formed by the trajectory of the setting operation is taken as the secret area; or the area in which the operation object corresponding to the setting operation is displayed is taken as the secret area.
  • An input device configured to receive the setting operation of the user; the processor is specifically configured to display a display object in a rectangular area that is a diagonal line connecting the operation starting point and the operation end point of the setting operation The security display object; or, the display object in the closed area formed by the trajectory of the setting operation is used as the security display object; or the operation object corresponding to the setting operation is displayed as the security display object .
  • the communication interface is further configured to acquire a control instruction sent by the receiving device by using the connection; the processor is further configured to: when the operating area and the secret area overlap, do not respond to the control instruction; When the operation area does not coincide with the secret area, the control command is responded to.
  • the communication interface is further configured to acquire a control instruction sent by the receiving device by using the connection; the processor is further configured to: when the display object corresponding to the control instruction includes the secret display object, does not respond to the control And in response to the control instruction when the display object corresponding to the control instruction does not include the secret display object.
  • the embodiment of the present invention provides a sharing device, configured to share a screen with a receiving device, where the sharing device includes:
  • An image output device a communication interface, a processor, the image output device, a user interface for displaying an application menu, the communication interface, configured to establish a connection with the receiving device for sharing a screen; Connecting, transmitting, to the receiving device, all image data corresponding to a user interface of the application menu, so that the receiving device displays a user interface of the application menu according to the all image data; acquiring the receiving device through the connection a control command sent; the processor, configured to respond to the control command when the control command satisfies a predetermined privacy condition.
  • the predetermined security condition includes: the operation area corresponding to the control instruction does not coincide with the security area determined according to the preset area or the setting operation of the user, wherein the security area is a part of the user interface; or
  • the display object corresponding to the control instruction does not include a security display object, wherein the security display object is a part of the display object of at least two display objects in the user interface of the sharing device application menu.
  • an embodiment of the present invention provides a receiving device, configured to share a screen during sharing
  • the receiving device includes:
  • An image output device configured to establish a connection with the sharing device for sharing a screen, and receive image data sent by the sharing device, where the image data corresponds to a part or all of the user interface of the application menu displayed by the sharing device; the image output device is configured to display a user interface corresponding to the image data; the input device is configured to receive an operation instruction input by the user; And a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition; the communication interface is further configured to send a control instruction to the sharing device, so that the receiving device responds The control command.
  • the predetermined security condition includes: the operation area corresponding to the operation instruction is in a non-secure area, wherein the non-secure area is a part of the user interface of the application menu displayed by the sharing device; or, the operation instruction
  • the operation object is a non-secure display object, wherein the non-secure display object is a part of the at least two display objects included in the user interface of the application menu displayed by the sharing device.
  • the predetermined security condition includes: an operation area corresponding to the operation instruction is in the shareable interface, or an operation object of the operation instruction is a display object in the shareable interface.
  • a user interface of an application menu is displayed; a connection with the receiving device for sharing a screen is established; and the shareable image data is determined, and the shareable image data is an image corresponding to the user interface. a portion of data in the data; the shareable image data is transmitted to the receiving device through the connection, so that the receiving device displays a user interface of the application menu according to the shareable image data.
  • the sharing device can only send the shareable image data to the receiving device, and the receiving device performs the user interface display according to the shareable image data, so that the sharing manner of the user interface of the application menu is more flexible and diverse.
  • FIG. 1 is a flow chart of an embodiment of a screen sharing method according to the present invention.
  • FIG. 2A is a flowchart of another embodiment of a screen sharing method according to the present invention.
  • FIGS. 2B to 2E are schematic diagrams showing a connection manner between a sharing device and a receiving device according to the present invention.
  • FIG. 2F to FIG. 2I are schematic diagrams showing operations of setting a secret area of a sharing device according to the present invention.
  • 2J is a schematic diagram showing a screen display effect of a receiving device according to the present invention.
  • 2K is a flowchart of another embodiment of a screen sharing method according to the present invention.
  • FIG. 3 is a flow chart of another embodiment of a screen sharing method according to the present invention.
  • FIG. 4 is a flowchart of another embodiment of a screen sharing method according to the present invention.
  • FIG. 5 is a schematic diagram of an embodiment of a sharing device according to the present invention.
  • FIG. 6 is a schematic diagram of another embodiment of a sharing device according to the present invention.
  • Figure 7 is a schematic diagram of another embodiment of a receiving device of the present invention.
  • FIG. 8 is a schematic diagram of an embodiment of a sharing device according to the present invention.
  • FIG. 9 is a schematic diagram of an embodiment of a receiving device of the present invention.
  • the sharing device is a device that provides screen data to other devices
  • the receiving device is a device that receives screen data.
  • the sharing device and the receiving device are devices that support the screen sharing function, such as a mobile phone, a mobile computer, a tablet computer, a personal digital assistant (PDA), a media player, a smart TV, a wearable device, and the like.
  • PDA personal digital assistant
  • a user interface refers to a medium for interaction and information exchange between a device and a user, which implements an internal form of information between the device and a human acceptable form. Conversion.
  • the user interface of the application menu refers to a user interface that displays an application icon in the form of a menu, and the application dish
  • a single user interface may include and is not limited to the following elements: time, battery status indicator, Bluetooth indicator, one or more wireless communication signal strength indicators, and application icons.
  • the indicator for wireless communication signal strength may include one or more cellular signal indicators and a Wi-Fi signal indicator;
  • the application icon is used to activate a responsive application, and the application icon may include a map, Icons for applications such as notepads, image management, cameras, video players, etc.
  • the user interface of the application menu may include a notification bar area and a tray area.
  • the time, the battery status indicator, the Bluetooth indicator, and the wireless communication signal strength indicator may be set in the notification bar area; applications of frequently used applications such as a phone, a short message, an email client, and a browser An icon can be placed in the tray area.
  • the display object refers to a set of elements or elements included in the user interface of the application menu.
  • the display object can include a collection of one or more of the elements of time display, battery status indicator, Bluetooth indicator, wireless communication signal strength indicator, application icon, and the like.
  • the device can reconstruct the user interface of the application menu according to the description information of all or part of the display object in the user interface of the application menu.
  • the security display object is a part of the display object included in the user interface of the application menu, and the information provided by the security display object to the user or the activating application corresponding to the security display object may cause user privacy on the sharing device.
  • the security display object may include an icon of a mobile banking, a payment application, a mailbox, a short message inbox, an instant application, a picture browser, and the like.
  • the non-secure display object refers to the display object remaining in the display object included in the user interface of the application menu except the secret display object, the information provided by the non-secure display object to the user or the activatable application corresponding to the non-secure display object. It usually does not cause leakage of user privacy on the sharing device.
  • the non-secure object may include a display object such as a time display, a battery status indicator, a Bluetooth indicator, a wireless communication signal strength indicator, and the like.
  • the preset display object refers to one or more display objects specified by the user of the sharing device or the user of the sharing device among the display objects included in the user interface of the application menu.
  • the display object can be preset as a non-secure display object as needed, or can be used as a secure display object.
  • the secret area is a part of the user interface of the application menu, and the information displayed by the security area or the information provided by the activateable application corresponding to the display object in the area may be shared by the user.
  • the secret area can be an area for displaying icons of mobile banking, payment applications, emails, SMS inboxes, instant applications, photo browsers, and the like.
  • the non-secure area is another part of the user interface of the application menu except the secret area.
  • the information displayed by the non-secure area or the information provided by the user of the display object corresponding to the display object in the non-secure area is generally not provided.
  • the non-secure area may include an area for displaying a display object such as a time display, a battery status indicator, a Bluetooth indicator, a wireless communication signal strength indicator, and the like.
  • the preset area refers to a part of the user interface of the application menu that is pre-specified by the operating system of the sharing device or the user of the sharing device.
  • the preset area can be used as a non-secure area or as a secret area as needed.
  • the predetermined triggering condition refers to a preset condition that triggers the sharing device to determine the shareable image data.
  • the sharing device can determine the shareable image data when the predetermined trigger condition is met.
  • the predetermined trigger condition may be set by the sharing device by default, or the user of the sharing device may set in the sharing device according to actual needs.
  • the operation instruction is an instruction sent by the user to the sharing device or the receiving device, and is used to instruct the sharing device or the receiving device to run the specified application, display the specified information on the user interface of the sharing device or the receiving device, or share the information.
  • the device or receiving device sends information, and so on.
  • the operation instructions may include touch commands, voice commands, gesture commands, and the like.
  • the triggering instruction refers to a user instruction for triggering the sharing device to perform the step of determining the shareable image data.
  • the sharing device determines that the image data can be shared after receiving the trigger command issued by the user.
  • a trigger instruction is a type of trigger condition and a type of operation instruction.
  • the setting operation refers to an operation performed by the user on the sharing device for setting a secret area, a non-secure area, a secret display object, or a non-secure display object, and the setting operation may be implemented by an operation instruction.
  • the original image data refers to all image data corresponding to the user interface of the application menu.
  • the user interface that displays or constructs a user interface consistent with the application menu displayed on the screen of the sharing device can be completed based on the original image data.
  • the shareable image data refers to a part of data in the image data corresponding to the user interface.
  • the shareable image data may not include data that may cause the sharing device user's private information to be leaked when sharing the screen, and the leakage of the user's private information on the sharing device may be reduced according to the image displayed by the shareable image data.
  • control instruction is an instruction sent by the receiving device to the sharing device, and is used to indicate the point.
  • the device or the receiving device runs the specified application, displays the specified information on the user interface of the sharing device or the receiving device, or transmits the information to the sharing device or the receiving device.
  • the control command corresponding to the operation command refers to a control command that acts or is the same as the operation command.
  • the display object corresponding to the control command is the display object specified by the control command.
  • the application icon specified by the control instruction For example, the application icon specified by the control instruction.
  • the response control instruction means that after receiving the control instruction, the sharing device runs the specified application according to the instruction of the control instruction or displays the specified information on the user interface of the sharing device according to the instruction of the control instruction.
  • the non-response control instruction means that the sharing device displays the specified information on the user interface of the sharing device without running the specified application according to the instruction of the control instruction or receiving the control instruction after receiving the control instruction.
  • Ignoring an operation instruction means not generating a control instruction corresponding to the operation instruction.
  • the subsequent normal operation may be continued, or the control instruction corresponding to the operation instruction is generated, but the generated control instruction is not sent to the sharing.
  • the device optional, can continue with other normal operations.
  • the operation area refers to an area specified by an operation instruction or a control instruction in the user interface, for example, a touch area of the user in a touch operation, an area determined according to coordinate information included in the control instruction, and the like.
  • the operation area corresponding to the control instruction refers to the area specified by the control instruction; the operation area corresponding to the operation instruction refers to the area specified by the operation instruction.
  • the operation object refers to a display object specified by an operation instruction or a control instruction in the user interface, such as an application icon of the user in a touch operation, an application icon specified in the control instruction, and the like.
  • the shareable user interface refers to a user interface displayed according to the shareable image data.
  • the overlap between the regions means that when there are two regions in the same user interface, a part of one region is also a part of another region.
  • FIG. 1 is a flow chart of an embodiment of a screen sharing method according to the present invention. This embodiment can be performed by the sharing device for sharing the screen between the sharing device and the receiving device.
  • Step 101 Display a user interface of an application menu.
  • the sharing device can display the user interface of the application menu before starting the screen sharing function or after starting the screen sharing function.
  • Step 102 Establish a screen sharing connection with the receiving device.
  • the sharing device may first enable the wireless connection function, so that the receiving device can establish a wireless connection for sharing the screen with the sharing device, so that the receiving device can receive the screen data of the sharing device, and can control The instruction is sent to the sharing device.
  • Step 103 Determine shareable image data, where the shareable image data is a part of data in the image data corresponding to the user interface.
  • the sharing device may determine the shareable image data, and the shareable image data is a part of the data in the image data corresponding to the user interface.
  • the sharing device may determine the secret area in the user interface according to the preset area or the setting operation of the user; and then determine that the image data corresponding to the non-secure area is The shareable image data is an area other than the secret area in the display interface.
  • the sharing device may first receive the setting operation of the user; when determining the secret area, the operation starting point and the operation end point of the setting operation may be a rectangular area in which a diagonal line is a diagonal line as the secret area; or a closed area formed by a track of the setting operation as the secret area; or an area in which an operation object corresponding to the setting operation is to be displayed As the secret area.
  • the sharing device may also determine a non-secure area in the user interface according to a preset area or a setting operation of the user, where the non-secure area is Describe a portion of the user interface; and then determine that the image data corresponding to the non-secure area is the shareable image data.
  • the sharing device may also first receive the setting operation of the user; then, the connection between the operation starting point and the operation end point of the setting operation is paired a rectangular area of the corner line as the non-secure area; or a closed area formed by the trajectory of the setting operation as the non-secure area; or, an area of the operation object corresponding to the setting operation is displayed as the Non-confidential area.
  • the sharing device may determine, according to the preset area or the setting operation of the user, the security display object in the user interface, where the security display object is the at least two Displaying a part of the display object in the object; then determining that the image data corresponding to the non-secure display object is The shareable image data is a display object other than the secret display object among at least two display objects.
  • the sharing device may first receive the setting operation of the user; when determining the security display object in the user interface, the setting operation may be performed a display object in a rectangular area that is diagonally connected between the operation start point and the operation end point as the security display object; or a display object in the closed area formed by the trajectory of the setting operation
  • the security display object is described; or the operation object corresponding to the setting operation is used as the security display object.
  • the sharing device may also determine the non-secure display object in the user interface according to the preset display object or the setting operation of the user, and the non-secure display The object displays an object for a part of the at least two display objects; and then determines that the image data corresponding to the non-secure display object is the shareable image data.
  • the sharing device may first receive the setting operation of the user; then, the connection between the operation starting point and the operation end point of the setting operation is paired a display object in a rectangular area of the corner line as the non-secure display object; or a display object in a closed area formed by the track of the setting operation as the non-secure display object; or The operation object corresponding to the setting operation is set as the non-secure display object.
  • the method further includes at least one step of: receiving a trigger instruction input by the user, the triggering instruction is used to trigger execution of the determining shareable image data; or determining that the data is not received within a predetermined time period An operation instruction input to the user; or determining that the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • the sharing device can determine the shareable image data, and after receiving the trigger instruction input by the user, determine the shareable image data, so that the user can determine when to determine the shareable image data according to the need.
  • the user may use; or, the sharing device may determine that the shareable image data is not received when the operation instruction input by the user is not received within a predetermined period of time, and determine the shareable image data when the operation instruction input by the user is not received within the predetermined time period.
  • the security problem may be reduced when the user does not operate the sharing device for a long time; or the sharing device may determine that the shareable image data is already available when the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • the shareable image data is determined, and the security problem when the number of receiving devices is large can be reduced.
  • Step 104 sending, by the connection, the shareable image data to the receiving device, so that the The receiving device displays a user interface of the application menu according to the shareable image data.
  • the sharing device can transmit the shareable image data to the receiving device through the connection.
  • the sharing device may transmit the shareable image data by transmitting the sharing device, and transmit the encoded shareable image data to the receiving device through the connection.
  • the receiving device decodes and displays the encoded shareable image data.
  • the picture or the video stream may be directly displayed; when the shareable image data received by the receiving device is the description information, the receiving device may according to the description.
  • the information rebuilds the user interface of an application menu and displays it.
  • a user interface of the application menu is displayed; a connection with the receiving device for sharing the screen is established; and the shareable image data is determined, and the shareable image data is image data corresponding to the user interface. a portion of data; transmitting, by the connection, the shareable image data to the receiving device such that the receiving device displays a user interface of an application menu according to the shareable image data.
  • the sharing device can only send the shareable image data to the receiving device, and the receiving device performs the user interface display of the application menu according to the shareable image data, so that the sharing of the user interface of the application menu is more flexible and diverse.
  • FIG. 2A is a flow chart of another embodiment of a screen sharing method according to the present invention. The present invention will be described below in conjunction with this embodiment.
  • Step 201 The sharing device starts the screen sharing function.
  • the sharing device first starts the screen sharing function and enters the screen sharing state. There are several ways to activate the screen sharing function. Different sharing devices can start the screen sharing function in different ways. For example, if the screen sharing application is installed on the sharing device, after receiving the user input to open the screen sharing application, the sharing device starts the screen sharing function; if the sharing device has the screen sharing function setting option, the user selects the startup screen. After sharing the function, enter the screen sharing function.
  • Step 202 After the screen sharing is started, the sharing device displays the user interface of the application menu.
  • the sharing device displays the user interface of the application menu through its own image output device before starting the screen sharing function or after starting the screen sharing function.
  • the user interface may be composed of a plurality of areas such as a notification bar area, a tray area, and an icon area.
  • Step 203 The sharing device establishes a connection with the receiving device for sharing a screen.
  • the sharing device After the sharing device function is shared, the sharing device turns on the wireless connection function, so that the receiving device can establish a connection for sharing with the sharing device, so that the receiving device can receive the display data sent by the sharing device, and can enable the receiving device to control
  • the instruction is sent to the sharing device.
  • the specific implementation of the connection for screen sharing may follow any feasible wireless communication protocol, such as IEEE 802.15 protocol, or IEEE 802.11 protocol, etc., including but not limited to Bluetooth, ZigBee, and 802.11b/g/n /ac/ad/ah and so on.
  • the IEEE 802.11 protocol can be established by using an AP-STA (Access Point-Station) mode, a wireless P2P (Peer to Peer) mode, an AP (Access Point) transfer mode, and a tunnel direct connection mode. a connection between the sharing device and the receiving device.
  • AP-STA Access Point-Station
  • P2P Packet to Peer
  • AP Access Point
  • tunnel direct connection mode a connection between the sharing device and the receiving device.
  • the sharing device and the receiving device can establish a direct connection in the AP-STA mode.
  • the sharing device can be used as a wireless AP, and the receiving device discovers the sharing device as a STA and establishes a connection with the sharing device.
  • the sharing device and the receiving device can directly connect through the Wi-Fi P2P mode.
  • the sharing device can be used as a GO (Group Owner) device of the wireless P2P group, and the receiving device is connected to the sharing device as a client device of the P2P group.
  • GO Group Owner
  • the sharing device can establish a connection with the receiving device through the AP relay. Both the sharing device and the receiving device establish a connection with the first AP as the STA. When the display data transmission is required, the sharing device sends the display data to the AP, and the AP transfers the received display data to the receiving device.
  • the sharing device and the receiving device can establish a connection through a tunnel direct connection.
  • the sharing device and the receiving device first establish a connection with the second AP as the STA, and then establish a tunnel direct connection channel between the sharing device and the receiving device.
  • the sharing device sends the display data to the receiving device through the tunnel direct connection channel.
  • step 202 does not limit the order of execution between step 202 and step 203.
  • Step 204 The sharing device determines a secret area in the user interface according to a setting operation of the user.
  • the user's setting operation can be of various types.
  • the user can complete the setting operation on the sharing device through a peripheral device such as a mouse or a keyboard; the setting operation can also be completed in a touch manner; or can be done in a non-contact manner such as voice or gesture.
  • Set the operation The following is an example of how the user completes the setting operation by touch:
  • the sharing device may use a rectangular area determined according to the touch track of the user as a secret area of the user interface.
  • the operation start point of the user touch operation is the first touch point
  • the operation end point of the user touch operation is the second touch point
  • the first touch point is connected with the second touch point.
  • the rectangle with the line as the diagonal is the defined secret area, wherein the sides of the rectangular frame are parallel to the sides of the sharing device screen display interface, respectively.
  • the sharing device records the location information of the currently selected area.
  • the sharing device can also pop up an option menu bar, which is displayed in the middle of the screen, and the user selects a desired operation in the option menu to complete the current privacy setting. For example, there are three kinds of "cancel", “reselect” and “OK” in the option menu. Selecting "Cancel” means giving up the setting of this time.
  • the first mobile terminal can cancel the display of the option menu, cancel the display of the rectangular frame of the selected area, cancel the display of the semi-transparent layer, and exit the setting mode; select "Reselect” to indicate To reset the privacy zone, the first mobile terminal cancels the selected area rectangle and the option menu bar, and the user can re-execute the setting step; after selecting "OK", the first mobile terminal cancels the option menu display and receives the selected privacy zone.
  • the sharing device may use a closed area formed by the touch track of the user as a secret area of the user interface.
  • the closed area formed by the touch track refers to the area surrounded by the touch track.
  • the user touches the starting touch point with a finger or other body part, keeps the contact, moves the finger to draw a circle, and finally returns to the starting touch point and then releases, so that the icon or display block that needs to be kept secret is made. It is included in the area surrounded by the finger touch track. The area enclosed by the touch track is the set secret area. Similarly, the option menu bar can also be popped up so that the user can confirm the secret area through the preset menu. The specific process can be referred to the foregoing.
  • a corresponding indication may also be given on the user interface, as shown in FIG. 2H, taking the finger to define a rectangular security zone as an example, the sharing device may cover a new half in the defined secret zone.
  • the transparent layer makes the application of the semi-transparent layer untriggered or directly covered, so that the application of the translucent layer cannot be triggered and is invisible.
  • the sharing device does not process on the screen, only intercepting the screen in the processing unit processing, that is, the user sharing the device sees a completely normal picture.
  • the sharing device may also determine a non-secure area in the user interface according to a user's setting operation. For example, a rectangular area determined according to a touch track of the user may be used as a non-secure area of the user interface, or a closed area formed by the touch track of the user may also be used as a non-secure area of the user interface.
  • the manner in which the non-secure area is determined is similar to the way in which the secret area is determined, and will not be described in detail herein.
  • the sharing device may also determine a secure display object in the user interface according to a user's setting operation.
  • each application icon is clickable. After the user clicks on the application icon to be kept secret, the corresponding application icon is a security display object. Similarly, the option menu bar can also be popped up so that the user can confirm the confidential display object through the preset menu.
  • the specific implementation manner of the preset menu can be referred to the foregoing.
  • the sharing device may also determine a non-secure display object in the user interface according to a user's setting operation.
  • the manner of determining the non-secure display object is similar to the manner of determining the aforementioned secure display object, and will not be described in detail herein.
  • the sharing device may also display the display object included in the security area as a security display object after determining the privacy zone, or the sharing device may also include the non-secure zone after determining the non-secure zone.
  • the display object is displayed as a non-secure display object.
  • the sharing device has saved the positioning information of the secret area, the non-secure area, the security display object, or the non-secure display object, the secured area, the non-secure area, and the confidentiality may also be determined according to the saved positioning information. Display object or non-secure display object.
  • the sharing device may also use the preset area as a secret area or a non-secure area as needed, or may also display the display object in the preset area as a secure display object or a non-secure display object.
  • the sharing device may directly use the tray area as a secure area, or the icon set in the tray area may be used as a secure display object.
  • Step 205 Determine image data corresponding to the non-secure area as the shareable image data, where the non-secure area is an area other than the secret area in the user interface.
  • the receiving device After the security area is determined, the receiving device first determines a non-secure area according to the secret area, where the non-secure area is an area other than the secret area in the user interface; and then determining that the image data corresponding to the non-secure area is the Image data can be shared. If the sharing device has directly determined the non-secure area, it may directly determine that the image data corresponding to the non-secure area is the shareable image data.
  • the image of the non-secure area may be a picture that is part of a picture corresponding to the user interface displaying the application menu. Since the user interface displaying the application menu is also a picture, the original display data is usually composed of pixels, so a series of arrays can be used to represent the original display data, wherein each pixel can be composed of coordinate values and color values as array elements.
  • the original display data provided by the SurfaceFlinger service can be read, and a series of pixel coordinates (X, Y) and pixel RGB values are obtained as numbers.
  • the original display data corresponding to the user interface of the application menu already exists in the memory module of the sharing device. Therefore, the sub-device can obtain the shareable image data directly from the memory module of the sharing device; or, the original image data can be first acquired from the memory module of the sharing device, and then the shareable image data is generated according to the original image data.
  • the sharing device may first determine all the pixels in the non-secure area, and then obtain an array corresponding to the pixels from the memory module of the sharing device, and the array corresponding to all the pixels in the non-secure area is combined. To share image data.
  • the sharing device may first acquire the original image data from the memory module, and then delete the portion of the original display data corresponding to the secret area, and only retain the corresponding to the non-secure area. Partially displaying data as shareable image data, or replacing a portion of the original display data corresponding to the secret area with replacement data, thereby obtaining shareable image data.
  • the color value in the array corresponding to the pixel in the secret area may be re-assigned, so that the replacement data is the same as the confidentiality.
  • Different display data of the data enables confidentiality of the image of the secret area. Re-assigning the color value of each pixel in the secret area to obtain the screen data is the shareable image data.
  • the RGB value of each pixel in the secret area can be written as (0, 0, 0) or (255, 255, 255), that is, Each pixel in the area is displayed as black or white; or, the pixel points in the secret area can be personalized and assigned one by one according to different display effects.
  • the image data corresponding to the non-secure display object may be determined to be the shareable image data.
  • the non-secure display object is a display object other than the secret display object among at least two display objects.
  • the sharing device may first determine the non-secure display object, obtain description information of all non-secure display objects, and then use the description information of all non-secure display objects as shareable image data.
  • the sharing device before determining that the image data can be shared, can also determine whether the trigger condition for determining the shareable image data has been met. If the trigger condition has been met, the sharing device determines that the image data can be shared, and if the satisfying trigger condition is not satisfied, the sharing device can directly transmit the original display data to the receiving device.
  • a triggering instruction that receives a user input may be used as a trigger condition.
  • the sharing device may determine whether a setting instruction for setting a secret area in the user interface is received, and if the setting instruction has been received, determining that the image data can be shared; if the setting instruction is not received, it is not necessary to determine the shareable image data.
  • the setting instruction may be a voice instruction, a touch instruction, a gesture instruction, and the like sent by the user.
  • the sharing device may determine whether any operation instruction input by the user is not received within a predetermined time period, and if the operation instruction input by the user is not received within the predetermined time period, the user does not operate the sharing device for a long time, To prevent user privacy from leaking, you can be sure to share image data.
  • the predetermined time period is a time period arbitrarily set according to requirements, for example, within a predetermined time period from the time when the screen sharing function is enabled, or within a predetermined time period after the previous user operation instruction is received.
  • the sharing device can determine whether a cancellation command input by the user for canceling generation of the shareable image data is not received within the predetermined time period. If the cancel instruction is not received within the predetermined time period, it is determined that the image data can be shared; if the cancel instruction is received within the predetermined time period, it is not necessary to determine the shareable image data.
  • the sharing condition may be triggered by whether the sharing device has a certain business condition.
  • the sharing device may detect whether the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value, or detect whether a predetermined device is included in the receiving device that has established a connection with the sharing device; if the sharing device finds the receiving device that has established the connection The number of shares exceeds a predetermined value, or a specific device or a specific type of device or the like is included in the receiving device, and the shareable image data is generated; otherwise, there is no need to generate shareable image data.
  • the content included in the original display data may be used as a trigger condition.
  • the sharing device can monitor the change of the original display data at any time, and generate shareable image data when the original display data contains specific content.
  • the sharing device finds that the original display data includes data corresponding to a specific application prompt screen such as a short message prompt, the shareable image data is generated.
  • the sharing device may judge according to a predetermined frequency after the screen sharing function is started until the predetermined trigger condition is met or the screen sharing function is turned off.
  • step 202 does not continue to limit the execution sequence between step 202, step 203, and step 204 to step 205, and the order of execution may be determined as needed.
  • Step 206 Send, by the connection, the shareable image data to the receiving device, so that the receiving device displays a user interface of the application menu according to the shareable image data.
  • the sharing device may compress and encode the shareable image data, and packetize the compressed encoded file to obtain a transport stream, and then transmit the transport stream, thereby transmitting the shareable image data to the receiving device.
  • the format is usually a picture or a video stream, and when the shareable image data is compression-encoded, it may be H.
  • the encoding method provided in the 264 specification encodes the shareable image data; when the encoded shareable image data is encapsulated, the packet method may also be various, for example, the packet may be encapsulated according to the PES packet method, and further encoded into MPEG2-
  • the TS format is convenient for transmission; the transmission stream can be transmitted by means of RTP transmission or the like.
  • the description information may be compressed to remove redundant data.
  • the receiving device After receiving the shareable image data, the receiving device performs image display according to the shareable image data.
  • the shareable image data received by the receiving device is corresponding to a picture or a video stream, the picture or the video stream may be directly displayed.
  • the shareable image data received by the receiving device is the description information
  • the receiving device may perform the description according to the description. The information rebuilds the user interface of an application menu and displays it.
  • 2J is a schematic diagram of a screen effect of a receiving device in the present invention.
  • the data displayed in the secure area of the receiving device can be made different from the data displayed in the secure area of the sharing device. This will protect the privacy information from leaking.
  • the security area of the user interface can be set as needed.
  • the sharing device sends the screen data to the receiving device, the sharing device does not send the portion corresponding to the security area, so that the original image in the security area is not displayed on the receiving device. Therefore, it is possible to effectively avoid leakage of privacy information due to image display.
  • the method may further include:
  • Step 207 The sharing device acquires a control instruction sent by the receiving device by using the connection.
  • the sharing device can detect whether a control command from the receiving device is received, wherein the control command can be generated by the receiving device in response to the user's operation on the receiving device.
  • the receiving instruction may include information such as the touch position coordinates of the user in the receiving device.
  • Step 208 determining an operation area corresponding to the control instruction.
  • the sharing device After receiving the control command sent by the receiving device, the sharing device determines according to the information contained in the control command. The operation area corresponding to the control instruction is determined.
  • the sharing device may first obtain, from information included in the control instruction, a first coordinate range touched by the user when performing a touch operation on the receiving device, and then determine, according to the first coordinate range, a user whose control command is displayed on the receiving device.
  • the first coordinate range is a coordinate range in which the user operates on the user interface of the receiving device, since there may be differences in size, scale, resolution, etc. between the user interface of the receiving device and the user interface of the sharing device,
  • the conversion relationship between the user interface coordinates of the receiving device and the user interface coordinates of the sharing device is converted, and the first coordinate range of the receiving device user interface is converted into a second coordinate range for operation on the user interface of the sharing device.
  • the control region of the control command on the user interface displaying the menu of the receiving device is then determined based on the second coordinate range.
  • the sharing device may determine the display object corresponding to the control instruction according to the control instruction.
  • the sharing device may determine the operation area corresponding to the control instruction according to the information included in the control instruction, and then display the display object included in the operation area corresponding to the control instruction as the display object corresponding to the control instruction.
  • Step 209 If the operation area overlaps with the security area, do not respond to the control instruction; if the operation area does not coincide with the security area, respond to the control instruction.
  • the sharing device can determine whether the operation area and the secret area overlap.
  • the receiving device may perform an operation on an area in the user interface that does not reveal the privacy information of the sharing device user.
  • the sharing device response control command does not cause leakage of the private information in the sharing device. .
  • the sharing device can respond to the control command.
  • the receiving device may perform an operation on an area of the user interface that may leak the shared device user privacy information, and the sharing device response control instruction may cause leakage of the private information in the sharing device. .
  • the sharing device may not respond to the control command.
  • control instruction corresponds to the display object
  • the control instruction is not responded; if the display object corresponding to the control instruction is not The security display object is included in response to the control instruction.
  • the receiving device hopes to operate the display object that does not disclose the privacy information of the sharing device user, and the sharing device does not respond to the control instruction. Causes the disclosure of private information in the sharing device. At this point, the sharing device can respond to the control command. If the display object corresponding to the control instruction includes a security display object, the description indicates that the receiving device desires to operate the display object that may leak the privacy information of the sharing device user, and the sharing device responding to the control instruction may cause leakage of the private information in the sharing device. . At this point, the sharing device may not respond to the control command.
  • the sharing device can only transmit the shareable image data corresponding to the non-secure area to the receiving device; and only respond to the control instruction that meets the predetermined security condition, thereby effectively avoiding transmitting the original image data to the receiving device and responding to all the control.
  • the leakage of user privacy information on the sharing device caused by the instruction reduces the security problem during the screen sharing process.
  • FIG. 3 it is a flowchart of an embodiment of a control method in screen sharing according to the present invention. This embodiment can be performed by a sharing device.
  • step 301 a user interface of the application menu is displayed.
  • Step 302 Establish a connection with the receiving device for sharing a screen.
  • steps 301 and 302 are similar to the steps in the foregoing embodiments, and will not be described in detail herein.
  • the foregoing embodiments can be seen in the related embodiments. It should be noted that the embodiment does not limit the execution sequence between step 301 and step 302.
  • Step 303 Send, by the connection, all image data corresponding to the user interface of the application menu to the receiving device, so that the receiving device displays the user interface of the application menu according to the all image data.
  • the transmitting device After the connection is established, the transmitting device transmits all image data corresponding to the user interface of the application menu to the receiving device, that is, after the connection is established, the transmitting device transmits the original image data to the receiving device.
  • Step 304 Acquire a control instruction sent by the receiving device through the connection.
  • Step 305 Respond to the control instruction when the control instruction meets a predetermined privacy condition.
  • the receiving device may determine whether the control instruction satisfies a predetermined security condition, and when the control instruction satisfies a predetermined security condition, the sharing device responds to the control instruction; if the control instruction does not satisfy the predetermined The sharing device does not respond to the control command when the condition is confidential.
  • the predetermined security condition may mean that the operation area corresponding to the control instruction does not coincide with the security area.
  • the receiving device may determine a secret area in the user interface according to a preset area or a setting operation of the user. Of course And determining whether the operation area corresponding to the control instruction overlaps with the security area, and responding to the control instruction when the operation area corresponding to the control instruction does not coincide with the security area.
  • the predetermined security condition may also mean that the display object corresponding to the control instruction does not include a security display object, wherein the security display object is a part of at least two display objects in the user interface of the sharing device application menu. Object.
  • the receiving device may determine a secret display object in the user interface according to a preset area or a setting operation of the user. And determining whether the display object corresponding to the control instruction includes a security display object, and responding to the control instruction when the display object corresponding to the control instruction does not include the security display object.
  • the sharing device determines the secret display object in the user interface, in another embodiment, if the display object corresponding to the control instruction includes the secret display object, the control instruction is not responded; if the control The display object corresponding to the instruction does not include the secret display object, and responds to the control instruction.
  • the sharing device responds to the control command only when the control command meets the predetermined security condition, and reduces leakage of user privacy information on the sharing device that may be caused by responding to all control commands, thereby reducing the response control command. Security issue.
  • FIG. 4 is a flow chart of another embodiment of a method for sharing a screen according to the present invention. This embodiment can be performed by a receiving device.
  • Step 401 Establish a connection with the sharing device for sharing the screen.
  • Step 402 Receive image data sent by the sharing device, where the image data corresponds to part or all of a user interface of an application menu displayed by the sharing device.
  • the image data received by the receiving device may be original image data or may be shareable image data.
  • the specific manner in which the sharing device generates and transmits the image data can be referred to the foregoing embodiment, and will not be described in detail herein.
  • Step 403 Display a user interface corresponding to the image data.
  • the receiving device When the image data corresponds to the entire content of the user interface of the application menu displayed by the sharing device, That is, when the receiving device receives the original image data, the receiving device displays a complete image interface corresponding to the original image data.
  • a part of the user interface of the application menu displayed by the sharing device is a shareable interface.
  • the receiving device may display a user interface of the application menu according to the shareable image data.
  • the shareable image data is a picture or a video stream
  • the receiving device can directly display the picture or video stream.
  • the sharing device may construct and display the user interface according to the description information of the non-secure display object included in the shareable image data.
  • Step 404 Receive an operation instruction input by a user.
  • the receiving device can receive an operation instruction input by the user.
  • Step 405 Generate a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition.
  • the receiving device When the operation instruction satisfies a predetermined secret condition, the receiving device generates a control instruction corresponding to the operation instruction; when the operation instruction does not satisfy the predetermined security condition, the receiving device ignores the operation instruction.
  • the ignoring the operation command means that the control command corresponding to the operation command is not generated, or the control command corresponding to the operation command is generated, but the control command is not transmitted to the sharing device.
  • the security condition may be that the operation area corresponding to the operation instruction is in a non-secure area, or the operation object of the operation instruction may be a non-secure display object, wherein the non-secure area is displayed by the sharing device. a portion of the user interface of the application menu; the non-secure display object is a portion of the at least two display objects included in the user interface of the application menu displayed by the sharing device.
  • the receiving device after receiving the operation instruction input by the user, the receiving device first determines an operation area corresponding to the operation instruction. And determining whether the operation area is in the non-secure area, and when the operation area is in the non-secure area, generating a control instruction corresponding to the operation instruction, when the operation area corresponding to the operation instruction When some or all of the user interface is outside the shareable user interface, the operation instruction is ignored.
  • the receiving device determines an operation object of the operation instruction. And generating, when the operation object of the operation instruction is a display object in the shareable user interface, a control instruction corresponding to the operation instruction, when an operation object of the operation instruction is not the When the display object in the user interface can be shared, the operation instruction is ignored.
  • the ignoring the operation command means that the control command corresponding to the operation command is not generated, or the control command corresponding to the operation command is generated, but the control command is not transmitted to the sharing device.
  • Step 406 Send a control instruction to the sharing device, so that the receiving device responds to the control instruction.
  • the receiving device After the control control command is generated, the receiving device transmits the control command to the control device to enable the sharing device to respond to the control command.
  • the receiving device can generate the control command when the predetermined confidentiality condition is met, thereby preventing the operation instruction input by the user from causing the leakage of the user's private information on the receiving device, and reducing the operation instruction in response to the user input to the sharing device. Security issue.
  • the present invention also provides a sharing device and a receiving device.
  • FIG. 5 is a schematic diagram of an embodiment of a sharing device according to the present invention.
  • the sharing device includes a display unit 501, a connection unit 502, a generation unit 503, and a transmission unit 504.
  • the display unit 501 is configured to display a user interface of an application menu.
  • the connecting unit 502 is configured to establish a connection with the receiving device for sharing a screen
  • the generating unit 503 is configured to determine shareable image data, where the shareable image data is a part of data in the image data corresponding to the user interface;
  • the sending unit 504 is configured to send, by using the connection, the shareable image data to the receiving device, so that the receiving device displays a user interface of the application menu according to the shareable image data.
  • the device may further include: a determining unit.
  • the determining unit may be configured to determine a secret area in the user interface according to a preset area or a setting operation of the user, where the secret area is a part of the user interface; the generating unit 503 may be used to Determining image data corresponding to the non-secure area is the shareable image data, and the non-secure area is an area of the user interface other than the secret area.
  • the determining unit may be configured to determine a non-secure area in the user interface according to a preset area or a setting operation of the user, where the non-secure area is a part of the user interface; the generating unit 503, The image data corresponding to the non-secure area may be used to determine the shareable image data.
  • the user interface includes at least two display objects
  • the determining unit may be configured to determine a secret display object in the user interface according to a preset display object or a setting operation of the user, where the secret display object is a part of the at least two display objects;
  • the generating unit 503 is configured to determine that the image data corresponding to the non-secure display object is the shareable image data, and the non-secure display object is a display object other than the secret display object among the at least two display objects.
  • the user interface includes at least two display objects
  • the determining unit may be configured to determine a non-secure display object in the user interface according to a preset display object or a setting operation of the user, where the non-secure display object is a part of the at least two display objects
  • the generating unit 503 is configured to determine that the image data corresponding to the non-secure display object is the shareable image data.
  • the generating unit 503 may determine the shareable image data when the following trigger condition is met: receiving a trigger instruction input by the user, the trigger instruction being used to trigger execution of the determining shareable image data; Or, determining that an operation instruction input by the user is not received within a predetermined time period; or determining that the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • the device may further include: a receiving unit.
  • the receiving unit may be configured to receive the setting operation of the user; the determining unit may be configured to use, as the rectangular area, a rectangular area connecting the operation starting point and the operation end point of the setting operation as a diagonal line a secret area; or, a closed area formed by the trajectory of the setting operation is used as the secret area; or an area showing an operation object corresponding to the setting operation is used as the secret area.
  • the receiving unit may be configured to receive the setting operation of the user; the determining unit may be configured to display the rectangular area in which the connection between the operation starting point and the operation end point of the setting operation is diagonal And the object to be displayed as the security display object; or the display object in the closed area formed by the trajectory of the setting operation is used as the security display object; or the operation object corresponding to the setting operation is displayed as the Keep the display object confidential.
  • the device further includes: an acquiring unit, a positioning unit, and a response unit.
  • the obtaining unit may be configured to acquire a control instruction sent by the receiving device by using the connection;
  • the positioning unit may be configured to determine an operation area corresponding to the control instruction
  • the response unit may be configured to not respond to the control instruction when the operation area overlaps with the secret area; and respond to the control instruction when the operation area does not coincide with the secret area.
  • the obtaining unit may be configured to acquire a control instruction sent by the receiving device by using the connection;
  • the positioning unit may be configured to determine a display object corresponding to the control instruction
  • the response unit may be configured to: when the display object corresponding to the control instruction includes the secret display object, does not respond to the control instruction; when the display object corresponding to the control instruction does not include the secret display object, Responding to the control command.
  • the sharing device can only send the shareable image data to the receiving device; thereby effectively avoiding leakage of user privacy information on the sharing device caused by sending the original image data to the receiving device, and reducing security problems in the screen sharing process.
  • FIG. 6 is a schematic diagram of another embodiment of a sharing device according to the present invention.
  • the sub-sharing device includes a display unit 601, a connection unit 602, a transmission unit 603, an acquisition unit 604, and a response unit 605.
  • the display unit 601 is configured to display a user interface of an application menu.
  • the connecting unit 602 is configured to establish a connection with the receiving device for sharing a screen
  • the sending unit 603 is configured to send, by using the connection, all image data corresponding to a user interface of the application menu to the receiving device, so that the receiving device displays the application menu according to the all image data.
  • the obtaining unit 604 is configured to acquire a control instruction sent by the receiving device by using the connection;
  • the response unit 605 is configured to respond to the control instruction when the control instruction satisfies a predetermined privacy condition.
  • the response unit 605 is specifically configured to: when the control instruction meets the following predetermined confidentiality conditions,
  • the control instructions should be:
  • the operation area corresponding to the control instruction does not coincide with the security area determined according to the preset area or the setting operation of the user, wherein the security area is a part of the user interface; or the display object corresponding to the control instruction does not
  • the security display object is included, wherein the security display object is a part of the display object of at least two display objects in the user interface of the sharing device application menu.
  • the sharing device responds to the control command only when the control command meets the predetermined security condition, thereby reducing leakage of user privacy information on the sharing device that may be caused by responding to all control commands, and reducing security during the screen sharing process. Sexual problems.
  • FIG. 7 is a schematic diagram of an embodiment of a receiving device of the present invention.
  • the receiving device includes a connecting unit 701, a receiving unit 702, a display unit 703, an input unit 704, a generating unit 705, and a sending unit 706.
  • the connection unit 701 is configured to establish a connection between the sharing device and the sharing screen.
  • the receiving unit 702 is configured to receive image data sent by the sharing device by using the connection, where the image data corresponds to a part or all of a user interface of an application menu displayed by the sharing device;
  • the display unit 703 is configured to display a user interface corresponding to the image data.
  • the input unit 704 is configured to receive an operation instruction input by a user
  • the generating unit 705 is configured to generate a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition
  • the sending unit 706 is configured to send a control instruction to the sharing device by using the connection, so that the receiving device responds to the control instruction.
  • the receiving unit 702 may be configured to receive image data sent by the sharing device, where the image data corresponds to all of a user interface of an application menu displayed by the sharing device;
  • the generating unit 705 is configured to generate a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition, where the predetermined security condition includes: an application menu displayed by the sharing device in the non-secret area a part of the user interface; or the operation object of the operation instruction is a non-secure display object, wherein the non-secure display object is at least two display objects included in the user interface of the application menu displayed by the sharing device Part of the display object.
  • the receiving unit 702 may be configured to receive image data sent by the sharing device, where the image data corresponds to a part of a user interface of an application menu displayed by the sharing device, and a user interface of an application menu displayed by the sharing device Part of it is a shareable interface;
  • the generating unit 705 is configured to generate a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition, where the predetermined security condition includes: the operation area corresponding to the operation instruction is in the shareable In the interface, or the operation object of the operation instruction is a display object in the shareable interface.
  • the generating unit 705 may not generate a control instruction corresponding to the operation instruction; or, although the generating unit 705 generates a The control instruction corresponding to the operation instruction is described, but the transmitting unit 706 does not send a control instruction to the sharing device.
  • the receiving device can generate the control command when the predetermined confidentiality condition is met, so that the operation instruction input by the user can be prevented from causing leakage of the user's private information on the receiving device.
  • FIG. 8 is a schematic diagram of another embodiment of a sharing device according to the present invention.
  • the sharing device is configured to share a screen with the receiving device.
  • the sharing device includes components such as an input device 801, a processor 802, an output device 803, a communication interface 804, a memory 805, a peripheral interface 806, and the like. These components communicate over one or more buses. It will be understood by those skilled in the art that the structure of the electronic device shown in the figure does not constitute a limitation of the present invention, and it may be a bus-shaped structure or a star-shaped structure, and may include more or less than the illustration. Parts, or combine some parts, or different parts.
  • the sharing device and the receiving device may be any mobile or portable electronic device, including but not limited to a mobile phone, a mobile computer, a tablet computer, a personal digital assistant (PDA), a media player, Smart TV, and combinations of two or more of the above.
  • PDA personal digital assistant
  • the input device 801 is configured to implement user interaction with the electronic device and/or information input into the electronic device.
  • input device 801 can receive numeric or character information input by a user to generate a signal input related to user settings or function controls.
  • the input device 801 may be a touch panel, or may be other human-computer interaction interfaces, such as physical input keys, microphones, etc., and other external information extraction devices, such as cameras.
  • a touch panel also known as a touch screen or touch screen, collects operational actions that the user touches or approaches on.
  • the user uses an action of any suitable object or accessory such as a finger or a stylus on or near the touch panel, and drives the corresponding connecting device according to a preset program.
  • the touch panel may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the user's Touching operation, converting the detected touch operation into an electrical signal, and transmitting the electrical signal to a touch controller; the touch controller receiving the electrical signal from the touch detection device and converting it into contact coordinates, Then send it to the processing unit.
  • the touch controller can also receive and execute commands from the processing unit.
  • touch panels can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the physical input keys used by the input device 801 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, and the like. kind or more.
  • the input device 801 in the form of a microphone can collect the voice input by the user or the environment and convert it into a command executable by the processing unit in the form of an electrical signal.
  • the input device 801 may also be various types of sensor devices, such as Hall devices, for detecting physical quantities of electronic devices, such as force, moment, pressure, stress, position, displacement, speed. , acceleration, angle, angular velocity, number of revolutions, speed, and time when the working state changes, etc., are converted into electricity for detection and control.
  • sensor components may also include gravity sensors, three-axis accelerometers, gyroscopes, and the like.
  • Processor 802 is a control center for an electronic device that connects various portions of the entire electronic device using various interfaces and lines, by running or executing software programs and/or modules stored in memory 805, and recalling data stored in memory 805. To perform various functions of the electronic device and/or process data.
  • the processor 802 may be composed of an integrated circuit (IC), for example, may be composed of a single packaged IC, or may be composed of a plurality of packaged ICs that have the same function or different functions.
  • the processor 802 may include only a central processing unit (CPU), or may be a GPU, a digital signal processor (DSP), and a control chip in the communication interface 804 (for example, A combination of baseband chips).
  • the CPU may be a single operation core, and may also include multiple operation cores.
  • the communication interface 804 is configured to establish a communication channel, and the sharing device is connected to the receiving device through the communication channel.
  • the communication interface 804 may include a wireless local area network (Wireless Local Area Network) module, a Bluetooth module, a baseband module, and the like, and a radio frequency (RF) circuit corresponding to the communication module.
  • RF radio frequency
  • wireless local area network Bluetooth communication, infrared communication, and/or cellular communication system communication, such as Wideband Code Division Multiple Access (W-CDMA) and/or high speed downlink packet access.
  • W-CDMA Wideband Code Division Multiple Access
  • HSDPA High Speed Downlink Packet Access
  • the communication module is used to control communication of components in the electronic device, and can support Direct Memory Access.
  • various communication modules in the communication interface 804 generally appear in the form of an integrated circuit chip, and can be selectively combined without including all communication modules and corresponding Antenna group.
  • the communication interface 804 can include only baseband chips, radio frequency chips, and corresponding antennas to provide communication functionality in a cellular communication system.
  • the wireless device can be connected to a cellular network (Cellular Network) or the Internet (Internet) via a wireless communication connection established by the communication interface 804, such as wireless local area network access or WCDMA access.
  • a communication module, such as a baseband module, in the communication interface 804 may be integrated into the processor 802, typically an APQ+MDM series platform such as that provided by Qualcomm.
  • the radio frequency circuit is used for receiving and transmitting signals during information transmission and reception or during a call. For example, the transmission stream of the shared screen data processed by the sharing device is transmitted to the receiving device, and the touch command returned by the receiving device is received.
  • the radio frequency circuit includes well-known circuits for performing these functions, including but not limited to an antenna system, a radio frequency transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec. (Codec) chipset, Subscriber Identity Module (SIM) card, memory, etc.
  • the RF circuit can communicate with the network and other devices through wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), High Speed Uplink Packet Access (HSUPA), LTE (Long Term Evolution) , email, SMS (Short Messaging Service), etc.
  • GSM Global System of Mobile communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • High Speed Uplink Packet Access HSUPA
  • LTE Long Term Evolution
  • email Short Messaging Service
  • the output device 803 includes, but is not limited to, an image output device 8031 and a sound output device 8032.
  • the image output device 803 is for outputting text, pictures, and/or video.
  • the image output device 8031 may include a display panel, such as an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or a field emission display (FED).
  • the configured display panel such as an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or a field emission display (FED).
  • the configured display panel Alternatively, the image output device 8031 may comprise a reflective display, such as an electrophoretic display, or a display utilizing an Interferometric Modulation of Light.
  • the image output device 8031 can include a single display or multiple displays of different sizes.
  • the touch panel used by the input device 801 can also serve as the display panel of the output device 8031.
  • the touch panel displays the current display screen and can receive an instruction from the user to specify a secret area.
  • the input device 801 and the output device 803 are used as two independent components to implement the input and output functions of the electronic device in the structural diagram, in some embodiments, the touch panel and the display panel may be integrated into one. Input and output functions of electronic devices.
  • the image output device The 803 can display various graphical user interfaces (GUIs) as virtual control components, including but not limited to windows, scrolling axes, icons, and scrapbooks, for the user to operate by touch.
  • GUIs graphical user interfaces
  • the image output device 8031 includes a filter and an amplifier for filtering and amplifying the video output by the processing unit.
  • the audio output device 8032 includes a digital to analog converter for converting the audio signal output by the processing unit from a digital format to an analog format.
  • the memory 805 can be used to store software programs and modules that execute various functional applications of the electronic device and implement data processing by running software programs and modules stored in the memory 805.
  • the memory 805 mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function, such as a sound playing program, an image playing program, and the like; and the data storage area can be stored according to the electronic device. Use the created data (such as audio data, phone book, etc.).
  • the memory 805 may include a volatile memory, such as a non-volatile volatile random access memory (NVRAM) or a phase change random access memory (PRAM).
  • NVRAM non-volatile volatile random access memory
  • PRAM phase change random access memory
  • MRAM magnetoresistive random access memory
  • non-volatile memory such as at least one disk storage device, electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory) , referred to as EEPROM), flash memory devices, such as NOR flash memory or NAND flash memory.
  • the non-volatile memory stores operating systems and applications executed by the processing unit.
  • the processing unit loads the running program and data from the non-volatile memory into the memory and stores the digital data in a plurality of storage devices.
  • the operating system includes various components and/or drivers for controlling and managing conventional system tasks such as memory management, storage device control, power management, and the like, as well as facilitating communication between various hardware and software.
  • the operating system may be an Android system of Google Inc., an iOS system developed by Apple Corporation, a Windows operating system developed by Microsoft Corporation, or an embedded operating system such as Vxworks.
  • the application includes any application installed on the electronic device, including but not limited to browsers, email, instant messaging services, word processing, keyboard virtualization, widgets, encryption, digital rights management, voice recognition, Voice copying, positioning (such as those provided by GPS), music playback, and more.
  • the power supply is used to power different parts of the electronic device to maintain its operation.
  • the power source may be a built-in battery, such as a common lithium ion battery, a nickel hydrogen battery, etc., and also directly to the electronic An external power source that supplies power to the device, such as an AC adapter.
  • the power source may also be more widely defined, and may further include, for example, a power management system, a charging system, a power failure detecting circuit, a power converter or an inverter, and a power status indicator (such as light emitting diodes, as well as any other components associated with the generation, management and distribution of electrical energy of electronic devices.
  • the image output device 8031 can be used to display a user interface of an application menu; the communication interface 804 can be used to establish a connection with the receiving device for sharing a screen; the processor 802 can be used Determining the shareable image data, the shareable image data is a part of data in the image data corresponding to the user interface; the communication interface 804 is further configured to send, by the connection, the Image data may be shared such that the receiving device displays a user interface of the application menu based on the shareable image data.
  • the processor 802 is further configured to: before determining the shareable image data, determine a secret area in the user interface according to a preset area or a setting operation of the user, where the secret area is a part of the user interface;
  • the process of determining that the image data can be shared includes: determining that the image data corresponding to the non-secure area is the shareable image data, and the non-secure area is an area of the user interface other than the secret area.
  • the processor 802 is further configured to: before determining the shareable image data, determine a non-secure area in the user interface according to a preset area or a setting operation of the user, where the non-secure area is part of the user interface
  • the process of determining the shareable image data includes determining that the image data corresponding to the non-secure area is the shareable image data.
  • the processor 802 is further configured to: before determining the shareable image data, determine a secret display object in the user interface according to a preset display object or a setting operation of the user, where the secret display object is the at least two Displaying a part of the display object in the object; the process of determining that the image data can be shared, comprising: determining that the image data corresponding to the non-secure display object is the shareable image data, and the non-secure display object is at least two display objects A display object other than the secret display object.
  • the processor 802 is further configured to display a preset object or user according to a preset before determining the shareable image data.
  • the predetermined triggering condition includes: receiving a triggering instruction input by the user, the triggering instruction is used to trigger execution of the determining shareable image data; or determining an operation instruction that the user input is not received within a predetermined time period; or It is determined that the number of receiving devices that have established a connection with the sharing device exceeds a predetermined value.
  • the input device 801 is configured to receive the setting operation of the user; the processor 802 is specifically configured to: in a rectangular area in which a line connecting the operation starting point and the operation end point of the setting operation is diagonal Displaying the object as the security display object; or displaying the display object in the closed area formed by the trajectory of the setting operation as the secret display object; or displaying the operation object corresponding to the setting operation as The confidential display object.
  • the input device 801 is configured to receive the setting operation of the user; the processor 802 is specifically configured to use a rectangular area in which a line connecting the operation starting point and the operation end point of the setting operation is a diagonal line
  • the secret area is defined; or the closed area formed by the trajectory of the setting operation is used as the secret area; or the area of the operation object corresponding to the setting operation is displayed as the secret area.
  • the communication interface 804 is further configured to acquire a control instruction sent by the receiving device by using the connection; the processor 802 is further configured to: when the operating area and the secret area overlap, do not respond to the control instruction And responding to the control instruction when the operation area does not coincide with the secret area.
  • the communication interface 804 is further configured to acquire a control instruction sent by the receiving device by using the connection; the processor 802 is further configured to: when the display object corresponding to the control instruction includes the secret display object, does not respond to the And a control instruction; when the display object corresponding to the control instruction does not include the secret display object, responding to the control instruction.
  • the image output device 8031 can also be used to display a user interface of an application menu; the communication interface 804 can also be used to establish a connection with the receiving device for sharing a screen; Receiving, by the receiving device, all image data corresponding to the user interface of the application menu, so that the receiving device displays a user interface of the application menu according to the all image data; acquiring a control instruction sent by the receiving device through the connection
  • the processor 802 is further configured to respond to the control instruction when the control instruction satisfies a predetermined privacy condition.
  • the predetermined security condition includes: the operation area corresponding to the control instruction is not coincident with the security area determined according to the preset area or the setting operation of the user; or the display object corresponding to the control instruction does not include the security display object, wherein The security area is a part of the user interface, and the security display object is a part of at least two display objects of the user interface of the sharing device application menu.
  • the sharing device can only send the shareable image data to the receiving device; thereby enriching the sharing mode of the user interface of the application menu.
  • FIG. 9 a schematic diagram of another embodiment of a receiving device of the present invention is shown.
  • the receiving device is configured to control the sharing device during the sharing of the screen.
  • the sharing device includes components such as an input device 901, a processor 902, an output device 903, a communication interface 904, a memory 905, a peripheral interface 906, and the like.
  • the output device 903 can include an image output device 9031 and an audio output device 9032.
  • the communication interface 904 may be configured to establish a connection with a sharing device for sharing a screen, and receive image data sent by the sharing device, where the image data corresponds to the sharing a part or all of the user interface of the application menu displayed by the device; the image output device 9031 may be configured to display a user interface corresponding to the image data; and the input device 901 may be configured to receive an operation instruction input by the user;
  • the processor 902 may be configured to generate a control instruction corresponding to the operation instruction when the operation instruction satisfies a predetermined security condition; the communication interface 904 may further be configured to send a control instruction to the sharing device, to The receiving device is caused to respond to the control command.
  • the predetermined security condition may include: the operation area corresponding to the operation instruction is in a non-secure area, and the non-secure area is a part of a user interface of the application menu displayed by the sharing device; or the operation instruction The operation object is a non-secure display object, and the non-secure display object is a part of the at least two display objects included in the user interface of the application menu displayed by the sharing device.
  • the predetermined security condition may include: the operation area corresponding to the operation instruction is in the shareable interface, or The operation object of the operation instruction is a display object in the shareable interface.
  • the receiving device can generate the control command when the predetermined confidentiality condition is satisfied, so that the leakage of the user's private information on the receiving device due to all the operation commands input in response to the user can be reduced.
  • the present invention further provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include some or all of the steps in various embodiments of the calling method provided by the present invention.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
  • the techniques in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution in the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product, which may be stored in a storage medium such as a ROM/RAM. , a disk, an optical disk, etc., including instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present invention or portions of the embodiments.
  • a computer device which may be a personal computer, server, or network device, etc.

Abstract

本申请提供了分享屏幕的方法、分享设备及接收设备。所述分享屏幕的方法包括：显示应用菜单的用户界面；建立与所述接收设备之间的用于分享屏幕的连接；确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。采用本实施例分享屏幕，分享设备可以只向接收设备发送可分享图像数据，从而减少屏幕分享带来的送安全性问题。

Description

分享屏幕的方法、分享设备及接收设备 技术领域
本发明涉及智能终端领域，尤其涉及分享屏幕的方法、分享设备及接收设备。
背景技术
无线设备的屏幕分享，也被称为屏幕镜像，是指两个及以上的电子设备建立无线连接后，一个电子设备将其屏幕的图像数据发送到其余与之通信连接的电子设备的屏幕上，以使得其余与之通信连接的设备也能实时地根据该设备发送的图像数据进行图像显示，其中，分享自身屏幕的图像数据的设备称为分享设备，接收图像数据并按照接收到的图像数据进行显示的设备称为接收设备。通过屏幕镜像的方式，可以使一个小范围内的多个用户进行照片共同浏览、合作打游戏、文件资料分享查看等，增加了电子设备的趣味性和实用性。
目前有一些专门的协议来实现不同品牌的互通，如Wi-Fi联盟(Wi-Fi Alliance，简称WFA)制定的Wi-Fi Display协议，又称为Miracast协议；除此之外也有些厂家按照私有协议实现屏幕镜像，只保证与支持该私有协议的设备能够互联互通。在现有的屏幕分享方案下，分享设备将显存中的屏幕图像数据实时编码为视频流，然后发送给接收设备，接收设备接收到视频流之后，根据视频流生成接收画面，并在屏幕上进行显示，从而可以使接收设备与分享设备呈现完全一样的画面。另外，接收设备还可以对分享设备进行控制，如，接收设备的用户在接收设备的屏幕上点击接收画面的应用程序图标时，该触控事件会被转化为控制指令并回传至分享设备，分享设备会响应该控制指令，并实时将画面投射到接收设备，接收设备的用户因而可以看到该触控事件的执行情况，例如，可以看到应用程序的数据。
发明人对现有技术进行研究后发现，采用现有技术进行屏幕分享，分享设备需要向接收设备发送与应用菜单的用户界面所对应的原始图像数据，使得应用菜单的用户界面会完整显示在每一个接收设备上，并且使用者可以通过任意一个接收设备对分享设备进行操作，这种屏幕分享方式比较单一。
发明内容
本发明实施例提供了分享屏幕的方法、分享设备及接收设备，使得应用菜单的用户界面的分享更加灵活多样。
第一方面，本发明实施例提供了一种分享屏幕的方法，用于分享设备与接收设备之间分享屏幕，所述方法包括：
显示应用菜单的用户界面；建立与所述接收设备之间的用于分享屏幕的连接；确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
结合第一方面，在第一方面第一种可能的实现方式中，
所述确定可分享图像数据之前，还包括：根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；所述确定可分享图像数据包括：确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
结合第一方面，在第一方面第二种可能的实现方式中，
所述确定可分享图像数据之前，还包括：根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；所述确定可分享图像数据包括：确定非保密区域对应的图像数据为所述可分享图像数据。
结合第一方面，在第一方面第三种可能的实现方式中，
所述用户界面包括至少两个显示对象；所述确定可分享图像数据之前，还包括：根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；所述确定可分享图像数据包括：确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
结合第一方面，在第一方面第四种可能的实现方式中，
所述用户界面包括至少两个显示对象；所述确定可分享图像数据之前，还包括：根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；所述确定可分享图像数据包括：确定非保密显示对象对应的图像数据为所述可分享图像数据。
结合第一方面或第一方面第一至四种可能的实现方式中的一种，在第一方面第五种可能的实现方式中，
所述确定可分享图像数据之前，还包括以下至少一个：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；确定在预定时间段内未接收到用户输入的操作指令；确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
结合第一方面第一种可能的实现方式，在第一方面第六种可能的实现方式中，
根据用户的设置操作，确定所述用户界面的保密区域之前，还包括：接收用户的所述设置操作；根据用户的设置操作，确定所述用户界面的保密区域，包括：将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
结合第一方面第三种可能的实现方式，在第一方面第七种可能的实现方式中，
确定所述用户界面中的保密显示对象之前，还包括：接收用户的所述设置操作；确定所述用户界面中的保密显示对象，包括：将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
结合第一方面第一、第五或第六种可能的实现方式中的一种，在第一方面第八种可能的实现方式中，
所述向所述接收设备发送所述可分享图像数据之后，所述方法还包括：获取接收设备通过所述连接发送的控制指令；确定所述控制指令对应的操作区域；如果所述操作区域与所述保密区域有重合，不响应所述控制指令；如果所述操作区域与所述保密区域无重合，响应所述控制指令。
结合第一方面第三种可能的实现方式，在第一方面第九种可能的实现方式中，
所述向所述接收设备发送所述可分享图像数据之后，所述方法还包括：获取接收设备通过所述连接发送的控制指令；确定所述控制指令对应的显示对象；如果所述控制指令对应的显示对象包括所述保密显示对象，不响应所述控制指令；如果所述控制指令对应的显示对象不包括所述保密显示对象，响应所述控制指令。
第二方面，本发明实施例提供了一种分享屏幕的方法，用于接收设备对分享设备的控制，所述方法包括：
显示应用菜单的用户界面；建立与所述接收设备之间的用于分享屏幕的连接；通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；获取接收设备通过所述连接发送的控制指令；在所述控制指令满足预定保密条件时，响应所述控制指令。
结合第二方面，在第二方面第一种可能的实现方式中，
所述控制指令满足预定保密条件包括：根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域，所述控制指令对应的操作区域与保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或者，所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
结合第二方面或第二方面第一种可能的实现方式，在第二方面第二种可能的实现方式中，
所述方法还包括，在所述控制指令不满足所述预定保密条件时，不响应所述控制指令。
第三方面，本发明实施例提供了一种分享屏幕的方法，用于接收设备对分享设备的控制，所述方法包括：
建立与分享设备之间的用于分享屏幕的连接；接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；显示所述图像数据对应的用户界面；接收用户输入的操作指令；在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
结合第三方面，在第三方面第一种可能的实现方式中，
所述图像数据对应所述分享设备显示的应用菜单的用户界面的全部；所述控制指令满足预定保密条件，包括：所述操作指令对应的操作区域在非保密区域内，其中，所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；或者，所述 操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
结合第三方面，在第三方面第二种可能的实现方式中，
所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分，所述分享设备显示的应用菜单的用户界面的一部分为可分享界面；所述控制指令满足预定保密条件，包括：所述操作指令对应的操作区域在所述可分享界面中，或者，所述操作指令的操作对象为所述可分享界面中的显示对象。
结合第三方面、第三方面第一种可能的实现方式或第三方面第二种可能的实现方式，在第三方面第三种可能的实现方式中，
所述方法还包括，在所述操作指令不满足所述预定保密条件时，忽略所述操作指令，和/或提示所述操作指令出错。
第四方面，本发明实施例提供了一种分享设备，用于与接收设备之间分享屏幕，所述分享设备包括：
显示单元，用于显示应用菜单的用户界面；连接单元，用于建立与所述接收设备之间的用于分享屏幕的连接；生成单元，用于确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；发送单元，用于通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
结合第四方面，在第四方面第一种可能的实现方式中，
确定单元，用于根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；所述生成单元，具体用于确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
结合第四方面，在第四方面第二种可能的实现方式中，
确定单元，用于根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；所述生成单元，具体用于确定非保密区域对应的图像数据为所述可分享图像数据。
结合第四方面，在第四方面第三种可能的实现方式中，
所述用户界面包括至少两个显示对象；所述设备还包括：确定单元，用于根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；所述生成单元，具体用于确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
结合第四方面，在第四方面第四种可能的实现方式中，
所述用户界面包括至少两个显示对象；所述设备还包括：确定单元，用于根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；所述生成单元，具体用于确定非保密显示对象对应的图像数据为所述可分享图像数据。
结合第四方面或第四方面第一至四种可能的实现方式中的一种，在第四方面第五种可能的实现方式中，
所述生成单元，具体用于在满足预定触发条件时确定可分享图像数据，所述预定触发条件包括：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或者，确定在预定时间段内未接收到用户输入的操作指令；或者，确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
结合第四方面第一种可能的实现方式，在第四方面第六种可能的实现方式中，
接收单元，用于接收用户的所述设置操作；所述确定单元，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
结合第四方面第三种可能的实现方式，在第四方面第七种可能的实现方式中，
接收单元，用于接收用户的所述设置操作；所述确定单元，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
结合第四方面第一、第五或第六种可能的实现方式中的一种，在第四方面第八种可能的实现方式中，
所述设备还包括：获取单元，用于获取接收设备通过所述连接发送的控制指令；定位单元，用于确定所述控制指令对应的操作区域；响应单元，用于当所述操作区域与所述保密区域有重合时，不响应所述控制指令；所述操作区域与所述保密区域无重合时，响应所述控制指令。
结合第四方面第三种可能的实现方式，在第四方面第九种可能的实现方式中，
所述向所述接收设备发送所述可分享图像数据之后，所述设备还包括：获取单元，用于获取接收设备通过所述连接发送的控制指令；定位单元，用于确定所述控制指令对应的显示对象；响应单元，用于当所述控制指令对应的显示对象包括所述保密显示对象时，不响应所述控制指令；当所述控制指令对应的显示对象不包括所述保密显示对象时，响应所述控制指令。
第五方面，本发明实施例提供了一种分享设备，用于与接收设备之间分享屏幕，所述分享设备包括：
显示单元，用于显示应用菜单的用户界面；连接单元，用于建立与所述接收设备之间的用于分享屏幕的连接；发送单元，用于通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；获取单元，用于获取接收设备通过所述连接发送的控制指令；响应单元，用于在所述控制指令满足预定保密条件时，响应所述控制指令。
结合第五方面，在第五方面第一种可能的实现方式中，
所述预定保密条件包括：所述控制指令对应的操作区域与根据预设区域或用户的设置操作确定的保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或者，所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
第六方面，本发明实施例提供了一种接收设备，用于与分享设备之间分享屏幕，所述接收设备包括：
连接单元，用于建立与分享设备之间的用于分享屏幕的连接；接收单元，用于接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；显示单元，用于显示所述图像数据对应的用户界面；输入单元，用于接收用户输入的操作指令；生成单元，用于在所述操作指令满足预定 保密条件时，生成与所述操作指令对应的控制指令；发送单元，用于向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
结合第六方面，在第六方面第一种可能的实现方式中，
所述接收单元，具体用于接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的全部；所述生成单元，具体用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令，所述预定保密条件包括：所述操作指令对应的操作区域在非保密区域内，其中，所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；或者，所述操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
结合第六方面，在第六方面第二种可能的实现方式中，
所述接收单元，具体用于接收所述分享设备发送的对应所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分的图像数据，所述分享设备显示的应用菜单的用户界面的一部分为可分享界面；所述预定保密条件包括：所述操作指令对应的操作区域在所述可分享界面中，或者，所述操作指令的操作对象为所述可分享界面中的显示对象。
第七方面，本发明实施例提供了一种分享设备，用于与接收设备之间分享屏幕，所述分享设备包括：
影像输出装置，通信接口，处理器，所述影像输出装置，用于显示应用菜单的用户界面；所述通信接口，用于建立与所述接收设备之间的用于分享屏幕的连接；所述处理器，用于确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；所述通信接口，还用于通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
结合第七方面，在第七方面第一种可能的实现方式中，
所述处理器，还用于在确定可分享图像数据之前，根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；所述确定可分享图像数据的过程，包括：确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
结合第七方面，在第七方面第二种可能的实现方式中，
所述处理器，还用于在确定可分享图像数据之前，根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；所述确定可分享图像数据的过程，包括：确定非保密区域对应的图像数据为所述可分享图像数据。
结合第七方面，在第七方面第三种可能的实现方式中，
所述用户界面包括至少两个显示对象；所述处理器，还用于在确定可分享图像数据之前，根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；所述确定可分享图像数据的过程，包括：确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
结合第七方面，在第七方面第四种可能的实现方式中，
所述用户界面包括至少两个显示对象；所述处理器，还用于在确定可分享图像数据之前，根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；所述确定可分享图像数据的过程，包括：确定非保密显示对象对应的图像数据为所述可分享图像数据。
结合第七方面或第七方面第一至四种可能的实现方式中的一种，在第七方面第五种可能的实现方式中，
所述预定触发条件包括：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或者，确定在预定时间段内未接收到用户输入的操作指令；或者，确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
结合第七方面第一种可能的实现方式，在第七方面第六种可能的实现方式中，
输入装置，用于接收用户的所述设置操作；所述处理器，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
结合第七方面第三种可能的实现方式，在第七方面第七种可能的实现方式中，
输入装置，用于接收用户的所述设置操作；所述处理器，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
结合第七方面第一、第五或第六种可能的实现方式中的一种，在第七方面第八种可能的实现方式中，
所述通信接口，还用于获取接收设备通过所述连接发送的控制指令；所述处理器，还用于在所述操作区域与所述保密区域有重合时，不响应所述控制指令；在所述操作区域与所述保密区域无重合时，响应所述控制指令。
结合第七方面第三种可能的实现方式，在第七方面第九种可能的实现方式中，
所述通信接口，还用于获取接收设备通过所述连接发送的控制指令；所述处理器，还用于在所述控制指令对应的显示对象包括所述保密显示对象时，不响应所述控制指令；在所述控制指令对应的显示对象不包括所述保密显示对象时，响应所述控制指令。
第八方面，本发明实施例提供了一种分享设备，用于与接收设备之间分享屏幕，所述分享设备包括：
影像输出装置，通信接口，处理器，所述影像输出装置，用于显示应用菜单的用户界面；所述通信接口，用于建立与所述接收设备之间的用于分享屏幕的连接；通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；获取接收设备通过所述连接发送的控制指令；所述处理器，用于在所述控制指令满足预定保密条件时，响应所述控制指令。
结合第八方面，在第八方面第一种可能的实现方式中，
所述预定保密条件包括：所述控制指令对应的操作区域与根据预设区域或用户的设置操作确定的保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或者，所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
第九方面，本发明实施例提供了一种接收设备，用于分享屏幕过程中对分享设 备的控制，所述接收设备包括：
影像输出装置，通信接口，输入装置，处理器，所述通信接口，用于建立与分享设备之间的用于分享屏幕的连接；接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；所述影像输出装置，用于显示所述图像数据对应的用户界面；所述输入装置，用于接收用户输入的操作指令；所述处理器，用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；所述通信接口，还用于向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
结合第九方面，在第九方面第一种可能的实现方式中，
所述预定保密条件包括：所述操作指令对应的操作区域在非保密区域内，其中，所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；或者，所述操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
结合第九方面，在第九方面第二种可能的实现方式中，
所述预定保密条件包括：所述操作指令对应的操作区域在所述可分享界面中，或者，所述操作指令的操作对象为所述可分享界面中的显示对象。
在本发明实施例中，显示应用菜单的用户界面；建立与所述接收设备之间的用于分享屏幕的连接；确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。采用本实施例分享屏幕，分享设备可以只向接收设备发送可分享图像数据，接收设备根据可分享图像数据进行用户界面显示，从而使得应用菜单的用户界面的分享方式更加灵活多样。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本发明屏幕分享方法一个实施例的流程图；
图2A为本发明屏幕分享方法另一个实施例的流程图；
图2B至图2E为本发明分享设备和接收设备连接方式示意图；
图2F至图2I为本发明分享设备保密区域设置操作示意图；
图2J为本发明接收设备屏幕显示效果示意图；
图2K为本发明屏幕分享方法另一个实施例的流程图；
图3为本发明屏幕分享方法另一个实施例的流程图；
图4为本发明屏幕分享方法另一个实施例的流程图；
图5为本发明分享设备一个实施例的示意图；
图6为本发明分享设备另一个实施例的示意图；
图7为本发明接收设备另一个实施例的示意图；
图8为本发明分享设备一个实施例的示意图；
图9为本发明接收设备一个实施例的示意图。
具体实施方式
为了使本领域技术人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所述描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本发明实施例中，分享设备是提供屏幕数据给其他设备的设备，接收设备是接收屏幕数据的设备。其中，分享设备与接收设备均为支持屏幕分享功能的设备，如移动电话、移动电脑、平板电脑、个人数字助理(Personal Digital Assistant，简称PDA)、媒体播放器、智能电视、可穿戴设备等。
本发明实施例中，本发明实施例中，用户界面(User Interface，简称UI)是指设备与用户之间进行交互和信息交换的媒介，它实现信息的设备内部形式与人类可以接受形式之间的转换。
应用菜单的用户界面是指以菜单形式显示有应用程序图标的用户界面，应用菜 单的用户界面可以包括并且不限于下列元素：时间、电池状态指示器、蓝牙指示器、一个或多个无线通信信号强度指示器及应用程序图标。其中，所述用于无线通信信号强度的指示器可以包括一个或多个蜂窝信号指示器及Wi-Fi信号指示器；所述应用程序图标用于激活响应的应用程序，应用图标可以包括地图、记事本、图像管理、照相机、视频播放器等应用的图标。
所述应用菜单的用户界面可以包括通知栏区域和托盘区域。其中，所述时间、电池状态指示器、蓝牙指示器及无线通信信号强度指示器可以设置在所述通知栏区域中；电话、短信、电子邮件客户端、浏览器等频繁使用的应用的应用程序图标可以设置在所述托盘区域中。
本发明实施例中，显示对象是指应用菜单的用户界面中所包括的元素或元素的集合。例如，显示对象可以包括时间显示、电池状态指示器、蓝牙指示器、无线通信信号强度指示器、应用程序图标等元素其中一个或多个所构成的集合。设备可以根据应用菜单的用户界面中全部或部分显示对象的描述信息，重新构建应用菜单的用户界面。
保密显示对象是所述应用菜单的用户界面中所包含显示对象中的一部分显示对象，保密显示对象向用户所提供的信息或保密显示对象对应的可激活应用程序可能会造成分享设备上用户隐私的泄露。所述保密显示对象，可以包括手机银行，支付类应用，邮箱，短信收件箱，即时应用，图片浏览器等应用程序的图标。
非保密显示对象是指所述应用菜单的用户界面中所包含显示对象中除去保密显示对象外剩余的显示对象，非保密显示对象向用户所提供的信息或非保密显示对象对应的可激活应用程序通常不会造成分享设备上用户隐私的泄露。所述非保密对象，可以包括时间显示、电池状态指示器、蓝牙指示器、无线通信信号强度指示器等显示对象。
预设显示对象是指所述应用菜单的用户界面中所包含显示对象中由分享设备的操作系统或分享设备的使用者指定的一个或多个显示对象。根据需要预设显示对象可以作为非保密显示对象，也可以作为保密显示对象。
本发明实施例中，保密区域是所述应用菜单的用户界面中的一部分区域，保密区域所显示的信息或该区域内的显示对象对应的可激活应用程序向用户所提供的信息可能会造成分享设备上用户隐私的泄露。保密区域可以为，用于显示手机银行，支付类应用，邮箱，短信收件箱，即时应用，图片浏览器等应用程序的图标的区域。
非保密区域是所述应用菜单的用户界面中除保密区域外的另一部分区域，非保密区域所显示的信息或非保密区域内显示对象对应的可激活应用程序向用户所提供的信息通常不会造成分享设备上用户隐私的泄露。非保密区域可以包括用于显示如下显示对象的区域：时间显示、电池状态指示器、蓝牙指示器、无线通信信号强度指示器等显示对象。
预设区域是指应用菜单的用户界面中由于分享设备的操作系统或分享设备的使用者预先指定的一部分区域。根据需要预设区域可以作为非保密区域，也可以作为保密区域。
本发明实施例中，预定触发条件是指触发分享设备确定可分享图像数据的预设条件。分享设备可以在满足预定触发条件时，才确定可分享图像数据。预定触发条件可以由分享设备默认设置，或分享设备的用户根据实际需要在分享设备中设置。
本发明实施例中，操作指令是指用户向分享设备或接收设备发送的指令，用于指示分享设备或接收设备运行指定应用程序、在分享设备或接收设备的用户界面上显示指定信息或向分享设备或接收设备发送信息等。所述操作指令可以包括触控指令、语音指令、手势指令等。
本发明实施例中，触发指令是指用于触发分享设备执行所述确定可分享图像数据步骤的一种用户指令。分享设备在接收到用户发出的触发指令后确定可分享图像数据。触发指令是触发条件的一种，也是操作指令的一种。
本发明实施例中，设置操作是指用户在分享设备上进行的用于设置保密区域、非保密区域、保密显示对象或非保密显示对象的操作，所述设置操作可以通过操作指令实现。
本发明实施例中，原始图像数据是指与应用菜单的用户界面所对应的所有图像数据。根据原始图像数据可以完成显示出或构建出与在分享设备屏幕上显示的应用菜单的用户界面一致的用户界面。
本发明实施例中，可分享图像数据是指所述用户界面对应的图像数据中的一部分数据。可分享图像数据中可以不包含在分享屏幕时可能导致分享设备用户隐私信息泄露的数据，根据可分享图像数据所显示的图像，可以减少分享设备上用户隐私信息的泄露。
本发明实施例中，控制指令是指接收设备向分享设备发送的指令，用于指示分 享设备或接收设备运行指定应用程序、在分享设备或接收设备的用户界面上显示指定信息或向分享设备或接收设备发送信息等。
与操作指令对应的控制指令是指所起作用与操作指令相同或相应的控制指令。
控制指令对应的显示对象是指控制指令所指定的显示对象。例如，控制指令指定的应用程序图标。
响应控制指令是指分享设备在接收到控制指令后，按照控制指令的指示运行指定应用程序或按照控制指令的指示在分享设备的用户界面上显示指定信息。
不响应控制指令是指分享设备在接收到控制指令后，不按控制指令的指示运行指定应用程序或不按控制指令的指示在分享设备的用户界面上显示指定信息。
忽略操作指令是指不生成与操作指令对应的控制指令，可选的，可以继续后续的其他正常操作，或者是指虽然生成与操作指令对应的控制指令，但是不将生成的控制指令发送给分享设备，可选的，可以继续后续的其他正常操作。
本发明实施例中，操作区域是指在用户界面中操作指令或控制指令所指定的区域，例如用户在触控操作中的触控区域，根据控制指令中包含的坐标信息确定的区域等。控制指令对应的操作区域是指控制指令所指定的区域；操作指令对应的操作区域是指操作指令所指定的区域。
操作对象是指用户界面中操作指令或控制指令所指定的显示对象，例如用户在触控操作中的应用程序图标，控制指令中指定的应用程序图标等。
本发明实施例中，可分享用户界面是指根据可分享图像数据显示的用户界面。
本发明实施例中，区域之间有重合是指在同一个用户界面中的具有两个区域时，其中一个区域的一部分也是另一个区域的一部分。
下面结合附图，对本发明做详细说明。
参见图1，为本发明屏幕分享方法一个实施例的流程图。该实施例可以由分享设备执行，用于分享设备与接收设备之间分享屏幕。
步骤101，显示应用菜单的用户界面。
分享设备在启动屏幕分享功能前或启动屏幕分享功能后，可以显示应用菜单的用户界面。
步骤102，建立与所述接收设备之间的屏幕分享连接。
分享设备在启动屏幕功能分享后，可以首先开启无线连接功能，以使得接收设备能够与分享设备建立用于实现屏幕分享的无线连接，从而使接收设备能够接收分享设备的屏幕数据，并且能够将控制指令发送给分享设备。
步骤103，确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据。
分享设备在屏幕分享连接建立后，可以确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据。
在一种可能的实现方式中，在确定可分享图像数据之前，分享设备可以根据预设区域或用户的设置操作，确定所述用户界面中的保密区域；然后确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述显示界面中除了所述保密区域之外的区域。
在根据用户的设置操作，确定所述用户界面的保密区域之前，分享设备还可以首先接收用户的所述设置操作；在确定保密区域时，可以将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
在另一种可能的实现方式中，在确定可分享图像数据之前，分享设备也可以根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；然后确定非保密区域对应的图像数据为所述可分享图像数据。
在根据用户的设置操作，确定所述用户界面的非保密区域之前，分享设备也可以首先接收用户的所述设置操作；然后将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述非保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述非保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述非保密区域。
在另一种可能的实现方式中，在确定分享数据之前，分享设备可以根据预设区域或用户的设置操作确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；然后确定非保密显示对象对应的图像数据为 所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
在根据用户的设置操作，确定所述用户界面的保密显示对象之前，分享设备可以首先接收用户的所述设置操作；在确定所述用户界面中的保密显示对象时，可以将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作对应的操作对象作为所述保密显示对象。
在另一种可能的实现方式中，在确定可分享图像数据之前，分享设备也可以根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；然后确定非保密显示对象对应的图像数据为所述可分享图像数据。
在根据用户的设置操作，确定所述用户界面的保密显示对象之前，分享设备也可以首先接收用户的所述设置操作；然后将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述非保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述非保密显示对象；或者，将所述设置操作对应的操作对象作为所述非保密显示对象。
所述确定可分享图像数据之前，还包括以下至少一个步骤：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或者，确定在预定时间段内未接收到用户输入的操作指令；或者，确定已与所述分享设备已建立连接的接收设备的数量超过预定值。分享设备可以在接收到用户输入的触发指令后，确定可分享图像数据，在接收到用户输入的触发指令后确定可分享图像数据，使用户可以根据需要自行确定何时确定可分享图像数据，方便用户使用；或者，分享设备也可以在预定时间段内未接收到用户输入的操作指令时，确定可分享图像数据，在预定时间段内未接收到用户输入的操作指令时确定可分享图像数据，可以减少在用户长时间未操作分享设备时安全性问题；或者，分享设备也可以在已与所述分享设备已建立连接的接收设备的数量超过预定值时，确定可分享图像数据，在已与所述分享设备已建立连接的接收设备的数量超过预定值时确定可分享图像数据，可以减少在接收设备数量众多时安全性问题。
步骤104，通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述 接收设备根据所述可分享图像数据显示应用菜单的用户界面。
在可分享图像数据确定之后，分享设备可以通过所述连接，向所述接收设备发送所述可分享图像数据。分享设备在发送所述分享设备可以对可分享图像数据进行编码，并通过所述连接将编码后的可分享图像数据发送至接收设备。接收设备在接收到编码后的可分享图像数据后，对编码后的可分享图像数据进行解码并进行显示。
当接收设备接收到的可分享图像数据为对应的是图片或视频流时，可以直接显示该图片或视频流；当接收设备接收到的可分享图像数据为描述信息时，接收设备可以根据这些描述信息重新构建一个应用菜单的用户界面并进行显示。
在本实施例中，显示应用菜单的用户界面；建立与所述接收设备之间的用于分享屏幕的连接；确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。采用本实施例分享屏幕，分享设备可以只向接收设备发送可分享图像数据，接收设备根据可分享图像数据进行应用菜单的用户界面显示，从而使得应用菜单的用户界面的分享更加灵活和多样。
参见图2A，为本发明屏幕分享方法另一个实施例的流程图。下面结合该实施例对本发明做进行一步说明。
步骤201，分享设备启动屏幕分享功能。
分享设备首先启动屏幕分享功能，进入屏幕分享状态。启动屏幕分享功能的方法有多种，不同的分享设备可以采用不同的方式启动屏幕分享功能。例如，如果分享设备上安装了屏幕分享应用程序，在接收到用户输入打开屏幕分享应用程序的指令后，分享设备启动屏幕分享功能；如果分享设备上具有屏幕分享功能设置选项，在用户选择启动屏幕分享功能后，进入屏幕分享功能。
步骤202，在屏幕分享启动后，分享设备显示应用菜单的用户界面。
分享设备在启动屏幕分享功能前或启动屏幕分享功能后，通过自身的影像输出装置显示应用菜单的用户界面。所述用户界面，可以由通知栏区域、托盘区域、图标区域等多个区域构成。
步骤203，分享设备建立与所述接收设备之间的用于分享屏幕的连接。
在屏幕分享功能启动后，建立分享设备与所述接收设备之间的屏幕分享连接。
分享设备在启动屏幕功能分享后，开启无线连接功能，以使得接收设备能够与分享设备建立用于屏幕分享的连接，从而使接收设备能够接收分享设备发送的显示数据，并且能够使接收设备将控制指令发送给分享设备。用于屏幕分享的连接的具体实施可以遵照任意可行的无线通信协议，例如，IEEE802.15协议，或是IEEE802.11协议等，包括但不限于蓝牙、紫蜂ZigBee，以及802.11b/g/n/ac/ad/ah等。
以IEEE802.11协议为例，可以采用AP-STA(Access Point-Station，接入点-站点)模式、无线P2P(Peer to Peer)模式、AP(Access Point)中转方式、隧道直连方式等建立所述分享设备与所述接收设备之间的连接。
如图2B所示，分享设备和接收设备可以以AP-STA模式建立直接连接。其中，可以由分享设备作为无线AP，并由接收设备作为STA发现分享设备并与分享设备建立连接。
如图2C所示，分享设备与接收设备可以通过Wi-Fi P2P模式进行直接连接。分享设备可以作为无线P2P群组的GO(Group Owner，群所有者)设备，接收设备作为P2P群组的客户端(Client)设备连接至分享设备。
如图2D所示，分享设备可以通过AP中转与接收设备建立连接。分享设备与接收设备均作为STA与第一AP建立连接。在需要进行显示数据传输时，分享设备向AP发送显示数据，AP再将接收到的显示数据中转给接收设备。
如图2E所示，分享设备与接收设备可以通过隧道直连方式建立连接。分享设备和接收设备首先作为STA分别与第二AP建立相连，随后建立分享设备和接收设备之间隧道直连通道。在需要进行显示数据传输时，分享设备通过隧道直连通道向接收设备发送显示数据。
以上只是列举了几种可行的方案，但本发明并不以此为限。
在此需要说明的是，本发明不对步骤202与步骤203之间的执行顺序进行限定。
步骤204，分享设备根据用户的设置操作，确定所述用户界面中的保密区域。
用户的设置操作可以为多种类型，例如用户可以过鼠标、键盘等外设设备对分享设备完成设置操作；也可以以触控方式完成设置操作；或者也可以通过语音或手势等非接触方式完成设置操作。以下仅以用户以触控方式完成设置操作为例进行说明：
在一种具体实现方式中，分享设备可以将根据用户的触控轨迹确定的矩形区域作为用户界面的保密区域。
如图2F所示，以用户触控操作的操作起点为第一触控点，并以用户触控操作的操作终点为第二触控点，以第一触控点与第二触控点连线作为对角线的矩形就是划定的保密区域，其中，矩形框的边分别平行于分享设备屏幕显示界面的边。分享设备记录当前选定区域的位置信息。
同时分享设备还可以可弹出选项菜单栏，该选项菜单栏显示在屏幕中部，用户在选项菜单中选择一个想要的操作完成本次保密区域设置。例如选项菜单中有“取消”、“重选”和“确定”三种。选择“取消”是放弃本次的设定，第一移动终端可取消选项菜单的显示，取消选定区域矩形框的显示，取消半透明图层的显示，退出设置模式；选择“重选”表示要重新设定保密区域，第一移动终端取消选定区域矩形框和选项菜单栏，用户可重新执行设定步骤；选择“确定”后，第一移动终端取消选项菜单显示，接收选定保密区域矩形框，记录当前选定区域。
在另一种具体实现方式中，分享设备可以将用户的触控轨迹所形成的封闭区域作为用户界面的保密区域。其中，触控轨迹所形成的封闭区域是指触控轨迹所包围的区域。
如图2G所示，用户用手指或其他身体部位触控起始触控点，保持接触，移动手指画圈，最后回到起始触控点后松开，使需要保密的图标或显示区块包含在手指触控轨迹所包围的区域内。所述触控轨迹所包围的区域即为设置的保密区域。同样的，也可弹出选项菜单栏以便于用户通过预设菜单确认保密区域，具体的过程可以参见前述。
在确定保密区域时，也可以在用户界面上给出相应的指示，如图2H所示，以用手指划定矩形保密区为例，分享设备可以在划定的保密区域处覆盖一个新的半透明图层，使该半透明图层的应用无法触发，或是直接遮盖，使该半透明层的应用无法触发且不可见。最常见地，分享设备在屏幕上不做处理，只截取屏幕在处理单元处理，即分享设备的用户看到完全正常的画面。
在另一个实施例中，分享设备也可以根据用户的设置操作，确定所述用户界面中的非保密区域。例如，可以将根据用户的触控轨迹确定的矩形区域作为用户界面的非保密区域，或者也可以将用户的触控轨迹所形成的封闭区域作为用户界面的非保密区域。非保密区域的确定方式与保密区域的确定方式相类似，在此就不再详细描述。
在另一个实施例中，分享设备也可以根据用户的设置操作，确定所述用户界面中的保密显示对象。
如图2I所示，当分享设备进入保密区域设置状态时，将各个应用程序图标进行可点选处理，用户点击所要保密的应用图标后，相应的应用图标即为保密显示对象。同样的，也可弹出选项菜单栏以便于用户通过预设菜单确认保密显示对象，预设菜单具体实现方式可以参见前述。
在另一个实施例中，分享设备也可以根据用户的设置操作，确定所述用户界面中的非保密显示对象。非保密显示对象的确定方式与前述保密显示对象的确定方式相类似，在此就不再详细描述。
在另一个实施例中，分享设备也可以在确定了保密区域之后将保密区域内包含的显示对象作为保密显示对象，或者，分享设备也可以在确定了非保密区域之后将非保密区域内包含的显示对象作为非保密显示对象。
在另一个实施例中，如果分享设备已经保存了保密区域、非保密区域、保密显示对象或非保密显示对象的定位信息，那么也可以根据已保存的定位信息确定保密区域、非保密区域、保密显示对象或非保密显示对象。
在另一个实施例中，分享设备也可以根据需要将预设区域作为保密区域或非保密区域，或者也可以将预设区域内的显示对象作为保密显示对象或非保密显示对象。
例如，当应用菜单的用户界面中包括托盘区域时，分享设备可以直接将托盘区域作为保密区域，或者也可以将设置在托盘区域中的图标作为保密显示对象。
步骤205，确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
在保密区域确定之后，接收设备首先根据保密区域确定非保密区域，所述非保密区域为所述用户界面中除了所述保密区域之外的区域；然后确定非保密区域对应的图像数据为所述可分享图像数据。如果分享设备已经直接确定了非保密区域，那么可以直接确定非保密区域对应的图像数据为所述可分享图像数据。
非保密区域的图像可以是一张图片，该图片是显示应用菜单的用户界面所对应的图片的一部分。由于显示应用菜单的用户界面也为一张图片，原始显示数据通常由像素构成，因此可以用一系列的数组来表示原始显示数据，其中，每一个像素可以由坐标值和色彩值作为数组元素构成的数组表示，坐标值代表该像素点在用户界面中的位置，色彩值代表该像素的颜色。以Android系统设备为例，可以读取SurfaceFlinger服务提供的原始显示数据，得到一系列由像素点坐标(X，Y)和像素点RGB值作为数 组元素构成的数组，所有数组组合起来即为完整的原始显示数据。由于与应用菜单的用户界面所对应的原始显示数据已经存在于分享设备的显存模块中。因此，分设备可以直接从分享设备的显存模块中获取可分享图像数据；或者，也可以首先从分享设备的显存模块中获取原始图像数据，然后根据原始图像数据生成可分享图像数据。
在一种可能的实现方式中，分享设备也可以首先确定非保密区域内所有像素，然后从分享设备的显存模块中获取这些像素对应的数组，非保密区域内所有像素所对应的数组组合起来即为可分享图像数据。
在另一种可能的实现方式中，分享设备可以首先从显存模块中获取原始图像数据，然后将所述原始显示数据中与所述保密区域对应的部分删除，仅保留与非保密区域相对应的部分显示数据作为可分享图像数据，或者将所述原始显示数据中与所述保密区域对应的部分替换为替换数据，从而得到可分享图像数据。
在将所述原始显示数据中与所述保密区域对应的保密数据替换为替换数据时，可以对保密区域内像素所对应的数组中的色彩值进行重新赋值，从而使得替换数据为与所述保密数据不同的显示数据，实现对所述保密区域图像进行保密。对保密区域内每一个像素点的色彩值进行重新赋值后得到屏幕数据即为可分享图像数据。例如，当像素由坐标值和RGB值构成的数组来进行表示时，可以将保密区域内的每个像素点的RGB值写为(0，0，0)或(255，255，255)，即，将该区域内每个像素点都显示为黑色或白色；或者，也可以根据不同的显示效果可以对该保密区域内的像素点逐一进行个性化赋值。
在另一种可能的实现方式中在另一个实施例中，当分享设备确定了保密显示对象或非保密显示对象后，可以确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
例如，分享设备可以首先确定非保密显示对象，获取所有非保密显示对象的描述信息，然后将所有非保密显示对象的描述信息作为可分享图像数据。
在另一个实施例中，确定可分享图像数据之前，分享设备还可以判断是否已满足确定可分享图像数据的触发条件。如果所述已满足触发条件，那么分享设备确定可分享图像数据，如果所述满足触发条件未满足，那么分享设备可以直接将原始显示数据发送至接收设备。
在一种可能的实现方式中，可以以接收到用户输入的触发指令作为触发条件。
例如，分享设备可以判断是否接收到用于设置用户界面中保密区域的设置指令，如果已接收到设置指令，则确定可分享图像数据；如果未接收到设置指令，则无需确定可分享图像数据。其中，设置指令可以是用户发出的语音指令、触控指令、手势指令等。
在另一种可能的实现方式中，可以预定时间内是否出现特定情况作为触发条件。
例如，分享设备可以判定在预定时间段内是否未接收到用户输入的任何操作指令，如果在预定时间段内未接收到用户输入的操作指令，则说明用户长时间未对分享设备进行操作，为防止用户的隐私泄露，可以确定可分享图像数据。其中，预定时间段是根据需要任意设置的时间段，如，自启用屏幕分享功能起的预定时长内，或者，自前次接收到用户操作指令后的预定时长内。
又如，分享设备可以判断在预定时间段内是否未接收到用户输入的用于取消生成可分享图像数据的取消指令。如果在预定时间段内未接收到取消指令，则确定可分享图像数据；如果在预定时间段内接收到了取消指令，则无需确定可分享图像数据。
在另一种可能的实现方式中，可以以分享设备是否出现某种业务状况为触发条件。
例如，分享设备可以检测已经与分享设备建立连接的接收设备的数量是否超过预定值，或者，检测已与分享设备建立连接的接收设备中是否包括预定设备；如果分享设备发现已建立连接的接收设备的数量超过预定值，或者接收设备中包括了特定设备或特定类型的设备等，则生成可分享图像数据；否则，就无需生成可分享图像数据。
在另一种可能的实现方式中，可以以原始显示数据所包含的内容作为触发条件。分享设备可以随时监测原始显示数据的变化，当原始显示数据中包含特定内容时生成可分享图像数据。
例如，当分享设备发现原始显示数据中包括短信提示等特定应用提示画面对应的数据时，生成可分享图像数据。
在此需要说明的，根据触发条件的不同，分享设备可以在屏幕分享功能启动后按照预定频率进行判断，直到满足预定触发条件或者屏幕分享功能关闭为止。
在此需要说明的是本发明不对步骤202、步骤203及步骤204至步骤205之间的执行先后顺序继续进行限定，其执行顺序可以根据需要进行确定。
步骤206，通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
在可分享图像数据生成之后，分享设备可以对可分享图像数据进行压缩编码，并对压缩编码得到的文件进行封包得到传输流，然后对传输流进行传输，从而将可分享图像数据发送给接收设备。
其中，压缩编码的方式有多种，例如当所述可分享图像数据与非保密区域相对应时，其格式通常为图片或视频流，在对可分享图像数据进行压缩编码时，可以以H.264规范中提供的编码方式对可分享图像数据进行编码；在对编码后的可分享图像数据进行封包时，封包方式也可以有多种，例如可以遵照PES封包方法进行封包，进一步编码成MPEG2-TS格式以便于传输；对传输流进行传输时可以采用RTP传输等方式。当所述可分享图像数为描述信息时，可以对描述信息进行压缩去除冗余数据。
接收设备在接收到可分享图像数据后，根据可分享图像数据进行图像显示。当接收设备接收到的可分享图像数据为对应的是图片或视频流时，可以直接显示该图片或视频流，当接收设备接收到的可分享图像数据为描述信息时，接收设备可以根据这些描述信息重新构建一个应用菜单的用户界面并进行显示。
参见图2J为本发明中，接收设备屏幕效果示意图。采用本实施例可以使得接收设备保密区域显示的数据不同于分享设备保密区域所显示的数据。从而达保护隐私信息不泄露的效果。
采用本实施例，可以根据需要设置用户界面的保密区域，分享设备在向接收设备发送屏幕数据时，不发送与保密区域相对应的部分，使得保密区域内原始的图像不会显示在接收设备上，从而可以有效避免因图像显示造成隐私信息泄露。
为防止使用者可以通过接收设备对分享设备进行的操作造成分享设备上用户隐私信息的泄露，如图2K所示，在步骤207之后还可以包括：
步骤207，分享设备获取接收设备通过所述连接发送的控制指令。
在屏幕分享过程中，分享设备可以检测是否接收到来自接收设备的控制指令，其中，控制指令可由接收设备响应用户对接收设备的操作产生。接收指令中可以包括用户在接收设备中的触控位置坐标等信息。
步骤208，确定所述控制指令对应的操作区域。
分享设备在接收到接收设备发送的控制指令后，根据控制指令所包含的信息确 定所述控制指令对应的操作区域。
例如，分享设备可以首先从控制指令所包含的信息中获取用户在接收设备上进行触控操作时所触控的第一坐标范围，然后根据第一坐标范围确定控制指令在接收设备显示菜单的用户界面上进行操作的区域。当第一坐标范围是用户在接收设备的用户界面上进行操作的坐标范围时，由于接收设备用户界面和分享设备的用户界面之间可能存在大小、比例、分辨率等方面的不同，还需要根据接收设备用户界面坐标和分享设备的用户界面坐标之间的转换关系，将接收设备用户界面第一坐标范围转换为分享设备的用户界面上进行操作的第二坐标范围。然后根据第二坐标范围确定控制指令在接收设备显示菜单的用户界面上的操作区域。
在另一个实施例中，分享设备在接收到接收设备发送的控制指令后，可以根据控制指令确定所述控制指令对应的显示对象。
例如，分享设备可以根据控制指令所包含的信息，确定控制指令对应的操作区域，然后将控制指令对应的操作区域内所包含的显示对象作为与所述控制指令对应的显示对象。
步骤209，如果所述操作区域与所述保密区域有重合，不响应所述控制指令；如果所述操作区域与所述保密区域无重合，响应所述控制指令。
由于保密区域和操作区域都是分享设备显示界面上的区域，在所述操作区域确定之后，分享设备可以判断所述操作区域与所述保密区域是否存在有重合。
如果所述操作区域与所述保密区域无重合，那么说明接收设备希望对用户界面中不会泄露分享设备用户隐私信息的区域进行操作，分享设备响应控制指令不会造成分享设备中隐私信息的泄露。此时，分享设备可以响应该控制指令。如果所述操作区域与所述保密区域有重合，那么说明接收设备希望对用户界面中可能会泄露分享设备用户隐私信息的区域进行操作，分享设备响应控制指令可能会造成分享设备中隐私信息的泄露。此时，分享设备可以不响应该控制指令。
在另一个实施例中，在所述控制指令对应显示对象时，如果所述控制指令对应的显示对象包括所述保密显示对象，不响应所述控制指令；如果所述控制指令对应的显示对象不包括所述保密显示对象，响应所述控制指令。
如果所述控制指令对应的显示对象不包括保密显示对象，说明接收设备希望对不会泄露分享设备用户隐私信息的显示对象进行操作，分享设备响应该控制指令不会 造成分享设备中隐私信息的泄露。此时，分享设备可以响应该控制指令。如果所述控制指令对应的显示对象包括保密显示对象，说明说明接收设备希望对可能会泄露分享设备用户隐私信息的显示对象进行操作，分享设备响应该控制指令可能会造成分享设备中隐私信息的泄露。此时，分享设备可以不响应该控制指令。
采用本实施例，分享设备可以只向接收设备发送与非保密区域对应的可分享图像数据；并且只响应符合预定保密条件的控制指令，从而有效避免将原始图像数据发送至接收设备及响应所有控制指令所导致的分享设备上用户隐私信息泄露，减少屏幕分享过程中的安全性问题。
参见图3，为本发明屏幕分享中控制方法一个实施例的流程图。该实施例可以由分享设备执行。
步骤301，显示应用菜单的用户界面。
步骤302，建立与所述接收设备之间的用于分享屏幕的连接。
在此需要说明的是，步骤301与步骤302与前述实施例中的步骤相类似，在此就不再详细描述，相关之处可以看见前述实施例。在此需要说明的是，本实施例不对步骤301与步骤302之间的执行顺序进行限定。
步骤303，通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面。
在所述连接建立之后，发送设备向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，即，在所述连接建立之后，发送设备向所述接收设备发送原始图像数据。
步骤304，获取接收设备通过所述连接发送的控制指令。
步骤305，在所述控制指令满足预定保密条件时，响应所述控制指令。
在接收到控制指令之后，接收设备可以判断所述控制指令是否满足预定保密条件，在所述控制指令满足预定保密条件时，分享设备响应所述控制指令；在所述控制指令不满足所述预定保密条件时，分享设备不响应所述控制指令。
所述预定保密条件可以是指，所述控制指令对应的操作区域与保密区域无重合。接收设备可以根据预设区域或用户的设置操作，确定所述用户界面中的保密区域。然 后判断所述控制指令对应的操作区域与保密区域有无重合，当所述控制指令对应的操作区域与保密区域无重合时响应所述控制指令。
所述预定保密条件也可以是指所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
接收设备可以根据预设区域或用户的设置操作，确定所述用户界面中的保密显示对象。然后判断所述控制指令对应的显示对象是否包括保密显示对象，当所述控制指令对应的显示对象不包括保密显示对象时响应所述控制指令。
当分享设备确定了所述用户界面中的保密显示对象时，在另一个实施例中，如果所述控制指令对应的显示对象包括所述保密显示对象，不响应所述控制指令；如果所述控制指令对应的显示对象不包括所述保密显示对象，响应所述控制指令。
由于本实施例中的步骤与前述实施例中的步骤相类似，相关之处可以看见前述实施例，在此就不再详细描述。
采用本实施例，分享设备只在所述控制指令满足预定保密条件时响应所述控制指令，减少响应所有控制指令可能导致的分享设备上用户隐私信息泄露，从而减少因响应控制指令所带来的安全性问题。
参见图4，为本发明分享屏幕的方法另一个实施例的流程图。该实施例可以由接收设备执行。
步骤401，建立与分享设备之间的用于分享屏幕的连接。
接收设备与分享设备之间建立用于屏幕分享的连接的所采用的具体方式可以参见前述实施例，在此就不再详细描述。
步骤402，接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部。
接收设备所接收到的图像数据可能是原始图像数据，也可能是可分享图像数据。分享设备生成和发送图像数据的是具体方式可以参见前述实施例，在此就不再详细描述。
步骤403，显示所述图像数据对应的用户界面。
当所述图像数据对应所述分享设备显示的应用菜单的用户界面的全部内容时， 即接收设备接收到与原始图像数据时，接收设备显示与原始图像数据相对应的完整图像界面。
当所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分时，所述分享设备显示的应用菜单的用户界面的一部分为可分享界面。具体来说，当所述可分享图像数据为非保密区域对应的图像数据时，接收设备可以根据所述可分享图像数据显示应用菜单的用户界面。例如，当所述可分享图像数据为图片或视频流时，接收设备可以直接显示该图片或视频流。当所述可分享图像数据非保密显示对象对应的图像数据时，接收设备可以根据所述可分享图像数据所包含的非保密显示对象的描述信息构建用户界面并进行显示。
步骤404，接收用户输入的操作指令。
接收设备可以接收用户输入的操作指令。
步骤405，在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令。
在所述操作指令满足预定保密条件时，接收设备生成与所述操作指令对应的控制指令；在所述操作指令不满足预定保密条件时，接收设备忽略该操作指令。其中，忽略操作指令是指不生成与所述操作指令对应的控制指令，或者虽然生成与所述操作指令对应的控制指令，但是不向分享设备发送所述控制指令。
所述保密条件可以是所述操作指令对应的操作区域在非保密区域内，或者，也可以是所述操作指令的操作对象为非保密显示对象，其中，所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
在一种可能的实现方式中，接收设备在接收到用户输入的操作指令后，首先确定所述操作指令对应的操作区域。然后判断所述操作区域是否在所述在非保密区域内，当所述操作区域在所述非保密区域内时，生成与所述操作指令对应的控制指令，当所述操作指令对应的操作区域部分或全部在所述可分享用户界面外时，则忽略该操作指令。
在一种可能的实现方式中，接收设备在接收到用户输入的操作指令后，确定所述操作指令的操作对象。当所述操作指令的操作对象为所述可分享用户界面内的显示对象时，生成与所述操作指令对应的控制指令，当所述操作指令的操作对象不为所述 可分享用户界面内的显示对象时，则忽略该操作指令。
其中，忽略操作指令是指不生成与所述操作指令对应的控制指令，或者虽然生成与所述操作指令对应的控制指令，但是不向分享设备发送所述控制指令。
步骤406，向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
在所述控制控制指令生成之后，接收设备向控制设备发送所述控制指令，以使分享设备能够响应所述控制指令。
采用本实施例，接收设备可以在满足预定保密条件时才生成控制指令，从而可以防止用户输入的操作指令造成接收设备上用户隐私信息的泄露，减少因响应用户输入的操作指令给分享设备带来的安全性问题。
与本发明分享屏幕的方法相对应，本发明还提供了分享设备和接收设备。
如图5所示，为本发明分享设备一个实施例的示意图。该分享设备包括显示单元501，连接单元502，生成单元503，发送单元504。
其中，所述显示单元501，用于显示应用菜单的用户界面；
所述连接单元502，用于建立与所述接收设备之间的用于分享屏幕的连接；
所述生成单元503，用于确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；
所述发送单元504，用于通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
在另一个实施例中，所述设备还可以包括：确定单元。
在一种可能的实现方式中，
所述确定单元，可以用于根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；所述生成单元503，可以用于确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
在另一种可能的实现方式中，
所述确定单元，可以用于根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；所述生成单元503， 可以用于确定非保密区域对应的图像数据为所述可分享图像数据。
在另一种可能的实现方式中，所述用户界面包括至少两个显示对象；
所述确定单元，可以用于根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；所述生成单元503，可以用于确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
在另一种可能的实现方式中，所述用户界面包括至少两个显示对象；
所述确定单元，可以用于根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；所述生成单元503，可以用于确定非保密显示对象对应的图像数据为所述可分享图像数据。
在另一个实施例中，所述生成单元503，可以在满足如下触发条件时确定可分享图像数据：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或，确定在预定时间段内未接收到用户输入的操作指令；或，确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
在另一个实施例中，所述设备还可以包括：接收单元。
在另一种可能的实现方式中，
所述接收单元，可以用于接收用户的所述设置操作；所述确定单元，可以用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
在另一种可能的实现方式中，
所述接收单元，可以用于接收用户的所述设置操作；所述确定单元，可以用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
在另一个实施例中，所述设备还包括：获取单元，定位单元，响应单元。
在另一种可能的实现方式中，
所述获取单元，可以用于获取接收设备通过所述连接发送的控制指令；
所述定位单元，可以用于确定所述控制指令对应的操作区域；
所述响应单元，可以用于当所述操作区域与所述保密区域有重合时，不响应所述控制指令；当所述操作区域与所述保密区域无重合时，响应所述控制指令。
在另一种可能的实现方式中，
所述获取单元，可以用于获取接收设备通过所述连接发送的控制指令；
所述定位单元，可以用于确定所述控制指令对应的显示对象；
所述响应单元，可以用于当所述控制指令对应的显示对象包括所述保密显示对象时，不响应所述控制指令；当所述控制指令对应的显示对象不包括所述保密显示对象时，响应所述控制指令。
采用本实施例，分享设备可以只向接收设备发送可分享图像数据；从而有效避免将原始图像数据发送至接收设备所导致的分享设备上用户隐私信息泄露，减少屏幕分享过程中的安全性问题。
如图6所示，为本发明分享设备另一个实施例的示意图。该分分享设备包括显示单元601，连接单元602，发送单元603，获取单元604，响应单元605。
其中，所述显示单元601，用于显示应用菜单的用户界面；
所述连接单元602，用于建立与所述接收设备之间的用于分享屏幕的连接；
所述发送单元603，用于通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；
所述获取单元604，用于获取接收设备通过所述连接发送的控制指令；
所述响应单元605，用于在所述控制指令满足预定保密条件时，响应所述控制指令。
在一种可能的实现方式中，
所述响应单元605，具体用于在满足所述控制指令满足如下预定保密条件时，响 应所述控制指令：
所述控制指令对应的操作区域与根据预设区域或用户的设置操作确定的保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
采用本实施例，分享设备只在所述控制指令满足预定保密条件时响应所述控制指令，从而可以减少响应所有控制指令可能造成的分享设备上的用户隐私信息泄露，减少屏幕分享过程中的安全性问题。
如图7所示，为本发明接收设备一个实施例的示意图。所述接收设备包括连接单元701，接收单元702，显示单元703，输入单元704，生成单元705，发送单元706。
其中，所述连接单元701，用于建立与分享设备之间的用于分享屏幕的连接；
所述接收单元702，用于通过所述连接接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；
所述显示单元703，用于显示所述图像数据对应的用户界面；
所述输入单元704，用于接收用户输入的操作指令；
所述生成单元705，用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；
所述发送单元706，用于通过所述连接向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
在一种可能的实现方式中，
所述接收单元702，可以用于接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的全部；
所述生成单元705，用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令，所述预定保密条件包括：所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；或所述操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
在一种可能的实现方式中，
所述接收单元702，可以用于接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分，所述分享设备显示的应用菜单的用户界面的一部分为可分享界面；
所述生成单元705，用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令，所述预定保密条件包括：所述操作指令对应的操作区域在所述可分享界面中，或所述操作指令的操作对象为所述可分享界面中的显示对象。
在一种可能的实现方式中，在所述操作指令满足预定保密条件时，所述生成单元705，可以不生成与所述操作指令对应的控制指令；或者，虽然所述生成单元705生成与所述操作指令对应的控制指令，但是所述发送单元706不向所述分享设备发送控制指令。
采用本实施例，接收设备可以在满足预定保密条件时才生成控制指令，从而可以防止用户输入的操作指令造成接收设备上用户隐私信息的泄露。
参见图8，为本发明分享设备另一个实施例的示意图。所述分享设备用于与接收设备之间分享屏幕。
如图8所示，所述分享设备包括输入装置801、处理器802、输出装置803、通信接口804、存储器805、外设接口806等组件。这些组件通过一条或多条总线进行通信。本领域技术人员可以理解，图中示出的电子设备的结构并不构成对本发明的限定，它既可以是总线形结构，也可以是星型结构，还可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。在本发明实施方式中，分享设备及接收设备均可以是任何移动或便携式电子设备，包括但不限于移动电话、移动电脑、平板电脑、个人数字助理(Personal Digital Assistant,PDA)、媒体播放器、智能电视，以及上述两项或两项以上的组合等。
输入装置801用于实现用户与电子设备的交互和/或信息输入到电子设备中。例如，输入装置801可以接收用户输入的数字或字符信息，以产生与用户设置或功能控制有关的信号输入。在本发明具体实施方式中，输入装置801可以是触控面板，也可以是其他人机交互界面，例如实体输入键、麦克风等，还可是其他外部信息撷取装置，例如摄像头等。触控面板，也称为触摸屏或触控屏，可收集用户在其上触摸或接近的操作动作。比如用户使用手指、触笔等任何适合的物体或附件在触控面板上或接近触控面板的位置的操作动作，并根据预先设定的程式驱动相应的连接装置。可选的，触控面板可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的 触摸操作，并将检测到的触摸操作转换为电信号，以及将所述电信号传送给触摸控制器；触摸控制器从触摸检测装置上接收所述电信号，并将它转换成触点坐标，再送给处理单元。所述触摸控制器还可以接收处理单元发来的命令并执行。此外，可以采用电阻式、电容式、红外线(Infrared)以及表面声波等多种类型实现触控面板。在本发明的其他实施方式中，输入装置801所采用的实体输入键可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。麦克风形式的输入装置801可以收集用户或环境输入的语音并将其转换成电信号形式的、处理单元可执行的命令。
在本发明的其他一些实施方式中，所述输入装置801还可以是各类传感器件，例如霍尔器件，用于检测电子设备的物理量，例如力、力矩、压力、应力、位置、位移、速度、加速度、角度、角速度、转数、转速以及工作状态发生变化的时间等，转变成电量来进行检测和控制。其他的一些传感器件还可以包括重力感应计、三轴加速计、陀螺仪等。
处理器802为电子设备的控制中心，利用各种接口和线路连接整个电子设备的各个部分，通过运行或执行存储在存储器805内的软件程序和/或模块，以及调用存储在存储器805内的数据，以执行电子设备的各种功能和/或处理数据。所述处理器802可以由集成电路(Integrated Circuit，简称IC)组成，例如可以由单颗封装的IC所组成，也可以由连接多颗相同功能或不同功能的封装IC而组成。举例来说，处理器802可以仅包括中央处理器(Central Processing Unit，简称CPU)，也可以是GPU、数字信号处理器(Digital Signal Processor，简称DSP)、及通信接口804中的控制芯片(例如基带芯片)的组合。在本发明实施方式中，CPU可以是单运算核心，也可以包括多运算核心。
所述通信接口804用于建立通信信道，使分享设备通过所述通信信道连接到接收设备。所述通信接口804可以包括无线局域网(Wireless Local Area Network，简称wireless LAN)模块、蓝牙模块、基带(Base Band)模块等通信模块，以及所述通信模块对应的射频(Radio Frequency，简称RF)电路，用于进行无线局域网络通信、蓝牙通信、红外线通信及/或蜂窝式通信系统通信，例如宽带码分多重接入(Wideband Code Division Multiple Access，简称W-CDMA)及/或高速下行封包存取(High Speed Downlink Packet Access，简称HSDPA)。所述通信模块用于控制电子设备中的各组件的通信，并且可以支持直接内存存取(Direct Memory Access)。
在本发明的不同实施方式中，所述通信接口804中的各种通信模块一般以集成电路芯片(Integrated Circuit Chip)的形式出现，并可进行选择性组合，而不必包括所有通信模块及对应的天线组。例如，所述通信接口804可以仅包括基带芯片、射频芯片以及相应的天线以在一个蜂窝通信系统中提供通信功能。经由所述通信接口804建立的无线通信连接，例如无线局域网接入或WCDMA接入，所述电子设备可以连接至蜂窝网(Cellular Network)或因特网(Internet)。在本发明的一些可选实施方式中，所述通信接口804中的通信模块，例如基带模块可以集成到处理器802中，典型的如高通(Qualcomm)公司提供的APQ+MDM系列平台。
射频电路用于信息收发或通话过程中接收和发送信号。例如，将分享设备处理过的共享屏幕数据的传输流传给接收设备，接收接收设备回传的触控指令等。通常，所述射频电路包括用于执行这些功能的公知电路，包括但不限于天线系统、射频收发机、一个或多个放大器、调谐器、一个或多个振荡器、数字信号处理器、编解码(Codec)芯片组、用户身份模块(SIM)卡、存储器等等。此外，射频电路还可以通过无线通信与网络和其他设备通信。所述无线通信可以使用任一通信标准或协议，包括但不限于GSM(Global System of Mobile communication，全球移动通讯系统)、GPRS(General Packet Radio Service，通用分组无线服务)、CDMA(Code Division Multiple Access，码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、高速上行行链路分组接入技术(High Speed Uplink Packet Access，HSUPA)、LTE(Long Term Evolution,长期演进)、电子邮件、SMS(Short Messaging Service，短消息服务)等。
输出装置803包括但不限于影像输出装置8031和声音输出装置8032。影像输出装置803用于输出文字、图片和/或视频。所述影像输出装置8031可包括显示面板，例如采用LCD(Liquid Crystal Display，液晶显示器)、OLED(Organic Light-Emitting Diode，有机发光二极管)、场发射显示器(field emission display，简称FED)等形式来配置的显示面板。或者所述影像输出装置8031可以包括反射式显示器，例如电泳式(electrophoretic)显示器，或利用光干涉调变技术(Interferometric Modulation of Light)的显示器。所述影像输出装置8031可以包括单个显示器或不同尺寸的多个显示器。在本发明的具体实施方式中，上述输入装置801所采用的触控面板亦可同时作为输出装置8031的显示面板。例如，触控面板显示当前的显示画面，同时可以接收到用户划定保密区域的指令。虽然在结构图中，输入装置801与输出装置803是作为两个独立的部件来实现电子设备的输入和输出功能，但是在某些实施例中，可以将触控面板与显示面板集成一体而实现电子设备的输入和输出功能。例如，所述影像输出装置 803可以显示各种图形化用户接口(Graphical User Interface，简称GUI)以作为虚拟控制组件，包括但不限于窗口、卷动轴、图标及剪贴簿，以供用户通过触控方式进行操作。
在本发明具体实施方式中，影像输出装置8031包括滤波器及放大器，用来将处理单元所输出的视频滤波及放大。音频输出装置8032包括数字模拟转换器，用来将处理单元所输出的音频信号从数字格式转换为模拟格式。
存储器805可用于存储软件程序以及模块，处理单元通过运行存储在存储器805的软件程序以及模块，从而执行电子设备的各种功能应用以及实现数据处理。存储器805主要包括程序存储区和数据存储区，其中，程序存储区可存储操作系统、至少一个功能所需的应用程序，比如声音播放程序、图像播放程序等等；数据存储区可存储根据电子设备的使用所创建的数据(比如音频数据、电话本等)等。在本发明具体实施方式中，存储器805可以包括易失性存储器，例如非挥发性动态随机存取内存(Nonvolatile Random Access Memory，简称NVRAM)、相变化随机存取内存(Phase Change RAM，简称PRAM)、磁阻式随机存取内存(Magetoresistive RAM，简称MRAM)等，还可以包括非易失性存储器，例如至少一个磁盘存储器件、电子可擦除可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，简称EEPROM)、闪存器件，例如反或闪存(NOR flash memory)或是反及闪存(NAND flash memory)。非易失存储器储存处理单元所执行的操作系统及应用程序。所述处理单元从所述非易失存储器加载运行程序与数据到内存并将数字数据储存于大量储存装置中。所述操作系统包括用于控制和管理常规系统任务，例如内存管理、存储设备控制、电源管理等，以及有助于各种软硬件之间通信的各种组件和/或驱动器。在本发明实施方式中，所述操作系统可以是Google公司的Android系统、Apple公司开发的iOS系统或Microsoft公司开发的Windows操作系统等，或者是Vxworks这类的嵌入式操作系统。
所述应用程序包括安装在电子设备上的任何应用，包括但不限于浏览器、电子邮件、即时消息服务、文字处理、键盘虚拟、窗口小部件(Widget)、加密、数字版权管理、语音识别、语音复制、定位(例如由全球定位系统提供的功能)、音乐播放等等。
电源用于给电子设备的不同部件进行供电以维持其运行。作为一般性理解，所述电源可以是内置的电池，例如常见的锂离子电池、镍氢电池等，也包括直接向电子 设备供电的外接电源，例如AC适配器等。在本发明的一些实施方式中，所述电源还可以作更为广泛的定义，例如还可以包括电源管理系统、充电系统、电源故障检测电路、电源转换器或逆变器、电源状态指示器(如发光二极管)，以及与电子设备的电能生成、管理及分布相关联的其他任何组件。
在一种可能的实现方式中，
所述影像输出装置8031，可以用于显示应用菜单的用户界面；所述通信接口804，可以用于建立与所述接收设备之间的用于分享屏幕的连接；所述处理器802，可以用于确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；所述通信接口804，还可以用于通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
在另一种可能的实现方式中，
所述处理器802，还用于在确定可分享图像数据之前，根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；所述确定可分享图像数据的过程，包括：确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
在另一种可能的实现方式中，
所述处理器802，还用于在确定可分享图像数据之前，根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；所述确定可分享图像数据的过程，包括：确定非保密区域对应的图像数据为所述可分享图像数据。
在另一种可能的实现方式中，
所述处理器802，还用于在确定可分享图像数据之前，根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；所述确定可分享图像数据的过程，包括：确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
在另一种可能的实现方式中，
所述处理器802，还用于在确定可分享图像数据之前，根据预设显示对象或用户 的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；所述确定可分享图像数据的过程，包括：确定非保密显示对象对应的图像数据为所述可分享图像数据。
在另一种可能的实现方式中，
所述预定触发条件包括：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或者，确定在预定时间段内未接收到用户输入的操作指令；或者，确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
在另一种可能的实现方式中，
所述输入装置801，用于接收用户的所述设置操作；所述处理器802，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
在另一种可能的实现方式中，
所述输入装置801，用于接收用户的所述设置操作；所述处理器802，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
在另一种可能的实现方式中，
所述通信接口804，还用于获取接收设备通过所述连接发送的控制指令；所述处理器802，还用于在所述操作区域与所述保密区域有重合时，不响应所述控制指令；在所述操作区域与所述保密区域无重合时，响应所述控制指令。
在另一种可能的实现方式中，
所述通信接口804，还用于获取接收设备通过所述连接发送的控制指令；所述处理器802，还用于在所述控制指令对应的显示对象包括所述保密显示对象时，不响应所述控制指令；在所述控制指令对应的显示对象不包括所述保密显示对象时，响应所述控制指令。
在另一个实施例中，
所述影像输出装置8031，还可以用于显示应用菜单的用户界面；所述通信接口804，还可以用于建立与所述接收设备之间的用于分享屏幕的连接；通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；获取接收设备通过所述连接发送的控制指令；所述处理器802，还可以用于在所述控制指令满足预定保密条件时，响应所述控制指令。
所述预定保密条件包括：所述控制指令对应的操作区域与根据预设区域或用户的设置操作确定的保密区域无重合；或者，所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密区域为所述用户界面的一部分区域，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
采用本实施例，分享设备可以只向接收设备发送可分享图像数据；从而丰富应用菜单的用户界面的分享方式。
参见图9，为本发明接收设备另一个实施例的示意图。所述接收设备用于分享屏幕过程中对分享设备的控制。
如图9所示，所述分享设备包括输入装置901、处理器902、输出装置903、通信接口904、存储器905、外设接口906等组件。其中，所述输出装置903可以包括影像输出装置9031及音频输出装置9032。各装置的功能和各装置之间的连接关系可以参见前述实施例，在此就不再赘述。
在一种可能的实现方式中，所述通信接口904，可以用于建立与分享设备之间的用于分享屏幕的连接；接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；所述影像输出装置9031，可以用于显示所述图像数据对应的用户界面；所述输入装置901，可以用于接收用户输入的操作指令；所述处理器902，可以用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；所述通信接口904，可以还用于向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
其中，所述预定保密条件可以包括：所述操作指令对应的操作区域在非保密区域内，所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；或者，所述操作指令的操作对象为非保密显示对象，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。或者，所述预定保密条件也可以包括：所述操作指令对应的操作区域在所述可分享界面中，或者， 所述操作指令的操作对象为所述可分享界面中的显示对象。
采用本实施例，接收设备可以在满足预定保密条件时才生成控制指令，从而可以减少由于响应用户输入的所有操作指令可能造成的接收设备上用户隐私信息的泄露。
具体实现中，本发明还提供一种计算机存储介质，其中，该计算机存储介质可存储有程序，该程序执行时可包括本发明提供的呼叫方法的各实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等。
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于装置、服务器、系统实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
以上所述的本发明实施方式，并不构成对本发明保护范围的限定。任何在本发明的精神和原则之内所作的修改、等同替换和改进等，均应包含在本发明的保护范围之内。

Claims (47)

  1. 一种分享屏幕的方法，用于分享设备与接收设备之间分享屏幕，其特征在于，所述方法包括：
    显示应用菜单的用户界面；
    建立与所述接收设备之间的用于分享屏幕的连接；
    确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；
    通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
  2. 如权利要求1所述的方法，其特征在于，所述确定可分享图像数据之前，还包括：
    根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；
    所述确定可分享图像数据包括：
    确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
  3. 如权利要求1所述的方法，其特征在于，所述确定可分享图像数据之前，还包括：
    根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；
    所述确定可分享图像数据包括：
    确定非保密区域对应的图像数据为所述可分享图像数据。
  4. 如权利要求1所述的方法，其特征在于，所述用户界面包括至少两个显示对象；
    所述确定可分享图像数据之前，还包括：
    根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；
    所述确定可分享图像数据包括：
    确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
  5. 如权利要求1所述的方法，其特征在于，所述用户界面包括至少两个显示对象；
    所述确定可分享图像数据之前，还包括：
    根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；
    所述确定可分享图像数据包括：
    确定非保密显示对象对应的图像数据为所述可分享图像数据。
  6. 如权利要求1至5任一项所述的方法，其特征在于，所述确定可分享图像数据之前，还包括以下至少一个：
    接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；
    确定在预定时间段内未接收到用户输入的操作指令；
    确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
  7. 如权利要求2所述的方法，其特征在于，根据用户的设置操作，确定所述用户界面的保密区域之前，还包括：
    接收用户的所述设置操作；
    根据用户的设置操作，确定所述用户界面的保密区域，包括：
    将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；
    或者，
    将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；
    或者，
    将显示所述设置操作对应的操作对象的区域作为所述保密区域。
  8. 如权利要求4所述的方法，其特征在于，根据用户的设置操作，确定所述用户界面中的保密显示对象之前，还包括：
    接收用户的所述设置操作；
    确定所述用户界面中的保密显示对象，包括：
    将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；
    或者，
    将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；
    或者，
    将显示所述设置操作对应的操作对象作为所述保密显示对象。
  9. 如权利要求2，6或7中任一项所述的方法，其特征在于，所述向所述接收设备发送所述可分享图像数据之后，所述方法还包括：
    获取接收设备通过所述连接发送的控制指令；
    确定所述控制指令对应的操作区域；
    如果所述操作区域与所述保密区域有重合，不响应所述控制指令；
    如果所述操作区域与所述保密区域无重合，响应所述控制指令。
  10. 如权利要求4所述的方法，其特征在于，所述向所述接收设备发送所述可分享图像数据之后，所述方法还包括：
    获取接收设备通过所述连接发送的控制指令；
    确定所述控制指令对应的显示对象；
    如果所述控制指令对应的显示对象包括所述保密显示对象，不响应所述控制指令；
    如果所述控制指令对应的显示对象不包括所述保密显示对象，响应所述控制指令。
  11. 一种分享屏幕的方法，用于接收设备对分享设备的控制，其特征在于，所述方法包括：
    显示应用菜单的用户界面；
    建立与所述接收设备之间的用于分享屏幕的连接；
    通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；
    获取接收设备通过所述连接发送的控制指令；
    在所述控制指令满足预定保密条件时，响应所述控制指令。
  12. 如权利要求11所述的方法，其特征在于，所述控制指令满足预定保密条件包括：
    根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域，
    所述控制指令对应的操作区域与保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或者，
    所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
  13. 如权利要求11或12所述的方法，其特征在于，所述方法还包括，在所述控制指令不满足所述预定保密条件时，不响应所述控制指令。
  14. 一种分享屏幕的方法，用于接收设备对分享设备的控制，其特征在于，所述方法包括：
    建立与分享设备之间的用于分享屏幕的连接；
    接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；
    显示所述图像数据对应的用户界面；
    接收用户输入的操作指令；
    在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；
    向所述分享设备发送所述控制指令，以使所述接收设备响应所述控制指令。
  15. 如权利要求14所述的方法，其特征在于，所述图像数据对应所述分享设备显示的应用菜单的用户界面的全部；
    所述控制指令满足预定保密条件，包括：
    所述操作指令对应的操作区域在非保密区域内，其中，所述非保密区域为所述分享设备显示的应用菜单的用户界面的一部分区域；或者，
    所述操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
  16. 如权利要求14所述的方法，其特征在于，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分，所述分享设备显示的应用菜单的用户界面的一部分为可分享界面；
    所述控制指令满足预定保密条件，包括：
    所述操作指令对应的操作区域在所述可分享界面中，或者，
    所述操作指令的操作对象为所述可分享界面中的显示对象。
  17. 如权利要求14至16任一项所述的方法，其特征在于，所述方法还包括，在所述操作指令不满足所述预定保密条件时，忽略所述操作指令，和/或提示所述操作指令出错。
  18. 一种分享设备，用于与接收设备之间分享屏幕，其特征在于，所述分享设备包括：
    显示单元，用于显示应用菜单的用户界面；
    连接单元，用于建立与所述接收设备之间的用于分享屏幕的连接；
    生成单元，用于确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；
    发送单元，用于通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
  19. 如权利要求18所述的设备，其特征在于，还包括：
    确定单元，用于根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；
    所述生成单元，具体用于确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
  20. 如权利要求18所述的设备，其特征在于，还包括：
    确定单元，用于根据预设区域或用户的设置操作，确定所述用户界面中的非 保密区域，所述非保密区域为所述用户界面的一部分区域；
    所述生成单元，具体用于确定非保密区域对应的图像数据为所述可分享图像数据。
  21. 如权利要求18所述的设备，其特征在于，所述用户界面包括至少两个显示对象；所述设备还包括：
    确定单元，用于根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；
    所述生成单元，具体用于确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
  22. 如权利要求18所述的设备，其特征在于，所述用户界面包括至少两个显示对象；所述设备还包括：
    确定单元，用于根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；
    所述生成单元，具体用于确定非保密显示对象对应的图像数据为所述可分享图像数据。
  23. 如权利要求18至22任一项所述的设备，其特征在于，
    所述生成单元，具体用于在满足预定触发条件时确定可分享图像数据，所述预定触发条件包括：
    接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或者，
    确定在预定时间段内未接收到用户输入的操作指令；或者，
    确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
  24. 如权利要求19所述的设备，其特征在于，所述设备还包括：
    接收单元，用于接收用户的所述设置操作；
    所述确定单元，具体用于将以所述设置操作的操作起点与操作终点之间连线 为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
  25. 如权利要求21所述的设备，其特征在于，所述设备还包括：
    接收单元，用于接收用户的所述设置操作；
    所述确定单元，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
  26. 如权利要求19，23或24中任一项所述的设备，其特征在于，所述设备还包括：
    获取单元，用于获取接收设备通过所述连接发送的控制指令；
    定位单元，用于确定所述控制指令对应的操作区域；
    响应单元，用于当所述操作区域与所述保密区域有重合时，不响应所述控制指令；当所述操作区域与所述保密区域无重合时，响应所述控制指令。
  27. 如权利要求21所述的设备，其特征在于，所述向所述接收设备发送所述可分享图像数据之后，所述设备还包括：
    获取单元，用于获取接收设备通过所述连接发送的控制指令；
    定位单元，用于确定所述控制指令对应的显示对象；
    响应单元，用于当所述控制指令对应的显示对象包括所述保密显示对象时，不响应所述控制指令；当所述控制指令对应的显示对象不包括所述保密显示对象时，响应所述控制指令。
  28. 一种分享设备，用于与接收设备之间分享屏幕，其特征在于，所述分享设备包括：
    显示单元，用于显示应用菜单的用户界面；
    连接单元，用于建立与所述接收设备之间的用于分享屏幕的连接；
    发送单元，用于通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应 用菜单的用户界面；
    获取单元，用于获取接收设备通过所述连接发送的控制指令；
    响应单元，用于在所述控制指令满足预定保密条件时，响应所述控制指令。
  29. 如权利要求28所述的设备，其特征在于，
    所述预定保密条件包括：所述控制指令对应的操作区域与根据预设区域或用户的设置操作确定的保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或者，所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
  30. 一种接收设备，用于与分享设备之间分享屏幕，其特征在于，所述接收设备包括：
    连接单元，用于建立与分享设备之间的用于分享屏幕的连接；
    接收单元，用于接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；
    显示单元，用于显示所述图像数据对应的用户界面；
    输入单元，用于接收用户输入的操作指令；
    生成单元，用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；
    发送单元，用于向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
  31. 如权利要求30所述的设备，其特征在于，
    所述接收单元，具体用于接收所述分享设备发送的对应所述分享设备显示的应用菜单的用户界面的全部的图像数据；
    所述预定保密条件包括：所述操作指令对应的操作区域在非保密区域内，其中，所述非保密区域为所述分享设备显示的应用菜单的用户界面的一部分区域；或者，所述操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
  32. 如权利要求30所述的设备，其特征在于，
    所述接收单元，具体用于接收所述分享设备发送的对应所述分享设备显示的应用菜单的用户界面的一部分的图像数据，所述分享设备显示的应用菜单的用户界面的一部分为可分享界面；
    所述预定保密条件包括：所述操作指令对应的操作区域在所述可分享界面中，或者，所述操作指令的操作对象为所述可分享界面中的显示对象。
  33. 一种分享设备，用于与接收设备之间分享屏幕，其特征在于，包括：
    影像输出装置，通信接口，处理器，
    所述影像输出装置，用于显示应用菜单的用户界面；
    所述通信接口，用于建立与所述接收设备之间的用于分享屏幕的连接；
    所述处理器，用于确定可分享图像数据，所述可分享图像数据为所述用户界面对应的图像数据中的一部分数据；
    所述通信接口，还用于通过所述连接，向所述接收设备发送所述可分享图像数据，以便所述接收设备根据所述可分享图像数据显示应用菜单的用户界面。
  34. 如权利要求33所述的设备，其特征在于，
    所述处理器，还用于在确定可分享图像数据之前，根据预设区域或用户的设置操作，确定所述用户界面中的保密区域，所述保密区域为所述用户界面的一部分区域；
    所述确定可分享图像数据的过程，包括：确定非保密区域对应的图像数据为所述可分享图像数据，所述非保密区域为所述用户界面中除了所述保密区域之外的区域。
  35. 如权利要求33所述的设备，其特征在于，
    所述处理器，还用于在确定可分享图像数据之前，根据预设区域或用户的设置操作，确定所述用户界面中的非保密区域，所述非保密区域为所述用户界面的一部分区域；
    所述确定可分享图像数据的过程，包括：确定非保密区域对应的图像数据为所述可分享图像数据。
  36. 如权利要求33所述的设备，其特征在于，所述用户界面包括至少两个 显示对象；
    所述处理器，还用于在确定可分享图像数据之前，根据预设显示对象或用户的设置操作，确定所述用户界面中的保密显示对象，所述保密显示对象为所述至少两个显示对象中的一部分显示对象；
    所述确定可分享图像数据的过程，包括：确定非保密显示对象对应的图像数据为所述可分享图像数据，所述非保密显示对象为至少两个显示对象中除了所述保密显示对象之外的显示对象。
  37. 如权利要求33所述的设备，其特征在于，所述用户界面包括至少两个显示对象；
    所述处理器，还用于在确定可分享图像数据之前，根据预设显示对象或用户的设置操作，确定所述用户界面中的非保密显示对象，所述非保密显示对象为所述至少两个显示对象中的一部分显示对象；
    所述确定可分享图像数据的过程，包括：确定非保密显示对象对应的图像数据为所述可分享图像数据。
  38. 如权利要求33至37任一项所述的设备，其特征在于，
    所述预定触发条件包括：接收到用户输入的触发指令，所述触发指令用于触发执行所述确定可分享图像数据；或者，确定在预定时间段内未接收到用户输入的操作指令；或者，确定已与所述分享设备已建立连接的接收设备的数量超过预定值。
  39. 如权利要求34所述的设备，其特征在于，还包括：
    输入装置，用于接收用户的所述设置操作；
    所述处理器，具体用于将以所述设置操作的操作起点与操作终点之间连线为对角线的矩形区域作为所述保密区域；或者，将所述设置操作的轨迹所形成的封闭区域作为所述保密区域；或者，将显示所述设置操作对应的操作对象的区域作为所述保密区域。
  40. 如权利要求36所述的设备，其特征在于，还包括：
    输入装置，用于接收用户的所述设置操作；
    所述处理器，具体用于将以所述设置操作的操作起点与操作终点之间连线为 对角线的矩形区域内的显示对象，作为所述保密显示对象；或者，将所述设置操作的轨迹所形成的封闭区域内的显示对象，作为所述保密显示对象；或者，将显示所述设置操作对应的操作对象作为所述保密显示对象。
  41. 如权利要求34，38或39中任一项所述的设备，其特征在于，
    所述通信接口，还用于获取接收设备通过所述连接发送的控制指令；
    所述处理器，还用于在所述操作区域与所述保密区域有重合时，不响应所述控制指令；在所述操作区域与所述保密区域无重合时，响应所述控制指令。
  42. 如权利要求36所述的设备，其特征在于，
    所述通信接口，还用于获取接收设备通过所述连接发送的控制指令；
    所述处理器，还用于在所述控制指令对应的显示对象包括所述保密显示对象时，不响应所述控制指令；在所述控制指令对应的显示对象不包括所述保密显示对象时，响应所述控制指令。
  43. 一种分享设备，用于与接收设备之间分享屏幕，其特征在于，包括：
    影像输出装置，通信接口，处理器，
    所述影像输出装置，用于显示应用菜单的用户界面；
    所述通信接口，用于建立与所述接收设备之间的用于分享屏幕的连接；通过所述连接，向所述接收设备发送与所述应用菜单的用户界面对应的所有图像数据，以便所述接收设备根据所述所有图像数据显示所述应用菜单的用户界面；获取接收设备通过所述连接发送的控制指令；
    所述处理器，用于在所述控制指令满足预定保密条件时，响应所述控制指令。
  44. 如权利要求43所述的设备，其特征在于，
    所述预定保密条件包括：所述控制指令对应的操作区域与根据预设区域或用户的设置操作确定的保密区域无重合，其中，所述保密区域为所述用户界面的一部分区域；或者，所述控制指令对应的显示对象不包括保密显示对象，其中，所述保密显示对象为所述分享设备应用菜单的用户界面中至少两个显示对象中的一部分显示对象。
  45. 一种接收设备，用于分享屏幕过程中对分享设备的控制，其特征在于， 包括：
    影像输出装置，通信接口，输入装置，处理器，
    所述通信接口，用于建立与分享设备之间的用于分享屏幕的连接；接收所述分享设备发送的图像数据，所述图像数据对应所述分享设备显示的应用菜单的用户界面的一部分或者全部；
    所述影像输出装置，用于显示所述图像数据对应的用户界面；
    所述输入装置，用于接收用户输入的操作指令；
    所述处理器，用于在所述操作指令满足预定保密条件时，生成与所述操作指令对应的控制指令；
    所述通信接口，还用于向所述分享设备发送控制指令，以使所述接收设备响应所述控制指令。
  46. 如权利要求45所述的设备，其特征在于，
    所述预定保密条件包括：所述操作指令对应的操作区域在非保密区域内，其中，所述非保密区域所述分享设备显示的应用菜单的用户界面的一部分区域；或者，所述操作指令的操作对象为非保密显示对象，其中，所述非保密显示对象为所述分享设备显示的应用菜单的用户界面包括的至少两个显示对象中的一部分显示对象。
  47. 如权利要求45所述的设备，其特征在于，
    所述预定保密条件包括：所述操作指令对应的操作区域在所述可分享界面中，或者，所述操作指令的操作对象为所述可分享界面中的显示对象。
PCT/CN2014/090155 2014-11-03 2014-11-03 分享屏幕的方法、分享设备及接收设备 WO2016070305A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/CN2014/090155 WO2016070305A1 (zh) 2014-11-03 2014-11-03 分享屏幕的方法、分享设备及接收设备
CN201480073784.9A CN106416170A (zh) 2014-11-03 2014-11-03 分享屏幕的方法、分享设备及接收设备
US15/518,667 US20170257403A1 (en) 2014-11-03 2014-11-03 Screen Sharing Method, Sharing Device, and Receiving Device
EP14905383.7A EP3190763B1 (en) 2014-11-03 2014-11-03 Screen sharing method and sharing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090155 WO2016070305A1 (zh) 2014-11-03 2014-11-03 分享屏幕的方法、分享设备及接收设备

Publications (1)

Publication Number Publication Date
WO2016070305A1 true WO2016070305A1 (zh) 2016-05-12

Family

ID=55908329

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/090155 WO2016070305A1 (zh) 2014-11-03 2014-11-03 分享屏幕的方法、分享设备及接收设备

Country Status (4)

Country Link
US (1) US20170257403A1 (zh)
EP (1) EP3190763B1 (zh)
CN (1) CN106416170A (zh)
WO (1) WO2016070305A1 (zh)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6122477B2 (ja) * 2015-10-15 2017-04-26 株式会社オプティム 画面共有システム及び画面共有方法
US9667676B1 (en) * 2016-01-29 2017-05-30 Dropbox, Inc. Real time collaboration and document editing by multiple participants in a content management system
CN110798457A (zh) * 2019-10-22 2020-02-14 厦门亿联网络技术股份有限公司 一种基于sip的辅流控制方法和会议系统
CN111258486B (zh) * 2020-01-09 2024-03-05 腾讯科技（深圳）有限公司 信息分享方法、装置、电子设备及存储介质
WO2021213097A1 (zh) 2020-04-24 2021-10-28 海信视像科技股份有限公司 一种显示设备及投屏方法
CN113556590B (zh) * 2020-04-24 2022-11-11 海信视像科技股份有限公司 一种投屏视频流有效分辨率检测方法及显示设备
CN115665454A (zh) * 2020-04-24 2023-01-31 海信视像科技股份有限公司 一种显示设备及投屏方法
CN111767554B (zh) * 2020-06-01 2024-02-20 Oppo（重庆）智能科技有限公司 屏幕分享方法、装置、存储介质及电子设备
CN114125546B (zh) * 2020-08-27 2023-02-28 荣耀终端有限公司 信息分享的方法、装置、终端设备和存储介质
CN112182673A (zh) * 2020-10-30 2021-01-05 维沃软件技术有限公司 信息共享方法、装置及设备
CN116301516A (zh) 2021-12-21 2023-06-23 北京小米移动软件有限公司 一种应用共享方法及装置、电子设备、存储介质
CN117459629A (zh) * 2022-07-18 2024-01-26 Oppo广东移动通信有限公司 内容共享控制方法、装置、存储介质及终端

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103200300A (zh) * 2012-01-10 2013-07-10 宇龙计算机通信科技(深圳)有限公司 终端及资源分享方法
WO2013182159A1 (zh) * 2012-12-28 2013-12-12 中兴通讯股份有限公司 电子装置及其应用程序的保护方法
CN103701927A (zh) * 2013-12-31 2014-04-02 杭州华为数字技术有限公司 一种终端间的图像共享方法、终端设备及通信系统
CN103916697A (zh) * 2014-04-04 2014-07-09 深圳市同洲电子股份有限公司 一种多应用显示的方法及相关智能终端

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5107443A (en) * 1988-09-07 1992-04-21 Xerox Corporation Private regions within a shared workspace
JP3846666B2 (ja) * 1998-09-24 2006-11-15 富士通株式会社 共有画面制御装置
US7028266B2 (en) * 2002-04-05 2006-04-11 Microsoft Corporation Processing occluded windows during application sharing
US7392296B2 (en) * 2002-06-19 2008-06-24 Eastman Kodak Company Method and computer software program for sharing images over a communication network among a plurality of users in accordance with a criteria
US10152190B2 (en) * 2003-12-15 2018-12-11 Open Invention Network, Llc Systems and methods for improved application sharing in a multimedia collaboration session
US20060002315A1 (en) * 2004-04-15 2006-01-05 Citrix Systems, Inc. Selectively sharing screen data
US7765483B2 (en) * 2005-09-12 2010-07-27 Microsoft Corporation Filtering obscured data from a remote client display
JP5211430B2 (ja) * 2006-03-02 2013-06-12 富士ゼロックス株式会社 電子会議システム、電子会議支援プログラム、電子会議支援方法、電子会議制御装置、会議サーバコンピュータ
US8407605B2 (en) * 2009-04-03 2013-03-26 Social Communications Company Application sharing
US20100131868A1 (en) * 2008-11-26 2010-05-27 Cisco Technology, Inc. Limitedly sharing application windows in application sharing sessions
JP2011070511A (ja) * 2009-09-28 2011-04-07 Sony Corp 端末装置、サーバ装置、表示制御方法、及びプログラム
US9141332B2 (en) * 2010-08-09 2015-09-22 Oracle Otc Subsidiary Llc Masking sensitive information in a screen sharing session
CN102457544B (zh) * 2010-10-26 2014-12-03 深圳市誉融科技有限公司 基于互联网的屏幕共享系统中用于采集屏幕图像的方法和系统
US20130141471A1 (en) * 2011-06-05 2013-06-06 Apple Inc. Obscuring graphical output on remote displays
US20150009152A1 (en) * 2013-07-03 2015-01-08 Htc Corporation Method of sharing application and electronic device using the same
US9361469B2 (en) * 2014-03-26 2016-06-07 Amazon Technologies, Inc. Electronic communication with secure screen sharing of sensitive information

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103200300A (zh) * 2012-01-10 2013-07-10 宇龙计算机通信科技(深圳)有限公司 终端及资源分享方法
WO2013182159A1 (zh) * 2012-12-28 2013-12-12 中兴通讯股份有限公司 电子装置及其应用程序的保护方法
CN103701927A (zh) * 2013-12-31 2014-04-02 杭州华为数字技术有限公司 一种终端间的图像共享方法、终端设备及通信系统
CN103916697A (zh) * 2014-04-04 2014-07-09 深圳市同洲电子股份有限公司 一种多应用显示的方法及相关智能终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3190763A4 *

Also Published As

Publication number Publication date
CN106416170A (zh) 2017-02-15
US20170257403A1 (en) 2017-09-07
EP3190763A1 (en) 2017-07-12
EP3190763A4 (en) 2017-09-27
EP3190763B1 (en) 2022-01-05

Similar Documents

Publication Publication Date Title
WO2016070305A1 (zh) 分享屏幕的方法、分享设备及接收设备
KR101872751B1 (ko) 애플리케이션 인터페이스를 디스플레이하는 방법 및 장치, 그리고 전자 장치
US20200413120A1 (en) Method of controlling the sharing of videos and electronic device adapted thereto
US20170011557A1 (en) Method for providing augmented reality and virtual reality and electronic device using the same
AU2018421189B2 (en) Method for quickly opening application or application function, and terminal
KR102481065B1 (ko) 애플리케이션 기능 구현 방법 및 전자 디바이스
KR102383103B1 (ko) 전자 장치 및 이의 화면 표시 방법
US20180274936A1 (en) Method and apparatus for providing augmented reality function in electronic device
WO2019227488A1 (zh) 一种查看信息内容的方法及终端
CN110168487B (zh) 一种触摸控制方法及装置
KR20170096408A (ko) 어플리케이션을 표시하는 방법 및 이를 지원하는 전자 장치
WO2016127426A1 (zh) 一种显示应用、图片的方法、装置及电子设备
CN114827914B (zh) 短信息处理方法、装置及电子设备
US10943404B2 (en) Content output method and electronic device for supporting same
WO2018133685A1 (zh) 界面显示方法、装置、终端及存储介质
KR20150037066A (ko) 전자 장치의 디스플레이 방법 및 그 전자 장치
KR102277460B1 (ko) 화면을 공유하기 위한 방법 및 그 전자 장치
KR20160071826A (ko) 무선 네트워크 연결 방법 및 그 전자 장치 및 방법
KR102110257B1 (ko) 전화번호를 이용하여 외부 기기를 제어하는 전자 기기 및 방법
KR20150075140A (ko) 전자 장치의 메시지 제어 방법 및 그 전자 장치
KR20160046099A (ko) 전자장치에서 표시 제어 방법 및 장치
CN108605373B (zh) 用于提供网络共享服务的方法和电子装置
CN111656347B (zh) 一种项目的显示方法及终端
KR20150051078A (ko) 전자 장치의 락 스크린 디스플레이 방법 및 그 전자 장치
CN108153460B (zh) 一种图标隐藏方法及终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14905383

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2014905383

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014905383

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 15518667

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE