WO2015165023A1 - 一种实现屏幕共享的方法、装置和系统 - Google Patents

一种实现屏幕共享的方法、装置和系统 Download PDF

Info

Publication number
WO2015165023A1
WO2015165023A1 PCT/CN2014/076421 CN2014076421W WO2015165023A1 WO 2015165023 A1 WO2015165023 A1 WO 2015165023A1 CN 2014076421 W CN2014076421 W CN 2014076421W WO 2015165023 A1 WO2015165023 A1 WO 2015165023A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
image
displayed
description information
viewheight
Prior art date
Application number
PCT/CN2014/076421
Other languages
English (en)
French (fr)
Inventor
许亮军
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201480000442.4A priority Critical patent/CN105247855A/zh
Priority to PCT/CN2014/076421 priority patent/WO2015165023A1/zh
Publication of WO2015165023A1 publication Critical patent/WO2015165023A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • Embodiments of the present invention relate to the field of communications, and, more particularly, to a method, apparatus, and system for implementing screen sharing.
  • a transmitting device that performs screen sharing can transmit a screen shared image acquired by capturing an image displayed on a shared area on the screen of the device to a receiving device in real time to present it.
  • the user of the receiving device feels as if the user of the transmitting device is watching the same screen.
  • the width and/or height of the display area for displaying the screen shared image in the receiving device screen is smaller than the width and/or height of the screen shared image, in which case the transmitting device The transmitted screen shared image is obviously not completely present on the screen of the receiving device.
  • the image content in the default area (such as the upper left corner area) in the screen sharing image is displayed on the screen of the receiving device by default.
  • the user of the sending device is currently paying attention to the image content outside the default area, for example, the user of the sending device introduces the image content outside the default area, and the user of the receiving device can only view the current by manually dragging a scroll bar or the like.
  • the content of the image that should be concerned, the communication efficiency is low.
  • the embodiments of the present invention provide a method, an apparatus, and a system for implementing screen sharing, which are used to solve the problem of low communication efficiency when screen sharing exists in the prior art.
  • a method for implementing screen sharing including:
  • the transmitting device during the screen sharing process An area that the user is currently paying attention to, the screen sharing image being an image displayed by a shared area on a screen of the transmitting device;
  • the receiving device determines a width of a display area for displaying the screen sharing image on a screen of the receiving device to be smaller than a width of the screen sharing image, or a height of the display area is smaller than a height of the screen sharing image Determining, according to the description information of the area of interest and the resolution of the display area, the area to be displayed in the screen sharing image, the determined resolution of the area to be displayed is the same as the resolution of the display area, And the area to be displayed includes at least a part of the area of interest;
  • the receiving device displays image content in the area to be displayed in the display area.
  • the description information of the attention area specifically includes coordinates of a center point of the attention area; and the description information according to the attention area and the resolution of the display area Determining the area to be displayed specifically includes: determining, in the screen sharing image, an area including the center point and having the same resolution as that of the display area according to coordinates of a center point of the attention area as the The area to be displayed.
  • the coordinates of the center point are (centerX, centerY), where an upper left corner of the screen shared image is a coordinate origin.
  • the axis of abscissa is laterally facing right, and the axis of ordinate is facing vertically downward;
  • the resolution of the screen shared image is pi cWidth*picHe ight; the resolution of the display area is viewWidth * viewHe ight;
  • Determining the to-be-displayed area according to the description information of the area of interest and the resolution of the display area specifically includes:
  • the abscissa rcLef t of the leftmost point of the area to be displayed, the ordinate rcTop of the highest point, the abscissa of the rightmost point rcRight, and the ordinate of the lowest point rcBot tom are calculated as follows:
  • the description information of the attention area specifically includes description information of a boundary of the attention area, where the attention area is one of a side of the image shared by the screen Rectangular area;
  • Determining the to-be-displayed area according to the description information of the area of interest and the resolution of the display area specifically includes:
  • the description information according to the boundary of the attention area is on the screen
  • an area including the center point of the attention area and having the same resolution as that of the display area is determined in the screen shared image.
  • the description information of the boundary of the attention area specifically includes the abscissa atLeft and the highest point of the leftmost point of the attention area.
  • the resolution of the screen shared image is picWidth*picHeight; the resolution of the display area is viewWidth * viewHeight;
  • Determining the to-be-displayed area according to the description information of the area of interest and the resolution of the display area specifically includes:
  • the abscissa rcLeft of the leftmost point of the area to be displayed, the ordinate rcTop of the highest point, the abscissa of the rightmost point rcRight, and the ordinate of the lowest point rcBottom are calculated as follows:
  • the image assistance information further includes description information of an effective image area in the screen sharing image, and the description information according to the attention area and the display area Determining the area to be displayed specifically includes: determining, according to the description information of the boundary of the effective image area, the resolution of the display area, and the description information of the attention area, the determined area
  • the resolution of the display area is the same as the resolution of the display area and includes at least a portion of the area of interest, and at least a portion of the determined area to be displayed is included in the effective image area.
  • the description information of the attention area specifically includes a coordinate of a center point of the attention area
  • the resolution of the screen shared image is picWidth*picHeight; the resolution of the display area is viewWidth * viewHeight;
  • the effective image area is a rectangular area in which one side is parallel to the abscissa axis, and the description information of the boundary of the effective image area i or is (BorderLeft, BorderTop, BorderRight, Bo rder Bo ttom), wherein BorderLeft is The abscissa of the leftmost point on the effective image area, BorderTo is the ordinate of the highest point on the effective image area, BorderRight is the abscissa of the rightmost point on the effective image area, and BorderBottom is the effective image The ordinate of the lowest point on the area;
  • Determining the to-be-displayed area according to the description information of the boundary of the effective image area and the description information of the attention area specifically includes:
  • the abscissa rcLeft of the leftmost point of the area to be displayed, the ordinate rcTop of the highest point, the abscissa rcRight of the rightmost point, and the ordinate rcBottom of the lowest point are calculated as follows:
  • rcLeft (BorderRight+BorderLef t-viewWidth) /2
  • rcRight (BorderRight+BorderLef t+viewWidth) /2;
  • BorderRight-BorderLef t ⁇ viewWidth -JL picWidth ⁇ viewWidth
  • the upper left corner of the screen shared image is a coordinate origin
  • the abscissa axis is laterally rightward
  • the ordinate axis is vertically downward.
  • the region of interest is a rectangular region in which one side is parallel to the axis of abscissa, wherein the description information of the region of interest specifically includes description information of the boundary of the region of interest (atLeft, atTop, atRight, atBottom), atLeft is The abscissa of the leftmost point of the region of interest i or above, atTop is the ordinate of the highest point on the region of interest, atRight is the abscissa of the rightmost point on the region of interest, and atBottom is the region of interest The ordinate of the lowest point above;
  • the effective image area is a rectangular area in which one side is parallel to the abscissa axis, and the description information of the boundary of the effective image area i or is (BorderLeft, BorderTop, BorderRight, BorderBottom), wherein BorderLeft is the effective image The abscissa of the leftmost point on the area, BorderTo is the ordinate of the highest point on the effective image area, BorderRight is the abscissa of the rightmost point on the effective image area, and BorderBottom is the area on the effective image area The ordinate of the lowest point;
  • the resolution of the screen shared image is picWidth*picHeight; the resolution of the display area Rate is viewWidth * viewHeight;
  • Determining the to-be-displayed area according to the description information of the area of interest and the resolution of the display area specifically includes:
  • the abscissa rcLeft of the leftmost point of the area to be displayed, the ordinate rcTop of the highest point, the abscissa of the rightmost point rcRight, and the ordinate of the lowest point rcBottom are calculated as follows:
  • rcLeft (BorderRight+BorderLef t-viewWidth) /2
  • rcRight (BorderRight+BorderLef t+viewWidth) /2;
  • BorderRight-BorderLef t ⁇ viewWidth -JL picWidth ⁇ viewWidth
  • the receiving device is displayed in the display area in the area to be displayed
  • the image content also includes:
  • first coordinate is a coordinate of a center point of the image content currently displayed in the display area in a screen sharing image corresponding to the currently displayed image content
  • the displaying the image content in the to-be-displayed area in the display area specifically includes: displaying the image content in the to-be-displayed area in the display area when determining that the difference exceeds a set threshold.
  • the receiving device performs the description information according to the attention area and the display area when determining that an operation for indicating scrolling is not detected within a period of a previous preset length
  • the resolution determines the area to be displayed and displays the image content in the area to be displayed.
  • the method further includes: when the receiving device receives the screen sharing image, determining whether the time period is An operation for indicating scrolling is detected;
  • determining, according to the detected information for indicating the operation of scrolling, the area currently focused by the user of the receiving device, and according to the The area currently in focus of the user of the receiving device and the resolution of the display area determine an area to be displayed in the screen sharing image and display image content in the area to be displayed in the display area.
  • a method for implementing screen sharing comprising: the sending device grabbing an image displayed by a shared area on a screen of the sending device to obtain a screen sharing image;
  • the sending device acquires description information of a region of interest in the screen sharing image, where the region of interest is an area that the user of the sending device is currently paying attention to during the screen sharing process; the sending device sends the device to the receiving device a screen sharing image and image assisting information, the image assisting information including description information of the region of interest to cause the receiving device to determine at least part of the region of interest in the screen sharing image according to the description information
  • the area to be displayed and the image content in the area to be displayed is displayed.
  • the description information of the attention area is specific The description information of the boundary of the region of interest or the coordinates of the center point of the region of interest.
  • the sending, by the sending device, the description information of the attention area specifically: the sending device uses a clustering algorithm
  • the recorded mouse position that satisfies the preset condition is grouped, the group that satisfies the target condition is used as the target group, and the area enclosed by the circumscribed rectangle of the mouse position in the target group is used as the attention area, and is obtained for description.
  • the information of the circumscribed rectangle is used as description information of the attention area.
  • the using the clustering algorithm to perform the grouping of the recorded mouse positions that meet the preset condition further includes: following the preset time interval Recording a current mouse position; the mouse position satisfying the preset condition includes a mouse position recorded within a preset length of time before the time when the grouping operation is performed.
  • the group that meets the target condition is specifically included in the target group:
  • the group including the largest number of mouse positions is included as the target group.
  • the mouse positions are assigned corresponding weights according to the time sequence recorded by each mouse position, and the mouse positions included in each group are weighted to obtain weight values of the respective groups, and the group with the largest weight value is used as the target group, wherein , the weight assigned to the mouse position of the post record is higher than the weight assigned to the mouse position recorded first.
  • the using the clustering algorithm to group the recorded mouse positions that meet the preset condition further includes: detecting a mouse operation Recording, corresponding to the mouse position corresponding to the mouse operation and the attribute information of the mouse operation;
  • the mouse position that satisfies the preset condition includes a mouse position corresponding to the mouse operation detected within a preset length of time before the time when the grouping operation is performed;
  • the group that satisfies the target condition as the target group specifically includes: assigning a corresponding weight to the mouse position corresponding to the mouse operation according to the attribute information of each mouse operation, and the mouse included in each group
  • the target position is subjected to weighting calculation to obtain weighting values of the respective groups, and the group having the largest weighting value is taken as the target group.
  • the attribute information of the mouse operation includes a type of the mouse operation and/or a time when the mouse operation occurs.
  • the acquiring, by the sending device, the description information of the attention area specifically: the sending device detects the keyboard When the input operation is performed, the current input cursor position is determined, and an input area centered on the cursor position in the screen sharing image is used as the attention area, and information for describing the input area is obtained as the attention area. Description.
  • the acquiring, by the sending device, the description information of the attention area specifically: the sending device, the sharing The area in which the updated image content occurs in the image displayed in the area is used as the attention area, and information for describing an area in which the image content is located is acquired as description information of the attention area.
  • the sending device sends the screen sharing image and an image to the receiving device
  • the auxiliary information further includes: the sending device identifying a boundary of the effective image area in the screen sharing image and acquiring description information of a boundary of the effective image area; the image auxiliary information further includes a boundary of the effective image area
  • the description information is used to cause the receiving device to determine the to-be-displayed area according to the description information of the attention area and the description information of the boundary of the effective image area, where the determined to-be-displayed area includes at least the attention area a portion, and at least a portion of the area to be displayed is included in the effective image area.
  • a communication device for implementing screen sharing including: a receiving unit, a determining unit, and a display unit;
  • the receiving unit is configured to receive a screen sharing image and image assistance information sent by a sending device that is performing screen sharing, where the image assisting information includes description information of a region of interest in the screen sharing image, where the region of interest is An area that the user of the transmitting device is currently paying attention to during the screen sharing process, the screen sharing image is an image displayed by a shared area on a screen of the transmitting device, and is used to transmit the image auxiliary information to the determination Unit, transmitting the screen sharing image to the display unit;
  • the determining unit is configured to receive the image auxiliary information from the receiving unit, and further configured to: when determining a width of a display area for displaying the screen sharing image on a screen of the communication device, is smaller than the screen sharing image a width, or a height of the display area is smaller than a height of the screen sharing image, determining a to-be-displayed area in the screen sharing image according to the description information of the attention area and the resolution of the display area, determined
  • the resolution of the area to be displayed is the same as the resolution of the display area, and the area to be displayed includes at least a part of the area of interest, and information for describing the area to be displayed is sent to the display.
  • the display unit is configured to receive the screen sharing image from the receiving unit, receive information for describing the area to be displayed from the determining unit, and use the information to describe the area to be displayed according to the The information displays the image content of the screen sharing image in the area to be displayed in the display area.
  • the description information of the area of interest specifically includes coordinates of a center point of the area of interest; the determining unit is specifically configured to be used according to a center point of the area of interest The coordinates determine, in the screen sharing image, an area including the center point and having the same resolution as that of the display area as the area to be displayed.
  • the coordinates of the center point are (centerX, centerY), where an upper left corner of the screen shared image is a coordinate origin.
  • the axis of abscissa is laterally facing right, and the axis of ordinate is facing vertically downward;
  • the resolution of the screen shared image is pi cWidth*picHe ight; the resolution of the display area is viewWidth * viewHe ight;
  • the determining unit is specifically configured to calculate an abscissa rcLeft of the leftmost point of the to-be-displayed area, an ordinate rcTop of the highest point, an abscissa rcRight of the rightmost point, and an ordinate rcBottom of the last point in the following manner:
  • the description information of the attention area specifically includes description information of a boundary of the attention area, where the attention area is one of the sides of the image shared by the screen
  • the determining unit is configured to: when the width of the display area is greater than the width of the area of interest and the height of the display area is greater than the height of the area of interest, according to the boundary of the area of interest
  • Descriptive information identifies the package in the screen shared image
  • the region including the center point of the region of interest and having the same resolution as the resolution of the display region is determined in the screen sharing image according to the description information of the boundary of the region of interest. Tell the display area.
  • the description information of the boundary of the attention area specifically includes the abscissa atLeft and the highest point of the leftmost point of the attention area.
  • the resolution of the screen shared image is picWidth*picHeight; the resolution of the display area is viewWidth * viewHeight;
  • the determining unit is specifically configured to calculate an abscissa rcLeft of the leftmost point of the to-be-displayed area, an ordinate rcTop of the highest point, an abscissa rcRight of the rightmost point, and an ordinate rcBottom of the last point:
  • the image assistance information received by the receiving unit further includes description information of an effective image area in the screen sharing image, where the determining unit is specifically configured to The description information of the boundary of the effective image area and the description information of the attention area determine the area to be displayed, and the determined resolution of the area to be displayed is the same as the resolution of the display area and includes the area of interest At least a portion of the determined area and at least a portion of the determined area to be displayed are included in the effective image area.
  • the communications device further includes a difference calculating unit
  • the determining unit is further configured to transmit information for describing the area to be displayed to the difference value calculating unit;
  • the difference calculation unit is configured to receive information for describing the to-be-displayed area from the determining unit, and configured to acquire a first coordinate, determine a second coordinate according to information used to describe the to-be-displayed area, and Calculating a difference between the first coordinate and the second coordinate, wherein the first coordinate is a screen corresponding to a center point of image content currently displayed in the display area on the currently displayed image content Coordinates in the image, the second coordinate is a coordinate of the center point of the area to be displayed in the screen sharing image received by the receiving unit, and is further configured to transmit the difference to the display unit ;
  • the display unit is specifically configured to display image content in the to-be-displayed area in the display area when the difference exceeds a set threshold.
  • the determining unit is specifically configured to determine the previous preset length The operation of determining the area to be displayed is performed when no operation for instructing scrolling is detected within the time period.
  • the determining unit is further configured to determine whether an operation for indicating a scrolling is detected in the time period, and When the determination result determines that the operation for indicating the scrolling is not detected within the time period, performing the description according to the description information of the attention area and the resolution of the display area, and determining the area to be displayed and The operation of the information about the display area is sent to the display unit; and is further configured to: when the operation for indicating the scrolling is detected within the time period according to the determination result, the scrolling is used according to the detected Determining an area to be displayed by the user of the receiving device, determining an area to be displayed in the screen sharing image according to a current area of the user of the receiving device and a resolution of the display area, and determining Information describing the area to be displayed is sent to the display unit.
  • a communication device for implementing screen sharing is provided, including an image capture unit, an information acquisition unit, and a sending unit:
  • the image capture unit is configured to capture an image displayed by a shared area on a screen of the communication device to acquire a screen shared image, and is configured to transmit the screen shared image to the sending unit;
  • the information acquiring unit Descriptive information for acquiring an area of interest in the screen sharing image, and for transmitting description information of the area of interest to the sending unit, wherein the area of interest is the transmitting device in a screen sharing process The area that the user is currently focusing on;
  • the sending unit is configured to receive the screen sharing image from the image capturing unit, receive description information of the attention area from the information acquiring unit, and send the screen sharing image and image assisting to a receiving device Information, the image assistance information includes description information of the attention area, to cause the receiving device to determine a package in the screen sharing image according to the description information
  • An area to be displayed of at least a portion of the area of interest is displayed and image content in the area to be displayed is displayed.
  • the information acquiring unit is specifically configured to use a clustering algorithm to group the recorded mouse positions that meet the preset condition, and use the group that meets the target condition as the target group.
  • An area enclosed by a circumscribed rectangle of a mouse position in the target group is determined as the attention area, and information for describing the circumscribed rectangle is acquired as description information of the attention area.
  • the information acquiring unit is further configured to record a current mouse position according to a preset time interval, where the preset condition is met
  • the mouse position includes a mouse position recorded within a preset length of time before the time at which the grouping operation is performed.
  • the information acquiring unit configured to use the group that meets the target condition as the target group, specifically includes: the maximum number of mouse positions to be included
  • the group is used as the target group; or, according to the time sequence recorded by each mouse position, corresponding weights are assigned to each mouse position, and the mouse positions included in each group are weighted to obtain weight values of each group, and the weighting value is maximized.
  • the group is the target group, wherein the weight assigned to the post-recorded mouse position is higher than the weight assigned to the previously recorded mouse position.
  • the information acquiring unit is further configured to record, when the mouse operation is detected, a mouse position corresponding to the mouse operation and the The attribute information of the mouse operation, the mouse position that satisfies the preset condition includes a mouse position corresponding to the detected mouse operation in the time period of the previous preset length; the information acquiring unit is configured to target the group that meets the target condition
  • the group includes: assigning a weight to the mouse position corresponding to the mouse operation according to the attribute information of each mouse operation, and weighting the mouse position included in each group to obtain a weight value of each group, and maximizing the weight value.
  • the group acts as the target group.
  • the information acquiring unit is specifically configured to: The area where the updated image content is generated in the image displayed by the shared area is used as the attention area, and information for describing an area where the image content is located is obtained as description information of the attention area.
  • the information acquiring unit is specifically configured to use, as the attention area, an area where the updated image content is generated in the image displayed by the shared area, and obtain The information of the area where the image content is located is used as the description information of the attention area.
  • the information acquiring unit is further configured to identify the image in the screen sharing image Defining the boundary of the effective image area and acquiring description information of the boundary of the effective image area, and transmitting the description information of the boundary of the effective image area to the sending unit;
  • the sending unit is further configured to receive, from the information acquiring unit, description information of a boundary of the effective image area, and send the description information of a boundary of the effective image area as part of the image auxiliary information to the Determining, by the receiving device, the receiving device to determine the to-be-displayed area according to the description information of the attention area and the description information of the boundary of the effective image area, where the determined to-be-displayed area includes at least the attention area a portion, and at least a portion of the area to be displayed is included in the effective image area.
  • a communication system for implementing screen sharing including: a sending device and a receiving device;
  • the sending device is configured to capture an image displayed by a shared area on a screen of the sending device to obtain a screen sharing image, obtain description information of a region of interest in the screen sharing image, and send the information to the receiving device a screen sharing image and image auxiliary information, the image auxiliary information including description information of the attention area, wherein the attention area is an area that the user of the transmitting device is currently paying attention to during the screen sharing process;
  • the receiving device configured to receive the screen sharing image sent by the sending device, and the Image assistance information, and a width of a display area for displaying the screen sharing image on a screen of the receiving device is smaller than a width of the screen sharing image, or a height of the display area is smaller than the screen sharing image Determining, according to the description information of the attention area and the resolution of the display area, the to-be-displayed area in the screen sharing image, the determined resolution of the to-be-displayed area is the same as the resolution of the display area And the area to be displayed includes at least a portion of the area of interest, and is further configured to display image content in the area to be displayed in the display area.
  • the sending device is further configured to identify a boundary of an effective image area in the screen sharing image and acquire description information of a boundary of the effective image area, and Transmitting, by the receiving device, the description information of the boundary of the effective image area to the receiving device as part of the image assistance information;
  • the description information of the boundary of the effective image area and the description information of the attention area determine the area to be displayed, and the determined resolution of the area to be displayed is the same as the resolution of the display area and includes at least the area of interest a portion, and the determined at least a portion of the area to be displayed is included in the effective image area.
  • the image content in the area to be displayed may be completely presented in the display area, and
  • the area to be displayed is determined according to the description information of the area that the user of the sending device is currently paying attention to during the screen sharing process and includes at least a part of the area, so the receiving device may be currently paying attention to the user of the sending device. At least a part of the image content in the area is displayed, thereby improving the communication efficiency when the screen is shared.
  • Embodiment 1 is an example of a screen sharing image 00 provided by Embodiment 1 of the present invention.
  • FIG. 3 is a schematic diagram of grouping of mouse positions according to Embodiment 1 of the present invention.
  • Embodiment 4 is a schematic diagram showing the relationship between weights and time in Embodiment 1 of the present invention.
  • FIG. 5 is a schematic diagram of a relationship between a region of interest and a region to be displayed according to Embodiment 1 of the present invention
  • FIG. 6 is a schematic diagram showing a relationship between a region of interest, an effective image region, and a region to be displayed according to Embodiment 1 of the present invention
  • FIG. 7 is a schematic structural diagram of a communication device 500 according to Embodiment 1 of the present invention.
  • FIGS. 8-9 are schematic structural diagrams of a communication device 600 according to Embodiment 3 of the present invention.
  • FIG. 10 is a schematic structural diagram of a communication device 1000 according to Embodiment 4 of the present invention.
  • FIG. 11 is a schematic structural diagram of a communication device 2000 according to Embodiment 5 of the present invention.
  • Figure 12 is a block diagram showing the structure of a communication system 5000 according to Embodiment 6 of the present invention. detailed description
  • Embodiment 1 is a schematic flowchart of a method according to Embodiment 1 of the present invention. As shown in FIG. 1, the method provided in Embodiment 1 of the present invention includes:
  • Step 210 The transmitting device captures an image displayed by the shared area on the screen of the transmitting device to obtain a screen sharing image.
  • the sharing area is the entire screen of the sending device, and correspondingly, the image displayed on the entire screen is captured in step 210.
  • the transmitting device only shares content displayed by a specific area (generally a rectangular area) of the screen to the receiving device, for example, an application displayed on the screen
  • the interface is shared with the receiving device, and the shared area is a specific area of the above-mentioned screen. Accordingly, the image displayed in the specific area is captured in step 210.
  • Step 220 The sending device acquires description information of a region of interest in the screen sharing image.
  • the area of interest is the area that the user of the sending device is currently paying attention to during the screen sharing process, and specifically may be the area where the location where the mouse operation is frequently performed by the sending device or the position where the mouse stays for the longest time is located.
  • the area may be the area where the location where the input operation is currently being performed, and the area where the content update is currently occurring frequently on the screen of the sending device.
  • the description information of the attention area may specifically include description information of a boundary of the attention area or coordinates of a center point of the attention area.
  • the screen shared image 00 includes a region of interest 01, and the region of interest 01 is a rectangular region, the boundary of the rectangular region is a rectangular dotted frame as shown in FIG. 2, and the center point of the region of interest 01 is a black dot 02. position.
  • the upper left corner of the screen sharing image 00 is the coordinate origin, the abscissa axis is laterally facing rightward, the ordinate coordinate axis 3 ⁇ 4 is facing downward, and one side of the attention area 01 is parallel to the abscissa axis.
  • the description information of the attention area 01 may specifically be the coordinates of the four vertices of the attention area 01. As shown in FIG. 2, the coordinates of the four vertices of the attention area 01 are (10, 5), (20, 5), (10 , 10) and (20, 10).
  • the description information of the attention area 01 may specifically be the ordinate MaxHe ight of the attention area 01, the ordinate MinHe ight of the attention area 01, the abscissa MinWidth of the leftmost point, and the abscissa MaxWidth of the rightmost point, as shown in FIG. 2, which is " 5( MaxHe ight ), 10( MinHe i ght ), 10( MinWidth ), 20 ( MaxWidth )".
  • the description information of the attention area 02 may also be the coordinates of the position of the black dot 02, as shown in Fig. 2, which is (15, 7. 5).
  • step 220 The following three implementations of step 220 are described separately:
  • Embodiment 1 The transmitting device uses a clustering algorithm to record a mouse bit that meets a preset condition
  • the group is grouped, the group that satisfies the target condition is used as the target group, and the area enclosed by the circumscribed rectangle of the mouse position in the target group is used as the attention area, and information for describing the circumscribed rectangle is obtained.
  • the coordinates of the center point of the circumscribed rectangle and the description information of the boundary of the circumscribed rectangle are used as the description information of the attention area.
  • Embodiment 1 An exemplary embodiment of Embodiment 1 will be described in detail below with reference to FIG.
  • the sending device records the current mouse position according to a preset time interval, for example, recording the current mouse position at a frequency of 0.2 seconds (ie, 5 times/second). .
  • the arrow shown in Figure 3 is the last 15 mouse positions recorded at a frequency of 5 times/second (that is, the mouse position recorded in the last 3 seconds).
  • step 220 the mouse position recorded in the preset length of time (such as in the last 3 seconds) before the time when the grouping operation is performed is grouped by using a clustering algorithm, for example, divided into FIG.
  • the mouse position group 1, the mouse position group 2, and the mouse position group 3 are shown.
  • the group including the largest number of mouse positions can be used as the target group.
  • the mouse position group 1 includes the largest number of mouse positions, and the mouse position group 1 is the target group.
  • each mouse position is assigned a corresponding weight to each mouse position according to the time sequence recorded by each mouse position (the weight given to the mouse position of the later record is higher than the weight given by the mouse position recorded first), and is included in each group.
  • the mouse position is subjected to weighting calculation to obtain weighting values of the respective groups, and the group having the largest weighting value is taken as the target group.
  • the mouse position in the mouse position group 2 is less than the mouse position in the mouse position group 1, if the mouse position in the mouse position group 2 is recorded in the last 1 second, the weight is given. Value, and the mouse position in the mouse position group 1 is recorded first, and given a smaller weight, it is possible that the weight value of the mouse position group 2 is larger than the weight value of the mouse position group 1, and thus the mouse position group 2 As a target group.
  • an area surrounded by a circumscribed rectangle of the mouse position in the target group (such as the mouse position group 1 in FIG. 3) is used as the attention area, and information for describing the circumscribed rectangle is acquired as the attention. Description of the area.
  • the method further includes: recording, when the mouse operation is detected, the mouse position corresponding to the mouse operation and the attribute information of the mouse operation, where the attribute information of the mouse operation may specifically include the The type of mouse action (eg, left-click, right-click, double-click, move, etc.) and/or when the mouse action occurred.
  • the type of mouse action eg, left-click, right-click, double-click, move, etc.
  • the mouse position that satisfies the preset condition includes a mouse position corresponding to the mouse operation detected within a preset length of time before the time when the grouping operation is performed.
  • step 220 a corresponding weight is assigned to the mouse position corresponding to the mouse operation according to the attribute information of each mouse operation.
  • the mouse operation is given different weights depending on the type of mouse operation.
  • the mouse operation is given different weights according to the time when the mouse operation occurs, and the difference between the time when the mouse operation occurs and the current time.
  • a weighting calculation is performed on the mouse positions included in each group to obtain weighting values of the respective groups, and the group having the largest weighting value is taken as the target group.
  • Embodiment 2 when detecting a keyboard input operation, the sending device determines a current input cursor position, and inputs an input area centered on the cursor position in the screen sharing image (eg, centered on the cursor position) As a rectangular area, as the attention area, information for describing the input area (for example, coordinates of the cursor position, or description information of a boundary of the input area) is acquired as description information of the attention area.
  • the attention area information for describing the input area (for example, coordinates of the cursor position, or description information of a boundary of the input area) is acquired as description information of the attention area.
  • the sending device may first determine an input area centered on the cursor position in the screen sharing image as the attention area, and use description information of a boundary of the input area as the attention. Description of the area; can also directly send the coordinates of the cursor position And sending the receiving device to indicate that the area where the cursor position is centered is the attention area (ie, the area of interest of the user of the transmitting device), without explicitly determining the attention area.
  • Embodiment 3 The transmitting device uses, as the attention area, an area in which an image content that is updated in an image displayed in the shared area is located, and acquires information for describing an area in which the image content is located as the attention area. Description. For example, if the shared area on the screen of the current sending device is playing a video, only the content of the playing area in the shared area changes, and the content of the area for displaying the player menu in the shared area is unchanged. Then, the play area can be determined as the attention area.
  • Step 230 The sending device sends the screen sharing image and image auxiliary information to the receiving device, where the image auxiliary information includes description information of the attention area.
  • the sending device encapsulates the content of the screen sharing image and the description information of the attention area into the data frame shared by the screen, and sends the data frame to the receiving device.
  • the description information of the attention area may be encapsulated in a frame header of the data frame, or may be encapsulated in the frame data of the data frame, for example, encapsulated in front of the screen shared image in the frame data, as shown in the following table. .
  • Step 240 The receiving device determines, in the screen sharing image, an area to be displayed including at least a part of the attention area according to the description information.
  • the receiving device determines a width of a display area for displaying the screen sharing image on a screen of the receiving device is smaller than a width of the screen sharing image, or a height of the display area is smaller than the screen sharing Determining the to-be-displayed area according to the description information of the attention area and the resolution of the display area, determining the resolution of the to-be-displayed area and the The resolution of the display area is the same, and the area to be displayed includes at least a portion of the area of interest.
  • the resolution of the screen sharing image may be expressed as picWidth*picHeight, where picWidth is the width of the screen sharing image, and pi cHeight is the height of the screen sharing image.
  • the resolution of the display area may be expressed as viewWidth * v iewHe ight , where viewWidth is the width of the display area, and v iewHeight is the height of the display area.
  • the resolution of the screen is ScrWidth*ScrHeight, that is, the width of the screen is ScrWidth and the height is ScrHeight.
  • the display area is the entire area of the screen of the receiving device, correspondingly The resolution of the display area is the resolution of the screen, that is, ScrWidth*ScrHeight; if a part of the screen of the receiving device is used to display the screen sharing image, the display area is the Receiving a portion of the screen of the device, for example, the width of the screen is M times the width of the display area, and the height of the screen is N times the height of the display area, and the resolution of the display area is (ScrWidth/M) * (ScrHe ight/N).
  • the description information of the attention area may specifically include coordinates of a center point of the attention area, and correspondingly, in step 240, determining, according to coordinates of a center point of the attention area, the screen sharing image includes the An area having a center point and having the same resolution as that of the display area is used as the area to be displayed.
  • a specific implementation manner will be described in detail through Embodiment 1.
  • the description information of the attention area may specifically include description information of a boundary of the attention area, where the attention area is a rectangular area in which one side is parallel to one side of the screen sharing image, and in step 240, When the width of the display area is greater than the width of the area of interest and the height of the display area is greater than the height of the area of interest, according to the side of the area of interest Defining information of the boundary, in the screen sharing image, determining, as the to-be-displayed area, an area including the attention area and having the same resolution as that of the display area, that is, the area to be displayed includes the area of interest All, as shown in a of FIG.
  • an area including a center point of the region of interest and having the same resolution as that of the display area as the area to be displayed, that is, the area to be displayed includes the Part of the area of interest, as shown in a2 of Figure 5.
  • Embodiment 1 and Embodiment 2 of step 240 are respectively introduced below.
  • the upper left corner of the screen shared image is the coordinate origin
  • the abscissa axis is laterally rightward
  • the ordinate axis is vertically downward.
  • the resolution of the screen shared image is picWidth*pi cHe ight
  • the resolution of the display area is viewWidth * v iewHe i ght.
  • the description information of the attention area specifically includes coordinates (centerX, centerY) of a center point of the attention area.
  • step 240 the horizontal coordinate rcLef t of the leftmost point of the area to be displayed, the ordinate rcTop of the highest point, the abscissa rcRight of the rightmost point, and the ordinate rcBot tom of the highest point may be calculated as follows:
  • rcLef t 0
  • rcRight viewWidth
  • the description information of the attention area specifically includes description information of a boundary of the attention area.
  • the attention area is a rectangular area in which one side is parallel to one side of the screen sharing image, and the description information of the boundary of the attention area specifically includes an abscissa atLeft of the leftmost point of the attention area, and an ordinate of the highest point. atTop, the rightmost point of the abscissa atRight and the most ⁇ ⁇ point of the ⁇ from the coordinates atBottom 0
  • step 240 the horizontal coordinate rcLeft of the leftmost point of the area to be displayed, the ordinate rcTop of the highest point, the abscissa rcRight of the rightmost point, and the ordinate rcBottom of the highest point may be calculated as follows:
  • rcTop ( atTo +atBot torn- viewHeight ) /2
  • rcBottom ( atTop+atBottom+viewHeight ) /2;
  • the receiving device may preferentially include an area near a center point of the attention area in the area to be displayed.
  • step 240 the receiving device further needs to obtain the resolution of the screen shared image, which may be obtained by one of the following three methods:
  • Method 1 The receiving device acquires a resolution of the screen shared image from the screen sharing image.
  • Method 2 The sending device sends the resolution of the screen sharing image as part of the image assistance information to the receiving device, and correspondingly, the receiving device acquires the screen sharing from the image auxiliary information The resolution of the image.
  • Method 3 The sending device sends a resolution of a shared area on a screen of the sending device to the receiving device when the screen sharing is started, and the receiving device uses the resolution of the shared area as a subsequent receiving
  • the screen of the transmitting device shares the resolution of the image. It should be noted that, if the sending device shares the content displayed on the entire screen to the receiving device, that is, the shared area is the entire screen, the resolution of the shared area is the resolution of the screen of the sending device.
  • Step 250 The receiving device displays an image in the area to be displayed.
  • the receiving device displays image content in the to-be-displayed area in the display area. It should be noted that, if the attention area of the current screen sharing image is changed compared to the attention area of the previous screen sharing image, correspondingly, when the current screen sharing image is received, it is determined. The area to be displayed is different from the area to be displayed determined when the previous screen sharing image is received. When the screen sharing image is received multiple times and steps 240-250 are performed, the effect of automatic scrolling is obtained.
  • the receiving device may perform the determining to perform the operation when it is determined that the operation for indicating the scrolling is not detected within a period of the previous preset length (eg, within the last 5 ms, within the last 3 seconds) Shows the operation of the area.
  • a period of the previous preset length eg, within the last 5 ms, within the last 3 seconds
  • the receiving device may want to view content other than the image content displayed on the current screen, the user may manually scroll through the mouse or keyboard operation, such as dragging the scroll bar.
  • the receiving device records information of the manual scrolling operation, such as execution time, scrolling direction, scrolling distance, etc., when receiving the screen sharing image, determining the previous preset length time Whether the user performed a manual scrolling operation within the segment (such as within the last 5ms, within the last 3 seconds). If the determination result is no, the area to be displayed may be determined according to the description information of the attention area.
  • the area to be displayed may not be determined according to the description information of the currently received area of interest, but the area currently in focus of the user of the receiving device may be determined according to the information of the manually scrolling operation recorded, for example, the receiving The user of the device performs the upward scrolling operation in the time period, and the scrolling distance is 10, and the target area above the attention area and the attention area is 10 is considered as the area of interest of the user of the receiving device.
  • the target area may be determined as an area of interest of the user of the receiving device, and the to-be-served in the screen sharing image is determined according to the area currently in focus of the user of the receiving device and the resolution of the display area.
  • the method for determining an area to be displayed according to an area currently used by a user of the receiving device and a resolution of the display area is similar to determining a to-be-displayed area according to the resolution of the attention area and the display area, No longer.
  • the image assistance information in step 230 may further include description information of a boundary of the effective image area in the screen sharing image. As shown in FIG.
  • the transmitting device uses the boundary recognition algorithm to identify And extracting a boundary of the effective image area in the screen sharing image, and transmitting description information of a boundary of the effective image area to the receiving device as part of the image auxiliary information.
  • the receiving device determines the to-be-displayed area according to the description information of the attention area, the resolution of the display area, and the description information of the boundary of the effective image area, and the determined location
  • the resolution of the display area is the same as the resolution of the display area and includes at least a portion of the area of interest, and at least a portion of the determined area to be displayed is included in the effective image area.
  • the receiving device may preferentially determine the to-be-displayed area in the effective image area, where the effective image area is a rectangular area in which one side is parallel to one side of the screen sharing image.
  • the effective image area may be determined
  • the display area, that is, the determined area to be displayed, is all included in the effective image area, as shown in the area to be displayed bl in FIG.
  • the height of the display area is greater than the height of the effective image area And/or the width of the display area is greater than the width of the effective image area, and a portion of the determined area to be displayed is included in the effective image area, as shown in the area to be displayed b2 in FIG.
  • the resolution of the display area is viewWidth * V i ewHe i gh t ; when the effective image area is a rectangular area in which one side is parallel to the abscissa axis, the description information of the boundary of the effective image area is (BorderLef t , BorderTop, BorderRight, BorderBot tom ), where BorderLef t is the abscissa of the leftmost point on the effective image area, BorderTop is the ordinate of the highest point on the effective image area, and BorderRight is the most on the effective image area The abscissa of the right point, BorderBot tom, is the ordinate of the lowest point on the effective image area.
  • Embodiment 3 In Embodiment 3, the description information of the attention area specifically includes the coordinates (centerX, centerY) of the center point of the attention area.
  • the abscissa rcLef t of the leftmost point of the to-be-displayed area, the ordinate rcTop of the highest point, the abscissa rcRight of the rightmost point, and the slave coordinate rcBot of the last point may be calculated as follows.
  • BorderRight-BorderLef t > viewWidth, rcLef t and rcRight are calculated according to the method:
  • rcLef t (BorderRight+BorderLef t-v iewWidth) /2
  • rcRi ght (BorderRight+BorderLef t+viewWidth) /2;
  • BorderRight-BorderLef t ⁇ viewWidth -JL picWidth ⁇ viewWidth
  • rcTo and rcBottom are calculated according to the method:
  • Embodiment 4 In Embodiment 4, the region of interest is a rectangular region in which one side is parallel to the axis of abscissa, wherein the description information of the region of interest specifically includes an abscissa of a leftmost point of the region of interest atLeft, the ordinate of the highest point atTop, the abscissa of the rightmost point atRight, and the ordinate of the lowest point atBottom.
  • rcLeft (BorderRight+BorderLef t-viewWidth) /2
  • rcRight (BorderRight+BorderLef t+viewWidth) /2;
  • BorderRight-BorderLef t ⁇ viewWidth -JL picWidth ⁇ viewWidth
  • rcTo and rcBottom are calculated according to the method:
  • rcTop (BorderBot tom+BorderTop-viewHeight) / 2
  • rcBottom (BorderBot tom+BorderTop+viewHeight) / 2;
  • the receiving device may preferentially include an area in the effective display area in the area to be displayed. Before the step 250, the receiving device may also perform the following operations:
  • S1 acquiring a first coordinate, where the first coordinate is a center point of the image content currently displayed in the display area, and a screen sharing image corresponding to the currently displayed image content (hereinafter referred to as a first screen sharing image) coordinate of.
  • the first coordinate may be specifically calculated and recorded by the receiving device when receiving the first screen shared image.
  • S2 determining a second coordinate, which is a coordinate in a screen sharing image (hereinafter referred to as a second screen sharing image) received by the center point of the area to be displayed in step 230.
  • a second coordinate which is a coordinate in a screen sharing image (hereinafter referred to as a second screen sharing image) received by the center point of the area to be displayed in step 230.
  • the corresponding area of the currently displayed image content in the first screen shared image is referred to as a first to-be-displayed area; the area to be displayed determined in step 240 is referred to as a second to-be-displayed area i or.
  • step 250 specifically includes: when determining that the difference exceeds a set threshold, in the The display area displays image content in the area to be displayed.
  • the receiving device determines whether the difference exceeds the set threshold, and displays the image content in the to-be-displayed area in the display area when it is determined that the set threshold is exceeded. And, when it is determined that the set threshold is not exceeded, the image content corresponding to the first to-be-displayed area in the second screen shared image is displayed in the display area.
  • the transmitting device not only sends the screen sharing image to the receiving device, but also sends description information of the attention area in the screen sharing image to the receiving device, and correspondingly, the receiving The device determines, according to the description information of the attention area, a to-be-displayed area including at least a part of the attention area, and displays image content in the to-be-displayed area in the display area, and therefore, the attention area specified by the sending device At least a portion of the image content may be displayed on a screen of the receiving device, thereby improving communication efficiency when the screen is shared.
  • Embodiment 2 of the present invention provides a communication device 500 for implementing screen sharing. As shown in FIG. 7, the communication device 500 includes: an image capture unit 501, an information acquisition unit 502, and a transmission unit 503.
  • the image capture unit 501 is configured to capture an image displayed by the shared area on the screen of the communication device 500 to acquire a screen shared image, and to transmit the screen shared image to the transmitting unit 503.
  • the information obtaining unit 502 is configured to acquire description information of the attention area in the screen sharing image, and is configured to transmit the description information of the attention area to the sending unit 503.
  • the area of interest in the screen sharing image is the area that the user of the transmitting device is currently paying attention to during the screen sharing process.
  • the description information of the attention area specifically includes description information of a boundary of the attention area or coordinates of a center point of the attention area.
  • the sending unit 503 is configured to receive the screen sharing image from the image capturing unit 501, receive the description information of the attention area from the information acquiring unit 502, and send the screen sharing image and the image auxiliary information to the receiving device.
  • the image auxiliary information includes a description letter of the region of interest And causing the receiving device to determine, in the screen sharing image, an area to be displayed including at least a part of the attention area according to the description information and display image content in the area to be displayed.
  • Embodiment 1 The information acquiring unit 502 is specifically configured to use a clustering algorithm to group the recorded mouse positions that meet the preset conditions, and use the group that meets the target condition as the target group, and connect the mouse position in the target group.
  • An area enclosed by the rectangle is used as the attention area, and information for describing the circumscribed rectangle is used as description information of the attention area, and is used to transmit description information of the attention area to the sending unit 503.
  • the information acquiring unit 502 is further configured to record a current mouse position according to a preset time interval, where the mouse position that meets the preset condition includes, when the grouping operation is performed. The mouse position recorded during the previous preset length period.
  • the information acquiring unit 502 is configured to specifically include the group that satisfies the target condition as the target group, and the information acquiring unit 502 is configured to: use the group with the largest number of mouse positions as the target group; or record according to each mouse position.
  • the time of each mouse position is assigned a corresponding weight, and the mouse position included in each group is weighted to obtain a weight value of each group, and the group with the largest weight value is used as the target group, wherein, for the post record
  • the weight assigned to the mouse position is higher than the weight assigned to the previously recorded mouse position.
  • the information acquiring unit 502 is further configured to record, when the mouse operation is detected, the mouse position corresponding to the mouse operation and the attribute information of the mouse operation, where the preset is satisfied.
  • the mouse position of the condition includes a mouse position corresponding to the mouse operation detected within a preset length of time before the time when the grouping operation is performed;
  • the information acquiring unit 502 is configured to specifically include the group that meets the target condition as the target group, and the information acquiring unit 502 is configured to: assign a corresponding weight to the mouse position corresponding to the mouse operation according to the attribute information of each mouse operation, for each group The mouse position included in the mouse is weighted to obtain weighting values of the respective groups, and the group having the largest weighting value is taken as the target group.
  • Embodiment 2 The information acquiring unit 502 is specifically configured to: when detecting a keyboard input operation, determine a current input cursor position, and use an input area centered on the cursor position in the screen sharing image as the attention area, Information describing the input area is used as description information of the attention area, and description information of the attention area is transmitted to the transmitting unit 503.
  • Embodiment 3 The information acquiring unit 502 is specifically configured to: use, as the attention area, an area in which an image content that is updated in an image displayed in the shared area is located, and obtain information for describing an area where the image content is located Descriptive information of the attention area, and the description information of the attention area is transmitted to the transmitting unit 503.
  • the information acquiring unit 502 may be further configured to identify a boundary of the effective image area in the screen sharing image and acquire description information of a boundary of the effective image area, and transmit the description information of the boundary of the effective image area to Transmitting unit 503.
  • the sending unit 503 is further configured to receive, from the information acquiring unit 502, description information of a boundary of the effective image area, and send the description information of the boundary of the effective image area as part of the image auxiliary information to the Determining, by the receiving device, the receiving device to determine the to-be-displayed area according to the description information of the attention area and the description information of the boundary of the effective image area, where the determined to-be-displayed area includes at least the attention area a portion, and at least a portion of the area to be displayed is included in the effective image area.
  • the functional unit described in Embodiment 2 of the present invention can be used to implement the operations performed by the transmitting device in the method described in Embodiment 1 above.
  • the communication device 500 not only transmits the screen sharing image to the receiving device, but also sends description information of the area currently being focused by the user of the communication device 500 to the receiving device during the screen sharing process. And causing the receiving device to determine, according to the description information, an area to be displayed including at least a portion of the area and display image content in the area to be displayed on a screen of the receiving device, and thus, a user of the communication device 500 At least a portion of the image content in the area currently being focused may be displayed on the screen of the receiving device, thereby improving communication efficiency when the screen is shared.
  • Embodiment 3 of the present invention provides a communication device 600 for implementing screen sharing. As shown in FIG. 8, the communication device 600 includes: a receiving unit 601, a determining unit 602, and a display unit 603.
  • the receiving unit 601 is configured to receive a screen sharing image and image assisting information sent by a sending device that is performing screen sharing, where the image assisting information includes description information of a region of interest in the screen sharing image, where the screen sharing image is The area of interest is an area that the user of the transmitting device is currently paying attention to during the screen sharing process, the screen sharing image is an image displayed by the shared area on the screen of the transmitting device, and is used to transmit the image auxiliary information To the determining unit 602, the screen sharing image is transmitted to the display unit 603.
  • the description information of the attention area specifically includes description information of a boundary of the attention area or coordinates of a center point of the attention area.
  • a determining unit 602 configured to receive the image assistance information from the receiving unit 601, and further configured to determine, on a screen of the communication device 600, a width of a display area for displaying the screen sharing image is smaller than a width of the screen sharing image, Or determining the to-be-displayed area in the screen sharing image according to the description information of the attention area and the resolution of the display area when the height of the display area is smaller than the height of the screen sharing image, and determining the to-be-displayed area
  • the resolution of the display area is the same as the resolution of the display area, and the area to be displayed includes at least a portion of the area of interest, and information for describing the area to be displayed is transmitted to the display unit 603.
  • the determining unit 602 may perform the operation of determining the area to be displayed when it is determined that the operation for indicating the scrolling is not detected within a period of the previous preset length.
  • the determining unit 602 is further configured to determine whether an operation for indicating scrolling is detected in the time period, and when it is determined that the operation for indicating scrolling is not detected within the time period according to the determination result, Determining the to-be-displayed area according to the description information of the attention area and the resolution of the display area, and transmitting information for describing the to-be-displayed area to the display list
  • the operation of the element is further configured to determine, according to the detected information for indicating the operation of scrolling, the user of the receiving device, when the operation for indicating the scrolling is detected within the time period determined according to the determining result
  • An area of current interest determining an area to be displayed in the screen sharing image according to an area currently in focus of the user of the receiving device and a resolution of the display area, and transmitting information for describing the area to be displayed to The display unit.
  • a display unit 603 configured to receive the screen sharing image from the receiving unit 601, and receive information for describing the area to be displayed from the determining unit 602, and configured to use the information for describing the area to be displayed
  • the image content in the area to be displayed of the screen sharing image is displayed in the display area.
  • the description information of the region of interest specifically includes coordinates of a center point of the region of interest; the determining unit may be specifically configured to share on the screen according to coordinates of a center point of the region of interest An area including the center point and having the same resolution as that of the display area is determined in the image as the area to be displayed.
  • the determining unit 602 can be used to implement the method provided in Embodiment 1 of the step 240 of the above-described Embodiment 1 to determine the area to be displayed.
  • the description information of the attention area specifically includes description information of a boundary of the attention area, where the attention area is a rectangular area in which one side is parallel to one side of the screen sharing image;
  • the determining unit may be configured to: when the width of the display area is greater than the width of the attention area and the height of the display area is greater than the height of the attention area, the description information according to the boundary of the attention area is Determining, in the screen sharing image, an area including the attention area and having the same resolution as that of the display area as the area to be displayed, the width of the display area being smaller than the width of the attention area and/or the When the height of the display area is smaller than the height of the attention area, determining a center point including the attention area and a resolution of the display area in the screen sharing image according to description information of a boundary of the attention area The same area is used as the area to be displayed.
  • the determining unit 602 can be used to implement the method provided in Embodiment 2 of the step 240 of the above-described Em
  • the image assistance information received by the receiving unit 601 may further include the screen sharing image Corresponding information of the effective image area, correspondingly, the determining unit 602 is specifically configured to determine the to-be-displayed area according to the description information of the boundary of the effective image area and the description information of the attention area, and the determined to be displayed
  • the resolution of the region is the same as the resolution of the display region and includes at least a portion of the region of interest, and at least a portion of the determined region to be displayed is included in the effective image region.
  • the determining unit 602 may be specifically configured to implement the method provided in Embodiment 3 of Step 240 of Embodiment 1 and Embodiment 4 to determine the area to be displayed.
  • the functional unit described in Embodiment 3 of the present invention can be used to implement the operations performed by the receiving device in the method described in Embodiment 1 above.
  • the communication device 600 may further include a difference calculation unit 604.
  • the determining unit 602 is further configured to transmit information for describing the area to be displayed to the difference calculating unit 604;
  • the difference calculation unit 604 is configured to receive, from the determining unit 602, information for describing the area to be displayed, and to obtain the first coordinate, determine the second coordinate according to the information used to describe the area to be displayed, and calculate the Determining a difference between the first coordinate and the second coordinate, wherein the first coordinate is a screen sharing image corresponding to a center point of the image content currently displayed in the display area corresponding to the currently displayed image content
  • the coordinate in the second coordinate is the coordinate of the center point of the area to be displayed in the screen sharing image received by the receiving unit 601, and is also used to transmit the difference to the display unit 603;
  • the display unit 603 is specifically configured to display image content in the to-be-displayed area in the display area when determining that the difference exceeds a set threshold.
  • Embodiment 3 of the present invention since the area to be displayed determined by the communication device 600 is the same as the resolution of the display area on the screen of the receiving device, the image content in the area to be displayed may be completely presented in the display area, and The to-be-displayed area is determined according to description information of an area that the user of the transmitting device is currently paying attention to during the screen sharing process, and includes at least one part of the area Therefore, the communication device 600 can display at least a part of the image content in the area that the user of the transmitting device is currently paying attention to, so that the communication efficiency at the time of screen sharing can be improved.
  • Embodiment 4 of the present invention provides a communication device 1000 for implementing screen sharing. As shown in FIG. 10, the communication device 1000 includes a processor 1010 and a memory 1020, wherein the processor 1010 and the memory 1020 are Inter-communication is accomplished via the bus.
  • the memory 1020 is configured to store computer operation instructions.
  • Memory 1020 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.
  • the processor 1010 is configured to execute computer operation instructions stored in the memory 1020.
  • the processor 1010 may specifically be a central processing unit (CPU, centra l proces s ing uni t ), which is a computer core unit.
  • the processor 1010 executes the computer operation instructions to cause the communication device 1000 to perform the following operations:
  • the image displayed on the shared area on the screen of the communication device 1000 is captured to acquire a screen share image.
  • Descriptive information of the attention area in the screen sharing image is obtained, wherein the attention area in the screen sharing image is an area that the user of the transmitting device is currently paying attention to during the screen sharing process.
  • the description information of the attention area may specifically include description information of a boundary of the attention area or coordinates of a center point of the attention area.
  • the processor 1010 executes the computer operation instructions to cause the communication device 1000 to specifically implement the operations performed by the sending device in the method according to Embodiment 1 of the present invention.
  • the communication device 1000 not only transmits the screen sharing image to the interface And receiving, by the device, description information of an area that the user of the communication device 1000 is currently paying attention to during the screen sharing process, to cause the receiving device to determine, according to the description information, at least a part of the area Displaying an area and displaying image content in the area to be displayed on a screen of the receiving device, and therefore, at least a part of image content in an area currently being focused by a user of the communication device 1000 may be displayed on the receiving device On the screen, you can improve the communication efficiency when sharing the screen.
  • Embodiment 5 of the present invention provides a communication device 2000 for implementing screen sharing. As shown in FIG. 11, the communication device 2000 includes a processor (proces sor) 2010 and a memory 2020, where Communication between the processor 2010 and the memory 2020 is accomplished by a bus.
  • the memory 2020 is configured to store computer operation instructions.
  • Memory 2020 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.
  • the processor 2010 is configured to execute computer operation instructions stored in the memory 2020.
  • the processor 2010 may specifically be a central processing unit (CPU, centra l proces s ing uni t ), which is a computer core unit.
  • the processor 2010 executes the computer operation instructions to cause the communication device 2000 to perform the following operations:
  • the image assisting information including description information of a region of interest in the screen sharing image, wherein the attention region in the screen sharing image is on the screen An area in which the user of the transmitting device is currently paying attention in the sharing process, and the screen sharing image is an image displayed by a shared area on a screen of the transmitting device;
  • a width of a display area for displaying the screen sharing image is smaller than a width of the screen sharing image, or a height of the display area is smaller than the screen sharing map Determining, according to the description information of the attention area and the resolution of the display area, the area to be displayed in the screen sharing image, the determined resolution of the area to be displayed and the resolution of the display area The rates are the same, and the area to be displayed includes at least a portion of the area of interest;
  • the image content in the area to be displayed is displayed in the display area.
  • the processor 2G1 G executes the computer operation instructions to cause the communication device 2000 to specifically implement the operations performed by the receiving device in the method according to Embodiment 1 of the present invention.
  • Embodiment 5 of the present invention since the area to be displayed determined by the communication device 2000 is the same as the resolution of the display area on the screen of the receiving device, the image content in the area to be displayed may be completely presented in the display area, and The to-be-displayed area is determined according to description information of an area that the user of the transmitting device is currently paying attention to during the screen sharing process and includes at least a part of the area, so the communication device 2000 may be currently paying attention to the user of the transmitting device. At least a part of the image content in the area is displayed, thereby improving the communication efficiency when the screen is shared.
  • Embodiment 6 of the present invention proposes a communication system 5000 for realizing screen sharing. As shown in FIG. 12, the communication system 5000 includes a transmitting device 5010 and a receiving device 5020.
  • the sending device 5010 is configured to capture an image displayed by the shared area on the screen of the sending device 5010 to obtain a screen sharing image, obtain description information of the attention area in the screen sharing image, and send the screen sharing to the receiving device 5020.
  • Image and image auxiliary information, the image auxiliary information including description information of the region of interest.
  • the area of interest in the screen sharing image is an area that the user of the transmitting device is currently paying attention to during the screen sharing process.
  • the receiving device 5020 is configured to receive the screen sharing image and the image assisting information sent by the sending device 5010, and the width of the display area for displaying the screen sharing image on the screen of the determining receiving device 5020 is smaller than the screen.
  • the width of the shared image, or the height of the display area is smaller than the height of the screen shared image, determining the area to be displayed in the screen shared image according to the description information of the attention area and the resolution of the display area, Determining the resolution of the area to be displayed The rate is the same as the resolution of the display area, and the area to be displayed includes at least a portion of the area of interest, and is further used to display image content in the area to be displayed in the display area.
  • the sending device 5010 is further configured to identify a boundary of the effective image area in the screen sharing image and acquire description information of a boundary of the effective image area, and use the description information of the boundary of the effective image area as the A part of the image assistance information is sent to the receiving device 5020.
  • the receiving device 5020 is configured to determine that the to-be-displayed area specifically includes, by the receiving device 5020, description information according to a boundary of the effective image area and the area of interest.
  • the description information determines the area to be displayed, the determined resolution of the area to be displayed is the same as the resolution of the display area and includes at least a part of the area of interest, and the determined at least part of the area to be displayed includes In the effective image area.
  • the communication system 5000 described in Embodiment 6 of the present invention can be used to implement the method described in Embodiment 1 above.
  • the sending device 5010 not only sends the screen sharing image to the receiving device 5020, but also sends description information of the area that the user of the device 5010 is currently paying attention to in the screen sharing process to the receiving device 5020, correspondingly
  • the receiving device 5020 determines, according to the description information, a to-be-displayed area including at least a portion of the area and displays the image content in the area to be displayed on a display area on the screen of the receiving device 5020, and thus, the transmitting device 5010 At least a part of the image content in the area that the user is currently paying attention to can be displayed on the screen of the receiving device 5020, so that the communication efficiency at the time of screen sharing can be improved.
  • the disclosed systems, devices, and methods may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
  • the components displayed for the unit may or may not be physical units, ie may be located in one place, or may be distributed over multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM, Random Acces s Memory), a magnetic disk, or an optical disk, and the like, which can store program codes. medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Image Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明实施例公开了一种实现屏幕共享的方法、装置和系统。该方法包括:接收设备接收正在进行屏幕共享的发送设备发送的屏幕共享图像和所述屏幕共享图像中的关注区域的描述信息,其中所述屏幕共享图像中的关注区域为在屏幕共享过程中所述发送设备的用户当前正在关注的区域,根据所述关注区域的描述信息和所述接收设备的屏幕上用于显示所述屏幕共享图像的显示区的分辨率确定所述屏幕共享图像中的包括所述关注区域的至少一部分的待显示区域,并在所述显示区显示所述待显示区域中的图像内容,因此,可以将该发送设备的用户当前正在关注的区域中的至少一部分图像内容显示出来,从而可以提升屏幕共享时的沟通效率。

Description

一种实现屏幕共享的方法、 装置和系统 技术领域
本发明实施例涉及通信领域, 并且更具体地, 涉及一种实现屏幕共享的 方法、 装置和系统。
背景技术
目前, 在远程数据会议、 远程协助等场景中, 进行屏幕共享的发送设备 可以将通过抓取本设备屏幕上的共享区域显示的图像获取的屏幕共享图像实 时地发送给接收设备以将其呈现在接收设备的屏幕上, 接收设备的用户感觉 如同与发送设备的用户在观看同一个屏幕一样。
在实际的使用中, 经常会出现接收设备屏幕中用于显示屏幕共享图像的 显示区的宽度和 /或高度小于该屏幕共享图像的宽度和 /或高度的情况, 在这 种情况下, 发送设备发送的屏幕共享图像显然无法完整地呈现在接收设备的 屏幕上。
根据现有技术, 会默认将该屏幕共享图像中的默认区域(如左上角区域) 中的图像内容显示在接收设备的屏幕上。 当发送设备的用户当前关注的是默 认区域以外的图像内容时, 如, 发送设备的用户就默认区域以外的图像内容 进行介绍, 接收设备的用户只可以通过拖滚动条等手动操作的方式观看当前 应该关注的图像内容, 沟通效率较低。
发明内容
本发明实施例提供一种实现屏幕共享的方法、 装置和系统, 用于解决现 有技术中存在的屏幕共享时沟通效率较低的问题。
第一方面, 提供了一种实现屏幕共享的方法, 包括:
接收设备接收正在进行屏幕共享的发送设备发送的屏幕共享图像和图像 辅助信息, 所述图像辅助信息包括所述屏幕共享图像中的关注区域的描述信 息, 其中所述屏幕共享图像中的关注区域为在屏幕共享过程中所述发送设备 的用户当前正在关注的区域, 所述屏幕共享图像是所述发送设备的屏幕上的 共享区显示的图像;
所述接收设备在确定所述接收设备的屏幕上用于显示所述屏幕共享图像 的显示区的宽度小于所述屏幕共享图像的宽度, 或所述显示区的高度小于所 述屏幕共享图像的高度时, 根据所述关注区域的描述信息和所述显示区的分 辨率确定所述屏幕共享图像中的待显示区域, 确定的所述待显示区域的分辨 率与所述显示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少 一部分;
所述接收设备在所述显示区显示所述待显示区域中的图像内容。
在第一方面的第一种可能的实现方式中, 所述关注区域的描述信息具体 包括所述关注区域的中心点的坐标; 所述根据所述关注区域的描述信息和所 述显示区的分辨率确定所述待显示区域具体包括: 根据所述关注区域的中心 点的坐标在所述屏幕共享图像中确定包括所述中心点且分辨率与所述显示区 的分辨率相同的区域作为所述待显示区域。
结合第一方面的第一种可能的实现方式 ,在第二种可能的实现方式中, 所述中心点的坐标为(centerX, centerY) , 其中, 所述屏幕共享图像的左上角 为坐标原点, 横坐标轴横向朝右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 pi cWidth*picHe ight ; 所述显示区的分辨 率为 viewWidth * viewHe ight ;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显 示区域具体包括:
按照如下方式计算所述待显示区域的最左点的横坐标 rcLef t、 最高点的 纵坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBot tom:
当 PicWidth >= viewWidth时, 按照 ¾口下方法计算 rcLef t和 rcRight:
如果 centerX_viewWidth/2 <= 0 , rcLef t = 0, rcRight =viewWidth; 如果 centerX+viewWidth/2 > PicWidth, rcLef t = PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = centerX-viewWidth/ 2 , rcRight = centerX+viewWidth/ 2;
当 PicWidth < viewWidth时,按照如下方法计算 rcLeft和 rcRight: rcLef t = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, 按照如下方法计算 rcTop和 rcBottom:
如果 centerY_viewHeight/2 <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (centerY+viewHeight/2 > PicHeight) , rcTop =
PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = centerY-viewHeight/2, rcBottom =
centerY+viewHeight/2;
当 PicHeight < viewHeight时, 按照如下方法计算 rcTop和 rcBottom: rcTop = 0, rcBottom = viewHeight。
在第一方面的第三种可能的实现方式中, 所述关注区域的描述信息具体 包括所述关注区域的边界的描述信息, 所述关注区域为其中一边和所述屏幕 共享图像的其中一边平行的矩形区域;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显 示区域具体包括:
在所述显示区的宽度大于所述关注区域的宽度且所述显示区的高度大于 所述关注区域的高度时, 根据所述关注区域的边界的描述信息在所述屏幕共 享图像中确定包括所述关注区域且分辨率与所述显示区的分辨率相同的区域 作为所述待显示区域;
在所述显示区的宽度小于所述关注区域的宽度和 /或所述显示区的高度 小于所述关注区域的高度时, 根据所述关注区域的边界的描述信息在所述屏 幕共享图像中确定包括所述关注区域的中心点且分辨率与所述显示区的分辨 率相同的区域作为所述待显示区域。
结合第一方面的第三种可能的实现方式 ,在第四种可能的实现方式中, 所述关注区域的边界的描述信息具体包括所述关注区域的最左点的横坐标 atLeft、 最高点的纵坐标 atTop、 最右点的横坐标 atRight和最氏点的纵坐标 atBottom, 其中, 所述屏幕共享图像的左上角为坐标原点, 横坐标轴横向朝 右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨 率为 viewWidth * viewHeight;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显 示区域具体包括:
按照如下方式计算所述待显示区域的最左点的横坐标 rcLeft、 最高点的 纵坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBottom:
当 PicWidth >= viewWidth时, 按照 ¾口下方法计算 rcLef t和 rcRight:
如果 atl ft+atRight-viewWidth <= 0, rcLef t = 0, rcRight =viewWidth;
如果 ( atLef t+atRight+viewWidth ) /2 > PicWidth, rcLeft = PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
当 PicWidth < viewWidth时, 按照 ¾口下方法计算 rcLef t和
rcRight: rcLef t = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, 按照如下方法计算 rcTo 和 rcBottom:
如果 atTop+atBot tom_viewHeight <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (atTop+atBottom+viewHeight ) / 2 > PicHeight, rcTop = PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = ( atTop+atBottom-viewHeight ) /2, rcBottom = ( atTop+atBottom+viewHeight ) /2;
当 PicHeight < viewHeight时, 按照如下方法计算 rcTop和 rcBottom: rcTop = 0, rcBottom = viewHeight。
在第一方面的第五种可能的实现方式中, 所述图像辅助信息还包括所述 屏幕共享图像中的有效图像区域的描述信息; 所述根据所述关注区域的描述 信息和所述显示区的分辨率确定所述待显示区域具体包括: 根据所述有效图 像区域的边界的描述信息、 所述显示区的分辨率、 以及所述关注区域的描述 信息确定所述待显示区域, 确定的所述待显示区域的分辨率与所述显示区的 分辨率相同且包括所述关注区域的至少一部分, 并且确定的所述待显示区域 的至少一部分包含在所述有效图像区域中。
结合第一方面的第五种可能的实现方式 ,在第六种可能的实现方式中, 所述关注区域的描述信息具体包括所述关注区域的中心点的坐标
(centerX, centerY) , 其中, 所述屏幕共享图像的左上角为坐标原点, 横坐标 轴横向朝右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨 率为 viewWidth * viewHeight;
所述有效图像区域为其中一边和所述横坐标轴平行的矩形区域, 所述有 效图像区 i或的边界的描述信息为 (BorderLeft, BorderTop, BorderRight, Bo rder Bo ttom),其中, BorderLeft为所述有效图像区域上的最左点的横坐标, BorderTo 为所述有效图像区域上的最高点的纵坐标, BorderRight为所述有 效图像区域上的最右点的横坐标, BorderBottom为所述有效图像区域上的最 低点的纵坐标;
所述根据所述有效图像区域的边界的描述信息和所述关注区域的描述信 息确定所述待显示区域具体包括: 按照如下方式计算所述待显示区域的最左点的横坐标 rcLeft、 最高点的 纵坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBottom:
当 BorderRight-BorderLef t >= viewWidth时,按照如下方法计算 rcLef t 和 rcRight:
如果 (centerX_viewWidth/2 <= BorderLef t) , rcLef t = BorderLef t , rcRight = BorderLef t+viewWidth;
如果(centerX+viewWidth/2 > BorderRight)时, rcLef t = BorderRight-viewWidth, rcRight = BorderRight;
否则, rcLef t = centerX-viewWidth/2, rcRight =
centerX+viewWidth/ 2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth > viewWidth 时, 按照 ¾。下方法计算 rcLeft和 rcRight:
如果((BorderLef t+BorderRight) /2 <= viewWidth/2) , rcLeft = 0, rcRight = viewWidth;
如果((BorderLef t+BorderRight+viewWidth) /2 > picWidth) , rcLeft = icWidth-viewWidth, rcRight = picWidth;
否则, rcLeft = (BorderRight+BorderLef t-viewWidth) /2, rcRight = (BorderRight+BorderLef t+viewWidth) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth < viewWidth 时, 按照如下方法计算 rcLeft和 rcRight: rcLeft: 0, rcRight= viewWidth; 当 BorderBot tom-BorderTop >= viewHeight时,按照如下方法计算 rcTop 和 rcBottom:
如果 (centerY_viewHeight/2 <= BorderTop) , rcTop =
BorderTop, rcBottom = BorderTop+viewHeight;
如果 (centerY+viewHeight/2 > BorderBot torn) , rcTop = BorderBot tom-viewHeight , rcBottom = BorderBot torn; 否则, rcTop = centerY-viewHeight/2, rcBot torn = centerY+viewHeight/2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight > viewHeight 时, 按照如下方法计算 rcTo 和 rcBottom:
如果 ( (BorderTop+BorderBottom) /2 <= viewHeight/2) , rcTop = 0, rcBottom = viewHeight;
如果 ( (BorderTop+BorderBot tom+viewHeight) /2 > picHeight) , rcTop = icHeight-viewHeight , rcBottom = icHeight; 否则, rcTop = (BorderBot tom+BorderTop-viewHeight) / 2, rcBottom = (BorderBot tom+BorderTop+viewHeight) / 2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight < viewHeight 时,按照如下方法计算 rcTo 和 rcBottom: rcTop = 0, rcBottom = viewHeight。
结合第一方面的第五种可能的实现方式 ,在第七种可能的实现方式中, 以所述屏幕共享图像的左上角为坐标原点, 横坐标轴横向朝右, 纵坐标轴纵 向朝下, 所述关注区域为其中一边和所述横坐标轴平行的矩形区域, 其中, 所述关注区域的描述信息具体包括所述关注区域的边界的描述信息(atLeft, atTop, atRight, atBottom), atLeft为所述关注区 i或上的最左点的横坐标, atTop为所述关注区域上的最高点的纵坐标, atRight为所述关注区域上的最 右点的横坐标, atBottom为所述关注区域上的最低点的纵坐标;
所述有效图像区域为其中一边和所述横坐标轴平行的矩形区域, 所述有 效图像区 i或的边界的描述信息为 (BorderLeft, BorderTop, BorderRight, BorderBottom),其中, BorderLeft为所述有效图像区域上的最左点的横坐标, BorderTo 为所述有效图像区域上的最高点的纵坐标, BorderRight为所述有 效图像区域上的最右点的横坐标, BorderBottom为所述有效图像区域上的最 低点的纵坐标;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨 率为 viewWidth * viewHeight;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显 示区域具体包括:
按照如下方式计算所述待显示区域的最左点的横坐标 rcLeft、 最高点的 纵坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBottom:
当 BorderRight-BorderLef t >= viewWidth时,按照如下方法计算 rcLef t 和 rcRight:
如果 ( atLef t+atRight-viewWidth ) /2 <= BorderLeft, rcLeft = BorderLeft, rcRight = BorderLef t+viewWidth;
如果( atLef t+atRight+viewWidth )/2 > BorderRight时, rcLef t = BorderRight - viewWidth, rcRight = BorderRight;
否则, rcLef t = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth > viewWidth 时, 按照 ¾。下方法计算 rcLeft和 rcRight:
如果((BorderLef t+BorderRight) /2 <= viewWidth/2) , rcLeft = 0, rcRight = viewWidth;
如果((BorderLef t+BorderRight+viewWidth) /2 > picWidth) , rcLeft = icWidth-viewWidth, rcRight = picWidth;
否则, rcLeft = (BorderRight+BorderLef t-viewWidth) /2, rcRight = (BorderRight+BorderLef t+viewWidth) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth < viewWidth 时, 按照如下方法计算 rcLeft和 rcRight: rcLeft: 0, rcRight= viewWidth; 当 BorderBot tom-BorderTop >= viewHeight时,按照如下方法计算 rcTop 和 rcBottom:
如果 ( atTop+atBottom-viewHeight ) / 2<= BorderTop, rcTop = BorderTop, rcBottom = BorderTop+viewHeight;
如果 ( atTop+atBot tom+viewHeight ) /2 > BorderBottom, rcTop = BorderBottom-viewHeight , rcBottom = BorderBottom;
否则, rcTop = ( atTop+atBottom-viewHeight ) /2, rcBottom = ( atTop+atBottom+viewHeight ) / 2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight > viewHeight 时, 按照如下方法计算 rcTo 和 rcBottom:
如果 ( (BorderTop+BorderBottom) /2 <= viewHeight/2) , rcTop = 0, rcBottom = viewHeight;
如果 ( (BorderTop+BorderBot tom+viewHeight) /2 > picHeight) , rcTop = icHeight-viewHeight , rcBottom = icHeight; 否则, rcTop = (BorderBot tom+BorderTop-viewHeight) / 2, rcBottom = (BorderBot tom+BorderTop+viewHeight) / 2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight < viewHeight 时,按照如下方法计算 rcTo 和 rcBottom: rcTop = 0, rcBottom = viewHeight。
结合第一方面、 第一方面的第一种至第七种任一可能的实现方式 ,在第 八种可能的实现方式中, 所述接收设备在所述显示区显示所述待显示区域中 的图像内容之前还包括:
获取第一坐标, 所述第一坐标为所述显示区中当前显示的图像内容的中 心点在所述当前显示的图像内容对应的屏幕共享图像中的坐标;
确定第二坐标, 所述第二坐标为所述待显示区域的中心点在所述屏幕共 享图像中的坐标;
计算所述第一坐标和所述第二坐标之间的差值;
所述在所述显示区显示所述待显示区域中的图像内容具体包括: 在确定 所述差值超过设定阔值时, 在所述显示区显示所述待显示区域中的图像内容。
结合第一方面、 第一方面的第一种至第八种任一可能的实现方式 ,在第 九种可能的实现方式中, 所述接收设备在确定在之前的预设长度的时间段内 没有检测到用于指示滚屏的操作时执行所述根据所述关注区域的描述信息和 所述显示区的分辨率确定所述待显示区域并显示所述待显示区域中的图像内 容的操作。
结合第一方面的第九种可能的实现方式 ,在第十种可能的实现方式中, 所述方法还包括: 所述接收设备在接收到所述屏幕共享图像时, 判断所述时 间段内是否检测到用于指示滚屏的操作;
如果根据判断结果确定所述时间段内没有检测到用于指示滚屏的操作, 执行所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显 示区域并显示所述待显示区域中的图像内容的操作;
如果根据所述判断结果确定所述时间段内检测到用于指示滚屏的操作, 根据检测到的所述用于指示滚屏的操作的信息确定所述接收设备的用户当前 关注的区域, 并根据所述接收设备的用户当前关注的区域和所述显示区的分 辨率确定所述屏幕共享图像中的待显示区域并在所述显示区显示所述待显示 区域中的图像内容。 第二方面, 提供了一种实现屏幕共享的方法, 所述方法包括: 发送设备抓取所述发送设备的屏幕上的共享区显示的图像以获取屏幕共 享图像;
所述发送设备获取所述屏幕共享图像中的关注区域的描述信息, 其中所 述关注区域为在屏幕共享过程中所述发送设备的用户当前正在关注的区域; 所述发送设备向接收设备发送所述屏幕共享图像和图像辅助信息 , 所述 图像辅助信息包括所述关注区域的描述信息, 以促使所述接收设备根据所述 描述信息在所述屏幕共享图像中确定包括所述关注区域的至少一部分的待显 示区域并显示所述待显示区域中的图像内容。
在第二方面的第一种可能的实现方式中, 所述关注区域的描述信息具体 包括所述关注区域的边界的描述信息或所述关注区域的中心点的坐标。
结合第二方面或第二方面的第一种可能的实现方式 ,在第二种可能的实 现方式中, 所述发送设备获取所述关注区域的描述信息具体包括: 所述发送 设备利用聚类算法对记录的满足预设条件的鼠标位置进行分群, 将满足目标 条件的群作为目标群, 将所述目标群中的鼠标位置的外接矩形所围成的区域 作为所述关注区域, 获取用于描述所述外接矩形的信息作为所述关注区域的 描述信息。
结合第二方面的第二种可能的实现方式 ,在第三种可能的实现方式中, 所述利用聚类算法对记录的满足预设条件的鼠标位置进行分群之前还包括: 按照预设时间间隔记录当前的鼠标位置; 所述满足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的预设长度的时间段内记录的鼠标位置。
结合第二方面的第三种可能的实现方式 ,在第四种可能的实现方式中, 所述将满足目标条件的群作为目标群具体包括:
将包括的鼠标位置数量最多的群作为所述目标群; 或者,
根据各鼠标位置记录的时间先后为各鼠标位置赋予对应的权值, 对各个 群中包括的鼠标位置进行加权计算以获得各个群的加权值, 将加权值最大的 群作为所述目标群, 其中, 为后记录的鼠标位置赋予的权值高于为先记录的 鼠标位置赋予的权值。
结合第二方面的第二种可能的实现方式 ,在第五种可能的实现方式中, 所述利用聚类算法对记录的满足预设条件的鼠标位置进行分群之前还包括: 在检测到鼠标操作时, 记录所述鼠标操作对应的鼠标位置和所述鼠标操作的 属性信息;
所述满足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的 预设长度的时间段内检测到的鼠标操作对应的鼠标位置;
所述将满足目标条件的群作为目标群具体包括: 根据各鼠标操作的属性 信息为所述鼠标操作对应的鼠标位置赋予对应的权值, 对各个群中包括的鼠 标位置进行加权计算以获得各个群的加权值, 将加权值最大的群作为所述目 标群。
结合第二方面的第五种可能的实现方式 ,在第六种可能的实现方式中, 所述鼠标操作的属性信息包括所述鼠标操作的类型和 /或所述鼠标操作发生 的时间。
结合第二方面或第二方面的第一种可能的实现方式 ,在第七种可能的实 现方式中, 所述发送设备获取所述关注区域的描述信息具体包括: 所述发送 设备在检测到键盘输入操作时, 确定当前的输入光标位置, 将所述屏幕共享 图像中以所述光标位置为中心的输入区域作为所述关注区域, 获取用于描述 所述输入区域的信息作为所述关注区域的描述信息。
结合第二方面或第二方面的第一种可能的实现方式 ,在第八种可能的实 现方式中, 所述发送设备获取所述关注区域的描述信息具体包括: 所述发送 设备将所述共享区显示的图像中发生更新的图像内容所在的区域作为所述关 注区域, 获取用于描述所述图像内容所在的区域的信息作为所述关注区域的 描述信息。
结合第二方面、 第二方面的第一种至第八种任一可能的实现方式 ,在第 九种可能的实现方式中, 所述发送设备向所述接收设备发送所述屏幕共享图 像和图像辅助信息之前还包括: 所述发送设备识别所述屏幕共享图像中的有 效图像区域的边界并获取所述有效图像区域的边界的描述信息; 所述图像辅 助信息还包括所述有效图像区域的边界的描述信息, 以促使所述接收设备根 据所述关注区域的描述信息和所述有效图像区域的边界的描述信息确定所述 待显示区域, 确定的所述待显示区域包括所述关注区域的至少一部分, 且所 述待显示区域的至少一部分包含在所述有效图像区域中。 第三方面, 提供了一种实现屏幕共享的通信设备, 包括: 接收单元、 确 定单元和显示单元; 所述接收单元, 用于接收正在进行屏幕共享的发送设备发送的屏幕共享 图像和图像辅助信息, 所述图像辅助信息包括所述屏幕共享图像中的关注区 域的描述信息, 其中所述关注区域为在屏幕共享过程中所述发送设备的用户 当前正在关注的区域, 所述屏幕共享图像是所述发送设备的屏幕上的共享区 显示的图像, 并用于将所述图像辅助信息传输至所述确定单元, 将所述屏幕 共享图像传输至所述显示单元;
所述确定单元, 用于从所述接收单元接收所述图像辅助信息, 还用于在 确定所述通信设备的屏幕上用于显示所述屏幕共享图像的显示区的宽度小于 所述屏幕共享图像的宽度, 或所述显示区的高度小于所述屏幕共享图像的高 度时, 根据所述关注区域的描述信息和所述显示区的分辨率确定所述屏幕共 享图像中的待显示区域, 确定的所述待显示区域的分辨率与所述显示区的分 辨率相同, 且所述待显示区域包括所述关注区域的至少一部分, 并将用于描 述所述待显示区域的信息发送给所述显示单元;
所述显示单元, 用于从所述接收单元接收所述屏幕共享图像, 从所述确 定单元接收用于描述所述待显示区域的信息, 并用于根据所述用于描述所述 待显示区域的信息将所述屏幕共享图像的在所述待显示区域中的图像内容显 示在所述显示区。
在第三方面的第一种可能的实现方式中, 所述关注区域的描述信息具体 包括所述关注区域的中心点的坐标; 所述确定单元, 具体用于根据所述关注 区域的中心点的坐标在所述屏幕共享图像中确定包括所述中心点且分辨率与 所述显示区的分辨率相同的区域作为所述待显示区域。
结合第三方面的第一种可能的实现方式 ,在第二种可能的实现方式中, 所述中心点的坐标为(centerX, centerY) , 其中, 所述屏幕共享图像的左上角 为坐标原点, 横坐标轴横向朝右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 pi cWidth*picHe ight ; 所述显示区的分辨 率为 viewWidth * viewHe ight ; 所述确定单元, 具体用于按照如下方式计算所述待显示区域的最左点的 横坐标 rcLeft、 最高点的纵坐标 rcTop、 最右点的横坐标 rcRight和最氐点 的纵坐标 rcBottom:
当 PicWidth >= viewWidth时, 按照 ¾口下方法计算 rcLef t和 rcRight:
如果 centerX_viewWidth/2 <= 0, rcLef t = 0, rcRight =viewWidth;
如果 centerX+viewWidth/2 > PicWidth, rcLef t = PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = centerX-viewWidth/2, rcRight = centerX+viewWidth/ 2;
当 PicWidth < viewWidth时,按照如下方法计算 rcLeft和 rcRight: rcLef t = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, 按照如下方法计算 rcTop和 rcBottom:
如果 centerY_viewHeight/2 <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (centerY+viewHeight/2 > PicHeight) , rcTop =
PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = centerY-viewHeight/2, rcBottom =
centerY+viewHeight/2;
当 PicHeight < viewHeight时, 按照如下方法计算 rcTop和 rcBottom: rcTop = 0, rcBottom = viewHeight。
在第三方面的第三种可能的实现方式中, 所述关注区域的描述信息具体 包括所述关注区域的边界的描述信息, 所述关注区域为其中一边和所述屏幕 共享图像的其中一边平行的矩形区域; 所述确定单元具体用于, 在所述显示 区的宽度大于所述关注区域的宽度且所述显示区的高度大于所述关注区域的 高度时, 根据所述关注区域的边界的描述信息在所述屏幕共享图像中确定包 括所述关注区域且分辨率与所述显示区的分辨率相同的区域作为所述待显示 区域, 在所述显示区的宽度小于所述关注区域的宽度和 /或所述显示区的高度 小于所述关注区域的高度时, 根据所述关注区域的边界的描述信息在所述屏 幕共享图像中确定包括所述关注区域的中心点且分辨率与所述显示区的分辨 率相同的区域作为所述待显示区域。
结合第三方面的第三种可能的实现方式 ,在第四种可能的实现方式中, 所述关注区域的边界的描述信息具体包括所述关注区域的最左点的横坐标 atLeft、 最高点的纵坐标 atTop、 最右点的横坐标 atRight和最氏点的纵坐标 atBottom, 其中, 所述屏幕共享图像的左上角为坐标原点, 横坐标轴横向朝 右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨 率为 viewWidth * viewHeight;
所述确定单元, 具体用于按照如下方式计算所述待显示区域的最左点的 横坐标 rcLeft、 最高点的纵坐标 rcTop、 最右点的横坐标 rcRight和最氐点 的纵坐标 rcBottom:
当 PicWidth >= viewWidth时, 按照 ¾口下方法计算 rcLef t和 rcRight:
如果 atl ft+atRight-viewWidth <= 0, rcLef t = 0, rcRight =viewWidth;
如果 ( atLef t+atRight+viewWidth ) /2 > PicWidth, rcLeft = PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
当 PicWidth < viewWidth时, 按照 ¾口下方法计算 rcLef t和
rcRight: rcLef t = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, 按照如下方法计算 rcTo 和 rcBottom:
如果 atTop+atBot tom_viewHeight <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (atTop+atBottom+viewHeight ) / 2 > PicHeight, rcTop = PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = ( atTop+atBottom-viewHeight ) /2, rcBottom = ( atTop+atBottom+viewHeight ) /2;
当 PicHeight < viewHeight时, 按照如下方法计算 rcTop和 rcBottom: rcTop = 0, rcBottom = viewHeight。
在第三方面的第五种可能的实现方式中, 所述接收单元接收的所述图像 辅助信息还包括所述屏幕共享图像中的有效图像区域的描述信息; 所述确定 单元, 具体用于根据所述有效图像区域的边界的描述信息和所述关注区域的 描述信息确定所述待显示区域, 确定的所述待显示区域的分辨率与所述显示 区的分辨率相同且包括所述关注区域的至少一部分, 并且确定的所述待显示 区域的至少一部分包含在所述有效图像区域中。
结合第三方面、 第三方面的第一种至第五种任一可能的实现方式 ,在第 六种可能的实现方式中, 所述通信设备还包括差值计算单元;
所述确定单元, 还用于将用于描述所述待显示区域的信息传输至所述差 值计算单元;
所述差值计算单元, 用于从所述确定单元接收用于描述所述待显示区域 的信息, 并用于获取第一坐标、 根据用于描述所述待显示区域的信息确定第 二坐标、 并计算所述第一坐标和所述第二坐标之间的差值, 其中, 所述第一 坐标为所述显示区中当前显示的图像内容的中心点在所述当前显示的图像内 容对应的屏幕共享图像中的坐标, 所述第二坐标为所述待显示区域的中心点 在所述接收单元接收的所述屏幕共享图像中的坐标, 还用于将所述差值传输 至所述显示单元;
所述显示单元, 具体用于在所述差值超过设定阔值时, 在所述显示区显 示所述待显示区域中的图像内容。 结合第三方面、 第三方面的第一种至第六种任一可能的实现方式 ,在第 七种可能的实现方式中, 所述确定单元, 具体用于在确定在之前的预设长度 的时间段内没有检测到用于指示滚屏的操作时执行所述确定所述待显示区域 的操作。
结合第三方面的第七种可能的实现方式 ,在第八种可能的实现方式中, 所述确定单元, 还用于判断所述时间段内是否检测到用于指示滚屏的操作, 并在根据判断结果确定所述时间段内没有检测到用于指示滚屏的操作时, 执 行所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域并将用于描述所述待显示区域的信息发送给所述显示单元的操作; 还用 于在根据所述判断结果确定所述时间段内检测到用于指示滚屏的操作时, 根 据检测到的所述用于指示滚屏的操作的信息确定所述接收设备的用户当前关 注的区域, 根据所述接收设备的用户当前关注的区域和所述显示区的分辨率 确定所述屏幕共享图像中的待显示区域, 并将用于描述所述待显示区域的信 息发送给所述显示单元。 第四方面, 提供了一种实现屏幕共享的通信设备, 包括图像抓取单元、 信息获取单元和发送单元:
所述图像抓取单元, 用于抓取所述通信设备的屏幕上的共享区显示的图 像以获取屏幕共享图像, 并用于将所述屏幕共享图像传输至所述发送单元; 所述信息获取单元, 用于获取所述屏幕共享图像中的关注区域的描述信 息, 并用于将所述关注区域的描述信息传输至所述发送单元, 其中所述关注 区域为在屏幕共享过程中所述发送设备的用户当前正在关注的区域;
所述发送单元, 用于从所述图像抓取单元接收所述屏幕共享图像, 从所 述信息获取单元接收所述关注区域的描述信息, 并用于向接收设备发送所述 屏幕共享图像和图像辅助信息, 所述图像辅助信息包括所述关注区域的描述 信息, 以促使所述接收设备根据所述描述信息在所述屏幕共享图像中确定包 括所述关注区域的至少一部分的待显示区域并显示所述待显示区域中的图像 内容。
在第四方面的第一种可能的实现方式中, 所述信息获取单元, 具体用于 利用聚类算法对记录的满足预设条件的鼠标位置进行分群, 将满足目标条件 的群作为目标群, 将所述目标群中的鼠标位置的外接矩形所围成的区域确定 为所述关注区域, 并获取用于描述所述外接矩形的信息作为所述关注区域的 描述信息。
结合第四方面的第一种可能的实现方式 ,在第二种可能的实现方式中, 所述信息获取单元, 还用于按照预设时间间隔记录当前的鼠标位置, 所述满 足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的预设长度的 时间段内记录的鼠标位置。
结合第四方面的第二种可能的实现方式 ,在第三种可能的实现方式中, 所述信息获取单元用于将满足目标条件的群作为目标群具体包括: 将包括的 鼠标位置数量最多的群作为所述目标群; 或者, 根据各鼠标位置记录的时间 先后为各鼠标位置赋予对应的权值, 对各个群中包括的鼠标位置进行加权计 算以获得各个群的加权值, 将加权值最大的群作为所述目标群, 其中, 为后 记录的鼠标位置赋予的权值高于为先记录的鼠标位置赋予的权值。
结合第四方面的第一种可能的实现方式 ,在第四种可能的实现方式中, 所述信息获取单元, 还用于在检测到鼠标操作时记录所述鼠标操作对应的鼠 标位置和所述鼠标操作的属性信息, 所述满足预设条件的鼠标位置包括之前 的预设长度的时间段内检测到的鼠标操作对应的鼠标位置; 所述信息获取单 元用于将满足目标条件的群作为目标群具体包括: 根据各鼠标操作的属性信 息为所述鼠标操作对应的鼠标位置赋予对应的权值, 对各个群中包括的鼠标 位置进行加权计算以获得各个群的加权值, 将加权值最大的群作为所述目标 群。
在第四方面的第五种可能的实现方式中, 所述信息获取单元, 具体用于 将所述共享区显示的图像中发生更新的图像内容所在的区域作为所述关注区 域, 获取用于描述所述图像内容所在的区域的信息作为所述关注区域的描述 信息。
在第四方面的第六种可能的实现方式中, 所述信息获取单元, 具体用于 将所述共享区显示的图像中发生更新的图像内容所在的区域作为所述关注区 域, 获取用于描述所述图像内容所在的区域的信息作为所述关注区域的描述 信息。
结合第四方面、 第四方面的第一种至第六种任一可能的实现方式 ,在第 七种可能的实现方式中, 所述信息获取单元, 还用于识别所述屏幕共享图像 中的有效图像区域的边界并获取所述有效图像区域的边界的描述信息, 并用 于将所述有效图像区域的边界的描述信息传输至所述发送单元;
所述发送单元, 还用于从所述信息获取单元接收所述有效图像区域的边 界的描述信息, 并用于将所述有效图像区域的边界的描述信息作为所述图像 辅助信息的一部分发送给所述接收设备, 以促使所述接收设备根据所述关注 区域的描述信息和所述有效图像区域的边界的描述信息确定所述待显示区 域, 确定的所述待显示区域包括所述关注区域的至少一部分, 且所述待显示 区域的至少一部分包含在所述有效图像区域中。 第五方面, 提供了一种实现屏幕共享的通信系统, 包括: 发送设备和接 收设备;
所述发送设备, 用于抓取所述发送设备的屏幕上的共享区显示的图像以 获取屏幕共享图像, 获取所述屏幕共享图像中的关注区域的描述信息, 并向 所述接收设备发送所述屏幕共享图像和图像辅助信息, 所述图像辅助信息包 括所述关注区域的描述信息, 其中所述关注区域为在屏幕共享过程中所述发 送设备的用户当前正在关注的区域;
所述接收设备, 用于接收所述发送设备发送的所述屏幕共享图像和所述 图像辅助信息, 并在确定所述接收设备的屏幕上用于显示所述屏幕共享图像 的显示区的宽度小于所述屏幕共享图像的宽度, 或所述显示区的高度小于所 述屏幕共享图像的高度时, 根据所述关注区域的描述信息和所述显示区的分 辨率确定所述屏幕共享图像中的待显示区域, 确定的所述待显示区域的分辨 率与所述显示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少 一部分, 还用于在所述显示区显示所述待显示区域中的图像内容。
在第五方面的第一种可能的实现方式中, 所述发送设备, 还用于识别所 述屏幕共享图像中的有效图像区域的边界并获取所述有效图像区域的边界的 描述信息, 并用于将所述有效图像区域的边界的描述信息作为所述图像辅助 信息的一部分发送给所述接收设备; 所述接收设备用于确定所述待显示区域 具体包括, 所述接收设备用于根据所述有效图像区域的边界的描述信息和所 述关注区域的描述信息确定所述待显示区域, 确定的所述待显示区域的分辨 率与所述显示区的分辨率相同且包括所述关注区域的至少一部分, 并且确定 的所述待显示区域的至少一部分包含在所述有效图像区域中。 根据本发明实施例, 由于该接收设备确定的待显示区域与该接收设备的 屏幕上的显示区的分辨率相同, 所以该待显示区域中的图像内容可以完整呈 现在该显示区, 又由于该待显示区域是根据在屏幕共享过程中所述发送设备 的用户当前正在关注的区域的描述信息确定的且包括该区域的至少一部分, 所以, 该接收设备可以将该发送设备的用户当前正在关注的区域中的至少一 部分图像内容显示出来, 从而可以提升屏幕共享时的沟通效率。
附图说明
为了更清楚地说明本发明实施例的技术方案, 下面将对实施例或现有技 术描述中所需要使用的附图作简单地介绍, 显而易见地, 下面描述中的附图 仅仅是本发明的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造 性劳动的前提下, 还可以根据这些附图获得其他的附图。 图 1是本发明实施例 1提供的方法流程示意图;
图 1是本发明实施例 1提供的屏幕共享图像 00的示例;
图 3是本发明实施例 1的鼠标位置分群示意图;
图 4是本发明实施例 1的权值和时间的关系示意图;
图 5是本发明实施例 1的关注区域与待显示区域的关系示意图; 图 6是本发明实施例 1 的关注区域、 有效图像区域与待显示区域的关系 示意图;
图 7是本发明实施例 1提供的通信设备 500的结构示意图;
图 8-9是本发明实施例 3提供的通信设备 600的结构示意图;
图 10是本发明实施例 4提供的通信设备 1000的结构示意图;
图 11是本发明实施例 5提供的通信设备 2000的结构示意图;
图 12是本发明实施例 6提供的通信系统 5000的结构示意图。 具体实施方式
下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案进行 清楚、 完整地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是 全部的实施例。 基于本发明中的实施例, 本领域普通技术人员在没有作出创 造性劳动前提下所获得的所有其他实施例, 都属于本发明保护的范围。
图 1是本发明实施例 1提供的方法流程示意图, 如图 1所示, 本发明实 施例 1提供的方法包括:
步骤 210:发送设备抓取所述发送设备的屏幕上的共享区显示的图像以获 取屏幕共享图像。
需要说明的是, 如果所述发送设备将整个屏幕上显示的内容共享给接收 设备, 则共享区为所述发送设备的整个屏幕, 相应地, 步骤 210 中抓取的是 整个屏幕上显示的图像; 如果所述发送设备仅将屏幕的特定区域(一般为矩 形区域)显示的内容共享给所述接收设备, 如, 将该屏幕上显示的某个应用 的界面共享给所述接收设备, 则共享区为上述的屏幕的特定区域, 相应地, 步骤 210中抓取的是该特定区域显示的图像。
步骤 220: 所述发送设备获取所述屏幕共享图像中的关注区域的描述信 息。
所述关注区域为在屏幕共享过程中所述发送设备的用户当前正在关注的 区域, 具体可以是所述发送设备检测到的频繁执行鼠标操作的位置所在的区 域或鼠标停留时间最长的位置所在的区域, 也可以是所述发送设备检测到的 当前正在执行输入操作的位置所在的区域, 还可以是所述发送设备的屏幕上 当前正频繁发生内容更新的位置所在的区域。
所述关注区域的描述信息具体可以包括所述关注区域的边界的描述信息 或所述关注区域的中心点的坐标。
以图 2为例, 屏幕共享图像 00包括关注区域 01 , 关注区域 01为一矩形 区域, 该矩形区域的的边界为图 2所示的矩形虚线框, 关注区域 01的中心点 为黑点 02所在位置。
假定以屏幕共享图像 00的左上角为坐标原点, 横坐标轴横向朝右, 纵坐 标轴 ¾向朝下, 关注区域 01的其中一边和横坐标轴平行。
关注区域 01的描述信息具体可以是关注区域 01的四个顶点的坐标, 如 图 2所示, 关注区域 01的四个顶点的坐标分别为( 10, 5 ), ( 20, 5 ), ( 10, 10 ) 和( 20, 10 )。 关注区域 01的描述信息具体还可以是关注区域 01的的纵坐标 MaxHe ight , 的纵坐标 MinHe ight、 最左点的横坐标 MinWidth和最右点的横坐 标 MaxWidth,如图 2所示,为 "5( MaxHe ight ), 10( MinHe i ght ), 10( MinWidth ), 20 ( MaxWidth )"。
关注区域 02的描述信息还可以是黑点 02所在位置的坐标, 如图 2所示, 为 (15 , 7. 5 )。
下面分别介绍步骤 220的三种实施方式:
实施方式 1 :所述发送设备利用聚类算法对记录的满足预设条件的鼠标位 置进行分群, 将满足目标条件的群作为目标群, 将所述目标群中的鼠标位置 的外接矩形所围成的区域作为所述关注区域, 获取用于描述所述外接矩形的 信息 (如所述外接矩形的中心点的坐标、 所述外接矩形的边界的描述信息) 作为所述关注区域的描述信息。
下面结合图 3详细介绍实施方式 1的示例实施方式 。
根据示例实施方式 A , 在步骤 220之前还包括, 所述发送设备按照预设时 间间隔记录当前的鼠标位置, 如, 以 0. 2秒一次的频率 (即 5次 /秒)记录当 前的鼠标位置。 图 3所示的箭头为以 5次 /秒的频率记录的最近 1 5个鼠标位 置 (即最近 3秒内记录的鼠标位置)。
相应地, 在步骤 220 中, 利用聚类算法对在执行所述分群操作的时间之 前的预设长度的时间段内 (如最近 3 秒内)记录的鼠标位置进行分群, 如, 分成如图 3所示的鼠标位置群 1、 鼠标位置群 2和鼠标位置群 3。
然后, 可以将包括的鼠标位置数量最多的群作为所述目标群, 如图 3 所 示, 鼠标位置群 1包括的鼠标位置数量最多, 将鼠标位置群 1作为目标群。
也可以根据各鼠标位置记录的时间先后为各鼠标位置赋予对应的权值 (为后记录的鼠标位置赋予的权值高于为先记录的鼠标位置赋予的权值 ), 对 各个群中包括的鼠标位置进行加权计算以获得各个群的加权值, 将加权值最 大的群作为所述目标群。 如图 3所示, 尽管鼠标位置群 2 中的鼠标位置比鼠 标位置群 1 中的鼠标位置少, 不过, 如果鼠标位置群 2 中的鼠标位置都是最 近 1秒中记录的, 赋予较大权值, 而鼠标位置群 1 中的鼠标位置都是最先记 录的, 赋予较小权值, 则有可能鼠标位置群 2的加权值比鼠标位置群 1 的加 权值大, 进而将鼠标位置群 2作为目标群。
确定目标群后, 将目标群(如图 3的鼠标位置群 1 )中的鼠标位置的外接 矩形所围成的区域作为所述关注区域, 获取用于描述所述外接矩形的信息作 为所述关注区域的描述信息。
下面详细介绍实施方式 1的示例实施方式8。 根据示例实施方式 B, 在步骤 220之前还包括, 在检测到鼠标操作时, 记 录所述鼠标操作对应的鼠标位置和所述鼠标操作的属性信息, 所述鼠标操作 的属性信息具体可以包括所述鼠标操作的类型 (如, 左键单击、 右键单击、 双击、 移动等)和 /或所述鼠标操作发生的时间。
所述满足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的 预设长度的时间段内检测到的鼠标操作对应的鼠标位置。
相应地, 在步骤 220 中, 根据各鼠标操作的属性信息为所述鼠标操作对 应的鼠标位置赋予对应的权值。
如下表所示, 属性信息为鼠标操作的类型时, 根据鼠标操作的类型的不 同对该鼠标操作赋予不同的权值。
Figure imgf000026_0001
又如图 4所示, 属性信息为鼠标操作发生的时间时, 根据鼠标操作发生 的时间距离当前时间的远近对该鼠标操作赋予不同的权值, 所述鼠标操作发 生的时间与当前时间的差值越大, 所述鼠标操作对应的鼠标位置的权值越小, 所述鼠标操作发生的时间与当前时间的差值越小, 所述鼠标操作对应的鼠标 位置的权值越大。 对各个群中包括的鼠标位置进行加权计算以获得各个群的 加权值, 将加权值最大的群作为所述目标群。
实施方式 2 : 所述发送设备在检测到键盘输入操作时, 确定当前的输入光 标位置, 将所述屏幕共享图像中以所述光标位置为中心的输入区域(如以所 述光标位置为中心的一个矩形区域)作为所述关注区域, 获取用于描述所述 输入区域的信息 (如, 所述光标位置的坐标, 或所述输入区域的边界的描述 信息)作为所述关注区域的描述信息。
需要说明的是, 所述发送设备可以先将所述屏幕共享图像中以所述光标 位置为中心的输入区域确定为所述关注区域, 并将所述输入区域的边界的描 述信息作为所述关注区域的描述信息; 也可以直接将所述光标位置的坐标发 送给所述接收设备, 以表明所述光标位置为中心的区域为所述关注区域(即 所述发送设备的用户关注的区域), 而无需显式确定所述关注区域。
实施方式 3: 所述发送设备将所述共享区显示的图像中发生更新的图像内 容所在的区域作为所述关注区域, 获取用于描述所述图像内容所在的区域的 信息作为所述关注区域的描述信息。 如, 当前发送设备的屏幕上的共享区正 在播放视频, 则所述共享区中仅播放区域的内容会发生变化, 该共享区中用 于显示播放器菜单的区域的内容是没有发生变化的, 则可以将该播放区域确 定为所述关注区域。
步骤 230:所述发送设备向所述接收设备发送所述屏幕共享图像和图像辅 助信息, 所述图像辅助信息包括所述关注区域的描述信息。
在具体实现时, 所述发送设备将屏幕共享图像的内容和关注区域的描述 信息一起封装到屏幕共享的数据帧中, 并将该数据帧发送给所述接收设备。 其中, 所述关注区域的描述信息可以封装在该数据帧的帧头中, 也可以封装 在该数据帧的帧数据中, 如, 封装在帧数据中的屏幕共享图像的前面, 如下 表所示。
Figure imgf000027_0001
步骤 240:所述接收设备根据所述描述信息在所述屏幕共享图像中确定包 括所述关注区域的至少一部分的待显示区域。
具体地, 所述接收设备在确定所述接收设备的屏幕上用于显示所述屏幕 共享图像的显示区的宽度小于所述屏幕共享图像的宽度, 或所述显示区的高 度小于所述屏幕共享图像的高度时, 根据所述关注区域的描述信息和所述显 示区的分辨率确定所述待显示区域, 确定的所述待显示区域的分辨率与所述 显示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少一部分。 所述屏幕共享图像的分辨率可以表示为 picWidth*picHe ight , 其中, picWidth为所述屏幕共享图像的宽度, pi cHe ight 为所述屏幕共享图像的高 度。
假设所述待显示区域是在所述屏幕共享图像中确定的宽度为 rcWidth (rcWidth<=picWidth) , 长度为 rcHe ight (rcHe i ght<= picHe ight)的 矩形区域, 则所述待显示区域的分辨率为 rcWidth*rcHe ight。
所述显示区的分辨率可以表示为 viewWidth * v iewHe ight , 其中, viewWidth为所述显示区的宽度, v iewHe ight为所述显示区的高度。
假设所述屏幕的分辨率为 ScrWidth*ScrHe ight , 即所述屏幕的宽度为 ScrWidth, 高度为 ScrHe ight。 如果所述接收设备的整个屏幕都用来显示所述 屏幕共享图像, 即所述接收设备以全屏模式显示所述屏幕共享图像, 则所述 显示区为所述接收设备的屏幕的全部区域, 相应地, 所述显示区的分辨率即 为所述屏幕的分辨率, 即 ScrWidth*ScrHe ight ; 如果所述接收设备的屏幕的 一部分用来显示所述屏幕共享图像, 则所述显示区为所述接收设备的屏幕的 一部分, 如, 所述屏幕的宽度为所述显示区的宽度的 M倍, 所述屏幕的高度 为所述显示区的高度的 N 倍, 则所述显示区的分辨率为(ScrWidth/M) * (ScrHe ight/N)。
所述关注区域的描述信息具体可以包括所述关注区域的中心点的坐标, 相应地, 在步骤 240 中, 可以根据所述关注区域的中心点的坐标在所述屏幕 共享图像中确定包括所述中心点且分辨率与所述显示区的分辨率相同的区域 作为所述待显示区域。 后续通过实施方式 1详细介绍一种具体实现方式。
所述关注区域的描述信息具体可以包括所述关注区域的边界的描述信 息, 以所述关注区域为其中一边和所述屏幕共享图像的其中一边平行的矩形 区域为例, 在步骤 240 中, 可以在所述显示区的宽度大于所述关注区域的宽 度且所述显示区的高度大于所述关注区域的高度时, 根据所述关注区域的边 界的描述信息在所述屏幕共享图像中确定包括所述关注区域且分辨率与所述 显示区的分辨率相同的区域作为所述待显示区域, 即所述待显示区域包括所 述关注区域的全部, 如图 5的 al所示; 还可以在所述显示区的宽度小于所述 关注区域的宽度和 /或所述显示区的高度小于所述关注区域的高度时, 根据所 述关注区域的边界的描述信息在所述屏幕共享图像中确定包括所述关注区域 的中心点且分辨率与所述显示区的分辨率相同的区域作为所述待显示区域, 即所述待显示区域包括所述关注区域的一部分, 如图 5的 a2所示。 后续通过 实施方式 2详细介绍一种具体实现方式。
下面分别介绍步骤 240的实施方式 1和实施方式 2 ,在这两种实施方式中, 假定以所述屏幕共享图像的左上角为坐标原点, 横坐标轴横向朝右, 纵坐标 轴纵向朝下, 所述屏幕共享图像的分辨率为 picWidth*pi cHe ight , 所述显示 区的分辨率为 viewWidth * v iewHe i ght。
实施方式 1 : 在实施方式 1中, 所述关注区域的描述信息具体包括所述关 注区域的中心点的坐标 (centerX, centerY) 。
在步骤 240中, 可以按照如下方式计算所述待显示区域的最左点的横坐 标 rcLef t、 最高点的纵坐标 rcTop、 最右点的横坐标 rcRight和最氏点的纵 坐标 rcBot tom:
当 PicWidth >= viewWidth时, rcLef t和 rcRight按照如下方法计算: 如果 centerX_viewWidth/2 <= 0, rcLef t = 0 , rcRi ght
=viewWidth;
如果 centerX+viewWidth/2 > PicWidth, rcLef t =
PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = centerX-viewWidth/2 , rcRi ght =
centerX+viewWidth/ 2;
当 PicWidth < viewWidth时, rcLef t和 rcRi ght按照如下方法计算: rcLef t = 0 , rcRight = viewWidth; 当 PicHeight >= viewHeight时, rcTo 和 rcBottom按照如下方法计算: 如果 centerY_viewHeight/2 <= 0, rcTop = 0, rcBottom = viewHeight; 如果 (centerY+viewHeight/2 > PicHeight) , rcTop =
PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = centerY-viewHeight/2, rcBottom =
centerY+viewHeight/2;
当 PicHeight < viewHeight时, rcTop和 rcBottom按照如下方法计 算: rcTop = 0, rcBottom = viewHeight。
实施方式 2: 在实施方式 2中, 所述关注区域的描述信息具体包括所述关 注区域的边界的描述信息。 所述关注区域为其中一边和所述屏幕共享图像的 其中一边平行的矩形区域, 所述关注区域的边界的描述信息具体包括所述关 注区域的最左点的横坐标 atLeft、 最高点的纵坐标 atTop、 最右点的横坐标 atRight和最^ ί氐点的 έ从坐标 atBottom0
在步骤 240中, 可以按照如下方式计算所述待显示区域的最左点的横坐 标 rcLeft、 最高点的纵坐标 rcTop、 最右点的横坐标 rcRight和最氏点的纵 坐标 rcBottom:
当 PicWidth >= viewWidth时, rcLeft和 rcRight按照如下方法计算: 如果 atl f t+atRight_viewWidth <= 0, rcLef t = 0, rcRight =viewWidth;
如果 ( atLef t+atRight+viewWidth ) /2 > PicWidth, rcLeft = PicWidth- viewWidth, rcRight = PicWidth;
否则, rcLeft = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
当 PicWidth < viewWidth时, rcLeft和 rcRight按照 ¾口下方法计 算: rcLeft = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, rcTo 和 rcBottom按照如下方法计算: 如果 atTop+atBoUom-viewHeight <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (atTop+atBot tom+viewHeight ) / 2 > PicHeight, rcTop = PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = ( atTo +atBot torn- viewHeight ) /2, rcBottom = ( atTop+atBottom+viewHeight ) /2;
当 PicHeight < viewHeight时, rcTop和 rcBottom按照如下方法计 算: rcTop = 0, rcBottom = viewHeight。
根据步骤 240的实施方式 1和实施方式 2,所述接收设备可以优先将所述 关注区域的中心点附近的区域包含在所述待显示区域中。
在步骤 240 中, 所述接收设备还需要获取所述屏幕共享图像的分辨率, 具体可以通过如下三种方式中的一种获取:
方法 1:所述接收设备从所述屏幕共享图像中获取所述屏幕共享图像的分 辨率。
方法 2:所述发送设备将所述屏幕共享图像的分辨率作为所述图像辅助信 息的一部分发送给所述接收设备, 相应地, 所述接收设备从所述图像辅助信 息中获取所述屏幕共享图像的分辨率。
方法 3: 所述发送设备在开始屏幕共享时, 将所述发送设备的屏幕上的共 享区的分辨率发送给所述接收设备, 所述接收设备将所述共享区的分辨率作 为后续接收自所述发送设备的屏幕共享图像的分辨率。 需要说明的是, 如果 发送设备将整个屏幕上显示的内容共享给接收设备, 即, 所述共享区为整个 屏幕, 所述共享区的分辨率即为所述发送设备的屏幕的分辨率。
步骤 250: 所述接收设备显示所述待显示区域中的图像。
具体地, 所述接收设备在所述显示区显示所述待显示区域中的图像内容。 需要说明的是, 如果当前屏幕共享图像的关注区域相比于之前的屏幕共 享图像的关注区域发生了变化, 相应地, 在接收到当前屏幕共享图像时确定 的待显示区域和接收到之前的屏幕共享图像时确定的待显示区域不同, 则在 先后多次接收到屏幕共享图像并执行步骤 240-250 时, 会取得自动滚屏的效 果。
在步骤 250中,所述接收设备可以在确定在之前的预设长度的时间段(如 最近 5ms 内、 最近 3秒内 ) 内没有检测到用于指示滚屏的操作时执行所述确 定所述待显示区域的操作。
在具体实现时, 接收设备的用户可能想看当前屏幕上显示的图像内容之 外的内容, 则可以通过鼠标或键盘操作进行手动滚屏, 如拖动滚动条。 所述 接收设备在检测到用户执行手动滚屏操作时, 记录下该手动滚屏操作的信息, 如执行时间、 滚动方向、 滚动距离等, 当接收到屏幕共享图像时, 判断之前 的预设长度的时间段内 (如最近 5ms 内、 最近 3秒内)用户是否执行了手动 滚屏操作。 如果判断结果为否, 则可以根据所述关注区域的描述信息确定所 述待显示区域。 如果判断结果为是, 则可以不根据当前接收的关注区域的描 述信息确定待显示区域, 而是根据记录的手动滚屏操作的信息确定所述接收 设备的用户当前关注的区域, 如, 所述接收设备的用户在所述时间段内执行 了向上滚屏的操作, 滚动距离为 10, 则可以认为所述关注区域上方与所述关 注区域距离为 10的目标区域为所述接收设备的用户关注的区域, 相应地, 可 以将该目标区域确定为所述接收设备的用户关注的区域, 并根据所述接收设 备的用户当前关注的区域和所述显示区的分辨率确定所述屏幕共享图像中的 待显示区域并显示所述待显示区域中的图像内容。 其中, 根据所述接收设备 的用户当前关注的区域和所述显示区的分辨率确定待显示区域的方法, 与根 据所述关注区域和所述显示区的分辨率确定待显示区域的方法类似, 不再赘 述。 步骤 230中的图像辅助信息还可以包括所述屏幕共享图像中的有效图像 区域的边界的描述信息。 如图 6所示, 屏幕共享图像 10的上下两侧都存在灰色区域, 灰色区域并 不包括图像内容, 非灰色区域才是包括图像内容的有效图像区域 11 , 所述发 送设备利用边界识别算法识别出所述屏幕共享图像中的有效图像区域的边 界, 并将所述有效图像区域的边界的描述信息作为所述图像辅助信息的一部 分发送给所述接收设备。
相应地, 在步骤 240中, 所述接收设备根据所述关注区域的描述信息、 所述显示区的分辨率、 以及所述有效图像区域的边界的描述信息确定所述待 显示区域, 确定的所述待显示区域的分辨率与所述显示区的分辨率相同且包 括所述关注区域的至少一部分, 并且确定的所述待显示区域的至少一部分包 含在所述有效图像区域中。
在步骤 240中, 所述接收设备可以优先在所述有效图像区域中确定所述 待显示区域, 以所述有效图像区域为其中一边和所述屏幕共享图像的其中一 边平行的矩形区域为例, 在所述有效图像区域的宽度大于所述接收设备的屏 幕上的所述显示区的宽度且所述有效图像区域的高度大于所述显示区的高度 时, 可以在所述有效图像区域中确定所述待显示区域, 即确定的待显示区域 的全部都包含在所述有效图像区域中, 如图 6中的待显示区域 bl所示; 如果 所述显示区的高度大于所述有效图像区域的高度, 和 /或所述显示区的宽度大 于所述有效图像区域的宽度, 则确定的待显示区域的一部分包含在所述有效 图像区域中, 如图 6中的待显示区域 b2所示。
下面分别介绍在步骤 240中根据所述关注区域的描述信息和所述有效图 像区域的边界的描述信息确定所述待显示区域的两种实施方式(实施方式 3 和实施方式 4 ), 在这两种实施方式中, 仍然假定以所述屏幕共享图像的左上 角为坐标原点, 横坐标轴横向朝右, 纵坐标轴纵向朝下, 所述屏幕共享图像 的分辨率为 pi cWidth*picHe ight , 所述显示区的分辨率为 viewWidth * V i ewHe i gh t ; 当所述有效图像区域为其中一边和所述横坐标轴平行的矩形区 域, 所述有效图像区域的边界的描述信息为 (BorderLef t, BorderTop, BorderRight, BorderBot tom ), 其中, BorderLef t为所述有效图像区域上的 最左点的横坐标, BorderTop为所述有效图像区域上的最高点的纵坐标, BorderRight为所述有效图像区域上的最右点的横坐标, BorderBot tom为所 述有效图像区域上的最低点的纵坐标。
实施方式 3: 在实施方式 3中, 所述关注区域的描述信息具体包括所述关 注区域的中心点的坐标 (centerX, centerY) 。
相应地, 在步骤 240中, 可以按照如下方式计算所述待显示区域的最左 点的横坐标 rcLef t、 最高点的纵坐标 rcTop、 最右点的横坐标 rcRight和最 氐点的从坐标 rcBot tom:
^ BorderRight-BorderLef t >= viewWidth时, rcLef t和 rcRight按照 口下方法计算:
如果 (centerX_viewWidth/2 <= BorderLef t) , rcLef t = BorderLef t , rcRight = BorderLef t+viewWidth;
如果(centerX+viewWidth/2 > BorderRight)时, rcLef t = BorderRight-viewWidth, rcRight = BorderRight;
否则, rcLef t = centerX-viewWidth/2 , rcRi ght =
centerX+viewWidth/ 2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth > viewWidth 时, 按照 ¾。下方法计算 rcLef t和 rcRight:
如果((BorderLef t+BorderRight) /2 <= viewWidth/2) , rcLef t = 0, rcRight = viewWidth;
如果((BorderLef t+BorderRight+viewWidth) /2 > p icWidth) , rcLef t = icWidth-viewWidth, rcRight = picWidth;
否则, rcLef t = (BorderRight+BorderLef t-v iewWidth) /2 , rcRi ght = (BorderRight+BorderLef t+viewWidth) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth < viewWidth 时, 按照如下方法计算 rcLeft和 rcRight: rcLef t= 0, rcRight= viewWidth; 当 BorderBot tom-BorderTop >= viewHeight时, rcTo 和 rcBottom按照 口下方法计算:
如果 (centerY_viewHeight/2 <= BorderTop) , rcTop =
BorderTop, rcBottom = BorderTop+viewHeight;
如果 (centerY+viewHeight/2 > BorderBot torn) , rcTop = BorderBot tom-viewHeight , rcBottom = BorderBot torn;
否则, rcTop = centerY-viewHeight/2, rcBottom =
centerY+viewHeight/2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight > viewHeight 时, 按照如下方法计算 rcTo 和 rcBottom:
如果 ( (BorderTop+BorderBottom) /2 <= viewHeight/2) , rcTop = 0, rcBottom = viewHeight;
如果 ( (BorderTop+BorderBot tom+viewHeight) /2 > picHeight) , rcTop = picHeight-viewHeight, rcBottom = icHeight; 否则, rcTop = (BorderBot tom+BorderTop-viewHeight) / 2, rcBottom = (BorderBot tom+BorderTop+viewHeight) / 2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight < viewHeight 时,按照如下方法计算 rcTo 和 rcBottom: rcTop = 0, rcBottom = viewHeight。
实施方式 4: 在实施方式 4中, 所述关注区域为其中一边和所述横坐标轴 平行的矩形区域, 其中, 所述关注区域的描述信息具体包括所述关注区域的 最左点的横坐标 atLeft、 最高点的纵坐标 atTop、 最右点的横坐标 atRight 和最低点的纵坐标 atBottom。
相应地, 在步骤 240中, 可以按照如下方式计算所述待显示区域的最左 点的横坐标 rcLeft、 最高点的纵坐标 rcTop、 最右点的横坐标 rcRight和最 氐点的从坐标 rcBottom: ^ BorderRight-BorderLef t >= viewWidth时, rcLef t和 rcRight按照 口下方法计算:
如果 ( atLef t+atRight-viewWidth ) /2 <= BorderLeft, rcLef t = BorderLeft, rcRight = BorderLef t+viewWidth;
如果 ( atLef t+atRight+viewWidth ) /2 > BorderRight时, rcLef t = BorderRight - viewWidth, rcRight = BorderRight;
否则, rcLef t = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth > viewWidth 时, 按照 ¾。下方法计算 rcLeft和 rcRight:
如果((BorderLef t+BorderRight)/2 <= viewWidth/2) , rcLeft = 0, rcRight = viewWidth;
如果((BorderLef t+BorderRight+viewWidth)/2 > picWidth) , rcLeft = icWidth-viewWidth, rcRight = picWidth;
否则, rcLeft = (BorderRight+BorderLef t-viewWidth) /2, rcRight = (BorderRight+BorderLef t+viewWidth) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth < viewWidth 时, 按照如下方法计算 rcLeft和 rcRight: rcLeft: 0, rcRight= viewWidth; 当 BorderBot tom-BorderTop >= viewHeight时, rcTo 和 rcBottom按照 口下方法计算:
如果 ( atTop+atBottom-viewHeight ) /2<= BorderTop, rcTop = BorderTop, rcBottom = BorderTop+viewHeight;
如果 ( atTop+atBottom+viewHeight ) / 2 > BorderBot torn, rcTop = BorderBot tom-viewHeight , rcBottom = BorderBot torn;
否则, rcTop = ( a t To +at Bottom- viewHeight ) /2, rcBottom = ( atTop+atBottom+viewHeight ) / 2; 当 BorderBot tom-BorderTop < viewHeight并且 PicHeight > viewHeight 时, 按照如下方法计算 rcTo 和 rcBottom:
如果 ( (BorderTop+BorderBottom) /2 <= viewHeight/2) , rcTop = 0, rcBottom = viewHeight;
如果 ( (BorderTop+BorderBot tom+viewHeight) /2 > picHeight) , rcTop = icHeight-viewHeight , rcBottom = picHeight;
否则, rcTop = (BorderBot tom+BorderTop-viewHeight) / 2, rcBottom = (BorderBot tom+BorderTop+viewHeight) / 2;
当 BorderBot tom-BorderTop < viewHeight并且 PicHeight < viewHeight 时,按照如下方法计算 rcTo 和 rcBottom: rcTop = 0, rcBottom = viewHeight。
根据步骤 240的实施方式 3和实施方式 4,所述接收设备可以优先将所述 有效显示区域中的区域包含在所述待显示区域中。 在步骤 250之前, 所述接收设备还可以执行如下操作:
S1: 获取第一坐标, 所述第一坐标为所述显示区中当前显示的图像内容 的中心点在所述当前显示的图像内容对应的屏幕共享图像(后续称为第一屏 幕共享图像) 中的坐标。
所述第一坐标具体可以是所述接收设备在接收到所述第一屏幕共享图像 时计算得出并记录下来的。
S2: 确定第二坐标, 所述第二坐标为所述待显示区域的中心点在步骤 230 中接收的屏幕共享图像(后续称为第二屏幕共享图像) 中的坐标。
为便于描述, 后续将所述当前显示的图像内容在所述第一屏幕共享图像 中对应的区域称为第一待显示区域; 将步骤 240中确定的待显示区域称为第 二待显示区 i或。
S3: 计算所述第一坐标和所述第二坐标之间的差值;
相应地, 步骤 250具体包括: 在确定所述差值超过设定阔值时, 在所述 显示区显示所述待显示区域中的图像内容。
在具体实现时, 所述接收设备判断所述差值是否超过所述设定阔值, 并 在判断出超过所述设定阔值时在所述显示区显示所述待显示区域中的图像内 容, 还可以在判断出没超过所述设定阔值时, 将所述第二屏幕共享图像中对 应于所述第一待显示区域的图像内容显示在所述显示区。
根据本发明实施例 1 ,所述发送设备不仅将所述屏幕共享图像发送给接收 设备, 还将所述屏幕共享图像中的关注区域的描述信息发送给所述接收设备, 相应地, 所述接收设备根据所述关注区域的描述信息确定包括所述关注区域 的至少一部分的待显示区域并在所述显示区显示所述待显示区域中的图像内 容, 因此, 所述发送设备指定的关注区域中的至少一部分图像内容可以显示 在所述接收设备的屏幕上 , 从而可以提升屏幕共享时的沟通效率。 根据本发明实施例 1 ,本发明实施例 2提出了一种实现屏幕共享的通信设 备 500 , 如图 7所示, 通信设备 500包括: 图像抓取单元 501、 信息获取单元 502和发送单元 503。
图像抓取单元 501 ,用于抓取通信设备 500的屏幕上的共享区显示的图像 以获取屏幕共享图像, 并用于将所述屏幕共享图像传输至发送单元 503。
信息获取单元 502 , 用于获取所述屏幕共享图像中的关注区域的描述信 息, 并用于将所述关注区域的描述信息传输至发送单元 503。
所述屏幕共享图像中的关注区域为在屏幕共享过程中所述发送设备的用 户当前正在关注的区域。
所述关注区域的描述信息具体包括所述关注区域的边界的描述信息或所 述关注区域的中心点的坐标。
发送单元 503 , 用于从图像抓取单元 501接收所述屏幕共享图像,从信息 获取单元 502接收所述关注区域的描述信息, 并用于向接收设备发送所述屏 幕共享图像和图像辅助信息, 所述图像辅助信息包括所述关注区域的描述信 息, 以促使所述接收设备根据所述描述信息在所述屏幕共享图像中确定包括 所述关注区域的至少一部分的待显示区域并显示所述待显示区域中的图像内 容。
下面分别介绍信息获取单元 502的三种实施方式:
实施方式 1 : 信息获取单元 502具体用于, 利用聚类算法对记录的满足预 设条件的鼠标位置进行分群, 将满足目标条件的群作为目标群, 将所述目标 群中的鼠标位置的外接矩形所围成的区域作为所述关注区域, 获取用于描述 所述外接矩形的信息作为所述关注区域的描述信息, 并用于将所述关注区域 的描述信息传输至发送单元 503。
在实施方式 1的一种示例实施方式中, 信息获取单元 502 , 还用于按照预 设时间间隔记录当前的鼠标位置, 所述满足预设条件的鼠标位置包括, 在执 行所述分群操作的时间之前的预设长度的时间段内记录的鼠标位置。
相应地, 信息获取单元 502 用于将满足目标条件的群作为目标群具体包 括, 信息获取单元 502 用于: 将包括的鼠标位置数量最多的群作为所述目标 群; 或者, 根据各鼠标位置记录的时间先后为各鼠标位置赋予对应的权值, 对各个群中包括的鼠标位置进行加权计算以获得各个群的加权值, 将加权值 最大的群作为所述目标群, 其中, 为后记录的鼠标位置赋予的权值高于为先 记录的鼠标位置赋予的权值。
在实施方式 1的另一种示例实施方式中,信息获取单元 502 ,还用于在检 测到鼠标操作时记录所述鼠标操作对应的鼠标位置和所述鼠标操作的属性信 息, 所述满足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的 预设长度的时间段内检测到的鼠标操作对应的鼠标位置;
信息获取单元 502 用于将满足目标条件的群作为目标群具体包括, 信息 获取单元 502 用于: 根据各鼠标操作的属性信息为所述鼠标操作对应的鼠标 位置赋予对应的权值, 对各个群中包括的鼠标位置进行加权计算以获得各个 群的加权值, 将加权值最大的群作为所述目标群。 实施方式 2: 信息获取单元 502具体用于, 在检测到键盘输入操作时, 确 定当前的输入光标位置, 将所述屏幕共享图像中以所述光标位置为中心的输 入区域作为所述关注区域, 获取用于描述所述输入区域的信息作为所述关注 区域的描述信息, 并将所述关注区域的描述信息传输至发送单元 503。
实施方式 3: 信息获取单元 502具体用于, 将所述共享区显示的图像中发 生更新的图像内容所在的区域作为所述关注区域, 获取用于描述所述图像内 容所在的区域的信息作为所述关注区域的描述信息, 并将所述关注区域的描 述信息传输至发送单元 503。
信息获取单元 502 ,还可以用于识别所述屏幕共享图像中的有效图像区域 的边界并获取所述有效图像区域的边界的描述信息, 并用于将所述有效图像 区域的边界的描述信息传输至发送单元 503。
相应地, 发送单元 503还用于从信息获取单元 502接收所述有效图像区 域的边界的描述信息, 并用于将所述有效图像区域的边界的描述信息作为所 述图像辅助信息的一部分发送给所述接收设备, 以促使所述接收设备根据所 述关注区域的描述信息和所述有效图像区域的边界的描述信息确定所述待显 示区域, 确定的所述待显示区域包括所述关注区域的至少一部分, 且所述待 显示区域的至少一部分包含在所述有效图像区域中。
本发明实施例 2 中描述的功能单元可以用来实施上述实施例 1所述的方 法中所述发送设备执行的操作。
根据本发明实施例 2 ,通信设备 500不仅将所述屏幕共享图像发送给接收 设备, 还将在屏幕共享过程中通信设备 500 的用户当前正在关注的区域的描 述信息发送给所述接收设备, 以促使所述接收设备根据所述描述信息确定包 括所述区域的至少一部分的待显示区域并将所述待显示区域中的图像内容显 示在所述接收设备的屏幕上, 因此, 通信设备 500 的用户当前正在关注的区 域中的至少一部分图像内容可以显示在所述接收设备的屏幕上, 从而可以提 升屏幕共享时的沟通效率。 根据本发明实施例 1 ,本发明实施例 3提出了一种实现屏幕共享的通信设 备 600 , 如图 8所示, 通信设备 600包括: 接收单元 601、 确定单元 602和显 示单元 603。
接收单元 601 ,用于接收正在进行屏幕共享的发送设备发送的屏幕共享图 像和图像辅助信息, 所述图像辅助信息包括所述屏幕共享图像中的关注区域 的描述信息, 其中所述屏幕共享图像中的关注区域为在屏幕共享过程中所述 发送设备的用户当前正在关注的区域, 所述屏幕共享图像是所述发送设备的 屏幕上的共享区显示的图像, 并用于将所述图像辅助信息传输至确定单元 602 , 将所述屏幕共享图像传输至显示单元 603。
所述关注区域的描述信息具体包括所述关注区域的边界的描述信息或所 述关注区域的中心点的坐标。
确定单元 602 , 用于从接收单元 601接收所述图像辅助信息,还用于在确 定通信设备 600的屏幕上用于显示所述屏幕共享图像的显示区的宽度小于所 述屏幕共享图像的宽度, 或所述显示区的高度小于所述屏幕共享图像的高度 时, 根据所述关注区域的描述信息和所述显示区的分辨率确定所述屏幕共享 图像中的待显示区域, 确定的所述待显示区域的分辨率与所述显示区的分辨 率相同, 且所述待显示区域包括所述关注区域的至少一部分, 并将用于描述 所述待显示区域的信息发送给显示单元 603。
在一种具体实现方式中, 确定单元 602可以在确定在之前的预设长度的 时间段内没有检测到用于指示滚屏的操作时执行所述确定所述待显示区域的 操作。
可选地, 确定单元 602 , 还可以用于判断所述时间段内是否检测到用于指 示滚屏的操作, 并在根据判断结果确定所述时间段内没有检测到用于指示滚 屏的操作时, 执行所述根据所述关注区域的描述信息和所述显示区的分辨率 确定所述待显示区域并将用于描述所述待显示区域的信息发送给所述显示单 元的操作; 还用于在根据所述判断结果确定所述时间段内检测到用于指示滚 屏的操作时, 根据检测到的所述用于指示滚屏的操作的信息确定所述接收设 备的用户当前关注的区域, 根据所述接收设备的用户当前关注的区域和所述 显示区的分辨率确定所述屏幕共享图像中的待显示区域, 并将用于描述所述 待显示区域的信息发送给所述显示单元。
显示单元 603 , 用于从接收单元 601接收所述屏幕共享图像,从确定单元 602接收用于描述所述待显示区域的信息,并用于根据所述用于描述所述待显 示区域的信息将所述屏幕共享图像的在所述待显示区域中的图像内容显示在 所述显示区。
在一种实施方式中: 所述关注区域的描述信息具体包括所述关注区域的 中心点的坐标; 所述确定单元, 具体可以用于根据所述关注区域的中心点的 坐标在所述屏幕共享图像中确定包括所述中心点且分辨率与所述显示区的分 辨率相同的区域作为所述待显示区域。 具体地, 确定单元 602可以用来实施 上述实施例 1的步骤 240的实施方式 1提供的方法以确定所述待显示区域。
在另一种实施方式中: 所述关注区域的描述信息具体包括所述关注区域 的边界的描述信息, 所述关注区域为其中一边和所述屏幕共享图像的其中一 边平行的矩形区域; 所述确定单元具体可以用于, 在所述显示区的宽度大于 所述关注区域的宽度且所述显示区的高度大于所述关注区域的高度时, 根据 所述关注区域的边界的描述信息在所述屏幕共享图像中确定包括所述关注区 域且分辨率与所述显示区的分辨率相同的区域作为所述待显示区域, 在所述 显示区的宽度小于所述关注区域的宽度和 /或所述显示区的高度小于所述关 注区域的高度时, 根据所述关注区域的边界的描述信息在所述屏幕共享图像 中确定包括所述关注区域的中心点且分辨率与所述显示区的分辨率相同的区 域作为所述待显示区域。 具体地, 确定单元 602可以用来实施上述实施例 1 的步骤 240的实施方式 2提供的方法以确定所述待显示区域。
接收单元 601接收的所述图像辅助信息还可以包括所述屏幕共享图像中 的有效图像区域的描述信息, 相应地, 确定单元 602 , 具体用于根据所述有效 图像区域的边界的描述信息和所述关注区域的描述信息确定所述待显示区 域, 确定的所述待显示区域的分辨率与所述显示区的分辨率相同且包括所述 关注区域的至少一部分, 并且确定的所述待显示区域的至少一部分包含在所 述有效图像区域中。
其中, 确定单元 602具体可以用来实施上述实施例 1的步骤 240的实施 方式 3和实施方式 4提供的方法以确定所述待显示区域。
本发明实施例 3中描述的功能单元可以用来实施上述实施例 1所述的方 法中所述接收设备执行的操作。 如图 9所示, 通信设备 600还可以包括差值计算单元 604。
相应地, 确定单元 602 , 还用于将用于描述所述待显示区域的信息传输至 差值计算单元 604;
差值计算单元 604 ,用于从确定单元 602接收用于描述所述待显示区域的 信息, 并用于获取第一坐标、 根据用于描述所述待显示区域的信息确定第二 坐标、 并计算所述第一坐标和所述第二坐标之间的差值, 其中, 所述第一坐 标为所述显示区中当前显示的图像内容的中心点在所述当前显示的图像内容 对应的屏幕共享图像中的坐标, 所述第二坐标为所述待显示区域的中心点在 接收单元 601接收的所述屏幕共享图像中的坐标, 还用于将所述差值传输至 显示单元 603;
显示单元 603 , 具体用于在确定所述差值超过设定阔值时, 在所述显示区 显示所述待显示区域中的图像内容。
根据本发明实施例 3 ,由于通信设备 600确定的待显示区域与该接收设备 的屏幕上的显示区的分辨率相同, 所以该待显示区域中的图像内容可以完整 呈现在该显示区, 又由于该待显示区域是根据在屏幕共享过程中所述发送设 备的用户当前正在关注的区域的描述信息确定的且包括该区域的至少一部 分, 所以, 通信设备 600可以将该发送设备的用户当前正在关注的区域中的 至少一部分图像内容显示出来, 从而可以提升屏幕共享时的沟通效率。 根据本发明实施例 1 ,本发明实施例 4提供了一种实现屏幕共享的通信设 备 1000, 如图 10所示, 通信设备 1000包括处理器 1010和存储器 1020, 其 中, 处理器 1010和存储器 1020之间通过总线完成相互间的通信。
存储器 1020, 用于存放计算机操作指令。 存储器 1020可能包含高速 RAM 存储器, 也可能还包括非易失性存储器 (non- vola t i le memory ), 例如至少 一个磁盘存储器。
处理器 1010 , 用于执行存储器 1020 中存放的计算机操作指令。 处理器 1010具体可以是中央处理器(CPU, centra l proces s ing uni t ), 是计算机核 心单元。
其中, 处理器 1010执行所述计算机操作指令使得通信设备 1000实现如 下操作:
抓取通信设备 1000的屏幕上的共享区显示的图像以获取屏幕共享图像。 获取所述屏幕共享图像中的关注区域的描述信息, 其中所述屏幕共享图 像中的关注区域为在屏幕共享过程中所述发送设备的用户当前正在关注的区 域。 所述关注区域的描述信息具体可以包括所述关注区域的边界的描述信息 或所述关注区域的中心点的坐标。
向接收设备发送所述屏幕共享图像和图像辅助信息, 所述图像辅助信息 包括所述关注区域的描述信息, 以促使所述接收设备根据所述描述信息在所 述屏幕共享图像中确定包括所述关注区域的至少一部分的待显示区域并显示 所述待显示区域中的图像。
具体地, 处理器 1010执行所述计算机操作指令使得通信设备 1000具体 实现本发明实施例 1所述的方法中所述发送设备执行的操作。
根据本发明实施例 4 , 通信设备 1000不仅将所述屏幕共享图像发送给接 收设备, 还将在屏幕共享过程中通信设备 1000的用户当前正在关注的区域的 描述信息发送给所述接收设备, 以促使所述接收设备根据所述描述信息确定 包括所述区域的至少一部分的待显示区域并将所述待显示区域中的图像内容 显示在所述接收设备的屏幕上, 因此, 通信设备 1000的用户当前正在关注的 区域中的至少一部分图像内容可以显示在所述接收设备的屏幕上, 从而可以 提升屏幕共享时的沟通效率。 根据本发明实施例 1 ,本发明实施例 5提供了一种实现屏幕共享的通信设 备 2000, 如图 11所示, 通信设备 2000包括处理器(proces sor) 2010和存储 器(memory) 2020, 其中, 处理器 2010和存储器 2020之间通过总线完成相互 间的通信。
存储器 2020, 用于存放计算机操作指令。 存储器 2020可能包含高速 RAM 存储器, 也可能还包括非易失性存储器 (non- vola t i le memory ), 例如至少 一个磁盘存储器。
处理器 2010 , 用于执行存储器 2020 中存放的计算机操作指令。 处理器 2010具体可以是中央处理器(CPU, centra l proces s ing uni t ), 是计算机核 心单元。
其中, 处理器 2010执行所述计算机操作指令使得通信设备 2000实现如 下操作:
接收正在进行屏幕共享的发送设备发送的屏幕共享图像和图像辅助信 息, 所述图像辅助信息包括所述屏幕共享图像中的关注区域的描述信息, 其 中所述屏幕共享图像中的关注区域为在屏幕共享过程中所述发送设备的用户 当前正在关注的区域, 所述屏幕共享图像是所述发送设备的屏幕上的共享区 显示的图像;
在确定通信设备 2000的屏幕上用于显示所述屏幕共享图像的显示区的宽 度小于所述屏幕共享图像的宽度, 或所述显示区的高度小于所述屏幕共享图 像的高度时, 根据所述关注区域的描述信息和所述显示区的分辨率确定所述 屏幕共享图像中的待显示区域, 确定的所述待显示区域的分辨率与所述显示 区的分辨率相同, 且所述待显示区域包括所述关注区域的至少一部分;
在所述显示区显示所述待显示区域中的图像内容。
具体地, 处理器 2G1 G执行所述计算机操作指令使得通信设备 2000具体 实现本发明实施例 1所述的方法中所述接收设备执行的操作。
根据本发明实施例 5 , 由于通信设备 2000确定的待显示区域与该接收设 备的屏幕上的显示区的分辨率相同, 所以该待显示区域中的图像内容可以完 整呈现在该显示区, 又由于该待显示区域是根据在屏幕共享过程中所述发送 设备的用户当前正在关注的区域的描述信息确定的且包括该区域的至少一部 分, 所以, 通信设备 2000可以将该发送设备的用户当前正在关注的区域中的 至少一部分图像内容显示出来, 从而可以提升屏幕共享时的沟通效率。 根据本发明实施例 1 ,本发明实施例 6提出了一种实现屏幕共享的通信系 统 5000, 如图 12所示, 通信系统 5000包括发送设备 5010和接收设备 5020。
发送设备 5010 ,用于抓取发送设备 5010的屏幕上的共享区显示的图像以 获取屏幕共享图像, 获取所述屏幕共享图像中的关注区域的描述信息, 并向 接收设备 5020发送所述屏幕共享图像和图像辅助信息, 所述图像辅助信息包 括所述关注区域的描述信息。
其中所述屏幕共享图像中的关注区域为在屏幕共享过程中所述发送设备 的用户当前正在关注的区域。
接收设备 5020 ,用于接收发送设备 5010发送的所述屏幕共享图像和所述 图像辅助信息, 并在确定接收设备 5020的屏幕上用于显示所述屏幕共享图像 的显示区的宽度小于所述屏幕共享图像的宽度, 或所述显示区的高度小于所 述屏幕共享图像的高度时, 根据所述关注区域的描述信息和所述显示区的分 辨率确定所述屏幕共享图像中的待显示区域, 确定的所述待显示区域的分辨 率与所述显示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少 一部分, 还用于在所述显示区显示所述待显示区域中的图像内容。
发送设备 5010, 还可以用于识别所述屏幕共享图像中的有效图像区域的 边界并获取所述有效图像区域的边界的描述信息, 并用于将所述有效图像区 域的边界的描述信息作为所述图像辅助信息的一部分发送给接收设备 5020; 相应地,接收设备 5020用于确定所述待显示区域具体包括,接收设备 5020 用于根据所述有效图像区域的边界的描述信息和所述关注区域的描述信息确 定所述待显示区域, 确定的所述待显示区域的分辨率与所述显示区的分辨率 相同且包括所述关注区域的至少一部分, 并且确定的所述待显示区域的至少 一部分包含在所述有效图像区域中。
本发明实施例 6中描述的通信系统 5000可以用来实施上述实施例 1所述 的方法。
根据本发明实施例 6 , 发送设备 5010不仅将所述屏幕共享图像发送给接 收设备 5020,还将在屏幕共享过程中发送设备 5010的用户当前正在关注的区 域的描述信息发送给接收设备 5020,相应地,接收设备 5020根据所述描述信 息确定包括所述区域的至少一部分的待显示区域并将所述待显示区域中的图 像内容显示在接收设备 5020的屏幕上的显示区, 因此, 发送设备 5010的用 户当前正在关注的区域中的至少一部分图像内容可以显示在接收设备 5020的 屏幕上, 从而可以提升屏幕共享时的沟通效率。 本领域普通技术人员可以意识到, 结合本文中所公开的实施例描述的各 示例的单元及算法步骤, 能够以电子硬件、 或者计算机软件和电子硬件的结 合来实现。 这些功能究竟以硬件还是软件方式来执行, 取决于技术方案的特 定应用和设计约束条件。 专业技术人员可以对每个特定的应用来使用不同方 法来实现所描述的功能, 但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到, 为描述的方便和简洁, 上述描 述的系统、 装置和单元的具体工作过程, 可以参考前述方法实施例中的对应 过程, 在此不再赘述。
在本申请所提供的几个实施例中, 应该理解到, 所揭露的系统、 装置和 方法, 可以通过其它的方式实现。 例如, 以上所描述的装置实施例仅仅是示 意性的, 例如, 所述单元的划分, 仅仅为一种逻辑功能划分, 实际实现时可 以有另外的划分方式, 例如多个单元或组件可以结合或者可以集成到另一个 系统, 或一些特征可以忽略, 或不执行。 另一点, 所显示或讨论的相互之间 的耦合或直接耦合或通信连接可以是通过一些接口, 装置或单元的间接耦合 或通信连接, 可以是电性, 机械或其它的形式。 为单元显示的部件可以是或者也可以不是物理单元, 即可以位于一个地方, 或者也可以分布到多个网络单元上。 可以根据实际的需要选择其中的部分或 者全部单元来实现本实施例方案的目的。
另外, 在本发明各个实施例中的各功能单元可以集成在一个处理单元中 , 也可以是各个单元单独物理存在, 也可以两个或两个以上单元集成在一个单 元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用 时, 可以存储在一个计算机可读取存储介质中。 基于这样的理解, 本发明的 技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可 以以软件产品的形式体现出来, 该计算机软件产品存储在一个存储介质中, 包括若干指令用以使得一台计算机设备(可以是个人计算机, 服务器, 或者 网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。 而前述的 存储介质包括: U盘、 移动硬盘、 只读存储器(ROM, Read-Only Memory ) 、 随机存取存储器 ( RAM, Random Acces s Memory ) 、 磁碟或者光盘等各种可以 存储程序代码的介质。
以上所述, 仅为本发明的具体实施方式, 但本发明的保护范围并不局限 于此, 任何熟悉本技术领域的技术人员在本发明揭露的技术范围内, 可轻易 想到变化或替换, 都应涵盖在本发明的保护范围之内。 因此, 本发明的保护 范围应所述以权利要求的保护范围为准。

Claims

权利 要求 书
1. 一种实现屏幕共享的方法, 其特征在于, 所述方法包括:
接收设备接收正在进行屏幕共享的发送设备发送的屏幕共享图像和图像辅 助信息, 所述图像辅助信息包括所述屏幕共享图像中的关注区域的描述信息, 其中所述屏幕共享图像中的关注区域为在屏幕共享过程中所述发送设备的用户 当前正在关注的区域, 所述屏幕共享图像是所述发送设备的屏幕上的共享区显 示的图像;
所述接收设备在确定所述接收设备的屏幕上用于显示所述屏幕共享图像的 显示区的宽度小于所述屏幕共享图像的宽度, 或所述显示区的高度小于所述屏 幕共享图像的高度时, 根据所述关注区域的描述信息和所述显示区的分辨率确 定所述屏幕共享图像中的待显示区域, 确定的所述待显示区域的分辨率与所述 显示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少一部分; 所述接收设备在所述显示区显示所述待显示区域中的图像内容。
2. 如权利要求 1所述的方法, 其特征在于: 所述关注区域的描述信息具体 包括所述关注区域的中心点的坐标;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域具体包括: 根据所述关注区域的中心点的坐标在所述屏幕共享图像中确定 包括所述中心点且分辨率与所述显示区的分辨率相同的区域作为所述待显示区 域。
3. 如权利要求 2所述的方法, 其特征在于: 所述中心点的坐标为
(centerX, centerY) , 其中, 所述屏幕共享图像的左上角为坐标原点, 横坐标轴 横向朝右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 pi cWidth*picHe ight ; 所述显示区的分辨率 为 viewWidth * viewHe ight ;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域具体包括: 按照如下方式计算所述待显示区域的最左点的横坐标 rcLeft、 最高点的纵 坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBottom:
当 PicWidth >= viewWidth时, 按照 ¾口下方法计算 rcLef t和 rcRight:
如果 centerX_viewWidth/2 <= 0, rcLef t = 0, rcRight
=viewWidth;
如果 centerX+viewWidth/2 > PicWidth, rcLef t = PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = centerX-viewWidth/2, rcRight = centerX+viewWidth/ 2;
当 PicWidth < viewWidth时, 按照如下方法计算 rcLeft和 rcRight: rcLeft = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, 按照如下方法计算 rcTop和 rcBottom:
如果 centerY_viewHeight/2 <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (centerY+viewHeight/2 > PicHeight) , rcTop = PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = centerY-viewHeight/2, rcBottom = centerY+viewHeight/2;
当 PicHeight < viewHeight时,按照^口下方法计算 rcTo 和 rcBot torn: rcTop = 0, rcBottom = viewHeight。
4. 如权利要求 1所述的方法, 其特征在于: 所述关注区域的描述信息具体 包括所述关注区域的边界的描述信息, 所述关注区域为其中一边和所述屏幕共 享图像的其中一边平行的矩形区域;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域具体包括:
在所述显示区的宽度大于所述关注区域的宽度且所述显示区的高度大于所 述关注区域的高度时, 根据所述关注区域的边界的描述信息在所述屏幕共享图 像中确定包括所述关注区域且分辨率与所述显示区的分辨率相同的区域作为所 述待显示区域;
在所述显示区的宽度小于所述关注区域的宽度和 /或所述显示区的高度小 于所述关注区域的高度时, 根据所述关注区域的边界的描述信息在所述屏幕共 享图像中确定包括所述关注区域的中心点且分辨率与所述显示区的分辨率相同 的区域作为所述待显示区域。
5. 如权利要求 4所述的方法, 其特征在于:
所述关注区域的边界的描述信息具体包括所述关注区域的最左点的横坐标 atLeft、 最高点的纵坐标 atTop、 最右点的横坐标 atRight和最氏点的纵坐标 atBottom, 其中, 所述屏幕共享图像的左上角为坐标原点, 横坐标轴横向朝右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨率 为 viewWidth * viewHeight;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域具体包括:
按照如下方式计算所述待显示区域的最左点的横坐标 rcLeft、 最高点的纵 坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBottom:
当 PicWidth >= viewWidth时, 按照 ¾口下方法计算 rcLef t和 rcRight:
如果 atl f t+atRight_viewWidth <= 0, rcLef t = 0, rcRight =viewWidth;
如果 ( atLef t+atRight+viewWidth ) /2 > PicWidth, rcLeft = PicWidth-viewWidth, rcRight = PicWidth;
否则, rcLef t = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
当 PicWidth < viewWidth时,按照 ¾口下方法计算 rcLeft和 rcRight: rcLeft = 0, rcRight = viewWidth;
当 PicHeight >= viewHeight时, 按照如下方法计算 rcTop和 rcBottom:
如果 atTop+atBoUom-viewHeight <= 0, rcTop = 0, rcBottom = viewHeight;
如果 (atTop+atBottom+viewHeight ) / 2 > PicHeight, rcTop = PicHeight-viewHeight, rcBottom = PicHeight;
否则, rcTop = ( atTop+atBottom-viewHeight ) / 2 , rcBottom = ( atTop+atBottom+viewHeight ) / 2;
当 PicHeight < viewHeight时,按照如下方法计算 rcTop和 rcBot torn: rcTop = 0, rcBottom = viewHeight。
6. 如权利要求 1所述的方法, 其特征在于, 所述图像辅助信息还包括所述 屏幕共享图像中的有效图像区域的描述信息;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域具体包括: 根据所述有效图像区域的边界的描述信息、 所述显示区的分辨 率、 以及所述关注区域的描述信息确定所述待显示区域, 确定的所述待显示区 域的分辨率与所述显示区的分辨率相同且包括所述关注区域的至少一部分, 并 且确定的所述待显示区域的至少一部分包含在所述有效图像区域中。
7. 如权利要求 6所述的方法, 其特征在于:
所述关注区域的描述信息具体包括所述关注区域的中心点的坐标
(centerX, centerY) , 其中, 所述屏幕共享图像的左上角为坐标原点, 横坐标轴 横向朝右, 纵坐标轴纵向朝下;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨率 为 viewWidth * viewHeight;
所述有效图像区域为其中一边和所述横坐标轴平行的矩形区域, 所述有效 图像区 i或的边界的描述信息为 (BorderLeft, BorderTop, BorderRight, BorderBottom), 其中, BorderLeft为所述有效图像区域上的最左点的横坐标, BorderTop为所述有效图像区域上的最高点的纵坐标, BorderRight为所述有效 图像区域上的最右点的横坐标, BorderBot tom为所述有效图像区域上的最低点 的 έ从坐标;
所述根据所述有效图像区域的边界的描述信息和所述关注区域的描述信息 确定所述待显示区域具体包括:
按照如下方式计算所述待显示区域的最左点的横坐标 rcLef t、 最高点的纵 坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBot tom:
^ BorderRight-BorderLef t >= viewWidth时, 按照如下方法计算 rcl f t 和 rcRi ght:
如果 (centerX_viewWidth/2 <= BorderLef t) , rcLef t =
BorderLef t , rcRight = BorderLef t+viewWidth;
如果(centerX+v iewWidth/2 > BorderRight)时, rcLef t = BorderRight-viewWidth, rcRight = BorderRight;
否则, rcLef t = centerX-viewWidth/2 , rcRi ght = centerX+viewWidth/ 2;
^ BorderRight-BorderLef t < v iewWidth -JL picWidth > viewWidth时, 按照 ^下方法计算 rcLef t和 rcRight:
如果((BorderLef t+BorderRight) /2 <= viewWidth/2) , rcLef t = 0, rcRight = viewWidth;
如果((BorderLef t+BorderRight+viewWidth) /2 > pi cWidth) , rcLef t = icWidth-viewWidth, rcRight = picWidth;
否则, rcLef t = (BorderRight+BorderLef t-v iewWidth) /2 , rcRi ght = (BorderRight+BorderLef t+viewWidth) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth < viewWidth时, 按照如下方法计算 rcLef t和 rcRight: rcLef t= 0, rcRight= v iewWidth;
^ BorderBot tom-BorderTop >= viewHe ight时, 按照如下方法计算 rcTop 和 rcBottom:
如果 (centerY-viewHeight/2 <= BorderTop) , rcTop = BorderTop, rcBottom = BorderTop+viewHeight;
如果 (centerY+viewHeight/2 > BorderBottom) , rcTop =
BorderBot tom-viewHeight , rcBottom = BorderBottom;
否则, rcTop = centerY-viewHeight/2, rcBottom = centerY+viewHeight/2;
^ BorderBot tom-BorderTop < viewHeight并且 PicHeight > viewHeight 时, 按照如下方法计算 rcTo 和 rcBottom:
如果 ( (BorderTop+BorderBottom) /2 <= viewHeight/2) , rcTop = 0, rcBottom = viewHeight;
如果 ( (BorderTop+BorderBottom+viewHeight) /2 > picHeight) , rcTop = icHeight-viewHeight , rcBottom = picHeight;
否则, rcTop = (BorderBot tom+BorderTop-viewHeight) / 2, rcBottom = (BorderBot tom+BorderTop+viewHeight) / 2;
^ BorderBot tom-BorderTop < viewHeight并且 PicHeight < viewHeight 时, 按照如下方法计算 rcTop和 rcBottom: rcTop = 0, rcBottom = viewHeight。
8. 如权利要求 6所述的方法, 其特征在于:
以所述屏幕共享图像的左上角为坐标原点, 横坐标轴横向朝右, 纵坐标轴 纵向朝下, 所述关注区域为其中一边和所述横坐标轴平行的矩形区域, 其中, 所述关注区域的描述信息具体包括所述关注区域的边界的描述信息 ( atLef t, atTop, atRight, atBottom ), atLef t为所述关注区域上的最左点的横坐标, atTop 为所述关注区域上的最高点的纵坐标, atRight为所述关注区域上的最右点的横 坐标, atBottom为所述关注区域上的最低点的纵坐标;
所述有效图像区域为其中一边和所述横坐标轴平行的矩形区域, 所述有效 图像区 i或的边界的描述信息为 (BorderLeft, BorderTop, BorderRight, BorderBottom), 其中, BorderLeft为所述有效图像区域上的最左点的横坐标, BorderTop为所述有效图像区域上的最高点的纵坐标, BorderRight为所述有效 图像区域上的最右点的横坐标, BorderBottom为所述有效图像区域上的最低点 的 έ从坐标;
所述屏幕共享图像的分辨率为 picWidth*picHeight; 所述显示区的分辨率 为 viewWidth * viewHeight;
所述根据所述关注区域的描述信息和所述显示区的分辨率确定所述待显示 区域具体包括:
按照如下方式计算所述待显示区域的最左点的横坐标 rcLeft、 最高点的纵 坐标 rcTop、 最右点的横坐标 rcRight和最低点的纵坐标 rcBottom:
^ BorderRight-BorderLef t >= viewWidth时, 按照如下方法计算 rcl f t 和 rcRight:
如果 ( atLef t+atRight-viewWidth ) /2 <= BorderLeft, rcLef t = BorderLeft, rcRight = BorderLef t+viewWidth;
如果 ( atLef t+atRight+viewWidth ) /2 > BorderRight时, rcLef t = BorderRight - viewWidth, rcRight = BorderRight;
否则, rcLef t = ( atLef t+atRight-viewWidth ) /2, rcRight = ( atLef t+atRight+viewWidth ) /2;
^ BorderRight-BorderLef t < viewWidth -JL picWidth > viewWidth时, 按照 ^下方法计算 rcLeft和 rcRight:
如果((BorderLef t+BorderRight) /2 <= viewWidth/2) , rcLeft = 0, rcRight = viewWidth;
如果((BorderLef t+BorderRight+viewWidth) /2 > picWidth) , rcLeft = icWidth-viewWidth, rcRight = picWidth;
否则, rcLeft = (BorderRight+BorderLef t-viewWidth) /2, rcRight = (BorderRight+BorderLef t+viewWidth) /2; ^ BorderRight-BorderLef t < viewWidth -JL picWidth < viewWidth时, 按照如下方法计算 rcLef t和 rcRight: rcLeft= 0, rcRight= viewWidth;
^ BorderBottom-BorderTop >= viewHeight时, 按照如下方法计算 rcTop 和 rcBottom:
如果 ( atTop+atBottom-viewHeight ) / 2<= BorderTop, rcTop = BorderTop, rcBottom = BorderTop+viewHeight;
如果 ( atTop+atBottom+viewHeight ) / 2 > BorderBottom, rcTop = BorderBottom-viewHeight , rcBottom = BorderBottom;
否则, rcTop = ( atTop+atBottom-viewHeight ) / 2 , rcBottom = ( atTop+atBottom+viewHeight ) /2;
^ BorderBottom-BorderTop < viewHeight并且 PicHeight > viewHeight 时, 按照如下方法计算 rcTo 和 rcBottom:
如果 ( (BorderTop+BorderBottom) /2 <= viewHeight/2) , rcTop = 0, rcBottom = viewHeight;
如果 ( (BorderTop+BorderBottom+viewHeight) /2 > picHeight) , rcTop = icHeight-viewHeight , rcBottom = picHeight;
否则, rcTop = (BorderBot tom+BorderTop-viewHeight) / 2, rcBottom = (BorderBot tom+BorderTop+viewHeight) / 2;
^ BorderBottom-BorderTop < viewHeight并且 PicHeight < viewHeight 时, 按照如下方法计算 rcTop和 rcBottom: rcTop = 0, rcBottom = viewHeight。
9. 如权利要求 1-8任一所述的方法, 其特征在于, 所述接收设备在所述显 示区显示所述待显示区域中的图像内容之前还包括:
获取第一坐标, 所述第一坐标为所述显示区中当前显示的图像内容的中心 点在所述当前显示的图像内容对应的屏幕共享图像中的坐标;
确定第二坐标, 所述第二坐标为所述待显示区域的中心点在所述屏幕共享 图像中的坐标; 计算所述第一坐标和所述第二坐标之间的差值;
所述在所述显示区显示所述待显示区域中的图像内容具体包括: 在确定所 述差值超过设定阔值时, 在所述显示区显示所述待显示区域中的图像内容。
10. 如权利要求 1-9任一所述的方法, 其特征在于, 所述接收设备在确定 在之前的预设长度的时间段内没有检测到用于指示滚屏的操作时执行所述根据 所述关注区域的描述信息和所述显示区的分辨率确定所述待显示区域并显示所 述待显示区域中的图像内容的操作。
11. 一种实现屏幕共享的方法, 其特征在于, 所述方法包括:
发送设备抓取所述发送设备的屏幕上的共享区显示的图像以获取屏幕共享 图像;
所述发送设备获取所述屏幕共享图像中的关注区域的描述信息, 其中所述 关注区域为在屏幕共享过程中所述发送设备的用户当前正在关注的区域;
所述发送设备向接收设备发送所述屏幕共享图像和图像辅助信息 , 所述图 像辅助信息包括所述关注区域的描述信息, 以促使所述接收设备根据所述描述 信息在所述屏幕共享图像中确定包括所述关注区域的至少一部分的待显示区域 并显示所述待显示区域中的图像内容。
12. 如权利要求 11所述的方法, 其特征在于, 所述关注区域的描述信息具 体包括所述关注区域的边界的描述信息或所述关注区域的中心点的坐标。
13. 如权利要求 11或 12所述的方法, 其特征在于, 所述发送设备获取所 述关注区域的描述信息具体包括:
所述发送设备利用聚类算法对记录的满足预设条件的鼠标位置进行分群, 将满足目标条件的群作为目标群, 将所述目标群中的鼠标位置的外接矩形所围 成的区域作为所述关注区域, 获取用于描述所述外接矩形的信息作为所述关注 区域的描述信息。
14. 如权利要求 13所述的方法, 其特征在于, 所述利用聚类算法对记录的满足预设条件的鼠标位置进行分群之前还包 括: 按照预设时间间隔记录当前的鼠标位置;
所述满足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的预 设长度的时间段内记录的鼠标位置。
15. 如权利要求 14所述的方法, 其特征在于, 所述将满足目标条件的群作 为目标群具体包括:
将包括的鼠标位置数量最多的群作为所述目标群; 或者,
根据各鼠标位置记录的时间先后为各鼠标位置赋予对应的权值, 对各个群 中包括的鼠标位置进行加权计算以获得各个群的加权值, 将加权值最大的群作 为所述目标群, 其中, 为后记录的鼠标位置赋予的权值高于为先记录的鼠标位 置赋予的权值。
16. 如权利要求 1 3所述的方法, 其特征在于,
所述利用聚类算法对记录的满足预设条件的鼠标位置进行分群之前还包 括: 在检测到鼠标操作时, 记录所述鼠标操作对应的鼠标位置和所述鼠标操作 的属性信息;
所述满足预设条件的鼠标位置包括, 在执行所述分群操作的时间之前的预 设长度的时间段内检测到的鼠标操作对应的鼠标位置;
所述将满足目标条件的群作为目标群具体包括: 根据各鼠标操作的属性信 息为所述鼠标操作对应的鼠标位置赋予对应的权值, 对各个群中包括的鼠标位 置进行加权计算以获得各个群的加权值, 将加权值最大的群作为所述目标群。
17. 如权利要求 16所述的方法, 其特征在于, 所述鼠标操作的属性信息包 括所述鼠标操作的类型和 /或所述鼠标操作发生的时间。
18. 如权利要求 11或 12所述的方法, 其特征在于, 所述发送设备获取所 述关注区域的描述信息具体包括: 所述发送设备在检测到键盘输入操作时, 确 定当前的输入光标位置, 将所述屏幕共享图像中以所述光标位置为中心的输入 区域作为所述关注区域, 获取用于描述所述输入区域的信息作为所述关注区域 的描述信息。
19. 如权利要求 11或 12所述的方法, 其特征在于, 所述发送设备获取所 述关注区域的描述信息具体包括: 所述发送设备将所述共享区显示的图像中发 生更新的图像内容所在的区域作为所述关注区域, 获取用于描述所述图像内容 所在的区域的信息作为所述关注区域的描述信息。
20. 如权利要求 11-19任一所述的方法, 其特征在于,
所述发送设备向所述接收设备发送所述屏幕共享图像和图像辅助信息之前 还包括: 所述发送设备识别所述屏幕共享图像中的有效图像区域的边界并获取 所述有效图像区域的边界的描述信息;
所述图像辅助信息还包括所述有效图像区域的边界的描述信息, 以促使所 述接收设备根据所述关注区域的描述信息和所述有效图像区域的边界的描述信 息确定所述待显示区域, 确定的所述待显示区域包括所述关注区域的至少一部 分, 且所述待显示区域的至少一部分包含在所述有效图像区域中。
21. 一种实现屏幕共享的通信设备, 其特征在于, 包括: 接收单元、 确定 单元和显示单元;
所述接收单元, 用于接收正在进行屏幕共享的发送设备发送的屏幕共享图 像和图像辅助信息, 所述图像辅助信息包括所述屏幕共享图像中的关注区域的 描述信息, 其中所述关注区域为在屏幕共享过程中所述发送设备的用户当前正 在关注的区域, 所述屏幕共享图像是所述发送设备的屏幕上的共享区显示的图 像, 并用于将所述图像辅助信息传输至所述确定单元, 将所述屏幕共享图像传 输至所述显示单元;
所述确定单元, 用于从所述接收单元接收所述图像辅助信息, 还用于在确 定所述通信设备的屏幕上用于显示所述屏幕共享图像的显示区的宽度小于所述 屏幕共享图像的宽度, 或所述显示区的高度小于所述屏幕共享图像的高度时, 根据所述关注区域的描述信息和所述显示区的分辨率确定所述屏幕共享图像中 的待显示区域, 确定的所述待显示区域的分辨率与所述显示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少一部分, 并将用于描述所述待显示 区域的信息发送给所述显示单元;
所述显示单元, 用于从所述接收单元接收所述屏幕共享图像, 从所述确定 单元接收用于描述所述待显示区域的信息, 并用于根据所述用于描述所述待显 示区域的信息将所述屏幕共享图像的在所述待显示区域中的图像内容显示在所 述显示区。
22. 如权利要求 21所述的通信设备, 其特征在于: 所述关注区域的描述信 息具体包括所述关注区域的中心点的坐标;
所述确定单元, 具体用于根据所述关注区域的中心点的坐标在所述屏幕共 享图像中确定包括所述中心点且分辨率与所述显示区的分辨率相同的区域作为 所述待显示区域。
23. 如权利要求 21所述的通信设备, 其特征在于: 所述关注区域的描述信 息具体包括所述关注区域的边界的描述信息, 所述关注区域为其中一边和所述 屏幕共享图像的其中一边平行的矩形区域;
所述确定单元具体用于, 在所述显示区的宽度大于所述关注区域的宽度且 所述显示区的高度大于所述关注区域的高度时, 根据所述关注区域的边界的描 述信息在所述屏幕共享图像中确定包括所述关注区域且分辨率与所述显示区的 分辨率相同的区域作为所述待显示区域, 在所述显示区的宽度小于所述关注区 域的宽度和 /或所述显示区的高度小于所述关注区域的高度时, 根据所述关注区 域的边界的描述信息在所述屏幕共享图像中确定包括所述关注区域的中心点且 分辨率与所述显示区的分辨率相同的区域作为所述待显示区域。
24. 如权利要求 21所述的通信设备, 其特征在于, 所述接收单元接收的所 述图像辅助信息还包括所述屏幕共享图像中的有效图像区域的描述信息;
所述确定单元, 具体用于根据所述有效图像区域的边界的描述信息和所述 关注区域的描述信息确定所述待显示区域, 确定的所述待显示区域的分辨率与 所述显示区的分辨率相同且包括所述关注区域的至少一部分, 并且确定的所述 待显示区域的至少一部分包含在所述有效图像区域中。
25. 如权利要求 21-24任一所述的通信设备, 其特征在于, 所述通信设备 还包括差值计算单元;
所述确定单元, 还用于将用于描述所述待显示区域的信息传输至所述差值 计算单元;
所述差值计算单元, 用于从所述确定单元接收用于描述所述待显示区域的 信息, 并用于获取第一坐标、 根据用于描述所述待显示区域的信息确定第二坐 标、 并计算所述第一坐标和所述第二坐标之间的差值, 其中, 所述第一坐标为 所述显示区中当前显示的图像内容的中心点在所述当前显示的图像内容对应的 屏幕共享图像中的坐标, 所述第二坐标为所述待显示区域的中心点在所述接收 单元接收的所述屏幕共享图像中的坐标, 还用于将所述差值传输至所述显示单 元;
所述显示单元, 具体用于在所述差值超过设定阔值时, 在所述显示区显示 所述待显示区域中的图像内容。
26. 如权利要求 21-25任一所述的通信设备, 其特征在于, 所述确定单元, 具体用于在确定在之前的预设长度的时间段内没有检测到用于指示滚屏的操作 时执行所述确定所述待显示区域的操作。
27. 一种实现屏幕共享的通信设备, 其特征在于, 包括图像抓取单元、 信 息获取单元和发送单元:
所述图像抓取单元, 用于抓取所述通信设备的屏幕上的共享区显示的图像 以获取屏幕共享图像, 并用于将所述屏幕共享图像传输至所述发送单元;
所述信息获取单元, 用于获取所述屏幕共享图像中的关注区域的描述信息 , 并用于将所述关注区域的描述信息传输至所述发送单元, 其中所述关注区域为 在屏幕共享过程中所述发送设备的用户当前正在关注的区域; 所述发送单元, 用于从所述图像抓取单元接收所述屏幕共享图像, 从所述 信息获取单元接收所述关注区域的描述信息, 并用于向接收设备发送所述屏幕 共享图像和图像辅助信息, 所述图像辅助信息包括所述关注区域的描述信息, 以促使所述接收设备根据所述描述信息在所述屏幕共享图像中确定包括所述关 注区域的至少一部分的待显示区域并显示所述待显示区域中的图像内容。
28. 如权利要求 27所述的通信设备, 其特征在于, 所述信息获取单元, 具 体用于利用聚类算法对记录的满足预设条件的鼠标位置进行分群, 将满足目标 条件的群作为目标群, 将所述目标群中的鼠标位置的外接矩形所围成的区域确 定为所述关注区域, 并获取用于描述所述外接矩形的信息作为所述关注区域的 描述信息。
29. 如权利要求 28所述的通信设备, 其特征在于, 所述信息获取单元, 还 用于按照预设时间间隔记录当前的鼠标位置, 所述满足预设条件的鼠标位置包 括, 在执行所述分群操作的时间之前的预设长度的时间段内记录的鼠标位置。
30. 如权利要求 29所述的通信设备, 其特征在于, 所述信息获取单元用于 将满足目标条件的群作为目标群具体包括: 将包括的鼠标位置数量最多的群作 为所述目标群; 或者, 根据各鼠标位置记录的时间先后为各鼠标位置赋予对应 的权值, 对各个群中包括的鼠标位置进行加权计算以获得各个群的加权值, 将 加权值最大的群作为所述目标群, 其中, 为后记录的鼠标位置赋予的权值高于 为先记录的鼠标位置赋予的权值。
31. 如权利要求 28所述的通信设备, 其特征在于,
所述信息获取单元, 还用于在检测到鼠标操作时记录所述鼠标操作对应的 鼠标位置和所述鼠标操作的属性信息, 所述满足预设条件的鼠标位置包括之前 的预设长度的时间段内检测到的鼠标操作对应的鼠标位置;
所述信息获取单元用于将满足目标条件的群作为目标群具体包括: 根据各 鼠标操作的属性信息为所述鼠标操作对应的鼠标位置赋予对应的权值, 对各个 群中包括的鼠标位置进行加权计算以获得各个群的加权值, 将加权值最大的群 作为所述目标群。
32. 如权利要求 27所述的通信设备, 其特征在于, 所述信息获取单元, 具 体用于在检测到键盘输入操作时, 确定当前的输入光标位置, 将所述屏幕共享 图像中以所述光标位置为中心的输入区域作为所述关注区域, 获取用于描述所 述输入区域的信息作为所述关注区域的描述信息。
33. 如权利要求 27所述的通信设备, 其特征在于, 所述信息获取单元, 具 体用于将所述共享区显示的图像中发生更新的图像内容所在的区域作为所述关 注区域, 获取用于描述所述图像内容所在的区域的信息作为所述关注区域的描 述信息。
34. 如权利要求 27-33任一所述的通信设备, 其特征在于,
所述信息获取单元, 还用于识别所述屏幕共享图像中的有效图像区域的边 界并获取所述有效图像区域的边界的描述信息, 并用于将所述有效图像区域的 边界的描述信息传输至所述发送单元;
所述发送单元, 还用于从所述信息获取单元接收所述有效图像区域的边界 的描述信息, 并用于将所述有效图像区域的边界的描述信息作为所述图像辅助 信息的一部分发送给所述接收设备, 以促使所述接收设备根据所述关注区域的 描述信息和所述有效图像区域的边界的描述信息确定所述待显示区域, 确定的 所述待显示区域包括所述关注区域的至少一部分, 且所述待显示区域的至少一 部分包含在所述有效图像区域中。
35. 一种实现屏幕共享的通信系统, 其特征在于, 包括: 发送设备和接收 设备;
所述发送设备, 用于抓取所述发送设备的屏幕上的共享区显示的图像以获 取屏幕共享图像, 获取所述屏幕共享图像中的关注区域的描述信息, 并向所述 接收设备发送所述屏幕共享图像和图像辅助信息, 所述图像辅助信息包括所述 关注区域的描述信息, 其中所述关注区域为在屏幕共享过程中所述发送设备的 用户当前正在关注的区域;
所述接收设备, 用于接收所述发送设备发送的所述屏幕共享图像和所述图 像辅助信息, 并在确定所述接收设备的屏幕上用于显示所述屏幕共享图像的显 示区的宽度小于所述屏幕共享图像的宽度, 或所述显示区的高度小于所述屏幕 共享图像的高度时, 根据所述关注区域的描述信息和所述显示区的分辨率确定 所述屏幕共享图像中的待显示区域, 确定的所述待显示区域的分辨率与所述显 示区的分辨率相同, 且所述待显示区域包括所述关注区域的至少一部分, 还用 于在所述显示区显示所述待显示区域中的图像内容。
36. 如权利要求 35所述的通信系统, 其特征在于,
所述发送设备, 还用于识别所述屏幕共享图像中的有效图像区域的边界并 获取所述有效图像区域的边界的描述信息, 并用于将所述有效图像区域的边界 的描述信息作为所述图像辅助信息的一部分发送给所述接收设备;
所述接收设备用于确定所述待显示区域具体包括, 所述接收设备用于根据 所述有效图像区域的边界的描述信息和所述关注区域的描述信息确定所述待显 示区域, 确定的所述待显示区域的分辨率与所述显示区的分辨率相同且包括所 述关注区域的至少一部分, 并且确定的所述待显示区域的至少一部分包含在所 述有效图像区域中。
PCT/CN2014/076421 2014-04-29 2014-04-29 一种实现屏幕共享的方法、装置和系统 WO2015165023A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201480000442.4A CN105247855A (zh) 2014-04-29 2014-04-29 一种实现屏幕共享的方法、装置和系统
PCT/CN2014/076421 WO2015165023A1 (zh) 2014-04-29 2014-04-29 一种实现屏幕共享的方法、装置和系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/076421 WO2015165023A1 (zh) 2014-04-29 2014-04-29 一种实现屏幕共享的方法、装置和系统

Publications (1)

Publication Number Publication Date
WO2015165023A1 true WO2015165023A1 (zh) 2015-11-05

Family

ID=54357986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/076421 WO2015165023A1 (zh) 2014-04-29 2014-04-29 一种实现屏幕共享的方法、装置和系统

Country Status (2)

Country Link
CN (1) CN105247855A (zh)
WO (1) WO2015165023A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109783732A (zh) * 2019-01-10 2019-05-21 珠海金山网络游戏科技有限公司 一种基于点击密度的游戏微端构建方法
CN112419999A (zh) * 2019-08-21 2021-02-26 京东方科技集团股份有限公司 图像处理方法、装置、内容分享方法和终端设备
CN113918070A (zh) * 2020-08-31 2022-01-11 北京金山办公软件股份有限公司 同步显示方法、装置、可读存储介质及电子设备

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112351282A (zh) * 2020-10-28 2021-02-09 西安万像电子科技有限公司 图像数据的传输方法及装置、非易失性存储介质及处理器
CN114461327A (zh) * 2022-02-09 2022-05-10 厦门纳龙健康科技股份有限公司 一种心电图波形放大方法、终端设备及存储介质
CN115297344B (zh) * 2022-06-27 2024-03-22 青岛海尔科技有限公司 屏端设备协同交互方法、装置、存储介质及电子装置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060136828A1 (en) * 2004-12-16 2006-06-22 Taiga Asano System and method for sharing display screen between information processing apparatuses
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003337644A (ja) * 2002-03-14 2003-11-28 Sony Corp 電子機器装置、プログラム、プログラム提供装置及び記録媒体
US20100271288A1 (en) * 2009-04-24 2010-10-28 Sudharshan Srinivasan Automatic synchronized scaling of views during application sharing
JP5903835B2 (ja) * 2011-04-28 2016-04-13 株式会社リコー 伝送端末、画像表示制御方法、画像表示制御プログラム、記録媒体、および伝送システム
CN102685445B (zh) * 2012-04-27 2015-10-21 华为技术有限公司 网真视频图像输送方法、设备及网真系统

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060136828A1 (en) * 2004-12-16 2006-06-22 Taiga Asano System and method for sharing display screen between information processing apparatuses
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109783732A (zh) * 2019-01-10 2019-05-21 珠海金山网络游戏科技有限公司 一种基于点击密度的游戏微端构建方法
CN109783732B (zh) * 2019-01-10 2023-07-04 珠海金山数字网络科技有限公司 一种基于点击密度的游戏微端构建方法
CN112419999A (zh) * 2019-08-21 2021-02-26 京东方科技集团股份有限公司 图像处理方法、装置、内容分享方法和终端设备
CN113918070A (zh) * 2020-08-31 2022-01-11 北京金山办公软件股份有限公司 同步显示方法、装置、可读存储介质及电子设备

Also Published As

Publication number Publication date
CN105247855A (zh) 2016-01-13

Similar Documents

Publication Publication Date Title
WO2015165023A1 (zh) 一种实现屏幕共享的方法、装置和系统
EP3105921B1 (en) Photo composition and position guidance in an imaging device
JP6167703B2 (ja) 表示制御装置、プログラム及び記録媒体
US9898241B2 (en) Information sharing system, image processing apparatus, and image processing method
US20150020014A1 (en) Information processing apparatus, information processing method, and program
JP6986187B2 (ja) 人物識別方法、装置、電子デバイス、記憶媒体、及びプログラム
JP6337907B2 (ja) 表示制御装置、表示制御方法およびプログラム
JP6505327B2 (ja) ビデオデータを取得するための方法、装置、及びシステム並びにコンピュータ可読記憶媒体
US8896692B2 (en) Apparatus, system, and method of image processing, and recording medium storing image processing control program
CN108777765B (zh) 获取全清晰图像的方法、装置及电子设备
EP3005300A1 (en) Combining a digital image with a virtual entity
CN108665510B (zh) 连拍图像的渲染方法、装置、存储介质及终端
JP2018531564A6 (ja) ビデオデータを取得するための方法、装置、及びシステム並びにコンピュータ可読記憶媒体
JP6290020B2 (ja) 画像処理装置、画像処理方法、およびプログラム
EP2793462B1 (en) Method and apparatus for video call in communication system
US10684707B2 (en) Display control device, display control method, and program
CN107733874B (zh) 信息处理方法、装置、计算机设备和存储介质
CN113810755B (zh) 全景视频预览的方法、装置、电子设备及存储介质
JP2013152543A (ja) 画像蓄積プログラム、方法および装置
US10430145B2 (en) Remote terminal, method of remote instruction
CN108540726B (zh) 连拍图像的处理方法、装置、存储介质及终端
JP2016025625A (ja) 情報処理装置、情報処理方法及びプログラム
CN111491095B (zh) 图像虚化方法、装置和电子设备
JP6623905B2 (ja) サーバ装置、情報処理方法およびプログラム
JP6443505B2 (ja) プログラム、表示制御装置及び表示制御方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14891071

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14891071

Country of ref document: EP

Kind code of ref document: A1