WO2015172522A1 - 传输图像的方法及装置 - Google Patents

传输图像的方法及装置 Download PDF

Info

Publication number
WO2015172522A1
WO2015172522A1 PCT/CN2014/089320 CN2014089320W WO2015172522A1 WO 2015172522 A1 WO2015172522 A1 WO 2015172522A1 CN 2014089320 W CN2014089320 W CN 2014089320W WO 2015172522 A1 WO2015172522 A1 WO 2015172522A1
Authority
WO
WIPO (PCT)
Prior art keywords
direction information
screen capture
image
connection request
computer
Prior art date
Application number
PCT/CN2014/089320
Other languages
English (en)
French (fr)
Inventor
王巍
孙鹏
赵全国
Original Assignee
小米科技有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 小米科技有限责任公司 filed Critical 小米科技有限责任公司
Priority to RU2014154248A priority Critical patent/RU2609147C2/ru
Priority to BR112015000269A priority patent/BR112015000269A2/pt
Priority to KR1020147035988A priority patent/KR101845404B1/ko
Priority to JP2016518836A priority patent/JP5982079B2/ja
Priority to MX2014015465A priority patent/MX353219B/es
Priority to US14/585,207 priority patent/US20150334191A1/en
Publication of WO2015172522A1 publication Critical patent/WO2015172522A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/174Redundancy elimination performed by the file system
    • G06F16/1744Redundancy elimination performed by the file system using compression, e.g. sparse files
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/50Address allocation
    • H04L61/5007Internet protocol [IP] addresses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/324Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the data link layer [OSI layer 2], e.g. HDLC
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the present disclosure relates to the field of communications and computer processing, and more particularly to a method and apparatus for transmitting images.
  • Terminal devices provide people with various services, such as entertainment services, information search services and interactive services.
  • Terminal devices include mobile phones, computers, and televisions.
  • connection and communication between a mobile phone and a computer, a mobile phone and a television, a computer and a television can be realized.
  • the inventors of the present disclosure have found that in the related art, since the mobile phone has a function of automatically rotating the screen, the picture on the mobile phone can be displayed in a horizontal screen or in a vertical screen. For the same picture, the horizontal screen display is different from the vertical screen display, so when the picture on the mobile phone is transferred to the computer, the display effect on the computer is not satisfactory, and the problem needs to be solved urgently.
  • the present disclosure provides a method and apparatus for transmitting an image.
  • a method of transmitting an image comprising:
  • the screen shot picture and the direction information are transmitted to the computer by the IP layer according to the received IP address.
  • the obtaining direction information of the screen capture image includes:
  • the direction information of the screen capture image is determined according to the direction information determined by the local direction sensor.
  • the method further includes: compressing the screen capture image to obtain a compressed screen capture image
  • Transmitting the screen shot image and the direction information to a computer by using an IP layer including transmitting, by using an IP layer, the compressed screen capture image and the direction information to a computer.
  • the IP connection request is an IP layer-based real-time streaming protocol RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • Transmitting, by the IP layer, the screen capture picture and the direction information to the computer according to the received IP address including: sending, by using an RTSP session of an IP layer, to a computer of the IP address and a UDP port number The screen shot picture and the direction information.
  • a method of transmitting an image comprising:
  • the screen shot image is displayed according to the direction information.
  • the displaying the screen capture image according to the direction information includes: controlling a scale and a size of a window for displaying the screen capture image according to the direction information, and displaying the screen capture image by using the window.
  • the IP connection request is an IP layer-based RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • Receiving, by the IP layer, the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal including: receiving, by using an RTSP session of the IP layer, the screen capture picture and the screen capture picture sent by the mobile terminal on the UDP port number Direction information.
  • an apparatus for transmitting an image comprising:
  • a receiving module configured to receive an IP connection request sent by the computer
  • An IP module configured to obtain an IP address of the computer according to the received IP connection request
  • the obtaining module is configured to obtain direction information of the screen capture image and the screen capture image;
  • a sending module configured to send, by the IP layer, the screen capture picture and the direction information to the computer according to the received IP address.
  • the obtaining module includes:
  • a reading unit configured to read the direction information from a storage location of the direction information of the preset preset stored screenshot image
  • a ratio unit configured to determine direction information of the screen capture image according to an aspect ratio of the screen capture image
  • the sensing unit is configured to determine direction information of the screen capture image according to the direction information determined by the local direction sensor.
  • the device further includes: a compression unit, configured to compress the screen capture image to obtain a compressed screen capture image;
  • the sending module sends the compressed screenshot image and the direction information to a computer through an IP layer.
  • the IP connection request is an IP layer-based real-time streaming protocol RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • the sending module sends the screenshot picture and the direction information to a computer of the IP address and the UDP port number through an RTSP session of the IP layer.
  • an apparatus for transmitting an image comprising:
  • a sending module configured to send an IP connection request to the mobile terminal according to the IP address of the locally stored mobile terminal
  • a receiving module configured to receive, by using an IP layer, direction information of a screen capture picture and a screen capture picture sent by the mobile terminal;
  • a display module configured to display the screenshot picture according to the direction information.
  • the display module controls a scale and a size of a window for displaying the screen shot image according to the direction information, and displays the screen capture image through the window.
  • the IP connection request is an IP layer-based RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • the receiving module receives the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal on the UDP port number through an RTSP session of the IP layer.
  • an apparatus for transmitting an image comprising:
  • a memory for storing processor executable instructions
  • processor is configured to:
  • the screen shot picture and the direction information are transmitted to the computer by the IP layer according to the received IP address.
  • an apparatus for transmitting an image comprising:
  • a memory for storing processor executable instructions
  • processor is configured to:
  • the screen shot image is displayed according to the direction information.
  • the screenshot image is transmitted through the IP layer, which is not limited by the hardware of the physical layer, and both USB and wireless communication can be applied.
  • the IP address of the mobile terminal is stored in the computer, and the IP connection request can be sent to the mobile terminal without an addressing process, and the mobile terminal can obtain the IP address of the computer by receiving the IP connection request at one time, which simplifies the IP connection process.
  • the direction information of the screen capture image is also transmitted, so that the receiving end can better display the screen capture image according to the direction information, thereby improving the display effect.
  • FIG. 1 is a schematic diagram of displaying a screenshot picture according to an exemplary embodiment.
  • FIG. 2 is a schematic diagram of displaying a screen shot according to an exemplary embodiment.
  • FIG. 3 is a schematic diagram of displaying a screen shot according to an exemplary embodiment.
  • FIG. 4 is a flowchart of a method of transmitting an image, according to an exemplary embodiment.
  • FIG. 5 is a schematic diagram showing a direction of a mobile terminal according to an exemplary embodiment.
  • FIG. 6 is a schematic diagram showing a direction of a mobile terminal according to an exemplary embodiment.
  • FIG. 7 is a flow chart showing a method of a connection process according to an exemplary embodiment.
  • FIG. 8 is a flowchart of a method of transmitting an image, according to an exemplary embodiment.
  • FIG. 9 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • FIG. 10 is a schematic diagram showing a screen shot displayed according to an exemplary embodiment.
  • FIG. 11 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • FIG. 11 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • FIG. 12 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • FIG. 13 is a block diagram of an acquisition module, according to an exemplary embodiment.
  • FIG. 14 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • FIG. 15 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • FIG. 16 is a block diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • Figure 17 is a block diagram of an apparatus, in accordance with an exemplary embodiment.
  • FIG. 18 is a block diagram of an apparatus, according to an exemplary embodiment.
  • the mobile terminal can automatically adjust the screen display mode according to its own direction, such as horizontal screen display or vertical screen display.
  • the screen capture picture when the mobile terminal is displayed in the horizontal screen is shown in FIG. 1
  • the screen capture picture when the vertical screen is displayed is shown in FIG. 2 .
  • the aspect ratio of the screen shot display is different from that of the vertical screen display.
  • the display window of most computers is a 16:9 aspect ratio. If the computer receives the screenshot picture shown in FIG. 1 and FIG. 2, when displayed in the 16:9 display window, the screen display effect of the horizontal screen is substantially the same as that of FIG. 1; the screen display effect of the vertical screen is displayed. See Figure 3. As can be seen from FIG.
  • the mobile terminal in addition to transmitting the screen capture picture, the mobile terminal also transmits the direction information of the screen capture picture, increases the amount of information transmitted, and provides reference information for the computer side display.
  • the computer can display the screen capture image according to the direction information adaptability, and improve the display effect.
  • FIG. 4 is a flowchart of a method for transmitting an image according to an exemplary embodiment. As shown in FIG. 4, the method may be implemented by a mobile terminal, including the following steps:
  • step 401 an IP connection request sent by the computer is received.
  • step 402 an IP address of the computer is obtained according to the received IP connection request.
  • step 403 direction information of the screen capture image and the screen capture image is obtained.
  • step 404 the screen capture picture and the direction information are transmitted to the computer according to the received IP address by the IP layer.
  • the mobile terminal acquires and transmits the screen capture picture, and also acquires and transmits the direction information of the screen capture picture.
  • the purpose is to provide direction information to the peer computer, so that the computer can better display the screen capture image according to the direction information, and solve the problem that the picture display effect caused by the horizontal or vertical screen of the mobile terminal is not good.
  • the mobile terminal can obtain the IP address of the computer by receiving the IP connection request at a time, realize the subsequent transmission of the screen capture picture, simplify the IP connection process, and improve the efficiency.
  • the mobile terminal and the computer can be connected or wirelessly connected through a USB (Universal Serial Bus), and the wireless connection includes: wifi (Wireless Fidelity) connection, Bluetooth connection, and NFC (Near Field Communication). Connection, etc.
  • the mobile terminal and the computer transmit and transmit information through the above-mentioned continuous transmission, and the connection transmissions are all connected to the physical layer, and the compatibility with each other is poor.
  • the IP layer communication is used in this embodiment, and the screen capture picture is transmitted through the IP layer, which is compatible with various physical connection modes.
  • the mobile terminal in this embodiment may be an electronic device such as a mobile phone or a tablet computer that can automatically rotate the screen.
  • the computer can be an electronic device such as a notebook computer, a desktop computer, and a desktop integrated computer that does not normally rotate the screen.
  • step 403 there are multiple implementation manners for obtaining the direction information of the screen capture image, such as mode A1 - mode A3.
  • the mobile terminal can mark the current screen orientation with a special status identifier and store the status identifier in a preset storage location.
  • the status identifier can be used as the direction information of the screen capture picture. Therefore, the direction information can be read from the storage location of the direction information of the locally stored screenshot image.
  • Mode A2 As shown in FIG. 1 , the aspect ratio of the screen shot image is 16:9, and the length is greater than the width. As shown in FIG. 2, the aspect ratio of the screenshot image in the vertical screen is 9:16, and the length is smaller than the width. Therefore, the screen capture image may be determined by the length of the screen capture image being greater than the width, and the screen capture image when the screen capture image is displayed in the horizontal screen is determined by the length of the screen capture image being less than the width. Therefore, the direction information of the screen shot image can be determined according to the aspect ratio of the screen shot image.
  • Mode A3 The mobile terminal can know that it rotates through the local direction sensor and automatically rotates the screen, so the mobile terminal can determine the current direction through the local direction sensor, and can determine the current direction according to the direction information provided by the direction sensor. Whether it is horizontal or vertical. Therefore, the direction information of the screen shot image can be determined according to the direction information determined by the local direction sensor. See, for example, Figures 5 and 6.
  • the direction of the mobile terminal is [0, 45], [125, 225] or [315, 360], it is a horizontal screen display, and the direction information of the screen capture picture is determined to indicate the direction information of the landscape screen; the direction of the mobile terminal is at (45, 125) or (225, 315) When the screen is displayed for the vertical screen, the direction information of the screen capture image is determined to indicate the direction information of the vertical screen.
  • the direction information in this embodiment includes direction information indicating a horizontal screen and direction information indicating a vertical screen, and may be various. Manifestations. For example, “0" is used as the direction information indicating the horizontal screen, and “1" is used as the direction information indicating the vertical screen.
  • step 403 the process of acquiring a screen capture image may have different implementation manners depending on the application scenario. Such as mode B1 and mode B2.
  • Mode B1 When the screen capture and transmission instructions are received, a screen capture process is performed to obtain a screen capture picture. After that, the obtained screenshot is sent. This method can be applied to the acquisition and transmission of one-time screen capture pictures.
  • Mode B2 Perform a screen capture operation on the local interface to obtain a screen capture image; store the obtained screen capture image in a frame buffer (Framebuffer); and obtain a screen capture image from the frame buffer.
  • This method can be applied to real-time dual-screen synchronization. After receiving the synchronization instruction, the screen capture processing is continuously performed; each time a screen capture image is obtained, the screen capture image is stored in the frame buffer; then the screen capture image is read from the frame buffer and transmitted, thereby alleviating the screen capture and sending The problem is not synchronized. And, each time a screenshot image is sent, the screen capture image can be deleted from the frame buffer to continue to store the new screen capture image.
  • the screen capture picture may be compressed to obtain a compressed screen capture picture; the compressed screen capture picture and the direction information are sent to the computer through the IP layer.
  • the mobile terminal receives the IP connection request, which is equivalent to establishing an IP connection, which simplifies the process of establishing an IP connection.
  • the embodiment may use a session protocol for transmission. Therefore, the IP connection request is an IP layer-based RTSP (Real Time Streaming Protocol) session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission.
  • RTSP Real Time Streaming Protocol
  • the mobile terminal is in the startup state of the RTSP service. Take the computer-initiated connection as an example, see Figure 7.
  • the computer obtains the IP address of the mobile terminal in advance, for example, obtains the IP address of the mobile terminal by means of a USB connection and a wifi scan.
  • step 701 the computer sends an RTSP session connection request to the mobile terminal according to the IP address of the mobile terminal, where the RTSP session connection request includes an IP address and a UDP port number of the computer, and the UDP port number is used for transmission of the screen capture picture.
  • step 702 the mobile terminal sends an RTSP session connection response to the computer.
  • the negotiation of various parameters through the RTSP session connection response and the computer is equivalent to merging the response process with the parameter negotiation process, which further simplifies the connection process.
  • step 703 the mobile terminal saves the IP address and UDP port number of the computer for subsequent transmission of the screen capture picture.
  • step 404 the screen capture picture and the direction information are sent to the computer of the IP address and the UDP port number through the RTSP session of the IP layer.
  • a network disconnection may occur.
  • the front is mainly to introduce the process of transmitting screenshots from the perspective of the mobile terminal.
  • the receiving end of the screenshot is a computer, and the process of transmitting the screenshot is introduced below from the perspective of the computer.
  • FIG. 8 is a flowchart of a method for transmitting an image according to an exemplary embodiment. As shown in FIG. 8, the method may be implemented by a computer, including the following steps:
  • step 801 an IP connection request is sent to the mobile terminal according to the IP address of the locally stored mobile terminal.
  • step 802 the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal is received through the IP layer.
  • step 803 the screen shot image is displayed according to the direction information.
  • the computer in addition to receiving the screen capture image, receives the direction information of the screen capture image, and increases the amount of information received. Moreover, the computer can better display the screen capture image according to the received direction information, thereby improving the display effect. In addition, the computer receives screenshots and orientation information through the IP layer, and is compatible with various physical connections, and is not limited by the physical connection form.
  • step 803 the screen capture image is displayed according to the direction information, and there may be multiple implementation manners, such as mode C1 and mode C2.
  • Mode C1 The display of the computer is usually a 16:9 display, so the display window is also generally 16:9. Such a display window is more suitable for displaying a screenshot of a horizontal screen shot. Therefore, when it is determined according to the direction information that the screen capture image is a horizontal screen capture image, the screen capture image can be directly displayed. According to the direction information, when the screen capture image is a vertical screen capture image, the screen capture image is enlarged according to the length of the display window.
  • Mode C2 The computer controls a scale and a size of a window for displaying the screenshot image according to the direction information, and displays the screen capture image through the window.
  • the scale and size of the display window are not fixed, and the adjustment is performed according to the situation of the screen capture picture. For example, when it is determined according to the direction information that the screen capture image is a horizontal screen capture image, the display window has a ratio of 16:9, and the size of the display window is adjusted according to the resolution of the screen capture image.
  • the display window has a ratio of 9:16, and the size of the display window is adjusted according to the resolution of the screen capture image.
  • the computer stores the IP address of the mobile terminal.
  • the computer is installed with an application of "Mobile Assistant", through which the IP address of the mobile terminal is obtained, and no addressing process is required.
  • the computer can send an IP connection request to the mobile terminal directly through the stored IP address.
  • the IP connection request is an IP layer-based RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission.
  • the connection process can be seen in the previous introduction and will not be described here.
  • the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal is received on the UDP port number through the RTSP session of the IP layer.
  • multiple links of the screen capture picture may have multiple implementation manners.
  • the implementation process is described in detail below through several embodiments.
  • FIG. 9 is a flowchart of a method for transmitting an image, as shown in FIG. 9 , according to an exemplary embodiment, including the following steps:
  • step 901 when the mobile terminal receives the screen capture and the transmission instruction, the screen capture process is performed to obtain a screen capture image.
  • step 902 the mobile terminal reads the direction information from the storage location of the direction information of the locally stored screenshot image.
  • step 903 the mobile terminal transmits the screen capture picture and the direction information to the computer through the IP layer.
  • step 904 the computer receives the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal through the IP layer.
  • the screen capture image is a horizontal screen capture image according to the direction information, proceeding to step 905; and determining that the screen capture image is a vertical screen capture image according to the direction information, proceeding to step 906.
  • step 905 the computer displays the screenshot image directly in the display window.
  • step 906 the computer displays the screen shot in an enlarged manner according to the length of the display window.
  • the screen capture picture transmitted by the mobile terminal is shown in FIG. 2, and the screen capture picture displayed after the computer is enlarged is shown in FIG.
  • the enlarged screenshot shows a clearer picture.
  • FIG. 11 is a flowchart of a method for transmitting an image, as shown in FIG. 11 , according to an exemplary embodiment, including the following steps:
  • step 1101 the mobile terminal performs a screen capture operation on the local interface to obtain a screen capture image.
  • step 1102 the mobile terminal stores the obtained screenshot picture to the frame buffer.
  • step 1103 the mobile terminal acquires a screen shot from the frame buffer.
  • step 1104 the mobile terminal determines direction information of the screen capture image according to the aspect ratio of the screen shot image.
  • step 1105 the computer receives the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal through the IP layer.
  • the screen capture image is a horizontal screen capture image according to the direction information
  • proceed to step 1105 if the screen capture image is a vertical screen capture image according to the direction information, proceed to step 1106.
  • step 1106 a display window suitable for horizontal display is selected, and a screenshot image is displayed in the display window. For example, select a 16:9 display window, and the size of the display window is adjusted according to the resolution of the screenshot.
  • a display window suitable for vertical screen display is selected, and a screen capture image is displayed in the display window. For example, select a 9:16 display window, and the size of the display window is adjusted according to the resolution of the screenshot.
  • the display effect of the screen capture image when the mobile terminal screen capture is substantially the same as the display effect on the computer, and the display effect is better, which is better than the display shown in FIG. effect.
  • FIG. 12 is a schematic diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • the apparatus includes: a receiving module 1201, an IP module 1202, an obtaining module 1203, and a sending module 1204.
  • the device is a mobile terminal.
  • the receiving module 1201 is configured to receive an IP connection request sent by the computer
  • the IP module 1202 is configured to obtain an IP address of the computer according to the received IP connection request.
  • the obtaining module 1203 is configured to obtain direction information of the screen capture image and the screen capture image.
  • the sending module 1204 is configured to send the screenshot picture and the direction information to a computer through an IP layer.
  • the obtaining module 1203 includes: a reading unit 12031 , a scaling unit 12032 , or a sensing unit 12033 .
  • the reading unit 12031 is configured to read out the direction information from a storage location of the direction information of the locally stored screenshot image.
  • the ratio unit 12032 is configured to determine direction information of the screen capture image according to the aspect ratio of the screen shot image.
  • the sensing unit 12033 is configured to determine direction information of the screenshot image according to the direction information determined by the local direction sensor.
  • the apparatus further includes: a compression module 1205, configured to compress the screen capture image to obtain a compressed screen capture image.
  • the sending module 1204 sends the compressed screenshot picture and the direction information to a computer through an IP layer.
  • the IP connection request is an IP layer-based real-time streaming protocol RTSP session connection request
  • the RTSP session connection request includes a UDP port number for screen capture picture transmission.
  • the sending module 1204 sends the screenshot picture and the direction information to a computer of the IP address and the UDP port number through an RTSP session of the IP layer.
  • the apparatus further includes: a screen capture module 1206 and a write module 1207.
  • the screen capture module 1206 is configured to perform a screen capture operation on the local interface to obtain a screen capture image.
  • the writing module 1207 is configured to store the obtained screenshot image into the frame buffer.
  • the obtaining module 1203 acquires a screen capture image from the frame buffer.
  • FIG. 16 is a schematic diagram of an apparatus for transmitting an image, according to an exemplary embodiment.
  • the apparatus includes: a transmitting module 1601, a receiving module 1602, and a display module 1603.
  • the device is a computer.
  • the sending module 1601 is configured to send an IP connection request to the mobile terminal according to the IP address of the locally stored mobile terminal.
  • the receiving module 1602 is configured to receive, by using an IP layer, direction information of the screen capture picture and the screen capture picture sent by the mobile terminal.
  • the display module 1603 is configured to display the screenshot picture according to the direction information.
  • the display module 1603 controls a scale and a size of a window for displaying the screenshot image according to the direction information, and displays the screen capture image through the window.
  • the IP connection request is an IP layer-based real-time streaming protocol RTSP session connection request
  • the RTSP session connection request includes a UDP port number used for screen capture picture transmission
  • the sending module sends the screenshot picture and the direction information to a computer of the IP address and the UDP port number through an RTSP session of the IP layer.
  • FIG. 17 is a block diagram of an apparatus 1700 for transmitting an image, according to an exemplary embodiment.
  • device 1700 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
  • apparatus 1700 can include one or more of the following components: processing component 1702, memory 1704, power component 1706, multimedia component 1708, audio component 1710, input/output (I/O) interface 1712, sensor component 1714, And a communication component 1716.
  • Processing component 1702 typically controls the overall operation of device 1700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • Processing component 1702 can include one or more processors 1720 to execute instructions to perform all or part of the steps of the above described methods.
  • processing component 1702 can include one or more modules to facilitate interaction between component 1702 and other components.
  • processing component 1702 can include a multimedia module to facilitate interaction between multimedia component 1708 and processing component 1702.
  • Memory 1704 is configured to store various types of data to support operation at device 1700. Examples of such data include instructions for any application or method operating on device 1700, contact data, phone book data, messages, pictures, videos, and the like. Memory 1704 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Disk or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • Power component 1706 provides power to various components of device 1700.
  • Power component 1706 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 1700.
  • Multimedia component 1708 includes a screen between the device 1700 and a user that provides an output interface.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may sense not only the boundary of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the multimedia component 1708 includes a front camera and/or a rear camera. When the device 1700 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 1710 is configured to output and/or input an audio signal.
  • the audio component 1710 includes a microphone (MIC) that is configured to receive an external audio signal when the device 1700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 1704 or transmitted via communication component 1716.
  • the audio component 1710 also includes a speaker for outputting an audio signal.
  • the I/O interface 1712 provides an interface between the processing component 1702 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • Sensor assembly 1714 includes one or more sensors for providing device 1700 with a status assessment of various aspects.
  • sensor assembly 1714 can detect an open/closed state of device 1700, relative positioning of components, such as the display and keypad of device 1700, and sensor component 1714 can also detect the location of one component of device 1700 or device 1700. Changes, the presence or absence of user contact with device 1700, device 1700 orientation or acceleration/deceleration and temperature change of device 1700.
  • Sensor assembly 1714 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 1714 can also include a light sensor, such as CMOS or CCD image sensor for use in imaging applications.
  • the sensor component 1714 can also include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 1716 is configured to facilitate wired or wireless communication between device 1700 and other devices.
  • the device 1700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component 1716 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 1716 also includes a near field communication (NFC) module to facilitate short range communication.
  • NFC near field communication
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • apparatus 1700 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • non-transitory computer readable storage medium comprising instructions, such as a memory 1704 comprising instructions executable by processor 1720 of apparatus 1700 to perform the above method.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • a device for transmitting images comprising:
  • a memory for storing processor executable instructions
  • processor is configured to:
  • the screen shot picture and the direction information are transmitted to the computer by the IP layer according to the received IP address.
  • the processor can also be configured to:
  • the obtaining direction information of the screen capture image includes:
  • the direction information of the screen capture image is determined according to the direction information determined by the local direction sensor.
  • the processor can also be configured to:
  • the method further includes: compressing the screen capture image to obtain a compressed screen capture image
  • Transmitting the screen shot image and the direction information to a computer by using an IP layer including transmitting, by using an IP layer, the compressed screen capture image and the direction information to a computer.
  • the processor can also be configured to:
  • the IP connection request is an IP layer-based real-time streaming protocol RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • Transmitting, by the IP layer, the screen capture picture and the direction information to the computer according to the received IP address including: sending, by using an RTSP session of an IP layer, to a computer of the IP address and a UDP port number The screen shot picture and the direction information.
  • a non-transitory computer readable storage medium when instructions in the storage medium are executed by a processor of a mobile terminal, to enable the mobile terminal to perform a method of transmitting an image, the method comprising:
  • the screen shot picture and the direction information are transmitted to the computer by the IP layer according to the received IP address.
  • the instructions in the storage medium may further include:
  • the obtaining direction information of the screen capture image includes:
  • the direction information of the screen capture image is determined according to the direction information determined by the local direction sensor.
  • the instructions in the storage medium may further include:
  • the method further includes: compressing the screen capture image to obtain a compressed screen capture image
  • Transmitting the screen shot image and the direction information to a computer by using an IP layer including transmitting, by using an IP layer, the compressed screen capture image and the direction information to a computer.
  • the instructions in the storage medium may further include:
  • the IP connection request is an IP layer-based real-time streaming protocol RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • Transmitting, by the IP layer, the screen capture picture and the direction information to the computer according to the received IP address including: sending, by using an RTSP session of an IP layer, to a computer of the IP address and a UDP port number The screen shot picture and the direction information.
  • FIG. 18 is a block diagram of an apparatus 1800 for transmitting images, according to an exemplary embodiment.
  • device 1800 can be provided as a computer.
  • apparatus 1800 includes a processing component 1822 that further includes one or more processors, and memory resources represented by memory 1832 for storing instructions executable by processing component 1822, such as an application.
  • An application stored in memory 1832 can include one or more modules each corresponding to a set of instructions.
  • processing component 1822 is configured to execute instructions to perform the method described above to transfer images.
  • Apparatus 1800 can also include a power supply component 1826 configured to perform power management of apparatus 1800, a wired or wireless network interface 1850 configured to connect apparatus 1800 to the network, and an input/output (I/O) connection Mouth 1858.
  • the device 1800 can operate based on an operating system stored in the memory 1832, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
  • a device for transmitting images comprising:
  • a memory for storing processor executable instructions
  • processor is configured to:
  • the screen shot image is displayed according to the direction information.
  • the processor can also be configured to:
  • the displaying the screen capture image according to the direction information includes: controlling a scale and a size of a window for displaying the screen capture image according to the direction information, and displaying the screen capture image by using the window.
  • the processor can also be configured to:
  • the IP connection request is an IP layer-based RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • Receiving, by the IP layer, the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal including: receiving, by using an RTSP session of the IP layer, the screen capture picture and the screen capture picture sent by the mobile terminal on the UDP port number Direction information.
  • a non-transitory computer readable storage medium when instructions in the storage medium are executed by a processor of a mobile terminal, to enable the mobile terminal to perform a method of transmitting an image, the method comprising:
  • the screen shot image is displayed according to the direction information.
  • the instructions in the storage medium may further include:
  • the displaying the screen capture image according to the direction information includes: controlling a scale and a size of a window for displaying the screen capture image according to the direction information, and displaying the screen capture image by using the window.
  • the instructions in the storage medium may further include:
  • the IP connection request is an IP layer-based RTSP session connection request, and the RTSP session connection request includes a UDP port number for screen capture picture transmission;
  • Receiving, by the IP layer, the direction information of the screen capture picture and the screen capture picture sent by the mobile terminal including: receiving, by using an RTSP session of the IP layer, the screen capture picture and the screen capture picture sent by the mobile terminal on the UDP port number Direction information.

Abstract

本公开是关于一种传输图像的方法及装置,用于改进图像的传输方式,以提高图像的显示效果。所述方法包括:接收计算机发送的IP连接请求;根据收到的所述IP连接请求获得所述计算机的IP地址;获取截屏图片及截屏图片的方向信息;通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。所述装置包括:接收模块、IP模块、获取模块和发送单元。本实施例通过IP层传输截屏图片,不受传输层的硬件限制,USB和无线通信均可适用。本实施例除了传输截屏图片,还传输截屏图片的方向信息,为了使接收端可以根据方向信息更好的显示截屏图片,提高显示效果。

Description

传输图像的方法及装置
本申请基于申请号为2014102035700、申请日为2014年05月14日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本公开涉及通信及计算机处理领域,尤其涉及传输图像的方法及装置。
背景技术
随着电子技术的发展,越来越多的终端设备为人们提供着各种服务,如娱乐服务、信息搜索服务和互动服务等。终端设备有手机、计算机和电视等。相关技术中,可以实现手机与计算机、手机与电视、计算机与电视的连接和通信。
本公开的发明人发现,相关技术中,由于手机自带屏幕自动旋转功能,所以手机上图片可以横屏显示也可以竖屏显示。对于同一个图片,横屏显示与竖屏显示的比例不同,所以当将手机上的图片传输到计算机上时,在计算机上的显示效果不理想,亟待解决这个问题。
发明内容
为克服相关技术中存在的问题,本公开提供一种传输图像的方法及装置。
根据本公开实施例的第一方面,提供一种传输图像的方法,包括:
接收计算机发送的IP连接请求;
根据收到的所述IP连接请求获得所述计算机的IP地址;
获取截屏图片及截屏图片的方向信息;
通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
所述获取截屏图片的方向信息,包括:
从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息;或者
根据所述截屏图片的长宽比确定截屏图片的方向信息;或者
根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
所述方法还包括:对所述截屏图片进行压缩,获得压缩后的截屏图片;
所述通过IP层将所述截屏图片和所述方向信息发送给计算机,包括通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机,包括:通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
根据本公开实施例的第二方面,提供一种传输图像的方法,包括:
根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
根据所述方向信息显示所述截屏图片。
所述根据所述方向信息显示所述截屏图片,包括:根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息,包括:通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
根据本公开实施例的第三方面,提供一种传输图像的装置,包括:
接收模块,用于接收计算机发送的IP连接请求;
IP模块,用于根据收到的所述IP连接请求获得所述计算机的IP地址;
获取模块,用于获取截屏图片及截屏图片的方向信息;
发送模块,用于通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
所述获取模块包括:
读取单元,用于从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息;或者
比例单元,用于根据所述截屏图片的长宽比确定截屏图片的方向信息;或者
感应单元,用于根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
所述装置还包括:压缩单元,用于对所述截屏图片进行压缩,获得压缩后的截屏图片;
所述发送模块通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述发送模块通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
根据本公开实施例的第四方面,提供一种传输图像的装置,包括:
发送模块,用于根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
接收模块,用于通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
显示模块,用于根据所述方向信息显示所述截屏图片。
所述显示模块根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述接收模块通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
根据本公开实施例的第五方面,提供一种传输图像的装置,包括:
处理器;
用于存储处理器可执行指令的存储器;
其中,所述处理器被配置为:
接收计算机发送的IP连接请求;
根据收到的所述IP连接请求获得所述计算机的IP地址;
获取截屏图片及截屏图片的方向信息;
通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
根据本公开实施例的第六方面,提供一种传输图像的装置,包括:
处理器;
用于存储处理器可执行指令的存储器;
其中,所述处理器被配置为:
根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
根据所述方向信息显示所述截屏图片。
本公开的实施例提供的技术方案可以包括以下有益效果:
本实施例通过IP层传输截屏图片,不受物理层的硬件限制,USB和无线通信均可适用。并且,计算机中存有移动终端的IP地址,不需要寻址过程便可向移动终端发送IP连接请求,移动终端通过一次接收IP连接请求便可获得计算机的IP地址,简化了IP连接过程。另外,本实施例除了传输截屏图片,还传输截屏图片的方向信息,为了使接收端可以根据方向信息更好的显示截屏图片,提高显示效果。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并与说明书一起用于解释本发明的原理。
图1是根据一示例性实施例示出的一种显示截屏图片的示意图。
图2是根据一示例性实施例示出的一种显示截屏图片的示意图。
图3是根据一示例性实施例示出的一种显示截屏图片的示意图。
图4是根据一示例性实施例示出的一种传输图像的方法的流程图。
图5是根据一示例性实施例示出的一种移动终端方向的示意图。
图6是根据一示例性实施例示出的一种移动终端方向的示意图。
图7是根据一示例性实施例示出的一种连接过程的方法的流程图。
图8是根据一示例性实施例示出的一种传输图像的方法的流程图。
图9是根据一示例性实施例示出的一种传输图像的装置的框图。
图10是根据一示例性实施例示出的一种显示截屏图片的示意图。
图11是根据一示例性实施例示出的一种传输图像的装置的框图。
图11是根据一示例性实施例示出的一种传输图像的装置的框图。
图12是根据一示例性实施例示出的一种传输图像的装置的框图。
图13是根据一示例性实施例示出的一种获取模块的框图。
图14是根据一示例性实施例示出的一种传输图像的装置的框图。
图15是根据一示例性实施例示出的一种传输图像的装置的框图。
图16是根据一示例性实施例示出的一种传输图像的装置的框图。
图17是根据一示例性实施例示出的一种装置的框图。
图18是根据一示例性实施例示出的一种装置的框图。
具体实施方式
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本发明的一些方面相一致的装置和方法的例子。
移动终端可以根据自身方向自动调整屏幕显示方式,如横屏显示或竖屏显示。例如,移动终端横屏显示时的截屏图片为图1所示,竖屏显示时的截屏图片为图2所示。通过图1和图2可知,横屏显示与竖屏显示时截屏图片的长宽比不同。然而,大多数的计算机的显示窗口是16:9的显示比例。若计算机收到图1和图2所示的截屏图片,在16:9的显示窗口中显示时,横屏时的截屏图片的显示效果与图1基本相同;竖屏时的截屏图片的显示效果参见图3所示。通过图3可知,截屏图片被明显缩小,清晰度较差。若希望清楚显示,还需要进行放大处理。本公开实施例中,移动终端除了传输截屏图片,还传输截屏图片的方向信息,增加了传输的信息量,为计算机侧的显示提供了参考信息。计算机可根据方向信息适应性显示截屏图片,提高显示效果。
图4是根据一示例性实施例示出的一种传输图像的方法的流程图,如图4所示,该方法可以由移动终端实现,包括以下步骤:
在步骤401中,接收计算机发送的IP连接请求。
在步骤402中,根据收到的所述IP连接请求获得所述计算机的IP地址。
在步骤403中,获取截屏图片及截屏图片的方向信息。
在步骤404中,通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
本实施例中移动终端除了获取和传输截屏图片,还获取和传输截屏图片的方向信息。目的是将方向信息提供给对端的计算机,以便计算机根据方向信息更好的显示截屏图片,解决因移动终端的横屏或竖屏所导致的图片显示效果不佳的问题。并且,移动终端通过一次接收IP连接请求便可获得计算机的IP地址,实现后续的截屏图片的传输,简化了IP连接过程,提高了效率。
移动终端与计算机可以通过USB(Universal Serial Bus,通用串行总线)连接或无线连接,无线连接包括:wifi(Wireless Fidelity,无线保真)连接、蓝牙连接和NFC(Near Field Communication,近场通信)连接等。相关技术中移动终端与计算机通过上述连续发送传输信息,上述连接发送均属于物理层连接,彼此兼容性较差。为了使截屏图片的传输适用于各种连接方式,本实施例中采用IP层通信,通过IP层传输截屏图片,可兼容各种物理连接方式。
本实施例中的移动终端可以是手机、平板计算机等可以自动旋转屏幕的电子设备。计算机可以是笔记本电脑、台式计算机和台式一体机等一般不自动旋转屏幕的电子设备。
在步骤403中,获取截屏图片的方向信息有多种实现方式,如方式A1-方式A3。
方式A1:移动终端可以用一个专门的状态标识来标记当前的屏幕方向,并将该状态标识存储在预设的存储位置。本实施例中可以将该状态标识作为截屏图片的方向信息。所以可以从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息。
方式A2:如图1所示,横屏时截屏图片的长宽比是16:9,长度大于宽度。如图2所示,竖屏时截屏图片的长宽比是9:16,长度小于宽度。因此,可以通过截屏图片的长度大于宽度来确定截屏图片为横屏显示时的截屏图片,以及通过截屏图片的长度小于宽度来确定截屏图片为竖屏显示时的截屏图片。所以,可以根据所述截屏图片的长宽比确定截屏图片的方向信息。
方式A3:移动终端通过本地的方向感应器可获知自身发生旋转,并自动进行屏幕旋转,所以移动终端可通过本地的方向感应器确定当前的方向,并可根据方向感应器提供的方向信息确定当前是横屏还是竖屏。因此,可以根据本地方向感应器确定的方向信息确定截屏图片的方向信息。例如,参见图5和图6所示。移动终端的方向在[0,45]、[125,225]或[315,360]时,为横屏显示,确定截屏图片的方向信息为表示横屏的方向信息;移动终端的方向在(45,125)或(225,315)时,为竖屏显示,确定截屏图片的方向信息为表示竖屏的方向信息。
本实施例中的方向信息包括表示横屏的方向信息和表示竖屏的方向信息,可以有多种 表现形式。例如,用“0”作为表示横屏的方向信息,用“1”作为表示竖屏的方向信息。
在步骤403中,获取截屏图片的过程可以因应用场景不同而有不同的实现方式。如方式B1和方式B2。
方式B1:收到截屏和传输指令时,进行截屏处理,获得截屏图片。之后,发送获得的截屏图片。该方式可以适用于一次性的截屏图片的获取和传输。
方式B2:对本地的界面进行截屏操作,获得截屏图片;将获得的截屏图片存储到帧缓存器(Framebuffer);从帧缓存器中获取截屏图片。该方式可以适用于实时的双屏同步。在收到同步指令后,连续进行截屏处理;每获得一张截屏图片,便将该截屏图片存储到帧缓存器;然后从帧缓存器中读取截屏图片并进行发送,这样可缓解截屏和发送不同步的问题。以及,每发送一张截屏图片,可将该截屏图片从帧缓存器中删除,以便继续存储新的截屏图片。
为了提高传输效率,可以对所述截屏图片进行压缩,获得压缩后的截屏图片;通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
在步骤401中,移动终端通过接收IP连接请求,相当于建立了IP连接,简化了建立IP连接的过程。为了便于截屏图片的传输,本实施例可采用会话协议进行传输。因此,所述IP连接请求为基于IP层的RTSP(Real Time Streaming Protocol,实时流传输协议)会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号。下面针对RTSP会话连接过程进行介绍。
移动终端处于RTSP服务的启动状态。以计算机发起连接为例,参见图7所示。计算机预先获得有移动终端的IP地址,例如通过USB连接和wifi扫描等方式获得移动终端的IP地址。
在步骤701中,计算机根据移动终端的IP地址向移动终端发送RTSP会话连接请求,其中RTSP会话连接请求包含计算机的IP地址和UDP端口号,UDP端口号用于截屏图片的传输。
在步骤702中,移动终端向计算机发送RTSP会话连接响应。通过RTSP会话连接响应与计算机进行各种参数的协商,相当于将响应过程与参数协商过程合并,进一步简化了连接过程。
在步骤703中,移动终端保存计算机的IP地址和UDP端口号,以便后续进行截屏图片的传输。
有了图7所示的连接过程后,在步骤404中,通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
移动终端与计算机建立连接后,可能会发生网络断开。网络断开可能有两种情况。情况1:异常断开;其原因可能有移动终端故障或计算机故障等。情况2:正常断开;例如移动终端向计算机发送断开消息或暂停消息,计算机收到断开消息或暂停消息后,进行断开网络的处理。
前面主要是以移动终端的角度介绍了传输截屏图片的过程,截屏图片的接收端为计算机,下面以计算机的角度介绍传输截屏图片的过程。
图8是根据一示例性实施例示出的一种传输图像的方法的流程图,如图8所示,该方法可以由计算机实现,包括以下步骤:
在步骤801中,根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求。
在步骤802中,通过IP层接收移动终端发送的截屏图片和截屏图片的方向信息。
在步骤803中,根据所述方向信息显示所述截屏图片。
本实施例中计算机除了接收截屏图片以外,还接收了截屏图片的方向信息,增加了接收的信息量。并且,计算机可以根据收到的方向信息更好的显示截屏图片,提高显示效果。另外,计算机通过IP层接收截屏图片和方向信息,兼容各种物理连接,不受物理连接形式的限制。
在步骤803中,根据所述方向信息显示所述截屏图片,可以有多种实现方式,如方式C1和方式C2。
方式C1:计算机的显示屏一般为16:9的显示屏,因此显示窗口一般也为16:9。这样的显示窗口较适合显示横屏截图时的截屏图片。因此根据方向信息确定截屏图片是横向的截屏图片时,可直接显示截屏图片。根据方向信息确定截屏图片是竖向的截屏图片时,按照显示窗口的长度对截屏图片进行放大显示。
方式C2:计算机根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。方式C2中,显示窗口的比例和尺寸不固定,根据截屏图片的情况进行调整。例如,根据方向信息确定截屏图片是横向的截屏图片时,显示窗口为16:9的比例,显示窗口的尺寸按照截屏图片的分辨率调整。根据方向信息确定截屏图片是竖向的截屏图片时,显示窗口为9:16的比例,显示窗口的尺寸按照截屏图片的分辨率调整。
在步骤801中,计算机存有移动终端的IP地址。例如,计算机安装有“手机助手”的应用,通过该应用获得移动终端的IP地址,不需要寻址过程。计算机可直接通过存储的IP地址向移动终端发送IP连接请求。并且为了便于截屏图片的传输,所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号。连接过程可参见前面的介绍,此处不再赘述。则,在步骤802中,通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
通过以上介绍可知,传输截屏图片的多个环节都可能有多种实现方式,下面通过几个实施例来详细介绍实现过程。
图9是根据一示例性实施例示出的一种传输图像的方法的流程图,如图9所示,包括以下步骤:
在步骤901中,移动终端收到截屏和传输指令时,进行截屏处理,获得截屏图片。
在步骤902中,移动终端从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息。
在步骤903中,移动终端通过IP层将截屏图片和方向信息发送给计算机。
在步骤904中,计算机通过IP层接收移动终端发送的截屏图片和截屏图片的方向信息。根据方向信息确定截屏图片是横向的截屏图片时,继续步骤905;根据方向信息确定截屏图片是竖向的截屏图片时,继续步骤906。
在步骤905中,计算机直接在显示窗口中显示截屏图片。
在步骤906中,计算机按照显示窗口的长度对截屏图片进行放大显示。
例如,移动终端传输的截屏图片参见图2所示,计算机放大后显示的截屏图片参见图10所示。放大后的截屏图片显示较清晰。
图11是根据一示例性实施例示出的一种传输图像的方法的流程图,如图11所示,包括以下步骤:
在步骤1101中,移动终端对本地的界面进行截屏操作,获得截屏图片。
在步骤1102中,移动终端将获得的截屏图片存储到帧缓存器。
在步骤1103中,移动终端从帧缓存器中获取截屏图片。
在步骤1104中,移动终端根据所述截屏图片的长宽比确定截屏图片的方向信息。
在步骤1105中,计算机通过IP层接收移动终端发送的截屏图片和截屏图片的方向信息。根据方向信息确定截屏图片是横向的截屏图片时,继续步骤1105;根据方向信息确定截屏图片是竖向的截屏图片时,继续步骤1106。
在步骤1106中,选择适合于横屏显示的显示窗口,并在显示窗口中显示截屏图片。例如,选择16:9的显示窗口,显示窗口的尺寸按照截屏图片的分辨率调整。
在步骤1107中,选择适合于竖屏显示的显示窗口,并在显示窗口中显示截屏图片。例如,选择9:16的显示窗口,显示窗口的尺寸按照截屏图片的分辨率调整。
本实施例中通过调整显示窗口的比例,使其适应截屏图片,所以移动终端截屏时的截屏图片的显示效果与计算机上的显示效果基本一致,显示效果较好,优于图3所示的显示效果。
通过以上介绍了解了传输截屏图片的实现过程,该过程由移动终端和计算机实现,下面分别针对两个设备的内部结构和功能进行介绍。
图12是根据一示例性实施例示出的一种传输图像的装置示意图。参照图12,该装置包括:接收模块1201、IP模块1202、获取模块1203和发送模块1204。例如,所述装置为移动终端。
接收模块1201,用于接收计算机发送的IP连接请求;
IP模块1202,用于根据收到的所述IP连接请求获得所述计算机的IP地址;
获取模块1203用于获取截屏图片及截屏图片的方向信息。
发送模块1204用于通过IP层将所述截屏图片和所述方向信息发送给计算机。
可选的,参见图13所示,所述获取模块1203包括:读取单元12031、比例单元12032或感应单元12033。
读取单元12031用于从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息。
比例单元12032用于根据所述截屏图片的长宽比确定截屏图片的方向信息。
感应单元12033用于根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
可选的,参见图14所示,所述装置还包括:压缩模块1205用于对所述截屏图片进行压缩,获得压缩后的截屏图片。所述发送模块1204通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
可选的,所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号。所述发送模块1204通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
可选的,参见图15所示,所述装置还包括:截屏模块1206和写模块1207。截屏模块1206,用于对本地的界面进行截屏操作,获得截屏图片。写模块1207,用于将获得的截屏图片存储到帧缓存器。所述获取模块1203从帧缓存器中获取截屏图片。
图16是根据一示例性实施例示出的一种传输图像的装置示意图。参照图17,该装置包括:发送模块1601、接收模块1602和显示模块1603。例如,所述装置为计算机。
发送模块1601,用于根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求。
接收模块1602,用于通过IP层接收移动终端发送的截屏图片和截屏图片的方向信息。
显示模块1603,用于根据所述方向信息显示所述截屏图片。
可选的,所述显示模块1603根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
可选的,所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述发送模块通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。
图17是根据一示例性实施例示出的一种用于传输图像的装置1700的框图。例如,装置1700可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理等。
参照图17,装置1700可以包括以下一个或多个组件:处理组件1702,存储器1704,电源组件1706,多媒体组件1708,音频组件1710,输入/输出(I/O)的接口1712,传感器组件1714,以及通信组件1716。
处理组件1702通常控制装置1700的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件1702可以包括一个或多个处理器1720来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件1702可以包括一个或多个模块,便于处理组件1702和其他组件之间的交互。例如,处理部件1702可以包括多媒体模块,以方便多媒体组件1708和处理组件1702之间的交互。
存储器1704被配置为存储各种类型的数据以支持在设备1700的操作。这些数据的示例包括用于在装置1700上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器1704可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
电力组件1706为装置1700的各种组件提供电力。电力组件1706可以包括电源管理系统,一个或多个电源,及其他与为装置1700生成、管理和分配电力相关联的组件。
多媒体组件1708包括在所述装置1700和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件1708包括一个前置摄像头和/或后置摄像头。当设备1700处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件1710被配置为输出和/或输入音频信号。例如,音频组件1710包括一个麦克风(MIC),当装置1700处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1704或经由通信组件1716发送。在一些实施例中,音频组件1710还包括一个扬声器,用于输出音频信号。
I/O接口1712为处理组件1702和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件1714包括一个或多个传感器,用于为装置1700提供各个方面的状态评估。例如,传感器组件1714可以检测到设备1700的打开/关闭状态,组件的相对定位,例如所述组件为装置1700的显示器和小键盘,传感器组件1714还可以检测装置1700或装置1700的一个组件的位置改变,用户与装置1700接触的存在或不存在,装置1700方位或加速/减速和装置1700的温度变化。传感器组件1714可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1714还可以包括光传感器,如 CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件1714还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。
通信组件1716被配置为便于装置1700和其他设备之间有线或无线方式的通信。装置1700可以接入基于通信标准的无线网络,如WiFi,2G或3G,或它们的组合。在一个示例性实施例中,通信部件1716经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信部件1716还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。
在示例性实施例中,装置1700可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器1704,上述指令可由装置1700的处理器1720执行以完成上述方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
一种传输图像的装置,包括:
处理器;
用于存储处理器可执行指令的存储器;
其中,所述处理器被配置为:
接收计算机发送的IP连接请求;
根据收到的所述IP连接请求获得所述计算机的IP地址;
获取截屏图片及截屏图片的方向信息;
通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
所述处理器还可以被配置为:
所述获取截屏图片的方向信息,包括:
从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息;或者
根据所述截屏图片的长宽比确定截屏图片的方向信息;或者
根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
所述处理器还可以被配置为:
所述方法还包括:对所述截屏图片进行压缩,获得压缩后的截屏图片;
所述通过IP层将所述截屏图片和所述方向信息发送给计算机,包括通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
所述处理器还可以被配置为:
所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机,包括:通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
一种非临时性计算机可读存储介质,当所述存储介质中的指令由移动终端的处理器执行时,使得移动终端能够执行一种传输图像的方法,所述方法包括:
接收计算机发送的IP连接请求;
根据收到的所述IP连接请求获得所述计算机的IP地址;
获取截屏图片及截屏图片的方向信息;
通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
所述存储介质中的指令还可以包括:
所述获取截屏图片的方向信息,包括:
从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息;或者
根据所述截屏图片的长宽比确定截屏图片的方向信息;或者
根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
所述存储介质中的指令还可以包括:
所述方法还包括:对所述截屏图片进行压缩,获得压缩后的截屏图片;
所述通过IP层将所述截屏图片和所述方向信息发送给计算机,包括通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
所述存储介质中的指令还可以包括:
所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机,包括:通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
图18是根据一示例性实施例示出的一种用于传输图像的装置1800的框图。例如,装置1800可以被提供为一计算机。参照图18,装置1800包括处理组件1822,其进一步包括一个或多个处理器,以及由存储器1832所代表的存储器资源,用于存储可由处理部件1822的执行的指令,例如应用程序。存储器1832中存储的应用程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外,处理组件1822被配置为执行指令,以执行上述方法传输图像。
装置1800还可以包括一个电源组件1826被配置为执行装置1800的电源管理,一个有线或无线网络接口1850被配置为将装置1800连接到网络,和一个输入输出(I/O)接 口1858。装置1800可以操作基于存储在存储器1832的操作系统,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM,FreeBSDTM或类似。
一种传输图像的装置,包括:
处理器;
用于存储处理器可执行指令的存储器;
其中,所述处理器被配置为:
根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
根据所述方向信息显示所述截屏图片。
所述处理器还可以被配置为:
所述根据所述方向信息显示所述截屏图片,包括:根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
所述处理器还可以被配置为:
所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息,包括:通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
一种非临时性计算机可读存储介质,当所述存储介质中的指令由移动终端的处理器执行时,使得移动终端能够执行一种传输图像的方法,所述方法包括:
根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
根据所述方向信息显示所述截屏图片。
所述存储介质中的指令还可以包括:
所述根据所述方向信息显示所述截屏图片,包括:根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
所述存储介质中的指令还可以包括:
所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
所述通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息,包括:通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本发明的其它实施方案。本申请旨在涵盖本发明的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本公开未公开的本技术领域中的公知常识或 惯用技术手段。说明书和实施例仅被视为示例性的,本发明的真正范围和精神由下面的权利要求指出。
应当理解的是,本发明并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本发明的范围仅由所附的权利要求来限制。

Claims (16)

  1. 一种传输图像的方法,其特征在于,包括:
    接收计算机发送的IP连接请求;
    根据收到的所述IP连接请求获得所述计算机的IP地址;
    获取截屏图片及截屏图片的方向信息;
    通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
  2. 根据权利要求1所述的传输图像的方法,其特征在于,所述获取截屏图片的方向信息,包括:
    从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息;或者,
    根据所述截屏图片的长宽比确定截屏图片的方向信息;或者,
    根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
  3. 根据权利要求1所述的传输图像的方法,其特征在于,所述方法还包括:对所述截屏图片进行压缩,获得压缩后的截屏图片;
    所述通过IP层将所述截屏图片和所述方向信息发送给计算机,包括通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
  4. 根据权利要求1所述的传输图像的方法,其特征在于,所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
    所述通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机,包括:通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
  5. 一种传输图像的方法,其特征在于,包括:
    根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
    通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
    根据所述方向信息显示所述截屏图片。
  6. 根据权利要求5所述的传输图像的方法,其特征在于,所述根据所述方向信息显示所述截屏图片,包括:根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
  7. 根据权利要求5所述的传输图像的方法,其特征在于,所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
    所述通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息,包括:通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
  8. 一种传输图像的装置,其特征在于,包括:
    接收模块,用于接收计算机发送的IP连接请求;
    IP模块,用于根据收到的所述IP连接请求获得所述计算机的IP地址;
    获取模块,用于获取截屏图片及截屏图片的方向信息;
    发送模块,用于通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
  9. 根据权利要求8所述的传输图像的装置,其特征在于,所述获取模块包括:
    读取单元,用于从本地预设的存储截屏图片的方向信息的存储位置读取出方向信息;或者
    比例单元,用于根据所述截屏图片的长宽比确定截屏图片的方向信息;或者
    感应单元,用于根据本地方向感应器确定的方向信息确定截屏图片的方向信息。
  10. 根据权利要求8所述的传输图像的装置,其特征在于,所述装置还包括:压缩单元,用于对所述截屏图片进行压缩,获得压缩后的截屏图片;
    所述发送模块通过IP层将所述压缩后的截屏图片和所述方向信息发送给计算机。
  11. 根据权利要求8所述的传输图像的装置,其特征在于,所述IP连接请求为基于IP层的实时流传输协议RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
    所述发送模块通过IP层的RTSP会话,向所述IP地址和UDP端口号的计算机发送所述截屏图片和所述方向信息。
  12. 一种传输图像的装置,其特征在于,包括:
    发送模块,用于根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
    接收模块,用于通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
    显示模块,用于根据所述方向信息显示所述截屏图片。
  13. 根据权利要求12所述的传输图像的装置,其特征在于,所述显示模块根据所述方向信息控制用于显示所述截屏图片的窗口的比例和尺寸,通过所述窗口显示所述截屏图片。
  14. 根据权利要求12所述的传输图像的装置,其特征在于,所述IP连接请求为基于IP层的RTSP会话连接请求,RTSP会话连接请求包括用于截屏图片传输的UDP端口号;
    所述接收模块通过IP层的RTSP会话,在所述UDP端口号上接收所述移动终端发送的截屏图片和截屏图片的方向信息。
  15. 一种传输图像的装置,其特征在于,包括:
    处理器;
    用于存储处理器可执行指令的存储器;
    其中,所述处理器被配置为:
    接收计算机发送的IP连接请求;
    根据收到的所述IP连接请求获得所述计算机的IP地址;
    获取截屏图片及截屏图片的方向信息;
    通过IP层根据收到的所述IP地址将所述截屏图片和所述方向信息发送给所述计算机。
  16. 一种传输图像的装置,其特征在于,包括:
    处理器;
    用于存储处理器可执行指令的存储器;
    其中,所述处理器被配置为:
    根据本地存有的移动终端的IP地址,向移动终端发送IP连接请求;
    通过IP层接收所述移动终端发送的截屏图片和截屏图片的方向信息;
    根据所述方向信息显示所述截屏图片。
PCT/CN2014/089320 2014-05-14 2014-10-23 传输图像的方法及装置 WO2015172522A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
RU2014154248A RU2609147C2 (ru) 2014-05-14 2014-10-23 Способ и устройство для передачи изображений
BR112015000269A BR112015000269A2 (pt) 2014-05-14 2014-10-23 método e dispositivo para a transmissão de imagem
KR1020147035988A KR101845404B1 (ko) 2014-05-14 2014-10-23 이미지 전송방법, 장치, 프로그램 및 기록매체
JP2016518836A JP5982079B2 (ja) 2014-05-14 2014-10-23 画像伝送の方法、装置、プログラム及び記録媒体
MX2014015465A MX353219B (es) 2014-05-14 2014-10-23 Metodo y dispositivo para transmision de imagen.
US14/585,207 US20150334191A1 (en) 2014-05-14 2014-12-30 Method and device for transmitting image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410203570.0 2014-05-14
CN201410203570.0A CN103997519A (zh) 2014-05-14 2014-05-14 传输图像的方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/585,207 Continuation US20150334191A1 (en) 2014-05-14 2014-12-30 Method and device for transmitting image

Publications (1)

Publication Number Publication Date
WO2015172522A1 true WO2015172522A1 (zh) 2015-11-19

Family

ID=51311522

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/089320 WO2015172522A1 (zh) 2014-05-14 2014-10-23 传输图像的方法及装置

Country Status (9)

Country Link
US (1) US20150334191A1 (zh)
EP (1) EP2945390A1 (zh)
JP (1) JP5982079B2 (zh)
KR (1) KR101845404B1 (zh)
CN (1) CN103997519A (zh)
BR (1) BR112015000269A2 (zh)
MX (1) MX353219B (zh)
RU (1) RU2609147C2 (zh)
WO (1) WO2015172522A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108055383A (zh) * 2017-10-19 2018-05-18 福建中金在线信息科技有限公司 截屏图片的获取方法、装置和移动终端

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103997519A (zh) * 2014-05-14 2014-08-20 小米科技有限责任公司 传输图像的方法及装置
CN104636110B (zh) * 2014-12-30 2018-04-06 小米科技有限责任公司 控制音量的方法及装置
CN104717546B (zh) * 2015-03-30 2018-02-09 天脉聚源(北京)教育科技有限公司 一种图像处理方法及装置
CN106488279A (zh) * 2015-11-27 2017-03-08 深圳市美贝壳科技有限公司 一种投射文件的旋转同步显示方法
JP6597435B2 (ja) * 2016-03-23 2019-10-30 コニカミノルタ株式会社 画面表示システム、画面表示方法、画像処理装置及び画面表示プログラム
CN106658288A (zh) * 2016-11-29 2017-05-10 努比亚技术有限公司 一种控制扬声器播放的方法及移动终端
CN107360389B (zh) * 2017-08-24 2020-11-06 北京奇艺世纪科技有限公司 一种视频通信方法、装置和终端
CN116719649A (zh) * 2022-09-01 2023-09-08 荣耀终端有限公司 会话通知的提示方法、电子设备及可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102314679A (zh) * 2010-03-22 2012-01-11 微软公司 使用加速计信息来确定图片和视频图像的方向
CN102438259A (zh) * 2011-09-09 2012-05-02 华南农业大学 一种无干扰式手机远程可用性测试系统及其测试方法
CN103440318A (zh) * 2013-08-29 2013-12-11 王靖洲 移动终端的景观识别系统
CN103678717A (zh) * 2013-12-31 2014-03-26 北京掌行通信息技术有限公司 一种获取地址数据信息的方法及系统
CN103997519A (zh) * 2014-05-14 2014-08-20 小米科技有限责任公司 传输图像的方法及装置

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004219791A (ja) * 2003-01-16 2004-08-05 Matsushita Electric Ind Co Ltd 携帯型表示装置
JP4406937B2 (ja) * 2006-12-01 2010-02-03 富士フイルム株式会社 撮影装置
KR100863676B1 (ko) * 2007-05-02 2008-10-15 (주) 엘지텔레콤 모바일 인터넷 브라우저의 입력창 선택에 따른자동화면회전장치 및 그 방법
US8095680B2 (en) * 2007-12-20 2012-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Real-time network transport protocol interface method and apparatus
US8217964B2 (en) * 2008-02-14 2012-07-10 Nokia Corporation Information presentation based on display screen orientation
JP5257157B2 (ja) * 2009-03-11 2013-08-07 ソニー株式会社 撮像装置、撮像装置の制御方法およびプログラム
US20100250817A1 (en) * 2009-03-27 2010-09-30 Qualcomm Incorporated System and method of managing data communication at a portable computing device and a portable computing device docking station
WO2010123011A1 (ja) * 2009-04-20 2010-10-28 京セラ株式会社 撮像装置および撮像方法
JP5359762B2 (ja) * 2009-10-15 2013-12-04 ソニー株式会社 情報処理装置、表示制御方法及び表示制御プログラム
US8687070B2 (en) * 2009-12-22 2014-04-01 Apple Inc. Image capture device having tilt and/or perspective correction
US9092128B2 (en) * 2010-05-21 2015-07-28 Apple Inc. Method and apparatus for managing visual information
JP5811602B2 (ja) * 2010-12-16 2015-11-11 ソニー株式会社 画像生成装置、プログラム、画像表示システム、および画像表示装置
US8983555B2 (en) * 2011-01-07 2015-03-17 Microsoft Technology Licensing, Llc Wireless communication techniques
US9811304B2 (en) * 2011-03-30 2017-11-07 Open Invention Network, Llc Method and apparatus of capturing a screen image of a remotely managed machine
WO2013008330A1 (ja) * 2011-07-14 2013-01-17 株式会社ビジョナリスト 対話型画面データ送受信システム及び対話型画面データ送受信プログラム
JP2013125508A (ja) * 2011-12-16 2013-06-24 Nec Saitama Ltd 表示システム及び方法
US9215405B2 (en) * 2011-12-09 2015-12-15 Hewlett-Packard Development Company, L.P. Modification of images based on orientation
TWI479866B (zh) * 2012-05-15 2015-04-01 Awind Inc 分享螢幕截圖之發送裝置、方法以及其電腦可讀取之媒體
JP6188284B2 (ja) * 2012-07-03 2017-08-30 キヤノン株式会社 画像表示装置、その制御方法及びプログラム
CN102769844B (zh) * 2012-07-04 2015-04-08 中国联合网络通信集团有限公司 基于移动终端的数据传输方法和系统以及移动终端
CN103237117B (zh) * 2013-03-25 2015-05-20 广东欧珀移动通信有限公司 Mtk平台的手机实现图片后台旋转的方法及装置
CN103257839A (zh) * 2013-06-07 2013-08-21 百度在线网络技术(北京)有限公司 跨设备进行显示的方法、系统和移动终端
CN103763505A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 一种在视频通话中适应屏幕方向切换的方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102314679A (zh) * 2010-03-22 2012-01-11 微软公司 使用加速计信息来确定图片和视频图像的方向
CN102438259A (zh) * 2011-09-09 2012-05-02 华南农业大学 一种无干扰式手机远程可用性测试系统及其测试方法
CN103440318A (zh) * 2013-08-29 2013-12-11 王靖洲 移动终端的景观识别系统
CN103678717A (zh) * 2013-12-31 2014-03-26 北京掌行通信息技术有限公司 一种获取地址数据信息的方法及系统
CN103997519A (zh) * 2014-05-14 2014-08-20 小米科技有限责任公司 传输图像的方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108055383A (zh) * 2017-10-19 2018-05-18 福建中金在线信息科技有限公司 截屏图片的获取方法、装置和移动终端

Also Published As

Publication number Publication date
KR101845404B1 (ko) 2018-04-05
MX353219B (es) 2018-01-08
MX2014015465A (es) 2016-04-26
EP2945390A1 (en) 2015-11-18
CN103997519A (zh) 2014-08-20
BR112015000269A2 (pt) 2017-06-27
JP2016522952A (ja) 2016-08-04
JP5982079B2 (ja) 2016-08-31
RU2609147C2 (ru) 2017-01-30
RU2014154248A (ru) 2016-07-20
KR20150141125A (ko) 2015-12-17
US20150334191A1 (en) 2015-11-19

Similar Documents

Publication Publication Date Title
WO2015172522A1 (zh) 传输图像的方法及装置
US11388453B2 (en) Method for processing live-streaming interaction video and server
JP6186090B2 (ja) 接続方法、装置、プログラム及び記録媒体
EP3046309B1 (en) Method, device and system for projection on screen
US9661390B2 (en) Method, server, and user terminal for sharing video information
WO2017219347A1 (zh) 直播显示方法、装置及系统
US20160381276A1 (en) Method and user terminal for capturing video frame
JP6259158B2 (ja) スマートデバイス検出方法、装置、プログラム及び記録媒体
US10205776B2 (en) Method and device for wireless connection
WO2016023344A1 (zh) 获取多媒体数据流的方法及装置
US9652823B2 (en) Method and terminal device for controlling display of video image
CN112114765A (zh) 投屏方法、装置及存储介质
WO2016026270A1 (zh) 传输图片的方法及装置
WO2016015403A1 (zh) 一种接入wi-fi网络的方法及装置
WO2017024713A1 (zh) 控制视频画面的方法、装置及终端
WO2019062115A1 (zh) 应用界面的显示方法及装置
CN106792024B (zh) 多媒体信息的分享方法及装置
CN105578391B (zh) 信息处理方法、装置、系统及终端设备
KR20110090164A (ko) 영상 데이터 송신 방법, 그리고 이를 이용한 디스플레이 장치 및 디스플레이 방법
US20160050242A1 (en) Methods and devices for playing streaming media data

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: MX/A/2014/015465

Country of ref document: MX

ENP Entry into the national phase

Ref document number: 2016518836

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20147035988

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2014154248

Country of ref document: RU

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112015000269

Country of ref document: BR

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14892169

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14892169

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 112015000269

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20150107