WO2019075901A1 - 图像传输方法及设备 - Google Patents

图像传输方法及设备 Download PDF

Info

Publication number
WO2019075901A1
WO2019075901A1 PCT/CN2017/117552 CN2017117552W WO2019075901A1 WO 2019075901 A1 WO2019075901 A1 WO 2019075901A1 CN 2017117552 W CN2017117552 W CN 2017117552W WO 2019075901 A1 WO2019075901 A1 WO 2019075901A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image compression
total number
compression rate
packets
Prior art date
Application number
PCT/CN2017/117552
Other languages
English (en)
French (fr)
Inventor
林敬顺
农北辰
Original Assignee
歌尔科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔科技有限公司 filed Critical 歌尔科技有限公司
Priority to US16/757,318 priority Critical patent/US11601527B2/en
Publication of WO2019075901A1 publication Critical patent/WO2019075901A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • H04L43/0829Packet loss
    • H04L43/0835One way packet loss
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/12Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164Feedback from the receiver or from the transmission channel
    • H04N19/166Feedback from the receiver or from the transmission channel concerning the amount of transmission errors, e.g. bit error rate [BER]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738Monitoring network characteristics, e.g. bandwidth, congestion level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784Data processing by the network
    • H04N21/64792Controlling the complexity of the content stream, e.g. by dropping packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/12Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18Automatic repetition systems, e.g. Van Duuren systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source

Definitions

  • the invention belongs to the field of electronic technology, and in particular to an image transmission method and device.
  • drone aerial photography technology has been widely used and popularized in the fields of industry, agriculture, and military.
  • the aerial photography technology of the drone is to take an image by installing a pan/tilt or a camera on the drone, and use the WIFI (Wireless Fidelity) network to transmit the captured image to the video viewing device for real-time viewing.
  • WIFI Wireless Fidelity
  • the obstacles, weather, distance, signal interference and other factors will cause the transmission rate of the WIFI network to decrease, which causes the card to appear when the device is playing the image, thus affecting the user. Viewing experience.
  • the present invention provides an image transmission method and an image transmission device, which solves the technical problem of image playback jam.
  • the present invention provides an image transmission method, the method comprising:
  • the adjusting the image compression rate based on the current network transmission status comprises:
  • the image compression ratio is adjusted based on the packet loss rate.
  • the determining the total number of packets sent in the preset time period and the total number of lost packets includes:
  • the compressing the image to be transmitted according to the adjusted image compression rate, and obtaining the compressed image comprises:
  • the image to be transmitted is compressed according to the adjusted image compression rate to obtain a compressed image.
  • the adjusting the image compression rate based on the packet loss rate comprises:
  • the image compression rate adjustment formula is expressed as:
  • New_CompQ (1-(Data_D/Data_T))*Old_CompQ;
  • the New_CompQ is the adjusted image compression rate
  • the Old_CompQ is the image compression rate before the adjustment
  • the Data_D is the total number of packets lost in the preset time
  • the Data_T is the total number of packets sent in the preset time
  • Data_D/Data_T is the packet loss rate
  • the present invention provides an image transmission device comprising a memory and a processing component for storing computer readable program code for executing the computer readable program code to:
  • Adjusting an image compression rate based on the current network transmission status performing compression processing on the image to be transmitted according to the adjusted image compression rate to obtain a compressed image; and transmitting the compressed image to the viewing device end for the viewing device to play the Compress the image.
  • the processing component adjusts the image compression rate based on the current network transmission status, specifically:
  • the processing component determines that the total number of packets sent in the preset time period and the total number of lost packets are specifically:
  • the processing component performs compression processing on the image to be transmitted according to the adjusted image compression ratio, and the obtained compressed image is specifically:
  • Determining whether the adjusted image compression ratio is greater than a preset image compression ratio if yes, performing compression processing on the image to be transmitted according to the preset image compression ratio to obtain a compressed image; if not, processing the image according to the adjusted image compression ratio A compression process is performed to obtain a compressed image.
  • the processing component adjusts the image compression rate based on the packet loss rate, specifically:
  • the image compression rate adjustment formula is expressed as:
  • New_CompQ (1-(Data_D/Data_T))*Old_CompQ;
  • the New_CompQ is the adjusted image compression rate
  • the Old_CompQ is the image compression rate before the adjustment
  • the Data_D is the total number of packets lost in the preset time
  • the Data_T is the total number of packets sent in the preset time
  • Data_D/Data_T is the packet loss rate
  • the present invention can obtain the following technical effects:
  • the present invention provides an image transmission method and apparatus for adjusting an image compression rate based on the network transmission condition in a case where the network transmission rate is unstable.
  • the image to be transmitted is compressed according to the adjusted image compression rate to obtain a compressed image. Therefore, when the network transmission rate is low, the amount of data of the transmitted image can be reduced under the condition that the number of transmitted image frames is constant. And transmitting the compressed image to a viewing device end for the viewing device to play the compressed image. Thereby ensuring the smoothness of image playback and improving the viewing experience of the user.
  • FIG. 1 is a flow chart of an embodiment of an image transmission method according to an embodiment of the present invention.
  • FIG. 2 is a flow chart of another embodiment of an image transmission method according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of an embodiment of an image transmission apparatus according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of another embodiment of an image transmission apparatus according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of an embodiment of an image transmission device according to an embodiment of the present invention.
  • the aerial photography technology of drones is widely used in various industries, providing great convenience for environmental detection, road condition monitoring, film and television production and other industries. Since the drone often works remotely, in order to realize the real-time transmission of the aerial image, a WIFI (Wireless Fidelity) device is usually installed on the drone to realize real-time transmission of the captured image.
  • WIFI Wireless Fidelity
  • the WIFI network signal is easily interfered by distance and external factors, such as weather, obstacles and co-channel interference, which leads to a decrease in the transmission rate of the network.
  • the image is transmitted by the drone, the image is compressed and processed at a fixed compression rate and then sent to the viewing device end.
  • the network transmission rate is reduced, the data volume of the image transmitted by the drone is also greatly reduced, thereby causing a jamming phenomenon when viewing the image on the device side.
  • an image transmission method and apparatus are provided.
  • the image compression rate is adjusted based on the network transmission status.
  • the image to be transmitted is compressed according to the adjusted image compression rate to obtain a compressed image. Therefore, when the network transmission rate is low, the amount of data of the transmitted image can be reduced under the condition that the number of transmitted image frames is constant.
  • FIG. 1 is a flowchart of an embodiment of an image transmission method according to an embodiment of the present invention, which may include:
  • the WIFI device installed by the drone will encounter unstable wall transmission when it encounters wall, large area metal and load-bearing wall, wireless equipment of similar frequency, strong signal interference, and weather factors. Therefore, by dynamically determining the current network transmission status to dynamically adjust the image compression rate of the drone end, the amount of data transmitted by the drone end can be increased.
  • a compressed image is obtained.
  • the drone end will encapsulate the compressed image and generate a data packet to send to the viewing device.
  • the viewing device end may be any terminal device capable of receiving and playing the image, such as a mobile phone, a computer, etc., with a WIFI device installed thereon. Users can view the images returned by the drone in real time through an APP (Application) installed on the phone or computer.
  • APP Application
  • the adjusting the image compression rate based on the current network transmission status may include:
  • the image compression ratio is adjusted based on the packet loss rate.
  • the network transmission status is mainly determined by the network transmission rate, and the factors affecting the network transmission rate mainly include bandwidth, delay, and packet loss.
  • the current network transmission status can be accurately determined by delay and packet loss. Therefore, by calculating the packet loss rate within a certain period of time, the current network transmission status can be reflected. The higher the packet loss rate of the packet in the preset time indicates that the current network transmission condition is worse, the lower the packet loss rate of the packet indicates that the current network transmission condition is better.
  • determining the total number of packets sent and the total number of lost packets in a preset time including:
  • the viewing device when the UAV sends a packet to the viewing device, the viewing device will reply with an ACK if it receives the packet, and will not reply with an ACK if the packet is not received. Therefore, by counting the total number of packets sent within the preset time and the number of received ACKs, the total number of lost packets in the preset time can be calculated. And calculating the packet loss rate in the preset time based on the total number of sent packets and the total number of lost packets.
  • bit rate of the data transmitted by the drone can be calculated according to the following formula:
  • BR is the number of bits transmitted per second
  • W is the image width
  • H is the image height
  • Pixel_Depth is the bit per pixel
  • FR is the frame rate
  • CompQ is the image compression rate.
  • New_BR (1-(Data_D/Data_T))*Old_BR (2)
  • Old_BR indicates the bit rate before the network transmission status changes
  • New_BR indicates the bit rate after the network transmission status changes
  • Data_D/Data_T indicates the packet loss rate.
  • New_CompQ (1-(Data_D/Data_T))*Old_CompQ (3)
  • the adjusting the image compression rate based on the packet loss rate may include:
  • the image compression rate adjustment formula is expressed as:
  • New_CompQ (1-(Data_D/Data_T))*Old_CompQ;
  • the New_CompQ is the adjusted image compression rate
  • the Old_CompQ is the image compression rate before the adjustment
  • the Data_D is the total number of packets lost in the preset time
  • the Data_T is the total number of packets sent in the preset time
  • Data_D/Data_T is the packet loss rate
  • an initial image compression ratio can be set in advance as Old_CompQ.
  • the initial image compression rate is adjusted based on the packet loss rate in the current preset time, the adjusted image compression rate New_CompQ is obtained, and the image to be transmitted is compressed based on the adjusted image compression rate to obtain compression. image.
  • the current network transmission status is confirmed by the packet loss rate of the packet at the UAV end.
  • the image compression ratio is adjusted based on the network transmission condition.
  • the image to be transmitted is compressed according to the adjusted image compression rate to obtain a compressed image. Therefore, when the network transmission rate is low, the number of transmitted image frames can be kept unchanged, and the data amount of the transmitted image is reduced to adapt to a lower network transmission condition. And transmitting the compressed image to a viewing device end for the viewing device to play the compressed image. Thereby, the smoothness of image playback is ensured, and the viewing experience of the user is improved.
  • FIG. 2 is a flowchart of another embodiment of an image transmission method according to an embodiment of the present invention, which may include:
  • step 202 Determine whether the adjusted image compression ratio is greater than a preset image compression ratio; if yes, execute step 203; if no, perform step 204.
  • the image compression processing is performed on the image to be transmitted according to the preset image compression ratio, which ensures that the transmitted image is sufficiently clear when played on the viewing device side. If the adjusted image compression ratio is less than or equal to the preset image compression ratio, the image compression processing is performed on the transmission according to the adjusted image compression ratio.
  • the image quality is poor due to the image compression rate being too high, thereby ensuring the clarity of the image played by the viewing device. Improve the user experience.
  • FIG. 3 is a schematic structural diagram of an embodiment of an image transmission apparatus according to an embodiment of the present disclosure, and the apparatus may include:
  • the image compression ratio adjustment module 301 is configured to adjust an image compression ratio based on a current network transmission status.
  • the WIFI device installed by the drone will encounter unstable wall transmission when it encounters wall, large area metal and load-bearing wall, wireless equipment of similar frequency, strong signal interference, and weather factors. Therefore, by dynamically determining the current network transmission status to dynamically adjust the image compression rate of the drone end, the amount of data transmitted by the drone end can be increased.
  • the image compression module 302 is configured to perform compression processing on the image to be transmitted according to the adjusted image compression ratio to obtain a compressed image.
  • a compressed image is obtained.
  • the drone end will encapsulate the compressed image and generate a data packet to send to the viewing device.
  • the image sending module 303 is configured to send the compressed image to the viewing device end, so that the viewing device end plays the compressed image.
  • the viewing device end may be any terminal device capable of receiving and playing the image, such as a mobile phone, a computer, etc., with a WIFI device installed thereon. Users can view the images returned by the drone in real time through an APP (application) installed on the phone or computer.
  • APP application
  • the image compression ratio adjustment module 301 may include:
  • a determining unit configured to determine a total number of packets sent within a predetermined time period and a total number of lost packets
  • a calculating unit configured to calculate a ratio of the total number of sent packets and the total number of lost packets, to obtain a packet loss rate
  • an adjusting unit configured to adjust the image compression rate based on the packet loss rate.
  • the network transmission status is mainly determined by the network transmission rate, and the factors affecting the network transmission rate mainly include bandwidth, delay, and packet loss.
  • the current network transmission status can be accurately determined by delay and packet loss. Therefore, by calculating the packet loss rate within a certain period of time, the current network transmission status can be reflected. The higher the packet loss rate of the packet in the preset time indicates that the current network transmission condition is worse, the lower the packet loss rate of the packet indicates that the current network transmission condition is better.
  • the determining unit may be specifically configured to:
  • the viewing device when the UAV sends a packet to the viewing device, the viewing device will reply with an ACK if it receives the packet, and will not reply with an ACK if the packet is not received. Therefore, by counting the total number of packets sent within the preset time and the number of received ACKs, the total number of lost packets in the preset time can be calculated. And calculating the packet loss rate in the preset time based on the total number of sent packets and the total number of lost packets.
  • bit rate of the data transmitted by the drone can be calculated according to the following formula:
  • BR is the number of bits transmitted per second
  • W is the image width
  • H is the image height
  • Pixel_Depth is the bit per pixel
  • FR is the frame rate
  • CompQ is the image compression rate.
  • New_BR (1-(Data_D/Data_T))*Old_BR (2)
  • Old_BR indicates the bit rate before the network transmission status changes
  • New_BR indicates the bit rate after the network transmission status changes
  • Data_D/Data_T indicates the packet loss rate.
  • New_CompQ (1-(Data_D/Data_T))*Old_CompQ (3)
  • the adjusting unit may be specifically configured to:
  • the image compression rate adjustment formula is expressed as:
  • New_CompQ (1-(Data_D/Data_T))*Old_CompQ;
  • the New_CompQ is the adjusted image compression rate
  • the Old_CompQ is the image compression rate before the adjustment
  • the Data_D is the total number of packets lost in the preset time
  • the Data_T is the total number of packets sent in the preset time
  • Data_D/Data_T is the packet loss rate
  • an initial image compression ratio can be set in advance as Old_CompQ.
  • the initial image compression rate is adjusted based on the packet loss rate in the current preset time, the adjusted image compression rate New_CompQ is obtained, and the image to be transmitted is compressed based on the adjusted image compression rate to obtain compression. image.
  • the current network transmission status is confirmed by the packet loss rate of the packet at the UAV end.
  • the image compression ratio is adjusted based on the network transmission condition.
  • the image to be transmitted is compressed according to the adjusted image compression rate to obtain a compressed image. Therefore, when the network transmission rate is low, the number of transmitted image frames can be kept unchanged, and the data amount of the transmitted image is reduced to adapt to a lower network transmission condition. And transmitting the compressed image to a viewing device end for the viewing device to play the compressed image. Thereby, the smoothness of image playback is ensured, and the viewing experience of the user is improved.
  • FIG. 4 is a schematic structural diagram of another embodiment of an image transmission apparatus according to an embodiment of the present disclosure, and the apparatus may include:
  • the image compression rate adjustment module 401 is configured to adjust an image compression rate according to a current network transmission status
  • the image compression module 402 is configured to perform compression processing on the image to be transmitted according to the adjusted image compression rate to obtain a compressed image.
  • the image compression module 402 can include:
  • the determining unit 411 is configured to determine whether the adjusted image compression ratio is greater than a preset image compression ratio; if yes, trigger the first image compressing unit 412; if not, trigger the second image compressing unit 413.
  • the first image compression unit 412 is configured to perform compression processing on the image to be transmitted according to the preset image compression ratio to obtain a compressed image.
  • the second image compressing unit 413 is configured to perform compression processing on the image to be transmitted according to the adjusted image compression ratio to obtain a compressed image.
  • the image sending module 415 is configured to send the compressed image to the viewing device end for the viewing device to play the compressed image.
  • the image compression processing is performed on the image to be transmitted according to the preset image compression rate, which can ensure that the transmitted image is sufficiently clear when playing on the viewing device end. If the adjusted image compression rate is less than or equal to the preset image compression ratio, the image compression processing is performed on the transmission according to the adjusted image compression ratio.
  • the image quality is poor due to the image compression rate being too high, thereby ensuring the clarity of the image played by the viewing device. Improve the user experience.
  • FIG. 5 is a schematic structural diagram of an embodiment of an image transmission device according to an embodiment of the present invention.
  • the device may include: the device includes a memory 501 and a processing component 502;
  • the memory 501 stores one or more computer program instructions
  • the processing component 502 invokes and executes the one or more computer program instructions to:
  • processing component 502 is further configured to perform all or part of the foregoing method steps.
  • the processing component 502 can include one or more processors to execute computer instructions.
  • the second processing component can also be one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, controller, microcontroller, microprocessor or other electronic component implementation for performing the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable gate arrays
  • the memory 501 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • the electronic device may also include other components such as an input/output interface, a communication component, and the like.
  • the input/output interface provides an interface between the processing component and the peripheral interface module, and the peripheral interface module may be an output device, an input device, or the like.
  • the communication component is configured to facilitate wired or wireless communication between the mobile device and other devices, such as communication with the control device, and the like.
  • An embodiment of the present invention provides a computer program product, including a computer readable storage medium, for storing computer instructions for use in a key detecting apparatus according to an embodiment of the present invention, which includes a method for detecting a key in any of the above embodiments. The procedures involved.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM) and/or non-volatile memory in a computer readable medium such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include non-transitory computer readable media, such as modulated data signals and carrier waves.
  • first device if a first device is coupled to a second device, the first device can be directly electrically coupled to the second device, or electrically coupled indirectly through other devices or coupling means. Connected to the second device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Environmental & Geological Engineering (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本发明公开了一种图像传输方法及设备。所述方法包括:基于当前网络传输状况,调整图像压缩率。按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。本发明保证了观看设备端图像播放的流畅度,提高了用户的观看体验。

Description

图像传输方法及设备 技术领域
本发明属于电子技术领域,具体地说,涉及一种图像传输方法及设备。
背景技术
随着无人机技术的快速发展,无人机航拍技术在工业、农业、军事等领域得到了广泛运用和普及。
目前,无人机航拍技术是通过在无人机上加装云台或摄像机拍摄图像,并利用WIFI(Wireless Fidelity,无线保真)网络将拍摄的图像实时发送至视频观看设备端以供用户观看。
但无人机在进行航拍过程中,由于遇到障碍物、天气、距离、信号干扰等因素均会导致WIFI网络的传输速率降低,使得观看设备端播放图像时出现卡顿现象,从而影响了用户的观看体验。
发明内容
有鉴于此,本发明提供了一种图像传输方法及一种图像传输设备,解决了图像播放卡顿的技术问题。
为了解决上述技术问题,本发明提供了一种图像传输方法,所述方法包括:
基于当前网络传输状况,调整图像压缩率;
按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像;
将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
优选地,所述基于当前网络传输状况,调整图像压缩率包括:
确定预定时间内发送的封包总数及丢失的封包总数;
计算所述封包发送总数以及所述封包丢失总数的比值,获得丢包率;
基于所述丢包率,调整所述图像压缩率。
优选地,所述确定预设时间内发送的封包总数及丢失的封包总数,包括:
确定所述预设时间内发送的封包总数;
确定接收所述观看设备端发送的确认字符ACK数量;
基于所述预设时间内发送的封包总数及接收的ACK数量,确定所述预设时间内丢失的封包总数。
优选地,所述按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像包括:
判断调整后的图像压缩率是否大于预设图像压缩率;
如果是,按照所述预设图像压缩率对待传输图像进行压缩处理,获得压缩图像;
如果否,按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
优选地,所述基于所述丢包率,调整所述图像压缩率包括:
基于图像压缩率调整公式调整所述图像压缩率;
所述图像压缩率调整公式表示为:
New_CompQ=(1-(Data_D/Data_T))*Old_CompQ;
其中,所述New_CompQ为调整后的图像压缩率,Old_CompQ为调整前的图像压缩率,所述Data_D为预设时间内丢失的封包总数,所述Data_T为预设时间内发送的封包总数,所述Data_D/Data_T为所述丢包率。
本发明提供了一种图像传输设备,所述设备包括存储器和处理组件,所述存储器用于存储计算机可读程序代码,所述处理组件用于执行所述计算机可读程序代码以实现:
基于当前网络传输状况,调整图像压缩率;按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像;将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
优选地,所述处理组件基于当前网络传输状况,调整图像压缩率具体是:
确定预定时间内发送的封包总数及丢失的封包总数;计算所述封包发送总数以及所述封包丢失总数的比值,获得丢包率;基于所述丢包率,调整所述图像压缩率。
优选地,所述处理组件确定预设时间内发送的封包总数及丢失的封包总数具体是:
确定所述预设时间内发送的封包总数;确定接收所述观看设备端发送的确认字符ACK数量;基于所述预设时间内发送的封包总数及接收的ACK数量,确定所述预设时间内丢失的封包总数。
优选地,所述处理组件按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像具体是:
判断调整后的图像压缩率是否大于预设图像压缩率;如果是,按照所述预设图像压缩率对待传输图像进行压缩处理,获得压缩图像;如果否,按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
优选地,所述处理组件基于所述丢包率,调整所述图像压缩率具体是:
基于图像压缩率调整公式调整所述图像压缩率;
所述图像压缩率调整公式表示为:
New_CompQ=(1-(Data_D/Data_T))*Old_CompQ;
其中,所述New_CompQ为调整后的图像压缩率,Old_CompQ为调整前的图像压缩率,所述Data_D为预设时间内丢失的封包总数,所述Data_T为预设时间内发送的封包总数,所述Data_D/Data_T为所述丢包率。
与现有技术相比,本发明可以获得包括以下技术效果:
本发明提供了一种图像传输方法及设备,在网络传输速率不稳定的情况下,基于所述网络传输状况来调整图像压缩率。按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。从而在网络传输速率较低时,可以保证传输图像帧数不变的情况下,降低了传输图像的数据量。将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。从而保证了图像播放的流畅度,提高了用户的观看体验。
附图说明
图1是本发明实施例的一种图像传输方法的一个实施例的流程图;
图2是本发明实施例的一种图像传输方法的另一个实施例的流程图;
图3是本发明实施例的一种图像传输装置的一个实施例的结构示意图;
图4是本发明实施例的一种图像传输装置的另一个实施例的结构示意图;
图5是本发明实施例的一种图像传输设备的一个实施例的结构示意图。
具体实施方式
以下将配合附图及实施例来详细说明本发明的实施方式,藉此对本发明如何应用技术手段来解决技术问题并达成技术功效的实现过程能充分理解并据以实施。
目前,无人机航拍技术广泛应用于各行各业,为环境探测,路况监测,影视制作等行业提供了极大的便利。由于无人机经常远距离作业,为了实现航拍图像的实时传输,通常在无人机上加装WIFI(Wireless Fidelity,无线保真)装置,实现拍摄图像的实时传输。
但WIFI的网络信号很容易受到距离和外在因素的干扰,例如天气、障碍物及同频信号干扰等,从而导致了网络的传输速率降低。现有技术中,无人机在传输图像时,是以固定的压缩率对图像进行压缩处理并封包后发送至观看设备端。当网络传输速率降低后,无人机端传输图像的数据量也大大降低,从而造成观看设备端播放图像时出现卡顿现象。
为了解决图像播放卡顿的技术问题,发明人经过一系列研究提出了本发明的技术方案。本发明中,提供了一种图像传输方法及设备,在网络传输速率不稳定的情况下,基于所述网络传输状况来调整图像压缩率。按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。从而在网络传输速率较低时,可以保证传输图像帧数不变的情况下,降低了传输图像的数据量。将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。从而保证了图像播放的流畅度,提高了用户的观看体验。
下面将结合附图对本发明技术方案进行详细描述。
图1是本发明实施例提供的一种图像传输方法的一个实施例的流程图,该方法可以包括:
101:基于当前网络传输状况,调整图像压缩率。
无人机安装的WIFI装置,在遇到墙体,大面积的金属和承重墙、同类频率无线设备、强信号干扰、天气因素等都会导致网络传输状况不稳定。因此通过实时判断当前网络传输状况来动态地调整无人机端的图像压缩率,可以提高无人机端发送图片的数据量。
102:按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
按照调整后的图像压缩率对待传输的图像进行压缩处理后,获得压缩图像。无人机端会对该压缩图像进行封装后生成数据包发送至观看设备端。
103:将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
其中,观看设备端可以是安装有WIFI装置的能够接收并播放该图像的任一终端设备,例如,手机,电脑等。用户可通过安装在手机或电脑上的APP(Application,应用程序)实时观看无人机传回的图像。
可选地,在某些实施例中,所述基于当前网络传输状况,调整图像压缩率可以包括:
确定预定时间内发送的封包总数及丢失的封包总数;
计算所述封包发送总数以及所述封包丢失总数的比值,获得丢包率;
基于所述丢包率,调整所述图像压缩率。
网络传输状况,主要是由网络传输速率决定的,而影响网络传输速率的因素主要有带宽、时延和丢包。在带宽固定的情况下,可通过时延和丢包准确地判断当前网络的传输状况。因此,通过计算一定时间内的封包丢失率可反映出当前的网络传输状况。当在预设时间内封包的丢包率越高表明当前网络传输状况越差,封包的丢包率越低则表明当前的网络传输状况越良好。
可选地,在某些实施例中,所述确定预设时间内发送的封包总数及丢失的封包总数,包括:
确定所述预设时间内发送的封包总数;
确定接收所述观看设备端发送的确认字符ACK数量;
基于所述预设时间内发送的封包总数及接收的ACK数量,确定所述预设时间内丢失的封包总数。
在传输协议中,当无人机端发送一个封包至观看设备端之后,观看设备端如果接收到该封包会回复一个ACK,如果未收到该封包则不会回复ACK。因此,通过统计在预设时间内发送的封包总数及接收到的ACK的数量即可计算出该预设时间内丢失的封包总数。并基于发送的封包总数及丢失的封包总数计算获得该预设时间内的丢包率。
在实际应用中,无人机端发送数据的比特率可根据下式计算获得:
BR=W*H*Pixel_Depth*FR*CompQ             (1)
其中,BR表示每秒传送的比特数,W表示图像宽度,H表示图像高度,Pixel_Depth表示比特每像素,FR表示帧率,CompQ表示图像压缩率。
由(1)式可知,无人机的每秒传送的比特数与图像压缩率成正比,图像压缩率越大,则传输的数据量越高。
由于比特率与网络传输状况存如下(2)式的关系:
New_BR=(1-(Data_D/Data_T))*Old_BR           (2)
其中,Old_BR表示网络传输状况变化前的比特率,New_BR表示随着网络传输状况变化后的比特率,Data_D/Data_T表示丢包率。
由(2)式可以得出,根据传输数据量随着网络传输状况的变化可获得图像压缩率随着网络传输状况的变化的关系。因此,基于上述(1)式和(2)式,可以计算得出如下(3)式:
New_CompQ=(1-(Data_D/Data_T))*Old_CompQ         (3)
可选地,在某些实施例中,所述基于所述丢包率,调整所述图像压缩率可以包括:
基于图像压缩率调整公式调整所述图像压缩率;
所述图像压缩率调整公式表示为:
New_CompQ=(1-(Data_D/Data_T))*Old_CompQ;
其中,所述New_CompQ为调整后的图像压缩率,Old_CompQ为调整前的图像压缩率,所述Data_D为预设时间内丢失的封包总数,所述Data_T为预设时间内发送的封包总数,所述Data_D/Data_T为所述丢包率。
通常可以预先设定一个初始图像压缩率,作为Old_CompQ。当网络传输状况发生变化时,基于当前预设时间内的丢包率调整该初始图像压缩率,获得调整后的图像压缩率New_CompQ,并基于调整后的图像压缩率对待传输图像进行压缩,获得压缩图像。再下一个预设时间内,将上一预设时间得到的调整后的图像压缩率New_CompQ=Old_CompQ,基于该预设时间内的丢包率,重新调整图像压缩率,从而实现对图像压缩率的动态调整。
本实施例中,透过无人机端的封包的丢包率,来确认当前网络的传输状况。在网络传输速率不稳定的情况下,基于所述网络传输状况来调整图像压缩率。按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。从而在网络传输速率较低时,可以保证传输图像帧数不变的情况下,降低了传输图像的数据量,以适应较低的网络传输状况。将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。从而,保证了图像播放的流畅度,提高了用户的观看体验。
图2是本发明实施例提供的一种图像传输方法的另一个实施例的流程图,该方法可以包括:
201:根据当前网络传输状况,调整图像压缩率;
202:判断调整后的图像压缩率是否大于预设图像压缩率;如果是,执行步骤203;如果否,执行步骤204。
203:按照所述预设图像压缩率对待传输图像进行压缩处理,获得压缩图像。
204:按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
205:将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
为了保证压缩图像的图像质量的清晰度,避免压缩后的图像失真,需要设置一个预设图像压缩率。如果调整后的图像压缩率高于预设图像压缩率,则按照预设图像压缩率对待传输 图像进行图像压缩处理,可以保证传输图像的在观看设备端播放时足够清晰。如果调整后的图像压缩率小于或等于预设图像压缩率,则按照调整后的图像压缩率对待传输进行图像压缩处理。
本实施例中,通过设定预设图像压缩率,避免了在对图像压缩率进行动态调整时,由于图像压缩率过高造成压缩图像质量较差,保证了观看设备端播放图像的清晰度,提高了用户体验。
图3是本发明实施例提供的一种图像传输装置的一个实施例的结构示意图,该装置可以包括:
图像压缩率调整模块301,用于基于当前网络传输状况,调整图像压缩率。
无人机安装的WIFI装置,在遇到墙体,大面积的金属和承重墙、同类频率无线设备、强信号干扰、天气因素等都会导致网络传输状况不稳定。因此通过实时判断当前网络传输状况来动态地调整无人机端的图像压缩率,可以提高无人机端发送图片的数据量。
图像压缩模块302,用于按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
按照调整后的图像压缩率对待传输的图像进行压缩处理后,获得压缩图像。无人机端会对该压缩图像进行封装后生成数据包发送至观看设备端。
图像发送模块303,用于将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
其中,观看设备端可以是安装有WIFI装置的能够接收并播放该图像的任一终端设备,例如,手机,电脑等。用户可通过安装在手机或电脑上的APP(应用程序)实时观看无人机传回的图像。
可选地,在某些实施例中,所述图像压缩率调整模块301可以包括:
确定单元,用于确定预定时间内发送的封包总数及丢失的封包总数;
计算单元,用于计算所述封包发送总数以及所述封包丢失总数的比值,获得丢包率;
调整单元,用于基于所述丢包率,调整所述图像压缩率。
网络传输状况,主要是由网络传输速率决定的,而影响网络传输速率的因素主要有带宽、时延和丢包。在带宽固定的情况下,可通过时延和丢包准确地判断当前网络的传输状况。因此,通过计算一定时间内的封包丢失率可反映出当前的网络传输状况。当在预设时间内封包的丢包率越高表明当前网络传输状况越差,封包的丢包率越低则表明当前的网络传输状况越良好。
可选地,在某些实施例中,所述确定单元具体可以用于:
确定所述预设时间内发送的封包总数;
确定接收所述观看设备端发送的确认字符ACK数量;
基于所述预设时间内发送的封包总数及接收的ACK数量,确定所述预设时间内丢失的封包总数。
在传输协议中,当无人机端发送一个封包至观看设备端之后,观看设备端如果接收到该封包会回复一个ACK,如果未收到该封包则不会回复ACK。因此,通过统计在预设时间内发送的封包总数及接收到的ACK的数量即可计算出该预设时间内丢失的封包总数。并基于发送的封包总数及丢失的封包总数计算获得该预设时间内的丢包率。
在实际应用中,无人机端发送数据的比特率可根据下式计算获得:
BR=W*H*Pixel_Depth*FR*CompQ            (1)
其中,BR表示每秒传送的比特数,W表示图像宽度,H表示图像高度,Pixel_Depth表示比特每像素,FR表示帧率,CompQ表示图像压缩率。
由(1)式可知,无人机的每秒传送的比特数与图像压缩率成正比,图像压缩率越大,则传输的数据量越高。
由于比特率与网络传输状况存如下(2)式的关系:
New_BR=(1-(Data_D/Data_T))*Old_BR           (2)
其中,Old_BR表示网络传输状况变化前的比特率,New_BR表示随着网络传输状况变化后的比特率,Data_D/Data_T表示丢包率。
由(2)式可以得出,根据传输数据量随着网络传输状况的变化可获得图像压缩率随着网络传输状况的变化的关系。因此,基于上述(1)式和(2)式,可以计算得出如下(3)式:
New_CompQ=(1-(Data_D/Data_T))*Old_CompQ          (3)
可选地,在某些实施例中,所述调整单元具体可以用于:
基于图像压缩率调整公式调整所述图像压缩率;
所述图像压缩率调整公式表示为:
New_CompQ=(1-(Data_D/Data_T))*Old_CompQ;
其中,所述New_CompQ为调整后的图像压缩率,Old_CompQ为调整前的图像压缩率,所述Data_D为预设时间内丢失的封包总数,所述Data_T为预设时间内发送的封包 总数,所述Data_D/Data_T为所述丢包率。
通常可以预先设定一个初始图像压缩率,作为Old_CompQ。当网络传输状况发生变化时,基于当前预设时间内的丢包率调整该初始图像压缩率,获得调整后的图像压缩率New_CompQ,并基于调整后的图像压缩率对待传输图像进行压缩,获得压缩图像。再下一个预设时间内,将上一预设时间得到的调整后的图像压缩率New_CompQ=Old_CompQ,基于该预设时间内的丢包率,重新调整图像压缩率,从而实现对图像压缩率的动态调整。
本实施例中,透过无人机端的封包的丢包率,来确认当前网络的传输状况。在网络传输速率不稳定的情况下,基于所述网络传输状况来调整图像压缩率。按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。从而在网络传输速率较低时,可以保证传输图像帧数不变的情况下,降低了传输图像的数据量,以适应较低的网络传输状况。将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。从而,保证了图像播放的流畅度,提高了用户的观看体验。
图4是本发明实施例提供的一种图像传输装置的另一个实施例的结构示意图,该装置可以包括:
图像压缩率调整模块401,用于根据当前网络传输状况,调整图像压缩率;
图像压缩模块402,用于按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
所述图像压缩模块402可以包括:
判断单元411,用于判断调整后的图像压缩率是否大于预设图像压缩率;如果是,触发第一图像压缩单元412;如果否,触发第二图像压缩单元413。
第一图像压缩单元412,用于按照所述预设图像压缩率对待传输图像进行压缩处理,获得压缩图像。
第二图像压缩单元413,用于按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
图像发送模块415,用于将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
为了保证压缩图像的图像质量的清晰度,避免压缩后的图像失真,需要设置一个预设图像压缩率。如果调整后的图像压缩率高于预设图像压缩率,则按照预设图像压缩率对待传输图像进行图像压缩处理,可以保证传输图像的在观看设备端播放时足够清晰。如果调整后的 图像压缩率小于或等于预设图像压缩率,则按照调整后的图像压缩率对待传输进行图像压缩处理。
本实施例中,通过设定预设图像压缩率,避免了在对图像压缩率进行动态调整时,由于图像压缩率过高造成压缩图像质量较差,保证了观看设备端播放图像的清晰度,提高了用户体验。
图5是本发明实施例提供的一种图像传输设备的一个实施例的结构示意图,所述设备可以包括:该设备包括存储器501以及处理组件502;
所述存储器501存储一条或多条计算机程序指令;
所述处理组件502调用并执行所述一条或多条计算机程序指令,实现如下操作:
基于当前网络传输状况,调整图像压缩率;
按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像;
将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
可选地,该处理组件502还用于执行前述各方法步骤中的全部或部分步骤。
其中,该处理组件502可以包括一个或多个处理器来执行计算机指令。当然第二处理组件也可以为一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。
该存储器501可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
当然,所述电子设备还可以包括其他部件,例如输入/输出接口、通信组件等。输入/输出接口为处理组件和外围接口模块之间提供接口,上述外围接口模块可以是输出设备、输入设备等。通信组件被配置为便于可移动设备和其他设备之间有线或无线方式的通信,例如和控制设备的通信等等。
本发明实施例提供了一种计算机程序产品,包括计算机可读存储介质,用于储存本发明实施例所述按键检测装置所用的计算机指令,其包含用于执行上述任一实施例中按键检测方法所涉及的程序。
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易 失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括非暂存电脑可读媒体(transitory media),如调制的数据信号和载波。
如在说明书及权利要求当中使用了某些词汇来指称特定组件。本领域技术人员应可理解,硬件制造商可能会用不同名词来称呼同一个组件。本说明书及权利要求并不以名称的差异来作为区分组件的方式,而是以组件在功能上的差异来作为区分的准则。如在通篇说明书及权利要求当中所提及的“包含”为一开放式用语,故应解释成“包含但不限定于”。“大致”是指在可接收的误差范围内,本领域技术人员能够在一定误差范围内解决所述技术问题,基本达到所述技术效果。此外,“耦接”一词在此包含任何直接及间接的电性耦接手段。因此,若文中描述一第一装置耦接于一第二装置,则代表所述第一装置可直接电性耦接于所述第二装置,或通过其他装置或耦接手段间接地电性耦接至所述第二装置。说明书后续描述为实施本发明的较佳实施方式,然所述描述乃以说明本发明的一般原则为目的,并非用以限定本发明的范围。本发明的保护范围当视所附权利要求所界定者为准。
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的商品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种商品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的商品或者系统中还存在另外的相同要素
上述说明示出并描述了本发明的若干优选实施例,但如前所述,应当理解本发明并非局限于本文所披露的形式,不应看作是对其他实施例的排除,而可用于各种其他组合、修改和环境,并能够在本文所述申请构想范围内,通过上述教导或相关领域的技术或知识进行改动。而本领域人员所进行的改动和变化不脱离本发明的精神和范围,则都应在本发明所附权利要 求的保护范围内。

Claims (10)

  1. 一种图像传输方法,其特征在于,所述方法包括:
    基于当前网络传输状况,调整图像压缩率;
    按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像;
    将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
  2. 根据权利要求1所述的方法,其特征在于,所述基于当前网络传输状况,调整图像压缩率包括:
    确定预定时间内发送的封包总数及丢失的封包总数;
    计算所述封包发送总数以及所述封包丢失总数的比值,获得丢包率;
    基于所述丢包率,调整所述图像压缩率。
  3. 根据权利要求2所述的方法,其特征在于,所述确定预设时间内发送的封包总数及丢失的封包总数,包括:
    确定所述预设时间内发送的封包总数;
    确定接收所述观看设备端发送的确认字符ACK数量;
    基于所述预设时间内发送的封包总数及接收的ACK数量,确定所述预设时间内丢失的封包总数。
  4. 根据权利要求1所述的方法,其特征在于,所述按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像包括:
    判断调整后的图像压缩率是否大于预设图像压缩率;
    如果是,按照所述预设图像压缩率对待传输图像进行压缩处理,获得压缩图像;
    如果否,按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
  5. 根据权利要求2所述的方法,其特征在于,所述基于所述丢包率,调整所述图像压缩率包括:
    基于图像压缩率调整公式调整所述图像压缩率;
    所述图像压缩率调整公式表示为:
    New_CompQ=(1-(Data_D/Data_T}}*Old_CompQ;
    其中,所述New_CompQ为调整后的图像压缩率,Old_CompQ为调整前的图像压缩率,所述Data_D为预设时间内丢失的封包总数,所述Data_T为预设时间内发送的封包总数,所述Data_D/Data_T为所述丢包率。
  6. 一种图像传输设备,其特征在于,所述设备包括存储器和处理组件,所述存储器用于存储计算机可读程序代码,所述处理组件用于执行所述计算机可读程序代码以实现:
    基于当前网络传输状况,调整图像压缩率;按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像;将所述压缩图像发送至观看设备端,以供所述观看设备端播放所述压缩图像。
  7. 根据权利要求6所述的设备,其特征在于,所述处理组件基于当前网络传输状况,调整图像压缩率具体是:
    确定预定时间内发送的封包总数及丢失的封包总数;计算所述封包发送总数以及所述封包丢失总数的比值,获得丢包率;基于所述丢包率,调整所述图像压缩率。
  8. 根据权利要求7所述的设备,其特征在于,所述处理组件确定预设时间内发送的封包总数及丢失的封包总数具体是:
    确定所述预设时间内发送的封包总数;确定接收所述观看设备端发送的确认字符ACK数量;基于所述预设时间内发送的封包总数及接收的ACK数量,确定所述预设时间内丢失的封包总数。
  9. 根据权利要求6所述的设备,其特征在于,所述处理组件按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像具体是:
    判断调整后的图像压缩率是否大于预设图像压缩率;如果是,按照所述预设图像压缩率对待传输图像进行压缩处理,获得压缩图像;如果否,按照调整后的图像压缩率对待传输图像进行压缩处理,获得压缩图像。
  10. 根据权利要求7所述的设备,其特征在于,所述处理组件基于所述丢包率,调整所述图像压缩率具体是:
    基于图像压缩率调整公式调整所述图像压缩率;
    所述图像压缩率调整公式表示为:
    New_CompQ=(1-(Data_D/Data_T))*Old_CompQ;
    其中,所述New_CompQ为调整后的图像压缩率,Old_CompQ为调整前的图像压缩率,所述Data_D为预设时间内丢失的封包总数,所述Data_T为预设时间内发送的封包总数,所述Data_D/Data_T为所述丢包率。
PCT/CN2017/117552 2017-10-19 2017-12-20 图像传输方法及设备 WO2019075901A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/757,318 US11601527B2 (en) 2017-10-19 2017-12-20 Method and device for transmitting image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710996585.0 2017-10-19
CN201710996585.0A CN107734300A (zh) 2017-10-19 2017-10-19 图像传输方法及设备

Publications (1)

Publication Number Publication Date
WO2019075901A1 true WO2019075901A1 (zh) 2019-04-25

Family

ID=61212407

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/117552 WO2019075901A1 (zh) 2017-10-19 2017-12-20 图像传输方法及设备

Country Status (3)

Country Link
US (1) US11601527B2 (zh)
CN (1) CN107734300A (zh)
WO (1) WO2019075901A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108897500B (zh) * 2018-05-23 2021-10-26 联想图像(天津)科技有限公司 数据传输方法、装置及电子设备
CN109167973A (zh) * 2018-10-24 2019-01-08 国网江苏省电力有限公司盐城供电分公司 一种智能安全帽的图像传输方法及装置
CN111432169B (zh) * 2019-12-25 2021-11-30 杭州海康威视数字技术股份有限公司 视频传输方法、装置、设备和系统
CN111314335B (zh) * 2020-02-10 2021-10-08 腾讯科技(深圳)有限公司 数据传输方法、装置、终端、存储介质和系统
CN114143407A (zh) * 2021-11-25 2022-03-04 厦门汉印电子技术有限公司 一种远程实时预览实现设备及方法、装置、可读存储介质
CN115547464A (zh) * 2022-11-29 2022-12-30 深圳市生强科技有限公司 一种用于数字病理切片的处理方法、设备及介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1466388A (zh) * 2002-06-19 2004-01-07 华为技术有限公司 视讯图像传输的主动防错方法
CN1703069A (zh) * 2004-05-27 2005-11-30 日本电气视象技术株式会社 使用再现范围内信息的图像传输装置
CN101090497A (zh) * 2007-06-26 2007-12-19 北京中星微电子有限公司 一种数据压缩方法和装置
JP2010258850A (ja) * 2009-04-27 2010-11-11 Panasonic Corp 映像伝送システム及び映像伝送方法
CN102984495A (zh) * 2012-12-06 2013-03-20 北京小米科技有限责任公司 一种视频图像的处理方法及装置
CN104394486A (zh) * 2014-11-26 2015-03-04 中标软件有限公司 一种基于云桌面的视频流处理方法及装置
CN107046606A (zh) * 2016-02-06 2017-08-15 株式会社理光 图像发送装置、图像实时显示系统以及图像实时显示方法
CN107222665A (zh) * 2017-06-13 2017-09-29 深圳市元维科技有限公司 多信号支持多功能可远距离传输高清视频的内窥镜系统

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101091910B1 (ko) * 2005-12-29 2011-12-08 삼성테크윈 주식회사 실시간 전송 프로토콜을 사용하는 비디오 서버의 제어 방법및 그 기록 매체
CN101304302A (zh) * 2008-06-06 2008-11-12 广东威创视讯科技股份有限公司 视频数据的传输方法及其系统
TWI501637B (zh) * 2013-07-31 2015-09-21 Univ Nat Taiwan 自動化影像擷取系統
CN103957389B (zh) * 2014-05-13 2017-02-22 重庆大学 基于压缩感知的3g视频传输方法及系统
KR101607773B1 (ko) * 2014-10-27 2016-04-11 삼성에스디에스 주식회사 데이터 송신 장치 및 이를 이용하는 데이터 통신 방법
CN104811694B (zh) * 2015-04-28 2017-03-08 华为技术有限公司 一种视频数据质量评估的方法和装置
KR102430315B1 (ko) * 2015-09-10 2022-08-09 삼성디스플레이 주식회사 영상 처리 장치 및 영상 처리 방법
CN106385374B (zh) * 2016-08-17 2019-12-06 武汉精伦电气有限公司 一种局域网发送端的缓解网络拥塞的传输控制方法及系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1466388A (zh) * 2002-06-19 2004-01-07 华为技术有限公司 视讯图像传输的主动防错方法
CN1703069A (zh) * 2004-05-27 2005-11-30 日本电气视象技术株式会社 使用再现范围内信息的图像传输装置
CN101090497A (zh) * 2007-06-26 2007-12-19 北京中星微电子有限公司 一种数据压缩方法和装置
JP2010258850A (ja) * 2009-04-27 2010-11-11 Panasonic Corp 映像伝送システム及び映像伝送方法
CN102984495A (zh) * 2012-12-06 2013-03-20 北京小米科技有限责任公司 一种视频图像的处理方法及装置
CN104394486A (zh) * 2014-11-26 2015-03-04 中标软件有限公司 一种基于云桌面的视频流处理方法及装置
CN107046606A (zh) * 2016-02-06 2017-08-15 株式会社理光 图像发送装置、图像实时显示系统以及图像实时显示方法
CN107222665A (zh) * 2017-06-13 2017-09-29 深圳市元维科技有限公司 多信号支持多功能可远距离传输高清视频的内窥镜系统

Also Published As

Publication number Publication date
US11601527B2 (en) 2023-03-07
CN107734300A (zh) 2018-02-23
US20200304605A1 (en) 2020-09-24

Similar Documents

Publication Publication Date Title
WO2019075901A1 (zh) 图像传输方法及设备
US20220263885A1 (en) Adaptive media streaming method and apparatus according to decoding performance
CN110557655B (zh) 一种视频画面显示方法、装置、电子设备及存储介质
JP2016021763A (ja) ワイヤレスディスプレイデバイスのためのフィードバックチャネル
US20080181259A1 (en) Method and system for dynamically adjusting packet size to decrease delays of streaming data transmissions on noisy transmission lines
US20150271224A1 (en) Transport accelerator inplementing extended transmission control functionality
KR101942270B1 (ko) 재생 지연 방지 시스템을 포함하는 미디어 재생 장치 및 방법
US20140105285A1 (en) Wireless channel aware adaptive video bit rate encoding
US8873590B2 (en) Apparatus and method for correcting jitter
CN108337246B (zh) 防止重放延迟的媒体重放设备和媒体服务设备
US9660767B2 (en) Communication control apparatus, communication control method, and computer-readable non-transitory recording medium
CN110830460A (zh) 一种连接建立方法、装置、电子设备及存储介质
EP3120475A1 (en) Transport accelerator implementing selective utilization of redundant encoded content data functionality
CN111343137B (zh) 协同传输方法及传输装置
KR102050417B1 (ko) 네트워크 시스템 및 방법
WO2015085873A1 (zh) 视频码流的获取方法及装置
GB2559271A (en) Managing congestion response during content delivery
US20100086021A1 (en) Information transmission apparatus, method of controlling the same, and storage medium
US10388247B2 (en) Dynamic display device adjustment for streamed video
US9853907B2 (en) Information processing system, information processing apparatus, and non-transitory computer readable medium
US20150074484A1 (en) Communication control apparatus, communication control method, and computer-readable non-transitory recording medium
CN103458053A (zh) 一种应用于金融系统的音视频采集系统的数据传输方法
US20100122134A1 (en) Application-configured, content-based retransmission scheme for dropped media access control frames
KR20150138774A (ko) 적응형 스트리밍 제공방법
CN112766093B (zh) 全景图片、视频检测方法及装置、可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17929394

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17929394

Country of ref document: EP

Kind code of ref document: A1