WO2019174044A1 - 一种图像处理方法、设备、系统及存储介质 - Google Patents
一种图像处理方法、设备、系统及存储介质 Download PDFInfo
- Publication number
- WO2019174044A1 WO2019174044A1 PCT/CN2018/079328 CN2018079328W WO2019174044A1 WO 2019174044 A1 WO2019174044 A1 WO 2019174044A1 CN 2018079328 W CN2018079328 W CN 2018079328W WO 2019174044 A1 WO2019174044 A1 WO 2019174044A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image processing
- image
- information
- terminal device
- communication connection
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000012545 processing Methods 0.000 claims abstract description 566
- 238000004891 communication Methods 0.000 claims abstract description 213
- 230000005540 biological transmission Effects 0.000 claims abstract description 81
- 238000000034 method Methods 0.000 claims abstract description 51
- 230000006870 function Effects 0.000 claims description 39
- 238000000605 extraction Methods 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 13
- 238000003384 imaging method Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 6
- 238000012360 testing method Methods 0.000 claims description 5
- 239000002699 waste material Substances 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000012546 transfer Methods 0.000 description 4
- 238000005538 encapsulation Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000004913 activation Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Definitions
- the present invention relates to the field of control technologies, and in particular, to an image processing method, device, system, and storage medium.
- the image processing system includes an image processing device and a terminal device, and the image processing device includes an unmanned aerial vehicle, an unmanned vehicle, and a robot provided with a photographing device.
- the terminal device includes a smart terminal such as a mobile phone or a tablet computer for displaying an image.
- the image processing apparatus can transmit an image captured by a photographing device mounted on the unmanned aerial vehicle to a terminal device for display.
- the embodiment of the invention provides an image processing method, device, system and storage medium, which can avoid waste of communication link resources and improve the definition of the image transmission image.
- an embodiment of the present invention provides an image processing method, including:
- an embodiment of the present invention provides an image processing apparatus, including a memory and a processor;
- the memory is configured to store program instructions
- the processor executes program instructions stored in the memory, and when the program instructions are executed, the processor is configured to perform the following steps:
- an embodiment of the present invention provides an image processing system, including: an image processing device and a terminal device,
- the image processing device is configured to: when the communication connection for transmitting an image is established between the photographing device and the terminal device, acquire image processing information of the terminal device; acquire link information of the communication connection; Determining an image processing strategy by the image processing information and the link information; controlling the photographing device to capture an acquired image according to an indication of the image processing policy, and controlling the photographing device according to an indication of the image processing policy
- the image transmission module transmits the captured image to the terminal device;
- the terminal device is configured to receive an image transmitted by the image processing device, and display the received image on a display screen of the terminal device.
- an embodiment of the present invention provides a computer readable storage medium storing a computer program, which when executed by a processor, implements the image processing method according to the first aspect described above.
- the image processing device determines an image processing policy according to the acquired image processing information of the terminal device and the link information of the communication connection, and controls the shooting device to shoot according to the indication of the image processing policy. Obtaining an image, and controlling the image transmission module of the photographing device to transmit the photographed image to the terminal device according to the indication of the image processing strategy. In this way, waste of communication link resources is avoided, and the clarity of the image transmitted image is improved.
- FIG. 1 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.
- FIG. 2 is a schematic flowchart of an image processing method according to an embodiment of the present invention.
- FIG. 3 is a schematic flowchart of another image processing method according to an embodiment of the present invention.
- FIG. 4 is a schematic flowchart of still another image processing method according to an embodiment of the present invention.
- FIG. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
- the image processing method provided in the embodiment of the present invention may be performed by an image processing apparatus, and the image processing apparatus may be disposed in an aircraft (such as a drone) configured with a photographing device, an unmanned automobile, a robot, and a mobile terminal (such as a mobile phone). Wait for the device.
- the photographing device includes a map transfer adapter, an image parameter adjustment module, a picture transmission module, an encoding module, an image sensor, and the like.
- the image processing apparatus may control an image sensor of the photographing device to take an image, and control the image transmitting module of the photographing device to transmit the photographed image to a terminal device for displaying the image.
- the terminal device for displaying the image may include a terminal device such as a mobile phone, a tablet computer, a smart watch, or the like.
- the image processing method may be applied to other terminal devices on which the camera is mounted, which is not specifically limited in the embodiment of the present invention.
- the image processing device may determine an image processing policy according to the image processing information and the link information, and control an image sensor of the camera to capture an image according to the indication of the image processing policy, and according to the image
- the indication of the processing policy controls the image transmission module of the photographing device to transmit the captured image to the terminal device.
- the image processing device dynamically adjusts the image processing information such as the resolution and the code stream of the image transmission by acquiring the image processing information and the link information of the terminal device in advance, and according to the adjusted image processing.
- the image transmission module of the information control photographing device transmits an image to the terminal device, so that the user can obtain a better image quality experience.
- the image processing apparatus may acquire an activation instruction of the photographing apparatus, and may detect whether an establishment between the photographing apparatus and the terminal device is established when an activation instruction of the photographing apparatus is acquired. A communication connection for transmitting images. If it is detected that the photographing device establishes a communication connection with the terminal device, the image processing device may acquire image processing information of the terminal device.
- the image processing information of the terminal device includes any one or more of display information, codec information, and transmission protocol information, and the display information includes a resolution of a display screen of the terminal device.
- the frame rate is not specifically limited in the embodiment of the present invention.
- the terminal device refers to a terminal device that establishes a communication connection for image transmission with the image processing device and displays an image transmitted by the image processing device, and the terminal device includes a mobile phone and a tablet. Intelligent terminals such as a computer and a smart watch are not specifically limited in the embodiment of the present invention.
- the connection manner for establishing the communication connection may be acquired, and according to the The connection mode is used to acquire image processing information of the terminal device.
- the connection manner of the communication connection includes a wired communication connection mode
- the image processing device detects a communication connection for transmitting an image between the camera device and the terminal device if
- a communication protocol corresponding to the wired communication connection mode may be acquired, and image processing information of the terminal device is acquired according to the communication protocol.
- the wired communication connection manner includes a physical communication interface such as a high definition multimedia interface (HDMI).
- HDMI high definition multimedia interface
- connection mode of the communication connection is a wired communication connection mode
- the wired communication connection mode is communication through a physical interface HDMI
- the image processing device detects that the connection mode of the communication connection is through physical
- the communication device establishes a communication connection, and the image processing device may acquire a communication protocol corresponding to the HDMI interface, and acquire image processing information (such as resolution and display information) of the terminal device according to the communication protocol.
- the connection manner of the communication connection includes a wireless communication connection mode, and when the image processing device detects that a communication connection for transmitting an image is established between the photographing device and the terminal device, If the connection mode of the communication connection is detected as a wireless communication connection mode, the communication link corresponding to the wireless communication connection mode may be tested to obtain link information such as a link bandwidth, and the link information may be acquired according to the link information.
- the image processing information of the terminal device includes, but is not limited to, a wireless communication connection manner such as Wi-Fi, Bluetooth, or the like.
- the image processing apparatus detects that a communication connection for transmitting an image is established between the photographing apparatus and the terminal device, detecting that the connection manner of the communication connection is a Wi-Fi connection, and acquiring
- the image processing device may acquire image processing information of the terminal device according to the link bandwidth of the 2M.
- the image processing apparatus may detect whether the photographing apparatus turns on a dynamic adjustment function of image processing if it detects that a communication connection for transmitting an image is established between the photographing apparatus and the terminal device, If the detection result is on, the image processing information extraction request may be sent to the terminal device, so that the terminal device extracts image processing information of the terminal device according to the extraction request, and extracts the image processing information. And transmitting to the image processing device, so that the image processing device acquires image processing information of the terminal device.
- the manner of turning on the dynamic adjustment function of the image processing comprises: by acquiring an open operation of an APP installed on the terminal device, by using an image built in the camera for opening image processing Turning on or off the image processing by dynamically controlling the touch operation of a menu (such as a touch panel) of a function or a click operation of a physical button set by the photographing device for turning on a dynamic adjustment function of image processing Dynamic adjustment function.
- a menu such as a touch panel
- a click operation of a physical button set by the photographing device for turning on a dynamic adjustment function of image processing Dynamic adjustment function.
- the image processing device may determine the preset information as image processing information of the terminal device if it detects that the camera does not turn on the dynamic adjustment function of the image processing.
- the preset information includes any one or more of preset display information, preset codec information, preset transmission protocol information, and the like. For example, assuming that the preset display information includes a preset resolution of 1024*768, if the image processing apparatus detects that the photographing apparatus does not turn on the dynamic adjustment function of the image processing, the image processing apparatus may The resolution of 1024*768 is determined as the image processing information of the terminal device.
- the image processing device may receive a user operation generated on the configuration interface and acquire the user operation in the configuration interface if it detects that the camera does not turn on the dynamic adjustment function of the image processing.
- the obtained image processing information is configured.
- the user operations generated on the configuration interface are for a user to manually configure image processing information (eg, frame rate, resolution, codec information, etc.) on the configuration interface.
- the image processing device may receive a user operation on the configuration interface of the user, and acquire image processing information such as a frame rate, a resolution, and an encoding format corresponding to the user operation.
- the image processing apparatus may receive a user operation generated on the configuration interface, and Obtaining image processing information of the default configuration selected by the user operation.
- the image processing information of the default configuration may be any image processing information (such as resolution, codec information, and the like) set by the user, which is not specifically limited in the embodiment of the present invention.
- the image processing information acquired by the image processing device includes: display information and codec information, and the image processing device may be configured according to the acquired display information and codec information of the terminal device. Determine the image processing strategy.
- the display information includes a resolution and/or a frame rate of a display screen of the terminal device, the determined image processing policy indicating a match with the display information and the codec information.
- the image processing device may acquire link information of the communication connection, where the link information includes link bandwidth, a communication protocol, a bandwidth required by the communication protocol, and the like. No specific restrictions.
- the image processing device may configure a shooting parameter of the shooting device according to an indication of the image processing policy, and control the shooting device to shoot according to the shooting parameter configured by the image processing policy. Acquiring an image, wherein, under the shooting parameters, an image sensor of the photographing device captures an image that matches the display information and the codec information.
- the image processing device may control, according to the indication of the image processing policy, a map transfer adapter of the image processing device to configure a photographing parameter of the photographing device, such as link information, resolution, and frame rate. And transmitting the shooting parameter to an image sensor of the photographing device, so that the image sensor captures an image that matches the display information and the codec information according to the photographing parameter. For example, if the image processing device configures the shooting parameter of the photographing device to have a resolution of 1024*768 according to the display information of the terminal device indicated by the image processing policy, the image processing device may set the shooting parameter. And transmitted to the image sensor of the photographing device, so that the image sensor captures an image with a resolution of 1024*768 according to the photographing parameter.
- the image processing device may control, according to the indication of the image processing policy, an encoding module of the capturing device to perform encoding processing on the captured image by using a target code stream, and according to the image processing strategy. Instructing to control the image transmission module of the photographing device to transmit the data obtained by the encoding process to the terminal device.
- the determined image processing policy indicates an encoding parameter associated with the codec information.
- the image processing device may configure, according to the indication of the image processing policy, an encoding parameter of an encoding module of the capturing device, where the encoding module of the capturing device is captured by the target code stream pair
- the image is encoded.
- the coding parameters include any one or more of an encapsulation format (such as GOP or GDR), a codec type (such as HEVC, H264, etc.), a bitrate type (CBR, VBR, CVBR, etc.), an I frame, and a P frame ratio.
- an encapsulation format such as GOP or GDR
- a codec type such as HEVC, H264, etc.
- I frame an I frame
- P frame ratio a P frame ratio
- the encoding parameter is determined according to any one or more kinds of information that the image processing device acquires the link information of the communication connection, the display information included in the image processing information, and the codec information.
- the correspondence between the coding parameters and the link information and the display information and the codec information included in the image processing information may include, but is not limited to, the correspondence relationship shown in Table 1.
- the image processing information includes transmission protocol information of the terminal device, the determined image processing policy indicating a transmission protocol parameter associated with the transmission protocol information.
- the image processing device may, according to the instruction of the image processing policy, control the image transmission module of the imaging device to transmit the data obtained by the encoding process to the terminal device, according to an indication of the image processing policy, Configuring a transmission protocol parameter of the image transmission module of the photographing device, where the image transmission module of the photographing device encapsulates the data obtained by the encoding process, and transmits the data obtained by the encoding process to the
- the terminal device is configured to enable the terminal device to parse out a package format (such as GOP or GDR), a codec type (such as HEVC or H264), a bitrate type (such as CBR, VBR, CVBR, etc.), I frame from the received data. And the parameter of the ratio of the P frame, and then the image captured by the photographing device is parsed and displayed on the display screen of the terminal device.
- a package format such
- the image processing device may be re-determined according to the acquired new display information. And controlling, according to the indication of the re-determined image processing policy, the photographing device to capture an acquired image, and transmitting the image to the terminal device according to an instruction of the image processing policy.
- FIG. 1 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.
- the image processing system shown in FIG. 1 includes an image processing device 11 and a terminal device 12, and the image processing device 11
- the image transmission adapter 111, the image sensor 112, the encoding module 113, and the image transmission module 114 include: a decoding module 121, a display module 122, and an information extraction module 123.
- the image processing system may detect, by the image processing device 11, whether the image processing device 11 establishes a communication connection with the terminal device 12 for transmitting an image, if the detection result is
- the image processing device 11 may send an extraction request of the image processing information to the terminal device 12, and after receiving the extraction request, the terminal device 12 extracts an image of the terminal device 12 through the information extraction module 123. Processing the information, and transmitting the image processing information to the image processing device 11, so that the image processing device 11 acquires image processing information of the terminal device 12, and the image processing device 11 can also acquire the communication.
- Link information such as the connected communication protocol and link bandwidth.
- the image processing device 11 may determine an image processing policy based on the image processing information and the link information.
- the image processing device 11 can control the image transmission device 111 of the image processing device 11 to configure the shooting parameters of the image capturing device configured in the image processing device 11 according to the indication of the image processing policy, such as link information and resolution. Any one or more of a rate, a frame rate, and the like, and transmitting the shooting parameters to the image sensor 112 of the photographing device, so that the image sensor 112 captures the display information according to the shooting parameters.
- the image in which the codec information matches.
- the image processing device 11 may perform an encoding process on the image captured by the image sensor 112 through the encoding module 113, and transmit the captured image to the terminal device 12 through the image transmitting module 114. After receiving the image, the terminal device 12 performs decoding processing on the received image through the decoding module 121, and outputs an image obtained by displaying the decoding through the display module 122.
- FIG. 2 is a schematic flowchart of an image processing method according to an embodiment of the present invention.
- the method may be performed by an image processing device, where the image processing device is provided with a photographing device, where the image processing is performed.
- the specific explanation of the equipment is as described above.
- the method of the embodiment of the present invention includes the following steps.
- S201 Acquire image processing information of the terminal device when a communication connection for transmitting an image is established between the photographing device and the terminal device.
- the image processing information of the terminal device when the image processing device detects that a communication connection for transmitting an image is established between the photographing device and the terminal device, the image processing information of the terminal device may be acquired.
- the image processing information includes any one or more of display information, codec information, and transmission protocol information of the terminal device, and the display information includes a resolution of the display screen of the terminal device and/or
- the frame rate is not limited in the embodiment of the present invention.
- the embodiment obtains image processing information of the terminal device, so that the image processing device can determine an image processing policy corresponding to the terminal device according to the image processing information, so as to improve image display on the terminal device. The clarity.
- the image processing apparatus may detect whether the photographing apparatus is established with the terminal device if the image processing apparatus acquires a start instruction of the photographing apparatus provided on the image processing apparatus.
- the link information of the communication connection may be acquired.
- the link information of the communication connection includes any one or more kinds of information, such as a link bandwidth, a communication protocol, and a bandwidth required by the communication protocol, which are not specifically limited in the embodiment of the present invention.
- S203 Determine an image processing policy according to the image processing information and the link information.
- the image processing device may determine an image processing policy according to the image processing information and the link information.
- the image processing apparatus may acquire image processing information of the terminal device for displaying an image and the communication connection when detecting a communication connection for transmitting an image between the photographing device and the terminal device. Link information, and determining an image processing policy based on the image processing information and the link information.
- the image processing information of the terminal device acquired by the image processing device to establish a communication connection with the image processing device includes display information and codec information.
- the image processing device may determine the image processing policy according to the acquired display information and codec information of the terminal device.
- the display information includes a resolution and/or a frame rate of a display screen of the terminal device, the determined image processing policy indicating a match with the display information and the codec information.
- the image processing device may Determining an image processing policy according to the obtained resolution of the terminal device is 1024*768, a frame rate of 18 fps, and codec information, wherein the determined image processing policy indicates that the resolution is 1024* 768, the frame rate is 18 fps display information and the codec information matching the shooting parameters.
- S204 Control the photographing device to capture the acquired image according to the indication of the image processing strategy, and control the image transmitting module of the photographing device to transmit the captured image to the terminal device according to the indication of the image processing strategy.
- the image processing device may control the image sensor of the camera to capture an image according to the indication of the image processing policy, and control the image transmission module of the camera to shoot according to the indication of the image processing strategy.
- the resulting image is transmitted to the terminal device.
- the image processing device may configure a shooting parameter of the camera according to an indication of the image processing policy, and control the camera according to the shooting parameter configured by the image processing policy.
- the image sensor captures an acquired image, wherein, under the shooting parameters, an image sensor of the photographing device captures an image that matches the display information and the codec information.
- the image processing device may control, according to the indication of the image processing policy, a map transfer adapter of the image processing device to configure a photographing parameter of the photographing device, such as link information, resolution, and frame rate. And transmitting the shooting parameter to an image sensor of the photographing device, so that the image sensor captures an image that matches the display information and the codec information according to the photographing parameter. For example, if the image processing device configures the shooting parameter of the photographing device to have a resolution of 1024*768 according to the display information of the terminal device indicated by the image processing policy, the image processing device may set the shooting parameter. And transmitted to the image sensor of the photographing device, so that the image sensor captures an image with a resolution of 1024*768 according to the photographing parameter.
- the image processing device may control, according to the indication of the image processing policy, an encoding module of the capturing device to perform encoding processing on the captured image by using a target code stream, and according to the image processing strategy. Instructing to control the image transmission module of the photographing device to transmit the data obtained by the encoding process to the terminal device.
- the determined image processing policy indicates an encoding parameter associated with the codec information.
- the image processing device may configure, according to the indication of the image processing policy, an encoding parameter of an encoding module of the capturing device, where the encoding module of the capturing device is captured by the target code stream pair
- the image is encoded.
- the coding parameters include any one or more of an encapsulation format (such as GOP or GDR), a codec type (such as HEVC, H264, etc.), a bitrate type (CBR, VBR, CVBR, etc.), an I frame, and a P frame ratio.
- an encapsulation format such as GOP or GDR
- a codec type such as HEVC, H264, etc.
- I frame an I frame
- P frame ratio a P frame ratio
- the encoding parameter is determined according to any one or more kinds of information that the image processing device acquires the link information of the communication connection, the display information included in the image processing information, and the codec information.
- the correspondence between the encoding parameter and the link information, the display information included in the image processing information, and the codec information is as shown in Table 1.
- the image processing information includes transmission protocol information of the terminal device, the determined image processing policy indicating a transmission protocol parameter associated with the transmission protocol information.
- the image processing device may, according to the instruction of the image processing policy, control the image transmission module of the imaging device to transmit the data obtained by the encoding process to the terminal device, according to an indication of the image processing policy, Configuring a transmission protocol parameter of the image transmission module of the photographing device, where the image transmission module of the photographing device encapsulates the data obtained by the encoding process, and transmits the data obtained by the encoding process to the Determining the terminal device to enable the mobile terminal device to parse out the encapsulation format (such as GOP or GDR), codec type (such as HEVC or H264), bitrate type (such as CBR, VBR, CVBR, etc.), I from the received data. Parameters such as the ratio of the frame and the P frame are then parsed to restore the image captured by the photographing device and displayed on the display screen of the terminal device.
- the image processing device may according to the acquired new display.
- the information re-determines the image processing strategy, and controls the image sensor of the camera to capture the image according to the re-determined image processing strategy.
- the image processing device when detecting that a communication connection for transmitting an image is established between the photographing device and the terminal device, acquires image processing information of the terminal device, and acquires link information of the communication connection. Determining an image processing policy according to the image processing information and the link information, and controlling the photographing device to capture an acquired image according to an indication of the image processing policy, and controlling the image according to an indication of the image processing policy.
- the image transmission module of the photographing device transmits the photographed image to the terminal device. In this way, the sharpness of the image is improved.
- FIG. 3 is a schematic flowchart diagram of another image processing method according to an embodiment of the present invention.
- the method may be performed by an image processing device, where a specific explanation of the image processing device is as described above.
- the difference between the embodiment of the present invention and the embodiment shown in FIG. 2 is that the embodiment of the present invention acquires the terminal according to the connection manner of the communication connection for transmitting images established between the acquired camera device and the terminal device. Image processing information of the device.
- S301 When acquiring a startup instruction of the photographing device, detecting whether a communication connection for transmitting an image is established between the photographing device and the terminal device.
- the image processing device may detect whether a communication connection for transmitting an image is established between the imaging device and the terminal device.
- the connection mode for establishing the communication connection may be acquired.
- the connection manner of the communication connection includes a wired communication connection manner and a wireless communication connection manner
- the wired communication connection manner includes a physical interface such as a high definition multimedia interface (HDMI) wired communication.
- the connection mode, the wireless communication connection mode includes a wireless communication connection mode such as Wi-Fi or Bluetooth.
- S303 Acquire image processing information of the terminal device according to the connection manner.
- the image processing device may acquire the image processing information of the terminal device according to the obtained connection manner between the image processing device and the terminal device.
- the image processing device detects that the connection mode of the communication connection is a wired communication connection mode
- the communication protocol corresponding to the wired communication connection mode may be acquired, and acquired according to the communication protocol.
- Image processing information of the terminal device The wired communication connection manner is as described above, and details are not described herein again. For example, assuming that the connection mode of the communication connection is a wired communication connection mode, and the wired communication connection mode is communication through a physical interface HDMI, if the image processing device acquires image processing information of the terminal device, Detecting that the connection manner of the communication connection is a communication connection established through the physical interface HDMI, the image processing device may acquire a communication protocol corresponding to the HDMI interface, and acquire the terminal device according to the communication protocol. Image processing information.
- the image processing device when the image processing device acquires image processing information of the terminal device, if it is detected that the connection mode of the communication connection is a wireless communication connection mode, the image communication device may correspond to the wireless communication connection mode.
- the communication link is tested to obtain the bandwidth information, and the image processing information of the terminal device is obtained according to the bandwidth information.
- the link information of the communication connection may be acquired.
- the link information of the communication connection includes information such as a link bandwidth, a communication protocol, and a bandwidth required by the communication protocol, which are not specifically limited in the embodiment of the present invention.
- S305 Determine an image processing policy according to the image processing information and the link information.
- the image processing device may determine an image processing policy according to the image processing information and the link information.
- the image processing apparatus may acquire image processing information of the terminal device for displaying an image and the communication connection when detecting a communication connection for transmitting an image between the photographing device and the terminal device. Link information, and determining an image processing policy based on the image processing information and the link information.
- S306 Control the photographing device to capture an acquired image according to the indication of the image processing strategy, and control the image transmitting module of the photographing device to transmit the captured image to the terminal device according to the indication of the image processing strategy.
- the image processing apparatus may control the photographing apparatus to capture an acquired image according to the indication of the image processing strategy, and control an image that the image capturing module of the photographing apparatus will capture according to the indication of the image processing strategy. Transmitted to the terminal device.
- the image processing device may configure a shooting parameter of the shooting device according to an indication of the image processing policy, and control the shooting device to shoot according to the shooting parameter configured by the image processing policy. Acquiring an image, wherein, under the shooting parameters, an image sensor of the photographing device captures an image that matches the display information and the codec information.
- the image processing device may control, according to the indication of the image processing policy, a map transfer adapter of the image processing device to configure a photographing parameter of the photographing device, such as link information, resolution, and frame rate. And transmitting the shooting parameter to an image sensor of the photographing device, so that the image sensor captures an image that matches the display information and the codec information according to the photographing parameter. For example, if the image processing device configures the shooting parameter of the photographing device to have a resolution of 1024*768 according to the display information of the terminal device indicated by the image processing policy, the image processing device may set the shooting parameter. And transmitted to the image sensor of the photographing device, so that the image sensor captures an image with a resolution of 1024*768 according to the photographing parameter.
- the image processing device may control, according to the indication of the image processing policy, an encoding module of the capturing device to perform encoding processing on the captured image by using a target code stream, and according to the image processing strategy. Instructing to control the image transmission module of the photographing device to transmit the data obtained by the encoding process to the terminal device.
- the determined image processing policy indicates an encoding parameter associated with the codec information.
- the image processing device may configure, according to the indication of the image processing policy, an encoding parameter of an encoding module of the capturing device, where the encoding module of the capturing device is captured by the target code stream pair The image is encoded.
- the description of the coding parameters is as described above, and details are not described herein again.
- the encoding parameter is determined according to any one or more kinds of information that the image processing device acquires the link information of the communication connection, the display information included in the image processing information, and the codec information.
- the correspondence between the encoding parameter and the link information, the display information included in the image processing information, and the codec information is as shown in Table 1.
- the image processing information includes transmission protocol information of the terminal device, the determined image processing policy indicating a transmission protocol parameter associated with the transmission protocol information.
- the image processing device may, according to the instruction of the image processing policy, control the image transmission module of the imaging device to transmit the data obtained by the encoding process to the terminal device, according to an indication of the image processing policy, Configuring a transmission protocol parameter of the image transmission module of the photographing device, where the image transmission module of the photographing device encapsulates the data obtained by the encoding process, and transmits the data obtained by the encoding process to the
- the terminal device is configured to cause the mobile terminal device to parse and restore an image captured by the photographing device from the received data, and display the image on the display screen of the terminal device.
- the image processing device may according to the acquired new display.
- the information re-determines the image processing strategy, and controls the photographing device to capture the acquired image according to the indication of the re-determined image processing strategy.
- the image processing device acquires image processing information of the terminal device according to a connection manner of a communication connection for transmitting an image established between the camera device and the terminal device, and acquires link information of the communication connection. Determining an image processing policy according to the image processing information and the link information, and controlling the photographing device to capture an acquired image according to an indication of the image processing policy, and controlling the image according to an indication of the image processing policy.
- the image transmission module of the photographing device transmits the photographed image to the terminal device. In this way, the clarity of the image transmitted image is improved, and the waste of communication link resources is avoided.
- FIG. 4 is a schematic flowchart diagram of still another image processing method according to an embodiment of the present invention.
- the method may be performed by an image processing device, where a specific explanation of the image processing device is as described above.
- the difference between the embodiment of the present invention and the foregoing embodiment shown in FIG. 3 is that, if the embodiment of the present invention detects that the camera device has turned on the dynamic adjustment function of the image processing, the image processing information extraction request may be sent to the terminal device to Obtaining image processing information of the terminal device.
- the image processing device detects that a communication connection for transmitting an image is established between the photographing device and the terminal device, it may be detected whether the photographing device turns on the dynamic adjustment function of the image processing.
- step S402 If the detection result is yes, send an extraction request of the image processing information to the terminal device to acquire image processing information of the terminal device, and execute step S404.
- the image processing device may send an extraction request of the image processing information to the terminal device to obtain Image processing information of the terminal device.
- the manner of turning on the dynamic adjustment function of the image processing is as described above, and details are not described herein again.
- step S403 If it is detected that the camera does not turn on the dynamic adjustment function of the image processing, the preset information is determined as the image processing information of the terminal device, and step S404 is performed.
- the preset information may be determined as the terminal device.
- Image processing information includes any one or more of preset display information, codec information, and transmission protocol information.
- the image processing apparatus may set any one or more of preset display information, codec information, transmission protocol information, and the like. It is determined as image processing information of the terminal device.
- the image processing apparatus may receive a user operation generated on the configuration interface, and Obtaining image processing information that is configured by the user operation on the configuration interface.
- the user action generated on the configuration interface is for a user to manually configure image processing information on the configuration interface.
- the image processing device may receive a user operation on the configuration interface of the user, and acquire image processing information such as a code stream size, a resolution, an encoding format, and the like configured by the user operation.
- the image processing apparatus may receive a user operation generated on the configuration interface, and Obtaining image processing information of the default configuration selected by the user operation.
- the link information of the communication connection may be acquired.
- the link information of the communication connection includes information such as a link bandwidth, a communication protocol, and a bandwidth required by the communication protocol, which are not specifically limited in the embodiment of the present invention.
- S405 Determine an image processing policy according to the image processing information and the link information.
- the image processing device may determine an image processing policy according to the image processing information and the link information.
- the image processing apparatus may acquire image processing information of the terminal device for displaying an image and the communication connection when detecting a communication connection for transmitting an image between the photographing device and the terminal device. Link information, and determining an image processing policy based on the image processing information and the link information.
- S406 Control the photographing device to capture an acquired image according to the indication of the image processing strategy, and control the image transmitting module of the photographing device to transmit the captured image to the terminal device according to the indication of the image processing strategy.
- the image processing apparatus may control the photographing apparatus to capture an acquired image according to the indication of the image processing strategy, and control an image that the image capturing module of the photographing apparatus will capture according to the indication of the image processing strategy. Transmitted to the terminal device.
- the specific implementation is as described above, and details are not described herein again.
- the image processing device determines an image processing policy according to the acquired image processing information and link information, and controls the camera to capture an image according to the indication of the image processing policy, and according to the image.
- the indication of the processing policy controls the image transmission module of the photographing device to transmit the captured image to the terminal device. In this way, waste of communication link resources is avoided, and the clarity of the image transmitted image is improved.
- FIG. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
- the image processing device includes: a memory 501, a processor 502, and a data interface 503.
- the memory 501 may include a volatile memory; the memory 501 may also include a non-volatile memory; the memory 501 may also include a combination of the above types of memory.
- the processor 502 can be a central processing unit (CPU).
- the processor 502 may further include a hardware chip.
- the hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. Specifically, for example, it may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
- ASIC application-specific integrated circuit
- PLD programmable logic device
- FPGA field-programmable gate array
- the memory 501 is configured to store program instructions, and when the program instructions are executed, the processor 502 may call program instructions stored in the memory 501 for performing the following steps:
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- the display information includes a resolution and/or a frame rate of a display screen of the terminal device, and the determined image processing policy includes a shooting parameter that matches the display information and the codec information.
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- the image transmission module that controls the imaging device transmits the data obtained by the encoding process to the terminal device.
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- an encoding parameter of the encoding module of the imaging device where the encoding module of the imaging device performs encoding processing on the captured image by the target code stream.
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- the image processing information of the terminal device is acquired.
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- connection mode of the communication connection is a wired communication connection mode
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- connection mode of the communication connection is a wireless communication connection mode
- testing the communication link corresponding to the wireless communication connection mode to obtain bandwidth information
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- the preset information is determined as the image processing information of the terminal device.
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- processor 502 calls a program instruction stored in the memory 501 for performing the following steps:
- the image processing device when detecting that a communication connection for transmitting an image is established between the photographing device and the terminal device, acquires image processing information of the terminal device, and acquires link information of the communication connection. Determining an image processing policy according to the image processing information and the link information, and controlling the photographing device to capture an acquired image according to an indication of the image processing policy, and controlling the image according to an indication of the image processing policy.
- the image transmission module of the photographing device transmits the photographed image to the terminal device. In this way, the degree of matching between the image transmission resolution and the image processing information of the terminal device for displaying an image is improved, thereby improving the sharpness of the image.
- An embodiment of the present invention further provides an image processing system, including: an image processing device and a terminal device;
- the image processing device is configured to acquire image processing information of the terminal device if a communication connection for transmitting an image is established between the camera device and the terminal device, and acquire link information of the communication connection; Determining an image processing strategy according to the image processing information and the link information; controlling the photographing device to capture an acquired image according to the indication of the image processing policy, and controlling the photographing device according to the indication of the image processing strategy
- the image transmission module transmits the captured image to the terminal device;
- the terminal device is configured to receive an image transmitted by the image processing device, and display the received image on a display screen of the terminal device.
- the image processing device is configured to determine the image processing policy according to the acquired display information and codec information of the terminal device, where the display information includes a resolution of a display screen of the terminal device. Rate and/or frame rate, the determined image processing strategy including shooting parameters that match the display information and the codec information.
- the image processing device is configured to configure a shooting parameter of the shooting device according to an instruction of the image processing policy; and control the capturing device to capture an image according to the shooting parameter configured by the image processing policy Under the shooting parameters, the image sensor of the photographing device captures an image that matches the display information.
- the image processing device is configured to control, according to an instruction of the image processing policy, the encoding device to perform encoding processing on the captured image by using a target code stream; and controlling the image according to the indication of the image processing policy
- the image transmission module of the photographing device transmits the data obtained by the encoding process to the terminal device.
- the image processing device is configured to configure, according to an instruction of the image processing policy, an encoding parameter of an encoding module of the capturing device, where the encoding module of the capturing device uses the target
- the code stream encodes the captured image.
- the image processing device is configured to configure a transmission protocol parameter of the image transmission module of the imaging device according to the indication of the image processing policy, and the image transmission module of the imaging device is configured under the transmission protocol parameter Transmitting the data obtained by the encoding process to the terminal device.
- the image processing device is configured to detect, when the startup instruction of the photographing device is acquired, whether a communication connection for transmitting an image is established between the photographing device and the terminal device; Yes, the image processing information of the terminal device is acquired.
- the image processing device is configured to acquire a connection manner for establishing the communication connection if a communication connection for transmitting an image is established between the photographing device and the terminal device; according to the connection In a manner, the image processing information of the terminal device is obtained.
- the image processing device is configured to acquire a communication protocol corresponding to the wired communication connection mode if the connection mode of the communication connection is detected as a wired communication connection mode; and acquire the Image processing information of the terminal device.
- the image processing device is configured to: if the connection mode of the communication connection is detected as a wireless communication connection mode, test the communication link corresponding to the wireless communication connection mode to obtain bandwidth information; according to the bandwidth Information, acquiring image processing information of the terminal device.
- the image processing device is further configured to detect whether the photographing device turns on a dynamic adjustment function of image processing if a communication connection for transmitting an image is established between the photographing device and the terminal device; If the detection result is yes, an extraction request of the image processing information is sent to the terminal device to acquire image processing information of the terminal device.
- the image processing device is configured to determine preset information as image processing information of the terminal device if it is detected that the camera does not turn on the dynamic adjustment function of the image processing.
- the image processing device is configured to: if a dynamic adjustment function of the image processing is not turned on by the photographing device, receive a user operation generated on the configuration interface; and obtain the user operation to be configured on the configuration interface The resulting image processing information.
- the image processing apparatus is configured to: if a dynamic adjustment function of the image processing is not turned on by the photographing apparatus, receive a user operation generated on the configuration interface; acquire an image of the default configuration selected by the user operation Process information.
- the image processing device when detecting that a communication connection for transmitting an image is established between the photographing device and the terminal device, acquires image processing information of the terminal device, and acquires link information of the communication connection. Determining an image processing policy according to the image processing information and the link information, and controlling the photographing device to capture an acquired image according to an indication of the image processing policy, and controlling the image according to an indication of the image processing policy.
- the image transmission module of the photographing device transmits the photographed image to the terminal device. In this way, the degree of matching between the image transmission resolution and the image processing information of the terminal device for displaying an image is improved, thereby improving the sharpness of the image.
- FIG. 5 Also provided in an embodiment of the present invention is a computer readable storage medium storing a computer program that, when executed by a processor, implements FIG. 2, FIG. 3, or FIG.
- the image processing device of the embodiment of the present invention shown in FIG. 5 can also be implemented in the image processing method of the embodiment described in FIG. 5, and details are not described herein again.
- the computer readable storage medium may be an internal storage unit of the device described in any of the preceding embodiments, such as a hard disk or a memory of the device.
- the computer readable storage medium may also be an external storage device of the device, such as a plug-in hard disk equipped on the device, a smart memory card (SMC), and a secure digital (SD) card. , Flash Card, etc.
- the computer readable storage medium may also include both an internal storage unit of the device and an external storage device.
- the computer readable storage medium is for storing the computer program and other programs and data required by the terminal.
- the computer readable storage medium can also be used to temporarily store data that has been output or is about to be output.
- the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明实施例提供了一种图像处理方法、设备、系统及存储介质,其中,方法包括:检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;获取所述通信连接的链路信息;根据所述图像处理信息和所述链路信息,确定出图像处理策略;根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,提高了图传图像的清晰度,避免了通信链路资源浪费。
Description
本发明涉及控制技术领域,尤其涉及一种图像处理方法、设备、系统及存储介质。
随着计算机技术的发展,图像处理系统的应用越来越广泛,所述图像处理系统包括图像处理设备和终端设备,所述图像处理设备包括设置有拍摄装置的无人飞行器、无人汽车、机器人等设备,所述终端设备包括用于显示图像的手机、平板电脑等智能终端。以设置有图像处理设备的无人飞行器为例,所述图像处理设备可以将挂载在所述无人飞行器上的拍摄装置拍摄得到的图像传输至终端设备上显示。
然而,在图像传输的过程中,由于终端设备的分辨率等显示信息与图像处理设备中拍摄装置拍摄得到的图像的显示信息不同,以及通信链路的链路带宽等链路信息的不同,可能导致图像处理设备向终端设备传输图像时出现画质较差、图像模糊、带宽资源浪费等问题。因此如何更有效地传输图像成为研究的热点问题。
发明内容
本发明实施例提供了一种图像处理方法、设备、系统及存储介质,可避免通信链路资源浪费,提高图传图像的清晰度。
第一方面,本发明实施例提供了一种图像处理方法,包括:
检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;
获取所述通信连接的链路信息;
根据所述图像处理信息和所述链路信息,确定出图像处理策略;
根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
第二方面,本发明实施例提供了一种图像处理设备,包括存储器和处理器;
所述存储器,用于存储程序指令;
所述处理器,执行所述存储器存储的程序指令,当程序指令被执行时,所述处理器用于执行如下步骤:
检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;
获取所述通信连接的链路信息;
根据所述图像处理信息和所述链路信息,确定出图像处理策略;
根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
第三方面,本发明实施例提供了一种图像处理系统,包括:图像处理设备和终端设备,
所述图像处理设备,用于检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;获取所述通信连接的链路信息;根据所述图像处理信息和所述链路信息,确定出图像处理策略;根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备;
所述终端设备,用于接收所述图像处理设备传输的图像,并将接收到的所述图像显示于所述终端设备的显示屏上。
第四方面,本发明实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序被处理器执行时实现如上述第一方面所述的图像处理方法。
本发明实施例中,图像处理设备根据获取到的所述终端设备的图像处理信息和所述通信连接的链路信息确定出图像处理策略,根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,避免了通信链路资源浪费,提高了图传图像的清晰度。
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种图像处理系统的结构示意图;
图2是本发明实施例提供的一种图像处理方法的流程示意图;
图3是本发明实施例提供的另一种图像处理方法的流程示意图;
图4是本发明实施例提供的又一种图像处理方法的流程示意图;
图5是本发明实施例提供的一种图像处理设备的结构示意图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
下面结合附图,对本发明的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。
本发明实施例中提供的图像处理方法可以由图像处理设备执行,所述图像处理设备可以设置在配置有拍摄装置的飞行器(如无人机)、无人汽车、机器人、移动终端(如手机)等设备上。所述拍摄装置包括图传适配器、图像参数调整模块、图传模块、编码模块、图像传感器等。所述图像处理设备可以控制拍摄装置的图像传感器拍摄得到图像,并控制所述拍摄装置的图传模块将拍摄得到的图像传输给用于显示所述图像的终端设备。在一个实施例中,所述用于显示所述图像的终端设备可以包括手机、平板电脑、智能手表等终端设备。在其他实施例中,所述图像处理方法还可以应用于挂载有拍摄装置的其他终端设备上,本发明实施例不做具体限定。
本发明实施例中,图像处理设备如果检测到拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以获取所述终端设备的图像处理信息,并获取所述通信连接的链路信息。所述图像处理设备可以根据所述图像处理信息和 所述链路信息,确定出图像处理策略,根据所述图像处理策略的指示控制所述拍摄装置的图像传感器拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,实现了所述图像处理设备通过预先获取终端设备的图像处理信息和链路信息,来动态地调整图传的分辨率和码流等图像处理信息,并根据调整后的图像处理信息控制拍摄装置的图传模块向所述终端设备传输图像,让用户能够获取到更佳的画质体验。
在一个实施例中,所述图像处理设备可以获取到所述拍摄装置的启动指令,并可以在获取到所述拍摄装置的启动指令时,检测所述拍摄装置与所述终端设备之间是否建立了用于传输图像的通信连接。如果检测出所述拍摄装置与所述终端设备建立通信连接,则所述图像处理设备可以获取所述终端设备的图像处理信息。
在一个实施例中,所述终端设备的图像处理信息包括:显示信息、编解码信息、传输协议信息等任意一种或多种,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,本发明实施例不做具体限定。在一个实施例中,所述终端设备是指与所述图像处理设备建立用于图像传输的通信连接,并用于显示所述图像处理设备传输的图像的终端设备,所述终端设备包括手机、平板电脑、智能手表等智能终端,本发明实施例不做具体限定。
在一个实施例中,所述图像处理设备如果检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接,则可以获取建立所述通信连接的连接方式,并根据所述连接方式,获取所述终端设备的图像处理信息。
在一个实施例中,所述通信连接的连接方式包括有线通信连接方式,所述图像处理设备在检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接时,如果检测到所述通信连接的连接方式为有线通信连接方式,则可以获取与所述有线通信连接方式对应的通信协议,并根据所述通信协议,获取所述终端设备的图像处理信息。在一个实施例中,所述有线通信连接方式包括物理接口如高清晰度多媒体接口(High Definition Multimedia Interface,HDMI)等有线通信连接方式。例如,假设所述通信连接的连接方式为有线通信连接方式,且所述有线通信连接方式是通过物理接口HDMI实现通信的,如果所述图像处理设备检测到所述通信连接的连接方式是通过物理接口 HDMI建立的通信连接,则所述图像处理设备可以获取与所述HDMI接口对应的通信协议,并根据所述通信协议,获取所述终端设备的图像处理信息(如分辨率等显示信息)。
在一个实施例中,所述通信连接的连接方式包括无线通信连接方式,所述图像处理设备在检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接时,如果检测到所述通信连接的连接方式为无线通信连接方式,则可以对所述无线通信连接方式对应的通信链路进行测试得到链路带宽等链路信息,并根据所述链路信息,获取所述终端设备的图像处理信息。在一个实施例中,所述无线通信连接方式包括但不限定于Wi-Fi、蓝牙等无线通信连接方式。例如,假设所述图像处理设备在检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接时,检测到所述通信连接的连接方式为Wi-Fi连接,并获取到所述通信链路的链路带宽为2M,则所述图像处理设备可以根据所述2M的链路带宽,获取所述终端设备的图像处理信息。
在一个实施例中,所述图像处理设备如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以检测所述拍摄装置是否开启图像处理的动态调整功能,如果检测结果为开启,则可以向所述终端设备发送图像处理信息的提取请求,以使所述终端设备根据所述提取请求提取终端设备的图像处理信息,并将提取到的所述图像处理信息发送给所述图像处理设备,从而使所述图像处理设备获取得到所述终端设备的图像处理信息。
在一个实施例中,所述开启所述图像处理的动态调整功能的方式包括:通过获取安装在所述终端设备上的APP的开启操作,通过对所述拍摄装置内置的用于开启图像处理的动态调整功能的菜单(如触控板)的触控操作,或对所述拍摄装置设置的用于开启图像处理的动态调整功能的物理按键的点击操作的方式来打开或者关闭所述图像处理的动态调整功能。
在一个实施例中,所述图像处理设备如果检测到所述拍摄装置未开启图像处理的动态调整功能,则可以将预设信息确定为所述终端设备的图像处理信息。在一个实施例中,所述预设信息包括预设的显示信息、预设的编解码信息、预设的传输协议信息等任意一种或多种。例如,假设预先设置的显示信息包括预设的分辨率1024*768,如果所述图像处理设备检测到所述拍摄装置未开启图像处理的动态调整功能,则所述图像处理设备可以将所述预设的分辨率 1024*768确定为所述终端设备的图像处理信息。
在一个实施例中,所述图像处理设备如果检测到所述拍摄装置未开启图像处理的动态调整功能,则可以接收在配置界面上产生的用户操作,并获取所述用户操作在所述配置界面上配置得到的图像处理信息。在一个实施例中,所述在配置界面上产生的用户操作用于用户在所述配置界面上手动配置图像处理信息(如帧率、分辨率、编解码信息等)。具体地,所述图像处理设备可以接收用户在配置界面上的用户操作,并获取所述用户操作对应配置的帧率、分辨率、编码格式等图像处理信息。
在一个实施例中,所述图像处理设备在检测到所述拍摄装置启动之后,如果检测到所述拍摄装置未开启图像处理的动态调整功能,则可以接收在配置界面上产生的用户操作,并获取所述用户操作所选择的默认配置的图像处理信息。其中,所述默认配置的图像处理信息可以是用户设置的任意的图像处理信息(如分辨率、编解码信息等),本发明实施例不做具体限定。
在一个实施例中,所述图像处理设备获取到的所述图像处理信息包括:显示信息和编解码信息,所述图像处理设备可以根据获取到的所述终端设备的显示信息和编解码信息,确定出图像处理策略。在一个实施例中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略指示了与所述显示信息和所述编解码信息相匹配的拍摄参数。在一个实施例中,所述图像处理设备可以获取所述通信连接的链路信息,所述链路信息包括链路带宽、通信协议、所述通信协议所需要的带宽等信息,本发明实施例不做具体限定。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数,并根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,其中,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息和所述编解码信息匹配的图像。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,控制所述图像处理设备的图传适配器配置所述拍摄装置的拍摄参数,如链路信息、分辨率、帧率等,并将所述拍摄参数传输给所述拍摄装置的图像传感器中,以使所述图像传感器根据所述拍摄参数拍摄得到与所述显示信息和所述编解码信息相匹配的图像。例如,假设所述图像处理设备根据所述图像处理策略指 示的终端设备的显示信息,配置所述拍摄装置的拍摄参数为分辨率为1024*768,则所述图像处理设备可以将所述拍摄参数传输给所述拍摄装置的图像传感器中,以使所述图像传感器根据所述拍摄参数拍摄得到分辨率为1024*768的图像。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,控制所述拍摄装置的编码模块以目标码流对拍摄得到的图像进行编码处理,并根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
在一个实施例中,所述确定的图像处理策略指示了与所述编解码信息关联的编码参数。所述图像处理设备可以根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。其中,所述编码参数包括封装格式(如GOP或GDR)、codec类型(如HEVC、H264等)、bitrate类型(CBR、VBR、CVBR等)、I frame和P frame的ratio等任意一种或多种。在一个实施例中,所述编码参数是根据所述图像处理设备获取到通信连接的链路信息、图像处理信息中包括的显示信息、编解码信息中任意一种或多种信息确定的。例如,所述编码参数与所述链路信息、图像处理信息中包括的显示信息、编解码信息的对应关系可以包括但不限定于表1所示的对应关系。
表1
物理链路 | 移动终端,分辨率 | 封装格式 | 编码类型 | bitrate |
USB | iPad2,1024*768 | GOP | H264 | CBR |
USB | iPhone6,1134*750 | GDR | H264 | CBR |
USB/Wi-Fi | iPadPro,2224*1668 | GDR | H265 | VBR |
Wi-Fi | iPad2,1024*768 | GDR | H265 | CBR |
Wi-Fi | iPhone6,1134*750 | GDR | H265 | VBR |
在一个实施例中,所述图像处理信息包括所述终端设备的传输协议信息,所述确定的图像处理策略指示了与所述传输协议信息关联的传输协议参数。所述图像处理设备在根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备时,可以根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议 参数下,所述拍摄装置的图传模块封装所述编码处理得到的数据,将所述编码处理得到的数据传输给所述终端设备,以使所述终端设备从接收到的数据中解析出封装格式(如GOP或GDR)、codec类型(如HEVC或H264)、bitrate类型(如CBR、VBR、CVBR等)、I frame和P frame的ratio等参数,然后解析还原出所述拍摄装置拍摄得到的图像,并显示在所述终端设备的显示屏上。
在一个实施例中,如果在图像传输过程中,所述图像处理设备检测到获取到的终端设备的图像处理信息中的显示信息发生变化,则可以根据获取到的新的显示信息重新确定图像处理策略,并根据所述重新确定的图像处理策略的指示,控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示传输所述图像给所述终端设备。
下面结合附图对应用于配置有拍摄装置的终端的图像处理方法进行举例说明。
请参见图1,图1是本发明实施例提供的一种图像处理系统的结构示意图,如图1所示的图像处理系统包括:图像处理设备11和终端设备12,所述图像处理设备11中包括:图传适配器111、图像传感器112、编码模块113、图传模块114,所述终端设备12中包括:解码模块121、显示模块122、信息提取模块123。
在一个实施例中,所述图像处理系统可以通过所述图像处理设备11检测所述图像处理设备11是否与所述终端设备12之间建立了用于传输图像的通信连接,如果检测结果为是,则所述图像处理设备11可以向所述终端设备12发送图像处理信息的提取请求,所述终端设备12接收到所述提取请求后,通过信息提取模块123提取得到所述终端设备12的图像处理信息,并将所述图像处理信息发送给所述图像处理设备11,使得所述图像处理设备11获取得到所述终端设备12的图像处理信息,所述图像处理设备11还可以获取所述通信连接的通信协议、链路带宽等链路信息。所述图像处理设备11可以根据所述图像处理信息和所述链路信息,确定出图像处理策略。所述图像处理设备11可以根据所述图像处理策略的指示,控制所述图像处理设备11的图传适配器111配置所述图像处理设备11中配置的拍摄装置的拍摄参数,如链路信息、分辨率、帧率等任意一种或多种,并将所述拍摄参数传输给所述拍摄装置的图像传感器112中,以使所述图像传感器112根据所述拍摄参数拍摄得到与所述显示 信息和所述编解码信息相匹配的图像。所述图像处理设备11可以通过所述编码模块113对所述图像传感器112拍摄得到的图像进行编码处理,并通过图传模块114将拍摄得到的图像传输给所述终端设备12。所述终端设备12接收到所述图像之后,通过所述解码模块121对接收到的所述图像进行解码处理,并通过显示模块122输出显示解码得到的图像。
请参见图2,图2是本发明实施例提供的一种图像处理方法的流程示意图,所述方法可以由图像处理设备执行,所述图像处理设备上设置有拍摄装置,其中,所述图像处理设备的具体解释如前所述。具体地,本发明实施例的所述方法包括如下步骤。
S201:检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取终端设备的图像处理信息。
本发明实施例中,图像处理设备检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,可以获取终端设备的图像处理信息。在一个实施例中,所述图像处理信息包括终端设备的显示信息、编解码信息、传输协议信息等任意一种或多种,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,本发明实施例不做限定。该实施方式通过获取终端设备的图像处理信息,以使所述图像处理设备可以根据所述图像处理信息确定出与所述终端设备相对应的图像处理策略,以提高图像显示在所述终端设备上的清晰度。
在一个实施例中,图像处理设备如果获取到设置在所述图像处理设备上的拍摄装置的启动指令,则所述图像处理设备可以检测所述拍摄装置是否与所述终端设备之间建立了用于传输图像的通信连接。
S202:获取所述通信连接的链路信息。
本发明实施例中,图像处理设备如果检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以获取所述通信连接的链路信息。在一个实施例中,所述通信连接的链路信息包括链路带宽、通信协议、所述通信协议所需要的带宽等任意一种或多种信息,本发明实施例不做具体限定。
S203:根据所述图像处理信息和所述链路信息,确定出图像处理策略。
本发明实施例中,图像处理设备可以根据所述图像处理信息和所述链路信息,确定出图像处理策略。在一个实施例中,图像处理设备可以在检测到所述拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取用于显示图 像的终端设备的图像处理信息和所述通信连接的链路信息,并根据所述图像处理信息和所述链路信息,确定出图像处理策略。
在一个实施例中,所述图像处理设备获取到的与所述图像处理设备建立通信连接的终端设备的图像处理信息包括显示信息和编解码信息。所述图像处理设备可以根据获取到的所述终端设备的显示信息和编解码信息,确定出所述图像处理策略。在一个实施例中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略指示了与所述显示信息和所述编解码信息相匹配的拍摄参数。
具体可举例说明,假设所述图像处理设备获取到的图像处理信息中的显示信息包括的所述终端设备的显示屏的分辨率为1024*768、帧率为18fps,则所述图像处理设备可以根据获取到的所述终端设备的分辨率为1024*768、帧率为18fps和编解码信息,确定出图像处理策略,其中,所述确定的图像处理策略指示了与所述分辨率为1024*768、帧率为18fps的显示信息和所述编解码信息相匹配的拍摄参数。
S204:根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
本发明实施例中,图像处理设备可以根据所述图像处理策略的指示控制所述拍摄装置的图像传感器拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数,并根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置的图像传感器拍摄获取图像,其中,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息和所述编解码信息匹配的图像。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,控制所述图像处理设备的图传适配器配置所述拍摄装置的拍摄参数,如链路信息、分辨率、帧率等,并将所述拍摄参数传输给所述拍摄装置的图像传感器中,以使所述图像传感器根据所述拍摄参数拍摄得到与所述显示信息和所述编解码信息相匹配的图像。例如,假设所述图像处理设备根据所述图像处理策略指 示的终端设备的显示信息,配置所述拍摄装置的拍摄参数为分辨率为1024*768,则所述图像处理设备可以将所述拍摄参数传输给所述拍摄装置的图像传感器中,以使所述图像传感器根据所述拍摄参数拍摄得到分辨率为1024*768的图像。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,控制所述拍摄装置的编码模块以目标码流对拍摄得到的图像进行编码处理,并根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
在一个实施例中,所述确定的图像处理策略指示了与所述编解码信息关联的编码参数。所述图像处理设备可以根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。其中,所述编码参数包括封装格式(如GOP或GDR)、codec类型(如HEVC、H264等)、bitrate类型(CBR、VBR、CVBR等)、I frame和P frame的ratio等任意一种或多种。
在一个实施例中,所述编码参数是根据所述图像处理设备获取到通信连接的链路信息、图像处理信息中包括的显示信息、编解码信息中任意一种或多种信息确定的。在一个实施例中,所述编码参数与所述链路信息、图像处理信息中包括的显示信息、编解码信息的对应关系的举例如表1所示。
在一个实施例中,所述图像处理信息包括所述终端设备的传输协议信息,所述确定的图像处理策略指示了与所述传输协议信息关联的传输协议参数。所述图像处理设备在根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备时,可以根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块封装所述编码处理得到的数据,将所述编码处理得到的数据传输给所述终端设备,以使所述移动终端设备从接收到的数据中解析出封装格式(如GOP或GDR)、codec类型(如HEVC或H264)、bitrate类型(如CBR、VBR、CVBR等)、I frame和P frame的ratio等参数,然后解析还原出所述拍摄装置拍摄得到的图像,并显示在所述终端设备的显示屏上。
在一个实施例中,如果在图像传输过程中,所述图像处理设备检测到获取 到的终端设备的图像处理信息中的显示信息发生变化,则所述图像处理设备可以根据获取到的新的显示信息重新确定图像处理策略,并根据所述重新确定的图像处理策略的指示,控制所述拍摄装置的图像传感器拍摄获取图像,具体的实施过程与上述实施过程相同,此处不再赘述。
本发明实施例中,图像处理设备在检测到拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息,并获取所述通信连接的链路信息,根据所述图像处理信息和所述链路信息,确定出图像处理策略,以及根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,提高了图像的清晰度。
请参见图3,图3是本发明实施例提供的另一种图像处理方法的流程示意图,所述方法可以由图像处理设备执行,其中,图像处理设备的具体解释如前所述。本发明实施例与上述图2所述实施例的区别在于,本发明实施例是根据获取到的拍摄装置与所述终端设备之间建立的用于传输图像的通信连接的连接方式,来获取终端设备的图像处理信息。
S301:当获取到拍摄装置的启动指令时,检测所述拍摄装置与终端设备之间是否建立了用于传输图像的通信连接。
本发明实施例中,图像处理设备如果获取到设置在所述图像处理设备上的拍摄装置的启动指令,则可以检测所述拍摄装置与终端设备之间是否建立了用于传输图像的通信连接。
S302:如果检测结果为是,则获取建立所述通信连接的连接方式。
本发明实施例中,图像处理设备如果检测到设置在所述图像处理设备上的拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以获取建立所述通信连接的连接方式。在一个实施例中,所述通信连接的连接方式包括有线通信连接方式和无线通信连接方式,所述有线通信连接方式包括物理接口如高清晰度多媒体接口(High Definition Multimedia Interface,HDMI)等有线通信连接方式,所述无线通信连接方式包括Wi-Fi、蓝牙等无线通信连接方式。
S303:根据所述连接方式,获取所述终端设备的图像处理信息。
本发明实施例中,所述图像处理设备可以根据获取到的所述图像处理设备和所述终端设备建立通信连接的连接方式,获取所述终端设备的图像处理信 息。
在一个实施例中,所述图像处理设备如果检测到所述通信连接的连接方式为有线通信连接方式,则可以获取与所述有线通信连接方式对应的通信协议,并根据所述通信协议,获取所述终端设备的图像处理信息。其中,所述有线通信连接方式如上所述,此处不再赘述。例如,假设所述通信连接的连接方式为有线通信连接方式,且所述有线通信连接方式是通过物理接口HDMI实现通信的,如果所述图像处理设备在获取所述终端设备的图像处理信息时,检测到所述通信连接的连接方式是通过物理接口HDMI建立的通信连接,则所述图像处理设备可以获取与所述HDMI接口对应的通信协议,并根据所述通信协议,获取所述终端设备的图像处理信息。
在一个实施例中,所述图像处理设备在获取所述终端设备的图像处理信息时,如果检测到所述通信连接的连接方式为无线通信连接方式,则可以对所述无线通信连接方式对应的通信链路进行测试得到带宽信息,并根据所述带宽信息,获取所述终端设备的图像处理信息,具体实施例和举例如上所述,此处不再赘述。
S304:获取所述通信连接的链路信息。
本发明实施例中,图像处理设备如果检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以获取所述通信连接的链路信息。在一个实施例中,所述通信连接的链路信息包括链路带宽、通信协议、所述通信协议所需要的带宽等信息,本发明实施例不做具体限定。
S305:根据所述图像处理信息和所述链路信息,确定出图像处理策略。
本发明实施例中,图像处理设备可以根据所述图像处理信息和所述链路信息,确定出图像处理策略。在一个实施例中,图像处理设备可以在检测到所述拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取用于显示图像的终端设备的图像处理信息和所述通信连接的链路信息,并根据所述图像处理信息和所述链路信息,确定出图像处理策略。
S306:根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
本发明实施例中,图像处理设备可以根据所述图像处理策略的指示控制所 述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数,并根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,其中,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息和所述编解码信息匹配的图像。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,控制所述图像处理设备的图传适配器配置所述拍摄装置的拍摄参数,如链路信息、分辨率、帧率等,并将所述拍摄参数传输给所述拍摄装置的图像传感器中,以使所述图像传感器根据所述拍摄参数拍摄得到与所述显示信息和所述编解码信息相匹配的图像。例如,假设所述图像处理设备根据所述图像处理策略指示的终端设备的显示信息,配置所述拍摄装置的拍摄参数为分辨率为1024*768,则所述图像处理设备可以将所述拍摄参数传输给所述拍摄装置的图像传感器中,以使所述图像传感器根据所述拍摄参数拍摄得到分辨率为1024*768的图像。
在一个实施例中,所述图像处理设备可以根据所述图像处理策略的指示,控制所述拍摄装置的编码模块以目标码流对拍摄得到的图像进行编码处理,并根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
在一个实施例中,所述确定的图像处理策略指示了与所述编解码信息关联的编码参数。所述图像处理设备可以根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。其中,所述编码参数的解释如上所述,此处不再赘述。
在一个实施例中,所述编码参数是根据所述图像处理设备获取到通信连接的链路信息、图像处理信息中包括的显示信息、编解码信息中任意一种或多种信息确定的。在一个实施例中,所述编码参数与所述链路信息、图像处理信息中包括的显示信息、编解码信息的对应关系的举例如表1所示。
在一个实施例中,所述图像处理信息包括所述终端设备的传输协议信息,所述确定的图像处理策略指示了与所述传输协议信息关联的传输协议参数。所 述图像处理设备在根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备时,可以根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块封装所述编码处理得到的数据,将所述编码处理得到的数据传输给所述终端设备,以使所述移动终端设备从接收到的数据中解析还原出所述拍摄装置拍摄得到的图像,并显示在所述终端设备的显示屏上。
在一个实施例中,如果在图像传输过程中,所述图像处理设备检测到获取到的终端设备的图像处理信息中的显示信息发生变化,则所述图像处理设备可以根据获取到的新的显示信息重新确定图像处理策略,并根据所述重新确定的图像处理策略的指示,控制所述拍摄装置拍摄获取图像,具体的实施过程与上述实施过程相同,此处不再赘述。
本发明实施例中,图像处理设备根据拍摄装置与终端设备之间建立的用于传输图像的通信连接的连接方式,获取所述终端设备的图像处理信息,并获取所述通信连接的链路信息,根据所述图像处理信息和所述链路信息,确定出图像处理策略,以及根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,提高了图传图像的清晰度,避免了通信链路资源浪费。
请参见图4,图4是本发明实施例提供的又一种图像处理方法的流程示意图,所述方法可以由图像处理设备执行,其中,图像处理设备的具体解释如前所述。本发明实施例与上述图3所述实施例的区别在于,本发明实施例如果检测到拍摄装置开启了图像处理的动态调整功能,则可以向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。
S401:如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则检测所述拍摄装置是否开启图像处理的动态调整功能。
本发明实施例中,如果所述图像处理设备检测到所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以检测所述拍摄装置是否开启图像处理的动态调整功能。
S402:如果检测结果为是,则向所述终端设备发送图像处理信息的提取请 求,以获取所述终端设备的图像处理信息,执行步骤S404。
本发明实施例中,如果所述图像处理设备检测到所述拍摄装置开启了图像处理的动态调整功能,则所述图像处理设设备可以向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。在一个实施例中,所述开启所述图像处理的动态调整功能的方式如上所述,此处不再赘述。
S403:如果检测到所述拍摄装置未开启图像处理的动态调整功能,则将预设信息确定为所述终端设备的图像处理信息,执行步骤S404。
本发明实施例中,所述图像处理设备在检测到所述拍摄装置启动之后,如果检测到所述拍摄装置未开启图像处理的动态调整功能,则可以将预设信息确定为所述终端设备的图像处理信息。在一个实施例中,所述预设信息包括预设的显示信息、编解码信息、传输协议信息等任意一种或多种。例如,如果所述图像处理设备检测到所述拍摄装置未开启图像处理的动态调整功能,则所述图像处理设备可以将预设的显示信息、编解码信息、传输协议信息等任意一种或多种确定为所述终端设备的图像处理信息。
在一个实施例中,所述图像处理设备在检测到所述拍摄装置启动之后,如果检测到所述拍摄装置未开启图像处理的动态调整功能,则可以接收在配置界面上产生的用户操作,并获取所述用户操作在所述配置界面上配置得到的图像处理信息。在一个实施例中,所述在配置界面上产生的用户操作用于用户在所述配置界面上手动配置图像处理信息。具体地,所述图像处理设备可以接收用户在配置界面上的用户操作,并获取所述用户操作对应配置的码流大小、分辨率、编码格式等图像处理信息。
在一个实施例中,所述图像处理设备在检测到所述拍摄装置启动之后,如果检测到所述拍摄装置未开启图像处理的动态调整功能,则可以接收在配置界面上产生的用户操作,并获取所述用户操作所选择的默认配置的图像处理信息。
S404:获取所述通信连接的链路信息。
本发明实施例中,图像处理设备如果检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接,则可以获取所述通信连接的链路信息。在一个实施例中,所述通信连接的链路信息包括链路带宽、通信协议、所述通信协议所需要的带宽等信息,本发明实施例不做具体限定。
S405:根据所述图像处理信息和所述链路信息,确定出图像处理策略。
本发明实施例中,图像处理设备可以根据所述图像处理信息和所述链路信息,确定出图像处理策略。在一个实施例中,图像处理设备可以在检测到所述拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取用于显示图像的终端设备的图像处理信息和所述通信连接的链路信息,并根据所述图像处理信息和所述链路信息,确定出图像处理策略。
S406:根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
本发明实施例中,图像处理设备可以根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。具体实施例如上所述,此处不再赘述。
本发明实施例中,图像处理设备根据获取到的图像处理信息和链路信息,确定出图像处理策略,以及根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,避免了通信链路资源浪费,提高了图传图像的清晰度。
请参见图5,图5是本发明实施例提供的一种图像处理设备的结构示意图。具体的,所述图像处理设备包括:存储器501、处理器502以及数据接口503。
所述存储器501可以包括易失性存储器(volatile memory);存储器501也可以包括非易失性存储器(non-volatile memory);存储器501还可以包括上述种类的存储器的组合。所述处理器502可以是中央处理器(central processing unit,CPU)。所述处理器502还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。具体例如可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
进一步地,所述存储器501用于存储程序指令,当程序指令被执行时所述处理器502可以调用存储器501中存储的程序指令,用于执行如下步骤:
检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;
获取所述通信连接的链路信息;
根据所述图像处理信息和所述链路信息,确定出图像处理策略;
根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
根据获取到的所述终端设备的显示信息和编解码信息,确定所述图像处理策略;
其中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略包括与所述显示信息和所述编解码信息相匹配的拍摄参数。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数;
根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息匹配的图像。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
根据所述图像处理策略的指示,控制所述拍摄装置以目标码流对拍摄得到的图像进行编码处理;
根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到 的图像进行编码处理。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
当获取到所述拍摄装置的启动指令时,检测所述拍摄装置与所述终端设备之间是否建立了用于传输图像的通信连接;
如果检测结果为是,则获取所述终端设备的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接,则获取建立所述通信连接的连接方式;
根据所述连接方式,获取所述终端设备的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到所述通信连接的连接方式为有线通信连接方式,则获取与所述有线通信连接方式对应的通信协议;
根据所述通信协议,获取所述终端设备的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到所述通信连接的连接方式为无线通信连接方式,则对所述无线通信连接方式对应的通信链路进行测试得到带宽信息;
根据所述带宽信息,获取所述终端设备的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则检测所述拍摄装置是否开启图像处理的动态调整功能;
如果检测结果为是,则向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到所述拍摄装置未开启图像处理的动态调整功能,则将预设信息确定为所述终端设备的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;
获取所述用户操作在所述配置界面上配置得到的图像处理信息。
进一步地,所述处理器502调用存储器501中存储的程序指令用于执行如下步骤:
如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;
获取所述用户操作所选择的默认配置的图像处理信息。
本发明实施例中,图像处理设备在检测到拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息,并获取所述通信连接的链路信息,根据所述图像处理信息和所述链路信息,确定出图像处理策略,以及根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,提高了图传清晰度与用于显示图像的终端设备的图像处理信息的匹配度,从而提高图像的清晰度。
本发明实施例还提供了一种图像处理系统,包括:图像处理设备和终端设备;
所述图像处理设备,用于如果检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接,则获取所述终端设备的图像处理信息;获取所述通信连接的链路信息;根据所述图像处理信息和所述链路信息,确定出图像处理策略;根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输 给所述终端设备;
所述终端设备,用于接收所述图像处理设备传输的图像,并将接收到的所述图像显示于所述终端设备的显示屏上。
进一步地,所述图像处理设备,用于根据获取到的所述终端设备的显示信息和编解码信息,确定所述图像处理策略;其中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略包括与所述显示信息和所述编解码信息相匹配的拍摄参数。
进一步地,所述图像处理设备,用于根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数;根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息匹配的图像。
进一步地,所述图像处理设备,用于根据所述图像处理策略的指示,控制所述拍摄装置以目标码流对拍摄得到的图像进行编码处理;根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
进一步地,所述图像处理设备,用于根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。
进一步地,所述图像处理设备,用于根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
进一步地,所述图像处理设备,用于当获取到所述拍摄装置的启动指令时,检测所述拍摄装置与所述终端设备之间是否建立了用于传输图像的通信连接;如果检测结果为是,则获取所述终端设备的图像处理信息。
进一步地,所述图像处理设备,用于如果检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接,则获取建立所述通信连接的连接方式;根据所述连接方式,获取所述终端设备的图像处理信息。
进一步地,所述图像处理设备,用于如果检测到所述通信连接的连接方式为有线通信连接方式,则获取与所述有线通信连接方式对应的通信协议;根据所述通信协议,获取所述终端设备的图像处理信息。
进一步地,所述图像处理设备,用于如果检测到所述通信连接的连接方式为无线通信连接方式,则对所述无线通信连接方式对应的通信链路进行测试得到带宽信息;根据所述带宽信息,获取所述终端设备的图像处理信息。
进一步地,所述图像处理设备,还用于如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则检测所述拍摄装置是否开启图像处理的动态调整功能;如果检测结果为是,则向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。
进一步地,所述图像处理设备,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则将预设信息确定为所述终端设备的图像处理信息。
进一步地,所述图像处理设备,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作在所述配置界面上配置得到的图像处理信息。
进一步地,所述图像处理设备,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作所选择的默认配置的图像处理信息。
本发明实施例中,图像处理设备在检测到拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息,并获取所述通信连接的链路信息,根据所述图像处理信息和所述链路信息,确定出图像处理策略,以及根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。通过这种方式,提高了图传清晰度与用于显示图像的终端设备的图像处理信息的匹配度,从而提高图像的清晰度。
在本发明的实施例中还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现本发明图2、图3、或图4所对应实施例中描述的图像处理方法方式,也可实现图5所述本发明所对应实施例的图像处理设备,在此不再赘述。
所述计算机可读存储介质可以是前述任一实施例所述的设备的内部存储单元,例如设备的硬盘或内存。所述计算机可读存储介质也可以是所述设备的外部存储设备,例如所述设备上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进 一步地,所述计算机可读存储介质还可以既包括所述设备的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述终端所需的其他程序和数据。所述计算机可读存储介质还可以用于暂时地存储已经输出或者将要输出的数据。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。
以上所揭露的仅为本发明部分实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。
Claims (43)
- 一种图像处理方法,其特征在于,包括:检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;获取所述通信连接的链路信息;根据所述图像处理信息和所述链路信息,确定出图像处理策略;根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
- 根据权利要求1所述的方法,其特征在于,所述图像处理信息包括显示信息和编解码信息,所述根据所述图像处理信息和所述链路信息,确定出图像处理策略,包括:根据获取到的所述终端设备的所述显示信息和所述编解码信息,确定所述图像处理策略;其中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略包括与所述显示信息和所述编解码信息相匹配的拍摄参数。
- 根据权利要求2所述的方法,其特征在于,所述根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,包括:根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数;根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息匹配的图像。
- 根据权利要求3所述的方法,其特征在于,所述根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备,包括:根据所述图像处理策略的指示,控制所述拍摄装置以目标码流对拍摄得到的图像进行编码处理;根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
- 根据权利要求4所述的方法,其特征在于,所述确定的图像处理策略指示了与所述编解码信息关联的编码参数;所述根据所述图像处理策略的指示,控制所述拍摄装置以目标码流对拍摄得到的图像进行编码处理,包括:根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。
- 根据权利要求4所述的方法,其特征在于,所述图像处理信息还包括:所述终端设备的传输协议信息,所述确定的图像处理策略指示了与所述传输协议信息关联的传输协议参数;所述根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备,包括:根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
- 根据权利要求1所述的方法,其特征在于,所述检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息,包括:当获取到所述拍摄装置的启动指令时,检测所述拍摄装置与所述终端设备之间是否建立了用于传输图像的通信连接;如果检测结果为是,则获取所述终端设备的图像处理信息。
- 根据权利要求7所述的方法,其特征在于,所述获取所述终端设备的 图像处理信息,包括:如果检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接,则获取建立所述通信连接的连接方式;根据所述连接方式,获取所述终端设备的图像处理信息。
- 根据权利要求8所述的方法,其特征在于,所述连接方式包括:有线通信连接方式,所述根据所述连接方式,获取所述终端设备的图像处理信息,包括:如果检测到所述通信连接的连接方式为有线通信连接方式,则获取与所述有线通信连接方式对应的通信协议;根据所述通信协议,获取所述终端设备的图像处理信息。
- 根据权利要求8所述的方法,其特征在于,所述连接方式还包括:无线通信连接方式,所述根据所述连接方式,获取所述终端设备的图像处理信息,包括:如果检测到所述通信连接的连接方式为无线通信连接方式,则对所述无线通信连接方式对应的通信链路进行测试得到带宽信息;根据所述带宽信息,获取所述终端设备的图像处理信息。
- 根据权利要求1所述的方法,其特征在于,所述检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息,还包括:如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则检测所述拍摄装置是否开启图像处理的动态调整功能;如果检测结果为是,则向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。
- 根据权利要求11所述的方法,其特征在于,所述如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则获取所述终端设备的图像处理信息,包括:如果检测到所述拍摄装置未开启图像处理的动态调整功能,则将预设信息确定为所述终端设备的图像处理信息。
- 根据权利要求11所述的方法,其特征在于,所述如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则获取所述终端设备的图像处理信息,包括:如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作在所述配置界面上配置得到的图像处理信息。
- 根据权利要求11所述的方法,其特征在于,所述如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则获取所述终端设备的图像处理信息,包括:如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作所选择的默认配置的图像处理信息。
- 一种图像处理设备,其特征在于,包括:处理器和存储器;所述存储器,用于存储程序指令;所述处理器,执行所述存储器存储的程序指令,当程序指令被执行时,所述处理器用于执行如下步骤:检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;获取所述通信连接的链路信息;根据所述图像处理信息和所述链路信息,确定出图像处理策略;根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备。
- 根据权利要求15所述的设备,其特征在于,所述处理器,用于根据获取到的所述终端设备的显示信息和编解码信息,确定所述图像处理策略;其中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略包括与所述显示信息和所述编解码信息相匹配的拍摄参数。
- 根据权利要求16所述的设备,其特征在于,所述处理器,用于根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数;根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息匹配的图像。
- 根据权利要求17所述的设备,其特征在于,所述处理器,用于根据所述图像处理策略的指示,控制所述拍摄装置以目标码流对拍摄得到的图像进行编码处理;根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
- 根据权利要求18所述的设备,其特征在于,所述处理器,用于根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。
- 根据权利要求18所述的设备,其特征在于,所述处理器,用于根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
- 根据权利要求15所述的设备,其特征在于,所述处理器,用于当获取到所述拍摄装置的启动指令时,检测所述拍摄装置与所述终端设备之间是否建立了用于传输图像的通信连接;如果检测结果为是,则获取所述终端设备的图像处理信息。
- 根据权利要求21所述的设备,其特征在于,所述处理器,用于如果检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接,则获取建立所述通信连接的连接方式;根据所述连接方式,获取所述终端设备的图像处理信息。
- 根据权利要求22所述的设备,其特征在于,所述处理器,用于如果检测到所述通信连接的连接方式为有线通信连接方式,则获取与所述有线通信连接方式对应的通信协议;根据所述通信协议,获取所述终端设备的图像处理信息。
- 根据权利要求22所述的设备,其特征在于,所述处理器,用于如果检测到所述通信连接的连接方式为无线通信连接方式,则对所述无线通信连接方式对应的通信链路进行测试得到带宽信息;根据所述带宽信息,获取所述终端设备的图像处理信息。
- 根据权利要求15所述的设备,其特征在于,所述处理器,还用于如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则检测所述拍摄装置是否开启图像处理的动态调整功能;如果检测结果为是,则向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。
- 根据权利要求25所述的设备,其特征在于,所述处理器,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则将预设信息确定为所述终端设备的图像处理信息。
- 根据权利要求25所述的设备,其特征在于,所述处理器,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作在所述配置界面上配置得到的图像处理信息。
- 根据权利要求25所述的设备,其特征在于,所述处理器,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作所选择的默认配置的图像处理信息。
- 一种图像处理系统,其特征在于,包括:图像处理设备和终端设备,所述图像处理设备,用于检测到在拍摄装置与终端设备之间建立了用于传输图像的通信连接时,获取所述终端设备的图像处理信息;获取所述通信连接的链路信息;根据所述图像处理信息和所述链路信息,确定出图像处理策略;根据所述图像处理策略的指示控制所述拍摄装置拍摄获取图像,并根据所述图像处理策略的指示控制所述拍摄装置的图传模块将拍摄得到的图像传输给所述终端设备;所述终端设备,用于接收所述图像处理设备传输的图像,并将接收到的所述图像显示于所述终端设备的显示屏上。
- 根据权利要求29所述的系统,其特征在于,所述图像处理设备,用于根据获取到的所述终端设备的显示信息和编解码信息,确定所述图像处理策略;其中,所述显示信息包括所述终端设备的显示屏的分辨率和/或帧率,所述确定的图像处理策略包括与所述显示信息和所述编解码信息相匹配的拍摄参数。
- 根据权利要求30所述的系统,其特征在于,所述图像处理设备,用于根据所述图像处理策略的指示,配置所述拍摄装置的拍摄参数;根据所述图像处理策略配置的所述拍摄参数,控制所述拍摄装置拍摄获取图像,在所述拍摄参数下,所述拍摄装置的图像传感器拍摄得到与所述显示信息匹配的图像。
- 根据权利要求31所述的系统,其特征在于,所述图像处理设备,用于根据所述图像处理策略的指示,控制所述拍摄装 置以目标码流对拍摄得到的图像进行编码处理;根据所述图像处理策略的指示,控制所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
- 根据权利要求32所述的系统,其特征在于,所述图像处理设备,用于根据所述图像处理策略的指示,配置所述拍摄装置的编码模块的编码参数,在所述编码参数下,所述拍摄装置的编码模块以所述目标码流对拍摄得到的图像进行编码处理。
- 根据权利要求32所述的系统,其特征在于,所述图像处理设备,用于根据所述图像处理策略的指示,配置所述拍摄装置的图传模块的传输协议参数,在所述传输协议参数下,所述拍摄装置的图传模块将所述编码处理得到的数据传输给所述终端设备。
- 根据权利要求29所述的系统,其特征在于,所述图像处理设备,用于当获取到所述拍摄装置的启动指令时,检测所述拍摄装置与所述终端设备之间是否建立了用于传输图像的通信连接;如果检测结果为是,则获取所述终端设备的图像处理信息。
- 根据权利要求35所述的系统,其特征在于,所述图像处理设备,用于如果检测到所述拍摄装置与所述终端设备之间建立了用于传输图像的通信连接,则获取建立所述通信连接的连接方式;根据所述连接方式,获取所述终端设备的图像处理信息。
- 根据权利要求36所述的系统,其特征在于,所述图像处理设备,用于如果检测到所述通信连接的连接方式为有线通信连接方式,则获取与所述有线通信连接方式对应的通信协议;根据所述通信协议,获取所述终端设备的图像处理信息。
- 根据权利要求36所述的系统,其特征在于,所述图像处理设备,用于如果检测到所述通信连接的连接方式为无线通信连接方式,则对所述无线通信连接方式对应的通信链路进行测试得到带宽信息;根据所述带宽信息,获取所述终端设备的图像处理信息。
- 根据权利要求29所述的系统,其特征在于,所述图像处理设备,还用于如果检测到在所述拍摄装置与终端设备之间建立了用于传输图像的通信连接,则检测所述拍摄装置是否开启图像处理的动态调整功能;如果检测结果为是,则向所述终端设备发送图像处理信息的提取请求,以获取所述终端设备的图像处理信息。
- 根据权利要求39所述的系统,其特征在于,所述图像处理设备,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则将预设信息确定为所述终端设备的图像处理信息。
- 根据权利要求39所述的系统,其特征在于,所述图像处理设备,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作在所述配置界面上配置得到的图像处理信息。
- 根据权利要求39所述的系统,其特征在于,所述图像处理设备,用于如果检测到所述拍摄装置未开启图像处理的动态调整功能,则接收在配置界面上产生的用户操作;获取所述用户操作所选择的默认配置的图像处理信息。
- 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至14任一项所述方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2018/079328 WO2019174044A1 (zh) | 2018-03-16 | 2018-03-16 | 一种图像处理方法、设备、系统及存储介质 |
CN201880010510.3A CN110291774B (zh) | 2018-03-16 | 2018-03-16 | 一种图像处理方法、设备、系统及存储介质 |
US17/009,024 US20200404154A1 (en) | 2018-03-16 | 2020-09-01 | Image processing method, device, and system, and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2018/079328 WO2019174044A1 (zh) | 2018-03-16 | 2018-03-16 | 一种图像处理方法、设备、系统及存储介质 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/009,024 Continuation US20200404154A1 (en) | 2018-03-16 | 2020-09-01 | Image processing method, device, and system, and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019174044A1 true WO2019174044A1 (zh) | 2019-09-19 |
Family
ID=67908357
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/079328 WO2019174044A1 (zh) | 2018-03-16 | 2018-03-16 | 一种图像处理方法、设备、系统及存储介质 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20200404154A1 (zh) |
CN (1) | CN110291774B (zh) |
WO (1) | WO2019174044A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111225151A (zh) * | 2020-01-20 | 2020-06-02 | 深圳传音控股股份有限公司 | 智能终端、拍摄控制方法及计算机可读存储介质 |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021217429A1 (zh) * | 2020-04-28 | 2021-11-04 | 深圳市大疆创新科技有限公司 | 图传控制方法、装置、电子设备与图传系统 |
CN113056904A (zh) * | 2020-05-28 | 2021-06-29 | 深圳市大疆创新科技有限公司 | 图像传输方法、可移动平台及计算机可读存储介质 |
CN115514883B (zh) * | 2021-02-04 | 2023-05-12 | 华为技术有限公司 | 跨设备的协同拍摄方法、相关装置及系统 |
WO2022174431A1 (zh) * | 2021-02-20 | 2022-08-25 | 深圳市大疆创新科技有限公司 | 图像传输方法、可移动平台、设备及计算机可读存储介质 |
WO2022246704A1 (zh) * | 2021-05-26 | 2022-12-01 | 京东方科技集团股份有限公司 | 一种设备间通信的方法、摄像头及显示器 |
US20230370260A1 (en) * | 2022-05-11 | 2023-11-16 | United States Of America As Represented By The Secretary Of The Navy | System for Providing Secure Communications and Related Methods |
CN115442408B (zh) * | 2022-09-13 | 2023-06-02 | 脉冲视觉(北京)科技有限公司 | 图像数据的传输处理方法、装置、介质以及电子设备 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101409848A (zh) * | 2007-10-09 | 2009-04-15 | 深圳华为通信技术有限公司 | 视频调节的方法、系统和采集设备控制器 |
CN102868859A (zh) * | 2012-08-21 | 2013-01-09 | 中兴通讯股份有限公司 | 多个终端组网实现媒体拍摄的方法、系统、以及终端 |
CN104980697A (zh) * | 2015-04-28 | 2015-10-14 | 杭州普维光电技术有限公司 | 一种网络摄像机视频传输方法 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020126751A1 (en) * | 1998-05-22 | 2002-09-12 | Christoph E. Scheurich | Maintaining a frame rate in a digital imaging system |
JP2003308277A (ja) * | 2002-04-17 | 2003-10-31 | Sony Corp | 端末装置、データ送信装置、データ送受信システム及びデータ送受信方法 |
JP2004096166A (ja) * | 2002-08-29 | 2004-03-25 | Nikon Corp | 電子カメラおよび電子カメラシステム |
JP2008113198A (ja) * | 2006-10-30 | 2008-05-15 | Sony Corp | 伝送方法、伝送システム、送信装置及び受信装置 |
US20130128074A1 (en) * | 2010-11-19 | 2013-05-23 | Mitsubishi Electric Corporation | Display unit, image sensing unit and display system |
CN105872651A (zh) * | 2015-12-18 | 2016-08-17 | 乐视移动智能信息技术(北京)有限公司 | 图像处理方法及装置 |
-
2018
- 2018-03-16 WO PCT/CN2018/079328 patent/WO2019174044A1/zh active Application Filing
- 2018-03-16 CN CN201880010510.3A patent/CN110291774B/zh not_active Expired - Fee Related
-
2020
- 2020-09-01 US US17/009,024 patent/US20200404154A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101409848A (zh) * | 2007-10-09 | 2009-04-15 | 深圳华为通信技术有限公司 | 视频调节的方法、系统和采集设备控制器 |
CN102868859A (zh) * | 2012-08-21 | 2013-01-09 | 中兴通讯股份有限公司 | 多个终端组网实现媒体拍摄的方法、系统、以及终端 |
CN104980697A (zh) * | 2015-04-28 | 2015-10-14 | 杭州普维光电技术有限公司 | 一种网络摄像机视频传输方法 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111225151A (zh) * | 2020-01-20 | 2020-06-02 | 深圳传音控股股份有限公司 | 智能终端、拍摄控制方法及计算机可读存储介质 |
CN111225151B (zh) * | 2020-01-20 | 2024-04-30 | 深圳传音控股股份有限公司 | 智能终端、拍摄控制方法及计算机可读存储介质 |
Also Published As
Publication number | Publication date |
---|---|
US20200404154A1 (en) | 2020-12-24 |
CN110291774A (zh) | 2019-09-27 |
CN110291774B (zh) | 2021-05-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019174044A1 (zh) | 一种图像处理方法、设备、系统及存储介质 | |
US10237318B2 (en) | Electronic device and method for encoding image data thereof | |
CN105430761B (zh) | 建立无线网络连接的方法、装置及系统 | |
US20190253644A1 (en) | Photographing Method for Terminal and Terminal | |
US10911577B2 (en) | Method and device for generating protocol data unit (PDU) packet | |
US20160381276A1 (en) | Method and user terminal for capturing video frame | |
US9772811B2 (en) | Image processing system, image processing apparatus, and image processing method | |
CN103078924A (zh) | 视野共享方法及设备 | |
US20200259880A1 (en) | Data processing method and apparatus | |
WO2020062134A1 (zh) | 调整图传分辨率的方法、图像拍摄设备、机器可读存储介质 | |
CN110996117B (zh) | 视频转码方法、装置、电子设备和存储介质 | |
US20150116489A1 (en) | Imaging apparatus | |
CN112584049A (zh) | 远程交互方法及装置、电子设备、存储介质 | |
CN112044055A (zh) | 图像数据采集方法、系统、装置、电子设备及存储介质 | |
JP2014057233A (ja) | 伝送システム、中継装置、伝送端末 | |
US20200007794A1 (en) | Image transmission method, apparatus, and device | |
WO2021022989A1 (zh) | 标定参数的获取方法、装置、处理器及电子设备 | |
WO2019033800A1 (zh) | 终端视频通话显示控制方法、装置、终端及存储介质 | |
US10827109B2 (en) | Imaging apparatus | |
US9648276B2 (en) | Transmission management apparatus, transmission system, transmission management method and recording medium | |
CN109698933B (zh) | 数据传输方法及摄像机、电子设备、计算机可读存储介质 | |
US20150189231A1 (en) | Video conferencing system | |
CN117193685A (zh) | 投屏数据的处理方法、电子设备及存储介质 | |
CN109698923B (zh) | 数据传输方法及摄像机、电子设备 | |
CN110784326A (zh) | 信息处理设备、控制方法和非暂时性计算机可读存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18909299 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18909299 Country of ref document: EP Kind code of ref document: A1 |