WO2023240508A1 - 控制方法、装置、图传设备及系统 - Google Patents
控制方法、装置、图传设备及系统 Download PDFInfo
- Publication number
- WO2023240508A1 WO2023240508A1 PCT/CN2022/099020 CN2022099020W WO2023240508A1 WO 2023240508 A1 WO2023240508 A1 WO 2023240508A1 CN 2022099020 W CN2022099020 W CN 2022099020W WO 2023240508 A1 WO2023240508 A1 WO 2023240508A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- control
- terminal device
- video
- control component
- image transmission
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 335
- 238000000034 method Methods 0.000 title claims abstract description 71
- 230000006870 function Effects 0.000 claims abstract description 146
- 238000013507 mapping Methods 0.000 claims description 70
- 230000002452 interceptive effect Effects 0.000 claims description 39
- 238000012545 processing Methods 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 13
- 230000006835 compression Effects 0.000 description 6
- 238000007906 compression Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 238000012356 Product development Methods 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 235000020281 long black Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
Definitions
- the embodiments of the present application relate to the field of image transmission technology, and specifically, to a control method and device for a terminal device, an image transmission device, and an image transmission system.
- Wireless image transmission technology is widely used in video shooting, film and television shooting and other fields.
- a wireless image transmission system includes an image transmission transmitting device and an image transmission receiving device.
- the image transmission transmitting device can obtain the images or videos collected by the image acquisition device and send them to the image transmission receiving device.
- the image transmission receiving device can display the received images. Images or videos, or the received images or videos are sent to other devices and displayed through other devices, so that users can view pictures remotely.
- users are no longer just satisfied with using wireless image transmission technology to realize remote viewing functions, but also hope to remotely control the image acquisition device based on the received image or video, such as focusing and adjusting focus. , change the lens orientation, or adjust some shooting parameters, etc. Therefore, the wireless image transmission technology can be further explored to use wireless image transmission technology to achieve more functions.
- the present application provides a terminal equipment control method, device, encoding and decoding method, image transmission equipment, and image transmission system.
- a method for controlling a terminal device including:
- control device Obtain the control signal generated when the user triggers the first control component on the control device, and the control device is used to communicate with the terminal device to control the terminal device;
- Both the first control component and the second control component can control multiple functions of the terminal device. If any of the first control component and the second control component If the control function of one of the first control component and the second control component changes, the control function of the other one of the first control component and the second control component will change accordingly.
- a control device for a terminal device includes a processor, a memory, and a computer program stored in the memory and executable by the processor.
- the computing program is The processor implements the following steps when executing:
- control device Obtain the control signal generated when the user triggers the first control component on the control device, and the control device is used to communicate with the terminal device to control the terminal device;
- Both the first control component and the second control component can control multiple functions of the terminal device. If any of the first control component and the second control component If the control function of one of the first control component and the second control component changes, the control function of the other one of the first control component and the second control component will change accordingly.
- a video transmission system includes a video transmission transmitting device and a video transmission receiving device.
- the video transmission transmitting device is used for communication connection with a terminal device.
- the video transmission receiving device The device is configured to communicate with the control device of the terminal device, and any one of the image transmission transmitting device and the image transmission receiving device is configured to perform the control method of the first aspect and the above.
- a video transmission device includes a hardware interface.
- the video transmission device is connected to a terminal device through the hardware interface.
- the video transmission device is configured to use the hardware
- the interface acquires image data from the terminal device, sends the image data to a control device of the terminal device, receives control instructions sent by the control device, and outputs the control instructions to the control device through the hardware interface. Described terminal equipment.
- an image transmission transmitting device configured to communicate with a terminal device and encode the source video data input by the terminal device before sending it to the terminal device.
- the display device of the terminal device is configured to display the target video data obtained after decoding on the screen of the display device. If the video parameters of the source video data change, the target video parameters change accordingly.
- a video transmission receiving device configured to be communicatively connected with the video transmission transmitting device.
- the video transmission receiving device is used to receive a source from the video transmission transmitting device.
- the code stream of the video data is decoded to obtain the target video data, so as to display the target video data on the display screen, wherein the video parameters of the target video data change as the video parameters of the source video data change. Variety.
- a video transmission system includes a video transmission transmitting device and a video transmission receiving device.
- the video transmission transmitting device is used for communication connection with a terminal device.
- the video transmission receiving device The device is used for communication connection with the display device of the terminal device,
- the image transmission transmitting device is used to encode the source video data input by the terminal device and send it to the image transmission receiving device;
- the image transmission receiving device is used to receive the code stream of the source video data from the image transmission transmitting device, and perform decoding processing to obtain the target video data, so as to display the target video data on the display screen, wherein the target video
- the video parameters of the data change as the video parameters of the source video data change.
- a computer-readable storage medium is provided.
- a computer program is stored on the computer-readable storage medium.
- the computer program is executed, the method mentioned in the first aspect is implemented.
- the embodiment of this application provides a method for controlling a terminal device, which can establish a mapping relationship between the control components on the control device and the control components on the terminal device, that is, the control components on the control device
- the function of the component is mapped to the function of the control component on the terminal device.
- the control signal triggered by the control component on the control device is transmitted through the image transmission system
- the control signal can be converted into a protocol through the image transmission system, and the control signal can be
- the corresponding control function is translated into the control function of the corresponding control component of the control component on the terminal device, and then executed by the terminal device. Since the functions of the control components on most current terminal devices can be set by users, the functions of the control components on the control devices are no longer fixed, but can be flexibly changed.
- Figures 1(a)-1(d) are schematic diagrams of various image transmission systems according to embodiments of the present application.
- Figure 2 is a flow chart of a control method of a terminal device according to an embodiment of the present application.
- Figure 3 is a schematic diagram of establishing a mapping relationship between a control component of a terminal device and a control component of a control device according to an embodiment of the present application.
- Figure 4 is a schematic diagram of the logical structure of a control device according to an embodiment of the present application.
- Figure 5 is a schematic diagram of a video transmission system according to an embodiment of the present application.
- Figure 6 is a schematic diagram of the connection between the image transmission equipment and the terminal equipment in the prior art.
- Figure 7 is a schematic diagram of a video transmission device according to an embodiment of the present application.
- Figure 8 is a schematic diagram of the video transmission device implementing "one send, multiple receivers" according to an embodiment of the present application.
- Figure 9 is a schematic diagram of the image transmission device implementing "multiple transmissions and one reception" according to an embodiment of the present application.
- Figure 10 is a schematic diagram of a video transmission device according to an embodiment of the present application.
- Figure 11 is a schematic diagram of the structure of a video transmission device according to an embodiment of the present application.
- Figure 12 is a schematic diagram of the structure of a video transmission device according to an embodiment of the present application.
- a wireless image transmission system includes image transmission transmitting equipment and image transmission receiving equipment.
- Figures 1(a)-1(d) show the schematic diagrams of four image transmission systems.
- the image transmission transmitting device can be a device that has the image collection function itself, and then sends the collected images or videos to the image transmission receiving device.
- the image transmission transmitting device can be a device with an integrated camera.
- the image transmission transmitting device can be an independent device with data transmission function.
- the image transmission transmitting device can be connected to the image acquisition device through a wired or wireless connection, and then the images or videos collected by the image acquisition device can be obtained. , and then send it to the image transmission receiving device.
- the image transmission transmitting device can be connected to the camera or PTZ camera through a data cable, and then obtain the images or videos collected by the camera or PTZ camera, and then send them to the image transmission receiving device.
- the image receiving device can be a device with a display screen itself. After receiving the image or video sent by the image transmission transmitting device, the image transmission receiving device can display it on its own display screen. For example, the image transmission receiving device can It's picture to screen. In some scenarios, the image transmission receiving device can also be an independent device with data transmission function. The image transmission receiving device can be connected to various other devices through wired or wireless methods, and then the image transmission receiving device will receive the image. Or the video is sent to other devices and displayed through other devices.
- wireless image transmission technology can be further explored to use wireless image transmission technology to achieve more functions.
- the image transmission receiving device or the device connected to the image transmission receiving device may also have the function of controlling the image collection device.
- the image transmission receiving device or the device connected to the image transmission receiving device can also be equipped with control components such as handles, joysticks, and buttons. Through these control components, the image acquisition device can be controlled, such as adjusting the focus, focusing, and shooting. Parameters, etc., or if the image acquisition device is set on the pan/tilt, you can also control the pan/tilt rotation, etc. through these control components.
- the terminal equipment can be a device that only has the function of image or video collection but does not have the function of transmitting images, or the terminal equipment can also be A device that has both image or video capture and image transmission functions.
- the device used to control the terminal device is called a control device, where the control device may be a device that only has a video display function and a function of controlling the terminal device, but does not have an image transmission function, or the The control device may also be a device that not only has video display functions and the function of controlling terminal equipment, but also has image transmission functions.
- control components of the control equipment can be used to control terminal equipment
- problems First, the control programs of the control components on the control equipment are all pre-written, and most of the control functions corresponding to the control components are fixed. For example, a certain handle is used to adjust the rotation of the gimbal, or a certain pulsator is used to focus, and its control function cannot be flexible.
- the other is that generally terminal equipment and control equipment are used together, that is, only a certain control equipment matched with the terminal equipment can control it, which is relatively limited and not flexible enough.
- embodiments of the present application provide a method for controlling a terminal device, which can establish a mapping relationship between the control components on the control device and the control components on the terminal device, that is, the function mapping of the control components on the control device. into the function of the control component on the terminal device.
- the control signal can be converted into a protocol through the image transmission system, and the control function corresponding to the control signal can be
- the control component is translated into the control function of the corresponding control component on the terminal device, and then executed by the terminal device. That is to establish a mirroring relationship between the control components on the control equipment and the control components on the terminal equipment. Since the functions of most control components on the terminal equipment can be set by users, the functions of the control components on the control equipment are not It is no longer fixed, but can be flexibly changed.
- control method provided by the embodiment of the present application can be executed by the transmitting end or the receiving end in the image transmission system.
- the transmitting end can be an independent image transmission transmitting device, or can be integrated on the terminal device.
- the receiving end can be an independent image transmission receiving device, or it can be integrated on the control device.
- the terminal device in the embodiment of this application may be a pan/tilt, camera, drone, or other various types of equipment that can collect images or videos.
- the control device in the embodiment of the present application can be various control devices with a display function and one or more control components.
- the control device can be a remote control, a picture transmission screen with a control function, a motion sensing controller, etc.
- Control components can be handles, pulsators, buttons, joysticks, etc.
- control method in the embodiment of the present application may include the following steps:
- control device is used to communicate with the terminal device to control the terminal device;
- control components can be set on the terminal device to control the functions of the terminal device.
- the terminal device is a pan/tilt equipped with a camera
- the pan/tilt can be equipped with pulsators, buttons, joysticks, etc.
- the control component can control the gimbal to perform certain control functions, such as adjusting the gimbal rotation, or focusing and adjusting the camera, etc.
- users can remotely control the terminal device through the control device of the terminal device.
- a mapping relationship can be established between the control components on the control device and the control components on the terminal device.
- the user triggers the first control component on the control device, it is equivalent to triggering the third control component on the terminal device corresponding to the first control component.
- the second control component can control the terminal device to perform the control function corresponding to the second control component.
- step S202 when the user needs to remotely control the terminal device, the user can trigger the first control component on the control device of the terminal device, and the control device will generate a corresponding control signal, wherein different control components can Corresponds to different control signals, so that based on the control signal, it can be determined which control component is triggered by the current user.
- the device executing this method can obtain the control signal.
- both the first control component and the second control component can control multiple functions of the terminal device. If the first control component and the second control component If the control function of one of the components changes, the control function of the other one of the first control component and the second control component will change accordingly.
- step S204 since the terminal device includes a second control component corresponding to the first control component, after obtaining the control signal, it can be determined that the second control component corresponding to the first control component is currently The corresponding control function is then used as the operation corresponding to the control signal, so that the terminal device can execute the control function.
- the terminal device is a pan/tilt equipped with a camera.
- the pan/tilt includes knob wheel 1 and knob 2.
- Knob 1 is used to control the rotation of the pan/tilt
- knob 2 is used to control the camera to take pictures
- the control device can be a remote control, which includes rocker 1 and rocker 2. Therefore, a mapping relationship between the control components of the two devices can be established, that is, knob 1 - rocker 1, and knob 2 - rocker 2.
- the pan/tilt can also be controlled to rotate.
- the camera can also be controlled to take pictures.
- knob 1 rotates counterclockwise - rocker 1 turns left
- knob 1 rotates clockwise - rocker 1 turns right
- the details can be set according to the characteristics of the control components and actual needs.
- the first control component or the second control component may be one or more of a pulsator, a handle, a rocker, a button, a knob, etc.
- control function corresponding to the second control component on the terminal device can be set by the user, that is, the control function can be changed rather than fixed. Since the control components in the control device in the embodiment of the present application correspond to the control components of the terminal device, when the control functions corresponding to the control components of the terminal device change, the control functions corresponding to the control components of the control device will also change accordingly. That is, the control function indicated by the control signal generated by the triggering first control component will change as the corresponding control function of the second control component changes.
- the corresponding functions of the control components on the control device can change as the functions of the control components on the terminal device change, and are no longer fixed, and There is no need to make any modifications to the configuration parameters of the control device, making it more flexible and convenient.
- control function corresponding to the second control component can be set by the user through the interactive interface.
- the terminal device includes an interactive interface, so the user can set the second control component through the interactive interface on the terminal device.
- the user can also set the control function corresponding to the second control component through the interactive interface on the control device, and then send the corresponding relationship to the terminal device.
- each control component on the terminal device can be displayed on the interactive interface. After the user clicks on each control component, a drop-down menu can be displayed. The drop-down menu corresponds to various control functions, and the user can select one of them as the corresponding control component. control function.
- control can be displayed through the interactive interface of the control device.
- the control functions corresponding to each control component on the device For example, you can set up a function introduction page, which can display the functions corresponding to each control component.
- the first control component and The second control component may be the same type of control component.
- the first control component is a pulsator
- the second control component is also a pulsator
- the first control component is a button
- the second control component is also a button.
- associating control components of the same type can also facilitate the establishment of a mapping relationship between the two operation methods.
- the pulsator includes two operating modes: clockwise and counterclockwise rotation
- the pulsators on the two devices are associated, and it is also convenient to establish a mapping relationship between the two operating modes on the two pulsators.
- terminal equipment The pulsator rotates clockwise - the pulsator on the control device rotates clockwise.
- the control components on both the control device and the terminal device can control the terminal device, in order to avoid confusion in the control instructions, for example, at the same time, a user triggers the control component on the control device and the control component on the terminal device, resulting in The terminal device receives multiple control instructions, and these instructions may be contradictory.
- the priority of the control signals sent by the two devices can be set. For example, usually the user on the side of the terminal device is closer to the terminal device, and the decisions he makes are often more accurate. Therefore, the priority of triggering the control signal generated by the control component on the terminal device can be set to be higher than the priority of triggering the control signal generated by the control component on the control device. That is, the terminal device will prioritize the execution of the control signal generated by the user triggering the control component on the terminal device. control instructions.
- the priority of the instructions issued by the control device can also be set higher, and the specific settings can be flexibly combined with actual needs.
- the first mapping relationship between the control components on the control device and the control components on the terminal device can be stored in advance.
- the first mapping relationship can be stored on the device where the image transmission transmitter is located, or it can also be stored On the device where the image transmission receiving end is located, when determining the control function indicated by the control signal, the second control component corresponding to the first control component can be determined based on the first mapping relationship, and then the second control component can be The corresponding control function is used as the control function corresponding to the control signal.
- each terminal equipment can only be controlled by its supporting control equipment, which is relatively limited and the control method is relatively simple.
- the control device of each terminal device may include multiple types of devices, and the first mapping relationship may also include groups. Each group The first mapping relationship may be used to characterize the corresponding relationship between the control component on the terminal device and the control component on one type of control device.
- the control device can be a remote control, an image transmission screen, a rocking wheel, etc. Therefore, three sets of first mapping relationships can be set up to record the control components on the pan/tilt. The corresponding relationship with the control components on the remote control, the corresponding relationship between the control components on the gimbal and the control components on the image transmission screen, and the corresponding relationship between the control components on the gimbal and the control components on the rocker, etc.
- control signal generated by the control component on the control device triggered by the user is obtained, it is possible to determine which control device the current user is using and which control component on the control device based on the control signal, and then call the corresponding first
- the mapping relationship determines the control component corresponding to the first mapping relationship on the terminal device.
- the first mapping relationship may be pre-solidified on the product before it leaves the factory.
- the first mapping relationship may be pre-set during the product development stage and stored on the device where the image transmission transmitter is located or on the image transmission device. on the device where the receiving end is located.
- the control device and the terminal device are in a frequency-matching state, that is, when they match the channel for transmitting data, the first mapping relationship is automatically determined.
- the first mapping relationship can also be set by the user.
- a control that establishes a first mapping relationship can be set on the interactive interface of the control device. After the terminal device and the control device are connected, when the user clicks the control, the control device can be displayed on the interactive interface of the control device.
- the first identification corresponding to the control component and the second identification corresponding to the control component on the terminal device are determined based on the user's operation on the first identification and the second identification.
- the first mapping relationship is determined.
- the name or icon of the control component on the control device and the name or icon of the control component on the terminal device can be displayed on the interactive interface, and the user can drag and drop the first identification or the second identification.
- the user will Drag a first identifier to the corresponding second identifier to establish a mapping relationship between the two control components.
- the user can draw a line on the screen to connect the two control components to establish a mapping relationship between the two control components.
- a drop-down menu will appear, displaying multiple second logos, and then the user can select the second logo in the drop-down menu to establish a mapping relationship between the two control components.
- the second mapping relationship between each control component and the control function on the terminal device can be set by the user, for example, the user can set the second mapping relationship through the interactive interface on the terminal device or the control device, therefore, the image transmission transmitter or The image transmission receiving end can also obtain the second mapping relationship between each control component and the control function on the terminal device, and determine the control function corresponding to the control component on the control device based on the first mapping relationship and the second mapping relationship, so as to control the control device on the control device.
- the interactive interface displays the corresponding relationship between each control component and the control function on the control device.
- the second mapping relationship can be obtained from the control device, and then based on the first mapping relationship and the second mapping relationship determines the control function corresponding to each control component on the control device, so as to be displayed on the interactive interface of the control device, so that the user can map the corresponding relationship between each control component and the control function on the control device displayed on the interactive interface. terminal equipment for control.
- the method can be performed by any one of the image transmission transmitting device and the image transmission receiving device of the image transmission system.
- the image transmission transmitting device is communicatively connected to the terminal device, and the The image transmission receiving device communicates with the control device.
- the image transmission transmitting device and the image transmission receiving device can be two independent devices.
- the image transmission transmitting device can be connected to the terminal device in a wired or wireless manner, and the image transmission receiving device can be connected to the terminal device in a wired or wireless manner.
- Device communication connection After the user triggers the first control component on the control device, the generated signal will be sent to the image transmission receiving device.
- the image transmission receiving device can perform protocol conversion on the control signal based on the pre-stored first mapping relationship and determine the corresponding control signal. After the control function, it is then sent to the image transmission transmitting device, so that the image transmission transmitting device can send it to the terminal device and control the terminal device. Alternatively, the image transmission transmitting device may send the control signal to the image transmission receiving device, and the image transmission receiving device performs protocol conversion based on the pre-stored first mapping relationship, determines the control function corresponding to the control signal, and then sends it to the terminal device. . By performing protocol conversion on the control signal in the image transmission system, the control function currently corresponding to the control signal is determined, thereby realizing mapping between the control components on the terminal device and the control components on the control device.
- the embodiment of the present application is a control device for terminal equipment.
- the control device includes a processor 41, a memory 42, and a computer program stored in the memory 42 and executable by the processor 41. , when the calculation program is executed by the processor 41, the following steps are implemented:
- control device Obtain the control signal generated when the user triggers the first control component on the control device, and the control device is used to communicate with the terminal device to control the terminal device;
- Both the first control component and the second control component can control multiple functions of the terminal device. If any of the first control component and the second control component If the control function of one of the first control component and the second control component changes, the control function of the other one of the first control component and the second control component will change accordingly.
- control function indicated by the control signal changes as the control function corresponding to the second control component changes.
- control function corresponding to the second control component is set by the user through an interactive interface
- the interactive interface includes an interactive interface of the control device and/or an interactive interface of the terminal device.
- the interactive interface on the control device displays control functions corresponding to each control component of the control device.
- the first control component and the second control component are the same type of control component.
- the first control component or the second control component includes one or more of the following: a pulsator, a handle, a rocker, a button, and a knob.
- the priority of triggering the control signal generated by the control component on the terminal device is higher than the priority of triggering the control signal generated by the control component on the control device.
- the processor when the processor is used to send the control signal to the terminal device, it is specifically used to:
- the control function corresponding to the second control component is regarded as the control function corresponding to the control signal.
- control device includes multiple types of devices, and the first mapping relationship includes multiple groups, and each group of first mapping relationships is used to characterize a control component on the terminal device and a type of control. Correspondence between control components on the device.
- the first mapping relationship is determined based on the following manner:
- the first mapping relationship is determined based on the user's operation on the first identification and the second identification.
- the first mapping relationship is determined based on the following manner:
- the first mapping relationship is automatically determined.
- the processor is also used to:
- the control function corresponding to the control component on the control device is determined based on the first mapping relationship and the second mapping relationship, so as to display the relationship between each control component on the control device and the control component on the interactive interface of the control device.
- the corresponding relationship between the control functions is determined based on the first mapping relationship and the second mapping relationship, so as to display the relationship between each control component on the control device and the control component on the interactive interface of the control device.
- control device may be a video transmission transmitting device of the video transmission system.
- control device may be a video transmission receiving device of the video transmission system.
- the embodiment of the present application provides an image transmission system.
- the image transmission system 50 includes an image transmission transmitting device 51 and an image transmission receiving device 52.
- the image transmission transmitting device 51 is used to communicate with The terminal device 53 is communicatively connected
- the image transmission receiving device 52 is used to communicate with the control device 54 of the terminal device 53
- any one of the image transmission transmitting device 51 and the image transmission receiving device 52 is used to execute The control method described in any of the above embodiments.
- Wireless image transmission technology is not only used to send images collected by the terminal device to the control device of the terminal device so that the device can display images.
- wireless image transmission technology can also be used to transmit control instructions sent by the user through the control device to Terminal equipment allows users to remotely control the terminal equipment.
- the transmitter end of the image transmission system can be made into an independent image transmission device.
- the image transmission device can be connected to the terminal device through a data cable so that the images collected by the terminal device can be sent to the control device.
- the image transmission receiving end can also be made into an independent image transmission device and communicate with the control device, or the image transmission receiving end can also be integrated on the control device.
- Communication interfaces usually include an HDMI interface and a USB interface.
- the HDMI interface is used to transmit image data
- the USB interface is used to transmit control instructions.
- this method requires multiple hardware interfaces on the image transmission device, which is not conducive to the miniaturization and portability of the image transmission device.
- users need to connect multiple data lines when using the image transmission device, which makes the operation cumbersome and difficult to use. Not convenient enough to get up.
- the embodiment of the present application provides a video transmission device, as shown in Figure 7, which is a schematic diagram of a video transmission device in the embodiment of the present application (it should be pointed out that the image transmission device provided by the embodiment of the present application
- the appearance shape is not limited to the image transmission device shown in the figure)
- the image transmission device includes a hardware interface
- the image transmission device can be connected to a terminal device through the hardware interface
- the terminal device can be a device with an image acquisition function,
- the terminal device can be a camera, a drone, a gimbal equipped with a camera, etc.
- the image transmission device can obtain image data from the terminal device through the hardware interface, and then send the image data to the control device of the terminal device so that the user can view the image through the display interface of the control device.
- the control device can be a remote control, an image transmission screen, a motion sensing controller and other devices.
- the terminal device can also receive control instructions sent by the control device and output the control instructions to the terminal device through the hardware interface to achieve remote control of the terminal device.
- the control device can be provided with control components, such as handles, rockers, buttons, pulsators, knobs, etc. The user can trigger these control components to issue control instructions, or the user can trigger the display interface of the control device.
- the control sends control instructions.
- the control instruction may be various instructions for controlling the terminal device.
- the terminal device may be a pan/tilt equipped with a camera. Therefore, the control instruction may be to control the rotation of the pan/tilt, or to control the focus and adjustment of the camera on the pan/tilt. Focus, take pictures, etc.
- the hardware interface in order to realize that the same hardware interface can transmit both images and control instructions, can be an HDMI interface, and the control instructions can be instructions in HDMI CEC format.
- HDMI CEC technology By combining HDMI CEC technology with wireless image transmission technology, it is possible to simultaneously complete the transmission of image data and control instructions through an HDMI interface.
- the hardware interface can also be other types of interfaces, such as SDI interface, USB interface, etc., and the type of the control instruction can also be adjusted based on the type adaptability of the hardware interface.
- the terminal device may be a shooting device
- the control instruction may be used to adjust shooting parameters of the shooting device.
- the control instruction can be used to adjust the focus position, focal length, aperture size, etc. of the shooting device.
- the control device of the terminal device may be multiple devices.
- the image transmission device may include multiple transmission channels ( As shown in the transmission channel 1-3 in Figure 8), each transmission channel can correspond to a control device (the control device 1-3 in Figure 8).
- Each transmission channel is used to send the image data obtained from the terminal device. to the corresponding control device, and for sending the control instructions sent by the control device to the terminal device. That is to say, the image transmission device can realize the "one-to-many" function, sending the image data collected by one terminal device to multiple control devices, and at the same time, sending the control instructions of multiple control devices to the terminal device.
- the priority of the control instructions issued by each control device can be set to avoid confusion of control instructions.
- the image transmission device may include multiple hardware interfaces (hardware interfaces 1-3 in Figure 9), each hardware interface is used to connect a terminal device ( Figure 9
- the terminal equipment 1-3) in is used to transmit the image data and control instructions of the connected terminal equipment through the hardware interface.
- the image transmission device may include multiple transmission channels (transmission channels 1-3 in Figure 9). Each transmission channel corresponds to a terminal device and is used to send image data received from the terminal device to the terminal device. control device, and used to send the control instructions sent by the control device to the terminal device. That is, the image transmission device can realize the "many-to-one" function, sending image data collected by multiple terminal devices to the same control device, so that users can remotely view images collected by multiple terminal devices at the same time.
- the image transmission device can also send the control instructions issued by the control device to each terminal device respectively, so that one control device can be used to control multiple terminal devices.
- the user before sending a control instruction through the control device, the user can first select the terminal device to be controlled from multiple terminal devices, and then send the control instruction.
- the image data received from each terminal device can be displayed in a split-screen manner on the interactive interface of the control device.
- the encoding unit in the image transmission transmitting device is based on fixed video specifications (such as frame rate and resolution, etc.).
- the video input interface receives source video data, and then encodes the received source video data according to fixed encoding parameters (such as code rate, compression rate) before sending it to the image transmission receiving device.
- the image transmission receiving device will also decode the encoded source video data according to the fixed video specifications to obtain a video image with a fixed frame rate and resolution for display.
- the terminal equipment connected to the image transmission transmitting device may change, the video specifications of the source video data collected by each terminal device will also change.
- the frame rate or resolution may be different. If the encoding in the image transmission transmitting device The units all receive source video data from the video input interface according to fixed video specifications, and then use fixed encoding parameters to encode the received source video data. This may result in the inability to fully and reasonably utilize the wireless bandwidth resources of the image transmission transmitting device. problems, and the ideal display effect cannot be achieved on the display device.
- the encoding units of the image transmission transmitting equipment receive source video data from the video input interface according to fixed video specifications (for example, frame rate: 60 frames/s, resolution: 10K), and then use the same encoding parameters (for example, the same code rate and compression rate) encode the received source video data and send it to the image transmission receiving device, and the image transmission receiving device will also decode the encoded source video data into a fixed specification (frame rate: 60 frames /s, resolution: 10K) video image is displayed again. Therefore, if the frame rate of the source video data collected by the terminal device is 30 frames/s and the resolution is 20K, the encoding unit of the image transmission device still reads from the video input interface according to the frame rate: 60 frames/s and resolution: 10K.
- fixed video specifications for example, frame rate: 60 frames/s, resolution: 10K
- the encoding unit of the image transmission transmitting device will still input the video according to the frame rate: 60 frames/s and resolution: 10K. If the interface receives the source video data and then encodes it, it may appear that the current network resources are good, but they are not maximized for transmitting video data, and the frame rate of the video image decoded by the image transmission receiving device is lower than the source video data. There may be a problem that the displayed video image is not smooth enough.
- embodiments of the present application provide an image transmission transmitting device.
- the image transmission transmitting device encodes the source video data obtained from the terminal device, it no longer encodes the source video data according to a fixed encoding strategy.
- a fixed encoding strategy for example, it is no longer a matter of receiving source video data from the terminal device according to fixed frame rate, resolution and other video parameters, nor is it no longer encoding the source video data according to fixed coding parameters such as bit rate and compression rate, but
- the encoding strategy is adaptively adjusted based on the video parameters of the source video data, so that the frame rate, resolution and other video parameters of the video data displayed on the receiving end display device are no longer fixed, but can change with the source video data.
- the video parameters change, so that the bandwidth resources of the image transmission transmitting device can be maximized, and at the same time, better display effects can be achieved when the video images displayed on the receiving end.
- the image transmission transmitting device configured to communicate with the terminal device.
- the image transmission transmitting device may include a hardware communication interface through which it is connected to the terminal device in a wired manner, or the image transmission transmitting device may be wired to the terminal device through the hardware communication interface.
- the transmission and transmission device may include a wireless transmission unit, and the wireless transmission unit is wirelessly connected to the terminal device.
- the terminal device may be a device with an image collection function, such as a camera, a drone, a pan-tilt equipped with a camera, etc.
- the image transmission transmitting device can obtain the source video data input by the terminal device, and then can detect the video parameters of the source video data currently input by the terminal device.
- the video parameters can be the frame rate, resolution, etc. of the source video data. one or more.
- the source video data can be encoded according to the video parameters of the source video data. For example, an encoding strategy that matches the video parameters of the source video data can be determined, where the encoding strategy is used to indicate the encoding of the image transmission transmitting device.
- the display device of the terminal device can be various electronic devices with a display screen. The video image collected by the terminal device is displayed to the user through the display screen of the display device, so that the user can view pictures remotely.
- the display device can be integrated with a device with an image transmission receiving function, that is, the display device is also an image transmission receiving device. After the display device receives the encoded source video data, it can decode it to obtain the target video data and then display it. .
- the display device can be a device that only has a display function. The display device can communicate with the image transmission receiving device. After receiving the encoded source video data, the image transmission receiving device can decode and process it to obtain the target video data. Output to the display device for display by the display device.
- the image transmission transmitting device when the image transmission transmitting device encodes the source video data, it adjusts the encoding strategy adaptively based on the video parameters of the source video data, that is, the frame rate, code rate, resolution, compression rate, etc. during encoding are all It is adaptively adjusted rather than fixed.
- the decoder also adaptively decodes according to the video parameters. Therefore, the video parameters of the target video data displayed in the final display device also change with the video parameters of the source video data. Change with change.
- the image transmission transmitting device includes a video input interface, and the image transmission transmitting device obtains source video data from the terminal device through the video input interface, where the video input interface may be an HDMI interface, an SDI interface, etc.
- the image transmission transmitting device may include a detection unit configured to detect video parameters of source video data currently input by the terminal device.
- the detection unit may be a hardware unit, for example, it may be a chip specially used to detect the frame rate and resolution of the source video data, etc.
- the detection unit can also be a software unit, that is, it can be a program or a piece of code capable of detecting video parameters of source video data.
- the image transmission transmitting device also includes a processing unit and a coding unit, wherein the processing unit is used to receive the currently detected video parameters from the detection unit, and determine the currently detected video parameters. If the detected video parameters are inconsistent with the last detected historical video parameters, the currently detected video parameters are sent to the encoding unit.
- the processing unit may be a processor in the image transmission device, such as a CPU, etc.
- the encoding unit is configured to receive the currently detected video parameters from the processing unit, determine an encoding strategy that matches the currently detected video parameters, and then encode the source video data based on the encoding strategy. For example, the encoding unit can adjust The frame rate, resolution and other video parameters of the video data received from the terminal device can be adjusted at the same time, such as the code rate used in the encoding process and the compression rate for compressing the video data, so that the current encoding strategy can be maximized. Utilize the bandwidth resources of the image transmission transmitting equipment. After the encoding unit encodes the source video data, a code stream of the source video data is obtained, and then the encoded code stream of the source video data can be sent to the display device through the wireless transmission unit.
- the encoding unit can be a hardware unit with encoding function, for example, it can be a chip specially used for encoding, or in some scenarios, the CPU has encoding function, and the encoding unit can also be a CPU. That is, the detection unit, processing unit and encoding unit can be three independent chips, or they can be the same chip.
- the display device can quickly receive the video image and display it, without a long black screen phenomenon, which will bring a bad experience to the user. . Therefore, after the image transmission transmitting device is powered on, the encoding unit can obtain the source video data from the terminal device through the video input interface of the image transmission transmitting device, and then encode the obtained source video data before sending. The encoding unit needs to initialize the video parameters of the received source video data according to certain specifications.
- the video parameters of the current source video data are consistent with the last video parameters (unless the video parameters are changed and are different) Therefore, every time the image transmission transmitting device is powered on, the video parameters of the source video data received by the image transmission transmitting device can be initialized to the last video parameters, so that the source video data can be quickly received and encoded for transmission.
- the image transmission transmitting device may also include a storage unit, and after determining that the currently detected video parameters of the source video data are inconsistent with the last detected historical video parameters, the image transmission device is also configured to The currently detected video parameters are stored in the storage unit, so that the next time the image transmission device is powered on, the encoding unit can initialize the video parameters of the received source video data to the most recently stored video parameters in the storage unit.
- the code stream obtained by encoding the source video data includes information indicating the video parameters.
- the video parameters can be recorded in the header information in the data packet of the code stream, so that the decoding end After obtaining the code stream, the video parameters can be obtained from the code stream information, and then the code stream is decoded based on the video parameters to obtain the target video data, so that the video parameters of the target video data decoded by the decoding end are also adaptive. It changes as the video parameters of the source video data change to achieve a more ideal display effect.
- embodiments of the present disclosure also provide an image transmission receiving device.
- the image transmission receiving device is configured to communicate with the image transmission transmitting device.
- the image transmission receiving device is used to receive source video data from the image transmission transmitting device. code stream, and obtain the video parameters of the source video data from the code stream.
- the video parameters can be obtained from the header information of the code stream.
- the code stream can be decoded based on the video parameters of the source video data to obtain the target video data to display the target video data, where the video parameters of the target video data change as the video parameters of the source video data change.
- inventions of the present disclosure provide a video transmission system.
- the video transmission system includes a video transmission transmitting device and a video transmission receiving device.
- the video transmission transmitting device is used to communicate with a terminal device.
- the video transmission receiving device For communication connection with the display device of the terminal device,
- the image transmission transmitting device is used to detect the video parameters of the source video data input by the terminal device, and encode the source video data based on the video parameters of the source video data to obtain a code stream of the source video data. , and send the code stream to the image transmission receiving device;
- the image transmission receiving device is used to obtain video parameters of the source video data from the code stream, decode the code stream based on the video parameters of the source video data to obtain target video data, and display the target video data on the display screen.
- the target video data is displayed in , wherein the video parameters of the target video data change as the video parameters of the source video data change.
- an encoding method which method includes:
- the source video data is encoded based on the video parameters of the source video data to obtain a code stream of the source video data, and the code stream is sent to the display device of the terminal device for display on the display device.
- the target video data obtained by decoding the code stream is displayed on the screen of the device, wherein the video parameters of the target video data change as the video parameters of the source video data change.
- the encoding method can be executed by the image transmission transmitting device.
- the image transmission transmitting device executes the encoding method, reference can be made to the description in the above embodiments and will not be described again here.
- the embodiment of the present application also provides a decoding method, which method includes:
- Obtain video parameters of the source video data from the code stream decode the code stream based on the video parameters of the source video data to obtain target video data, and display the target video data on a display screen, wherein, the video parameters of the target video data change as the video parameters of the source video data change.
- the decoding method can be executed by the image transmission receiving device.
- the image transmission receiving device executes the decoding method.
- embodiments of the present application also provide a computer storage medium, the storage medium stores a program, and when the program is executed by a processor, the method in any of the above embodiments is implemented.
- Embodiments of the present application may take the form of a computer program product implemented on one or more storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code.
- Storage media available for computers include permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology to store information.
- Information may be computer-readable instructions, data structures, modules of programs, or other data.
- Examples of computer storage media include, but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, Magnetic tape cassettes, tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium can be used to store information that can be accessed by a computing device.
- PRAM phase change memory
- SRAM static random access memory
- DRAM dynamic random access memory
- RAM random access memory
- ROM read-only memory
- EEPROM electrically erasable programmable read-only memory
- flash memory or other memory technology
- CD-ROM compact disc read-only memory
- DVD digital versatile disc
- Magnetic tape cassettes tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium can be used to store information that can be accessed by
- the device embodiment since it basically corresponds to the method embodiment, please refer to the partial description of the method embodiment for relevant details.
- the device embodiments described above are only illustrative.
- the units described as separate components may or may not be physically separated.
- the components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Selective Calling Equipment (AREA)
Abstract
一种终端设备的控制方法、装置、编解码方法、图传设备以及图传系统。所述方法包括:获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于控制所述终端设备;发送所述控制信号至所述终端设备控制功能,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上包括与所述第一控制部件相对应的第二控制部件,所述控制信号指示的控制功能与所述第二控制部件对应的控制功能一致。通过这种方式,可以使得控制设备上的控制部件的功能更加灵活多变。
Description
本申请实施例涉及图传技术领域,具体而言,涉及一种终端设备的控制方法、装置、图传设备以及图传系统。
无线图传技术广泛用于视频拍摄、影视拍摄等领域中。通常一套无线图传系统包括图传发射设备和图传接收设备,图传发射设备可以获取图像采集设备采集的图像或视频,并发送给图传接收设备,图传接收设备可以显示接收到的图像或视频,或者将接收到的图像或视频发送给其他设备,通过其他设备显示,从而可以实现用户远程看图。随着用户需求的增加,用户不再仅仅满足于利用无线图传技术实现远程看图功能,还希望可以基于接收到的图像或视频远程地对图像采集设备进行一些操控,比如,对焦、调整焦距、改变镜头朝向、或者调整一些拍摄参数等等,因而,可以对无线图传技术进行进一步的发掘,以利用无线图传技术实现更多的功能。
发明内容
有鉴于此,本申请提供一种终端设备的控制方法、装置、编解码方法、图传设备以及图传系统。
根据本申请的第一方面,提供一种终端设备的控制方法,所述方法包括:
获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于与所述终端设备通信连接,以控制所述终端设备;
发送所述控制信号至所述终端设备,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上设有第二控制部件,所述第二控制部件用于获取用户的操作以控制所述终端设备,所述第一控制部件以及所述第二控制部件均能够控制所述终端设备的多种功能,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化。
根据本申请的第二方面,提供一种终端设备的控制装置,所述控制装置包括处理器、存储器、存储于所述存储器可供所述处理器执行的计算机程序,所述计算程序被所述处理器执行时实现以下步骤:
获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于与所述终端设备通信连接,以控制所述终端设备;
发送所述控制信号至所述终端设备,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上设有第二控制部件,所述第二控制部件用于获取用户的操作以控制所述终端设备,所述第一控制部件 以及所述第二控制部件均能够控制所述终端设备的多种功能,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化。
根据本申请的第三方面,提供一种图传系统,所述图传系统包括图传发射设备和图传接收设备,所述图传发射设备用于与终端设备通信连接,所述图传接收设备用于与所述终端设备的控制设备通信连接,所述图传发射设备和所述图传接收设备中的任一个用于执行上述第一方面以及的控制方法。
根据本申请的第四方面,提供一种图传设备,所述图传设备包括硬件接口,所述图传设备通过所述硬件接口与终端设备连接,所述图传设备用于通过所述硬件接口从所述终端设备获取图像数据,并将所述图像数据发送给所述终端设备的控制设备,以及接收所述控制设备发送控制指令,并将所述控制指令通过所述硬件接口输出给所述终端设备。
根据本申请的第五方面,提供一种图传发射设备,所述图传发射设备被配置为与终端设备通信连接,并将所述终端设备输入的源视频数据进行编码处理后发送给所述终端设备的显示设备,以使得在所述显示设备的屏幕上显示解码处理后得到的目标视频数据,若所述源视频数据的视频参数发生变化,则所述目标视频参数相应地发生变化。
根据本申请的第六面,提供一种图传接收设备,所述图传接收设备被配置为与图传发射设备通信连接,所述图传接收设备用于从所述图传发射设备接收源视频数据的码流,并进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
根据本申请的第七方面,提供一种图传系统,所述图传系统包括图传发射设备和图传接收设备,所述图传发射设备用于与终端设备通信连接,所述图传接收设备用于与所述终端设备的显示设备通信连接,
所述图传发射设备用于将所述终端设备输入的源视频数据进行编码处理后发送给所述图传接收设备;
所述图传接收设备用于从所述图传发射设备接收源视频数据的码流,并进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
根据本申请的第八方面,提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被执行时实现上述第一方面提及的方法。
应用本申请提供的方案,本申请实施例提供了一种用于对终端设备进行控制的方法,可以建立控制设备上的控制部件和终端设备上的控制部件的映射关系,即将控制设备上的控制部件的功能映射成终端设备上的控制部件的功能,在通过图传系统传输控制设备上的控制部件触发的控制信号时,可以通过该图传系统对控制信号进行协议的转换,将该控制信号对应的控制功能翻译成该控制部件在终端设备上的对应控制部件的控制功能, 再由终端设备执行。由于目前大多数终端设备上的控制部件的功能都可以由用户自行设置,因而,控制设备上的控制部件的功能也不再是固定的,而是可以灵活变化。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,而非限制本申请。
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1(a)-1(d)是本申请实施例的多种图传系统的示意图。
图2是本申请一个实施例的终端设备的控制方法的流程图。
图3是本申请一个实施例的建立终端设备的控制部件与控制设备的控制部件的映射关系的示意图。
图4是本申请一个实施例的控制装置的逻辑结构的示意图。
图5是本申请一个实施例的图传系统的示意。
图6是现有技术中图传设备和终端设备连接的示意图。
图7是本申请一个实施例的图传设备的示意图。
图8本申请一个实施例的图传设备实现“一发多收”的示意图。
图9本申请一个实施例的图传设备实现“多发一收”的示意图。
图10本申请一个实施例的图传设备的示意图。
图11本申请一个实施例的图传设备的结构的示意图。
图12本申请一个实施例的图传设备的结构的示意图。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
无线图传技术广泛用于视频拍摄、影视拍摄等领域中。通常一套无线图传系统包括图传发射设备和图传接收设备。如图1(a)-1(d)展示了四种图传系统的示意图。在一些场景,图传发射设备可以是本身就具备图像采集功能的设备,然后将采集到的图像或视频发送给图传接收设备,比如,图传发射备可以是一个集成有摄像头的设备。在一些场景,图传发射设备可以是一个独立的具备数据传输功能的设备,可以通过有线或者无线连接的方式将图传发射设备与图像采集设备连接,然后可以获取图像采集设备采集的图像或视频,再发送给图传接收设备。比如,图传发射设备可 以通过数据线与相机或者云台相机连接,然后获取相机或云台相机的采集的图像或视频,再发送给图传接收设备。
在一些场景,图像接收设备可以是本身就具备显示屏幕的设备,图传接收设备在接收图传发射设备发送的到图像或视频后,可以通过自身的显示屏幕显示,比如,图传接收设备可以是图传屏。在一些场景,图传接收设备也可以是一个独立的具有数据传输功能的设备,可以通过有线或无线的方式将图传接收设备与各种其他设备连接,然后图传接收设备将接收到的图像或视频发送给其他设备,通过其他设备显示。
随着用户需求的增加,用户不再仅仅满足于利用无线图传技术实现远程看图功能,还希望可以基于接收到的图像或视频远程地对图像采集设备和/或搭载图像采集设备的可移动平台进行一些操控,比如,对焦、调整焦距、改变镜头朝向、或者调整图像采集装置的各拍摄参数等等,又例如控制可移动平台运动、调整姿态等等。因而,可以对无线图传技术进行进一步的发掘,以利用无线图传技术实现更多的功能。
比如,在一些场景,图传接收设备或与图传接收设备通信连接的设备除了具备显示图像或视频的功能之外,还可以具备对图像采集设备的控制功能。比如,图传接收设备或与图传接收设备连接的设备中还可以设置手柄、摇杆、按键等控制部件,通过这些控制部件可以对图像采集设备进行控制,比如,调整焦距、对焦、调整拍摄参数等,或者如果图像采集设备设置于云台上,还可以通过这些控件部件控制云台转动等。
为了方便描述,以下将用于采集图像或视频的设备称为终端设备,其中,终端设备可以是仅具有图像或视频采集功能,而不具备图传发射功能的设备,或者该终端设备也可以是既具有图像或视频采集功能,又具有图传功能的设备。以下将用于对该终端设备进行控制的设备称为控制设备,其中,该控制设备可以是仅具有视频显示功能、以及对终端设备进行控制的功能,而不具备图传功能的设备,或者该控制设备也可以是既具有视频显示功能、以及对终端设备进行控制的功能,又具备图传功能的设备。
目前,针对可以利用控制设备的控制部件对终端设备进行控制的场景,存在以下问题:一个是控制设备上的控制部件的控制程序都是预先写好的,控制部件对应的控制功能大多都是固定的,比如,某个手柄就是用于调节云台转动,或者某个波轮就是用于对焦,其控制功能不能灵活变通。另一个是一般终端设备和控制设备都是配套使用的,即只有与终端设备配套的某个控制设备才能对其进行控制,比较局限,不够灵活。
基于此,本申请实施例提供了一种用于对终端设备进行控制的方法,可以建立控制设备上的控制部件和终端设备上的控制部件的映射关系,即将控制设备上的控制部件的功能映射成终端设备上的控制部件的功能,在通过图传系统传输控制设备上的控制部件触发的控制信号时,可以通过该图传系统对控制信号进行协议的转换,将该控制信号对应的控制功能翻译成该控制部件在终端设备上的对应控制部件的控制功能,再由终端设备执行。即建立控制设备上的控制部件与终端设备上的控制部件的镜像关系, 由于目前大多数终端设备上的控制部件的功能都可以由用户自行设置,因而,控制设备上的控制部件的功能也不再是固定的,而是可以灵活变化。
其中,本申请实施例提供的控制方法可以由图传系统中的发射端或接收端执行,该发射端可以是一个独立的图传发射设备,也可以集成在终端设备上。该接收端可以是一个独立的图传接收设备,也可以集成在控制设备上。
本申请实施例中的终端设备可以是云台、相机、无人机等可以采集图像或者视频的各类设备。本申请实施例中的控制设备可以是具备显示功能且设有一个或多个控制部件的各类控制设备,比如,控制设备可以是遥控器、具备控制功能的图传屏、体感控制器等,控制部件可以是手柄、波轮、按键、摇杆等。
具体的,如图2所示,本申请实施例的控制方法可以包括以下步骤:
S202、获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于与所述终端设备通信连接,以控制所述终端设备;
通常终端设备上可以设置一些控制部件,用于对终端设备的功能进行控制,比如,以终端设备为设置有相机的云台为例,云台上可以设置波轮、按键、摇杆等,这些控制部件可以控制云台执行某些控制功能,比如,调整云台转动,或者对相机进行对焦和调焦等等。为了方便用户可以通过终端设备的控制设备远程对终端设备进行控制。可以建立控制设备上的控制部件和终端设备上的控制部件的映射关系,当用户触发控制设备上的第一控制部件时,则等同于触发终端设备上与该第一控制部件的相对应的第二控制部件,从而可以控制终端设备执行该第二控制部件对应的控制功能。
所以,在步骤S202中,当用户需要远程对终端设备进行控制时,用户可以触发该终端设备的控制设备上的第一控制部件,控制设备会产生相应的控制信号,其中,不同的控制部件可以对应不同的控制信号,以便基于控制信号可以确定当前用户触发的哪个控制部件。执行该方法的设备可以获取该控制信号。
S204、发送所述控制信号至所述终端设备,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上设有第二控制部件,所述第二控制部件用于获取用户的操作以控制所述终端设备,所述第一控制部件以及所述第二控制部件均能够控制所述终端设备的多种功能,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化。
在步骤S204中,由于终端设备上包括与该第一控制部件相对应的第二控制部件,因此,在获取到该控制信号后,可以确定与该第一控制部件相对应的第二控制部件当前对应的控制功能,然后将该控制功能作为该控制信号对应的操作,以便终端设备执行该控制功能。
举个例子,如图3所示,假设终端设备为设置有相机的云台,云台上包括旋钮轮1和旋钮2,旋钮1用于控制云台转动,旋钮2用于控制相机拍照, 而控制设备可以是遥控器,遥控器上包括摇杆1和摇杆2,因而可以建立两个设备的控制部件之间的映射关系,即旋钮1-摇杆1,旋钮2-摇杆2,当用户调节遥控器上的旋钮1时,则也可以控制云台转动,当用户调节遥控器上的旋钮2时,则也可以控制相机拍照。当然,实际在建立映射关系的时候,可以对控制部件的具体操作方式进行更加细致的映射,比如,旋钮1逆时针旋转-摇杆1左转、旋钮1顺时针旋转-摇杆1右转,具体可以根据控制部件的特点和实际需求设置。
在一些实施例中,第一控制部件或第二控制部件可以是波轮、手柄、摇杆、按键、旋钮等一种或多种。
在一些实施例中,终端设备上的第二控制部件对应的控制功能可以由用户自行设置,即其控制功能可以是变化的,而非固定。由于本申请实施例中控制设备中的控制部件与终端设备的控制部件对应,因而,当终端设备的控制部件对应的控制功能变化时,控制设备的控制部件对应的控制功能也会相应的变化。即触发第一控件部件产生的控制信号指示的控制功能会随着第二控制部件对应的控制功能的变化而变化。通过建立控制设备的控制部件与终端设备的控制部件的映射关系,从而控制设备上的控制部件对应功能可以随着终端设备上的控制部件的功能的变化而变化,不再是固定不变,且无需对控制设备的配置参数进行任何的修改,更加地灵活方便。
在一些实施例中,第二控制部件对应的控制功能可以由用户通过交互界面设置,比如,在一些场景,终端设备上包括交互界面,因而用户可以通过终端设备上的交互界面设置第二控制部件对应的控制功能。或者用户也可以通过控制设备上的交互界面设置好第二控制部件对应的控制功能,再将对应关系发送给终端设备。比如,可以在交互界面上展示终端设备上的各控制部件,用户点击每个控制部件后,可以显示一个下拉菜单,下拉菜单对应各种控制功能,用户可以选取其中的一种作为该控制部件对应的控制功能。
由于控制设备上的各个控制部件对应的控制功能是可以变化的,靠用户记忆这些对应关系比较复杂,也不方便用户使用。所以,为了方便用户在利用控制设备的控制部件对终端设备进行控制时,可以快速的知道每个控制设备的各个控制部件对应的功能,在一些实时例中,可以通过控制设备的交互界面展示控制设备上的各个控制部件对应的控制功能。比如,可以设置一个功能介绍页面,该页面上可以展示各个控制部件对应的功能。
在一些实施例中,为了方便用户记忆和理解控制设备上的控制部件的功能,同时也为了方便两个设备上的控制部件建立比较准确且符合用户操作习惯的映射关系,该第一控制部件和第二控制部件可以是同种类型的控制部件。比如,第一控制部件是波轮,则第二控制部件也是波轮,第一控件部件是按键,则第二控制部件也是按键。如此,可以方便用户在使用过程中快速将两者关联起来。并且,由于针对不同的控制部件操作方式也不一样,将同种类型的控制部件关联,也可以方便将两者的操作方式建立映射关系。比如,波轮包括顺时针和逆时针旋转两种操作方式,则将两个设备上的波轮关联起来,也方便建立两个波轮上的这两种操作方式的映射关系,比如,终端设备的波 轮顺时针旋转-控制设备上的波轮顺时针旋转。
当然,由于控制设备和终端设备上的控制部件均可以对终端设备进行控制,为了避免控制指令混乱,比如,同一时刻分别有用户触发控制设备上的控制部件,以及触发终端设备的控制部件,导致终端设备接收到多个控制指令,并且这些指令可能还是相悖的。为了避免这种情况,在一些实施例中,可以设置两个设备上发出的控制信号的优先级,比如,通常终端设备一侧的用户比较接近终端设备,其做出的决断往往更为准确,因而,可以设置触发终端设备上的控制部件产生的控制信号的优先级高于触发控制设备上的控制部件产生的控制信号的优先级,即终端设备会优先执行用户触发终端设备上的控制部件产生的控制指令。
当然,也可以将控制设备一侧发出的指令的优先级设置的更高一些,具体可以结合实际需求灵活设置。
在一些场景,为了避免控制指令紊乱,也可以在控制设备或终端设备上设置功能禁用的功能,比如,可以在控制设备或终端设备的交互界面上设置功能禁用的控件,用户触发该控件后,可以禁用终端设备上的控制部件的功能,或者也可以禁用控制设备上的控制部件的功能,只保留一侧设备上的控制部件的功能,避免控制指令紊乱。
在一些实施例中,可以预先存储控制设备上的控制部件与终端设备上的控制部件的第一映射关系,比如,第一映射关系可以存储在图传发射端所在的设备上,或者也可以存储在图传接收端所在的设备上,在确定控制信号指示的控制功能时,可以先基于该第一映射关系,确定与第一控制部件对应的所述第二控制部件,然后将第二控制部件对应的控制功能作为该控制信号对应的控制功能。
目前在对终端设备进行远程控制的时候,通常每个终端设备就只能用其配套的控制设备对其进行控制,比较局限,控制方式也比较单一。为了可以让多种类型的控制设备都能对终端设备进行远程控制,在一些实施例中,每个终端设备的控制设备可以包括多种类型的设备,第一映射关系也可以包括组,每组第一映射关系可以用于表征该终端设备上的控制部件与其中一种类型的控制设备上的控制部件的对应关系。
举个例子,假设终端设备为设置有相机的云台,控制设备可以是遥控器、图传屏、摇轮等,因而可以设置三组第一映射关系,分别用于记录云台上的控制部件和遥控器上的控制部件的对应关系、云台上的控制部件和图传屏上的控制部件的对应关系、以及云台上的控制部件和摇轮上的控制部件的对应关系等。在获取到用户触发控制设备上控制部件产生的控制信号时,可以基于控制信号确定当前用户使用的是哪一款控制设备,以及是该款控制设备上的哪个控制部件,进而调用相应的第一映射关系确定在终端设备上与该第一映射关系对应的控制部件。
在一些实施例中,第一映射关系可以是在产品出厂前预先固化在产品上,比如,产品研发阶段可以预先设置好第一映射关系,并存储在图传发射端所在的设备上或图传接收端所在的设备上。当控制设备与终端设备处于对上频 的状态时,即两者匹配上传输数据的频道时,则自动确定该第一映射关系。
在一些实施例中,为了让控制设备的控制部件对应的功能可以更加灵活,第一映射关系也可以由用户自行设置。比如,可以在控制设备的交互界面上设置一个建立第一映射关系的控件,在终端设备和控制设备建立连接后,当用户点击该控件,则可以在控制设备的交互界面上展示控制设备上的控制部件对应的第一标识,以及终端设备上的控制部件对应的第二标识,基于用户对第一标识和第二标识的操作,确定该第一映射关系。
比如,可以在交互界面展示控制设备上的控制部件的名称或者图标、以及终端设备上的控制部件的名称或者图标,用户可以对该第一标识或第二标识进行拖拽处理,比如,用户将某个第一标识拖拽到对应的第二标识处,即建立两个控制部件的映射关系,或者用户也可以在屏幕中划线将两个控制部件连接,从而建立两个控制部件的映射关系。或者用户点击第一标识时,会出现下拉菜单,展示多个第二标识,然后用户可以选择下拉菜单中的第二标识,以建立两个控制部件的映射关系。
由于终端设备上的各个控制部件与控制功能的第二映射关系可以由用户自行设置,比如,用户可以通过终端设备或控制设备上的交互界面设置该第二映射关系,因此,图传发射端或图传接收端还可以获取终端设备上的各控制部件与控制功能的第二映射关系,基于该第一映射关系和第二映射关系确定控制设备上的控制部件对应的控制功能,以在控制设备的交互界面上显示控制设备上的各控制部件与控制功能的对应关系。比如,当用户通过控制设备的交互界面设置好终端设备上的各控制部件对应的控制功能后,即确定第二映射关系后,可以从控制设备获取该第二映射关系,然后基于第一映射关系和第二映射关系确定控制设备上的各控制部件对应的控制功能,以显示在控制设备的交互界面上,以便用户可以通过交互界面展示的控制设备上的各控制部件与控制功能的对应关系对终端设备进行控制。
在一些实施例中,该方法可以由图传系统的图传发射设备和图传接收设备中的任一个执行,如图1(d)所示,该图传发射设备与终端设备通信连接,该图传接收设备与控制设备通信连接。比如,图传发射设备和图传接收设备可以是两个独立的设备,其中,图传发射设备可以通过有线或无线的方式与终端设备连接,图传接收设备可以通过有线或无线的方式与控制设备通信连接。用户触发控制设备上的第一控制部件后,会将产生的信号发送给图传接收设备,图传接收设备可以基于预先存储的第一映射关系对该控制信号进行协议转换,确定该控制信号对应的控制功能后,再发送给图传发射设备,以便图传发射设备发送给终端设备,对终端设备进行控制。或者也可以是图传发射设备将控制信号发送给图传接收设备,由图传接收设备基于预先存储的第一映射关系进行协议转换,确定该控制信号对应的控制功能后,再发送给终端设备。通过在图传系统中对控制信号进行协议的转换,确定控制信号当前对应的控制功能,从而实现终端设备上的控制部件与控制设备上的控制部件之间的映射。
相应的,本申请实施例一种终端设备的控制装置,如图4所示,所述控制装置包括处理器41、存储器42、存储于所述存储器42可供所述处理器41执行的计算机程序,所述计算程序被所述处理器41执行时实现以下步骤:
获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于与所述终端设备通信连接,以控制所述终端设备;
发送所述控制信号至所述终端设备,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上设有第二控制部件,所述第二控制部件用于获取用户的操作以控制所述终端设备,所述第一控制部件以及所述第二控制部件均能够控制所述终端设备的多种功能,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化。
在一些实施例中,所述控制信号指示的控制功能随着所述第二控制部件对应的控制功能的变化而变化。
在一些实施例中,所述第二控制部件对应的控制功能由用户通过交互界面设置,所述交互界面包括所述控制设备的交互界面和/或所述终端设备的交互界面。
在一些实施例中,所述控制设备上的交互界面展示有所述控制设备的各个控制部件对应的控制功能。
在一些实施例中,所述第一控制部件和所述第二控制部件为同种类型的控制部件。
在一些实施例中,所述第一控制部件或所述第二控制部件包括以下一种或多种:波轮、手柄、摇杆、按键、旋钮。
在一些实施例中,触发所述终端设备上的控制部件产生的控制信号的优先级高于触发所述控制设备上的控制部件产生的控制信号的优先级。
在一些实施例中,所述处理器用于发送所述控制信号至所述终端设备时,具体用于:
基于所述控制设备上的控制部件与所述终端设备上的控制部件的第一映射关系,确定与所述第一控制部件对应的所述第二控制部件;
将所述第二控制部件对应的控制功能作为所述控制信号对应的控制功能。
在一些实施例中,所述控制设备包括多种类型的设备,所述第一映射关系包括多组,每组第一映射关系用于表征所述终端设备上的控制部件与一种类型的控制设备上的控制部件的对应关系。
在一些实施例中,所述第一映射关系基于以下方式确定:
在所述控制设备的交互界面上展示所述控制设备上的控制部件对应的第一标识,以及所述终端设备上的控制部件对应的第二标识;
基于用户对所述第一标识和所述第二标识的操作,确定所述第一映射关系。
在一些实施例中,所述第一映射关系基于以下方式确定:
当所述控制设备与所述终端设备处于对上频的状态时,自动确定所述第一映射关系。
在一些实施例中,所述处理器还用于:
获取所述终端设备上的各控制部件与所述控制功能的第二映射关系;
基于所述第一映射关系和所述第二映射关系确定所述控制设备上的控制部件对应的控制功能,以在所述控制设备的交互界面上显示所述控制设备上的各控制部件与所述控制功能的对应关系。
在一些实施例中,所述控制装置可以是图传系统的图传发射设备。
在一些实施例中,所述控制装置可以是图传系统的图传接收设备。
进一步地,本申请实施例提供了一种图传系统,如图5所示,所述图传系统50包括图传发射设备51和图传接收设备52,所述图传发射设备51用于与终端设备53通信连接,所述图传接收设备52用于与所述终端设备53的控制设备54通信连接,所述图传发射设备51和所述图传接收设备52中的任一个用于执行上述任一实施例所述的控制方法。
无线图传技术不仅仅用于将终端设备采集的图像发送给该终端设备的控制设备,以便控制设备显示图像,同时,无线图传技术还可以用于将用户通过控制设备发送的控制指令传输给终端设备,以便用户远程对终端设备进行控制。目前,在一些场景,图传系统的发射端可以做成一个独立的图传设备,该图传设备可以通过数据线与终端设备连接,以便将终端设备采集的图像发送给控制设备一端。而图传接收端也可以做成一个独立的图传设备,与控制设备通信连接,或者图传接收端也可以集成在控制设备上。
由于与终端设备连接的图传设备既需要传输终端设备采集的图像,又需要传输控制设备发送给终端设备的控制指令,因而,如图6所示,一般需要在图传设备上设置2个硬件通信接口,比如,通常会设置一个HDMI接口和一个USB接口,HDMI接口用于传输图像数据,USB接口用于传输控制指令。在使用图传设备传输终端设备采集的图像和控制设备对终端设备的控制指令时,需要同时利用一根HDMI数据线和一根USB数据将图传设备和终端设备连接,以实现数据传输和控制指令传输两种功能。很明显,这种方式需要在图传设备上设置多个硬件接口,不利于图传设备的小型化和轻便化,同时用户在使用图传设备时需要连接多根数据线,操作比较繁琐,使用起来不够便捷。
基于此,本申请实施例提供了一种图传设备,如图7所示,为本申请实施例中的一种图传设备的示意图(需要指出的是本申请实施例提供的图传设备的外观形状不局限于图中所示的图传设备),该图传设备包括硬件接口,图传设备可以通过该硬件接口与终端设备连接,其中,该终端设备可以是具有图像采集功能的设备,比如,可以是相机、无人机、设置有相机的云台等等。该图传设备可以通过该硬件接口从终端设备获取图像数据,然后将图像数据发送给该终端设备的控制设备,以便用户可以通过控制设备的显示界面查看图像。其中,控制设备可以是遥控器、图传屏、体感控制器等设备。同时,终端设备也可以接收控制设备发送的控制指令,通过该硬件接口将控制指令 输出给终端设备,以实现对终端设备的远程控制。其中,控制设备上可以设置有控制部件,比如,手柄、摇杆、按键、波轮、旋钮等,用户可以触发这些控制部件,以发出控制指令,或者用户可以触发该控制设备的显示界面上的控件发送控制指令。该控制指令可以是用于控制终端设备的各类指令,比如,终端设备可以是设置有相机的云台,因而,该控制指令可以是控制云台转动,或者控制云台上的相机对焦、调焦、拍照等。
通过在图传设备的一个硬件接口上集成图像数据的传输和控制指令的传输两种功能,可以无需在图传设备设置两个硬件接口分别执行上述两种功能,可以简化图传设备,同时用户在使用图传设备时,也无需连接多根数据线,方便用户使用。
在一些实施例中,为了实现同一个硬件接口既能传输图像,又能传输控制指令,该硬件接口可以是HDMI接口,该控制指令可以是HDMI CEC格式的指令。通过将HDMI CEC技术和无线图传技术相结合,即可以实现通过一个HDMI接口同时完成图像数据的传输,以及控制指令的传输。当然,该硬件接口也可以是其他类型的接口,比如SDI接口、USB接口等,该控制指令的类型也可以基于硬件接口的类型适配性的调整。
在一些实施例中,该终端设备可以是拍摄装置,该控制指令可以用于调整拍摄装置的拍摄参数。比如,该控制指令可以用于调节拍摄装置的焦点的位置、焦距的大小、光圈的大小等等。
在一些实施例中,如图8所示,终端设备的控制设备可以是多个设备,比如,同时有多个用户需要查看终端设备采集的图像,因而,图传设备可以包括多个传输通道(如图8中的传输通道1-3),每个传输通道可以对应一个控制设备(如图8中的控制设备1-3),每个传输通道用于将从终端设备获取到的图像数据发送给相应的控制设备,以及用于将该控制设备发送的控制指令发送给终端设备。即图传设备可以实现“一对多”的功能,将一个终端设备采集的图像数据发送给多个控制设备,同时,将多个控制设备的控制指令发送给终端设备。当然,在多个控制设备均能对终端设备进行控制的场景,可以设置各个控制设备发出的控制指令的优先级,避免控制指令混乱。
在一些实施例中,如图9所示,该图传设备可以包括多个上述硬件接口(如图9中的硬件接口1-3),每个硬件接口用于连接一个终端设备(如图9中的终端设备1-3),用于通过该硬件接口传输相连接的终端设备的图像数据和控制指令。该图传设备可以包括多个传输通道(如图9中的传输通道1-3),每个传输通道对应一个终端设备,用于将从该终端设备接收到的图像数据发送给该终端设备的控制设备,以及用于将该控制设备发送的控制指令发送给该终端设备。即图传设备可以实现“多对一”的功能,将多个终端设备采集的图像数据发送给同一个控制设备,以便用户可以同时远程查看多个终端设备采集的图像。同时,图传设备也可以将控制设备发出的控制指令分别发送给各个终端设备,以实现利用一个控制设备对多个终端设备进行控制。其中,用户在通过控制设备发送控制指令之前,可 以先从多个终端设备中选定要控制的终端设备,然后再发送控制指令。
在一些实施例中,为了方便用户在控制设备上查看多个终端设备采集的图像,可以在控制设备的交互界面上通过分屏显示的方式显示从各个终端设备接收到的图像数据。
目前,在使用无线图传系统将终端设备采集的图像数据发送给接收端的显示设备时,通常图传发射设备中的编码单元都是按照固定的视频规格(比如,帧率和分辨率等)从视频输入接口接收源视频数据,然后再按照固定的编码参数(比如,码率、压缩率)对接收到的源视频数据进行编码处理后再发送给图传接收设备。同样的,图传接收设备也会按照该固定的视频规格对编码后的源视频数据进行解码处理,得到固定帧率和分辨率的视频图像再显示。然而,由于图传发射设备连接的终端设备可能会变化,每个终端设备采集的源视频数据的视频规格也会发生变化,比如,帧率或分辨率可能不同,如果图传发射设备中的编码单元均按照固定的视频规格从视频输入接口接收源视频数据,再采用固定的编码参数对接收到的源视频数据进行编码,那么可能会到导致无法充分合理的利用图传发射设备的无线带宽资源的问题,且在显示设备端也无法达到理想的显示效果。
举个例子,假设图传发射设备的编码单元都是按照固定视频规格(比如,帧率:60帧/s,分辨率:10K)从视频输入接口接收源视频数据,然后按照相同的编码参数(比如,相同的码率和压缩率)对接收到的源视频数据编码后发送给图传接收设备,而图传接收设备也会将编码后的源视频数据解码成固定规格(帧率:60帧/s,分辨率:10K)的视频图像再显示。因而,如果终端设备采集的源视频数据的帧率是30帧/s,分辨率是20K时,图传设备的编码单元依然按照帧率:60帧/s,分辨率:10K,从视频输入接口接收源视频数据,再编码处理,则会出现由于终端设备每秒采集的源视频数据的帧率小于编码单元每秒编码的帧率,则编码单元会重复地对相同的图像帧编码,浪费带宽资源,同样的,将原本高分辨率的图像按照低分辨率图像接收后再编码,也会导致图传接收设备解码得到的视频图像的分辨率低于源图像,导致图像的显示效果不理想。同样的,如果终端设备采集的源视频数据的帧率是80帧/s,分辨率是5K时,图传发射设备的编码单元依然按照帧率:60帧/s,分辨率:10K从视频输入接口接收源视频数据,再编码处理,则会出现可能当前的网络资源良好,但是却没有最大化的利用其传输视频数据,并且图传接收设备解码得到视频图像的帧率低于源视频数据,可能会出现显示的视频图像不够流畅的问题。
基于此,本申请实施例提供了一种图传发射设备,图传发射设备在对从终端设备获取到的源视频数据进行编码处理时,不再是按照固定的编码策略对源视频数据进行编码,比如,不再是按照固定的帧率、分辨率等视频参数从终端设备接收源视频数据,也不再是按照固定的码率和压缩率等编码参数对源视频数据进行编码处理,而是基于源视频数据的视频参数自适应的调整编码策略,使得在接收端的显示设备显示的视频数据的帧率、分辨率等视频参数不再是固定不变的,而是可以随着源视频数据的视频参数的变化而变化, 从而可以最大化的利用图传发射设备的带宽资源,同时在接收端显示的视频图像时也可以达到更佳的显示效果。
如图10所示,本申请实施例提供的图传发射设备被配置为与终端设备通信连接,比如,图传发射设备可以包括硬件通信接口,通过该硬件通信接口与终端设备有线连接,或者图传发射设备中可以包括无线传输单元,通过无线传输单元与终端设备无线连接。其中,该终端设备可以是具有图像采集功能的设备,比如,可以是相机、无人机、设置有相机的云台等等。
图传发射设备可以获取终端设备输入的源视频数据,然后可以检测终端设备当前输入的源视频数据的视频参数,比如,在一些场景,该视频参数可以是源视频数据的帧率、分辨率等一种或多种。然后,可以根据该源视频数据的视频参数对源视频数据进行编码处理,比如,可以确定和该源视频数据的视频参数相匹配的编码策略,其中,编码策略用于指示图传发射设备的编码单元接收到的视频图像的帧率、分辨率等视频参数,以及编码单元对源视频数据编码时所采用的码率、压缩率等编码参数,然后可以基于该编码策略对源视频数据编码处理,并将编码处理后的源视频数据发送给该终端设备的显示设备。其中,该终端设备的显示设备可以是带有显示屏幕的各种电子设备,通过显示设备的显示屏幕将终端设备采集的视频图像显示给用户,可以实现用户远程看图。
其中,在一些场景,显示设备可以集成有图传接收功能的设备,即显示设备也是图传接收设备,显示设备接收到编码处理的源视频数据后,可以进行解码处理,得到目标视频数据再显示。在一些场景,显示设备可以是仅仅具备显示功能的设备,显示设备可以和图传接收设备通信连接,图传接收设备在接收到编码处理的源视频数据后,可以解码处理得到目标视频数据后再输出给显示设备,以便显示设备显示。
其中,由于图传发射设备在对源视频数据进行编码处理时,是基于源视频数据的视频参数自适应的调整编码策略,即编码时的帧率、码率、分辨率、压缩率等都是自适应调整的,而不是固定不变的,同样的,解码端也适应性按照该视频参数解码,所以,最终显示设备中显示的目标视频数据的视频参数也随着源视频数据的视频参数的变化而变化。
在一些实施例中,该图传发射设备包括视频输入接口,图传发射设备通过该视频输入接口从终端设备获取源视频数据,其中,视频输入接口可以是HDMI接口、SDI接口等。
在一些实施例中,如图11所示,该图传发射设备可以包括检测单元,该检测单元用于检测终端设备当前输入的源视频数据的视频参数。其中,检测单元可以是一个硬件单元,比如,可以是一个专门用于检测源视频数据的帧率、分辨率的芯片等。当然,在一些场景,检测单元也可以是一个软件单元,即可以是一个具备检测源视频数据的视频参数的程序或一段代码。
在一些实施例中,如图12所示,该图传发射设备还包括处理单元和编码单元,其中,该处理单元用于从检测单元中接收当前检测得到的视频参 数,并在确定该当前检测到的视频参数与上一检测到的历史视频参数不一致的情况下,将当前检测到的视频参数发送给编码单元。其中,处理单元可以是图传设备中的处理器,比如,CPU等。
编码单元用于基于从处理单元接收当前检测到的视频参数,并确定与该当前检测到的视频参数相匹配的编码策略,然后基于该编码策略对源视频数据进行编码,比如,编码单元可以调整从终端设备接收的视频数据的帧率、分辨率等视频参数,同时可以调整编码过程中所使用的码率、对视频数据进行压缩处理的压缩率等编码参数,使得当前的编码策略可以最大化的对图传发射设备的带宽资源进行利用。编码单元对源视频数据进行编码后,得到源视频数据的码流,然后可以通过无线传输单元将编码得到的源视频数据的码流发送给显示设备。其中,编码单元可以是一个具有编码功能的硬件单元,比如,可以是一个专门用于编码的芯片,或者在一些场景,CPU具有编码功能,该编码单元也可以是CPU。即检测单元、处理单元和编码单元可以是三个独立的芯片,也可以是同一个芯片。
为了实现接收端不会出现过多的延时,即终端设备进行视频采集后,显示设备即可以快速接收到视频图像并显示,不会出现长时间的黑屏现象,给用户带来不好的体验。因而,在图传发射设备上电后,编码单元即可以通过图传发射设备的视频输入接口从终端设备获取源视频数据,然后对获取的源视频数据进行编码处理后发送。而编码单元需按照一定的规格初始化接收的源视频数据的视频参数,考虑到大多数情况,当前的源视频数据的视频参数和上一次的视频参数都是一致的(除非更换了视频参数不一样的终端设备),因而,每次图传发射设备上电后,都可以将图传发射设备接收源视频数据的视频参数初始化为上一次的视频参数,以便可以快速接收源视频数据并编码传输。所以,在一些实施例中,该图传发射设备还可以包括存储单元,在确定当前检测到源视频数据的视频参数和上一次检测到的历史视频参数不一致后,该图传设备还用于将当前检测到的视频参数存储于该存储单元中,以便下一次图传设备上电时,编码单元可以将接收源视频数据的视频参数初始化为存储单元最近一次存储的视频参数。
在一些实施例,对源视频数据进行编码得到的码流中包括用于指示该视频参数的信息,比如,可以在码流的数据包中的头部信息中记录该视频参数,从而,解码端在获取到码流后,可以从码流信息中获取该视频参数,然后基于该视频参数对码流进行解码,得到目标视频数据,使得解码端解码得到的目标视频数据的视频参数也自适应的随着源视频数据的视频参数的变化而变化,到达更理想的显示效果。
相应的,本公开实施例还提供了一种图传接收设备,该图传接收设备被配置为与图传发射设备通信连接,该图传接收设备用于从图传发射设备接收源视频数据的码流,并从码流中获取源视频数据的视频参数,比如,可以从码流的头部信息获取该视频参数。然后可以基于源视频数据的视频参数对码流进行解码处理得到目标视频数据,以显示该目标视频数据,其中,目标视频数据的视频参数随着源视频数据的视频参数的变化而变化。
进一步地,本公开实施例提供一种图传系统,所述图传系统包括图传发射设备和图传接收设备,所述图传发射设备用于与终端设备通信连接,所述图传接收设备用于与所述终端设备的显示设备通信连接,
所述图传发射设备用于检测所述终端设备输入的源视频数据的视频参数,基于所述源视频数据的视频参数对所述源视频数据进行编码处理,得到所述源视频数据的码流,并将所述码流发送给所述图传接收设备;
所述图传接收设备用于从所述码流中获取所述源视频数据的视频参数,基于所述源视频数据的视频参数对所述码流进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
其中,所述图传发射设备和所述图传接收设备在对视频数据进行编解码处理时的具体细节可参考上述实施例中的描述,在此不再赘述。
进一步地,本申请实施例还提供一种编码方法,所述方法包括:
检测终端设备输入的源视频数据的视频参数;
基于所述源视频数据的视频参数对所述源视频数据进行编码处理,得到所述源视频数据的码流,并将所述码流发送给所述终端设备的显示设备,以在所述显示设备的屏幕上显示对所述码流进行解码后得到的目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
其中,在一些场景,该编码方法可以由图传发射设备执行,图传发射设备执行该编码方法时的具体细节可参考上述实施例中的描述,在此不再赘述。
进一步地,本申请实施例还提供一种解码方法所述方法包括:
接收源视频数据的码流;
从所述码流中获取所述源视频数据的视频参数,基于所述源视频数据的视频参数对所述码流进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
其中,在一些场景,该解码方法可以由图传接收设备执行,图传接收设备执行该解码方法时的具体细节可参考上述实施例中的描述,在此不再赘述。
其中,不难理解,上述各实施例中的描述的技术方案在不存在冲突的情况,可以进行组合,鉴于篇幅原因,本申请实施例中不一一例举。
相应地,本申请实施例还提供一种计算机存储介质,所述存储介质中存储有程序,所述程序被处理器执行时实现上述任一实施例中的方法。
本申请实施例可采用在一个或多个其中包含有程序代码的存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。计算机可用存储介质包括永久性和非永久性、可移动和非可移动媒体,可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括但不限于:相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除 可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上对本发明实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。
Claims (56)
- 一种终端设备的控制方法,其特征在于,所述方法包括:获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于与所述终端设备通信连接,以控制所述终端设备;发送所述控制信号至所述终端设备,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上设有第二控制部件,所述第二控制部件用于获取用户的操作以控制所述终端设备,所述第一控制部件以及所述第二控制部件均能够控制所述终端设备的多种功能,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化。
- 根据权利要求1所述的方法,其特征在于,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化,包括:若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相同变化。
- 根据权利要求1或2所述的方法,其特征在于,所述第二控制部件对应的控制功能由用户通过交互界面设置,所述交互界面包括所述控制设备的交互界面和/或所述终端设备的交互界面。
- 根据权利要求1-3任一项所述的方法,其特征在于,所述控制设备上的交互界面展示有所述控制设备的各个控制部件对应的控制功能。
- 根据权利要求1-4任一项所述的方法,其特征在于,所述第一控制部件和所述第二控制部件为同种类型的控制部件。
- 根据权利要求1-5任一项所述的方法,其特征在于,所述第一控制部件或所述第二控制部件包括以下一种或多种:波轮、手柄、摇杆、按键、旋钮。
- 根据权利要求1-6任一项所述的方法,其特征在于,触发所述终端设备上的控制部件产生的控制信号的优先级高于触发所述控制设备上的控制部件产生的控制信号的优先级。
- 根据权利要求1-7任一项所述的方法,其特征在于,发送所述控制信号至所述终端设备,包括:基于所述控制设备上的控制部件与所述终端设备上的控制部件的第一映射关系,确定与所述第一控制部件对应的所述第二控制部件;将所述第二控制部件对应的控制功能作为所述控制信号对应的控制功能。
- 根据权利要求8所述的方法,其特征在于,所述控制设备包括多种类型的设备,所述第一映射关系包括多组,每组第一映射关系用于表征所述终端设备上的控制部件与一种类型的控制设备上的控制部件的对应关系。
- 根据权利要求8或9所述的方法,其特征在于,所述第一映射关 系基于以下方式确定:在所述控制设备的交互界面上展示所述控制设备上的控制部件对应的第一标识,以及所述终端设备上的控制部件对应的第二标识;基于用户对所述第一标识和所述第二标识的操作,确定所述第一映射关系。
- 根据权利要求8或9所述的方法,其特征在于,所述第一映射关系基于以下方式确定:当所述控制设备与所述终端设备处于对上频的状态时,自动确定所述第一映射关系。
- 根据权利要求1-11任一项所述的方法,其特征在于,所述方法还包括:获取所述终端设备上的各控制部件与所述控制功能的第二映射关系;基于所述第一映射关系和所述第二映射关系确定所述控制设备上的控制部件对应的控制功能,以在所述控制设备的交互界面上显示所述控制设备上的各控制部件与所述控制功能的对应关系。
- 根据权利要求1-12任一项所述的方法,其特征在于,所述方法由图传系统的图传发射设备和图传系统的图传接收设备中的任一个执行,所述图传发射设备与所述终端设备通信连接,所述图传接收设备与所述控制设备通信连接。
- 一种终端设备的控制装置,其特征在于,所述控制装置包括处理器、存储器、存储于所述存储器可供所述处理器执行的计算机程序,所述计算程序被所述处理器执行时实现以下步骤:获取用户触发控制设备上的第一控制部件时产生的控制信号,所述控制设备用于与所述终端设备通信连接,以控制所述终端设备;发送所述控制信号至所述终端设备,以使所述终端设备执行所述控制信号指示的控制功能,其中,所述终端设备上设有第二控制部件,所述第二控制部件用于获取用户的操作以控制所述终端设备,所述第一控制部件以及所述第二控制部件均能够控制所述终端设备的多种功能,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化。
- 根据权利要求14所述的装置,其特征在于,若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相应变化,包括:若所述第一控制部件以及所述第二控制部件中的一个的控制功能发生变化,则所述第一控制部件以及所述第二控制部件中的另外一个的控制功能发生相同变化。
- 根据权利要求14或15所述的装置,其特征在于,所述第二控制部件对应的控制功能由用户通过交互界面设置,所述交互界面包括所述控制设备的交互界面和/或所述终端设备的交互界面。
- 根据权利要求14-16任一项所述的装置,其特征在于,所述控制 设备上的交互界面展示有所述控制设备的各个控制部件对应的控制功能。
- 根据权利要求1-17任一项所述的装置,其特征在于,所述第一控制部件和所述第二控制部件为同种类型的控制部件。
- 根据权利要求1-18任一项所述的装置,其特征在于,所述第一控制部件或所述第二控制部件包括以下一种或多种:波轮、手柄、摇杆、按键、旋钮。
- 根据权利要求1-19任一项所述的装置,其特征在于,触发所述终端设备上的控制部件产生的控制信号的优先级高于触发所述控制设备上的控制部件产生的控制信号的优先级。
- 根据权利要求1-20任一项所述的装置,其特征在于,所述处理器用于发送所述控制信号至所述终端设备时,具体用于:基于所述控制设备上的控制部件与所述终端设备上的控制部件的第一映射关系,确定与所述第一控制部件对应的所述第二控制部件;将所述第二控制部件对应的控制功能作为所述控制信号对应的控制功能。
- 根据权利要求21所述的装置,其特征在于,所述控制设备包括多种类型的设备,所述第一映射关系包括多组,每组第一映射关系用于表征所述终端设备上的控制部件与一种类型的控制设备上的控制部件的对应关系。
- 根据权利要求21或22所述的装置,其特征在于,所述第一映射关系基于以下方式确定:在所述控制设备的交互界面上展示所述控制设备上的控制部件对应的第一标识,以及所述终端设备上的控制部件对应的第二标识;基于用户对所述第一标识和所述第二标识的操作,确定所述第一映射关系。
- 根据权利要求21或22所述的装置,其特征在于,所述第一映射关系基于以下方式确定:当所述控制设备与所述终端设备处于对上频的状态时,自动确定所述第一映射关系。
- 根据权利要求1所述的装置,其特征在于,所述处理器还用于:获取所述终端设备上的各控制部件与所述控制功能的第二映射关系;基于所述第一映射关系和所述第二映射关系确定所述控制设备上的控制部件对应的控制功能,以在所述控制设备的交互界面上显示所述控制设备上的各控制部件与所述控制功能的对应关系。
- 根据权利要求14所述的装置,其特征在于,所述装置为图传系统的图传发射设备或图传接收设备中的任一个。
- 根据权利要求14所述的装置,其特征在于,所述装置为图传系统的图传发射设备,所述图传发射设备包括硬件接口,所述图传发射设备通过所述硬件接口与终端设备连接,所述图传发射设备用于通过所述硬件接口从所述终端设备获取图像数据,并将所述图像数据发送给所述终端设备 的控制设备,以及接收所述控制设备发送控制指令,并将所述控制指令通过所述硬件接口输出给所述终端设备。
- 根据权利要求27所述的装置,其特征在于,所述硬件接口为HDM I接口,所述控制指令为HDMI CEC格式的指令。
- 根据权利要求27或28所述的装置,其特征在于,所述终端设备为拍摄装置,所述控制指令用于调整所述拍摄装置的拍摄参数。
- 根据权利要求27-29任一项所述的装置,其特征在于,所述终端设备的控制设备包括多个,所述图传发射设备包括多个传输通道,每个传输通道对应一个控制设备,用于将从所述终端设备接收到的图像数据发送给该控制设备,以及用于将该控制设备发送的控制指令发送给所述终端设备。
- 根据权利要求27-29任一项所述的装置,其特征在于,所述硬件接口包括多个,每个硬件接口用于连接一个终端设备,所述图传发射设备包括多个传输通道,每个传输通道对应一个终端设备,用于将从该终端设备接收到的图像数据发送给该终端设备的控制设备,以在所述控制设备的交互界面上通过分屏显示的方式显示从各个终端设备接收到的图像数据;以及用于将所述控制设备发送的控制指令发送给该终端设备。
- 根据权利要求14所述的装置,其特征在于,所述装置为图传系统的图传发射设备,所述图传发射设备被配置为与终端设备通信连接,所述图传发射设备用于检测所述终端设备输入的源视频数据的视频参数,基于所述源视频数据的视频参数对所述源视频数据进行编码处理,得到所述源视频数据的码流,并将所述码流发送给所述终端设备的显示设备,以在所述显示设备的屏幕上显示对所述码流进行解码后得到的目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
- 根据权利要求32所述的装置,其特征在于,所述图传发射设备包括检测单元,所述检测单元用于检测所述终端设备当前输入的源视频数据的视频参数。
- 根据权利要求33所述的装置,其特征在于,所述图传发射设备还包括处理单元和编码单元,所述处理单元用于从所述检测单元接收当前检测到的视频参数,在确定所述当前检测到的视频参数与上一次检测到的视频参数不一致的情况下,将所述当前检测到的视频参数发送给所述编码单元;所述编码单元用于确定与所述当前检测到的视频参数相匹配的编码策略,并基于所述编码策略对所述源视频数据进行编码处理,得到源视频数据的码流,以将所述码流发送给所述显示设备。
- 根据权利要求32-34任一项所述的装置,其特征在于,所述图传发射设备包括视频输入接口,所述图传发射设备通过所述视频输入接口从所述终端设备获取源视频数据,所述视频输入接口包括以下一种或多种:HDMI接口、SDI接口。
- 根据权利要求32-35任一项所述的装置,其特征在于,所述图传发射设备还包括存储单元,所述图传发射设备还用于将所述视频参数存储于所述存储单元中。
- 根据权利要求32-36任一项所述的装置,其特征在于,所述码流中包括用于指示所述视频参数的信息,以使图传接收设备基于所述视频参数信息解码。
- 根据权利要求32-37任一项所述的装置,其特征在于,所述码流中包括用于指示所述视频参数的信息。
- 根据权利要求32-38任一项所述的装置,其特征在于,所述视频参数包括以下一种或多种:视频图像的分辨率、视频图像的帧率。
- 根据权利要求14所述的装置,其特征在于,所述装置为图传系统的图传接收设备,所述图传接收设备被配置为与图传发射设备通信连接,所述图传接收设备用于从所述图传发射设备接收源视频数据的码流,从所述码流中获取所述源视频数据的视频参数,基于所述源视频数据的视频参数对所述码流进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
- 一种图传系统,其特征在于,所述图传系统包括图传发射设备和图传接收设备,所述图传发射设备用于与终端设备通信连接,所述图传接收设备用于与所述终端设备的控制设备通信连接,所述图传发射设备和所述图传接收设备中的任一个用于执行如权利要求1-13任一项所述的控制方法。
- 一种图传设备,其特征在于,所述图传设备包括硬件接口,所述图传设备通过所述硬件接口与终端设备连接,所述图传设备用于通过所述硬件接口从所述终端设备获取图像数据,并将所述图像数据发送给所述终端设备的控制设备,以及接收所述控制设备发送控制指令,并将所述控制指令通过所述硬件接口输出给所述终端设备。
- 根据权利要求42所述的图传设备,其特征在于,所述硬件接口为HDMI接口,所述控制指令为HDMI CEC格式的指令。
- 根据权利要求42或43所述的图传设备,其特征在于,所述终端设备为拍摄装置,所述控制指令用于调整所述拍摄装置的拍摄参数。
- 根据权利要求42-44任一项所述的图传设备,其特征在于,所述终端设备的控制设备包括多个,所述图传设备包括多个传输通道,每个传输通道对应一个控制设备,用于将从所述终端设备接收到的图像数据发送给该控制设备,以及用于将该控制设备发送的控制指令发送给所述终端设备。
- 根据权利要求42-44任一项所述的图传设备,其特征在于,所述硬件接口包括多个,每个硬件接口用于连接一个终端设备,所述图传设备包括多个传输通道,每个传输通道对应一个终端设备,用于将从该终端设备接收到的图像数据发送给该终端设备的控制设备,以在所述控制设备的 交互界面上通过分屏显示的方式显示从各个终端设备接收到的图像数据;以及用于将所述控制设备发送的控制指令发送给该终端设备。
- 一种图传发射设备,其特征在于,所述图传发射设备被配置为与终端设备通信连接,并将所述终端设备输入的源视频数据进行编码处理后发送给所述终端设备的显示设备,以使得在所述显示设备的屏幕上显示解码处理后得到的目标视频数据,其中,若所述源视频数据的视频参数发生变化,则所述目标视频数据的视频参数相应地发生变化。
- 根据权利要求47所述的图传发射设备,其特征在于,所述图传发射设备包括检测单元,所述检测单元用于检测所述终端设备当前输入的源视频数据的视频参数。
- 根据权利要求48所述的图传发射设备,其特征在于,所述图传发射设备还包括处理单元和编码单元,所述处理单元用于从所述检测单元接收当前检测到的视频参数,在确定所述当前检测到的视频参数与上一次检测到的视频参数不一致的情况下,将所述当前检测到的视频参数发送给所述编码单元;所述编码单元用于确定与所述当前检测到的视频参数相匹配的编码策略,并基于所述编码策略对所述源视频数据进行编码处理,得到源视频数据的码流,以将所述码流发送给所述显示设备。
- 根据权利要求48-49任一项所述的图传发射设备,其特征在于,所述图传发射设备包括视频输入接口,所述图传发射设备通过所述视频输入接口从所述终端设备获取源视频数据,所述视频输入接口包括以下一种或多种:HDMI接口、SDI接口。
- 根据权利要求47-50任一项所述的图传发射设备,其特征在于,所述图传发射设备还包括存储单元,所述图传发射设备还用于将所述视频参数存储于所述存储单元中。
- 根据权利要求47-51任一项所述的图传发射设备,其特征在于,所述码流中包括用于指示所述视频参数的信息,以使图传接收设备基于所述视频参数信息对所述码流进行解码。
- 根据权利要求47-52任一项所述的图传发射设备,其特征在于,所述视频参数包括以下一种或多种:视频图像的分辨率、视频图像的帧率。
- 一种图传接收设备,其特征在于,所述图传接收设备被配置为与图传发射设备通信连接,所述图传接收设备用于从所述图传发射设备接收源视频数据的码流,并进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
- 一种图传系统,其特征在于,所述图传系统包括图传发射设备和图传接收设备,所述图传发射设备用于与终端设备通信连接,所述图传接收设备用于与所述终端设备的显示设备通信连接,所述图传发射设备用于将所述终端设备输入的源视频数据进行编码处理后发送给所述图传接收设备;所述图传接收设备用于从所述图传发射设备接收源视频数据的码流,并进行解码处理得到目标视频数据,以在显示屏幕中显示所述目标视频数据,其中,所述目标视频数据的视频参数随着所述源视频数据的视频参数的变化而变化。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被执行时实现如权利要求1-13任一项所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2022/099020 WO2023240508A1 (zh) | 2022-06-15 | 2022-06-15 | 控制方法、装置、图传设备及系统 |
CN202280058586.XA CN117897946A (zh) | 2022-06-15 | 2022-06-15 | 控制方法、装置、图传设备及系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2022/099020 WO2023240508A1 (zh) | 2022-06-15 | 2022-06-15 | 控制方法、装置、图传设备及系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023240508A1 true WO2023240508A1 (zh) | 2023-12-21 |
Family
ID=89192751
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/099020 WO2023240508A1 (zh) | 2022-06-15 | 2022-06-15 | 控制方法、装置、图传设备及系统 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117897946A (zh) |
WO (1) | WO2023240508A1 (zh) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103079021A (zh) * | 2012-12-26 | 2013-05-01 | 百度在线网络技术(北京)有限公司 | 通过移动终端对智能家电进行控制的方法、系统和装置 |
CN105721524A (zh) * | 2014-12-04 | 2016-06-29 | 深圳市大疆创新科技有限公司 | 一种多机互联系统、控制设备及多机互联配置方法 |
WO2017004982A1 (zh) * | 2015-07-09 | 2017-01-12 | 北京海誉动想科技股份有限公司 | 智能系统及其实现方法、和用于智能设备的外设 |
CN110248228A (zh) * | 2019-05-28 | 2019-09-17 | 深圳市金锐显数码科技有限公司 | 一种基于小程序控制智能设备的方法及终端 |
WO2020155037A1 (zh) * | 2019-01-31 | 2020-08-06 | 深圳市大疆创新科技有限公司 | 多负载多路图传方法、控制系统和终端、无人机和服务器 |
CN112219176A (zh) * | 2019-07-23 | 2021-01-12 | 深圳市大疆创新科技有限公司 | 遥控可移动平台控制方法、设备及计算机可读存储介质 |
WO2022104638A1 (zh) * | 2020-11-19 | 2022-05-27 | 深圳市大疆创新科技有限公司 | 图传数据的处理方法、图传设备、终端设备及存储介质 |
-
2022
- 2022-06-15 CN CN202280058586.XA patent/CN117897946A/zh active Pending
- 2022-06-15 WO PCT/CN2022/099020 patent/WO2023240508A1/zh active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103079021A (zh) * | 2012-12-26 | 2013-05-01 | 百度在线网络技术(北京)有限公司 | 通过移动终端对智能家电进行控制的方法、系统和装置 |
CN105721524A (zh) * | 2014-12-04 | 2016-06-29 | 深圳市大疆创新科技有限公司 | 一种多机互联系统、控制设备及多机互联配置方法 |
WO2017004982A1 (zh) * | 2015-07-09 | 2017-01-12 | 北京海誉动想科技股份有限公司 | 智能系统及其实现方法、和用于智能设备的外设 |
WO2020155037A1 (zh) * | 2019-01-31 | 2020-08-06 | 深圳市大疆创新科技有限公司 | 多负载多路图传方法、控制系统和终端、无人机和服务器 |
CN110248228A (zh) * | 2019-05-28 | 2019-09-17 | 深圳市金锐显数码科技有限公司 | 一种基于小程序控制智能设备的方法及终端 |
CN112219176A (zh) * | 2019-07-23 | 2021-01-12 | 深圳市大疆创新科技有限公司 | 遥控可移动平台控制方法、设备及计算机可读存储介质 |
WO2022104638A1 (zh) * | 2020-11-19 | 2022-05-27 | 深圳市大疆创新科技有限公司 | 图传数据的处理方法、图传设备、终端设备及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN117897946A (zh) | 2024-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101467430B1 (ko) | 클라우드 컴퓨팅 기반 어플리케이션 제공 방법 및 시스템 | |
WO2018054375A1 (zh) | 直播信息的处理方法、装置及存储介质 | |
US11095936B2 (en) | Streaming media transmission method and client applied to virtual reality technology | |
US20110158313A1 (en) | Reception apparatus, reception method, and program | |
US9445142B2 (en) | Information processing apparatus and control method thereof | |
KR20160031403A (ko) | 멀티 윈도우 어플리케이션을 지원하는 멀티 스크린 제어 방법 및 디바이스 | |
JP6852411B2 (ja) | 映像信号処理装置、映像信号処理方法およびプログラム | |
US7068306B2 (en) | Proxy-based remote control method and system for a digital camera | |
EP2866434A1 (en) | Imaging apparatus | |
JP7190594B1 (ja) | 撮像装置およびその制御方法、画像処理装置および画像処理システム | |
WO2023240508A1 (zh) | 控制方法、装置、图传设备及系统 | |
KR100736898B1 (ko) | 원격 카메라 서비스 제공 영상전송 이동통신 시스템 및이를 이용한 영상전송 서비스 제공방법 | |
US20140258464A1 (en) | System and method for electronic device control | |
US10136072B2 (en) | Image pickup apparatus, image pickup system, method for controlling image pickup apparatus, method for controlling image pickup system, and program | |
CN210381100U (zh) | 摄影控制系统 | |
CN113489934B (zh) | 一种智能管家服务器、系统及屏幕远程交互方法 | |
US11470234B2 (en) | Wireless camera and method of video streaming | |
US11140442B1 (en) | Content delivery to playback systems with connected display devices | |
CN116266868A (zh) | 一种显示设备及切换视角方法 | |
US20150373073A1 (en) | Image pickup apparatus, control method and recording medium | |
JP2013255171A (ja) | 画像配信装置及び画像表示装置 | |
JP6735566B2 (ja) | 画像管理装置、画像再生装置及びそれらの制御方法、プログラム並びに記憶媒体 | |
KR101430997B1 (ko) | 컨텐츠 관리방법, 이를 적용한 방송수신장치 및 영상기기 | |
EP4020148A1 (en) | Output of content from a first device to a second device | |
CN115686415A (zh) | 一种投屏方法、装置、电子设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22946202 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280058586.X Country of ref document: CN |