CN110572424A - Device control method, device, electronic device and storage medium - Google Patents
Device control method, device, electronic device and storage medium Download PDFInfo
- Publication number
- CN110572424A CN110572424A CN201810576573.7A CN201810576573A CN110572424A CN 110572424 A CN110572424 A CN 110572424A CN 201810576573 A CN201810576573 A CN 201810576573A CN 110572424 A CN110572424 A CN 110572424A
- Authority
- CN
- China
- Prior art keywords
- frame rate
- coding frame
- remote control
- code rate
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000005540 biological transmission Effects 0.000 claims description 36
- 238000004891 communication Methods 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 7
- 238000012423 maintenance Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000010355 oscillation Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a device control method, a device, an electronic device and a storage medium, wherein the method comprises the following steps: capturing an output window picture of the NVR by using a DSP encoding and decoding chip, and carrying out H264 encoding on the captured output window picture to obtain an H264 code stream; sending the H264 code stream to a remote control center; receiving a remote control instruction sent by the remote control center; and converting the remote control instruction into a local control instruction, and executing the local control instruction. The method can realize remote control of the NVR, improve the efficiency of operations such as configuration and maintenance of the NVR, and save bandwidth resources while ensuring the smoothness and definition of the picture.
Description
Technical Field
the present disclosure relates to video monitoring technologies, and in particular, to a method and an apparatus for controlling a device, an electronic device, and a storage medium.
Background
NVR (Network Video Recorder) equipment belongs to electronic products applied in the CCTV (Closed Circuit Television monitoring system) field industry, along with the development of science and technology and the increase of service requirements, functions supported by the NVR are various and complex, correspondingly, the operation difficulty of configuration, maintenance and the like of the NVR is increased, if all the NVR configuration and maintenance are operated by professional technicians to the site, the efficiency is low, and the cost is too high.
disclosure of Invention
in view of the above, the present application provides a device control method, apparatus, electronic device and storage medium.
Specifically, the method is realized through the following technical scheme:
according to a first aspect of embodiments of the present application, there is provided an apparatus control method applied to NVR, the method including:
Capturing an output window picture of the NVR by using a data signal processing DSP coding and decoding chip, and carrying out H264 coding on the captured output window picture to obtain an H264 code stream;
sending the H264 code stream to a remote control center;
Receiving a remote control instruction sent by the remote control center;
and converting the remote control instruction into a local control instruction, and executing the local control instruction.
Optionally, the method further includes:
and dynamically adjusting the coding frame rate or/and the code rate according to the data amount in the sending buffer.
Optionally, the dynamically adjusting the coding frame rate or/and the code rate according to the data amount in the sending buffer includes:
inquiring the corresponding relation between a preset data ratio interval and the coding frame rate or/and the code rate according to the data ratio in the sending buffer area so as to determine the target coding frame rate or/and the code rate corresponding to the data ratio in the sending buffer area; the higher the numerical value of the data proportion interval is, the smaller the corresponding coding frame rate or/and code rate is;
And if the currently used coding frame rate or/and code rate is not consistent with the target coding frame rate or/and code rate, updating the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate.
Optionally, the dynamically adjusting the coding frame rate or/and the code rate according to the data amount in the sending buffer includes:
When the data proportion of the sending buffer area exceeds a first preset threshold value, reducing the currently used coding frame rate or/and code rate;
When the data proportion of the sending buffer area is lower than a second preset threshold value, improving the currently used coding frame rate or/and code rate; and the second preset threshold is less than or equal to the first preset threshold.
optionally, the sending the H264 code stream to a remote control center includes:
and transmitting the H264 code stream to a remote control center by adopting a real-time streaming protocol (RTSP).
According to a second aspect of the embodiments of the present application, there is provided an apparatus for controlling a device, which is applied to NVR, the apparatus including:
The image processing unit is used for capturing the output window image of the NVR by using a data signal processing DSP coding and decoding chip and carrying out H264 coding on the captured output window image to obtain an H264 code stream;
The transmission unit is used for transmitting the H264 code stream to a remote control center;
the transmission unit is also used for receiving a remote control instruction sent by the remote control center;
and the instruction processing unit is used for converting the remote control instruction into a local control instruction and executing the local control instruction.
Optionally, the apparatus further comprises:
And the adjusting unit is used for dynamically adjusting the coding frame rate or/and the code rate according to the data quantity in the sending buffer.
Optionally, the adjusting unit is specifically configured to query a corresponding relationship between a preset data ratio interval and a coding frame rate or/and a code rate according to the data ratio in the sending buffer, so as to determine a target coding frame rate or/and a code rate corresponding to the data ratio in the sending buffer; the higher the numerical value of the data proportion interval is, the smaller the corresponding coding frame rate or/and code rate is; and if the currently used coding frame rate or/and code rate is not consistent with the target coding frame rate or/and code rate, updating the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate.
optionally, the adjusting unit is specifically configured to reduce a currently used coding frame rate or/and a coding rate when a data ratio of the sending buffer exceeds a first preset threshold; when the data proportion of the sending buffer area is lower than a second preset threshold value, improving the currently used coding frame rate or/and code rate; and the second preset threshold is less than or equal to the first preset threshold.
Optionally, the transmission unit is specifically configured to send the H264 code stream to a remote control center by using a real-time streaming protocol RTSP protocol.
According to a third aspect of the embodiments of the present application, there is provided an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps of the equipment control method when executing the program stored in the memory.
According to a fourth aspect of embodiments of the present application, there is provided a computer-readable storage medium having stored therein a computer program which, when executed by a processor, implements the above-described apparatus control method steps.
According to the equipment control method, the NVR captures the output window picture of the NVR by using the DSP coding and decoding chip, the captured output window picture is subjected to H264 coding to obtain an H264 code stream, and the H264 code stream is sent to the remote control center, so that the fluency and the definition of the picture are ensured, and meanwhile, the bandwidth resource is saved; when the NVR receives a remote control instruction sent by the remote control center, the received remote control instruction is converted into a local control instruction, and the local control instruction is executed, so that the remote control of the NVR is realized, the efficiency of operations such as configuration and maintenance of the NVR is improved, and the cost is reduced.
Drawings
FIG. 1 is a block diagram illustrating an architecture of a plant control system according to an exemplary embodiment of the present application;
FIG. 2 is a flow chart diagram illustrating a method for controlling a device according to an exemplary embodiment of the present application;
FIG. 3 is an architectural diagram illustrating a specific application scenario according to an exemplary embodiment of the present application;
FIG. 4A is a flow diagram illustrating a codestream processing according to an exemplary embodiment of the present application;
FIG. 4B is a flow diagram illustrating a control instruction process according to an exemplary embodiment of the present application;
FIG. 5 is a schematic diagram illustrating a configuration of a device control apparatus according to an exemplary embodiment of the present application;
Fig. 6 is a schematic structural diagram of an apparatus control device according to yet another exemplary embodiment of the present application;
Fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
In order to make those skilled in the art better understand the technical solutions provided by the embodiments of the present application, a brief description is first given below of a system architecture to which the embodiments of the present application are applicable.
Referring to fig. 1, a schematic structural diagram of an apparatus control system provided in an embodiment of the present application is shown in fig. 1, where the apparatus control system includes an NVR end and a remote control center; the NVR end at least comprises an NVR and a first display device (the display may be a display device (if present) carried by the NVR or a display device externally connected to the NVR); the remote control center includes a second display device and an input device (e.g., a mouse, a keyboard, etc.).
In the device control system, the NVR may capture an output window picture of the NVR (displayed in the first display device) by using a DSP (Digital Signal Processing) codec chip, perform H264 (a Digital video codec standard) encoding on the captured output window picture, and further send the obtained H264 code stream to the remote control center.
When the remote control center receives the H264 code stream sent by the NVR, the H264 code stream can be decoded and displayed in the second display device, so that a technician at the remote control center can remotely view a real-time operation window picture of the NVR and input a corresponding control instruction (such as a mouse or/and a keyboard event) through the input device.
The second display device obtains the control command input locally and transmits the control command to the NVR terminal.
When the NVR receives the remote control instruction, the received remote control instruction can be converted into a local control instruction, and the local control instruction is executed, so that the remote control of the NVR can be realized, the efficiency of operations such as configuration and maintenance of the NVR is improved, and the cost is reduced.
In order to make the aforementioned objects, features and advantages of the embodiments of the present application more comprehensible, embodiments of the present application are described in detail below with reference to the accompanying drawings.
referring to fig. 2, an apparatus control method provided in an embodiment of the present application may be applied to an NVR (such as an NVR in an apparatus control system shown in fig. 1), and as shown in fig. 2, the apparatus control method may include the following steps:
And S200, capturing an output window picture of the NVR by using the DSP coding chip, and carrying out H264 coding on the captured output window picture to obtain an H264 code stream.
In this embodiment of the application, the NVR may capture an output window picture of the NVR (a real-time output picture of an operation window picture of the NVR in a display device (e.g., a first display device in fig. 1)) by using a DSP encoding chip, and perform H264 encoding on the captured output window picture to obtain an H264 code stream.
And step S210, sending the obtained H264 code stream to a remote control center.
In the embodiment of the application, after the NVR obtains the H264 code stream, the obtained H264 code stream can be sent to the remote control center.
For example, the NVR may send the H264 codestream to a remote control center over a remote control connection with the remote control center.
the remote control connection can be established by the NVR with the remote control center when remote control is needed (triggered by the NVR or the remote control center), or the remote control connection can exist all the time when the NVR is in normal operation.
In one example, to improve the Real-Time performance of the H264 bitstream transmission, the NVR may send the H264 bitstream to the remote control center through RTSP (Real Time Streaming Protocol).
In this embodiment of the application, when receiving the H264 code stream sent by the NVR, the remote control center may decode the H264 code stream, and display the H264 code stream on a local display device (e.g., the second display device in fig. 1), so that a technician at the remote control center can view an output window picture of the NVR in real time and input a control instruction according to an actual situation (e.g., through the input device in fig. 1).
The display device (or other devices (if any)) of the remote control center may obtain a locally input control instruction, such as capturing a mouse event (position and operation of the mouse in the output window screen (e.g., single-click or double-click, etc.)) or/and a keyboard event (e.g., keyboard operation (e.g., information input)), and send the obtained control instruction to the NVR, for example, to the NVR through a TCP (transmission control Protocol) Protocol.
and step S220, receiving a remote control instruction sent by the remote control center.
and step S230, converting the remote control instruction into a local control instruction, and executing the local control instruction.
in the embodiment of the application, when receiving a remote control instruction sent by a remote control center, the NVR may convert the received remote control instruction into a local control instruction, for example, into a local mouse event or/and a keyboard event, and execute the local control instruction.
it can be seen that, in the method flow shown in fig. 2, by applying a remote assistance scheme in the video monitoring system, the NVR captures an output window picture through the DPS codec chip, performs H264 coding on the captured output window picture, and further sends the obtained code stream to the remote control center, and the remote control center performs remote control according to the obtained output window picture after decoding, thereby improving the smoothness of picture transmission and the definition of the picture, and saving bandwidth resources; when the NVR receives a remote control instruction sent by the remote control center, the remote control instruction is converted into a local control instruction and executed, so that the remote control of the NVR is realized, the efficiency of operations such as configuration, maintenance and the like of the NVR is improved, and the cost is reduced.
further, in the embodiment of the present application, when the NVR transmits the H264 code stream to the remote control center, a large amount of data may be accumulated in the sending buffer due to an excessively large amount of data (e.g., an encoding frame rate or/and an excessively high code rate), so as to affect the real-time performance of the picture transmission.
Accordingly, in one embodiment of the present application, the NVR may dynamically adjust the coding frame rate or/and the code rate according to the amount of data in the transmission buffer.
For example, when the amount of data in the transmission buffer is large (e.g., exceeds a preset threshold), the coding frame rate or/and the code rate are reduced; when the amount of data in the transmission buffer is small (e.g., lower than a preset threshold), the encoding frame rate or/and the code rate are increased, i.e., the amount of data in the transmission buffer is inversely related to the encoding frame rate or/and the code rate.
In an embodiment of the present application, the dynamically adjusting the coding frame rate or/and the code rate according to the data amount in the transmission buffer may include:
inquiring the corresponding relation between a preset data ratio interval and the coding frame rate or/and the code rate according to the data ratio in the sending buffer area so as to determine the target coding frame rate or/and the code rate corresponding to the data ratio in the sending buffer area; the higher the numerical value of the data proportion interval is, the smaller the corresponding coding frame rate or/and code rate is;
And if the currently used coding frame rate or/and code rate is not consistent with the target coding frame rate or/and code rate, updating the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate.
In this embodiment, in order to implement that the NVR dynamically adjusts the encoding frame rate or/and the code rate according to the data amount in the transmission buffer, a corresponding relationship between a data proportion interval in the transmission buffer and the encoding frame rate or/and the code rate (referred to as a corresponding relationship between a preset data proportion interval and the encoding frame rate or/and the code rate herein) may be configured in the NVR in advance, where the data proportion in the transmission buffer is a ratio of the data amount in the transmission buffer to the total space size of the transmission buffer, and the higher the data of the data proportion interval, the lower the corresponding encoding frame rate or/and the code rate.
accordingly, in the process that the NVR transmits the H264 code stream to the remote control center, the NVR may detect the data ratio in the sending buffer at regular time (e.g., periodically), and query the corresponding relationship between the preset data ratio interval and the coding frame rate or/and the code rate according to the detected data ratio in the sending buffer, so as to determine the coding frame rate or/and the code rate (referred to as the target coding frame rate or/and the code rate herein) corresponding to the detected data ratio in the sending buffer.
Furthermore, the NVR may compare the currently used encoding frame rate or/and code rate with the target encoding frame rate or/and code rate; if the two are not consistent, the NVR may update the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate, and perform coding and code stream transmission using the updated coding frame rate or/and code rate (i.e., the target coding frame rate or/and code rate).
it should be noted that, in this embodiment, when the NVR determines that the currently used coding frame rate or/and code rate is consistent with the target coding frame rate or/and code rate, the NVR may maintain the currently used coding frame rate or/and code rate.
in another implementation manner of this embodiment, the dynamically adjusting the coding frame rate or/and the code rate according to the data amount in the transmission buffer may include:
When the data proportion of the sending buffer area exceeds a first preset threshold value, reducing the currently used coding frame rate or/and code rate;
when the data proportion of the sending buffer area is lower than a second preset threshold value, the currently used coding frame rate or/and the code rate are/is improved; and the second preset threshold is less than or equal to the first preset threshold.
in this embodiment, in order to implement that the NVR dynamically adjusts the encoding frame rate or/and the code rate according to the amount of data in the transmission buffer, a threshold for adjusting the encoding frame rate or/and the code rate may be set in the NVR in advance.
accordingly, in the process that the NVR transmits the H264 code stream to the remote control center, the NVR may periodically (e.g., periodically) detect the data proportion in the sending buffer, and compare the detected data proportion in the sending buffer with the preset threshold.
In this embodiment, when the data occupancy in the transmission buffer exceeds a preset threshold (referred to herein as a first preset threshold), the currently used coding frame rate or/and code rate is reduced. For example, the currently used coding frame rate or/and code rate is adjusted downward according to a preset adjustment amplitude or adjustment ratio (referred to as a first adjustment amplitude or adjustment ratio herein).
When the data ratio in the transmission buffer is lower than a preset threshold (referred to as a second preset threshold herein), the currently used coding frame rate or/and code rate are increased. For example, the currently used coding frame rate or/and code rate is adjusted upward according to a preset adjustment magnitude or adjustment ratio (referred to as a second adjustment magnitude or adjustment ratio herein).
the second preset threshold is less than or equal to the first preset threshold, and the second adjustment amplitude or the adjustment ratio may be the same as or different from the first adjustment amplitude or the first adjustment ratio.
Preferably, the second preset threshold is smaller than the first preset threshold, so as to avoid that after the currently used coding frame rate or/and code rate is reduced (increased), the currently used coding frame rate or/and code rate needs to be increased (decreased) soon, and further oscillation occurs to affect normal transmission of the H264 code stream.
in order to enable those skilled in the art to better understand the technical solutions provided in the embodiments of the present application, the following describes the technical solutions provided in the embodiments of the present application with reference to specific application scenarios.
please refer to fig. 3, which is a schematic diagram of an architecture of a specific application scenario provided in the embodiment of the present application, and as shown in fig. 3, the application scenario includes a remote control center and an NVR end; the remote control center includes a server and a PC (personal computer), and the NVR end includes an NVR and VGA (Video Graphics Array)/HDMI (High Definition Multimedia Interface) display and input devices (not shown in the figure) such as a mouse and a keyboard. And the NVR end is interconnected with the remote control center through a network.
Based on the application scenario shown in fig. 3, the implementation flow of the device control scheme provided in the embodiment of the present application is as follows:
data transmission
The NVR captures an NVR operation window picture displayed in the VGA/HDMI display in real time through the DSP coding and decoding chip, carries out H264 coding to obtain an H264 code stream, and stores the H264 code stream in a code stream sending buffer area.
And the NVR sends the H264 code stream in the sending buffer area to a code stream receiving buffer area in a server of the remote control center through an RTSP protocol.
In this embodiment, in the process of transmitting the H264 code stream, the NVR may detect the data ratio in the code stream sending buffer at regular time, and determine the target coding rate and the target code rate corresponding to the detected data ratio in the code stream sending buffer according to the correspondence between the data ratio interval, the coding frame rate, and the code rate shown in the data ratio lookup table 1 in the detected code stream sending buffer:
TABLE 1
| Data proportion interval | coding frame rate | code rate |
| [0，DR1) | FR1 | BR1 |
| [DR1，DR2) | FR2 | BR2 |
| [DR2，DR3) | FR3 | BR3 |
| … | … | … |
wherein DR3 & gtDR 2 & gtDR 1 & gt0, FR1 & gtFR 2 & gtFR 3, and BR1 & gtBR 2 & gtBR 3.
after the target coding frame rate and the target code rate are determined by the NVR, coding and code stream transmission can be performed according to the target coding frame rate and the target code rate.
Assuming that the data occupation ratio in the code stream sending buffer detected by the NVR is DR0, and DR0 belongs to [ DR1, DR2 ], the NVR may determine that the target coding frame rate corresponding to the data occupation ratio DR0 is FR2, and the target code rate is BR2, and further, the NVR may perform H264 coding according to the coding frame rate FR2, and perform H264 code stream transmission according to the code rate BR2 (if the currently used coding frame rate and code rate are not FR2 and BR2, the coding frame rate and code rate need to be updated).
in this embodiment, the server of the remote control center reads the H264 code stream from the code stream receiving buffer, decodes the H264 code stream through the decoding library, and displays the decoded H264 code stream on the display of the PC, so that a technician at the remote control center can remotely view an operation window screen of the NVR, and a schematic diagram thereof can be as shown in fig. 4A.
Second, control the instruction transmission
The PC captures mouse events (mouse positions and operations) and keyboard events (input operations) of a technician on the PC, generates control instructions, stores the control instructions in an instruction sending buffer area, and sends the control in the instruction buffer area to an instruction receiving buffer area of an NVR end in real time.
The NVR acquires a control instruction (remote control instruction) from the instruction receiving buffer, converts the acquired remote control instruction into a local control instruction (that is, converts a mouse event and a keyboard event of the remote control center into a local mouse event and a local keyboard event), and executes the local control instruction, thereby implementing control of the NVR by the remote control center, and a schematic diagram thereof may be as shown in fig. 4B.
In the embodiment of the application, the NVR captures an output window picture of the NVR by using the DSP coding and decoding chip, performs H264 coding on the captured output window picture to obtain an H264 code stream, and sends the H264 code stream to the remote control center, so that bandwidth resources are saved while smoothness and definition of the picture are ensured; when the NVR receives a remote control instruction sent by the remote control center, the received remote control instruction is converted into a local control instruction, and the local control instruction is executed, so that the remote control of the NVR is realized, the efficiency of operations such as configuration and maintenance of the NVR is improved, and the cost is reduced.
The methods provided herein are described above. The following describes the apparatus provided in the present application:
referring to fig. 5, a schematic structural diagram of an apparatus control device provided in an embodiment of the present application is shown, where the apparatus control device may be applied to NVR in the foregoing method embodiment, and as shown in fig. 5, the apparatus control device may include:
the picture processing unit 510 is configured to capture an output window picture of the NVR by using a data signal processing DSP codec chip, and perform H264 coding on the captured output window picture to obtain an H264 code stream;
the transmission unit 520 is used for transmitting the H264 code stream to a remote control center;
The transmission unit 520 is further configured to receive a remote control instruction sent by the remote control center;
an instruction processing unit 530, configured to convert the remote control instruction into a local control instruction, and execute the local control instruction.
referring to fig. 6 together, for a schematic structural diagram of another apparatus control device provided in the embodiment of the present application, as shown in fig. 6, on the basis of the apparatus control device shown in fig. 5, the apparatus control device shown in fig. 6 may further include:
An adjusting unit 540, configured to dynamically adjust the coding frame rate or/and the code rate according to the data amount in the sending buffer.
in an optional implementation manner, the adjusting unit 540 is specifically configured to query a corresponding relationship between a preset data ratio interval and a coding frame rate or/and a code rate according to a data ratio in the sending buffer, so as to determine a target coding frame rate or/and a code rate corresponding to the data ratio in the sending buffer; the higher the numerical value of the data proportion interval is, the smaller the corresponding coding frame rate or/and code rate is; and if the currently used coding frame rate or/and code rate is not consistent with the target coding frame rate or/and code rate, updating the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate.
In an optional implementation manner, the adjusting unit 540 is specifically configured to reduce a currently used coding frame rate or/and a coding rate when the data percentage of the transmission buffer exceeds a first preset threshold; when the data proportion of the sending buffer area is lower than a second preset threshold value, improving the currently used coding frame rate or/and code rate; and the second preset threshold is less than or equal to the first preset threshold.
in an optional implementation manner, the transmission unit 520 is specifically configured to send the H264 code stream to a remote control center by using a real-time streaming protocol RTSP protocol.
fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure. The electronic device may include a processor 701, a communication interface 702, a memory 703, and a communication bus 704. The processor 701, the communication interface 702, and the memory 703 communicate with each other via a communication bus 704. Wherein, the memory 703 is stored with a computer program; the processor 701 may execute the device control method described above by executing the program stored on the memory 703.
The memory 703, as referred to herein, may be any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and the like. For example, the memory 702 may be: RAM (random access memory), volatile memory, non-volatile memory, flash memory, a storage drive (e.g., a hard drive), a solid state drive, any type of storage disk (e.g., an optical disk, dvd, etc.), or similar storage medium, or a combination thereof.
The embodiment of the present application also provides a machine-readable storage medium, such as the memory 703 in fig. 7, storing a computer program, which can be executed by the processor 701 in the electronic device shown in fig. 7 to implement the device control method described above.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (12)
1. An equipment control method is applied to a Network Video Recorder (NVR), and is characterized by comprising the following steps:
capturing an output window picture of the NVR by using a data signal processing DSP coding and decoding chip, and carrying out H264 coding on the captured output window picture to obtain an H264 code stream;
sending the H264 code stream to a remote control center;
Receiving a remote control instruction sent by the remote control center;
And converting the remote control instruction into a local control instruction, and executing the local control instruction.
2. The method of claim 1, further comprising:
And dynamically adjusting the coding frame rate or/and the code rate according to the data amount in the sending buffer.
3. The method of claim 2, wherein the dynamically adjusting the coding frame rate or/and the code rate according to the amount of data in the transmission buffer comprises:
Inquiring the corresponding relation between a preset data ratio interval and the coding frame rate or/and the code rate according to the data ratio in the sending buffer area so as to determine the target coding frame rate or/and the code rate corresponding to the data ratio in the sending buffer area; the higher the numerical value of the data proportion interval is, the smaller the corresponding coding frame rate or/and code rate is;
And if the currently used coding frame rate or/and code rate is not consistent with the target coding frame rate or/and code rate, updating the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate.
4. The method of claim 2, wherein the dynamically adjusting the coding frame rate or/and the code rate according to the amount of data in the transmission buffer comprises:
When the data proportion of the sending buffer area exceeds a first preset threshold value, reducing the currently used coding frame rate or/and code rate;
When the data proportion of the sending buffer area is lower than a second preset threshold value, improving the currently used coding frame rate or/and code rate; and the second preset threshold is less than or equal to the first preset threshold.
5. The method according to any one of claims 1-4, wherein said sending said H264 codestream to a remote control center comprises:
And transmitting the H264 code stream to a remote control center by adopting a real-time streaming protocol (RTSP).
6. An equipment control device is applied to a network video recorder NVR, and is characterized by comprising:
The image processing unit is used for capturing the output window image of the NVR by using a data signal processing DSP coding and decoding chip and carrying out H264 coding on the captured output window image to obtain an H264 code stream;
The transmission unit is used for transmitting the H264 code stream to a remote control center;
the transmission unit is also used for receiving a remote control instruction sent by the remote control center;
and the instruction processing unit is used for converting the remote control instruction into a local control instruction and executing the local control instruction.
7. the apparatus of claim 6, further comprising:
and the adjusting unit is used for dynamically adjusting the coding frame rate or/and the code rate according to the data quantity in the sending buffer.
8. The apparatus of claim 7,
The adjusting unit is specifically configured to query a corresponding relationship between a preset data ratio interval and a coding frame rate or/and a code rate according to the data ratio in the sending buffer, so as to determine a target coding frame rate or/and a code rate corresponding to the data ratio in the sending buffer; the higher the numerical value of the data proportion interval is, the smaller the corresponding coding frame rate or/and code rate is; and if the currently used coding frame rate or/and code rate is not consistent with the target coding frame rate or/and code rate, updating the currently used coding frame rate or/and code rate to the target coding frame rate or/and code rate.
9. The apparatus of claim 7,
The adjusting unit is specifically configured to reduce a currently used coding frame rate or/and a currently used code rate when the data occupancy of the sending buffer exceeds a first preset threshold; when the data proportion of the sending buffer area is lower than a second preset threshold value, improving the currently used coding frame rate or/and code rate; and the second preset threshold is less than or equal to the first preset threshold.
10. The apparatus according to any one of claims 6 to 9,
the transmission unit is specifically configured to send the H264 code stream to a remote control center by using a real-time streaming protocol RTSP protocol.
11. an electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
A memory for storing a computer program;
A processor for implementing the method steps of any one of claims 1 to 5 when executing a program stored in the memory.
12. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of the claims 1-5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810576573.7A CN110572424A (en) | 2018-06-06 | 2018-06-06 | Device control method, device, electronic device and storage medium |
| PCT/CN2019/088368 WO2019233296A1 (en) | 2018-06-06 | 2019-05-24 | Remote control of device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810576573.7A CN110572424A (en) | 2018-06-06 | 2018-06-06 | Device control method, device, electronic device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110572424A true CN110572424A (en) | 2019-12-13 |
Family
ID=68770063
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810576573.7A Pending CN110572424A (en) | 2018-06-06 | 2018-06-06 | Device control method, device, electronic device and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110572424A (en) |
| WO (1) | WO2019233296A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113395244A (en) * | 2020-03-13 | 2021-09-14 | 杭州海康威视数字技术股份有限公司 | Code stream control method, device and equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101511006A (en) * | 2009-03-12 | 2009-08-19 | 深圳市深视音电子技术有限公司 | Method for monitoring network audio and video, and network hard disk videocorder using the method |
| CN101742199A (en) * | 2009-12-31 | 2010-06-16 | 上海天域时捷信息系统有限公司 | Recorded broadcast workstation system |
| CN201830383U (en) * | 2010-07-28 | 2011-05-11 | 中电国科(北京)科技有限公司 | Remote high-definition real-time wireless audio and video communication system |
| CN102547259A (en) * | 2010-12-21 | 2012-07-04 | 联芯科技有限公司 | Rate-control-based video coding method and device |
| KR101454014B1 (en) * | 2014-04-03 | 2014-10-30 | 서순이 | Real time system and method for monitoring error of network camera and network video recorder |
| US20150293571A1 (en) * | 2014-04-09 | 2015-10-15 | Zmodo Shenzhen Technology Co., Ltd. | Enhanced Power over Ethernet (POE) System |
| CN105338318A (en) * | 2015-11-09 | 2016-02-17 | 浙江宇视科技有限公司 | Monitoring system and remote control method thereof |
-
2018
- 2018-06-06 CN CN201810576573.7A patent/CN110572424A/en active Pending
-
2019
- 2019-05-24 WO PCT/CN2019/088368 patent/WO2019233296A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101511006A (en) * | 2009-03-12 | 2009-08-19 | 深圳市深视音电子技术有限公司 | Method for monitoring network audio and video, and network hard disk videocorder using the method |
| CN101742199A (en) * | 2009-12-31 | 2010-06-16 | 上海天域时捷信息系统有限公司 | Recorded broadcast workstation system |
| CN201830383U (en) * | 2010-07-28 | 2011-05-11 | 中电国科(北京)科技有限公司 | Remote high-definition real-time wireless audio and video communication system |
| CN102547259A (en) * | 2010-12-21 | 2012-07-04 | 联芯科技有限公司 | Rate-control-based video coding method and device |
| KR101454014B1 (en) * | 2014-04-03 | 2014-10-30 | 서순이 | Real time system and method for monitoring error of network camera and network video recorder |
| US20150293571A1 (en) * | 2014-04-09 | 2015-10-15 | Zmodo Shenzhen Technology Co., Ltd. | Enhanced Power over Ethernet (POE) System |
| CN105338318A (en) * | 2015-11-09 | 2016-02-17 | 浙江宇视科技有限公司 | Monitoring system and remote control method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 邓中亮等: "《基于H.264的视频编/解码与控制技术》", 31 July 2010, 北京邮电大学出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113395244A (en) * | 2020-03-13 | 2021-09-14 | 杭州海康威视数字技术股份有限公司 | Code stream control method, device and equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019233296A1 (en) | 2019-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9699099B2 (en) | Method of transmitting data in a communication system | |
| CN102457544B (en) | Method and system for acquiring screen image in screen sharing system based on Internet | |
| US20090016622A1 (en) | Image transmitting apparatus, image transmitting method, receiving apparatus, and image transmitting system | |
| CN101883140B (en) | Coding system and method based on remote display as well as server | |
| US8477842B2 (en) | Encoding method of screen frame and electronic device applying the same | |
| US20140002645A1 (en) | Server and video surveillance method of target place | |
| CN111147860B (en) | Video data decoding method and device | |
| CN112035081A (en) | Screen projection method and device, computer equipment and storage medium | |
| CN106227492A (en) | Combination and mobile intelligent terminal interconnected method and device | |
| WO2022057362A1 (en) | Image processing method and apparatus, cloud real machine system, storage medium, and electronic device | |
| CN109168041B (en) | Mobile terminal monitoring method and system | |
| WO2023036258A1 (en) | Unmanned aerial vehicle-based video live broadcast method, system, device and storage medium | |
| US9226003B2 (en) | Method for transmitting video signals from an application on a server over an IP network to a client device | |
| US20120281756A1 (en) | Complexity change detection for video transmission system | |
| CN111093082A (en) | Method and system for live broadcasting of streaming media | |
| CN110572424A (en) | Device control method, device, electronic device and storage medium | |
| JP2003163914A (en) | Monitor system and picture transmission unit | |
| CN112039961B (en) | Streaming media system, data stream collection method, and storage medium | |
| JP5152044B2 (en) | Image encoding apparatus and method, and program | |
| CN112543348A (en) | Remote screen recording method, device, equipment and computer readable storage medium | |
| CN111107387B (en) | Video transcoding method and device and computer storage medium | |
| JP2016103117A (en) | Information processing apparatus, terminal device, image display system, and image transmission program | |
| CN103974062A (en) | Image display device, image display system and image display method | |
| CN110798700B (en) | Video processing method, video processing device, storage medium and electronic equipment | |
| JP5171655B2 (en) | Image transmitting apparatus, method, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191213 |