CN114040141A

CN114040141A - Data transmission method, camera and electronic equipment

Info

Publication number: CN114040141A
Application number: CN202111305886.7A
Authority: CN
Inventors: 马强; 顾昕宇
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2017-10-20
Filing date: 2017-10-20
Publication date: 2022-02-11
Also published as: CN109698923A; CN109698923B; CN114007030B; CN114007030A

Abstract

The embodiment of the application provides a data transmission method, a camera and electronic equipment. The method comprises the following steps: the method comprises the steps of obtaining an image to be sent, obtaining target data to be sent, determining a first position of the image to be sent in an effective image area of an image frame, determining a second position of the target data in a blanking area of the image frame, using the image to be sent and the target data as data of the same image frame, sending the image to be sent according to the first position by adopting a data sending mode of the effective image area, and sending the target data according to the second position by adopting a data sending mode of the blanking area; the target data is data different from the image to be sent and the coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end. By applying the scheme provided by the embodiment of the application, the target data and the image to be sent can be sent to the electronic equipment in the same image frame without additional wiring, so that the equipment cost can be saved.

Description

Data transmission method, camera and electronic equipment

The application is a divisional application, the application number of an original case is 201710985836.5, the application date is 10 and 20 months in 2017, and the invention name is as follows: data transmission method, camera and electronic equipment.

Technical Field

The present application relates to the field of signal transmission technologies, and in particular, to a data transmission method, a camera, and an electronic device.

Background

In a monitoring system, an image capture device (e.g., a camera) may transmit a captured image to an electronic device, which may receive and store the image transmitted by the image capture device and then display a monitoring video. The image acquisition device can also transmit the coaxial data to the electronic device together with the image. Coaxial data is notification information when devices interact with each other. An image frame transmitted between devices may be as shown in fig. 1, the image frame including an active image area and a blanking area. When transmitting an image frame, the image is usually used as data of an effective image area, and coaxial data is used as data of a blanking area.

In the related art, when the image frames are transmitted, coaxial cables or twisted pair wires are generally used for transmission between devices. If it is necessary to transmit target data other than the image and the coaxial data, additional wiring is provided between the devices. But this approach increases the cost of the equipment.

Disclosure of Invention

An object of the embodiments of the present application is to provide a data transmission method, a camera, and an electronic device, which do not need additional wiring to achieve transmission of target data. The specific technical scheme is as follows.

An embodiment of the present application provides a data transmission method, including:

acquiring an image to be sent, and acquiring target data to be sent; the target data is different from the image to be sent and the coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

determining a first position of the image to be transmitted in an effective image area of an image frame and determining a second position of the target data in a blanking area of the image frame;

and taking the image to be sent and the target data as data of the same image frame, sending the image to be sent according to the first position by adopting a data sending mode of an effective image area, and sending the target data according to the second position by adopting a data sending mode of a blanking area.

Optionally, before sending the image to be sent and the target data, the method further includes:

acquiring coaxial data to be transmitted and determining a third position of the coaxial data in a blanking area of an image frame;

and taking the coaxial data as data of the image frame where the image to be sent and the target data are located, and sending the coaxial data according to the third position by adopting a data sending mode of a blanking area.

Optionally, the step of obtaining coaxial data to be sent includes:

coaxial data to be transmitted including data representing the second location is acquired.

Optionally, the position of the data representing the second position in the blanking area of the image frame is before the second position.

Optionally, the target data includes a header identifier indicating a start position of the target data, and a tail identifier indicating an end position of the target data.

Optionally, the step of obtaining target data to be sent includes:

acquiring target data to be sent, wherein the target data represent environment information of an environment where image acquisition equipment of an image to be sent is located; and/or the presence of a gas in the gas,

acquiring target data to be sent, which represents audio information acquired by image acquisition equipment of an image to be sent; and/or the presence of a gas in the gas,

target data representing image information of an image to be transmitted is acquired.

Optionally, when the target data is data representing environmental information, the second position is a position in a blanking area located after the effective image area;

when the target data is data representing audio information, the second position is a position in a blanking region located before the effective image region;

when the target data is data representing image information, the second position is a position in a blanking region located before the effective image region.

The embodiment of the application provides another data transmission method, which comprises the following steps:

receiving an image frame;

determining a first position of an image in an active image area of the image frame and determining a second position of target data in a blanking area of the image frame; the target data is different from the image and coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

and acquiring an image from the image frame according to the first position by adopting a data acquisition mode of an effective image area, and acquiring target data from the image frame according to the second position by adopting a data acquisition mode of a blanking area.

Optionally, after receiving the image frame, the method further comprises:

determining a third position of the on-axis data in a blanking region of the image frame;

and acquiring the coaxial data from the image frame according to the third position by adopting a blanking area data acquisition mode.

Optionally, the on-axis data is acquired before determining a second position of the target data in a blanking region of the image frame;

the step of determining a second position of the target data in the blanking area of the image frame comprises:

data representing a second position of the target data in a blanking region of the image frame is acquired from the on-axis data.

Optionally, the step of determining a second position of the target data in the blanking area of the image frame includes:

determining a head mark representing the starting position of the target data and a tail mark representing the tail position of the target data from the blanking area of the image frame, and taking the position between the head mark and the tail mark and including the head mark and the tail mark as a second position of the target data in the blanking area of the image frame.

An embodiment of the present application provides a camera, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;

the processor is configured to acquire an image to be transmitted, acquire target data to be transmitted, determine a first position of the image to be transmitted in an effective image area of an image frame, determine a second position of the target data in a blanking area of the image frame, use the image to be transmitted and the target data as data of the same image frame, transmit the image to be transmitted according to the first position in a data transmission manner of the effective image area, and transmit the target data according to the second position in a data transmission manner of the blanking area; the target data is different from the image to be sent and the coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

and the memory is used for storing the image to be sent and the target data acquired by the processor.

Optionally, the processor is further configured to, before the image to be sent and the target data are sent, obtain coaxial data to be sent, and determine a third position of the coaxial data in a blanking area of an image frame; and taking the coaxial data as data of the image frame where the image to be sent and the target data are located, and sending the coaxial data according to the third position by adopting a data sending mode of a blanking area.

Optionally, the processor is specifically configured to acquire coaxial data to be transmitted, where the coaxial data includes data representing the second position.

Optionally, the processor is specifically configured to obtain target data to be sent, where the target data represents environment information of an environment where an image acquisition device of the image to be sent is located; and/or acquiring target data to be sent, which represents audio information acquired by image acquisition equipment of the image to be sent; and/or acquiring target data representing image information of an image to be transmitted.

An embodiment of the present application provides an electronic device, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;

the processor is used for receiving an image frame, determining a first position of an image in an effective image area of the image frame, and determining a second position of target data in a blanking area of the image frame, acquiring the image from the image frame according to the first position by adopting a data acquisition mode of the effective image area, and acquiring the target data from the image frame according to the second position by adopting a data acquisition mode of the blanking area; the target data is different from the image and coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

the memory is used for storing the image and the target data acquired by the processor.

Optionally, the processor is further configured to determine a third position of the coaxial data in a blanking area of the image frame after receiving the image frame, and acquire the coaxial data from the image frame according to the third position by using a data acquisition manner of the blanking area.

Optionally, the on-axis data is acquired before determining a second position of the target data in a blanking region of the image frame; the memory is specifically configured to obtain, from the coaxial data, data representing a second position of the target data in a blanking region of the image frame.

Optionally, the memory is specifically configured to determine, from the blanking area of the image frame, a header identifier indicating a start position of the target data and a trailer identifier indicating an end position of the target data, and use a position between and including the header identifier and the trailer identifier as a second position of the target data in the blanking area of the image frame.

The embodiment of the application provides a computer-readable storage medium, a computer program is stored in the computer-readable storage medium, and the computer program is executed by a processor to implement a data transmission method provided by the embodiment of the application. The data transmission method comprises the following steps:

The embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements another data transmission method provided by the embodiment of the present application. The data transmission method comprises the following steps:

receiving an image frame;

According to the data transmission method and the camera provided by the embodiment of the application, after the image to be transmitted and the target data are obtained, the first position of the image to be transmitted in the effective image area of the image frame and the second position of the target data in the blanking area of the image frame are determined, the image to be transmitted and the target data are used as data of the same image frame, the image to be transmitted is transmitted according to the first position by adopting a data transmission mode of the effective image area, and the target data is transmitted according to the second position by adopting a data transmission mode of the blanking area. The target data is data different from the image to be transmitted and the coaxial data. Therefore, the target data and the image to be sent can be sent to the electronic equipment in the same image frame without additional wiring, and equipment cost can be saved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.

FIG. 1 is a schematic diagram of a structure of an image frame;

fig. 2 is a schematic flowchart of a data transmission method according to an embodiment of the present application;

fig. 3a is a schematic structural diagram of an image frame provided in an embodiment of the present application;

fig. 3b is a schematic diagram of a transmission frame for an image frame according to an embodiment of the present application;

fig. 4 is a schematic flowchart of another data transmission method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a camera provided in an embodiment of the present application;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solution in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the described embodiments are merely a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the related art, devices can transmit image and coaxial data only through a transmission medium such as a coaxial cable or a twisted pair. If data other than image and coaxial data needs to be transmitted, additional wiring is required.

In order to avoid additional wiring and achieve transmission of target data, embodiments of the present application provide a data transmission method, a camera, and an electronic device. The present application will be described in detail below with reference to specific examples.

Fig. 2 is a schematic flowchart of a data transmission method according to an embodiment of the present application. The embodiment is applied to a data sending end, which can be a camera, a computer, a smart phone or other equipment with data processing capability. The method comprises the following steps S201 to S203:

step S201: and acquiring an image to be sent and acquiring target data to be sent.

The target data is data different from the image to be transmitted and the coaxial data. Coaxial data is notification information exchanged between a data receiving end and a data transmitting end, and may also be referred to as PTZ data. When the data sending end and the data receiving end are respectively a video generating end and a video receiving end, the coaxial data exchanged between the video generating end and the video receiving end may include the coaxial sending data sent from the video generating end to the video receiving end, and may also include the coaxial receiving data sent from the video receiving end to the video generating end. For example, when the Video generating end is a Video camera and the Video receiving end is a Digital Video Recorder (DVR), the coaxial data may include shooting mode information sent by the Video camera to the DVR, information ready for upgrading, and the like, and may also include handshake data between the Video camera and the DVR, which may be used to send data indicating a device type, an image resolution, and the like. The on-axis data may also include control information sent by the DVR to the camera, which may include control instructions for the camera, such as image parameter adjustment instructions, camera aperture adjustment instructions, camera rotation adjustment instructions, resolution switching instructions, remote upgrade data instructions, and the like. The on-axis data may also include information such as the position of the image to be transmitted in the image frame and the position of the target data in the image frame.

The image frames may or may not include on-axis data.

In this step, when obtaining the target data to be sent, at least one of the following manners may be included:

in the first mode, target data representing environment information of an environment where image acquisition equipment to be sent is located is obtained.

For example, the target data in the present embodiment may be temperature information, humidity information, atmospheric pressure information, noise information, negative ion concentration, or the like. Correspondingly, one or more of a temperature sensor, a humidity sensor, an air pressure sensor, a noise sensor, an anion sensor and the like can be integrated in the image acquisition equipment; the image capturing device may be installed at the same position as the sensor without integrating the sensor.

When the data transmitting end serving as the execution main body is not the image acquisition device, the data transmitting end may acquire target data acquired by a sensor inside the image acquisition device, or the data transmitting end may directly acquire the target data transmitted by the sensor.

When the data transmitting end as the execution subject is the image capturing apparatus, the image capturing apparatus may directly acquire the target data transmitted by the sensor.

And acquiring target data of audio information acquired by image acquisition equipment representing an image to be transmitted.

The audio information collected by the image collecting device can be audio information collected in a preset time period. The preset time period may be a continuous time period or a plurality of discontinuous time periods. The preset time period may include the time when the target data is acquired, or may not include the time when the target data is acquired, and the duration of the preset time period may be fixed or variable.

And acquiring target data of image information representing an image to be transmitted.

The image may be an image to be sent, an image acquired before the image to be sent, or an image acquired after the image to be sent. One or more images may be used. The image information may include a sub-image obtained from the image and conforming to a preset image characteristic, and may also include information describing the sub-image. For example, the sub-images may be used to represent moving objects in the image, or to represent occluded objects in the image, or to represent anomalies in the image (e.g., overexposure, blur, or color distortion of the image, etc.), or to represent special scenes in the image (e.g., objects crossing predetermined boundaries, etc.). The object may include a human body, a vehicle, an animal, a building, etc., among others. The information for describing the sub-image may be the number of images corresponding to the sub-image, the image position corresponding to the sub-image, or the like, or an image coding format, a video coding format, private information, or the like. The image encoding format may include jpg, bmp, etc., and the video encoding format may include H264, H265, etc. Private information may be understood as any information that is not disclosed to the outside, for example, information about the usage right of the image capturing device.

In addition to the target data obtained in the above several manners, the target data to be sent may also be obtained as target data of other data to be sent, except for the image to be sent and the coaxial data. The present embodiment does not limit the specific information contained in the target data.

In this embodiment, the target data type may be an image type, a video type, or other types.

Step S202: a first position of an image to be transmitted in an active image area of an image frame is determined, and a second position of target data in a blanking area of the image frame is determined.

In this step, when determining the first position of the image to be sent in the effective image area of the image frame, the first preset position may be determined as the first position of the image to be sent in the effective image area of the image frame, and the preset position includes a start position and an end position. The first position of the image to be transmitted in the effective image area of the image frame can also be determined according to the data amount of the image to be transmitted.

When determining the first position of the image to be sent in the effective image area of the image frame according to the data amount of the image to be sent, specifically, the first position of the image to be sent in the effective image area of the image frame is determined as: starting from a first preset initial position to a first tail position; wherein, the first end position is: and adding the data size of the image to be sent to the first preset initial position to obtain the position. The first preset initial position and the first end position are both located in the effective image area.

In this step, when determining the second position of the target data in the blanking area of the image frame, the second preset position may be determined as the second position of the target data in the blanking area of the image frame. The second position of the target data in the blanking area of the image frame may also be determined according to the data amount of the target data.

When the second position of the target data in the blanking area of the image frame is determined according to the data amount of the target data, specifically, the second position of the target data in the blanking area of the image frame may be determined as: starting from a second preset initial position to a second tail position; wherein, the second end position is: and adding the data amount of the target data to the second preset initial position to obtain the position. The second preset initial position and the second end position are both positioned in the blanking area.

The second position may be a fixed position of the image frame blanking area or an unfixed position. The position of the coaxial data in the blanking region is a fixed position, and thus the second position of the target data in the blanking region may be a position other than the position of the coaxial data in the blanking region. For example, the second position may be a position of a partial region except for a position of the coaxial data in the blanking region, or may be a position of the entire region except for the position of the coaxial data in the blanking region, which is not specifically limited in this application.

The blanking region includes a field blanking region and a line blanking region. The second position may be located in a vertical blanking area, or in a horizontal blanking area, or in a portion of the vertical blanking area and another portion of the horizontal blanking area. In one embodiment, the storable amount of data of the vertical blanking region is larger than the storable amount of data of the line blanking region, and thus the second position may be determined from the vertical blanking region to increase the amount of data of the storable target data.

In one embodiment, the location of both the coaxial data and the target data may be in the vertical blanking region. For example, it is known that a vertical blanking interval of a 1920 × 1080P image frame includes 36 lines. The data volume of the coaxial data is generally small, and is a data volume of byte level, 2-4 lines of a vertical blanking area can be allocated to the coaxial data, and the remaining 32 lines can be allocated to the target data, so that the data volume of the target data which can be stored in the blanking area is about several hundred bytes.

In order to increase the storable amount of data of the blanking area, the specification of the transmitted image frame may be increased. For example, from an image frame of 200 ten thousand pixels to an image frame of 300 ten thousand pixels.

When the second position is a fixed position, the data receiving end and the data transmitting end can agree the second position in advance, so that the data receiving end can acquire the target data according to the agreed second position, and the accuracy in acquiring the target data is improved.

When the second position is not fixed, the target data may include a header mark indicating a start position of the target data and a trailer mark indicating an end position of the target data. Thus, when the data receiving end acquires the target data, the initial position of the target data can be determined according to the head mark, the tail position of the target data can be determined according to the tail mark, and the target data can be acquired from the blanking area according to the determined initial position of the target data and the tail position of the target data, so that the target data can be accurately acquired when the second position is not fixed. The flexibility in transmitting the target data is relatively large in this embodiment.

The head identifier may be a first predetermined bit string, and the tail identifier may be a second predetermined bit string. The first predetermined number of bits of the target data may be a first predetermined bit string, and the second predetermined number of bits of the target data may be a second predetermined bit string.

Step S203: and taking the image to be sent and the target data as data of the same image frame, sending the image to be sent according to the first position by adopting a data sending mode of an effective image area, and sending the target data according to the second position by adopting a data sending mode of a blanking area.

In this embodiment, the image to be transmitted and the target data are transmitted to the electronic device at the rear end through the same image frame, and the image and the target data can be transmitted through the same cable.

The data transmission mode may include an analog signal transmission mode and a digital signal transmission mode. The data transmission mode of the effective image area can be an analog signal transmission mode or a digital signal transmission mode. The data transmission mode of the blanking area is a digital signal transmission mode.

In this step, the target data may be transmitted in the form of a digital signal or an analog signal. In one embodiment, the target data may be transmitted in the form of digital signals in order to make the transmitted target data more accurate. The image to be transmitted can be transmitted in the form of an analog signal, which makes the transmitted image information richer.

When the image frame is transmitted, the data in the image frame may be transmitted in the form of a data stream line by line, or the data in the image frame may be transmitted in the form of a data stream line by line.

When receiving the image frame sent by the data sending end, the data receiving end can analyze the image frame according to a preset data storage rule to obtain an image and target data in the image frame.

As can be seen from the above, in this embodiment, after the image to be transmitted and the target data are obtained, a first position of the image to be transmitted in the effective image area of the image frame and a second position of the target data in the blanking area of the image frame are determined, the image to be transmitted and the target data are used as data of the same image frame, the image to be transmitted is transmitted according to the first position by using a data transmission manner in the effective image area, and the target data is transmitted according to the second position by using a data transmission manner in the blanking area. The target data is data different from the image to be transmitted and the coaxial data. Therefore, the target data and the image to be sent can be sent to the electronic equipment in the same image frame without additional wiring, and equipment cost can be saved.

In a large number of image frames sent from a data sending end to a data receiving end, target data may be carried in all the image frames, or may be carried in a part of the image frames. When the target data is obtained, the image frame carrying the image to be sent in the effective image area and the target data in the blanking area can be sent to the data receiving end. When the target data is not acquired, the image frame, which carries the image to be transmitted in the effective image area and does not carry the target data in the blanking area, can be transmitted to the data receiving end.

In another embodiment of the present application, in the embodiment shown in fig. 2, before transmitting the image to be transmitted and the target data, the method may further include the following steps 1 to 2:

step 1: acquiring coaxial data to be transmitted, and determining a third position of the coaxial data in a blanking area of the image frame.

In this embodiment, the image frame includes an image to be transmitted, target data, and coaxial data.

Determining the third position of the on-axis data in the blanking region of the image frame may include: the third preset position is determined as a third position of the on-axis data in a blanking area of the image frame. For example, the positions of the 2 nd to 4 th lines preset in the blanking area may be determined as the third position. In another embodiment, the blanking region may further include a position of coaxial data transmitted from the data receiving end to the data transmitting end, where the position may be a position different from the third position in the blanking region.

The third position may be before or after the second position in the blanking region. Since the data amount of the vertical blanking region is much larger than that of the line blanking region, the third position can be determined from the vertical blanking region.

Step 1 may be performed before step S202, or may be performed after step S202, which is not specifically limited in this application.

When the second location is not a fixed location, the step of acquiring coaxial data to be transmitted may include: coaxial data to be transmitted including data representing the second location is acquired.

Since the third position of the coaxial data may be a fixed position, the data receiving end and the data transmitting end may agree the third position in advance, so that when the data receiving end acquires the coaxial data, the coaxial data may be acquired according to the agreed third position. After acquiring the coaxial data, the second position may be determined according to data representing the second position included in the coaxial data, and the target data may be acquired from the second position, thereby improving accuracy in acquiring the target data.

In this embodiment, the coaxial data may further include other data besides the data indicating the second position, which is not specifically limited in this application.

Step 2: and taking the coaxial data as data of an image frame where the image to be transmitted and the target data are located, and transmitting the coaxial data according to a third position by adopting a data transmission mode of a blanking area.

In this step, the data transmission mode of the blanking region is a digital signal transmission mode, and the coaxial data may be transmitted according to the third position by adopting the digital signal transmission mode of the blanking region.

As an example, fig. 3a is a schematic diagram of data corresponding to an effective image area and a blank area of a frame image. The vertical line shadow area is an effective image area, and the blank area outside the vertical line shadow area is a blanking area. The blanking regions above and below the effective image region are field blanking regions, and the blanking regions on the left and right sides of the effective image region are line blanking regions. In the example shown in fig. 3a, the storage location of the coaxial data is located in the upper vertical blanking region, and the storage location of the target data is located in the lower vertical blanking region.

As an example, fig. 3b is a transmission architecture diagram of a frame image transmitted from a data transmitting end to a data receiving end. Wherein, one frame image comprises an image, coaxial data and target data.

Therefore, the embodiment can acquire the coaxial data, and send the image to be sent, the target data and the coaxial data to the data receiving end as the data of the same image frame, so that the data receiving end receives the image to be sent, the target data and the coaxial data through the same image frame, and the data transmission efficiency is improved.

In a specific implementation of the above embodiment, the position of the data indicating the second position in the blanking area of the image frame may be located before the second position.

This embodiment may be specifically configured such that the third position precedes the second position, which may ensure that the data representing the second position precedes the second position in the position of the blanking area of the image frame.

If the data receiving end acquires data in a front-to-back data acquisition mode when receiving data carried by the image frame, the position of the data representing the second position in the blanking area of the image frame is positioned before the second position, the data receiving end can acquire the data representing the second position in the coaxial data first, and then the target data can be acquired from the blanking area according to the data representing the second position, so that the efficiency of acquiring the target data is improved.

In another embodiment of the present application, in the embodiment shown in fig. 2, the target data may be a plurality of types of data, and for example, may be data representing environment information, data representing audio information, and data representing image information. The second position may be set in advance according to the relationship of the above-described type data with the image.

Specifically, when the target data is data representing environmental information, the second position may be a position located in a blanking area following the effective image area.

When the target data is data representing audio information, the second position is a position located in a blanking region before the effective image region.

When the target data is data representing image information, the second position is a position located in a blanking area before the effective image area.

In this embodiment, it is considered that the data representing the audio information and the data representing the image information have a large correlation with the image, and belong to data that can be acquired before the image, and this part of data can be located in a blanking region before the effective image region; it is considered that the data representing the environmental information is less correlated with the image, belonging to the data that can be acquired after the image, and this part of the data can be located in the blanking area after the effective image area.

In this way, if the data receiving end acquires data in a data acquisition mode from front to back when receiving data carried by an image frame, the data which can be acquired before the image is acquired first, and the data can be processed after the data is acquired, for example, a target image is determined from the image according to the data so as to display the target image as soon as possible for a user to view, and the target image can be a head portrait of a stranger, an image of a suspicious vehicle, and the like; or the image may be processed according to the data, for example, it is determined that there is an abnormality in the monitoring video, the user is prompted to pay attention to the monitoring video, or the data receiving end is enabled to start a video recording function, and the like.

The present application will be described in detail with reference to specific examples.

The data sending end is a Video camera, and the data receiving end is a Digital Video Recorder (DVR). The camera can acquire three kinds of data; image data, target data, on-axis data. The three acquired data can be stored in a buffer memory in the form of digital signals, and when the sending period of the image frame comes, the corresponding data is acquired from the buffer memory according to the determined first position, the second position and the third position. The data transmitting end transmits the data in the image frame in the form of a data stream line by line. When the image to be sent is required to be sent when the first position is reached, the image data in the form of digital signals is read from the buffer, converted into the form of analog signals and sent to the DVR. And when the target data is required to be sent when the second position is reached, reading the target data in the form of digital signals from the buffer, and sending the target data to the DVR. And when the coaxial data is required to be transmitted when the third position is reached, reading the coaxial data in the form of digital signals from the buffer, and transmitting the coaxial data to the DVR. The front and back positions of the first position, the second position and the third position in the same image frame may include various cases, and the present application is not particularly limited thereto.

In the related art, an image to be transmitted may be superimposed in an analog signal on an effective image area, and coaxial data may be superimposed in a digital signal on a blanking area. The amount of coaxial data is small, approximately on the order of bytes (which may be 6-24 bytes), and therefore there is a large amount of free blanking area available for storing the target data. In this embodiment, the target data may be stored in an idle blanking region.

In this embodiment, the image and coaxial data to be transmitted remain unchanged from the original transmission mode, and some unused blanking areas are used to fill the target data. The data transmitting end and the data receiving end can agree on the storage position of the target data in the image frame. Alternatively, the storage location of the target data in the image frame may be placed in the on-axis data. The data receiving end can resolve the storage location from the coaxial data relatively easily.

The data transmission mode provided by the embodiment can enable each image frame to have corresponding target data, so that the real-time performance and the synchronism of the data are better. The embodiment also does not limit the transmission material, the transmission material can be a coaxial cable, a twisted pair or other materials, additional wiring is not needed, and the equipment cost is reduced.

The following describes an application scenario of the present application in detail with reference to specific examples.

A company installs an analog camera with a motion detection function at a large portal. When a moving object such as a person, a vehicle, etc. passes through the area detected by the camera, the camera generates corresponding information (i.e., target data) including: whether there is a moving object at present, the coordinates of the moving object in the image, etc.

The specific procedure is as follows. The intelligent module built in the camera can detect the macro block which is currently moving. Specifically, the moving macroblocks may be numbered in an image that is divided into 16 × 16 equal parts and has 256 macroblocks. For example, the intelligent module may set the number value of the detected moving macroblock to 1 and the number value of the detected non-moving macroblock to 0. That is, when the camera detects that a vehicle is passing, the macro block that the vehicle is moving in the current image frame is marked. This information is placed in fixed lines of the blanking area in the form of target data. And add the following description to the coaxial data: the current camera is a camera with a motion detection function, the current data includes motion detection data, and the data is placed in which line of the blanking area. After receiving the signal, the DVR analyzes the coaxial data by default, and when the storage position of the target data is analyzed, the target data in the blanking area is searched. When the DVR analyzes that the current image frame passes by a moving object, the event recording function is started, and the video sent by the camera is stored. Finally, when the client watches the video in the DVR, all the monitoring videos with the moving object can be seen, and the video with the moving object does not need to be searched in a large amount of videos.

Fig. 4 is a flowchart illustrating another data transmission method according to an embodiment of the present application. The method is applied to a data receiving end, and the data receiving end can be a computer, a smart phone or other electronic equipment with data processing capability. The method comprises the following steps S401 to S403:

step S401: an image frame is received.

Specifically, the image frame is received, which can be understood as an image frame sent by a data sending end. The image frames may be data received over a coaxial cable or twisted pair.

Step S402: a first position of the image in an active image area of the image frame is determined and a second position of the target data in a blanking area of the image frame is determined.

The target data is data different from the image and the coaxial data, and the coaxial data is notification information interacted between the data receiving end and the data sending end.

This coaxial data may also be referred to as PTZ data. When the data sending end and the data receiving end are respectively a video generating end and a video receiving end, the coaxial data exchanged between the video generating end and the video receiving end may include the coaxial sending data sent from the video generating end to the video receiving end, and may also include the coaxial receiving data sent from the video receiving end to the video generating end. The on-axis data may also include information such as the position of the image to be transmitted in the image frame and the position of the target data in the image frame.

The image frames may or may not include on-axis data.

In this step, when a first position of the image in the effective image area of the image frame is determined, and a second position of the target data in the blanking area of the image frame is determined, the first position and/or the second position may be determined according to the appointed position. This way, the accuracy in acquiring the target data can be improved.

When the target data includes a header mark indicating a start position of the target data and a tail mark indicating an end position of the target data, in determining the second position of the target data in the blanking area of the image frame, it may further include:

determining a head mark representing the starting position of the target data and a tail mark representing the tail position of the target data from the blanking area of the image frame, and taking the position between the head mark and the tail mark and including the head mark and the tail mark as a second position of the target data in the blanking area of the image frame. The method can accurately determine the position of the target data, and the flexibility of the position is relatively high when the target data is transmitted.

Step S403: and acquiring an image from the image frame according to a first position by adopting a data acquisition mode of an effective image area, and acquiring target data from the image frame according to a second position by adopting a data acquisition mode of a blanking area.

The data acquisition mode of the effective image area can be an analog signal acquisition mode or a digital signal acquisition mode. The data acquisition mode of the blanking area is a digital signal acquisition mode.

As can be seen, after receiving the image frame, the present embodiment may determine a first position of the image in the effective image area of the image frame, and determine a second position of the target data in the blanking area of the image frame, acquire the image according to the first position, and acquire the target data according to the second position by using the data acquisition manner of the corresponding area. Therefore, the present embodiment can realize acquisition of an image and target data from the same image frame without additional wiring, thereby enabling cost saving.

In another embodiment of the present application, after step S401 in the embodiment shown in fig. 4, i.e. after receiving the image frame, the method may further include the following steps 1 and 2:

step 1: a third position of the on-axis data in a blanking area of the image frame is determined.

The step may specifically include: a third position of the on-axis data in the blanking area of the image frame is determined based on the agreed position. The appointed position may be a preset line in the blanking region, for example, lines 2 to 4 in the blanking region.

Wherein the third position may be before the second position or after the second position. The third position may be before the first position or after the second position. The position of the front or rear is understood to mean that the upper part is the front position and the lower part is the rear position when the image frames are analyzed in the order from top to bottom. For example, in fig. 3a, when the data receiving end analyzes the image frame line by line from top to bottom, the upper line is located at a position before the lower line.

Step 2: and acquiring coaxial data from the image frame according to the third position by adopting a data acquisition mode of the blanking area.

The step may specifically be, in a digital signal acquisition form of the blanking region, acquiring coaxial data from the image frame according to the third position.

It can be seen that the image frame of this embodiment includes the coaxial data, and after the image frame is received, the third position of the coaxial data in the blanking area of the image frame may be determined, and the coaxial data is acquired from the image frame according to the third position in the data acquisition manner of the blanking area, so that the image, the target data, and the coaxial data can be received through the same image frame, and the data transmission efficiency is improved.

In another implementation of the above embodiment, the on-axis data is acquired prior to determining the second position of the target data in the blanking region of the image frame; step S402, namely, the step of determining the second position of the target data in the blanking area of the image frame, may include:

In this embodiment, the position of the target data in the blanking area of the image frame may not be a fixed position, so that the second position of the target data may be acquired from the coaxial data for each image frame, thereby acquiring the target data according to the second position, and improving the accuracy when acquiring the target data.

After the target data is acquired, the target data may also be stored. In this way, the user can be made to inquire the required data from the stored target data.

Fig. 5 is a schematic structural diagram of a camera according to an embodiment of the present application. This embodiment corresponds to the embodiment of the method shown in fig. 2. The camera includes: the system comprises a processor 501, a communication interface 502, a memory 503 and a communication bus 504, wherein the processor 501, the communication interface 502 and the memory 503 are communicated with each other through the communication bus 504;

the processor 501 is configured to acquire an image to be sent, acquire target data to be sent, determine a first position of the image to be sent in an effective image area of an image frame, and determine a second position of the target data in a blanking area of the image frame, send the image to be sent and the target data as data of the same image frame, send the image to be sent according to the first position in a data sending manner of the effective image area, and send the target data according to the second position in a data sending manner of the blanking area; the target data is different from the image to be sent and the coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

and a memory 502 for storing the image to be transmitted and the target data acquired by the processor 501. The memory may specifically be a cache.

In another embodiment of the present application, the processor 501 in the embodiment shown in fig. 5 may be further configured to, before transmitting the image to be transmitted and the target data, obtain coaxial data to be transmitted, and determine a third position of the coaxial data in a blanking area of an image frame; and taking the coaxial data as data of the image frame where the image to be sent and the target data are located, and sending the coaxial data according to the third position by adopting a data sending mode of a blanking area.

In another embodiment of the present application, in the embodiment shown in fig. 5, the processor 501 may be specifically configured to acquire coaxial data to be transmitted, where the coaxial data includes data representing the second position.

In another embodiment of the present application, the position of the data representing the second position in the blanking area of the image frame is located before the second position in the embodiment shown in fig. 5.

In another embodiment of the present application, in the embodiment shown in fig. 5, the target data includes a header mark indicating a start position of the target data, and a tail mark indicating an end position of the target data.

In another embodiment of the present application, in the embodiment shown in fig. 5, the processor 501 may be specifically configured to obtain target data to be sent, where the target data represents environment information of an environment where an image acquisition device of an image to be sent is located; and/or acquiring target data of audio information acquired by image acquisition equipment which represents an image to be transmitted and is to be transmitted; and/or acquiring target data representing image information of an image to be transmitted.

In another embodiment of the present application, in the embodiment shown in fig. 5, when the target data is data representing environmental information, the second position is a position located in a blanking area following the effective image area; when the target data is data representing audio information, the second position is a position located in a blanking region before the effective image region; when the target data is data representing image information, the second position is a position located in a blanking area before the effective image area.

Since the above-mentioned camera embodiment is obtained based on the method embodiment, and has the same technical effect as the method, the technical effect of the camera embodiment is not described herein again. As for the camera embodiment, since it is substantially similar to the method embodiment, it is described relatively simply, and relevant points can be referred to the partial description of the method embodiment shown in fig. 2.

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application. This embodiment corresponds to the method embodiment shown in fig. 4. The electronic device includes: the system comprises a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602 and the memory 603 complete mutual communication through the communication bus 604;

a processor 601, configured to receive an image frame, determine a first position of the image in an effective image area of the image frame, and determine a second position of target data in a blanking area of the image frame, acquire the image from the image frame according to the first position in a data acquisition manner of the effective image area, and acquire the target data from the image frame according to the second position in a data acquisition manner of the blanking area; the target data is data different from the image and the coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

a memory 602 for storing the image and the target data acquired by the processor 601.

In another embodiment of the present application, the processor 601 in the embodiment shown in fig. 6 may be further configured to determine a third position of the coaxial data in the blanking area of the image frame after receiving the image frame, and acquire the coaxial data from the image frame according to the third position by using a data acquisition manner of the blanking area.

In another embodiment of the present application, in the embodiment shown in FIG. 6, the on-axis data is acquired prior to determining the second position of the target data in the blanking region of the image frame; the processor 601 may be specifically configured to obtain data indicating a second position of the target data in the blanking region of the image frame from the coaxial data.

In another embodiment of the present application, in the embodiment shown in fig. 6, the memory may be specifically configured to determine a header identifier indicating a start position of the target data and a trailer identifier indicating an end position of the target data from the blanking area of the image frame, and use a position between and including the header identifier and the trailer identifier as the second position of the target data in the blanking area of the image frame.

In this embodiment, the electronic device may be a DVR device, and the DVR device may specifically include: digital-to-Analog (AD) conversion module, main chip, display, interface, hard disk. The main chip may include a Digital Signal Processing (DSP) encoding module, a DSP decoding module, and a CPU. The hard disk may be a ROM memory. The electronic device may webcast image data in received image frames.

Since the electronic device embodiment is obtained based on the method embodiment and has the same technical effect as the method, the technical effect of the electronic device embodiment is not described herein again. For the embodiment of the electronic device, since it is substantially similar to the embodiment of the method, it is described relatively simply, and relevant points can be referred to the partial description of the embodiment of the method shown in fig. 4.

In the camera embodiment and the electronic device embodiment, the communication bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the above-mentioned device and other devices.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), an arm (advanced RISC machines) Processor, and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

The embodiment of the application also provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the data transmission method provided by the embodiment of the application is implemented. The data transmission method comprises the following steps:

As can be seen, in this embodiment, after the image to be sent and the target data are obtained, the image to be sent and the target data are used as data of the same image frame, the image to be sent is sent according to the determined first position, and the target data is sent according to the determined second position. The target data is data different from the image to be transmitted and the coaxial data. Therefore, the target data and the image to be sent can be sent to the electronic equipment in the same image frame without additional wiring, and equipment cost can be saved.

receiving an image frame;

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments.

The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. A method of data transmission, the method comprising:

taking the image to be sent and the target data as data of the same image frame, sending the image to be sent according to the first position by adopting a data sending mode of an effective image area, and sending the target data according to the second position by adopting a data sending mode of a blanking area;

the location of the data representing the second location in the blanking area of the image frame is prior to the second location.

2. The method of claim 1, further comprising:

3. The method of claim 2, wherein the step of obtaining coaxial data to be transmitted comprises: coaxial data to be transmitted including data representing the second location is acquired.

4. The method of claim 1, wherein the target data includes a header mark indicating a start position of the target data and a trailer mark indicating an end position of the target data.

5. The method of claim 1, wherein the step of obtaining target data to be transmitted comprises:

acquiring target data to be sent, wherein the target data is data representing audio information; and/or acquiring target data to be transmitted, wherein the target data is data representing image information; and/or acquiring target data to be sent, wherein the target data is target data representing environment information;

when the target data is data representing image information, the second position is a position in a blanking region located before the effective image region;

when the target data is data representing environmental information, the second position is a position located in a blanking region following the effective image region.

6. The method of claim 5,

the acquiring target data to be transmitted, the target data being data representing audio information, includes: acquiring target data to be sent, which represents audio information acquired by image acquisition equipment of an image to be sent; and/or the presence of a gas in the gas,

the acquiring target data to be transmitted, the target data being data representing image information, includes: acquiring target data representing image information of an image to be transmitted; and/or the presence of a gas in the gas,

acquiring target data to be transmitted, wherein the target data is target data representing environment information and comprises the following steps:

and acquiring target data to be sent, which represents environment information of the environment where the image acquisition equipment of the image to be sent is located.

7. The method according to any one of claims 1 to 6, wherein the second position is located in a line blanking region, or wherein the second position is located in a field blanking region, or wherein the second position has a part in the field blanking region and another part in the line blanking region.

8. A method of data transmission, the method comprising:

determining a first position of an image in an active image area of an image frame and determining a second position of target data in a blanking area of the image frame; the target data is different from the image and coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end;

acquiring an image from the image frame according to the first position by adopting a data acquisition mode of an effective image area, and acquiring target data from the image frame according to the second position by adopting a data acquisition mode of a blanking area;

9. The method of claim 8, further comprising:

10. The method of claim 8, wherein the step of determining a second location of target data in a blanking region of the image frame comprises:

11. The method of claim 8, wherein the step of determining a second location of target data in a blanking region of the image frame comprises:

12. The method according to any one of claims 8 to 11, characterized in that the target data is data representing audio information, and/or data representing image information, and/or data representing environment information;

when the target data is data representing audio information, the second position is a position in a blanking region located before the effective image region; and/or the presence of a gas in the gas,

when the target data is data representing image information, the second position is a position in a blanking region located before the effective image region; and/or the presence of a gas in the gas,

13. The method of claim 12, wherein the second location is in a line blanking region, or wherein the second location is in a field blanking region, or wherein the second location has a portion in the field blanking region and another portion in the line blanking region.

14. A camera, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;

the processor is configured to acquire an image to be transmitted, acquire target data to be transmitted, determine a first position of the image to be transmitted in an effective image area of an image frame, determine a second position of the target data in a blanking area of the image frame, use the image to be transmitted and the target data as data of the same image frame, transmit the image to be transmitted according to the first position in a data transmission manner of the effective image area, and transmit the target data according to the second position in a data transmission manner of the blanking area; the target data is different from the image to be sent and the coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end; a position of the data representing the second position in a blanking area of the image frame, prior to the second position;

15. The camera of claim 14, wherein the processor is further configured to obtain coaxial data to be transmitted and to determine a third position of the coaxial data in a blanking region of an image frame; and taking the coaxial data as data of the image frame where the image to be sent and the target data are located, and sending the coaxial data according to the third position by adopting a data sending mode of a blanking area.

16. The camera of claim 15, wherein the processor is specifically configured to obtain coaxial data to be transmitted that includes data representing the second position.

17. The camera of claim 14, wherein the target data includes a header mark indicating a start position of the target data and a footer mark indicating an end position of the target data.

18. The camera according to claim 14, wherein the processor is specifically configured to acquire target data to be transmitted, where the target data is data representing audio information; and/or acquiring target data to be transmitted, wherein the target data is data representing image information; and/or acquiring target data to be sent, wherein the target data is target data representing environment information;

19. The camera of claim 18,

the acquiring target data to be transmitted, the target data being data representing audio information, includes: (ii) a Acquiring target data to be sent, which represents audio information acquired by image acquisition equipment of an image to be sent; and/or the presence of a gas in the gas,

20. The camera of any one of claims 14 to 19, wherein the second position is located in a line blanking region, or wherein the second position is located in a field blanking region, or wherein the second position has a portion in the field blanking region and another portion in the line blanking region.

21. An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;

the processor is used for determining a first position of an image in an effective image area of the image frame and determining a second position of target data in a blanking area of the image frame, acquiring the image from the image frame according to the first position by adopting a data acquisition mode of the effective image area, and acquiring the target data from the image frame according to the second position by adopting a data acquisition mode of the blanking area; the target data is different from the image and coaxial data, and the coaxial data is notification information interacted between a data receiving end and a data sending end; a position of the data representing the second position in a blanking area of the image frame, prior to the second position;

22. The electronic device of claim 21, wherein the processor is further configured to determine a third location of coaxial data in a blanking region of the image frame, and wherein the coaxial data is obtained from the image frame at the third location using a blanking region data obtaining manner.

23. Electronic device according to claim 21, characterized in that the memory is in particular adapted to retrieve data from the coaxial data representing a second position of target data in a blanking area of the image frame.

24. The electronic device according to claim 21, wherein the memory is specifically configured to determine a header indicator indicating a start position of the target data and a trailer indicator indicating an end position of the target data from the blanking area of the image frame, and to use a position between and including the header indicator and the trailer indicator as the second position of the target data in the blanking area of the image frame.

25. Electronic device according to any of claims 21 to 24, characterized in that the object data are data representing audio information, and/or data representing image information, and/or data representing environment information;

26. The electronic device of claim 25, wherein the second location is in a line blanking region, or wherein the second location is in a field blanking region, or wherein the second location has a portion in the field blanking region and another portion in the line blanking region.

27. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any of the claims 1-7, or which computer program, when being executed by a processor, carries out the method steps of any of the claims 8-13.