CN112379856B - Display picture reconstruction device and method - Google Patents

Display picture reconstruction device and method Download PDF

Info

Publication number
CN112379856B
CN112379856B CN202011091609.6A CN202011091609A CN112379856B CN 112379856 B CN112379856 B CN 112379856B CN 202011091609 A CN202011091609 A CN 202011091609A CN 112379856 B CN112379856 B CN 112379856B
Authority
CN
China
Prior art keywords
picture
unit
sampling
receiving
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011091609.6A
Other languages
Chinese (zh)
Other versions
CN112379856A (en
Inventor
张乐平
侯磊
杨涛
李海峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Deepctrl Co ltd
Original Assignee
Beijing Deepctrl Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Deepctrl Co ltd filed Critical Beijing Deepctrl Co ltd
Priority to CN202011091609.6A priority Critical patent/CN112379856B/en
Publication of CN112379856A publication Critical patent/CN112379856A/en
Application granted granted Critical
Publication of CN112379856B publication Critical patent/CN112379856B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application belongs to the field of video data processing and discloses a display picture reconstruction device and a method, wherein the device comprises: the input interface is connected with at least one receiving card and is used for receiving the picture driving signals sent by the receiving card, wherein the receiving card converts the picture information output by the terminal equipment into corresponding picture driving signals; the picture reconstruction module is connected with the input interface and used for receiving the picture driving signal sent by the input interface, sampling and analyzing the picture driving signal to obtain a local display picture, and recombining the local display picture to form a complete acquisition picture; and the output interface is connected with the picture reconstruction module and used for receiving and outputting the complete collected picture sent by the picture reconstruction module. Therefore, the pictures corresponding to the receiving cards can be integrated to reconstruct the complete collected pictures, and the reconstructed collected pictures can be analyzed and processed by the video analysis device more conveniently.

Description

Display picture reconstruction device and method
Technical Field
The present application relates to the field of video data processing technologies, and in particular, to a display screen reconstruction apparatus and method.
Background
Currently, two typical LED screen control circuits are available in the market:
1. the main control computer samples the standard video port sampling points through the standard video lines and then sends the sampling points to the video processor/sending card for packaging processing, then the video processor/sending card is used for analyzing the video network communication protocol analysis points, the analyzed videos are sent to one or more receiving cards through the network lines to be processed to form corresponding video driving information, and the video driving information is sent to the LED screen for displaying.
2. After the master control computer + the sending card/the mobile phone/the Pad + the network player packages the video, the video network communication protocol analysis point is analyzed, the analyzed video is directly sent to one or more receiving cards through a network cable to be processed to form corresponding video driving information, and the video driving information is sent to an LED screen to be displayed.
The LED screen includes: monochrome screens, grayscale screens, color screens, etc.; on the same user side, there may also be a 1+2 hybrid control mode.
In the above 1 and 2, if the image to be displayed is analyzed at the "video network communication protocol analysis point" by analyzing the network communication protocol, the main problem is that:
all equipment manufacturers and integration manufacturers have different network communication protocols, and no standard communication protocol exists; each project can be matched with the communication protocol of the original manufacturer to correctly analyze the display picture information; when the original communication protocol is changed, the original communication protocol is also required to be changed in a matching way at any time;
some network communication protocols, including encryption function, are not opened, and thus, the protocols cannot be analyzed and display pictures can be obtained.
Some sampling points exist at the standard video port, and picture information can be sampled at the sampling points at the standard video port, so that the problem of the network sampling points does not exist. But in many applications, such as most monochromatic LED screens and low-end at least one color-glare LED screen, the sampling point is not present; and a standard video port sampling point does not exist in a high-end color LED screen. Therefore, the method of sampling and reconstructing the video through the standard video port has application limitation.
Disclosure of Invention
In view of the above, the present application provides a display screen reconstructing apparatus and method. The method mainly aims to solve the technical problem of how to reconstruct the display picture suitable for various display screens.
According to a first aspect of the present application, there is provided a display screen reconstruction apparatus including:
the input interface is connected with at least one receiving card and used for receiving the picture driving signals sent by the receiving card, wherein the receiving card converts the picture information output by the terminal equipment into corresponding picture driving signals;
the picture reconstruction module is connected with the input interface and used for receiving the picture driving signal sent by the input interface, sampling and analyzing the picture driving signal to obtain a local display picture, and recombining the local display picture to form a complete acquisition picture;
and the output interface is connected with the picture reconstruction module and used for receiving and outputting the complete collected picture sent by the picture reconstruction module.
Further, the picture reconstruction module comprises: the system comprises a preprocessing unit, an analysis unit and a recombination unit which are connected in sequence, wherein the preprocessing unit is connected with an input interface, and the recombination unit is connected with an output interface;
the preprocessing unit is used for preprocessing the picture driving signals sent by the input interface, completing sampling and recording of the picture driving signals and obtaining sampling recorded data, wherein the picture driving signals output by each receiving card correspond to local pictures of a display screen;
the analysis unit is used for receiving at least one sampling record data sent by the preprocessing unit and performing data conversion on the sampling record data to form at least one local display picture;
the recombination unit is used for receiving at least one local display picture sent by the analysis unit and combining the at least one local display picture to form a complete acquisition picture.
Further, the preprocessing unit includes: the buffer unit is arranged between the input interface and the sampling unit, and the sampling unit is connected with the analysis unit;
the buffer unit is used for receiving the picture driving signal sent by the input interface and carrying out data bit buffer on the picture driving signal;
the sampling unit is used for acquiring the data bit cache of the cache unit and preprocessing the data bit cache to form corresponding sampling record data.
Further, the sampling unit is specifically configured to:
and acquiring the data bit cache of the cache unit, and sampling and recording the data bit cache according to the pre-configured interface driving characteristic parameters to form sampling record data.
Further, the parsing unit is specifically configured to:
and receiving sampling record data sent by the sampling unit, extracting time sequence signal data in the digital signal, performing data analysis on the time sequence signal data to form a corresponding local display picture, and marking corresponding transverse and longitudinal positions in the local display picture attribute according to a relation parameter corresponding to the position of the local display picture by a pre-configured interface.
Further, the recombination unit is specifically configured to:
receiving at least one local display picture sent by the analysis unit, and extracting the horizontal and vertical positions in the local display picture attribute;
and arranging the positions of the local display pictures according to the transverse and longitudinal positions, and recombining the at least one local display picture into a complete acquisition picture.
Further, the picture reconstruction module comprises: CPU processor and FPGA programmable logic device.
Further, still include: a configuration interface connected with the picture reconstruction module;
the configuration interface is used for receiving corresponding video interface configuration parameter information when the picture reconstruction program executed by the picture reconstruction module is received.
Further comprising: the RAM storage module and the Flash storage module are connected with the picture reconstruction module;
the RAM storage module is used for caching running data formed when the picture reconstruction module executes the picture reconstruction program;
and the Flash storage module is used for storing the picture reconstruction program executed by the picture reconstruction module, and firmware data and configuration data required by the operation of the picture reconstruction program.
According to a second aspect of the present application, a method for reconstructing a display screen is provided, which includes:
receiving a picture driving signal sent by at least one receiving card, wherein the receiving card converts picture information output by the terminal equipment into a corresponding picture driving signal;
sampling and analyzing the picture driving signal to obtain a local display picture, and recombining the local display picture to form a complete acquisition picture;
and outputting the complete acquisition picture.
By means of the technical scheme, the device and the method for reconstructing the display picture provided by the application have the advantages that the picture information output by the terminal equipment needs to be coded through the receiving card to form the picture driving signal, the picture driving signal is sent to the picture reconstructing module through the input interface, the picture driving signal is sampled and analyzed to be analyzed into at least one local display picture, the at least one local display picture is reconstructed to form a complete acquisition picture, and the complete acquisition picture can be directly output through the output interface. Through the scheme of this application, can integrate the picture that each receiving card corresponds and reconstruct the complete collection picture of department, and then be convenient for more utilize video analysis device to carry out analysis processes to the collection picture of reconsitution.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a block diagram of a display screen reconstruction apparatus according to an embodiment of the present application;
fig. 2 is a flowchart of a display reconstruction method according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Example 1
As shown in fig. 1, the present embodiment provides a display screen reconstructing apparatus including: the input interface 1 is connected with at least one receiving card and used for receiving picture driving signals sent by the receiving card, wherein the receiving card converts the picture information output by the terminal equipment into corresponding picture driving signals; the picture reconstruction module 2 is connected with the input interface 1, is used for being connected with the input interface 1 and is used for receiving the picture driving signal sent by the input interface 1, sampling and analyzing the picture driving signal to analyze the picture driving signal into a local display picture and recombining the local display picture to form a complete acquisition picture; and the output interface 3 is connected with the picture reconstruction module 2 and used for receiving and outputting the complete collected picture sent by the picture reconstruction module 2.
In the above scheme, the display picture reconstruction apparatus is applied to a driving interface of the display screen, and a protocol of the driving interface is one of driving interface protocols such as 08/12/75. And connecting with a receiving card, sampling and analyzing the picture driving signal sent by the receiving card, and recombining the picture driving signal. And outputting the recombined complete acquisition picture through an output interface 3. The pictures refer to video pictures or picture pictures.
In addition, the complete collected picture output by the output interface can be identified and judged through the external image analysis device, whether the display picture contains unhealthy information such as pornographic information, violence information, horror information, anti-sharing information and the like is judged, if yes, the picture information of the driving interface of the display screen is intercepted, and otherwise, the picture information of the driving interface of the display screen is released.
No matter one receiving card or a plurality of receiving cards, the complete collected picture can be reconstructed only by analyzing the picture driving signal output by each receiving card to obtain a display picture and then carrying out jigsaw puzzle or image fusion processing.
In addition, the input interface 1 is connected to the image reconstruction module 2 through an input driving module, and the input driving module performs conversion between an electrical standard and an interface protocol on the image driving signal to logically adapt to the electrical standard and the interface protocol of the image reconstruction module 2. The output interface 3 is connected with the picture reconstruction module 2 through an output driving module, and the output driving module performs conversion of an electrical standard and an interface protocol on a complete collected picture signal output by the picture reconstruction module 2 so as to logically adapt to the electrical standard and the interface protocol of the signal transmitted by the output interface 3.
According to the technical scheme, the picture information output by the terminal equipment needs to be coded through the receiving card to form a picture driving signal, the picture driving signal is sent to the picture reconstruction module through the input interface, the picture driving signal is sampled and analyzed to be analyzed into at least one local display picture, the at least one local display picture is recombined to form a complete collection picture, and the complete collection picture can be directly output through the output interface. Therefore, the pictures corresponding to the receiving cards can be integrated to reconstruct the complete collected pictures, and the reconstructed collected pictures can be analyzed and processed by the video analysis device more conveniently.
In a specific embodiment, the picture reconstruction module 2 includes: the system comprises a preprocessing unit, an analysis unit 23 and a recombination unit 24 which are connected in sequence, wherein the preprocessing unit is connected with an input interface 1, and the recombination unit 24 is connected with an output interface 3; the preprocessing unit is used for preprocessing the picture driving signals sent by the input interface 1, completing sampling and recording of the picture driving signals and obtaining sampling recorded data, wherein the picture driving signals output by each receiving card correspond to local pictures of a display screen; the analysis unit 23 is configured to receive at least one sampling record data sent by the preprocessing unit, perform data conversion on the sampling record data, and form at least one local display picture; and the recombination unit 24 is configured to receive the at least one local display image sent by the analysis unit 23, and combine the at least one local display image to form a complete acquisition image.
In the above scheme, since the picture driving signal input by the input interface 1 belongs to a serial communication signal, which is inconvenient for subsequent processing, the picture driving signal needs to be preprocessed by the preprocessing unit, the serial communication signal is converted into a digital signal, and then the digital signal is analyzed and recombined by the analyzing unit 23 and the recombining unit 24 to form a complete collection picture, which is output through the output interface 3.
The reconstructed picture may be analyzed by a picture analysis module, which may be disposed in the display picture reconstruction device or may be connected to the picture analysis module through an external interface.
The specific identification process of the picture analysis module for further identifying and judging the output complete collected picture is as follows:
firstly, some videos and images with bad information and some videos and images without the bad information are collected as sample information, corresponding positions of the bad information in the sample information and corresponding bad categories (such as pornography, violence, scare, confusing, anti-sharing and the like) are marked, and videos and images without the bad information are marked as normal categories.
Secondly, constructing a network training model by utilizing at least one neural network, wherein the neural network comprises: CNN (convolutional neural network), RNN (recurrent neural network), DNN (deep neural network). When the network training model is constructed, one or at least one of the above neural networks, or a superimposed combination of at least one of the same neural networks may be used, or some commonly used functions (e.g., linear functions) may be added to the constructed network training model to improve the resolution accuracy, which is not limited herein.
The number of hidden layers of the neural network in the constructed network training model is also set according to experience, and the number of the hidden layers can be set to be at least one layer than the number of the common hidden layers, so that useless hidden layers can be deleted after training.
Inputting marked sample information from an input port of a network training model, sequentially processing the sample information through hidden layers of a neural network, outputting an output result corresponding to the sample information, comparing the type in the output result with the mark, performing input training of next sample information if the type in the output result is consistent with the mark, calculating a loss function according to the comparison between the output result and the mark if the type in the output result is inconsistent with the mark, adjusting each hidden parameter in the network training model by using the loss function until the output result is consistent with the mark, and then training the next sample information. After the training is finished, the network training model is used as a bad information identification model to identify videos and images.
And fourthly, constructing a recognition unit according to the bad information recognition model, and adding the recognition unit into the picture analysis module.
Fifthly, inputting the reconstructed complete collected picture into a picture analysis module for identification, and if the identification result is a normal type, releasing the picture driving signal sent by the receiving card; if the identification result is a bad category, the picture driving signal sent by the receiving card is intercepted.
In a particular embodiment, the pre-processing unit comprises: the buffer unit 21 is arranged between the input interface 1 and the sampling unit 22, and the sampling unit 22 is connected with the analysis unit 23; a buffer unit 21, configured to receive the picture driving signal sent from the input interface 1, and perform data bit buffering on the picture driving signal; and the sampling unit 22 is configured to obtain the data bit cache of the cache unit 21, and perform preprocessing on the data bit cache to form corresponding sampling record data.
In the above scheme, after the input interface 1 receives the picture driving signal, the buffer unit 21 starts to automatically buffer the data bits in the picture driving signal, and after the picture driving signal is sampled by the sampling unit 22, the data bits are automatically deleted from the buffer for saving space. And the calling processing of the data bit cache is facilitated.
In a specific embodiment, the sampling unit 22 is specifically configured to: and acquiring a data bit cache of the cache unit 21, and sampling and recording the data bit cache according to a pre-configured interface driving characteristic parameter to form sampling record data.
In a specific embodiment, the parsing unit 23 is specifically configured to: receiving the sampling record data sent by the sampling unit 22, extracting the time sequence signal data in the digital signal, performing data analysis on the time sequence signal data to form a corresponding local display picture, and marking the corresponding horizontal and vertical positions in the local display picture attribute according to the relation parameter corresponding to the position of the local display picture and the pre-configured interface.
In a specific embodiment, the recombination unit 24 is specifically configured to: receiving at least one local display picture sent by the analysis unit 23, and extracting the horizontal and vertical positions in the local display picture attribute; and carrying out position arrangement on the partial display pictures according to the transverse and longitudinal positions, and recombining at least one partial display picture into a complete acquisition picture.
If the horizontal and vertical positions are not marked in the picture driving signal sent by the receiving card, the sampling unit 22, the analyzing unit 23 and the recombining unit 24 may complete the recombining process by adopting the following scheme.
The method specifically comprises the following steps:
the sampling unit 22 is specifically configured to: acquiring a picture driving signal in the cache unit 21, and scanning pixel points of an image in the picture driving signal; scanning a line of pixel points to form a line synchronizing signal, and then scanning the pixel points of the next line until the whole picture driving signal is scanned to form a field synchronizing signal; the line synchronizing signal and the field synchronizing signal of the picture driving signal for each frame are combined together as timing signal data. The horizontal synchronizing signal and the field synchronizing signal are both pulse signals. In order to transmit the horizontal synchronizing signal and the field synchronizing signal in one channel, the horizontal synchronizing signal and the field synchronizing signal need to be superimposed together to form a composite synchronizing signal, and the composite synchronizing signal is used as timing signal data.
By the scheme, the picture driving signals are converted into the time sequence signal data, and normal transmission of the picture driving signals can be ensured.
The analysis unit 23 is specifically configured to: and taking a line synchronizing signal in the time sequence signal data as an abscissa and a field synchronizing signal as an ordinate to establish a coordinate system, and marking pixel points corresponding to the line synchronizing signal and the field synchronizing signal in the coordinate system to form a local display picture corresponding to the time sequence signal data.
In the above-described configuration, the field sync signal is separated from the timing signal data by the integrating circuit, and the row sync signal is separated from the timing signal by the differentiating circuit. Then marking the line synchronizing signal and the field synchronizing signal in a coordinate system to restore the corresponding local display picture. Each time sequence signal correspondingly restores a local display picture.
The recombination unit 24 is specifically configured to: acquiring characteristic data information in local display pictures, wherein each local display picture corresponds to a group of characteristic data information; judging whether the characteristic data information of the two local display pictures is similar, if so, splicing and fusing the two local display pictures until all the local display pictures are spliced and fused completely to form a complete acquisition picture.
In the above scheme, each partial display screen has corresponding feature data information, and the feature data information includes a screen edge feature, an internal contour feature, and the like. Wherein, the picture edge characteristics include: color arrangement on the edge line, length of the edge line and the like, and the internal profile characteristics comprise: the shape, size, etc. of the objects in the picture. Comparing the characteristic data information in one local display picture with the characteristic data information in other local display pictures, determining one local display picture with the highest matching degree with the characteristic data information in the local display picture from the other local display pictures, splicing and fusing the two local display pictures, and then comparing the characteristic data information in the next step until all the local display pictures are spliced and fused completely, thereby forming a complete acquisition picture. And finally, pushing the complete acquisition picture to an information output interface.
In a specific embodiment, the picture reconstruction module 2 includes: CPU processor and FPGA programmable logic device.
In the above solution, the CPU, i.e. central processing unit, the FPGA, i.e. Field Programmable gate array, the Field Programmable logic gate array. The video processor adopts the programmable accelerator card based on the Arria 10GT FPGA, and puts the function to be processed in the CPU into the FPGA for running, namely, the fact to be done by the original software is done for the FPGA, so that fine adjustment can be flexibly carried out, the power consumption is lowest and the speed is fastest according to the application requirement of a user. The FPGA has natural advantages in the aspect of parallel processing, so that the FPGA is suitable for simultaneously analyzing 08/12/75 interface time sequences and protocols of multiple bottom layers in parallel; the CPU is more flexible in communication and control, so that the CPU is suitable for communication transmission, command control and the like, the video processor of the CPU + FPGA combines the capability of software and the capability of the CPU, so that more workload can be placed on the FPGA by being unloaded from the CPU, the whole network can process more workload, higher performance, higher efficiency and lower total cost can be provided, and the cache of the CPU can be optimized.
In a specific embodiment, the method further comprises: a configuration interface 4, an RAM storage module 5 and a Flash storage module 6 which are connected with the picture reconstruction module 2; a configuration interface 4, configured to receive a video interface configuration parameter corresponding to the picture reconfiguration program executed by the picture reconfiguration module 2; the RAM storage module 5 is used for caching the running data formed when the picture reconstruction module 2 executes the picture reconstruction program; and the Flash storage module 6 is used for storing the picture reconstruction program executed by the picture reconstruction module 2 and firmware data and configuration data required by the operation of the picture reconstruction program.
In the above technical solution, the configuration interface is used to receive various video interface configuration parameter information required when the program is executed.
In a specific embodiment, the method further comprises: the RAM storage module 5 is connected with the picture reconstruction module 2 and is used for caching running data formed when the picture reconstruction module 2 executes a picture reconstruction program; and the Flash storage module 6 is connected with the picture reconstruction module 2 and is used for storing the picture reconstruction program executed by the picture reconstruction module 2 and firmware data and configuration data required by the operation of the picture reconstruction program.
The RAM storage module 5 is called as: random access Memory, random access Memory.
When the picture reconstruction module 2 executes the video reconstruction program, the formed operation data includes: the video display device comprises time sequence signal data obtained by sampling video driving information, a local display picture obtained by analyzing the time sequence signal data, characteristic data information obtained from the local display picture and the like.
The Flash Memory module 6(Flash Memory) is a Non-Volatile (Non-Volatile) Memory and can hold data for a long time even without current supply.
The running program and the running data in the picture reconstruction module can be stored and reserved in time through the RAM storage module and the Flash storage module, and the program in the picture reconstruction module can be smoothly executed.
As shown in fig. 1, the display screen reconstruction device is further provided with a power supply module that performs DC-DC conversion to supply DC power to all modules or electrical components that require power. In addition, the power supply interface is also arranged and is connected with all modules or electrical components needing power utilization, and an external power supply can be connected through the power supply interface to supply power.
Example 2
The present embodiment proposes a method for reconstructing a display frame, which includes, as shown in fig. 2:
step 201, receiving a picture driving signal sent by at least one receiving card, wherein the receiving card converts the picture information output by the terminal device into a corresponding picture driving signal.
Step 202, the picture driving signal is sampled and analyzed to be a local display picture, and the local display picture is recombined to form a complete collection picture.
And step 203, outputting the complete collected picture.
In a specific embodiment, step 202 specifically includes:
step 2021, preprocessing the image driving signal, and completing sampling and recording of the image driving signal to obtain sampling recorded data, wherein the image driving signal output by each receiving card corresponds to a local image of the display screen.
Step 2022, data conversion is performed on the sampled and recorded data to form at least one partial display screen.
Step 2023, combine at least one of the partial display frames to form a complete acquisition frame.
In a specific embodiment, step 2021 specifically includes:
step 20211, receiving the frame driving signal, and performing data bit buffering on the frame driving signal.
Step 20212, preprocess the data bits to form corresponding sampled recorded data.
In a specific embodiment, step 20212 specifically includes: and acquiring a data bit cache of the cache unit, and sampling and recording the data bit cache according to a pre-configured interface driving characteristic parameter to form sampling record data.
In a specific embodiment, step 2022 specifically includes:
receiving sampling record data sent by a sampling unit, extracting time sequence signal data in the sampling record data, performing data analysis on the time sequence signal data to form a corresponding local display picture, and marking corresponding transverse and longitudinal positions in the local display picture attribute according to a relation parameter corresponding to the position of the local display picture by a pre-configured interface.
In a specific embodiment, step 2023 specifically includes:
receiving at least one local display picture sent by an analysis unit, and extracting the horizontal and vertical positions in the local display picture attribute; and carrying out position arrangement on the partial display pictures according to the transverse and longitudinal positions, and recombining at least one partial display picture into a complete acquisition picture.
Example 3
Based on the display image reconstruction device of the present embodiment, the LED screen control circuit (i.e., the display image reconstruction device) applies an LED screen driving interface (the protocol is one of driving interface protocols such as 08/12/75, etc.), samples the LED screen driving interface and reconstructs a display image, and the display image reconstruction device has general applicability.
Whether the card is a single receiving card or a plurality of receiving cards, the complete display picture can be reconstructed only by processing the display picture reconstructed by each receiving card, jigsaw puzzle or other images.
As shown in fig. 1, the hardware interface of the display screen reconstruction apparatus mainly includes:
(1) LED screen drive signal input interface (i.e., input interface 1): the LED screen driving interface is used for accessing picture driving signals of the LED screen and accessing 08/12/75 and other driving interfaces of the original equipment.
(2) Display screen drive output interface (i.e., output interface 3): for outputting the reconstructed video stream.
(3) Configuration interface 4: the bus form is accessed to the system bus, and the software configuration and the update can be carried out on the picture reconstruction module 2 in a software driving mode.
(4) A power supply interface: and the low-voltage direct-current power supply input interface provides power for the module.
The hardware components of the display picture reconstruction device mainly comprise:
(1) a power supply module: and DC-DC conversion for providing DC power supply for all the hardware of the module.
(2) The signal input driving module: and inputting a driving interface signal aiming at the display screen, and carrying out level adaptation before signal acquisition.
(3) The signal output driving module: and converting the recombined pictures into video stream signals to be output.
(4) The RAM storage module 5: for caching the operation data of the picture reconstruction module 2.
(5) The Flash storage module 6: for storing software, firmware, configuration data, etc. of the picture reconstruction module 2.
(6) And the picture reconstruction module 2: based on the CPU + FPGA, the following functions are realized: caching a driving signal; sampling a driving signal; analyzing a display picture; and recombining the display pictures.
The working logic of the picture reconstruction module 2 is described as follows:
the picture driving signal is accessed through an input interface 1, firstly the interface level is adapted through an input driving module, and then the picture reconstructing module 2 is accessed.
The hardware of the picture reconstruction module 2 is developed based on a CPU + programmable logic device FPGA. The specific functions of the picture reconstruction module 2 are realized by software programming or firmware programming, and the specific function modules comprise drive signal caching, drive signal sampling, display picture analysis and display picture recombination.
After the picture reconstruction module 2 receives the driving signal which is subjected to level conversion adaptation, the buffer unit 21 adopts corresponding signal buffer according to different protocol standards of interfaces such as 08/12/75 and the like; then, the signal is sampled by the sampling unit 22 to form a timing signal corresponding to each frame, and then the timing signal is converted into a partial display image by the analyzing unit 23, and then the partial display image is transmitted to the recombination unit 24, and at least one partial image forms a complete video frame by means of puzzle splicing and fusion, and is transmitted to the output driving module.
And the output driving module outputs the reconstructed video stream to the output interface 3 according to a standard video output protocol.
In summary, the following beneficial effects are achieved: 08/12/75 picture driving signals which are common to all display screens are collected to reconstruct a display picture, the method is applicable to all display screen types, a transmission protocol which is self-defined by any manufacturer does not need to be analyzed, the manufacturer can freely change a network transmission protocol, and the universal applicability of the method is not influenced.
Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, which may be stored in a non-volatile memory (which may be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the implementation scenarios of the present application.
Optionally, the device may also be connected to a user interface, a network interface, a camera, Radio Frequency (RF) circuitry, sensors, audio circuitry, a WI-FI module, and so forth. The user interface may include a Display screen (Display), an input unit such as a keypad (Keyboard), etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (e.g., a bluetooth interface, WI-FI interface), etc.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present application can be implemented by software plus a necessary general hardware platform, and can also be implemented by hardware.
By applying the technical scheme, the picture information output by the terminal equipment needs to be coded through the receiving card to form a picture driving signal, the picture driving signal is sent to the picture reconstruction module through the input interface, the picture driving signal is sampled and analyzed to be analyzed into at least one local display picture, the at least one local display picture is recombined to form a complete collection picture, and the complete collection picture can be directly output through the output interface. Therefore, the pictures corresponding to the receiving cards can be integrated to reconstruct the complete collected pictures, and the reconstructed collected pictures can be analyzed and processed by the video analysis device more conveniently.
Those skilled in the art will appreciate that the figures are merely schematic representations of one preferred implementation scenario and that the blocks or flow diagrams in the figures are not necessarily required to practice the present application. Those skilled in the art will appreciate that the modules in the devices in the implementation scenario may be distributed in the devices in the implementation scenario according to the description of the implementation scenario, or may be located in one or at least one device different from the present implementation scenario with corresponding changes. The modules of the implementation scenario may be combined into one module, or may be further split into at least one sub-module.
The above application serial numbers are for description purposes only and do not represent the superiority or inferiority of the implementation scenarios. The above disclosure is only a few specific implementation scenarios of the present application, but the present application is not limited thereto, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present application.

Claims (9)

1. A display screen reconstruction apparatus, comprising:
the input interface is connected with at least one receiving card and used for receiving the picture driving signals sent by the receiving card, wherein the receiving card converts the picture information output by the terminal equipment into corresponding picture driving signals;
the picture reconstruction module is connected with the input interface and used for receiving the picture driving signal sent by the input interface, sampling and analyzing the picture driving signal to obtain a local display picture, and recombining the local display picture to form a complete acquisition picture;
the output interface is connected with the picture reconstruction module and used for receiving and outputting the complete collected picture sent by the picture reconstruction module;
the picture reconstruction module comprises: the system comprises a preprocessing unit, an analysis unit and a recombination unit which are connected in sequence, wherein the preprocessing unit is connected with an input interface, and the recombination unit is connected with an output interface;
the preprocessing unit is used for preprocessing the picture driving signals sent by the input interface, completing sampling and recording of the picture driving signals and obtaining sampling recorded data, wherein the picture driving signals output by each receiving card correspond to local pictures of a display screen, and the preprocessing is to convert serial communication signals of the picture driving signals into digital signals;
the analysis unit is used for receiving at least one sampling record data sent by the preprocessing unit and performing data conversion on the sampling record data to form at least one local display picture;
the recombination unit is used for receiving at least one local display picture sent by the analysis unit and combining the at least one local display picture to form a complete acquisition picture.
2. The display screen reconstruction device according to claim 1, wherein the preprocessing unit includes: the buffer unit is arranged between the input interface and the sampling unit, and the sampling unit is connected with the analysis unit;
the buffer unit is used for receiving the picture driving signal sent by the input interface and carrying out data bit buffer on the picture driving signal;
the sampling unit is used for acquiring the data bit cache of the cache unit and preprocessing the data bit cache to form corresponding sampling record data.
3. The display screen reconstruction device according to claim 2, wherein the sampling unit is specifically configured to:
and acquiring the data bit cache of the cache unit, and sampling and recording the data bit cache according to the pre-configured interface driving characteristic parameters to form sampling record data.
4. The display screen reconstruction device according to claim 3, wherein the parsing unit is specifically configured to:
receiving sampling record data sent by the sampling unit, extracting time sequence signal data in the sampling record data, performing data analysis on the time sequence signal data to form a corresponding local display picture, and marking corresponding transverse and longitudinal positions in the local display picture attribute according to a relation parameter corresponding to the position of the local display picture by a pre-configured interface.
5. The display screen reconstruction device according to claim 4, wherein the reorganizing unit is specifically configured to:
receiving at least one local display picture sent by the analysis unit, and extracting the horizontal and vertical positions in the local display picture attribute;
and arranging the positions of the local display pictures according to the transverse and longitudinal positions, and recombining the at least one local display picture into a complete acquisition picture.
6. The apparatus according to claim 1, wherein the picture reconstructing module comprises: CPU processor and FPGA programmable logic device.
7. The display screen reconstruction device according to claim 1, further comprising: a configuration interface connected with the picture reconstruction module;
the configuration interface is used for receiving corresponding video interface configuration parameter information when the picture reconstruction module executes a picture reconstruction program.
8. The display screen reconstruction device according to claim 1, further comprising: the RAM storage module and the Flash storage module are connected with the picture reconstruction module;
the RAM storage module is used for caching running data formed when the picture reconstruction module executes the picture reconstruction program;
and the Flash storage module is used for storing the picture reconstruction program executed by the picture reconstruction module, and firmware data and configuration data required by the operation of the picture reconstruction program.
9. A method for reconstructing a display, the method comprising:
receiving a picture driving signal sent by at least one receiving card, wherein the receiving card converts picture information output by the terminal equipment into a corresponding picture driving signal;
the method comprises the following steps of sampling and analyzing a picture driving signal, analyzing the picture driving signal into a local display picture, recombining the local display picture to form a complete acquisition picture, and specifically comprising the following steps: preprocessing the picture driving signals to finish sampling and recording of the picture driving signals to obtain sampling recorded data, wherein the picture driving signals output by each receiving card correspond to local pictures of a display screen, and the preprocessing is to convert serial communication signals of the picture driving signals into digital signals; carrying out data conversion on the sampling record data to form at least one local display picture; combining at least one local display picture to form a complete acquisition picture;
and outputting the complete acquisition picture.
CN202011091609.6A 2020-10-13 2020-10-13 Display picture reconstruction device and method Active CN112379856B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011091609.6A CN112379856B (en) 2020-10-13 2020-10-13 Display picture reconstruction device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011091609.6A CN112379856B (en) 2020-10-13 2020-10-13 Display picture reconstruction device and method

Publications (2)

Publication Number Publication Date
CN112379856A CN112379856A (en) 2021-02-19
CN112379856B true CN112379856B (en) 2021-07-06

Family

ID=74581386

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011091609.6A Active CN112379856B (en) 2020-10-13 2020-10-13 Display picture reconstruction device and method

Country Status (1)

Country Link
CN (1) CN112379856B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101902654A (en) * 2010-07-22 2010-12-01 杭州爱威芯科技有限公司 Video scaling control method applied to multi-cannel video decoding chip
CN104767973A (en) * 2015-04-08 2015-07-08 北京航空航天大学 Multi-channel video real-time wireless transmission and display system and construction method
CN105761215A (en) * 2016-01-27 2016-07-13 京东方科技集团股份有限公司 Image compression method, image reconstruction method, device and system
CN109120886A (en) * 2017-06-26 2019-01-01 王芮 A kind of complete picture fusion method, device and system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685415A (en) * 2011-03-18 2012-09-19 华为终端有限公司 Method, system, device and terminal for processing video picture
CN103618869B (en) * 2013-11-25 2017-07-18 广东威创视讯科技股份有限公司 Many picture video joining methods and device
CN103686307B (en) * 2013-12-24 2017-05-10 北京航天测控技术有限公司 Digital signal processor based multi-screen splicing display device
CN103680411B (en) * 2013-12-30 2015-10-07 深圳市大族元亨光电股份有限公司 A kind of LED shows single wire transmission circuit and the method for module single point correction data
CN106652894B (en) * 2016-12-26 2018-11-30 西安诺瓦电子科技有限公司 LED display control system
CN106652893B (en) * 2016-12-26 2019-01-29 西安诺瓦电子科技有限公司 LED display control system
CN107566903B (en) * 2017-09-11 2020-07-03 北京匠数科技有限公司 Video filtering device and method and video display system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101902654A (en) * 2010-07-22 2010-12-01 杭州爱威芯科技有限公司 Video scaling control method applied to multi-cannel video decoding chip
CN104767973A (en) * 2015-04-08 2015-07-08 北京航空航天大学 Multi-channel video real-time wireless transmission and display system and construction method
CN105761215A (en) * 2016-01-27 2016-07-13 京东方科技集团股份有限公司 Image compression method, image reconstruction method, device and system
CN109120886A (en) * 2017-06-26 2019-01-01 王芮 A kind of complete picture fusion method, device and system

Also Published As

Publication number Publication date
CN112379856A (en) 2021-02-19

Similar Documents

Publication Publication Date Title
US10726299B2 (en) Sorted geometry with color clustering (SGCC) for point cloud compression
CN108933935A (en) Detection method, device, storage medium and the computer equipment of video communication system
CN105373471B (en) Detection method and device for RAM leakage loophole
CN114331820A (en) Image processing method, image processing device, electronic equipment and storage medium
US6847333B2 (en) Method of and system for low-bandwidth transmission of color video
EP3961499A1 (en) Information compression/decompression methods and apparatuses, and storage medium
CN108900830B (en) Platform for verifying accuracy of infrared video image processing algorithm
CN112001274A (en) Crowd density determination method, device, storage medium and processor
CN109660762A (en) Size figure correlating method and device in intelligent candid device
US7463750B2 (en) Image data processing apparatus and method
CN107027069B (en) Processing method, device and system, storage medium and the processor of image data
CN116016693A (en) Compression processing method and system for printing data of portable printer
US20210377548A1 (en) Video encoding and decoding system using contextual video learning
CN111263164A (en) High frame frequency video parallel coding and recombination method
CN112379856B (en) Display picture reconstruction device and method
CN116915971A (en) Quality evaluation method, device, equipment and medium for hardware-in-loop video data
US20240048716A1 (en) Image processing method and device, storage medium and electronic device
CN113489791B (en) Image uploading method, image processing method and related devices
US20210368095A1 (en) Method, apparatus, electronic device, storage medium and system for vision task execution
CN111652186A (en) Video category identification method and related device
CN111353536A (en) Image annotation method and device, readable medium and electronic equipment
CN101247474B (en) Image processing device and method
CN201044472Y (en) Image processing device
JPH07210127A (en) Method of processing color image
CN115361570B (en) Video data reorganization method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant