CN111182235B - Method, device, computer device and storage medium for recording spliced screen pictures - Google Patents
Method, device, computer device and storage medium for recording spliced screen pictures Download PDFInfo
- Publication number
- CN111182235B CN111182235B CN201911233968.8A CN201911233968A CN111182235B CN 111182235 B CN111182235 B CN 111182235B CN 201911233968 A CN201911233968 A CN 201911233968A CN 111182235 B CN111182235 B CN 111182235B
- Authority
- CN
- China
- Prior art keywords
- data
- screen
- recording
- image
- returned data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a method, equipment, computer equipment and a storage medium for recording a spliced screen picture, wherein screen recording parameters are acquired, a data sending thread and a data receiving thread are established according to the screen recording parameters, a shared buffer memory corresponding to the data sending thread is distributed, frame extraction and scaling are carried out on a target video of a single screen according to the screen recording parameters to obtain return data, the return data are sent through the data sending thread, the return data are received through the data receiving thread, the return data have serial numbers corresponding to the single screen one by one, the return data are fused to obtain video data, the video data are stored according to a preset path, the fusion comprises framing, frame synchronization verification and coding, the problems that the operation is complex and the cost is high due to the fact that hardware is needed to be added for recording the spliced screen picture are solved, and the method realizes the recording of a spliced screen fused image from a software level, additional hardware resources are not needed, and the cost is reduced.
Description
Technical Field
The present application relates to the field of display technologies, and in particular, to a method, an apparatus, a computer apparatus, and a storage medium for recording a picture on a tiled display.
Background
Along with the development of display technology, the spliced screen has appeared in daily life, and the spliced screen is a complete liquid crystal spliced display unit, has advantages such as super long life-span, big and the resolution ratio height of visual angle, and along with the development of spliced screen technique, the use of spliced screen in daily life is more and more extensive, and the user is also more and more to the requirement of spliced screen display content and display mode. On the other hand, in various situations such as a public security command center, a building control monitoring center, and the like, a user needs to record and store the display content after the comprehensive layout of the spliced screens, that is, the screen recording with multi-screen splicing.
In the related art, one recording method is that a screen recording system records a single-channel signal, and a signal to be displayed and the recorded signal are copied and distributed through a signal distributor, and in the case of realizing a large-scale screen splicing scheme, the method needs to package and record the output signal of the distributor, so that the complexity is increased in multiples; the other recording method is to record images in a control range in a mode of networking by an additional screen node signal machine and collecting the images to a control computer, and has the advantages of high cost, low efficiency, high complexity and high operability difficulty.
Aiming at the problems of complex operation and high cost caused by the fact that hardware needs to be added for recording the spliced screen pictures in the related technology, an effective solution is not provided at present.
Disclosure of Invention
The invention provides a method, equipment, computer equipment and a storage medium for recording a spliced screen picture, aiming at the problems of complex operation and high cost caused by the fact that hardware is required to be added for recording the spliced screen picture in the related art, and at least solves the problems.
According to an aspect of the present invention, a method for recording a spliced screen picture is provided, and the method includes:
acquiring screen recording parameters, creating a data sending thread and a data receiving thread according to the screen recording parameters, and allocating a shared buffer memory corresponding to the data sending thread;
frame extraction and scaling are carried out on a target video of a single screen according to the screen recording parameters to obtain return data, the return data are sent through the data sending thread, and the return data are received through the data receiving thread, wherein the return data have serial numbers corresponding to the single screens one to one;
and fusing the returned data to obtain video data, and storing the video data according to a preset path, wherein the fusing comprises framing, frame synchronization check and coding.
In one embodiment, the frame extraction and scaling of the single-screen target video according to the screen recording parameter to obtain the return data, the sending of the return data by the data sending thread, and the receiving of the return data by the data receiving thread includes:
and the recording of the target video is completed in a plurality of display periods, wherein a frame extraction rate is determined according to the screen recording parameters, and the number of the display periods is determined according to the frame extraction rate.
In one embodiment, the fusing the backhaul data includes:
after the frame grouping is carried out on the returned data, the frame synchronization check is carried out, whether the returned data is the same frame image or not is judged according to the frame synchronization check result, wherein the frame grouping comprises the step of determining the position of the returned data in the video data according to the serial number of the returned data;
under the condition that the returned data are not the same frame image, judging that the returned data are a leading image or a lagging image;
and under the condition that the returned data is the leading image, discarding the returned data, and under the condition that the returned data is the lagging image, acquiring the image data of the previous frame of the returned data.
In one embodiment, the fusing the returned data to obtain the video data includes:
under the condition that the number of the returned data is consistent with that of the single screens, fusion is considered to be completed, and under the condition that the fusion is completed within a preset time period, the returned data is coded to obtain video data;
and under the condition that the fusion is not completed within the preset time period, discarding the returned data and carrying out the fusion of the next frame.
In one embodiment, after the acquiring of the screen recording parameters, the method includes:
and performing format conversion on the screen recording parameters according to the bottom layer recognition language to obtain conversion parameters, and creating a data receiving thread according to the conversion parameters.
According to another aspect of the present invention, an apparatus for recording a picture on a tiled screen is provided, where the apparatus includes an acquisition module, a transmission module, and a fusion module:
the acquisition module is used for acquiring screen recording parameters, creating a data sending thread and a data receiving thread according to the screen recording parameters, and distributing a shared buffer memory corresponding to the data sending thread;
the transmission module is used for performing frame extraction and scaling on a target video of a single screen according to the screen recording parameters to obtain return data, sending the return data through the data sending thread, and receiving the return data through the data receiving thread, wherein the return data has serial numbers corresponding to the single screens one to one;
and the fusion module is used for fusing the returned data to obtain video data, and storing the video data according to a preset path, wherein the fusion comprises framing, frame synchronization check and coding.
In one embodiment, the transmission module further comprises a control unit:
the control unit is used for controlling the recording of the target video to be completed in a plurality of display periods, wherein a frame extraction rate is determined according to the screen recording parameters, and the number of the display periods is determined according to the frame extraction rate.
In one embodiment, the fusion module includes a checking unit, a judging unit and a processing unit:
the checking unit is configured to perform the frame synchronization check after the framing is performed on the returned data, and determine whether the returned data is a same frame image according to the frame synchronization check result, where the framing includes determining a position of the returned data in the video data according to the serial number of the returned data;
the judging unit is used for judging whether the returned data is a leading image or a lagging image under the condition that the returned data is not the same frame image;
the processing unit is configured to discard the returned data when the returned data is the leading image, and acquire image data of a previous frame of the returned data when the returned data is the lagging image.
According to another aspect of the present invention, there is provided a computer device comprising a memory storing a computer program and a processor implementing any of the methods described above when the processor executes the computer program.
According to another aspect of the invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements any of the methods described above.
According to the method, the screen recording parameters are obtained, the data sending thread and the data receiving thread are created according to the screen recording parameters, the shared buffer memory corresponding to the data sending thread is distributed, frame extraction and scaling are performed on the target video of the single screen according to the screen recording parameters to obtain the return data, the return data are sent through the data sending thread, the return data are received through the data receiving thread, the return data have serial numbers corresponding to the single screen one by one, the return data are fused to obtain the video data, and the video data are stored according to the preset path.
Drawings
Fig. 1 is a schematic diagram of an application environment of a method for splicing screen picture recording according to an embodiment of the present invention;
FIG. 2 is a first flowchart of a method for splicing screen picture recording according to an embodiment of the present invention;
FIG. 3 is a flowchart II of a method for splicing screen picture recording according to an embodiment of the present invention;
fig. 4 is a flowchart three of a method for splicing screen picture recording according to an embodiment of the present invention;
FIG. 5 is a block diagram of a first embodiment of an apparatus for tiled screen image recording according to the present invention;
FIG. 6 is a block diagram of a second embodiment of an apparatus for splicing screen picture recording according to the present invention;
fig. 7 is a block diagram of a third structure of a device for splicing screen picture recording according to an embodiment of the present invention;
FIG. 8 is a fourth flowchart of a method for tiled screen picture recording according to an embodiment of the present invention;
FIG. 9 is a schematic data flow diagram of a tiled display screen image recording according to an embodiment of the present invention;
FIG. 10 is a flow chart of a display cycle of single screen data processing according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of a tiled screen picture fusion process according to an embodiment of the present invention;
fig. 12 is a schematic diagram of an apparatus for mosaic screen picture recording according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The method for recording the spliced screen picture provided by the present application can be applied to the application environment shown in fig. 1, and fig. 1 is an application environment schematic diagram of the method for recording the spliced screen picture according to the embodiment of the present invention, wherein the spliced screen terminal 102 communicates with the server 104 through a network. The server 104 acquires the video recording parameters from the terminal 102, and performs frame extraction, scaling and fusion on the image data from the single screen to obtain video recording data. The terminal 102 may be a liquid crystal tiled screen, a plasma tiled screen, a Digital Light Processing (DLP), a transparent screen, etc., and may be used in combination with auxiliary materials such as a tiled processor, a central control High Definition Multimedia Interface (HDMI) matrix, and an HDMI distributor, etc. to achieve the use of the whole system, and the server 104 may be implemented by an independent server or a server cluster composed of a plurality of servers.
In an embodiment, a method for recording a picture on a mosaic screen is provided, and fig. 2 is a first flowchart of the method for recording a picture on a mosaic screen according to the embodiment of the present invention, as shown in fig. 2, the method includes the following steps:
step S202, screen recording parameters are obtained, a data sending thread and a data receiving thread are created according to the screen recording parameters, a shared buffer memory corresponding to the data sending thread is allocated, the screen recording parameters comprise sectional coordinates, a video area, video resolution, a screen scaling ratio, a video data storage format and the like which are set by a user according to needs, and the data sending thread and the data receiving thread are created according to the video resolution.
Step S204, frame extraction and scaling are carried out on the target video of the single screen according to the screen recording parameters to obtain return data, the return data are sent through the data sending thread, and the return data are received through the data receiving thread, wherein optionally, the target video is a high-definition image, the frame rate is 60 frames, the video data are 25 frames or 30 frames, therefore, frame reduction needs to be carried out on the target video through the frame extraction process, in addition, due to the fact that the size of a spliced screen formed by splicing a plurality of single screens is different from the size of a recorded image, scaling needs to be carried out on the image of the target video, in addition, each single screen has a number, and after the target video of the single screen is obtained, the return data obtained by frame extraction and scaling of the target video have serial numbers which correspond to the single screens one to one.
And step S206, fusing the returned data to obtain video data, and storing the video data according to a preset path, wherein the fusing comprises framing, frame synchronization checking and encoding, the framing is to combine a frame of image of all target videos into a complete image of the spliced screen, the frame synchronization checking is to check whether each image is an image of the same frame, and the encoding is to convert the format of the video data so as to store and play the video data.
Through the steps S202 to S206, after the target video of a single screen is obtained, frame extraction and scaling are performed on the target video to obtain the return data, and the return data is fused to obtain the video data.
In one embodiment, the frame extraction and scaling of the single-screen target video according to the screen recording parameters to obtain the return data, the sending of the return data by the data sending thread, and the receiving of the return data by the data receiving thread further include: the recording of the target video is completed in a plurality of Display periods, wherein in the Display period, the loading of the normal service is also required, the normal service includes an On Screen Display (OSD), a Graphical User Interface (GUI), and the like, the normal service and the framing, scaling, and returning of the target video are performed at the start time of one Display period, in addition, the frame extraction rate is determined according to the Screen recording parameters, the number of the Display periods is determined according to the frame extraction rate, for example, in the case of lowering the video from 60 frames to 20 frames, the framing, scaling, and returning of the normal service, the target video are allocated in 3 Display periods, in the case of lowering the video from 60 frames to 30 frames, the framing, scaling, returning, and allocating of the normal service, the target video are performed in 2 Display periods, the method provided in this embodiment allocates the processing of the target video to be completed in a plurality of Display periods, the contention for resources such as memory, data transmission lines and the like is reduced, and the fault condition during reading and writing is further reduced.
In an embodiment, fig. 3 is a flowchart of a method for recording a picture on a tiled screen according to an embodiment of the present invention, as shown in fig. 3, the method includes the following steps:
step S302, after framing the returned data, performing frame synchronization check, and judging whether the returned data is the same frame image according to a frame synchronization check result, wherein the framing comprises determining the position of the returned data in the video data according to the serial number of the returned data, the frame synchronization check is to judge whether each returned data belongs to the same frame according to the header information of each frame data, the header information comprises a frame serial number and a time stamp, under the condition that the header information of each returned data is consistent, each returned data is considered to belong to the same frame, and under the condition that the header information of each returned data is inconsistent, each returned data is considered not to belong to the same frame.
Step S304, judging whether the returned data is a leading image or a lagging image when the returned data is not the same frame of image, regarding the returned data with the time stamp inconsistent with the prior time stamp as abnormal data, and judging the chronological sequence of the abnormal data and other returned data according to the time stamp, wherein for example, the image corresponding to the abnormal data is called the lagging image when the time stamp of the abnormal data is 1:50:30 and the prior time stamp is 1:50:36, and the image corresponding to the abnormal data is called the leading image when the time stamp of the abnormal data is 1:50:30 and the prior time stamp is 1:50: 20.
Step S306, discarding the returned data when the returned data is a leading image, and acquiring the image data of the previous frame of the returned data when the returned data is a lagging image.
Through the above steps S302 to S306, it is determined whether each returned data belongs to the same frame of image according to the frame header information, the returned data is discarded if the returned data is a leading image, and the previous frame of image data of the returned data is obtained if the returned data is a lagging image, thereby ensuring the synchronization and integrity of the video data.
In an embodiment, fig. 4 is a flowchart three of a method for recording a picture on a tiled screen according to an embodiment of the present invention, as shown in fig. 4, the method includes the following steps:
step S402, under the condition that the number of the returned data is consistent with the number of the single screens, fusion is considered to be completed, under the condition that fusion is completed within a preset time period, the returned data is encoded to obtain video data, the number of the received returned data is recorded while the returned data is received, the number is compared with the preset number of the single screens, the preset time period is time limit of the fusion process and can be 1 second or other time periods, for example, under the condition that the preset time period is 1 second, within 1 second, the number of the received returned data is consistent with the number of the single screens, fusion is considered to be completed, and the returned data is encoded.
Step S404, discarding the returned data and performing the next frame fusion if the fusion is not completed within the preset time period, for example, if the preset time period is 1 second, and the number of the received returned data is less than the number of single screens within 1 second, it is considered that the fusion is not completed, discarding all the returned data of the frame, and starting the next frame fusion.
Through the above steps S402 and S404, whether the fusion of the returned data of one frame is completed is determined by comparing and judging the number of returned data and the number of single screens within a preset time period, so that the integrity of the screen is improved in the process of splicing screen image fusion.
In one embodiment, after screen recording parameters are obtained, format conversion is carried out on the screen recording parameters according to a bottom layer identification language to obtain conversion parameters, a data receiving thread is established according to the conversion parameters, in the process of recording the spliced screen picture, due to the fact that the computer language and the coordinate resolution are different, the format of the screen recording parameters input by a user is different from the format of the parameters which can be identified by a bottom layer algorithm, through the format conversion of the screen recording parameters, the identification of parameters by a bottom layer module is facilitated, and the efficiency of recording the spliced screen picture is improved.
It should be understood that, although the steps in the flowcharts of fig. 2 to 4 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-4 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.
Corresponding to the method for recording the spliced screen picture, in this embodiment, an apparatus for recording the spliced screen picture is further provided, and the apparatus is used to implement the above embodiments and preferred embodiments, and is not described again after having been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware or a combination of software and hardware are also possible and contemplated.
In an embodiment, an apparatus for recording a picture on a tiled screen is provided, and fig. 5 is a first block diagram of the apparatus for recording a picture on a tiled screen according to the embodiment of the present invention, as shown in fig. 5, including: an acquisition module 52, a transmission module 54, and a fusion module 56, wherein:
the obtaining module 52 is configured to obtain a screen recording parameter, create a data sending thread and a data receiving thread according to the screen recording parameter, and allocate a shared buffer memory corresponding to the data sending thread;
the transmission module 54 is configured to perform frame extraction and scaling on a single-screen target video according to the screen recording parameter to obtain returned data, send the returned data through the data sending thread, and receive the returned data through the data receiving thread, where the returned data have serial numbers corresponding to the single screens one to one;
and the fusion module 56 is configured to fuse the returned data to obtain video data, and store the video data according to a preset path, where the fusion includes framing, frame synchronization check and encoding.
Through the above device, after the obtaining module 52 obtains a single-screen target video, the processing module 54 performs frame extraction and scaling on the target video to obtain return data, and the fusion module 56 performs fusion on the return data to obtain video data.
In an embodiment, fig. 6 is a block diagram of a second structure of an apparatus for recording a picture on a mosaic screen according to an embodiment of the present invention, and as shown in fig. 6, the transmission module 54 includes a control unit 62: and the control unit 62 is configured to control the recording of the target video to be completed in a plurality of display periods, where a frame rate is determined according to the screen recording parameters, and the number of the display periods is determined according to the frame rate. The device provided by the embodiment can distribute the processing of the target video to be completed in a plurality of display periods, thereby reducing the contention for resources such as memory, data transmission lines and the like and further reducing the fault occurrence during reading and writing.
In an embodiment, fig. 7 is a block diagram of a third structure of a device for recording a picture on a mosaic screen according to an embodiment of the present invention, and as shown in fig. 7, the fusion module 56 includes a verification unit 72, a judgment unit 74, and a processing unit 76:
the checking unit 72 is configured to perform frame synchronization checking after framing the returned data, and determine whether the returned data is a same frame image according to a frame synchronization checking result, where framing includes determining a position of the returned data in the video data according to a serial number of the returned data;
a judging unit 74 for judging whether the return data is a leading image or a lagging image in the case where the return data is not the same frame image;
the processing unit 76 is configured to discard the returned data if the returned data is a leading image, and obtain the image data of the previous frame of the returned data if the returned data is a lagging image.
In the apparatus provided in this embodiment, the checking unit 72 determines whether each returned data belongs to the same frame of image according to the frame header information, the determining unit 74 determines that the returned data is an advanced image or a delayed image, the processing unit 76 discards the returned data if the returned data is an advanced image, and acquires the image data of the previous frame of the returned data if the returned data is a delayed image, thereby ensuring the synchronization and integrity of the recorded data.
The following describes an embodiment of the present invention in detail with reference to an actual application scenario, and when a splicing screen picture is recorded, fig. 8 is a fourth flowchart of a method for recording a splicing screen picture according to an embodiment of the present invention, as shown in fig. 8, the method includes the following steps:
step S802, acquiring a video data storage path set by a user, initializing, creating a data sending thread and a data receiving thread, and allocating a shared buffer memory corresponding to the data sending thread, wherein the data receiving thread may be a Peripheral Component Interconnect Express (PCIE or PCI-Express);
step S804, acquiring screen recording parameters and starting screen recording, wherein the screen recording parameters comprise a matting coordinate, a screen recording area, a resolution ratio after screen recording, a scaling ratio, a video file format and the like;
step 806, reversely zooming the output screen image to a specified ratio by the chip where each single screen of the bottom layer is located, and transmitting the output screen image back to the server through the PCIE, wherein the server waits for the transmitted back data transmitted back by the board card where each single screen of the bottom layer is located;
step S808, framing the returned data, judging whether framing is finished, performing frame synchronization check and coding on the returned data under the condition that framing is finished to obtain video data, continuously waiting for the returned data under the condition that framing is not finished and does not exceed a preset time period, discarding the returned data of the frame under the condition that framing is not finished within the preset time period, and receiving the returned data of each single screen of the next frame;
step S810, obtaining a final video data write file by using the cached pointer function (Get Buffer), and writing the file to a designated hard disk storage area according to user configuration.
Through the steps S802 to S810, after a single-screen target video is obtained, frame extraction and scaling are performed on the target video to obtain return data, the return data is fused to obtain video data, the method for recording a spliced screen picture provided by this embodiment is completely implemented by software, and is implemented based on a Field Programmable Gate Array (FPGA) and an embedded processor Nios, and a PCIE architecture is adopted, so that no additional hardware resource is needed, the problem that the operation is complicated and the cost is high due to the fact that hardware needs to be added for recording the spliced screen picture is solved, the recording cost of the spliced screen picture is reduced, the spliced screen picture recording is implemented by software, the portability is high, the expansion and maintenance of the spliced screen are more convenient, and the method provided by this embodiment also has reference significance for systems of other architectures.
In an embodiment, fig. 9 is a schematic data flow diagram of a picture recording of a tiled screen according to an embodiment of the present invention, as shown in fig. 9, a single-screen complete output is composed of a video layer and a GUI layer, the video layer includes a plurality of windows representing a single screen, the GUI layer includes a plurality of OSDs, the server scales and returns video data of the plurality of windows, and the scaled video is written back to the display unit for display.
In one embodiment, fig. 10 is a flow chart of a display cycle of single-screen data processing according to an embodiment of the present invention, as shown in fig. 10, the method includes the following steps:
step S1002, loading conventional services, wherein the conventional services comprise services of a window, an OSD (on screen display) and other video layers and a GUI (graphical user interface) layer;
step S1004, the target video is zoomed and then written back to a display unit for displaying;
step S1006, frame extraction, scaling and returning are carried out on the target video;
step S1008, the next regular service is started.
Through the steps S1002 to S1006, the flow of controlling a plurality of single screens in the recording process is simplified, and the situations of reading and writing faults are reduced, in the method provided in this embodiment, the conventional service and the frame extraction, scaling and returning of the target video can be performed at the start time of one display period, and the task of processing the target video can be distributed to a plurality of display periods as shown in fig. 9, so as to reduce contention for resources such as memory and data transmission lines, and further reduce the situations of reading and writing faults.
In an embodiment, fig. 11 is a schematic diagram of a splicing screen image fusion process according to an embodiment of the present invention, and as shown in fig. 11, framing is performed on returned data, whether framing is completed is determined, and when framing is completed, frame synchronization check and encoding are performed on the returned data to obtain video data, and when framing is not completed and does not exceed a preset time period, the returned data continues to wait for, and when framing is not completed within the preset time period, the returned data of the current frame is discarded, and the returned data of each single screen of the next frame is received, so that synchronization and integrity of the video data are ensured.
In one embodiment, fig. 12 is a schematic diagram of an apparatus for splicing screen picture recording according to an embodiment of the present invention, as shown in fig. 12, including an application processing module 1202, a system conversion processing module 1204, and an image display processing module 1206: the application processing module 1202 collects videos and configures parameters, the system conversion processing module 1204 receives the parameters and performs parameter conversion, data link creation and flow construction, the image display processing module 1206 scales screen images and transmits the scaled screen images back to the system conversion processing module 1204, the system conversion processing module 1204 receives the transmitted data and transmits the data to the application processing module 1202 after packaging and encoding, and the application processing module 1202 acquires encoded video data and stores the video data as a video file.
In one embodiment, a computer device is provided. The computer device may be a server. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing image data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method for mosaic screen picture recording.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method for mosaic screen picture recording. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
In one embodiment, a computer device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the steps in the method for recording the pictures of the mosaic screen provided in the foregoing embodiments.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program is executed by a processor to implement the steps in the method for recording the picture of the spliced screen provided in the above embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not to be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.
Claims (10)
1. A method for recording spliced screen pictures, comprising:
acquiring screen recording parameters, creating a data sending thread and a data receiving thread according to the screen recording parameters, and allocating a shared buffer memory corresponding to the data sending thread;
the image display processing module performs frame extraction and scaling on a target video of a single screen according to the screen recording parameters to obtain return data, the return data is sent through the data sending thread, and the return data is received through the data receiving thread, wherein the return data has serial numbers corresponding to the single screens one to one; the image display processing module comprises a field programmable logic gate array and an embedded processor Nios;
and fusing the returned data to obtain video data, and storing the video data according to a preset path, wherein the fusing comprises framing, frame synchronization check and coding.
2. The method for splicing screen picture recording according to claim 1, wherein the step of performing frame extraction and scaling on the target video of a single screen according to the screen recording parameters to obtain the return data, the step of sending the return data through the data sending thread, and the step of receiving the return data through the data receiving thread comprises:
and the recording of the target video is completed in a plurality of display periods, wherein a frame extraction rate is determined according to the screen recording parameters, and the number of the display periods is determined according to the frame extraction rate.
3. The method for tiled screen picture recording according to claim 1, wherein the fusing the return data comprises:
after the frame grouping is carried out on the returned data, the frame synchronization check is carried out, whether the returned data is the same frame image or not is judged according to the frame synchronization check result, wherein the frame grouping comprises the step of determining the position of the returned data in the video data according to the serial number of the returned data;
under the condition that the returned data are not the same frame image, judging that the returned data are a leading image or a lagging image;
and under the condition that the returned data is the leading image, discarding the returned data, and under the condition that the returned data is the lagging image, acquiring the image data of the previous frame of the returned data.
4. The method for spliced-screen image recording according to claim 1, wherein the fusing the returned data to obtain the recorded data comprises:
under the condition that the number of the returned data is consistent with that of the single screens, fusion is considered to be completed, and under the condition that the fusion is completed within a preset time period, the returned data is coded to obtain video data;
and under the condition that the fusion is not completed within the preset time period, discarding the returned data and carrying out the fusion of the next frame.
5. The method for spliced screen picture recording according to any one of claims 1 to 4, wherein after the screen recording parameters are obtained, the method comprises:
and carrying out format conversion on the screen recording parameters according to the bottom layer identification language to obtain conversion parameters, and creating a data receiving thread according to the conversion parameters.
6. The equipment for recording the spliced screen picture is characterized by comprising an acquisition module, an image display processing module and a fusion module:
the acquisition module is used for acquiring screen recording parameters, creating a data sending thread and a data receiving thread according to the screen recording parameters, and distributing a shared buffer memory corresponding to the data sending thread;
the image display processing module is used for performing frame extraction and scaling on a target video of a single screen according to the screen recording parameters to obtain return data, sending the return data through the data sending thread, and receiving the return data through the data receiving thread, wherein the return data has serial numbers corresponding to the single screens one to one; the image display processing module comprises a field programmable gate array and an embedded processor Nios;
and the fusion module is used for fusing the returned data to obtain video data, and storing the video data according to a preset path, wherein the fusion comprises framing, frame synchronization check and coding.
7. The apparatus for tiled screen picture recording according to claim 6, wherein the image display processing module further comprises a control unit:
the control unit is used for controlling the recording of the target video to be completed in a plurality of display periods, wherein a frame extraction rate is determined according to the screen recording parameters, and the number of the display periods is determined according to the frame extraction rate.
8. The device for splicing screen picture recording according to claim 6, wherein the fusion module comprises a verification unit, a judgment unit and a processing unit:
the checking unit is configured to perform the frame synchronization check after the framing is performed on the returned data, and determine whether the returned data is a same frame image according to the frame synchronization check result, where the framing includes determining a position of the returned data in the video data according to the serial number of the returned data;
the judging unit is used for judging whether the returned data is a leading image or a lagging image under the condition that the returned data is not the same frame image;
the processing unit is configured to discard the returned data when the returned data is the leading image, and acquire image data of a previous frame of the returned data when the returned data is the lagging image.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor when executing the computer program performs the steps of the method according to any of claims 1 to 5.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911233968.8A CN111182235B (en) | 2019-12-05 | 2019-12-05 | Method, device, computer device and storage medium for recording spliced screen pictures |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911233968.8A CN111182235B (en) | 2019-12-05 | 2019-12-05 | Method, device, computer device and storage medium for recording spliced screen pictures |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111182235A CN111182235A (en) | 2020-05-19 |
| CN111182235B true CN111182235B (en) | 2022-05-20 |
Family
ID=70653831
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911233968.8A Active CN111182235B (en) | 2019-12-05 | 2019-12-05 | Method, device, computer device and storage medium for recording spliced screen pictures |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111182235B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929583B (en) * | 2021-05-10 | 2021-07-23 | 北京小鸟科技股份有限公司 | Method and system for synchronously recording and replaying original signal source based on large-screen window |
| CN115734021A (en) * | 2021-08-30 | 2023-03-03 | 华为技术有限公司 | Screen recording method, electronic equipment and computer readable storage medium |
| CN114189730B (en) * | 2021-11-04 | 2023-12-19 | 北京淳中科技股份有限公司 | Video recording method, video playback method and device |
| CN114257844B (en) * | 2021-12-21 | 2023-01-06 | 威创集团股份有限公司 | Multi-video synchronous playing method, device, equipment and readable storage medium |
| CN114615539A (en) * | 2022-03-29 | 2022-06-10 | 西安超越申泰信息科技有限公司 | Multi-display screen recording playback method, computer and readable medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3530559B2 (en) * | 1993-12-07 | 2004-05-24 | オリンパス株式会社 | Image information handling equipment |
| CN101533179B (en) * | 2003-09-04 | 2011-01-05 | 富士通株式会社 | Display element drive method |
| KR101572665B1 (en) * | 2014-03-19 | 2015-11-27 | 소프트상추 주식회사 | Security system to supply screen watch information to prepare information leak and method thereof |
| CN109656494A (en) * | 2017-10-12 | 2019-04-19 | 阿里巴巴集团控股有限公司 | The management method of content is shown in Mosaic screen |
| CN108924452A (en) * | 2018-06-12 | 2018-11-30 | 西安艾润物联网技术服务有限责任公司 | Part record screen method, apparatus and computer readable storage medium |
-
2019
- 2019-12-05 CN CN201911233968.8A patent/CN111182235B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111182235A (en) | 2020-05-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111182235B (en) | Method, device, computer device and storage medium for recording spliced screen pictures | |
| US20220038724A1 (en) | Video stream decoding method and apparatus, terminal device, and storage medium | |
| CN106060622B (en) | The screenshotss method and TV of TV | |
| CN109618225B (en) | Video frame extraction method, device, equipment and medium | |
| CN111190558A (en) | Screen projection control method and device, computer readable storage medium and computer equipment | |
| US20230405479A1 (en) | Data processing method and apparatus, device and storage medium | |
| CN111741246B (en) | Video storage method, device, SOC system and medium | |
| US10944920B2 (en) | Video switching method, device and video patrol system | |
| CN112532896A (en) | Video production method, video production device, electronic device and storage medium | |
| CN113658219A (en) | High-altitude parabolic detection method, device and system, electronic device and storage medium | |
| CN111918098A (en) | Video processing method and device, electronic equipment, server and storage medium | |
| CN109089120B (en) | Analysis-aided encoding | |
| US9137587B2 (en) | System event assisted live keyboard, video and mouse (KVM) capture | |
| CN113938587A (en) | Shooting and recording method based on double cameras and electronic equipment | |
| CN109597595A (en) | Control method, device, computer equipment and the storage medium of liquid crystal display | |
| CN107506119A (en) | Picture display method, device, equipment and storage medium | |
| CN107241608A (en) | A kind of hardware fault-tolerant method and apparatus decompressed for frame buffer | |
| CN111522476A (en) | Method, device, computer device and storage medium for monitoring window switching | |
| CN113645484B (en) | Data visualization accelerated rendering method based on graphic processor | |
| CN111143117A (en) | Data storage method and device | |
| CN113672326A (en) | Application window screen recording method and device, terminal equipment and storage medium | |
| CN110888682A (en) | Display method and device and electronic equipment | |
| CN102185874B (en) | Method and device for processing commands based on iSCSI (internet small computer system interface) | |
| CN118301360A (en) | Data transmission method, terminal equipment and server | |
| CN115243098B (en) | Screen recording method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |