KR101833644B1 - System and Method for recording screen shot combined with event information, graphic information, and template image - Google Patents

Abstract

The present invention relates to a screen recording technology and, more specifically, to a screen recording system and a method thereof which time-synchronize, integrate and record graphic information, event information and a template image, wherein the graphic information is for determining whether a system operation is proper, the event information is extracted from the graphic information, and expectation actions for possible operation problems and/or system defects are reflected to the template image. According to the present invention, the method enables an accurate result analysis compared to an existing method for manually checking a graphic information state of an abnormal situation by a textbook, a manual or speaking.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a screen recording system and method for combining event information,

The present invention relates to a screen recording technology, and more particularly, to a screen recording technology in which graphical information capable of determining suitability of a system operation, event information extracted therefrom, operational problems that can be generated, and / And more particularly, to a screen recording system and method for synchronizing and recording time-synchronized template images.

The present invention also relates to a screen recording system and method capable of performing accurate post-analysis on the operation result, performing accurate countermeasure and / or maintenance according to the result, and applicable to various induction weapon training equipments.

In the prior art, graphic information was recorded for management and / or system abnormality, and the event file was separately managed. A drawing showing this is shown in Fig. 1 and Fig. 1 is an event information screen recorder data structure 100 according to a general technique, and FIG. 2 is a graphic information screen recorder data structure 200 according to a general technique.

Therefore, manuals or manuals should be referenced manually for corrective actions and / or training against abnormal situations, and verbal or graphical information status should be verified.

In this way, there is a problem in that the normal operating state of the graphic information that operates abnormally at the time point can not be visually confirmed. Further, since the expected image and / or the maintenance method for the image must be manually searched, accurate post-analysis at the time and / or a countermeasure and / or maintenance thereof are limited.

In addition, in case of separately managing the expected image for the operational problem and / or the system defect, it is very inconvenient to operate the system because it requires to refer to different screens which are not synchronized in time for the purpose of system operation in the same system, There is a problem that maintenance costs are increased.

1. Korean Patent Laid-Open No. 10-2014-0028616 (entitled "Screen Recording System and Method and Apparatus in Terminal, and Recording Medium Saving Program Source for the Method")

1. Shin, Jung-sik, "Development of Instructor-Tracked Unattended Recording System Using Motion Detection Algorithm in Real-Time Video Information,"

The present invention has been proposed in order to solve the problem according to the above background art, and it is an object of the present invention to provide an information processing apparatus, And to provide a screen recording system and method capable of recording a template image that reflects an expected motion of the template image in synchronization with time synchronization.

Also, the present invention provides a screen recording system and method that can perform accurate post-analysis on the operation result, perform accurate countermeasure and / or maintenance according to the result, and applicable to various induction weapon training equipments. There is a purpose.

In order to achieve the above-described object, the present invention provides an information processing system including graphic information capable of determining suitability of a system operation, event information extracted therefrom, and an expected operation that can be generated and / The present invention also provides a screen recording system and method capable of recording and synchronizing template images in time synchronization.

The screen recording system and method may include:

An event information management module for generating event information by first input information programmed by a user;

A graphic information management module for generating graphic information by second input information programmed by a user;

A template image management module for generating a template image by third input information programmed by a user based on the event information;

A time schedule module for generating time information by performing time synchronization on the event information, the graphic information, and the template image; And

And an image management module for synthesizing the time information, the event information, the graphic information, and the template image to generate a recorded image.

In this case, the event information management module may include first synthesis information for synchronizing the template image with the template image, and event output information for reproducing the template image.

In addition, the graphic information management module may set a recording area, a screen resolution, a recording speed, and a bit rate according to an input of a user, and may add second composition information for time synchronization with the template image to the graphic information And the like.

The template image managing module generates a synthesized template image by including first synthesis information in the template image, and the synthesized template image is reproduced as a template image by receiving a reproduction signal from the event information .

Also, the image management module may include an information input unit for receiving the event information, the graphic information, the template image information, and the time information; An image synthesizer for synthesizing the time information, the event information, the graphic information, and the template image to generate a recording image; And an image output unit for outputting the recorded image.

The image synthesizer may further include: a synthesis module for synthesizing the time information, the event information, the graphic information, and the template image to generate a synthesized image; And an encoder for encoding the synthesized image to generate a recorded image.

The image synthesizer may further include: an image input unit for inputting the recorded image; A decoder for decoding the recorded image and converting the decoded image into a synthesized image; And a division module for separating the synthesized image into the time information, event information, graphic information, and template image information.

In addition, the recorded image may be output as RGB content corresponding to a file or a screen resolution.

The data structure of the recorded image may include a header field having identification information based on the time synchronization, an event information field having event information, a graphic information field having graphic information, and a template image data field having template image information sequentially As shown in FIG.

On the other hand, another embodiment of the present invention is a method of generating event information, comprising the steps of: generating event information by first input information programmed by a user; The graphic information management module generating graphic information by second input information which is programmed by the user; The template image management module generating a template image based on third input information that is programmed by a user based on the event information; Generating time information by performing time synchronization on the event information, the graphic information, and the template image by the time schedule module; And a step of generating a recording image by combining the time information, the event information, the graphic information, and the template image by the image management module, and a screen recording method combining the event information, the graphic information, and the template image can do.

 According to the present invention, there is provided a method for reproducing a template image in which an expected image for action and maintenance is synchronized with graphic information on operational problems or system defects and event information extracted therefrom in time synchronization, Accurate results analysis is possible compared to the conventional method which requires manually checking the status of the graphical information by manual, manual, or verbal.

Further, as another effect of the present invention, it is possible to provide precise instructions for the system error and the post-implementation plan for the error correction contents of the operator, thereby enabling precise countermeasures and maintenance thereof and greatly enhancing the operational convenience have.

Another advantage of the present invention is that the inefficient use and maintenance of resources for separately operating a template image can be reduced.

1 is an event information screen recorder data structure 100 according to a general technique.
FIG. 2 is a graphic information screen recorder data structure 200 according to a general technique.
3 is a block diagram of a screen recording system 300 in which event information, graphic information, and template images are combined according to an embodiment of the present invention.
4 is a detailed block diagram of the image management module 350 shown in FIG.
FIG. 5 is a detailed block diagram of the synthesis module 455a shown in FIG. 4, and is a block diagram illustrating image synthesis of event information, graphic information, and template images.
FIG. 6 is a detailed block diagram of the division module 455c shown in FIG. 4, and is a block diagram showing an image separation of event information, graphic information, and template images.
7 is an image data structure in which event information, graphic information, and template image are combined according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Like reference numerals are used for similar elements in describing each drawing.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The term "and / or" includes any combination of a plurality of related listed items or any of a plurality of related listed items.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Should not.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A screen recording system and method according to an exemplary embodiment of the present invention will be described in detail with reference to the accompanying drawings.

3 is a block diagram of a screen recording system 300 in which event information, graphic information, and template images are combined according to an embodiment of the present invention. Referring to FIG. 3, a recording system 300 in which event information, graphic information, and template images are combined includes an event information management module 310, a graphic information management module 320, a template image management module 330, (340), a video management module (350), and the like.

The event information management module 310 manages event information programmed by the user and also manages input / output information on event information input from the system. In addition, if the user programs the system log, the transmission / reception data, the keyboard / mouse event, and the like on the event information of the system in various ways and inputs them as program information to the event information management module 310, event information is generated by the input information And outputs it to the video management module 350.

In particular, the event information management module 310 transmits the event information to the video management module 350, including synthesis information for time synchronization with the template video and event output information for reproducing the template video.

The graphic information management module 320 generates graphic information using the input information, and outputs the graphic information to the image management module 350 when the user sets a recording area, a recording period, a bit rate, and the like. In addition, the graphic information includes synthesis information for time synchronization with the template image, and transmits the synthesis information to the image management module 350.

The template image management module 330 programs the expected operation template image for the event information programmed by the event information management module 310 and inputs it to the template image management module 330. The template image management module 330 generates a template image And outputs it to the video management module 350.

In addition, the template image management module 330 generates a composite template image by including the composite information included in the event information in the template image. Therefore, the composite template image can be reproduced as the original template image by receiving the reproduction signal from the event information.

The time schedule module 340 time-synchronizes the event information, the graphic information, and the template image information output to the video management module 350 to generate time information.

The video management module 350 generates time-synchronized time information, event information, graphic information, and template video to generate composite information, and converts the composite information to a recorded video. Of course, the time information, the event information, the graphic information, and the template image can be divided and generated from the recorded image.

4 is a detailed block diagram of the image management module 350 shown in FIG. 4, the image management module 350 includes an event information input unit 451, a graphic information input unit 452, a template image input unit 453, an image input unit 454, an image synthesis unit 455, (456), and the like.

The event information input unit 451 receives event information from the event information management module 310 and the graphic information input unit 452 receives graphic information from the graphic information management module 320. The template image input unit 453 receives the template image from the template image management module 330, and the image input unit 454 receives the image information. Of course, the event information input unit 451, the graphic information input unit 452, the template image input unit 453, and the like may be configured as one information input unit. In an embodiment of the present invention, do.

The image input unit 454 receives the recorded image from the image output unit 456. In addition, the image input unit 454 may be software for uploading image information, or may be a storage medium. Of course, it can be connected online.

The image synthesis unit 455 synthesizes and / or compresses event information, graphic information, template images, and time information input from the event information input unit 451, the graphic information input unit 452, and the template image input unit 453 And generates a recorded image.

 In order to generate such a recorded image, the image synthesizing unit 455 includes a synthesizing module 455a for synthesizing the event information, the graphic information, the template image, and the time information to generate a synthesized image, And an image output unit 456 for outputting a recorded image.

The video output unit 456 can output the transmitted video image on the screen or output it as a video file.

Of course, the image synthesizing unit 455 may include an image input unit 454 for receiving a recorded image from the image output unit 456, a decoder 455d for decoding the recorded image into a composite image, event information, A division module 455c for dividing the image and time information, and the like.

The data stored in the recording image file is input to the video input unit 454 of the video management module 350 and is interpreted by the decoder 455d of the video composition unit 455 and then divided by the division module 455c And transmits the event information, the graphic information, and the template image to the video output unit 456, and is displayed on the screen.

FIG. 5 is a detailed block diagram of the synthesis module 455a shown in FIG. 4, and is a block diagram illustrating image synthesis of event information, graphic information, and template images. 5, the synthesis module 455a includes first to third mixers 555-1, 555-2 and 555-3 for synthesizing information, first and second compressors 556-1 and 556- The template information (i.e., the template image) 514, the first and second buffers 557-1 and 557-2 (temporary data) for temporary processing data, and the time information 511 and the event information 512, ), And the like.

That is, the first mixer 555-1 combines the time information 511 and the event information 512 to generate first synthesis information. The first compressor 556-1 compresses the graphic information 513 to generate the first compressed data. The first compressed data is temporarily stored in the first buffer 557-1 and then synthesized with the first composite information in the second mixer 555-2 to become the second composite information.

On the other hand, the second compressor 556-2 compresses the template information (i.e., the template image) 514 to generate second compressed data. The second compressed data is temporarily stored in the second buffer 557-2, and is then combined with the second composite information in the third mixer 555-3 to generate a composite image.

The encoder 455b encodes the composite image to generate a recorded image. This recorded image can be output as RGB content 560 corresponding to the file and / or screen resolution.

Also, the event information and the graphic information screen may be stopped at the time of reproducing the template image, and the event information and the graphic information screen may be reproduced at the end of the template image reproduction.

FIG. 6 is a detailed block diagram of the division module 455c shown in FIG. 4, and is a block diagram showing an image separation of event information, graphic information, and template images. Referring to FIG. 6, similarly to FIG. 5, the partitioning module 455c may also include first through third buffers for temporarily storing data and first through third decompressors for decompressing the image data.

At this time, the first decompressor first generates the template information 614, the second decompressor generates the graphic information 613, and the third decompressor generates the event information 612 and the time information 611 And becomes the corresponding contents 660, respectively. Here, the time information 611, the event information 612, and the graphic information 613 may be the same as or different from the time information 511, the event information 512, and the graphic information 513 shown in FIG. 5 .

7 is an image data structure in which event information, graphic information, and template image are combined according to an embodiment of the present invention. Referring to FIG. 7, the data structure of the composite image generated by the third mixer 555-3 of FIG. 5 is shown.

The data structure of the composite image includes a header field 701 having identification information of data, an event information field 702 having event information, a graphic information field 703 having graphic information, a template image data having template image information Field 704 are sequentially arranged. Which may be arranged on a time synchronization basis.

The terms " part, "" unit," " module, "and the like, which are described in the specification, refer to a unit that processes at least one function or operation, and may be implemented by hardware or software or a combination of hardware and software. In particular, in hardware implementation, an application specific integrated circuit (ASIC), a digital signal processing (DSP), a programmable logic device (PLD), a field programmable gate array (FPGA) A microprocessor, another electronic unit, or a combination thereof. In software implementation, it may be implemented as a module that performs the above-described functions. The software may be stored in a memory unit and executed by a processor. The memory unit or processor may employ various means well known to those skilled in the art.

300: Screen recording system
310: Event information management module
320: graphic information management module
330: template image management module
340: Time schedule module
350: Video management module
451: Event information input unit
452: Graphic information input section
453: Template video input unit
455:
455a: Composite module
455b: Encoder
455c: Split module
455d: decoder
456: Video output section

Claims (10)

An event information management module for generating event information by first input information programmed by a user;
A graphic information management module for generating graphic information by second input information programmed by a user;
A template image management module for generating a template image by third input information programmed by a user based on the event information;
A time schedule module for generating time information by performing time synchronization on the event information, the graphic information, and the template image; And
And a video management module for synthesizing the time information, the event information, the graphic information, and the template image to generate a recording image,
The graphic information is information capable of determining suitability of the system operation,
Wherein the event information is extracted from the graphic information, and the template image is generated by programming an expected operation template image for the event information.
The method according to claim 1,
Wherein the event information management module includes first event information for synchronizing time with the template image, and event output information for reproducing the template image. The event information management module includes event information, Screen recording system.
The method according to claim 1,
The graphic information management module may set a recording area, a screen resolution, a recording speed, and a bit rate according to an input of a user, and may include second synthesis information for time synchronization with the template image in the graphic information Wherein the event information, the graphic information, and the template image are combined.
The method according to claim 1,
Wherein the template image management module generates a composite template image by including first composite information in the template image, and the composite template image is reproduced as a template image by receiving a reproduction signal from the event information. , Graphic information, and template image.
The method according to claim 1,
Wherein the image management module comprises: an information input unit for receiving the event information, the graphic information, the template image information, and the time information;
An image synthesizer for synthesizing the time information, the event information, the graphic information, and the template image to generate a recording image; And
And a video output unit for outputting the recorded video, wherein the event information, the graphic information, and the template video are combined.
6. The method of claim 5,
Wherein the image synthesizer comprises:
A synthesis module for synthesizing the time information, the event information, the graphic information, and the template image to generate a synthesized image; And
And an encoder that encodes the composite image to generate a recorded image. The system of claim 1, wherein the event information, the graphic information, and the template image are combined.
6. The method of claim 5,
Wherein the image synthesizer comprises:
An image input unit for inputting the recorded image;
A decoder for decoding the recorded image and converting the decoded image into a synthesized image; And
And a division module for separating the composite image into the time information, the event information, the graphic information, and the template image information based on the event information, the graphic information, and the template image.
The method according to claim 1,
Wherein the recorded image is output as RGB content corresponding to a file or a screen resolution.
The method according to claim 1,
The data structure of the recorded image includes a header field having identification information based on the time synchronization, an event information field having event information, a graphic information field having graphic information, and a template image data field having template image information Wherein the event information, the graphic information, and the template image are combined.
The event information management module generating event information by first input information programmed by the user;
The graphic information management module generating graphic information by second input information which is programmed by the user;
The template image management module generating a template image based on third input information that is programmed by a user based on the event information;
Generating time information by performing time synchronization on the event information, the graphic information, and the template image by the time schedule module; And
And a video management module synthesizing the time information, the event information, the graphic information, and the template image to generate a recording image,
The graphic information is information capable of determining suitability of the system operation,
Wherein the event information is extracted from the graphic information, and the template image is generated by programming an expected operation template image for the event information.

Images