KR100821661B1 - Method for recording image pictures on a display screen of mobile terminal and Apparatus thereof - Google Patents

Abstract

The present invention relates to a method for recording a video screen of a mobile terminal and a device thereof, and more particularly to replaying the history of a video screen output to the portable terminal display by recording an image output to the portable terminal display. The present invention relates to a video screen recording method of a mobile terminal and a device thereof.

To this end, the video screen recording method of the mobile terminal according to the present invention, the video screen editing mode setting step of the mobile terminal; Transmitting predetermined image screen data to the portable terminal display unit; Temporarily storing the transmitted predetermined video screen data; A recording start command key input step for the video screen of the mobile terminal; Capturing the temporarily stored video screen data; Storing the captured image screen data; And a recording end command key input step for the video screen of the mobile terminal.

Accordingly, by recording the video output to the mobile terminal display without a separate hardware configuration, it is possible to replay the history of the video screen output to the mobile terminal display unit have.

Video screen history, RGB frame, YUV frame, frame conversion, data structure

Description

Method for recording image pictures on a display screen of mobile terminal and Apparatus

1 is a configuration diagram of a mobile terminal having a video screen recording apparatus of the mobile terminal according to an embodiment of the present invention;

2A is a flowchart of a video screen recording method of a mobile terminal according to one embodiment of the present invention;

2B is a flowchart of a video screen recording method of a mobile terminal according to another embodiment B of the present invention;

3A is a flowchart illustrating a process of converting and storing a frame form of image screen data according to an embodiment A of the present invention;

3B is a flowchart illustrating a process in which a data structure is added to and stored in an image screen data frame according to another embodiment B of the present invention.

The present invention relates to a method for recording a video screen of a mobile terminal and a device thereof, and more particularly to replaying the history of a video screen output to the portable terminal display by recording an image output to the portable terminal display. The present invention relates to a video screen recording method of a mobile terminal and a device thereof.

A general mobile terminal (mobile terminal) is a device that is carried by the individual by carrying out wireless connection with the other party at any time and anywhere while freely moving in the service area of the registered mobile communication system.

The portable terminal (MT) is initially developed from a communication method using a voice level signal, a communication method using characters and symbols, etc., and is now developing into a multimedia communication method including a video signal, for the multimedia communication The portable terminal further includes a photographing means (eg, a camera) for capturing an image signal. In addition, since the game function is embedded, various video screens are displayed on the portable terminal display unit when the game function is executed.

In particular, the conventional photographing function of the portable terminal is a function of photographing the outside of the portable terminal using the photographing means built in the portable terminal.

However, a mobile terminal having a conventional photographing function can execute an image file stored in the portable terminal or an image file received from the outside of the portable terminal and output the image file to the display unit. There is a problem in that it is impossible to replay the history of the video screen output to the portable terminal display unit since the image cannot be taken. For example, when executing a game function of a mobile terminal, only the video data of a specific game execution result screen as a game execution result can be captured, and a game execution process of a process of displaying a specific game execution result screen is displayed. You cannot record.

In addition, in the mobile terminal game development, it is difficult to smoothly communicate between the mobile terminal game developer and the game verifier because the game execution process cannot be recorded as to what process is displayed on the screen of a specific game execution result. There is this.

On the other hand, in order to record the video generated by the mobile terminal itself, a hardware configuration, for example, a video recording memory chip in a mobile terminal having a digital multimedia broadcasting (DMB) function, etc. can be used, but has a separate semiconductor chip. There is a problem of an increase in cost.

An object of the present invention for solving the above problems is to replay the history of the video screen output to the portable terminal display by recording the image output to the portable terminal display without a separate hardware configuration Could The present invention provides a method and apparatus for recording a video screen of a mobile terminal.

Still another object of the present invention is to record the game execution process for which process a specific game execution result screen is displayed on a portable terminal having a game function and then replay the recorded specific game execution process. The present invention provides a method and apparatus for recording a video screen of a mobile terminal.

According to an embodiment of the present invention, a video screen recording method of a mobile terminal includes: setting a video screen editing mode of a mobile terminal; Transmitting predetermined image screen data to the portable terminal display unit; Temporarily storing the transmitted predetermined video screen data; A recording start command key input step for the video screen of the mobile terminal; Capturing the temporarily stored video screen data; Storing the captured image screen data; And a recording end command key input step for the video screen of the mobile terminal.

Preferably, the video screen recording method of the mobile terminal according to an embodiment of the present invention, the step of converting the frame shape of the captured video screen data; The method may further include storing image screen data converted from the frame shape.

In addition, preferably, the video screen recording method of the mobile terminal according to an embodiment of the present invention, adding a predetermined data structure to the captured video screen data; The method may further include storing image screen data to which the predetermined data structure is added.

The transmitted predetermined video screen data is displayed on the portable terminal display unit,

In particular, the transmitted predetermined video screen data may be temporarily stored in a buffer memory of the mobile terminal display unit.

On the other hand, the frame shape of the captured image screen data is a frame of RGB form,

The RGB frame is converted into a YUV frame,

The frame of the RGB type and the frame of the YUV type have a corresponding relationship as shown in Table 1 below.

Y = 0.3R + 0.95G + 0.11B U = (B-Y) x 0.493 V = (R-Y) x0.877

In addition, the predetermined data structure preferably has a configuration as shown in Table 2 below.

Typedef Frame_Ani {int Caputer_No; // Frame Buffer Number to be captured Number int img_ptr; // Save Data Memory Address int ani_time; // Animation structure to display one sheet. Frame_Ani * prev_ptr; Frame_Ani * next_ptr; } Frame_Animation

On the other hand, the video screen recording apparatus of the mobile terminal according to the present invention for achieving the above object, the video screen editing mode setting means of the mobile terminal; Means for transmitting predetermined image screen data to the portable terminal display unit; Means for temporarily storing the transmitted predetermined video screen data; Recording start command key input means for the video screen of the mobile terminal; Means for capturing the temporarily stored image data; Means for storing the captured image data; And a recording end command key input means for the video screen of the portable terminal.

Hereinafter, with reference to the accompanying drawings will be described in detail the present invention.

<Example 1>

1 is a block diagram of a video screen recording apparatus of a mobile terminal according to an embodiment of the present invention.

The mobile terminal according to an embodiment of the present invention has a camera function and a mobile communication function.

The RF unit 118 performs a wireless communication function of the mobile terminal. The RF unit 118 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal.

The data processor 119 includes a transmitter for encoding and modulating the transmitted signal and a receiver for demodulating and decoding the received signal. That is, the data processor 119 may be configured of a modem and a codec. The codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice.

The portable terminal controller 110 controls the overall operation of the portable terminal. The controller 110 may include a memory 111, a data converter 112, an audio processor 114, an image processor 116, a display 117, a display buffer 117a, and the like. It is connected to the data processing unit 119 and controls to exchange, process, process data, and set up a call. In addition, the controller 110 may include the data converter 112 and the data processor 119.

In the present invention, the control unit 110 transmits the image data to the display unit buffer 117a, receives the data frame converted by the data converter 112 and performs an encoding and decoding operation.

The memory unit 111 stores a predetermined data necessary for driving the mobile terminal and specific data generated during the operation of the mobile terminal.

The audio processor 114 reproduces the received audio signal output from the audio codec of the data processor 119 or transmits a transmission audio signal generated from the microphone to the audio codec of the data processor 119.

The camera module 115 includes a camera sensor for converting the photographed optical signal into an electrical signal, and a signal processor for converting the analog image signal photographed from the camera sensor into digital data. Herein, it is assumed that the camera sensor is a CCD sensor, and the signal processor may be implemented by a digital signal processor (DSP). In addition, the camera sensor and the signal processor may be integrally implemented or may be separately implemented.

The image processor 116 performs a function of generating screen data for displaying an image signal output from the camera unit 15. The image processor 116 processes the image signal output from the camera unit 15 in units of frames, and outputs the frame image data according to the characteristics and the size of the display unit 117. In addition, the image processing unit 116 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 117 in a set manner or restoring the compressed frame image data to the original frame image data. do. The image codec may be a JPEG codec, an MPEG4 codec, a wavelet codec, or the like. It is assumed that the image processor 116 has an On Screen Display (OSD) function, and may output on-screen display data according to a screen size controlled and displayed by the controller 110. .

The display unit 117 displays an image signal output from the image processor 116 on a screen and displays data output from the control unit 10. The display unit 117 may be configured as a liquid crystal display (LCD) device having a touch-screen function, and may temporarily store image data of an image screen displayed on the LCD screen. Memory and the like.

In one embodiment according to the present invention, the temporary memory functions as the display unit buffer 117a.

The key input unit 113 may include keys for inputting a predetermined telephone number including numbers and text information, function keys for setting various functions, and shortcut keys thereof. For example, the shortcut key may be ' It can be # 'or' * '.

The data converter 112 captures predetermined image screen data transmitted from the portable terminal controller 110 and temporarily stored in the display buffer 117a to convert a data frame form or add a specific data structure.

<Example 2>

A preferred embodiment A of the present invention is characterized by converting the shape of a data frame after capturing predetermined data.

2A is a flowchart of a video screen recording method of a mobile terminal according to an embodiment A of the present invention.

Referring to FIG. 2A, in the standby state of the portable terminal, that is, in the ON state of the portable terminal (step 201), it is determined whether the image data editing mode of the portable terminal is operated (step 203).

The image data editing mode may be set by inputting a predetermined shortcut key button (for example, a * key button or a # key button) (step 205).

In the state where the image data editing mode of the portable terminal is operated, predetermined image data is transferred from the portable terminal controller to the display unit buffer 117a and temporarily stored (step 207).

The predetermined image data is a RGB (red-green-blue) type signal and is temporarily stored in the display buffer 117a.

Subsequently, an image screen corresponding to the image data is displayed on the screen of the display unit 117 (step 209).

In operation 211, the user of the portable terminal inputs a recording start command key button. The recording start command key button may be a predetermined shortcut key button (eg, a * key button or a # key button).

When the portable terminal user inputs a recording start command key button, the portable terminal informs the portable terminal user of an effective storage capacity for storing the captured image data. For example, the voice or the light of the keypad may inform the data storage available space or the data storage time of the memory unit 111. That is, when the user of the portable terminal inputs the recording start command key button, the keypad 9 is turned on, and when the data storage capacity decreases after a predetermined time, the keypads 8, 7, 6, .. are sequentially turned on and stored. The degree of dose can be indicated. Alternatively, the amount of memory capacity that can be stored may be displayed by a bar graph display at the bottom of the portable terminal display unit.

In operation 213, the data converter 112 captures image data temporarily stored in the display buffer 117a. The image data transmitted from the control unit 110 to the display unit buffer 117a is temporarily stored in data frame units having a predetermined size, and the data conversion unit 112 connected to the display unit buffer 117a is temporarily stored. Is to capture a frame of data.

In operation 215A, the data converter 112 converts the frame shape of the image data captured from the display buffer 117a.

The frame type of the image data temporarily stored in the display buffer 117a is a frame of an RGB (Red-Green-Blue) signal,

The data converter 112 converts the RGB frame into a YUV frame. The RGB-type frame and the YUV-type frame have a correspondence relationship (encoding and decoding algorithm) as shown in [Table 1].

Depending on the data rate or the quality of the picture, different encoding and decoding algorithms may be used.

In step 217A, the controller 110 stores the data frame converted into the YUV form by the data converter 112 in the memory 111.

The YUV-type frame is decoded in accordance with the rules according to [Table 1] and reproduced as a video screen.

When the recording end command key is input in step 219, the data conversion unit 112 stops capturing image data from the display unit buffer 117a.

That is, as described above, the predetermined video data transmitted from the portable terminal controller 110 to the portable terminal display buffer 117a continues from the input of the recording start command key in step 211 to the input of the recording end command key in step 219. The frame type is converted and stored in the memory unit.

On the other hand, after the recording end command key is input, the video recording data is transferred from the portable terminal controller 110 to the display buffer 117a and the video screen is displayed on the portable terminal display unit 117. In step 213 to 217A, the predetermined image data is stored in the portable terminal memory 111 (step 221).

3A is a flowchart illustrating a process of converting and storing a frame form of image screen data according to an embodiment A of the present invention.

In the embodiment A of the present invention, predetermined image data is transferred from the portable terminal controller to the display unit buffer 117a and temporarily stored and then displayed on the display unit 117 screen.

Referring to FIG. 3A, when the image data editing mode of the mobile terminal is operated, the data converter 112 captures an RGB data frame that is temporarily stored in the display buffer 117a, and then the frame shape of the image data. Is converted into a YUV form, and the converted frame is encoded in the manner according to [Table 1] and stored in the memory unit 111.

The predetermined image data stored in the memory unit through the above process is displayed on the portable terminal display unit 117 through the same decoding process as shown in [Table 1].

Example 3

Another preferred embodiment B of the present invention is characterized by adding a specific data structure after capturing predetermined data.

2B is a flowchart of a video screen recording method of a mobile terminal according to another embodiment B of the present invention.

The third embodiment goes through the same process as steps 201 to 213, 219, and 221 of the second embodiment, but has the following differences in steps 215B and 217B.

In step 215B, instead of converting the captured RGB image data frame into a YUV frame form, a specific data structure is added to the captured RGB image data, instead.

In step 217B, the data frame in which a specific data structure is added to the captured RGB image data is stored in the portable terminal memory unit 111.

The specific data structure has the same configuration as shown in [Table 2], and a method of animate Font-Data (that is, a technique of continuously displaying a series of images generated inside a computer on a screen to make it appear to move). Has the same data structure as used in.

3B is a flowchart illustrating a process in which a data structure is added to and stored in an image screen data frame according to another embodiment B of the present invention.

In another embodiment B of the present invention, predetermined image data is transferred from the portable terminal controller to the display unit buffer 117a and temporarily stored, and then displayed on the display unit 117 screen.

When the image data editing mode of the mobile terminal is activated, the data conversion unit 112 captures an RGB data frame that is temporarily stored in the display unit buffer 117a, and then displays the captured image data in [Table 2]. Add a specific data structure according to the stored in the memory unit 111.

The predetermined image data stored in the memory unit through the above process is displayed on the portable terminal display unit 117 according to the instruction of the portable terminal controller 110.

Example 4

Another preferred embodiment C of the present invention is a method that can be effectively used when a game engine for playing a predetermined game in a mobile terminal is stored in the mobile terminal. The video screen of the mobile This is how you can play the history.

The game engine is configured to sequentially proceed with the game according to a predetermined key input command.

After the mobile terminal user inputs the 'recording start command key' at a certain time during the execution of a specific game, the user presses various keys of the portable terminal to execute a specific game, and after a successful game mission (mission), the 'recording end command key' If you type

The portable terminal controller 110 creates a 'time table file' in which a command key input time for performing the mission of the game is recorded.

Therefore, when the 'command key input time data' stored in the time table is applied to the game engine, since the mission performance of the specific game is performed sequentially, the history of the video screen showing the process of performing the specific game mission on the portable terminal display unit. Can play.

According to various embodiments of the present disclosure as described above, a history of a specific video screen output on a display unit of a mobile terminal such as a video screen recording a rearing process of a cyber-pet (pet managed in a virtual space) History, history) can be saved as a video file.

As described above, preferred embodiments of the present invention are disclosed for the purpose of illustration, and those skilled in the art can improve other various embodiments within the spirit and technical scope of the present invention disclosed in the appended claims below. Changes, substitutions or additions will be possible.

According to the present invention, it is possible to replay the history of the video screen output to the portable terminal display unit by recording the image output to the portable terminal display unit without a separate hardware configuration have.

In addition, it is possible to replay a specific game execution process later by recording a game execution process on which process a specific game execution result screen is displayed on a mobile terminal having a game function. Good communication between game verifiers is possible.

Claims (13)

delete In the video screen recording method of a mobile terminal, Setting a video screen editing mode of the mobile terminal; Transmitting predetermined image screen data to the portable terminal display unit; Temporarily storing the transmitted predetermined video screen data; A recording start command key input step for the video screen of the mobile terminal; Capturing the temporarily stored video screen data; Converting a frame shape of the captured image screen data; Storing image screen data in which the frame form is converted; And And a recording end command key input step for the video screen of the mobile terminal. In the video screen recording method of a mobile terminal, Setting a video screen editing mode of the mobile terminal; Transmitting predetermined image screen data to the portable terminal display unit; Temporarily storing the transmitted predetermined video screen data; A recording start command key input step for the video screen of the mobile terminal; Capturing the temporarily stored video screen data; Adding a predetermined data structure to the captured image screen data; Storing image screen data to which the predetermined data structure is added; And And a recording end command key input step for the video screen of the mobile terminal. delete delete In the video screen recording method of a mobile terminal, Setting a video screen editing mode of the mobile terminal; Transmitting predetermined image screen data to the portable terminal display unit; Temporarily storing the transmitted predetermined video screen data; A recording start command key input step for the video screen of the mobile terminal; Capturing the temporarily stored video screen data; Storing the captured image screen data; And a recording end command key input step for the video screen of the mobile terminal. The frame type of the captured image screen data is an image frame recording method of a mobile terminal, characterized in that the frame. The method of claim 2, The frame type conversion is a video screen recording method of a mobile terminal, characterized in that for converting the frame of the RGB type to the frame of the YUV type. The method of claim 7, wherein And the frame of the RGB type and the frame of the YUV type have a corresponding relationship as shown in [Table 1]. TABLE 1 Y = 0.3R + 0.95G + 0.11B U = (B-Y) x 0.493 V = (R-Y) x0.877 The method of claim 3, wherein The predetermined data structure has a configuration as shown in Table 2 below. TABLE 2 Typedef Frame_Ani {int Caputer_No; // Frame Buffer Number to be captured Number int img_ptr; // Save Data Memory Address int ani_time; // Animation structure to display one sheet. Frame_Ani * prev_ptr; Frame_Ani * next_ptr; } Frame_Animation In the video screen recording apparatus of a mobile terminal, Means for setting a video screen editing mode of the mobile terminal; Means for transmitting predetermined image screen data to the portable terminal display unit; Means for temporarily storing the transmitted predetermined video screen data; Recording start command key input means for the video screen of the mobile terminal; Means for capturing the temporarily stored image data; Means for storing the captured image data; Recording end command key input means for the video screen of the mobile terminal; And And controlling means for changing and storing the captured image screen data frame shape or adding and storing a predetermined data structure to the captured image screen data. Device. In the video screen recording apparatus of a mobile terminal, A video screen displayed on the display unit; At least one key input for proceeding with the video screen; A controller configured to capture the video screen according to the key inputs to generate a history of the video screen; And And a storage unit for storing a history of the video screen. The method of claim 11, The video screen is a screen according to a game application, And the video screen history is a mission progress history according to the mission of the game application. In the video screen recording method of a mobile terminal, Buffering the received image screen data; Reading the buffered video screen data; Converting a frame shape of the read image screen data; And And storing the video screen data of which the frame form is converted.

Images