KR200280406Y1 - Electronic Notepad - Google Patents

Abstract

The present invention obtains the position value from the touch pen on the touch screen attached to the graphic LCD module, converts it into two-dimensional coordinate data, and then generates an image signal based on the image signal generator that can transmit to various display devices. In order to display the handwriting signal on the screen of various image display devices in real time, not only the video synchronization but also the storage function is stored in one memory by the mixing function of the handwriting signal and the external image, and the two kinds of images can be discriminated. In addition, the present invention relates to configuring an image format for the purpose of separately handling a handwritten image and an external image during editing, displaying a mixed image on an LCD, and simultaneously exporting the image to a PC or TV image output. It also enables video conferencing and communication to send and receive handwriting screens with other parties. When not using video signal input / output, various personal information can be stored in handwritten form, such as electronic notebooks or electronic memo books that can be read and written. Is to make use of it. To this end, the present invention is a memory input synchronization unit for synchronizing the memory input of the input writing signal in addition to the LCD and touch screen module, a memory control unit for storing both external and internal writing signals in one memory, mixed image and internal handwriting image, Manages the operation of mode selector, image selector, and memory controller to select and display and output external images arbitrarily, and reads the operation of touch screen to control the entire system and non-volatile for image storage and editing It includes a memory unit.

Description

Electronic Notepad

Writing devices such as electronic blackboards have disadvantages such as inconvenience in typing, small letters not visible from a distance, and expensive products. In addition, the input device using a digitizer or a tablet is not easy to record the desired content in detail because the writing is blunt, and the handwriting is not displayed directly on the input panel. there was.

On the other hand, the display of the handwritten signal through a high-resolution touch screen is mainly used in a terminal such as a PDA and is applied to input data through handwriting recognition. The data can also be transferred to an external computer or stored separately in nonvolatile memory for simple memos.

However, it is not practical to use handwriting data as an image signal and directly connect it to an external display device, and even though a technically possible method is known, it is possible to treat a handwritten image as a new separate image and separate it from an external image, so that two or more It has been common to process the above video signals by a technique of overlapping or selecting a plurality of video sources with a video switch. That is, the same principle as the processing of two video signal sources, a main signal and a sub-signal, by storing, editing, and processing an image signal of an external image signal and handwriting data separately is used.

The present invention inputs the desired handwriting according to the change of position of touch point of touch pen from touch screen attached to LCD module, and the position information is read by touch screen controller connected to touch screen, converted into digital data, and stored in memory. In a device that mixes with an external image or outputs only handwriting data to an external image display device or displays on its own display such as an LCD, by storing the memory separately for an external image or a mixed image and an internal image, that is, a handwritten image In order to solve the problem of increasing the memory usage and increasing the complexity of the hardware, it uses a technique of simultaneously storing its own handwritten and external images as a single memory. Of course, even at this time, the display function and output as PC video and TV video signal on the built-in screen are maintained as they are, and the interconnection function between terminals transfers only the screen of a specific terminal or all screens among a plurality of terminals connected in series. Overlapping and final output are also supported.

In addition, the memory for image storage also adopts a first-in first-out (FIFO) method, which is easy to use, so that hardware can be easily configured. In addition, by using a data structure suitable for color writing, writing in color is also possible. Then, the handwritten or mixed video is encoded and transmitted back to the TV video signal to implement a function of inputting and displaying each other's intentions on the same screen as the counterpart.

Since the handwritten image is stored in the built-in nonvolatile memory and can be reproduced at any time, when used in conjunction with an external video device, the handwritten image can be used alone as an electronic notebook or an electronic memo book.

1 is a configuration diagram for generating and displaying a handwritten image of an electronic memo pad as an embodiment of the present invention;

2 is a block diagram of a memory input synchronization unit of FIG. 1;

3 is an example of the configuration of a memory map stored in the FIFO memory of FIG.

4 is a configuration diagram of the memory controller of FIG. 1;

5 is a block diagram of a video conferencing system using the present invention

6 is a block diagram of a video communication system using the present invention

Explanation of symbols on the main parts of the drawings

110: coordinate scaler 111: memory input synchronization unit

112: memory controller 113: FIFO memory

114: output mode selection unit 115: image selection unit

120: TV encoder 121: A / D converter

122: resolution scaler

130: microcomputer 131: non-volatile memory

In order to achieve the above object, the present invention scales the range of handwriting data to its own indicator and synchronizes it with an external video signal to the memory. Memory control means for storing in the memory, output mode selection and image selection means for selecting and outputting the internal image or external image or mixed image, TV encoding means for changing the form of the image output according to the TV signal, external image signal Means for digitizing and scaling the input and forwarding it to a memory controller.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

The present invention is to enable lectures, consultations, meetings, handwriting video communication, such as handwriting data by video signal to the real-time display or video communication devices such as LCD projectors, TVs, monitors, video phones, etc. Have the same configuration.

Referring to FIG. 1, an apparatus according to an embodiment of the present invention includes a coordinate scaler 110 that scales resolution of handwritten data to a display device thereof, and a memory input synchronizer configured to transfer the data in synchronization with an external image signal. 111), a memory controller 112 which distinguishes input external signals and internal writing signals, corrects them according to a proposed format, controls writing and reading of the memory, and a FIFO memory 113 which stores external and internal images at once. The output mode selection unit 114 allows the user to select the shape of the output image by mixing, internal, and external, the image selection unit 115 which adds only the internal image while maintaining the signal of the external image, and the image output. TV encoder 120 for changing the form to match the TV signal and outputting, A / D converter 121 for converting the external PC signal into a digital form, and PC signals of various external resolutions With a resolution scaler 122 that adjusts to the resolution of the image, and a microcomputer 130 and a nonvolatile memory 131 for transferring image data to a nonvolatile memory for various memo storage functions such as an electronic memo pad. It is composed.

The operation of the apparatus having the structure as described above will be described in detail as follows.

The handwritten data scaled by the coordinate scaler 110 is not possible at any time of writing in order to be input into the memory, but when the external image is being input, the vertical and horizontal synchronization with the external image signal must be matched. 111).

The reference signal of synchronization is a horizontal and vertical synchronization outputted with an image signal such as a PC signal input from the outside, and when there is no external PC image input, the memory input synchronization unit 111 receives a horizontal and vertical synchronization signal for an image. You can make it yourself. The memory input synchronizer 111 is described in detail with reference to FIG. 2. The memory controller 112 stores or modifies handwritten data synchronized with an external video signal in the memory input synchronizer 111 in the FIFO memory 113 and is described in detail with reference to FIG. 4. The output mode selector 114 selects and outputs a handwritten image, an external image, or a mixed image of the user. The output mode selector 114 controls the image selector 115 to output desired data according to the selected mode. That is, when the external image is selected, the switch of the image selecting unit 115 may be fixed to the outside. When the internal image is selected, the switch of the image selecting unit 115 is output only when the internal data is in the FIFO memory 113. Just do it. The method of determining whether the data stored in the FIFO memory 113 is internal data or external data is divided into index bits as shown in FIG. 3.

For example, if the index bit is 1, the handwritten data is internal image data, and if the index bit is 0, it is external image data. In addition, in the mixed mode, the image selection may be internal only when the output of the FIFO memory 113 is internal data, and the image selection may be the external input image when external data is used.

The external PC image stored in the FIFO memory 113 is digitized through the A / D converter 121 and again scaled to match the display resolution of the LCD by the resolution scaler 122 and then internal data in the memory controller 112. And then sent to the FIFO memory 113.

In addition, in order to output in the TV image format, the TV encoder 120 should be provided. The TV encoder 120 encodes the internal data or the external data or all data with data output from the FIFO memory, rather than selecting an image. The signal is output as an internal image, an external image, or a mixed image.

On the other hand, when the screen is to be saved, the microcomputer 120 stores the mixed image data in a form displayed on its own display in the nonvolatile memory 121, and the screen stored therein is read out in units of frames when desired, such as the LCD itself. It is displayed on the display and is simultaneously output as a PC image or through the TV encoder 120, the image is corrected for TV format and output.

FIG. 2 illustrates an embodiment of the configuration of the memory input synchronization unit of FIG. 1 and is configured as follows.

First, the address selectors 210 and 211 may alternately select the output of the address counter 213 and the scaled handwritten coordinate 1. Then, the four-line dual-port memory (220, 221) is in the read mode while being alternately writing or reading and writing at the same time alternately each time the output of the writing coordinate comparison unit 212 by the T flip-flop (214) When the output of the address counter 213 is selected when the writing mode, the writing coordinates 1 are selected. The writing coordinate 2 comparison unit 212 compares the writing coordinate 2 position of the current writing point and the writing coordinate 2 position of the next point and records the writing coordinates in different memories if they are different from each other. The output of the address counter and the vertical and horizontal values of the handwritten coordinates are divided into addresses 1 and 2 and the handwritten coordinates 1 and 2, and their definitions are as shown in FIG. This is limited to four-line memory. When eight-line memory is used, address 2 or handwritten coordinates are the rest except for the lower 3 bits of the vertical address bit. The reason why 4 line memory is used is that handwriting data generates 200 ~ 300 points per second. Even though these points are spread over different lines, the frame frequency of external video is at least 60Hz. If you store only 4 points, you can store 240 points per second. Therefore, to increase the processing speed of handwritten data, the number of line memories can be increased.

The address comparison unit 222 compares the address 2 and the writing coordinate 2, which are outputs of the address counter, generates a pulse and outputs writing data through the AND gate 223 during the same value.

Referring to FIG. 2 configured as described above, the internal handwriting signal has a dual-port memory of only 4 lines so that it synchronizes with an image signal input from the outside, which is more economical than when storing a conventional frame, and in terms of complexity. It is advantageous.

The detailed operation of FIG. 2 is as follows.

When the horizontal and vertical synchronization signals input simultaneously with the external PC image are counted by the address counter 213 and the address 2 is transmitted to the address comparison unit 222, the address comparison unit 222 receives the vertical coordinate values and the image of the handwritten data. By comparing the vertical addresses of the data, when one frame is divided into four line periods, it is determined whether the vertical positions on the screen coincide with each other in the same range. That is, the same instant is notified by comparing the upper address bits except the lower two digit bits of the vertical address. Then, when the output of the memory in which the read mode is operated is transmitted to the two four-line dual port memory lines, this becomes synchronized handwriting data.

The two dual port memories 220 and 221 read or write while erasing the memory or writing handwriting data while only writing or reading / writing at the same time. The write mode always operates in the two memories. The only difference is whether the address to be written becomes the writing coordinate 1 or the address 1 by the address selecting sections 210 and 211. When the writing address becomes the writing coordinate 1, the writing operation is performed simultaneously with the reading operation. Since the input data, that is, the value of '1' is automatically written according to the writing coordinate 1, the writing position is recorded in the memory. By reading this value sequentially according to the address 1, the handwriting is changed into a form for merging with the video signal. The read address is always address 1, so it is synchronized with the external video code. In conclusion, the writing coordinate 1 is used as the writing address, and the writing data, that is, the input data, is fixed to one. It is necessary to indicate whether the writing is 1 or 0, since only 1 is input at the writing position, that is, the writing coordinate.

3 shows the format of a pixel stored in the FIFO memory 113, so that two pixels can be stored in 8-bit data. Then, since R, G, and B have values of 0 and 1, respectively, 8 colors can be represented, and the 4th bit is an index bit, which is used to distinguish an internal image (written data) from an external image. Herein, it is assumed that the index bit is 1 when the internal image and the index bit is 0 when the external image. 3 shows the storage location of the data according to the address of the FIFO memory 113. U0 to U639 mean horizontal numbers of pixels corresponding to the upper 240 lines of the LCD screen having 640x480 resolution. L639 means a horizontal number of the pixel corresponding to the lower 240 line. The reason for storing in this manner is according to the pixel display order of the LCD module driver, and the screen is displayed when data is transmitted to the LCD while reading the FIFO memory 113 in sequence. If there are LCD modules displayed in a different order, they will be followed.

4 is a diagram illustrating an internal configuration of the memory controller 112 in FIG. 1, and serves to supply data to the FIFO memory 113. In the configuration of FIG. 4, the data selectors 1 (410 and 411) serve to select external data and handwriting data, and are processed in 4 bit units so that two pixels are bundled into 8 bits and sent to the FIFO memory 113. . The pixel type selector 412 receives a control signal according to the mode when the menu such as color, line thickness, write / erase, etc. is determined according to a menu selection by a touch screen or a button in the color / writing mode selection unit 416. The color, thickness, and data writing / erasing of pixels are determined. The output data is sent to the data selectors 1 (410, 411), and the order of the pixels is adjusted by the D flip-flop 415. For example, in this case, the lower 4 bits are the pixels which are entered first, and the upper 4 bits are the pixels which are entered later. Similarly, the D flip-flop 420 and the data selector 2 (421, 422) decide whether to select an external image or an output of the FIFO memory 113. If the output of the memory is handwritten data, the memory output is selected. In the case of external image data, the data stored in the memory is discarded and the external image currently input is selected. This is to change the new data in real time because the change of the external image is unknown.

The D flip-flops 413 and 414 adjust the timing to input the selected image data to the FIFO memory 113. The D flip-flops 413 and 414 output the pixel clock, that is, the dividing period 431, which is a two-division clock of the writing data clock. Input by 2 pixels. In addition, the second divider 432 first stores U0 to U639 at an even number by activating the input enable (IE) of the memory by one pixel in order to store the memory in the format shown in FIG. 3 below. This is to save L0 ~ L639 at address. To this end, since the FIFO memory 113 must be reset twice during one vertical synchronization, the frequency of the external vertical synchronization is doubled by the multiplier 430 to use this as a reset signal of the FIFO memory 113.

In this way, the external image data and the writing data are continuously recorded in a new form, and writing and erasing of the writing data is freely performed by preferentially processing the writing data to the external image data by index bits.

The present invention not only makes it possible to unify the memory for external and internal signals used in displaying the writing signals on the screen of various image display devices in real time, but also separately synchronizes the writing data with respect to the external video signals. By implementing synchronization with only four lines of memory without the need, a much more economical hardware configuration is possible. In addition, various color writing of 8 colors can be performed according to the proposed data format, and the output mode of the video can be classified into internal video, external video, or mixed video, and the video conferencing system can be connected in series. If you configure this has the advantage that anyone can pass the handwritten information to all or finally see only the screen of a specific person. That is, by connecting the present invention in series to configure a video conferencing system anyone has the advantage that can deliver the written content to the power source, Figure 5 is configured a video conferencing system using the present invention. In addition, when connected to the TV input and output terminal of the video phone or connected to the PC instead of a PC camera can be used for communication meetings, video tutoring, communication consultation between the two. 6 shows an example of a configuration of a video communication system between the two. Each of the unspecified blocks of FIGS. 5 and 6 represents the present handwritten image generating and indicator.

Handwritten or external input and mixed video can be stored in non-volatile memory to be read as needed at any time.

Claims (2)

An apparatus for displaying a writing screen on a video display device, Means for converting the written shape into a video signal in real time using a single frame of memory; In the means for converting the handwritten shape into an image signal and outputting the same, a first-in-first-out (FIFO) memory is used to mix and store handwritten image data and external image data. A device having a function of selecting and writing handwritten data and external image data to a memory by comparison; In the handwriting display device, in order to synchronize an image signal such as a PC input from the outside with its own writing signal, the internal handwriting image signal is transferred to the external signal using two four-line or more dual port memories. Means for synchronizing; Means for controlling a mode to output an image output as an internal signal, an external signal, or a mixed signal in the handwriting display device; Electronic memo pad with video signal generation and display function including The method of claim 1, In the means for converting the handwritten shape into an image signal and outputting the same, the format of the image data stored in the image memory for color handwriting input is composed of 4 bits, and the 3-bit pixel information is separated from the internal and external images. By configuring the index bit information to modify, edit and edit the handwritten video screen, it is possible to distinguish between internal and external video to enable or disable editing. Electronic memo pad with image signal generation and display