KR20020050769A - Method of synchronizing multiple communication terminal apparatus having the graphic functions - Google Patents

Abstract

PURPOSE: A method for synchronizing display contents in a communication terminal having graphic function is provided to enable communication maintaining always the same display contents when the terminal exchanges graphic materials with the other terminal. CONSTITUTION: A communication terminal exchanges a manufacturer number, a model number, and a version number with the other communication terminal. It is determined whether the numbers are the same. If so, the size of working space is set as a white board. Otherwise, the terminal exchanges the dot size of an LCD screen and the working space size with the other terminal, and sets the minimum of the X-axis and the minimum of the Y-axis as a new white board. The terminal exchanges a set of sharing graphic commands with the other terminal. The terminal sets a new set of sharing graphic commands with only common commands in the exchanged sharing graphic commands.

Description

Method of synchronizing multiple communication terminal apparatus having the graphic functions}

The present invention relates to a method of synchronizing screen contents in a communication terminal having a graphic function, and more particularly, regardless of whether a communication means used is wireless or wired, a terminal participating in communication sends and receives graphic data for communication. It was invented to communicate while maintaining the screen of the contents.

Recently, with the development of information technology and communication technology, a new communication terminal combining the two technologies has emerged.

Personal handheld terminals, known as PDAs (Personal Digital Assistants), are equipped with LCDs and touch panels that can enter and store graphical information such as handwritten notes on the LCD with a plastic pen.

When an information terminal equipped with an LCD and a touch panel is combined with wired / wireless communication, graphic information can be exchanged between terminals, and thus it is possible to send and receive directions, drawings, and formulas that are difficult to express only by hand. Therefore, given this handwritten memo function along with voice function, communication will be very easy.

However, various communication terminals incorporating a conventional PDA do not have such a function, and thus there is a problem in that communication cannot be performed while handwriting memo with voice function.

Therefore, Microsoft has developed and released a product called NetMeeting, which is a whiteboard function that can send and receive graphics between two computers.

However, the method used here is a method of storing and managing all the graphic units performed by the object-oriented method as one object, and unlike the present invention, it is not limited to using only one whiteboard at a time. Way.

However, this method is the same as that applied to Microsoft's PowerPoint, which takes up a lot of memory and requires large computational performance, so it can only be used on personal computers with large screens.

On the other hand, Korean Patent Application No. 99-23995 (name: Receiving message transmitting and receiving apparatus using a notepad and a control method thereof) that the applicant has previously applied for the configuration and method that can exchange graphics between the two terminals Although it is suggested, there is a case that the contents are inconsistent when the graphic commands are executed at the same time because the method of sharing the whiteboard is not used, and it is possible only when the manufacturer, model, and version number are the same. There is a problem in that both voice and message transmission and reception are impossible at the same time.

The present invention has been made to solve such a conventional problem, and always maintains the same screen when the terminal participating in the communication sends and receives graphic data for communication, regardless of whether the means of communication is wireless or wired. The purpose of the present invention is to provide a method for synchronizing screen contents in a communication terminal having a graphic function capable of communicating.

It is another object of the present invention to apply a graphic unit directly to an image screen in the form of an image and discard it without storing it after application so that a memory is not required separately and is suitable for PDAs having a low screen and low computational performance. When editing a graphic, it can be performed based on the image itself. Also, two terminals having different manufacturers, models, and version numbers can communicate with each other while maintaining the same contents through commands shared with each other. The present invention provides a method for synchronizing screen contents in a communication terminal having a graphic function.

The central idea of the present invention is a concept in which a terminal participating in communication uses a virtual graphic space called a white board (whiteboard) as if they share the space and work with only one person at a time. Invented to occupy a whiteboard.

This is because, unless the whiteboard is restricted to only one person at a time, when one person adds and deletes another part of the same area at the same time, the contents differ between terminals.

In order to solve this problem, the present invention was invented to share a whiteboard and use only one person but occupy only one unit of graphic work, and when the use of one unit of graphic is completed, anyone can freely use the whiteboard right away. In addition, if both attempts to use at the same time, there are various methods other than giving priority to the sender as a method of processing the usage right. In this case, the present invention cancels both modes as an embodiment. This method is one of the standardization methods for exchanging graphic contents at the application level in the communication terminal with LCD and touch panel and having graphic function.

Therefore, by applying the unit of graphic directly to the image screen in the form of an image, no separate memory is required, even on a PDA with a small screen and low computational performance, and when editing a graphic, it can be performed based on the image itself. In case of two terminals with different manufacturers, models, and version numbers, commands that can be performed in common can be used to communicate while maintaining the same screen when the participating terminals exchange graphic data for communication. You can do it.

1 is a connection state diagram of a communication terminal to which the present invention method is applied.

2 is an exemplary screen configuration of a terminal according to the present invention.

3 is a block diagram of a general communication terminal supporting voice and data at the same time.

4 is a block diagram of a general communication terminal supporting separation of voice and data.

5 (a) and 5 (b) are flowcharts for explaining the method of the present invention.

6 is a detailed flowchart of the initialization subroutine in FIG.

Explanation of symbols on the main parts of the drawings

1: Network connection part 2: Signal transmitting and receiving part

3: modulation and demodulation unit 4: multiplexing / demultiplexing unit

5: codec 6: microphone

7: speaker 8: memory

9: microcomputer 10: LCD

11: touch panel

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a connection state of a communication terminal to which the method of the present invention is applied, each of which is equipped with an LCD and a touch panel and is configured to create a handwritten memo as a graphic work on a terminal with a plastic pen called a stylus.

FIG. 2 is a diagram illustrating an example of a screen configuration of a terminal according to the present invention, which is configured to be used as an area representing a title, and a graphic editing tool is located on the right side. In this case, the title area and the editing tool area are located. Except for the rest, you can use the whiteboard as the workspace.

Meanwhile, there may be two types of communication terminals equipped with an LCD and a touch panel, one of which is a terminal supporting voice and data at the same time as in FIG. 3, and the other is a voice and handwriting memo as shown in FIG. 4. There is a terminal that cannot communicate at the same time and can select and communicate only one voice or handwritten memo at a time.

In the case of Figure 3 is very smooth communication but bandwidth should be somewhat wide and expensive, Figure 4 is inconvenient communication but cheap.

In FIG. 3, a received signal input through a wired or wireless network is separated into a transmitted signal and a received signal by the signal transmitting and receiving unit 2 through the network connection unit 1, and when received, a signal from the modulation and demodulation unit 3 which is a modem. After demodulation, the demodulated signal is separated into speech and data through a demultiplexing process through a multiplexing / demultiplexing unit (4). The speech is output to the speaker (7) via a codec (5), and the data is obtained by a microcomputer ( 9) is stored in the memory (8) and sent to the LCD (10) at the same time through graphics processing. In addition, during transmission, the graphic command input to the touch panel 11 is also displayed on the LCD 10 and at the same time, multiplexed with the voice input through the microphone 6, and then becomes a single signal to undergo a modulation process. The signal comes out through the net.

In FIG. 4, a received signal input through a wired or wireless network is separated into a transmission signal and a reception signal by the signal transmission / reception unit 2 through the network connection unit 1, and at the time of reception, a signal from the modulation / demodulation unit 3 which is a modem. After demodulating, the demodulated signal is outputted through the codec (5) to the speaker (7) if it is voice communication, and stored in the memory (8) through graphic processing through the microcomputer (9). Are sent to. In the case of voice communication, the modulation process is performed through the modulation and demodulation unit 3 through the microphone 6 and the codec 5 in the case of voice communication, and in the case of data communication, graphic data input to the touch panel 11 is processed and the LCD 10 ) And at the same time through the modulation process, the signal goes through the network through the transmitter.

On the other hand, the number of LCD dots may not be the same between the communication terminals, the types of graphic editing tools may be different, and if the manufacturer or model number is different, compatibility problems may occur between the two communication devices. have.

In order to solve this problem, it is necessary to set the necessary elements before sending and receiving graphic commands between the two communication terminals to determine a common element or element value that satisfies the specifications of both terminals. This initialization process must be performed before the two terminals have completed the connection with each other and send and receive graphic commands.

The method of the present invention in view of these points will be described in detail with reference to FIGS. 5 (a) (b) and 6.

Performing an initialization subroutine prior to data transmission and reception between two terminals;

Determining whether there is a command received;

If there is a received command, sequentially determining whether a communication termination command is received, a whiteboard busy command is received, a whiteboard dead command is received, and a shared graphic command is received;

If all of the received commands are determined to be communication termination commands, storing all pages as a file in a memory and ending communication;

As a result of the above judgment, if the command is in use of the whiteboard, set the whiteboard to 'in use'; if the command is in use of the whiteboard, set the whiteboard to 'disabled'; if the shared graphic command is executed, execute the received shared graphic command. Sending an error message or all of the above commands as a result of determining the command;

Determining whether a 'communication end' command has been input or an on-hook has occurred if no command is received as a result of the determination, or all steps according to each reception command are completed;

Determining whether a 'No Carrier' code is generated if a communication termination command is not input or no on-hook occurs as a result of the above determination;

As a result of the above judgment, if a communication termination command is input or an on-hook occurs, all pages are stored in a file as a file and communication is executed as if the 'No Carrier' code occurred after sending the 'communication termination' command to the other party. Terminating;

Judging whether the execution of the independent graphic command is started if a 'No Carrier' code is not generated as a result of the determination;

If it is determined as described above that the execution of the sole graphics command is to wait until the completion of the execution of the discrete graphics command to perform the discrete graphics command;

Determining whether to start the shared graphic command if the single graphic command has not been started as a result of the above determination;

As a result of the above judgment, if the execution of the shared graphic command is not started, the process returns to the initial stage. If the execution of the shared graphic command is started, it is determined whether the whiteboard is in use. Then returning to the initial stage;

If it is determined that the whiteboard is not in use, sending a 'busy' command to the other party and then determining whether the whiteboard has received a 'busy' command;

As a result of the above judgment, if the whiteboard receives the 'in use' command, it starts to use at the same time and recognizes that a conflict has occurred.If it starts to draw some graphics, it clears the part and cancels execution, Sending and returning to the initial stage;

Waiting for the execution of the shared graphics command if the whiteboard did not receive the 'in use' command as a result of the above determination;

If the wait is completed as a result of performing the shared graphics command, and sends a whiteboard 'disabled' command to the counterpart, performing the shared graphics command and returning to the initial stage; characterized in that consisting of.

In the above initialization subroutine, sending and receiving the manufacturer number, model number, version number with the other party;

Determining whether the manufacturer number, model number, and version number are the same, and setting the size of the workspace to the whiteboard and ending;

If the manufacturer number, model number, and version number are not the same as above, the dot size of the LCD screen and the size of the workspace are exchanged, and then the new whiteboard is used to determine the minimum of the X-axis value and the minimum of the Y-axis value in the size of the workspace. After setting to the set of shared graphics commands to and from the other party, and then the command of the common elements of the shared graphics commands sent and received, characterized in that the step consisting of setting and ending a new set of shared graphics commands.

Referring to the operation and effect of the method of the present invention consisting of these steps are as follows.

First, when communication is established between two terminals and the connection is successful, the two terminals perform the initialization process before the connection is completed and send and receive graphic commands. The necessary elements for the initialization process are the manufacturer, model number, and version. The size of the screen and workspace, including the number.

Such manufacturer, model number and version number is the manufacturer, model number and version number of the program of the terminal, and the graphic specification and the function of the graphic editing tool supported by the version number must be disclosed in advance.

In addition, the size of the screen and workspace is the size that can represent the actual graphic except the title area and the area of the editing tool in the total size and total size of the LCD represented by the size of dots. do.

On the other hand, the sharing graphic command (sharing graphic command) is a graphic editing command to be performed on the own device and at the same time sent to the other device among the tools for graphic editing, for example, the following command.

First, in drawing, there are free lines, straight lines, circles, and rectangles. A free line is a function that draws a pen trajectory, and points connected by commands drawing a connection point from pen down to pen up. A thickness element is required, a line requires two points connected by a command connecting two points, and an element of thickness of a line, and a circle requires an element of center point, two radial lengths, and a thickness by drawing an ellipse. If two points in the diagonal direction are given, the rectangle needs two points and a thickness element.

Second, in erasing, erase, block, and full-screen erase can be performed. In this case, erase is a command for erasing the dots in the trajectory through which the pen passes. Block erasing is a command that selects an area of a rectangle and erases the picture in it, and two point elements are required. Erasing full screen is a command that erases all pictures in the workspace.

Third, open the file by opening the file, adjust the size of the file to match the current whiteboard, and send it to the other party.

Fourth, in block cutting, pasting, and copying, block cutting selects two points to select a rectangular area, saves the picture of the area in memory, builds a picture of the area, and blocks copy two points. Select the area of the rectangle and save the picture of the area in memory, and block paste is a command to copy the picture of the block to the desired location when it is saved in the memory after executing the block cutting or copying command. Memory data and location are required.

Fifth, in adding and deleting pages, adding a page is a command for creating a workspace of one page and linking to a previous page, and deleting a page is a command for deleting a currently selected page.

Sixth, by expanding and scrolling pages, the workspace is expanded left and right or up and down on one page, and the scrolled portion is scrolled to work.

Seventh, it is a command to move back and forth of the page, and the seventh character input is a command for moving the characters input by the keyboard to a desired position, and the elements of the character value and position are necessary.

Ninth, it is a command to cancel the work performed in the reverse order. In this case, the work must be stored in the memory. In some cases, only the last execution result can be saved.

In addition, the single graphic command is a graphic editing command which is executed only on one's own device and not sent to the other device among the tools for graphic editing. For example, the following command may be used.

First, with the file list view command, you can see a list of saved files. If you select and open a file, the result is displayed on the LCD and sent to the other party.

Second, you can save the contents of the current job with the Save File command. Third, you can select the pen thickness used to perform the graphic commands with the Pen Width Selection command.

The fourth menu view command acts as an icon or button to view the contents of a menu.

In addition, the whiteboard status command is when the busy state of the whiteboard is in use by the first busy command, and the second board can be used first because nobody is using the whiteboard by the idle command. to be.

In addition, a disconnect command or signal is a case in which a terminal participating in the communication ends communication and returns to voice communication or tries to terminate all communication to a telephone station or a base station. When two terminals communicate, if one end of communication, the other end sends a communication termination command to the other end, or when the carrier signal is lost from the communication network, the modem informs the central processing unit to know that the communication is terminated.

On the other hand, when the communication between the terminal to which the present invention is applied is subjected to the initialization process as described above.

That is, the terminals exchange their producer number, model number, and version number with the other party, and as a result, if their producer number, model number, and version number are the same mode, the terminal sets the size of the workspace dot to the size of the whiteboard and initializes it. The process ends.

However, if the producer number, model number, and version number of the terminals are different, the size of the LCD dot and the size of the workspace dot are exchanged. If the size of the workspace dot is different, the smallest value on the X axis is used as the X value of the whiteboard. Set the smallest value on the Y axis to the Y value on the whiteboard.

After that, the shared graphic command is exchanged with the other party, and then only the common command is set as the new shared graphic command.

On the other hand, when the initialization is completed, it is checked whether there is a command sent from another terminal. As a result, if there is a command sent by the other party, it checks whether the command is the end of communication. And communication ends.

However, if the command is not the end of communication, check whether the whiteboard is in use. If the whiteboard is in use, set the whiteboard to be in use, and then check whether the end of communication is entered. As a result of the above judgment, if it is not the whiteboard 'in use' command, find out whether it is 'disabled' or 'unused' command.If the whiteboard is 'inactive' command, set the whiteboard to 'unused' and then 'end communication' Enter the command confirmation phase.

As a result of the above determination, if the whiteboard 'disabled' command is not a shared graphic command, if the shared graphic command is executed, the graphic command is executed, and then the 'communication terminated' command check step is entered. Display the message and enter the 'terminate communication' command confirmation step.

Also, as a result of checking in each of the above-mentioned steps, if the command is not sent by the other party, check whether the 'communication end' command is input or on-hook has occurred. Save all the pages you were working on as a file and end the communication.

However, as a result of the above determination, if it is not the 'end of communication' command or if no on-hook occurs, check whether the 'No Carrier' code is generated that the carrier is disconnected. If 'No Carrier' occurs, save all pages as a file in memory and communicate To exit.

On the other hand, if the 'No Carrier' has not occurred as a result of the above determination, it checks whether the execution of the single graphic command is started, and if so, waits for the end and then returns to the step of executing the command and checking whether there is a command sent from another terminal. .

As a result of the determination, if the single graphic command is not performed, the method checks whether the execution of the shared graphic command is started, and if the shared graphic command is not performed, returns to the step of checking whether there is a command sent from another terminal as described above.

In addition, if the execution of the shared graphics command is determined as above, if the whiteboard is in use, a warning message is displayed on the screen and stops the execution, and then returns to the step of checking whether there is a command sent from another terminal as described above. .

If the whiteboard is not in use, it sends a whiteboard 'busy' command to the other party and waits for the shared graphics command to finish.

If there is a conflict in the use of the whiteboard by starting the shared graphic command with the other party at the same time, the conflict message is displayed on the screen and the process returns to the step of checking whether there is a command sent from another terminal as described above. Continue until it's over.

After the execution, send the whiteboard 'disabled' command to the other party, perform the task corresponding to the shared graphic command, and then return to the step of checking whether there is a command sent from another terminal as described above. Whether it is wireless or wired, when a terminal participating in communication sends and receives graphic data for communication, it can always communicate while maintaining the same screen.

As described above, according to the present invention, a terminal participating in a communication using a white graphic board, which is a virtual graphic space, introduces the concept of working while sharing this space, and uses only one person by sharing the white board. It can be occupied and used only for graphic work, and once a unit of graphic is used, the user can freely use the whiteboard and use it again, and apply the unit of graphic directly to the image screen so that no memory is required. This can be done on PDAs with low screen and computing power, and graphics can be edited based on the image itself, and voice and data can be shared through commands shared between two devices with different manufacturers, models, and version numbers. By allowing communication to take place, Regardless of whether it is wireless or wired, when a terminal participating in communication sends and receives graphic data for communication, it can always communicate while maintaining the same screen.

Claims (2)

Performing an initialization subroutine prior to data transmission and reception between two terminals; Determining whether there is a command received; If there is a received command, sequentially determining whether a communication termination command is received, a whiteboard busy command is received, a whiteboard dead command is received, and a shared graphic command is received; If all of the received commands are determined to be communication termination commands, storing all pages as a file in a memory and ending communication; As a result of the above judgment, if the command is in use of the whiteboard, set the whiteboard to 'in use'; if the command is in use of the whiteboard, set the whiteboard to 'disabled'; if the shared graphic command is executed, execute the received shared graphic command. Sending an error message or all of the above commands as a result of determining the command; Determining whether a 'communication end' command has been input or an on-hook has occurred if no command is received as a result of the determination, or all steps according to each reception command are completed; Determining whether a 'No Carrier' code is generated if a communication termination command is not input or no on-hook occurs as a result of the above determination; As a result of the above judgment, if a communication termination command is input or an on-hook occurs, all pages are stored in a file as a file and communication is executed as if the 'No Carrier' code occurred after sending the 'communication termination' command to the other party. Terminating; Judging whether the execution of the independent graphic command is started if a 'No Carrier' code is not generated as a result of the determination; If it is determined as described above that the execution of the sole graphics command is to wait until the completion of the execution of the discrete graphics command to perform the discrete graphics command; Determining whether to start the shared graphic command if the single graphic command has not been started as a result of the above determination; As a result of the above judgment, if the execution of the shared graphic command is not started, the process returns to the initial stage. If the execution of the shared graphic command is started, it is determined whether the whiteboard is in use. Then returning to the initial stage; If it is determined that the whiteboard is not in use, sending a 'busy' command to the other party and then determining whether the whiteboard has received a 'busy' command; As a result of the above judgment, if the whiteboard receives the 'in use' command, it starts to use at the same time and recognizes that a conflict has occurred.If it starts to draw some graphics, it clears the part and cancels execution, Sending and returning to the initial stage; Waiting for the execution of the shared graphics command if the whiteboard did not receive the 'in use' command as a result of the above determination; If the result of the waiting for the shared graphics command is finished, sending a whiteboard 'disabled' command to the other party and then performing the shared graphics command and returning to the initial stage; communication terminal having a graphics function, characterized in that consisting of How to synchronize screen content on. The method according to claim 1, The initialization subroutine, the step of sending and receiving the manufacturer number, model number, version number with the other party; Judging whether the manufacturer number, model number, and version number are the same, and setting the size of the workspace to the whiteboard and ending; If the manufacturer number, model number, and version number are not the same as above, the dot size of the LCD screen and the size of the workspace are exchanged, and then the new whiteboard is used to determine the minimum of the X-axis value and the minimum of the Y-axis value in the size of the workspace. After setting the set of shared graphics commands to and from the other party, and then set only the commands of the common elements of the shared graphics commands sent and received and set to a new set of shared graphics commands and ends; having a graphics function, characterized in that consisting of Method of synchronizing screen contents in communication terminal.