KR101407939B1 - Method of providing drawing conference service based on touch events, and computer-readable recording medium with drawing conference program for the same - Google Patents

Abstract

The present invention relates to a drawing conference technology based on a touch event in a smart terminal. More particularly, the present invention relates to a method and apparatus for providing a touch-operated conference or the like on a document or an image set in a sink on the basis of a drawing made by a user's touch operation between touch screen based terminals, And more particularly, to a touch event-based drawing conference technology configured to operate. According to the present invention, a user can send and receive a drawn drawing while viewing a same document or an image among a plurality of terminals connected to a conference network and conducting a conference, thereby providing a quick and accurate communication power. In addition, according to the present invention, only the touch event information and the meta data are transmitted instead of the transmission of the drawing image itself, thereby reducing the amount of data transmitted and received between terminals compared to the conventional image data transmission method, Service provides a possible effect.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a touch event based drawing conference method and a touch event based drawing program,

The present invention relates to a drawing conference technology based on a touch event in a smart terminal. More particularly, the present invention relates to a method and apparatus for providing a touch-operated conference or the like on a document or an image set in a sink on the basis of a drawing made by a user's touch operation between touch screen based terminals, And more particularly, to a touch event-based drawing conference technology configured to operate.

A touch screen based terminal such as a smart phone, a smart pad, a tablet computer, and the like, and an interactive system and corresponding information exchange application are widely used due to expansion of wireless Internet service.

However, these information exchange applications are merely a conversation through a character input of a virtual keyboard, so that not only their own personality can be expressed to the other person but also there are many limitations in expressing information to be exchanged in various ways.

In addition, since a conventional touch-screen-based information exchange service can exchange only characters and images, a QWERTY keyboard implemented as a UI screen on a touch screen, a child or an elderly person with a 3 × 4 keyboard unfamiliar with a UI There is a problem that it takes a long time to input.

Particularly, since the information exchange service (for example, group chat, etc.) conventionally used for the multi-party conference is composed based on the transmission function for various attachments such as an image file or the like, There is a disadvantage in that the ability to transmit accurate information is insufficient. Therefore, the actual utilization value is not high.

[Related Technical Literature]

1. Method for providing education, broadcasting, multi-party video conference and chat service using the Internet (Patent Application No. 10-2000-0080181)

2. A mobile communication terminal and a character conference service method supporting a character conference function using a short message service (Patent Application No. 10-2006-0011103)

3. System and method for real-time text conference service providing animation effect to text (Patent Application No. 10-2002-0023399)

An object of the present invention is to provide a drawing conference technology based on a touch event in a smart terminal. More particularly, it is an object of the present invention to provide a conference service by promptly transmitting / receiving a drawing drawn by a user on a touch screen provided on a terminal while viewing the same screen among terminals connected to a conference network, To provide a touch event-based drawing conferencing technology to transmit seamless touch event information and meta data, not the transmission of the drawing image itself, thereby reducing the amount of data transmitted and received to enable seamless service in the transmission of multi-party conference data .

According to another aspect of the present invention, there is provided a touch event-based drawing conference method for a touch event based on a drawing event, the method comprising the steps of: receiving, by a calling terminal, one or more receiving terminals (drawing conference receiving terminals) A first step of synchronizing a background image through a conference server to set a common background image; The touch event information and the meta information are generated corresponding to the drawing input through the touch on the common background image set on the touch screen of the calling terminal of the calling terminal user and then the drawing event data is generated by matching the touch event information and the meta information A second step; A third step of the calling terminal setting the drawing data as conference data and transmitting the drawing data through a drawing conference server connected to the conference network; And a fourth step in which the drawing receiving terminal recognizes that the drawing data is included in the touch event information and then implements the drawing image on the common background image using the meta information.

In this case, the third step may include analyzing whether the character data based on the character input by the calling terminal user or the image data based on the image designated by the calling terminal user, in addition to the drawing data, according to the transmission request; And generating conference data by packetizing the drawing data and the character data or the image data when the character data or the image data is included.

In the present invention, the meta information includes coordinate information, time information, decompression information, drawing setting information according to a drawing input, the coordinate information is information on a coordinate change on the touch screen according to a drawing input, The pressure setting information is information on the pressure change applied to the touch screen by the user of the calling terminal, and the drawing setting information is information on the drawing property of the calling terminal user, and the pen type, pen color, pen transparency, Pen thickness.

4-1) analyzing whether or not touch event information is included in the conference data after the drawing conference terminal receives the conference data from the calling terminal; (4-2) extracting the drawing data from the conference data when the conference data includes touch event information; A fourth step of extracting meta data from the drawing data extracted by the receiving end of the drawing meeting; A fourth step of analyzing a change in drawing coordinates according to time using the time information and the coordinate information included in the extracted metadata to implement a drawing image; A fourth step of applying the drawing effect using the decompression information and the drawing setting information included in the metadata extracted in the drawing image of the drawing meeting terminal; And if the touch event information is not included in the conference data received by the receiving end of the drawing conference, character data or image data is extracted from the received conference data to implement a character or an image.

In step 4-5, the user of the calling terminal on the drawing image applies the shadow of the drawing image area differently using the pressure change information applied on the touch screen by using the decompression information included in the extracted extracted metadata Step 4-51; And pen-type, pen color, pen transparency, and pen thickness of the drawing image area by the calling terminal user using the drawing setting information included in the extracted metadata.

A computer-readable recording medium according to the present invention is a computer-readable recording medium for storing background images (hereinafter, referred to as " background images ") through a drawing conference server for one or more receiving terminals (drawing conference receiving terminals) designated by a calling terminal user among receiving terminal groups connected via a conference network A background image sink means (15a) for performing synchronization and setting a common background image; The touch event information and the meta information are generated according to the drawing input through the touch on the common background image set on the touch screen of the calling terminal of the calling terminal user and then the drawing event data is generated by matching the touch event information and the meta information Drawing data generating means (15b); A conference data generating means (15c) for controlling the transmission / reception unit to transmit the drawing data from the calling terminal to the drawing conference terminal via the drawing conference server connected to the conference network in accordance with the transmission request for the drawing data of the calling terminal user; A conference data analysis unit (15d) for controlling the transmission / reception unit to receive conference data from the reception terminal group, and extracting the drawing data from the conference data when touch event information is included in the received conference data; Extracting the metadata from the extracted drawing data, analyzing the changes of the drawing coordinates according to time using the time information and the coordinate information included in the extracted metadata, and drawing the drawing image on the common background image set on the touch screen The drawing conference receiving terminal recognizes that the drawing data is included in the touch event information, and then the drawing image is implemented on the common background image using the meta information This is a recording of a drawing event based on the touch event.

According to the present invention, a user can send and receive a drawn drawing while viewing a same document or an image among a plurality of terminals connected to a conference network and conducting a conference, thereby providing a quick and accurate communication power.

In addition, according to the present invention, only the touch event information and the meta data are transmitted instead of the transmission of the drawing image itself, thereby reducing the amount of data transmitted and received between terminals compared to the conventional image data transmission method, Service provides a possible effect.

1 illustrates an overall system in which a touch event-based drawing conference method according to the present invention is implemented.
2 is a diagram showing the configuration of a calling terminal in the overall system of the present invention.
3 is a diagram showing a configuration of a drawing conference module in a calling terminal of the present invention.
4 is a diagram for explaining a UI screen implemented in a calling terminal in the present invention;
5 is a flowchart showing a process of a calling terminal in a drawing conference method according to the present invention.
6 is a flowchart showing a process of a receiving terminal in a drawing conference method according to the present invention;

Hereinafter, the present invention will be described in detail with reference to the drawings.

1 is a diagram illustrating an entire system in which a touch event-based drawing conference method according to the present invention is implemented. 1, a whole system in which a touch event-based drawing conference method is implemented includes a calling terminal 10, a conference network 20, a drawing conference server 30, and a receiving terminal group 40.

2 is a diagram showing the detailed configuration of the calling terminal 10 in the present invention. 2, the calling terminal 10 includes a touch clean 11, a transmitting / receiving unit 12, a control unit 13, a storage unit 16, a gyro sensor 17, and a system memory area A, And a conferencing application 14 that is implemented in the Internet. In addition, the conference application 14 has a drawing meeting module 15.

The control unit 13 automatically sets the speaker output communication mode ('one call') when the calling terminal 10 is located on the horizontal plane through the gyro sensor 17, The setting to the speaker output call mode is performed through the user operation. Then, the control unit 40 controls the transmitting / receiving unit 12 to establish a call connection with one or more receiving terminals specified by the user of the calling terminal 10 (hereinafter referred to as 'calling terminal user') in the receiving terminal group 40.

Here, as shown in FIG. 4A, call origination of the calling terminal 10 is automatically performed according to the setting of the speaker output calling mode, and when a call connection is made, a message such as " The control unit 13 can control the background image setting button B to be implemented on the touch screen 11. [ On the other hand, the call connection is established according to the setting of the speaker output communication mode, and the control unit 13 controls the voice output through the speaker 18, and the voice input of the calling terminal user is performed through a microphone (not shown) . Here, the speaker output call mode may be referred to as a name such as 'one call' depending on the terminal model.

The control unit 13 loads the conferencing application 14 into the system memory area A according to the request of the calling terminal user to execute the conferencing application 14 through the touch screen 11, And drives the drawing meeting module 15 provided therein.

3 is a diagram showing a detailed configuration of the drawing meeting module 15 in the present invention. 3, the drawing meeting module 15 includes a background image sink unit 15a, a drawing data generation unit 15b, a conference data generation unit 15c, a conference data analysis unit 15d, And means 15e. FIG. 4 shows a UI screen implemented in the calling terminal 10. FIG.

Hereinafter, the overall system in which the touch event-based drawing conference method according to the present invention is implemented, focusing on the drawing conference module 15, will be described in detail with reference to FIG. 1 to FIG.

The background image sinking means 15a of the drawing meeting module 15 is adapted to allow the background image sinking means 15a of the drawing meeting module 15 to designate one image among the various images stored in the storage unit 16 of the calling terminal user through the touch screen 11, And receives a background image setting request signal from the background image setting unit 11. Then, the background image is transmitted through the drawing conference server 30 connected to the conference network 20 to one or more receiving terminals (hereinafter referred to as 'drawing conference receiving terminals') designated by the calling terminal user of the receiving terminal group 40 do. 4B, when the user of the calling terminal inputs the background image setting button B and selects the common background image for one of the various images stored in the storage unit 16, the background image as shown in FIG. 4C is displayed And the drawing conference receiver is set to the same background image according to the synchronization control of the drawing conference server 30 connected to the conference network 20. [

 Meanwhile, in another embodiment of the present invention, the calling terminal user may set a route map or a general document as a background image. Accordingly, the drawing conference server 30 sets the background image to be the same as the background image set in the drawing conference receiving terminal through the conference network 20, thereby performing the background image sinking.

When the calling terminal user operates the drawing conference, the drawing data generating means 15b receives the drawing conference request signal corresponding thereto and waits for drawing input on the touch screen 11 by the calling terminal user.

The drawing data generating means 15b generates touch event information and meta information according to the drawing input of the calling terminal user, and generates drawing data by matching the touch event information and the meta information.

Here, FIG. 4D shows a character data and image data input mode, and FIG. 4E shows a drawing data input mode. First, when the cursor C and the mode conversion button T are implemented in the character data and image data input mode (FIG. 4D), the calling terminal user can touch the QWERTY keyboard, the 3 × 4 keyboard, 11), it is possible to input character data and image data for a conference.

When the mode conversion button T is touched by the calling terminal user, a pen icon for inputting the drawing data after converting into the drawing data input mode as shown in FIG. 4E can be implemented.

The drawing data generating means 15b generates touch event information and meta information according to a drawing input through a touch to the touch screen 11 of the calling terminal user and then matches the touch event information with the meta information to generate drawing data And stores it in the storage unit 16. Here, the meta information includes coordinate information based on a drawing input, time information, decompression information, and drawing setting information. The coordinate information is information on a coordinate change on the touch screen 11 according to a drawing input. The time information is information on a time when the coordinate change occurs. The decompression information is information It means information about the change of pressure. In addition, the drawing setting information may include, for example, pen type, pen color, pen transparency, and pen thickness information as information relating to a drawing attribute. In FIG. 4E, an algorithm may be provided so as to provide a detailed menu corresponding to the input of the setting button S.

After storing the drawing data in the storage unit 16, the drawing data generation unit 15b sends a generation completion notification to the conference data generation unit 15c.

The conference data generation means 15c generates the conference data in accordance with the drawing data generated by the drawing data generation means 15b in response to the transmission request through the touch screen 11 of the calling terminal user, Quot; character data "by the user, or" image data "by the image designated by the user. Here, the generation timing of the character data and the image data can be generated irrespective of before and after generation of the drawing data.

According to the result of the analysis, when the character data or the image data is not included, the conference data generation means 15c generates the conference data through the drawing conference server 30 connected to the conference network 20, And controls the transmission / reception unit 12 to transmit the message.

On the other hand, according to the analysis, when the character data or the image data is not included, the conference data generating means 15c packetizes the drawing data generated by the drawing data generating means 15b, the character data or the image data, And controls the transmitting and receiving unit 12 to transmit the conference data to the receiving terminal group 40 through the drawing conference server 30 connected to the conference network 20. [

The conference data analyzing unit 15d controls the transmitting and receiving unit 12 to receive the conference data from any one of the receiving terminal groups 40 through the drawing conference server 30 connected to the conference network 20. [

The conference data analyzing unit 15d analyzes whether the touch event information is included in the received conference data, and then determines whether the touch event information is included in the received conference data. When the touch event information is included in the conference data, the conference data analysis unit 15d extracts the drawing data from the conference data. Conversely, when the received conference data does not contain touch event information, the conference data analysis unit 15d extracts character data or image data from the received conference data to implement a character or an image on the touch screen 11 .

The drawing data implementing means 15e extracts the meta data from the drawing data extracted by the meeting data analyzing means 15d.

The drawing data implementing means 15e analyzes the change of the drawing coordinates according to the time flow using the time information and the coordinate information included in the extracted metadata to implement the drawing image on the touch screen 11. [

The drawing data implementing means 15e applies the drawing effect using the decompression information and the drawing setting information included in the extracted metadata in the drawing image. For example, the user of the calling terminal 10 on the drawing image can apply the shadow of the corresponding drawing image area using the pressure change information on the touch screen 11 using the reduced pressure information. When the pressure of the user of the calling terminal 10 on the touch screen 11 on the drawing image is relatively high using the decompression information, the shade of the pen color is darkly applied, and when the pressure is relatively weak, the shade can be applied brightly. The pen type, pen color, pen transparency, and pen thickness of a specific area of the drawing image by the user of the calling terminal 10 using the drawing setting information.

5 is a flowchart showing a process of a calling terminal in a drawing conference method according to the present invention.

First, the control unit 13 controls the transmitting / receiving unit 12 to establish a call connection with the drawing conference receiving terminal in the speaker output calling mode (S11). It is determined that the calling terminal 10 is located on the horizontal plane through the gyro sensor 17 and is set to the speaker output calling mode automatically or if the calling terminal user provides the mode setting input on the touch screen 11, do. When the speaker output communication mode is set, the controller 13 controls the voice output through the speaker 18 according to the call connection, and voice input of the calling terminal user is performed through a microphone (not shown). The speaker output call mode may also be referred to as a call function depending on the terminal model.

After step S11, the control unit 13 loads the conference application 14 into the system memory area A when the calling terminal user requests execution of the drawing conference service, and the loaded conference application 14 again And drives the drawing meeting module 15 provided therein (S12).

The drawing meeting module 15 receives an image designation through user operation among various images stored in the storage unit 16 of the calling terminal user and receives a background image setting request signal from the touch screen 11, (S13). The background image synchronization (sinking) is achieved through the drawing conference server 30, which is connected to the conference network 20 by means of a drawing conference receiving terminal.

On the other hand, the calling terminal user may set a route map or a general document as a background image. Accordingly, the drawing conference server 30 The same image as the background image set in the drawing conference receiving terminal in step S11 is set as the background through the conference network 20.

The drawing meeting module 15 waits for a drawing input of the user of the calling terminal to the touch screen 11 in response to receiving the drawing meeting request signal through the touch screen 11 of the calling terminal user (S14).

The drawing meeting module 15 generates touch event information and meta information according to the drawing input through the operation of the touch screen 11 of the calling terminal user, and generates drawing data by matching the touch event information and the meta information (S15 ).

Here, the meta information includes coordinate information based on a drawing input, time information, decompression information, and drawing setting information. The coordinate information is information on a coordinate change on the touch screen 11 according to a drawing input. The time information is information on a time when the coordinate change occurs. The decompression information is information It means information about the change of pressure. The drawing setting information may include information relating to a drawing attribute by the calling terminal user, such as pen type, pen color, pen transparency, and pen thickness.

After the step S15, the drawing conferencing module 15 receives the drawing data generated in step S13 in accordance with the transmission request through the touch screen 11 of the user of the calling terminal 10, Or whether image data is included in the image designated by the user (S16).

According to the analysis of step S16, the drawing meeting module 15 determines whether or not character data or image data is included in the drawing data (S17).

If the drawing data does not include the character data and the image data as a result of the determination in step S17, the drawing meeting module 15 uses the drawing data generated in step S13 as meeting data, To the receiving terminal group 40 through the conference server 30 (S18).

On the other hand, when the drawing data includes character data or image data as a result of the determination in step S17, the drawing meeting module 15 determines that the drawing data generated in step S15 and the character data analyzed in step S16, The data is packetized to generate conference data (S19).

After the step S19, the drawing conference module 15 transmits the generated conference data to the drawing conference terminal through the drawing conference server 30 (S20).

6 is a flowchart showing a process of a receiving terminal in a drawing conference method according to the present invention.

First, when receiving the conference data from the calling terminal 10 through the drawing conference server 30 connected to the conference network 20, the drawing conference receiving terminal analyzes whether or not the conference data includes touch event information (S21) . Meanwhile, in the step S21, the conference application and the drawing conference module are loaded in the system memory area. For convenience of explanation, the receiving terminal describes each receiving terminal of the receiving terminal group as a reference, but in reality, Is performed by the conference module.

Then, the receiving terminal determines whether the touch event information is included in the conference data according to the analysis of step S21 (S22).

If it is determined in step S22 that the touch event information is included in the conference data, the receiving terminal extracts the drawing data from the conference data (S23).

After step S23, the receiving terminal extracts metadata from the drawing data extracted in step S23 (S24).

After the step S24, the receiving terminal analyzes the drawing coordinate changes according to the time flow using the time information and the coordinate information included in the metadata extracted in the step S24 (S25).

After the step S25, the receiving terminal applies the drawing effect to the drawing image implemented in the step S25 using the decompression information and the drawing setting information included in the metadata extracted in the step S24 (S26). For example, the user of the calling terminal on the drawing image can apply different shades of the corresponding drawing image area using the pressure change information on the touch screen 11 by using the decompression information. When the pressure applied by the calling terminal user on the touch screen 11 is relatively high on the drawing image, the shade of the pen color is darkly applied, and when the pressure is relatively weak, the shade is brightly applied. The pen type, pen color, pen transparency, and pen thickness of a specific area of the drawing image by the user of the calling terminal 10 using the drawing setting information.

On the other hand, if it is determined in step S22 that the touch event information is not included in the conference data, the receiving terminal extracts the character data or the image data from the conference data received in step S21 to implement the character or image on the touch screen (S27).

The present invention can also be embodied in the form of computer readable code on a computer readable recording medium. At this time, the computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage, and the like, and may be implemented in the form of a carrier wave . The computer-readable recording medium can also be stored and executed by a computer-readable code in a distributed manner on a networked computer system. And functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

As described above, the embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention. And is not intended to limit the scope of the invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: Originating terminal
11: Touch screen
12: Transmitting /
13:
A: System memory area
14: Conference application
15: Drawing Meeting Module
15a: background image sink means
15b: Drawing data generating means
15c: means for generating conference data
15d: Meeting data analysis means
15e: Means for implementing drawing data
16:
17: Gyro sensor
20: Conference Network
30: Drawing Conferencing Server
40: Receiving terminal group

Claims (7)

A first step of establishing a common background image by synchronizing a background image with at least one receiving terminal (drawing conference receiving terminal) designated by the calling terminal user among the receiving terminal groups connected through the calling terminal and the conference network through the drawing conference server; ;
The touch event information and the meta information are generated in correspondence with the drawing input through the touch on the common background image set on the touch screen of the calling terminal of the calling terminal user and then the touch event information and the meta information are matched with each other, A second step of generating a second step;
The calling terminal sets the drawing data as conference data and transmits the drawing data to the drawing conference receiving end through a drawing conference server connected to the conference network. In addition to the drawing data, And analyzing whether or not the image data is included in the image designated by the calling terminal user, and when the character data or the image data is included as the analysis result, packetizing the drawing data, the character data or the image data, And transmitting the generated data to the receiving end of the drawing conference;
A fourth step of implementing a drawing image on the common background image using the meta information after the drawing conference receiver recognizes that the drawing data is included in the touch event information;
A touch event based drawing meeting method comprising:
delete The method according to claim 1,
Wherein the meta information includes coordinate information, time information, decompression information, and drawing setting information according to the drawing input,
Wherein the coordinate information is information on a coordinate change on the touch screen according to the drawing input,
The time information is information on a time at which the coordinate change occurred,
The decompression information is information on a pressure change applied to the touch screen by the calling terminal user,
Wherein the drawing setting information includes information related to a drawing attribute of a calling terminal user, including a pen type, a pen color, a pen transparency, and a pen thickness.
The method of claim 3,
In the fourth step,
A step 4-1 of analyzing whether or not touch event information is included in the conference data after the drawing conference receiving end receives the conference data from the calling terminal;
(4-2) extracting the drawing data from the conference data when the drawing conference receiving end includes the touch event information in the conference data;
(4-3) in which the terminal of the drawing conference extracts metadata from the extracted drawing data;
A fourth step of analyzing a change of drawing coordinates according to a time flow using the time information and the coordinate information included in the extracted metadata to implement a drawing image;
A fourth step of the drawing conference receiving the drawing effect using the decompression information and the drawing setting information included in the extracted metadata in the drawing image;
And a touch event based drawing meeting method.
The method of claim 4,
In the step 4-5,
(4-51) a user of the calling terminal on the drawing image applies different shades of the drawing image area using the pressure change information applied to the touch screen by using the decompression information included in the extracted metadata;
(4-52) applying pen type, pen color, pen transparency, and pen thickness of a drawing image area by a calling terminal user using drawing setting information included in the extracted metadata;
And a touch event-based drawing meeting method.
The method of claim 4,
In the fourth step,
If the touch event information is not included in the received conference data, extracting character data or image data from the received conference data to implement a character or an image;
Wherein the touch event-based drawing meeting method further comprises:
A computer-readable recording medium on which a touch event-based drawing conference program for executing a touch event-based drawing conference method according to any one of claims 1 and 3 to 6 is recorded.

Images