TWI226173B - Electronic chat and instant messaging with ink data - Google Patents

Abstract

A method and apparatus for implementing ink data communication between multiple parties using computing and/or communication devices on a network is disclosed. An electronic chat system comprising a hardware interface layer for receiving raw ink data from an input device, an ink management layer for processing the raw ink data into a form usable by a chat interface layer, and a network interface layer for transferring the processed ink data across a network to a chat interface layer on a remote computer.

Description

Description of the invention The scope of the invention The scope of this invention is related to the use of computers and / or communication devices for communication. The invention relates to the use of computers and / or people to sign data communication on a network. The services of the invention hall and chat room are provided by the Internet service, which is called jasmine, and most of the participants in the public meeting place are called RA and urdu. Conversation through a shared whiteboard

I: "Information: Scholars or many servers are expanded into a larger area through-network connection to maintain. π Relying on two basic transfer control protocols / Internet is the user mountain) (The Internet system is based on the above network protocol β @t ^ User 碥 implementation provides their connection to a

The guilty party said that / / '' mouth server is running mutually. 〆 ^ 司 服 杰 'the client can access the meeting > $ Guarding YanΨ ^ ㈢ Lin Bei 枓 and many other servers The server is provided to allow the chat room service to operate. The remote server is currently available, such as in the A-master / :: structure application. The feeder accepts one or more end-to-end connections at the same time. Generally speaking, Numerous confessioners and ambassadors " ... film A np. . … ▼ One πΊ 六 疋 矸 chat room service operates on the currently available chat rooms to save information, each: generated, new places, this information will be passed to the Internet on every = quarantine, shrine service: also on the connection The client and its set color management: '# all the information in the feeder when it changes; in: change, code: the chat system (such as Internet multiplayer online iRC), described in Internet Request for Proposal (rfc) i 4 59 I, Internet p

1226173 V. Description of the invention (2) Internet multi-person online chat system agreement ". The current chat room provides less support for non-American Information Interchange Standard Code (ASCI I) characters, and uses languages other than English It is very difficult to communicate (such as the language of ideographic characters). In addition, the current chat room service provides little support for sharing images and signing data messages between clients. Traditional signing data provides a set of Simple information about pen devices moving on an electronic board.

In the past, many clients provided certain services to send images using a dry whiteboard between clients. Each client system had a video camera pointing to a whiteboard on the client website. After capturing the image, it is sent to a server. The server will superimpose the images received by each video camera, and send new images to each client for display. A similar system, Xer〇x pARC% image ~ system (乂 1 (16〇Draw) is described in Vide0 Draw: j〇hn c. Ding Kou and Scott L. Minneman, " A Video Interface For § Collaborative Drawing 'is registered in "丨In the 90 minutes, the use of shared whiteboards has several shortcomings. The first disadvantage of using shared whiteboards is that it is not easy to communicate linear talks through a shared image space. &Amp; More than two client-side sharing It's difficult to decide which one to use for a whiteboard

It is using shared whiteboards, and it is difficult to follow the sequence when each client uses it. Another disadvantage of using the shared whiteboard is that after the whiteboard fills up, before further use of it, the client must wait for other clients to release their content on the whiteboard. A special case of using chat rooms is traditional instant messaging, where

1226173 V. Description of the invention (3) " A client can immediately send messages to another client or receive flood information from another user or client. Generally speaking, the instant message M) is used on two networks. For users to send short text messages quickly, longer and more complex messages and documents can use traditional e-mail to transfer messages between network users in less time, general e-mail The system supports the transmission of files composed of various forms, including text, pictures, GIF, JPEG, BMP, ΕΕΕ and many other forms. However, the traditional ... and chat room architecture has more restrictions on very few data formats, mainly ASCII text and / or sound. / As the number of IMM and chat room users continues to increase, it is very important that other branch types grow more than simple ASCI I text and / or sound forms. One such type of traditional IMM and chat system currently does not support The data type is a handwritten data type (such as signed data). The use of signed data is particularly important in applications (where traditional text data is less efficient). For example, many other languages are more symbolic than English ( (I.e. a keyboard type that is hand-written rather than text-oriented) is more efficient. As another example, some portable devices, such as personal digital assistants (PDAs), cellular telephones, portable devices, portable pagers, and similar devices are more efficient when used with input devices, while pen input devices The entry of signature data is more efficient than traditional text. Unless handwriting recognition software is used, the handwriting recognition software wastes a lot of system resources. Therefore, a device that integrates non-traditional data types (such as signed data) into traditional IM and conversation architecture is necessary. positive. In addition, a computer is used on a network to communicate between many people. V. Description of the invention (4) The method of data communication and the necessary diagrams are briefly explained. The invention of the present invention is by way of example. Da Sui's illustration method, in which "Cha Zha Ming", and not with the help of Figure 1 to explain one of the examples of the present invention;-, a block diagram of a computer system Series 2 illustrates that the present invention uses μ ^ ^ α, owe > 丨 \ One of the uni-cast protocols, one of the examples of the body distribution system & Figure 3 illustrates the use of the present invention 'Jun «presents a decentralized system, which is one of the bile shell targets of the multi-Cast protocol; and FIG. 4 illustrates the process of the present invention. The functional architecture and processing flow of the specific embodiments are described in detail. The present invention discloses a method and a device for communicating using a computer and / or a communication device at a multi-person gate. Let the reader have a complete understanding of the present invention, however, those skilled in the art will understand that :: knot = to execute, to another: In addition, to avoid ambiguity, methods, and interfaces. Detailed representation and description, 2 focus of the present invention. As indicated by 100, a specific embodiment of the computer system invented by Z is a system or CPU 101. The second system 100 includes a processor for processing digital data (CISC). A complex instruction set arithmetic processing and fine instruction set arithmetic processor (RISC), a very long protection 11111

1226173

v sub = processor (VLIW), a processor that executes a combination of instruction sets, or other processor devices. The processor 101 is connected to a CPU bus no. Signals are transmitted between other components. For the specific embodiment of the drawing, a memory 113 includes a dynamic random access memory (dram) device, a static random access memory (SRAM jf and other memory devices. When the processor 1 0 1 During implementation,

The memory 113 stores information and other intermediary data, and a bridge means that the controller 111 is connected to the CPU bus 11 and the memory 113, and the bridge is the memory controller U1 on the processor 101 The memory 113 and other components in the computer system 100 direct the data flow, and bridge signals from these components to the high-speed 丨 / 0 bus 丨 2 0. For the specific embodiment of the figure, the high-speed 丨 / 〇 bus 丨 2 〇 support high-speed data = processing speed to support peripheral equipment to operate, the bus 丨 2 〇 can be used as a letter, bus or multi-bus For example, the bus 12 can be a peripheral component connection (pc I) bus, a personal computer memory card association (PCMCIA) bus, and other buses. The bus 12 is in the computer system 100. Communication link between components.八位 # Road interface 121 is connected to the bus 12G. This network interface connects the computer to a server or a computer in the network for operation and provides communication in some machines. The network interface 丨 2 J It is used as a telephone modem, cable modem, an integrated service digital network (ISM) communication line or an interface connected to a network. A display device controller 122 is connected to the high-speed I / O bus 120, and the display device controller 122 is connected to the bus

Page 1226173 V. Description of the Invention (6) ---- Row 120, the display device controller 122 allows the display device to be connected to a computer system 'and acts as an interface between the display device and the computer system 100. The, The display device receives information from the processor through the display device controller 22, and then displays the information and data on the user side of the computer system 100. The image input device 124 is connected to the bus 120. The image input device 124 performs operations to input image images and / or handwriting and signature data to the computer system 100. For example, the graphic input device 124 can be used as a video camera. ,, White board, an electronic pen and board or other image input device. The image input device 1 2 4 also includes a traditional handwriting input device, such as a touch screen, a digitizing device, an electronic board, a mouse, an electronic pen, and a light pen. Similar devices. For the specific embodiment of the drawing, a bus bridge 丨 2 3 connects a high-speed I / O bus 120 to an I / O bus 130, and the bus bridge 123 includes a translator to bridge the high-speed I / O bus The signals between the bus 120 and the I / 〇 bus 315. The I / 0 bus 130 operates at a lower processing speed and performs information communication between peripheral devices. The I / 0 bus 130 can be used as a single bus or a combination of multiple buses. For example, the I / 〇 bus 丨 3 〇 includes an industry standard architecture (ISA) bus, an extension An industry standard architecture (EI SA) bus and a macro channel architecture (MCA) bus. The bus 130 provides communication links between components of a computer system. A data storage device 131 can be used as a hard disk device, a floppy disk device, a CD-ROM device, a flash memory device, or other large-capacity storage devices. A keyboard interface 132 allows a keyboard to be connected to the computer system 'and to transmit signals to the computer system 100 from a keyboard. A sound of choice

Page 10, 1226173 V. Description of the invention (7) " The sound controller 133 is also connected to the 1 / 〇 bus 13, whose operation is to make the recording and playback of the sound coordinated, and a little device 135 is also connected to the ^ / bus Row 1 3 0 (such as a traditional mouse or trackball). * The present invention is related to the use of the computer system 00, which enables the signed data to communicate with multiple people on a network. According to a specific embodiment, the drive system for the signed data communication is 00 Execute the response processor ι〇ι execute a series of instructions contained in A memory 11 13, such instructions can be read into the memory by other readable computer media 丨 3, such as data storage ^ set 1 3 1 Or a storage medium on the network, which is contained in the memory 11 3 'of' = a sequence of instructions causes the processor to perform the functions as described. In another specific embodiment, the hard-wired circuit system can be replaced by software instructions or combined with the two to be used in the present invention. Therefore, the present invention does not apply to a specific hardware circuit system or software combination. To put a limit, it will be understood by those skilled in the art that the present invention can be applied to various other computer devices and / or communication devices, such as chat devices, personal digital assistants (PDAs \, / computers, or similar devices. &Amp; Figure 2 illustrates a data decentralized system according to one embodiment of the present invention using a unicast protocol. The data decentralized system 2000 is a network including multiple users 100 and 20 1 -204, and the client 10 〇, and 201—204 can be used by the brain system (such as described in Figure 1). The data distribution system ^ 200 also includes a server 210, each client and server 21. All communication lines, lines 22 1-225 represent the communication lines between the client 100, 200, 208, and 2 10, respectively. The communication lines 2 2 1-2 2 5 can be (for example, )-Use Transmission Control Protocol (TCP) or user data Closure agreement (Dp)

1226173

V. Description of the invention (8)

Internet communication lines. According to a specific embodiment of the present invention, after the client generates an image or a signed data message, the client transmits the image or the signed data message to the server 2 10 through a communication line, and the image or the signed data message The message sent to the server 2 10 is original, which also stores other images or signed data messages sent from other clients. Each client receives the copied image or signature data message, and then the server 210 sequentially sends it to the client 100, 2001-204, and receives it. The client 100 , 201-204 receive the image sent by the server 21 or sign the data message 'and store it in the original of the message they received, so. Each client receives a copy of the message and sends it to the servo state 2 1 0 'in turn and receives it from the server 2 10. The client 1 0, 2 (Π-2 04 will be stored in The original image of the received message or the packet of the signed data message is displayed on the display device. According to a specific embodiment of the present invention, the server 2 can be connected to many other servers with similar configurations, According to another embodiment of the present invention, the communication lines 221-225 may be via a local area network (LAN) or a wide area network (WAN). For non-internet communication lines, the server 2 and the client 1 100, 20 1-204 can be used by any known circuit system. We should understand that the data decentralized system 200 can be connected by many clients to Computer; a single-computer system, in which many clients can communicate with another client using internal communication.

1226173 V. Description of Invention (9) "-

The system 300 is a network including a plurality of clients 100 and 200, and the clients 100 and 201-204 can be used by a computer system (such as described in FIG. 2). The client 1 〇〇, and 20〇 204 are connected to the transmission medium 31, and the transmission medium 3 10 may be, for example, an Internet, a local area network, or a Lu domain network. According to a specific embodiment of the present invention, the first client terminal “0 S” transmits a diagram or a signed data message to the relay device located in the f-material distribution system through a transmission medium 3 1 0 as an image or a signed data packet. In the I client 20, 204, each client 100, and 20, 204 have a receipt ^ ^ original Ning's in order to receive and store the order by other clients and send to the two depositors : The original message in the received message (use, two t to store a single message, and send it to other users, although the original picture of the message received the message, although it conveys an image or signature Like or β village strip display device. The specific implementation examples of like or signed data messages are designed and approved to allow the use of projects, chat and instant messaging t # it # it r Graphic or handwriting input device board; : J; Touch screen, digital electric / lunar milk, a light pen 痞 have been used for a long time as a device familiar with this skill: a simple form to take handwriting input for the public-electronic board movement Extracting information from Bai Zhi, its essence is matched with data. In traditional technology, :: The type of information is usually represented by one of the pens. The food stamp data is expressed at a specific early X and y position. A more similar protocol is also implemented for each user; user: 20 鳊 2 〇4 In their picking up, but from ★ a-· ·-. And, 20 1-204 will display the storage packet in the information structure of the present invention 'and obtain the signing brain, an electronic signing information such as electronic Electronic pen in the so-called time stamp increment

Page 13 1226173 V. Description of Invention (10) In the traditional signature data retrieval device, other parameters include hand position, time, pen pressure, font, color, and other shoulders of the pen movement. The capture device outputs to a processing device through a traditional interface. Although these signature data capture devices already exist in previous technologies, the applications that use them for instant messaging or chat systems have never been heard or proposed. Too. The traditional communicator talked to another person about the fact that one person provided the printed information. The special printed information such as the edge map and the related auxiliary change floor plane are believed to be in the United States. Referring to the architecture of FIG. 4, any input device and handwriting input generally include ~. … Small minds, extra-workers are used for 〆 · road fighting Internet users to transmit text during conversations and talks, many traditional participants have added the function of voice transmission, but have not offered or offered an instant message or The form used in conversations and talks, however, the form of signing data is suitable for the following rationale suitable for the integration of instant messaging or the integration of the chat structure. First, the: type is very suitable for sharing creative activities: tools, examples, 'signature The format of the data is not suitable for visual considerations, such as pointing directions on maps, changing maps, and so on. The third form of signing information is for people-very natural and comfortable to communicate with "but for them • A block diagram illustrates the device 41 of the present invention. On behalf of the traditional different types of devices and other types of traditional \ sub-pen wheel shock This input device 410 generates an X-coordinate, a y-coordinate in the original signing and beating device, and the signing in 4 turns. Printing and printing materials obtained by comparison set 1226173 V. Description of the invention (Π) __   Information between the temples, the signing layer or the device 420 work together, with Lin \ 410 and-hardware interface software suitable for processing higher functions The level of the originalization of the original signature data becomes; in real time, it is used to determine the position of the reference point: the position of the electronic pen point provided by the time-specific device 410, the accuracy of which is improved by precision, and therefore increases Electric & Zihua's handwriting strokes can be greatly attractive in terms of aesthetics, this improved display recognizability and class and machine handwriting recognition. If sexuality can be applied to the human-based device 41, additional information (such as signage input information, color information, and other signing information): Type or line style configuration 41 ° is provided to the hardware interface layer 42〇, for input) can be learned from the input device, the person who provided additional signing capital domain will be able to express and display the available information in the signing data [°? For remote use once the hardware interface layer 42 0 combination The original signed and printed data packet, the packet will transmit the original _ ',,, — the original ^ 30 ·-^ ^ f ^ 43〇ΓΛ " The initial operation of the received original signed data, according to " The type and amount of data received by the surface layer 420 41〇, and whether it must be dusted by the input device through the hardware interface layer 4 2 0. The original = tight or, for example, using traditional technology, the signature The printing management team 43 ° can use the original signing data or insert and smooth out some careless duplicate signing data. In addition, the printing management team 43 is able to use the original technology of transmission and technology to reduce conversion The higher power required for data Beca Fort I, without reducing the original signed print data / and the Beca, shellfish alum, additional

Page 15 1226173

V. Description of the invention (12) At this level, the signing management layer 4300 can also use well-known technology to encrypt, and in addition, the signing management layer 430 can use the pass-through processing technology. The signature data is converted to text form. These processes are: use ::: kind: such as compaction, compression, shrinkage, encryption and handwriting recognition can be transmitted through the Internet. I :: The original signature data is converted into-management sound 43〇1 & ^ form, when the input signature data processing is completed, the signing of Lu Wangli 4 ό ϋ produces the processed answer g, w 1 440, the Nd people look at the Indian shellfish, and convey to The network interface is in the form of the road surface of the second district ^ Computer device: 7 phase valley of Jianye, if the system described in the present invention can not tir the Internet communication line, in some traditional human computers) Jianye Road interface layer 440 'This device (-desktop type, however, Λ has the ability to transmit processed signature data through / passage in particular "Φ υ can be used or is not suitable for the present invention-Data < Α 1 , Then the network interface layer 44.0 can convert the processed signature type, and the network can process λ When the data is signed, the message interface 4Sfn 2 17 will be transmitted to the message layer C0 (for example, the use of the two: ί surface layer 450 for the two power in a computer network ... Self-provided traditional system architecture, the message architecture of the present invention has dealt with it: signing two H packets, using the transmission system, and real-time use in a network environment. In this way, you can pass the transmission Send the signature data to a remote network

Page 16 1226173

V. Description of the invention (13) A __ User, the structure for the 孰知 士 π a > can be similar = domain :: 士 到: his traditional real-time chat function introduction = / = such as the interface layer 450 also Can be used as 440 will be described 徂, said. In this specific embodiment, the network interface 屄 _ /, processed signed data to a chat interface layer, which means that ϋ = sends the processed signed data to other messages during the parent talk, #, In addition, the present invention adds a traditional conversation interface layer to provide = signed and printed materials * ,,, and the specific implementation of the implementation: other conversation receivers. Another aspect of the present invention is to use this as a traditional e-mail to send printed data to a e-mail address. The network interface layer 440 provides a processed signature as a traditional e-mail message. Become a user. In addition, the signature information of a message is sent to a remote network and used to send Luli and Majia. A traditional system must hide the signature data in the traditional information by email. E-mail message to send the signed information or the e-mail framework to send and send the signed data to C ', and then: the signed data channel that will be entered later) surface layer 440, network interface layer 44. Incoming stamps

For the conversation or "the specific embodiment described in the present invention includes the function of the receiving end π, it is received by the receiving user after receiving 11 messages (including the signature information) —know," surface layer 4 〇 Will use traditional technology from the remote interface, the second message, in addition, the interface layer 450 can be used as any interface for an instant messaging method or an e-mail interface. Use these traditional parties to pick you up *, this message includes receiving 1226173 by the network interface layer 450 V. Description of the invention (14) = Open the message, and obtain the signature data, and sign the signature received through the incoming message The data packet is passed from the network interface layer 44 to the signing management layer 4 ^ 0 'The signing management layer 43Q is responsible for ^ coding the incoming signed data message, and the sending end of the message depends on the processing of the signed data, If you send: 胄 to add a signed data message, the signing "receiving the signing data of the receiver will be decrypted at the receiving end. Therefore, the bit / connection ^ signing ^ management layer 430 will Use traditional technology for signing data, compress, signing at the receiving end 4 = use, traditional handwriting recognition technology, if necessary, two: Be: processing, so that ιΐΐ / ΛΛ signing data is performed further At 46 °, the second entry is the second one: the data is decoded by the display device at the receiving end. The signature decoded by the Haier: Λ㈣ 收 端 _ 厗 4 9 η The signing of the solution will be sent to the receiving end. Product = ◦, the hardware interface on the receiving end With a display device 460 compatible with the hardware interface layer 42MUh / of the signing device, the user can use the display device to receive and sign the sign. , By the network sending terminal or e-mail pole by the traditional instant messaging, conversation and / therefore, this; then Γ, and display to the receiver :. The communication device uses shoulders between multiple people = using a computer and / Or Although the present invention is described with respect to one special two: two: communication 5 methods and devices, for the person skilled in the art 2f embodiment, many repairs are included in the scope of the present invention, "easy Happened so 1226173

Page 19 1226173 Schematic description of component symbols 1 00 Computer system (user side) 10 1 Processing σσ (CPU) 110 CPU bus 11 1 Bridge crying ασ Memory controller 113 1 Memory module 12 0 High-speed I / 0Bus 12 1 Network interface 12 2 Display device controller 1 23 Bus bridge 12 4 Image ¥ m Input device 130 I / 0 Bus 13 1 Data storage device 1 32 Keyboard interface 13 3 Sound controller 1 35 Point device 20 0 data distribution system 201 \ 202, 203, 204 client 2 10 server 221 > 222, 2 2 3 > 224, 225 communication line 300 data distribution system 31 0 transmission media 400 basic architecture 41 0 fm access Device 420 Hardware interface layer 43 0 Signing management layer 440 Network interface layer 45 0 Instant messaging interface layer 460 Display device

O: \ 71 \ 71058.ptd Page 20

Claims (1)

1226173 VI. Scope of Patent Application 1. An electronic conversation system, comprising: a hardware interface layer for receiving the original signed data by an input device; and processing the original signed data into a kind through a conversation interface layer Available forms of signature management; and a network interface layer that sends processed signature data over the network to a chat interface layer on a remote computer. 2. The electronic conversation system according to item 1 of the patent application scope, wherein the conversation interface layer further comprises an instant message layer for receiving the processed signature data. 3. The electronic conversation system according to item 1 of the scope of patent application, further comprising: a conversation subsystem for displaying the processed signature data as a part of a majority of users' conversations. 4. The electronic chat system according to item 1 of the scope of patent application, further comprising: an instant messaging subsystem that displays processed signature data during a part of the instant messaging talk. 5. The electronic conversation system according to item 1 of the scope of patent application, wherein the signature management layer further includes a data compression element that compresses the original signature data. 6. The electronic conversation system according to item 1 of the patent application scope, wherein the signature management layer further includes a data encryption element that encrypts the original signature data. O: \ 71 \ 7i058.ptd Page 21, 1226173 VI. Scope of patent application · '7. If the electronic conversation system under the scope of patent application No. 1 further includes: a receiver who receives the processed signed materials, It is transmitted by a remote computer system and converts the received signed data into a displayable form as part of a conversation. 8. The electronic conversation system according to item 7 of the scope of patent application, further comprising: a data decompression element that decompresses the received signed data from the network. 9. The electronic conversation system according to item 7 of the scope of patent application, further comprising: a data decryption element for decrypting the received signed data on the network. 10. The electronic conversation system according to item 1 of the patent application scope, wherein the signature management layer further includes a handwriting recognition element. Π. — A method for communicating between many people using signed data, including:-receiving the original signed data by an input device; processing the original signed data into a usable interface through a conversation interface layer And send the processed signature data over the network to a chat interface layer located on a remote computer. 12. The method according to item 11 of the scope of patent application, wherein the chat interface layer further includes: an instant message layer that receives processed signature data. O: \ 7l \ 71058.ptd Page 22 1226173 VI. Application for Patent Scope 1 3. The method for applying for Patent Scope Item 11 further includes: As part of the majority of users who have conducted conversations and talks, they have dealt with the tribute. Expected to show no. 14. The method according to item 11 of the scope of patent application, further comprising: displaying the processed tribute as part of the majority of the users during the instant message talk. 15. The method according to item 11 of the scope of patent application, further comprising compressing the original signed materials. 16. The method according to item 11 of the scope of patent application, further comprising encrypting the original signed data. 17. The method according to item 11 of the scope of patent application, further comprising: receiving the processed signed data and transmitting it through a remote computer system, and converting the received signed data into a partial conversation Displayable form of talks. 18. The method according to item 17 of the scope of patent application, further comprising: decompressing the received signed data from a network. 19. The method according to item 17 of the scope of patent application, further comprising: decrypting the received signed data from a network. 20. The method according to item 11 of the scope of patent application, further comprising handwriting recognition of the received printed materials. 2 1. A computer-readable medium with instructions encoded for processing. The instructions for processing include: a hardware interface layer component that receives an original signature from an input device; O: \ 71 \ 7L058.ptd Page 23 1226173 6. Scope of patent application-processing the original signing data into a usable form of signing management layer component through a chat interface layer; and The signed data is sent to the network interface layer component of the chat interface layer on the remote computer. O: \ 71 \ 71058.ptd Page 24