JP2021522617A - Display device - Google Patents

Abstract

The present invention is a device for organizing and displaying messages, wherein the device includes a processor, the processor for organizing and displaying the message exchanged between the devices in a structured manner. A plurality of layout modes are set, one layout mode for a chat session is determined from the plurality of layout modes, a message included in the chat session is displayed on the display in the determined layout mode, and a predetermined layout mode is displayed. The width of the text box of all the messages displayed when the event occurs is adjusted by the structured method, and the event is the rotation of the device, the transmission or reception of at least one message, and the at least one message display method. The present invention relates to a device including at least one of the input of commands to.
[Selection diagram] FIG. 9a

Description

The present invention relates to a device and a method for organizing instant messages in various structured methods and providing a user interface for displaying the organized instant messages on a display.

The description in this section only provides background information related to the present invention and does not constitute prior art.

When users communicate with each other through instant messaging (“IM”), they may not be able to respond to received questions or findings sent by third parties. The inventor noted that one user must send a large number of questions to another user and the other user must answer such questions at the same time. When such a situation occurs, the "responder" faces the mental burden of having to respond to the sender for a question, and if it is not clearly explained, the sender will be asked which message. Has the mental burden of having to determine if is a response to a message sent by him. The inventor has intuitively experienced that the situation can be exacerbated when more than two users communicate with each other through IM. The present inventor finds that when multiple users send an IM using messaging software (or application), it is crowded and troublesome in distinguishing the messages received by the user from the plurality of users by the IM. For each message, it can be burdensome to identify who is the source of each message.

The present inventor displays a message on a touch screen display for the user to conveniently communicate or exchange a message between a known IM software or a known IM application between a responder and a sender. Noted that it does not provide any user interface to do so.

When users communicate with each other through instant messaging (hereinafter referred to as "IM") in which all messages are organized in a hierarchical manner, the users are displayed in or within the structure itself. You may want to partially modify a text message. The user can make such partial modifications using a carefully designed instruction set (or instruction process) within a hierarchically structured framework. In particular, the instruction set operates within the framework of the structure when the physical width and height of the hierarchical structure need to be adjusted each time a text message is sent or received. The point is important. It is important to provide not only logically operating instructions but also a convenient interface for the user so that the user can easily use the instructions. That is, the degree of freedom is given to the user, the user can easily use the command on the screen, and the command can be hidden or displayed as needed. In some cases, it is desirable for the user to be able to set the instruction in a way that the instruction is executed by a simple hand gesture.

One aspect of the present invention provides an apparatus for organizing and displaying messages. The device includes a processor, which sets a plurality of layout modes for organizing and displaying messages exchanged between the devices in a structured manner, and a chat session in the plurality of layout modes. One layout mode for, the messages contained in the chat session from the determined layout mode are displayed on the display, and the width of the text box of all the messages displayed each time a predetermined event occurs. The event comprises at least one of the rotation of the device, the transmission or reception of at least one message, and the input of at least one instruction to the display method of the message.

The message includes a response message generated by specifically selecting the target message to be responded to.

The processor includes at least one message with a message expiration time set by the creator of the message, and the message with the message expiration time is deleted from the devices of all users who participate in the chat session at the expiration time. Will be done.

A message for which the expiration time of the message is set can be set so that no response can be made to the message.

The processor sets an instruction set for the message display method as one type selected from a group consisting of an internalized type, an externalized type, and a customized type, and the internalized type is a user's hand. The instruction set is displayed according to the gesture input, the externalized type is the type in which the instruction set is displayed together with each message, and the customized type is the corresponding hand by the user's hand gesture input. This is a type in which commands corresponding to gestures are performed without display.

The instruction set includes at least response, shrink, extend, delete, UBD, hidden, display, modify, invert, and restore instructions, each instruction being an independent internalization, externalization, or customization type. , Can be set independently.

The instructions further include all shrink, all extend, all delete, all UBD, all hidden, all show, increase, decrease.

The processor sets an instruction set for the message display scheme, the instruction set includes at least reduction, expansion, all reduction and all extension instructions, and the reduction instruction is a sentence to which the processor applies the reduction instruction. At the same time as reducing the sub-sentence of the sentence so that it is not displayed, an expandable symbol is displayed in the sentence to which the reduction instruction is applied. At the same time, a reduceable symbol is displayed in the sentence to which the extension instruction is applied, and in the all reduction instruction, the processor applies the reduction instruction to the sentence to which the all reduction instruction is applied and its subordinate sentences. The all-extended instruction causes the processor to apply the extended instruction to the sentence to which the all-extended instruction is applied and its subordinate sentences.

When some or all of the other sentences in the layout to which the newly received sentence belongs are in the reduced state, the processor automatically expands at least a part of the reduced sentences in the layout.

The processor automatically expands only the higher-level sentences directly related to the received sentence, and executes an MPS automatic extension instruction that restores the layout to the state before one of the higher-level sentences was reduced.

In addition, the processor automatically expands only the higher-level sentences directly related to the received sentence, and executes a CD automatic extension instruction for reducing a sentence having the same depth as the received sentence.

The processor automatically expands only the higher-level sentences directly related to the received sentences, and executes an OB automatic extension instruction for reducing other sentences in the layout.

The processor executes an EA automatic extension instruction that extends all reduced sentences in the layout to which the received sentence belongs.

On the other hand, the processor sets an instruction for the message display method, the instruction includes at least a hidden, display, all-hidden and all-display instruction, and the hidden instruction is a sentence to which the processor applies the hidden instruction. The height of the text box is adjusted to the default height so that a part of the text is not displayed, and at the same time, a displayable symbol is displayed in the sentence to which the hidden command is applied. The processor can return the height of the box of the text to which the display instruction is applied from the default height to the original height, display all the text parts, and at the same time hide it in the text to which the display instruction is applied. The all-hidden instruction causes the processor to apply the hidden instruction to the sentence to which the all-hidden instruction is applied and the sentences below it. The display command is applied to all sentences to which the display command is applied and its subordinate sentences.

The processor sets an instruction for the message display scheme, the instruction includes at least a delete and all delete instructions, the delete instruction causes the processor to delete the text of the text to which the delete instruction applies and said delete. The instruction is a deletion method 1 in which the processor adjusts the text box of the sentence to which the deletion instruction is applied to a default height and displays the text box, and the processor deletes the text box of the sentence to which the deletion instruction is applied. One of the deletion methods 2 is executed, and the all deletion command applies the deletion command to the sentence to which the deletion command is applied and its subordinate sentences so that the deletion command executes the deletion method 2. If set to, the processor that receives the response message to the deleted text displays the deleted text box again. Alternatively, the deleted text box and the deleted text are displayed together again.

The processor sets an instruction for the message display scheme, the instruction includes at least USD and all USD instructions, the USD instruction at the same time that the processor deletes the text of the sentence to which the USD instruction applies. A message requesting that the sentence be deleted is sent to another user who has received the sentence, and all the USD instructions apply the USD instruction to a sub-sentence of the sentence to which the processor applies the USD instruction. ..

When the USD instruction is executed, the processor transmits the response of the other user to the request message to the user to whom the USD instruction is applied.

The processor sets an instruction for the message display scheme, the instruction includes at least a modification instruction, which allows the processor to modify at least a portion of the text to which the modification instruction applies. Send a message to other users who have received the text notifying that the text has been modified.

The processor sets an instruction for the message display method, and the instruction includes at least an inversion and return instruction, and displays only the leaf text of the layout to which the inversion instruction is applied, and at the same time, the inversion instruction is applied. A returnable symbol is displayed on the layout, and the return command displays the text of the layout to which the return command is applied as it is, and at the same time, displays a symbol that can be inverted to the layout to which the return command is applied. indicate.

The processor sets instructions for the message display scheme, the instructions include at least increase and decrease instructions, which are the font of the text to which the increase instruction applies, the width of the text box, and the increase instruction. At the same time as increasing the size of the text box, a decrementable symbol is displayed in the sentence to which the increase instruction is applied, and the decrease instruction is the font of the sentence to which the decrease instruction is applied by the processor, the text box. At the same time as reducing the width and size of the text box, the increaseable symbol is displayed in the text to which the reduction instruction is applied.

The present invention relates to providing a user interface for displaying a message to be communicated or exchanged between a responder and a sender on a touch screen so as to be familiar to the user.

As one aspect of the present invention, when all messages communicate with each other using an IM organized in a hierarchical manner, the user may use the structure itself or a portion of the text message displayed within that structure. You may want to make a partial fix. The user can make such partial modifications using a carefully designed instruction set (or instruction processor) within a hierarchically structured framework. In particular, the instruction set still operates within the framework of the structure if the physical width and height of the hierarchical structure are adjusted each time a text message is sent or received. The point is important. That is, it gives the user more freedom, allows them to easily use commands from the user's screen, hides or displays commands as needed, and in some cases commands with simple hand gestures. Can be set in a way that allows the user to execute.

The above and other objects, features and advantages of the present invention will be further clarified by the detailed description of the invention made in connection with the accompanying drawings.
It is a schematic block diagram of the apparatus which concerns on at least one exemplary embodiment of the present invention. FIG. 6 is a schematic block diagram of a touch screen according to at least one exemplary embodiment of the present invention. FIG. 6 is a schematic block diagram of an apparatus according to at least one other exemplary embodiment of the present invention. FIG. 5 illustrates a user interface to a menu of applications on a device according to at least one exemplary embodiment of the present invention. It is an example diagram which shows the situation which a group of 4 people is exchanging instant messages. It is an exemplary figure which shows the messaging display which concerns on at least one exemplary embodiment of this invention. An exemplary diagram illustrating the rationale for the present invention is illustrated. It is a figure which illustrates the layout which has a unique identifier. It is an example figure which shows the primary key (Primary key). It is an example diagram which illustrates the "template" called GFAL (Generalyzed Fixed Angle Layout). It is an example diagram which illustrates the "template" called GFAL (Generalyzed Fixed Angle Layout). It is an example diagram which illustrates the "template" called GVAL (Generalyzed Varying Angle Layout). It is an example diagram which illustrates the "template" called GVAL (Generalyzed Varying Angle Layout). It is an example diagram which illustrates the "template" called GMAL (Generalyzed Mixed Angle Layout). It is an example diagram which illustrates the "template" called GMAL (Generalyzed Mixed Angle Layout). It is an example diagram which illustrates SWL-LR (Same Width Rayout-Left to Right) and SWL-RL (Same WideLayout-Right to Left). It is an example diagram which illustrates SWL-LR (Same Width Rayout-Left to Right) and SWL-RL (Same WideLayout-Right to Left). FAL-R (Fixed Angle Layout-Right Alogned), VAL-R (Varing Angle Lowout-Right Aligned) and MAL-R (Mixed Angle Layout-Right Aligned) are illustrated. Illustrations illustrating the Fixed Angle Layout-Center Aligned (FAL-C), the Variable Angle Layout-Center Aligned (VAL-C) and the Mixed Angle Layout-Center Aligned (MAL-C), respectively. Fixed Illustrated Angle Layout-Left Aligned (FAL-L), Variable Angle Layout-Left Aligned (VAL-L), and Mixed Angle Layout-Left Aligned (MAL-L) are illustrated. It is a flowchart illustrating how to process an incoming or outgoing text message to determine the width of all text boxes in the layout. It is a flowchart illustrating how to process an incoming or outgoing text message to determine the width of all text boxes in the layout. It is a table which illustrates various Reference Wide Equations (RWEs) and Reference Depth Equations (RDEs). It is an exemplary diagram illustrating instant messaging between users under SWL-LR. It is an exemplary diagram illustrating instant messaging between users under FAL-R. FIG. 5 is an example diagram illustrating instant messaging between users under a fixed rotation point VAL-R. FIG. 5 is an example diagram illustrating instant messaging between users under a floating rotation point VAL-R. FIG. 5 is an example diagram illustrating instant messaging between users under a fixed rotation point MAL-R. It is explanatory drawing which illustrates the layout in the vertical mode and the horizontal mode. and It is a flowchart which illustrates the method of readjusting the width of all text boxes when the device rotates from the vertical mode to the horizontal mode. It is a flowchart which illustrates the method of selecting a layout mode. It is a flowchart which illustrates the method of sending a text message which has a related parameter (information). It is a flowchart which illustrates the method of extracting the related parameter from the detected text message. It is an exemplary diagram illustrating the concept of an internalized instruction. It is an exemplary diagram illustrating the concept of an externalized instruction. It is an exemplary diagram illustrating the concept of a customized instruction. It is an exemplary diagram showing how a user sends a text message and how it is displayed. It is an example diagram which shows that a user responds to an existing text message. It is an example figure which shows the layout by the maximum capacity. It is an example diagram which shows the interaction of instant messaging between users. from FIG. 6 is an example diagram illustrating a method of applying a time-expired text message. It is an example diagram which illustrates the method of applying a reduction instruction (Collapse command). FIG. 5 is an example diagram illustrating a method of applying an extended instruction. FIG. 5 is an example diagram illustrating a method of applying an extended instruction. FIG. 5 is an example diagram illustrating a method of applying the Collapse All instruction. It is an exemplary diagram illustrating a method of applying an all-expand All instruction. FIG. 5 is an example diagram illustrating a method of applying a Hide instruction. FIG. 5 is an example diagram illustrating a method of applying a Show instruction. FIG. 5 is an example diagram illustrating a method of applying a Hide All instruction. It is an exemplary diagram illustrating a method of applying the Show All instruction. FIG. 5 is an example diagram illustrating a method of applying a Delete instruction. It is an exemplary diagram illustrating a method of applying the Delete All instruction. It is an exemplary diagram illustrating that a user receives a text message after the text message has been deleted. It is explanatory drawing which illustrates the method of applying a UBD instruction. It is explanatory drawing which illustrates the method of applying a UBD instruction. It is an exemplary diagram illustrating a method of applying all UBD (UBD All) instructions. It is an exemplary diagram illustrating a method of applying all UBD (UBD All) instructions. It is an exemplary diagram illustrating a method of applying all UBD (UBD All) instructions. FIG. 5 is an exemplary diagram illustrating a method of applying a Modify instruction. FIG. 5 is an exemplary diagram illustrating a method of applying a Modify instruction. It is an exemplary diagram illustrating how to apply the Invert and Revert instructions. It is an illustration which illustrates that a user receives a text message after the layout is inverted and is in the restored state. It is an exemplary diagram illustrating how to apply the Increase and Decrease instructions. It is an exemplary diagram illustrating how the ALL instruction is displayed on the display of the device. It is an example diagram which illustrates the method of applying the instruction of all reduction, all expansion, all hiding and all display. It is an example diagram which illustrates the method of applying the instruction of all delete, all UBD, all inversion and all return. Automatic expansion and maintenance of the previous state (Maintain the Previous State Auto-Expand), automatic expansion of common depth (Common Depth Auto-Expand), 1-branch automatic expansion (One Branch Auto-Expand), and all expansion automatic expansion It is an example diagram which shows the concept of Expand All Auto-Expand). It is an example diagram showing the concept of automatic expansion and maintenance of the previous state, automatic expansion of a common depth, one-branch automatic expansion, and all expansion automatic expansion. It is an example diagram which illustrates the two different methods of arranging a layout each time a user sends and receives a text message. It is an example diagram which illustrates the two different methods of arranging a layout each time a user sends and receives a text message. It is a table showing how each instruction can be presented, that is, all possible combinations of internalized instructions, externalized instructions, and customized instructions. It is a table which shows the possible combination of each instruction which can be set by a user. It is an example diagram which shows the instruction display area which has an internalized instruction to be displayed internally. Also, the externalized instructions are illustrated using symbols. It is a flowchart which illustrates both methods of adjusting the width of a text (TWA) and adjusting the width of a text at the time of rotation (TWA-R). It is a flowchart which illustrates the method of sending a text message to another user. It is a flowchart which illustrates the method of receiving a text message from another user. It is a flowchart which illustrates the method of deleting an expired text message. It is a flowchart which illustrates the method of a response instruction. It is a flowchart which illustrates the method of reduction, extension, all reduction and all extension instruction. It is a flowchart which shows the method of automatic expansion maintenance to the previous state, automatic expansion to a common depth, one-branch automatic expansion, and all expansion automatic expansion. It is a flowchart which illustrates the method of the deletion and the deletion instruction of all. It is a flowchart which illustrates the method of hiding, displaying, all hiding and all displaying command. It is a flowchart which shows the method of UBD and all UBD instructions. It is a flowchart which shows the method of a correction instruction. It is a flowchart which shows the method of the inversion and return instruction. It is a flowchart which shows the method of an increase and decrease instruction. It is a flowchart which shows the method of an internalized, externalized, and customized instruction.

Hereinafter, examples according to the present invention will be described with reference to the attached drawings.

The present invention selects the messages received earlier from the exchanged messages, organizes the instant messages into various hierarchically structured methods, and displays the organized instant messages on the touch screen in various methods. With respect to devices and methods that provide a user interface for The disclosed examples often have a touch screen display that allows users to respond to messages received or sent by instant messaging software (or applications), structure them, and manage instant messages in a consistent manner. Regarding functional devices.

FIG. 1 is a schematic block diagram of an apparatus according to at least one embodiment of the present invention. Device (100) refers to a user device for sending and receiving instant messages via a wired or wireless network, for example, a mobile portable terminal, a multimedia player device, a navigation device, an educational device, a gaming system, a control. Compatible with devices, personal computers, laptop computers, tablet personal computers, personal digital assistants (PDAs), etc. However, the device (100) is not limited to this, and may include all devices capable of transmitting and receiving instant messages via a wired or wireless network. The device (100) is a touch-sensitive display (102) configured to enter text messages, image and video messages, send them to other users, and / or display messages received from them. Includes a touch screen or (referred to as a touch screen display). The touch-sensitive display (102) is a "touch screen" or "touch-sensitive display" provided with an input panel for sensing and / or detecting the user's motion and, for example, the contact disclosed by the user's finger or stylus pen. Refers to "system". The device (100) may also include a memory (104) (which may include one or more non-volatile computer-readable storage media), a memory controller (106), one or more processors (eg, a microprocessor or). Includes CPU) (108), peripheral interface (110), RF circuit (112), audio circuit (114), speed (116), microphone (118), proximity sensor (120) and accelerometer (122). Device (100) includes input / output (I / O) subsystems (124), other inputs or controls (126), external ports (128) and one or more optical sensors (not shown). include. These components can communicate through one or more communication buses or signal lines (indicated by double-headed arrows). Device (100) is an exemplary embodiment of a portable multifunction device, the device being realized with more or fewer components than those illustrated in FIG. 1, combining two or more components, or different. This can be achieved with the components of the configuration or array of. The various components illustrated in FIG. 1 can be realized by hardware, software, or a combination of hardware and software, including one or more signal processors and / or circuits. Each component of device (100) is implemented by one or more processors and / or customized integrated circuits (ASICs) to perform specific functions as described below.

FIG. 2 is a schematic block diagram of a touch screen of a multifunctional device according to at least one exemplary embodiment of the present invention. With reference to FIG. 2, the touch screen (102) has one or more graphics and / or in the user interface (UI) of the device (200) (ie, a device similar to the device (100) of FIG. 1). Display text. In some embodiments, as well as in other embodiments described below, the user connects to the graphic with, for example, one or more finger touches (202). Alternatively, touch to select one or more graphics associated with a predefined function. In some embodiments, if the user disconnects from one or more graphics, one or more graphics are selected. In some embodiments, the various types of connections are connected, for example, to the touch screen (102) of the device (200) (or a camera sensor (not shown in the drawing) for detecting various motions). One or more taps of a finger, one or more swipes (left to right, right to left, up and / or down) and / or rolling (right to left, left to right) Includes gestures such as (to, up, and / or down). In some embodiments, the accidental connection with the graphic does not select the graphic. For example, a swipe gesture that swaps over an application's icon does not select the corresponding application if the gesture corresponding to the selection is a tap.

The device (200) also includes a "home" or one or more physical buttons such as a menu button (204) and a control button (206). The menu button (204) or control button (206) is intended for navigating any application within a set of applications that is loaded in memory (104), then retrieved, and executed on device (200). Used. Apart from that, in some embodiments, the menu button (204) replaces the physical button or, additionally, as a softkey implemented within the graphic user interface (GUI) within the touch screen (102). It will be realized.

The device (200) according to one embodiment includes a touch screen (102), a menu button (204), a control button (206), a push button (208) for powering on / off the device and locking the device, and a volume. It includes an adjustment button (210), a subscriber identification module (SIM) card slot (212), a headset jack (214), an external memory card slot (216) and a docking / charging external port (218). The push button (208) turns power on and off on the device by pressing the button and maintaining a predefined time interval with the button pressed, and pressing the button for a predefined time. It is used to lock the device, unlock the device, and start the unlocking process by releasing the button before the interval elapses. In another embodiment, the device (100) detects oral input for activation or deactivation of some functions through a microphone (118).

FIG. 3 is a schematic block diagram of an apparatus according to at least one exemplary embodiment of the present invention. With reference to FIG. 3, in some embodiments, the apparatus (200) includes one or more processors (CPUs) (300) and one or more networks or other communication interfaces (302). The device (200) includes a memory (304). The memory includes high speed random access memory such as DRAM, SRAM, DDR RAM or other random access individual state memory devices, one or more magnetic disk storage devices, optical disk storage devices, flash memory devices or other. Includes non-volatile memory such as non-volatile solid state storage equipment. The device (200), in some embodiments, is an input / output (I / O) composed of a display, a keyboard and / or a mouse (or another pointing device) and a touch pad, which are touch screen displays (102). ) Includes interface (306). The multifunction device (200) has one or more communication buses (308) for interconnecting these components. The communication bus (308) includes circuits (sometimes referred to as chipsets) that interconnect system components and control these communications.

FIG. 4 is an exemplary diagram illustrating a user's interface to a menu of applications on a device according to at least one exemplary embodiment of the present invention. Similar to the user interface embodiment, the user interface (400) has the following elements: signal strength indicator (402), time (404) for wireless communication such as cellular and Wi-Fi® signals. , Battery status indicator (406), and other information related to the device, or device such as stock price and weather, or user customization information, or a subset (or subset) of these, or a superset (or). Superset) is included.

The interface (400) includes icons for applications such as settings (general settings of the device), photographs, traffic information, mathematical formulas, games, calculators, dictionaries, movies, emails, cameras, and the like. Interface (400) includes widgets such as stock market information widgets that provide weather forecasts for designated areas and stock prices and news to users, for example.

The interface (400) also highlights and groups a number of commonly used icons such as phones, texts, internet browsers, music players and exchange rates.

FIG. 5 is an exemplary diagram illustrating how a group of four (500; me, Superman, Batman, Spider-Man) exchanges instant messages (or text messages). In the state of exchanging instant messages among four members in the same session, the method of displaying a text message as shown in FIG. 5 distinguishes (identifies, organizes, or organizes) the text message to the recipient (user). Classification) and if it is not clear who a text message will reach, both parties can be even more confused by instant messaging. This is because in the general scheme illustrated in FIG. 5, the recipient must make a predetermined effort to identify and track who is the originator of each text message. To avoid confusion, users display who they are responding to, for example by adding a predefined identification or symbol (identifier or operator) (eg @ + target recipient). .. For example, in drawing codes 502, 504 and 506, the user uses the operator symbol @ (at) symbol to indicate who they are responding to (ie, the symbol of the operator that specifies the target recipient for a particular text message). Was used. This requires unnecessary time to enter the operator symbol (ie @) and the target recipient for each text message from a member of the group, which is annoying to the user, as shown in FIG. The system puts unnecessary psychological burden on responders and recipients.

FIG. 6 is an exemplary diagram showing a messaging display according to at least one exemplary embodiment of the present invention. As illustrated in FIG. 6, the response of any text message is displayed as a hierarchical structure by placing the response text message below the corresponding text message that the user intends to respond to. The text message response, along with the indentation, is placed under the "target" text message (eg, the outgoing text message of "Blue crab tonight? Anybody up for it?" In FIG. 6). Therefore, all text messages under the target text message with the same amount of indentation are the most relevant responses to the target text message (ie, the response that directly depends on the target text message (600) (602, 602). Grouped by 604,606 and 608). For example, the first text message (600) is an outgoing message initiated by the sender (ie, me, Ironman). Text messages (602,604,606 and). 608) are all responses to the first text message (600) and depend directly on it. The four responses (ie, text messages (602, 604, 606 and 608)) are directly with the first text message (600). Related. The user identifies that the four text messages are the responses associated with the text message (600), which is the same amount of it arranged from the position of the first text message (600). This is because it is placed under the text message (600) along with the indent. Also, the user (ie, me, Ironman) said that the text message (610, 612) was directly associated with the text message (604). The response can be identified as not related to or derived from the text message (600), and the two responses (610, 612) are so identified, which are the targets of the two. This is because it is placed under the target text message (604) with the same amount of indentation arranged from the position of the text message (604).

Accordingly, the present invention provides an IM display method that structures and presents user communications in an organized manner. The present invention provides a systematically optimized method (in a technical sense) that integrates the presentation to the device (100) with the touch screen display (102).

When a group of users can respond to text messages that already exist and the communication is visually organized in a hierarchical manner, such a system is referred to as a response messaging system (RMS).

Hereinafter, the ideas and rationale for RMS will be described in FIGS. 7a-7i.

In a known IM, the size of a text box containing a user's text message is optimized in that the shorter the text message, the smaller the text box, and the longer the text message, the larger the text box. Text messages sent by users to each other have a clearly random length, so such text messages are displayed in text boxes of different sizes. In the absence of such features, all users' text messages are placed within text boxes of the same size and width, regardless of the length of those text messages.

As illustrated in FIG. 7a, when the device (200) displays a relatively short text message (eg, a text message (700)), the width of the text box that "encloses" the text message is also relatively short. If the device (200) displays a longer text message (702), the width of the text box surrounding the text message also increases. Also, if the text message is longer than the predetermined width, the device (200) can divide the text message into a large number of (text) lines, and the width of the text message (704) and the text box (706) can be kept constant. ..

Note that if the device simply organizes all text messages in a structured manner without any mechanism to adjust the width of the text boxes according to their relevance, the text messages will be as shown in FIG. 7b. Is displayed. In FIG. 7b, all text messages are organized in a structured manner, but the width of the text box is arbitrary, it cannot provide good readability to the user, and the arrangement of the text box is chaotic. be. To improve readability and organization, the width of all text boxes is adjusted as shown in FIG. 7c.

The collection of text messages in FIG. 7c is the final result of user communication. However, this does not show how each instant message (IM) was executed.

FIG. 7d illustrates this point as well as the basic characteristics of the RMS. In (1) of FIG. 7d, the user receives a text message (“ABC”). As shown, the text box "encloses" the text, and the width of the text box is close to the actual length of the text "ABC". In (2) of FIG. 7d, the user receives a longer text message (“ABCDE”) in response to the first text message. Note that the width of the text box of the first text message (“ABC”) has been adjusted to form a particular predefined appearance. In (3) of FIG. 7d, the user receives a response text message (“EDCBA”) to the first text message. Since the text message is a response to the first text message, it is placed below the first response. In (4) of FIG. 7d, the user receives a longer text message (“ABCDEFGHIJKLMN”) and the width of the text box of the first three text messages is adjusted to have a particular appearance. Also, the received text message ("ABCDEFGHIJKLMN") is a response to the second ("ABCDE") and depends directly on it. In (5) of FIG. 7d, the final text message (ie, "ABCDEFGHIJKLMN") was deleted from the device (or system). Note that the width of the text boxes of the first two text messages has been adjusted (decreased) to be the same as the width of the text box with the longest width of the remaining text boxes.

FIG. 7d illustrates that in RMS, the width of the text box changes not only with the text length of the incoming / outgoing text message, but also with the deletion of any existing text message. Outgoing or incoming text messages can be of any length, so when a user sends or receives a text message, they calculate the width of the "right" text box for each text box and the message currently presented in the chat session. The procedure for detecting and analyzing is performed (text messages, for example, the length of "ABC" is a real number of any quantity, and the units can be pixels, characters, millimeter, centimeter, inch, etc. Note that there are also). Therefore, in RMS, when a user sends or receives a text message, all chat sessions that the device (200) sends to or receives from other users currently participating in the chat session. The width of all text boxes can be adjusted by a set of rules that use the message length of. Also, changing the width of the text box is performed according to predefined rules, so that the collection of text messages is shaped to have a particular look.

In RMS, the width of the text box is calculated to avoid extreme situations. As illustrated in FIG. 7e, the space within the text box overlaps too much. On the other hand, as shown in FIG. 7f, the space inside the text box is so inadequate that it gives the user a feeling of "suppressing". Therefore, the procedure (or set of procedures) that determines the width of the text box aims to balance overlapping space with inadequate space and improve readability and organization.

In reality, the width of the text box cannot be increased indefinitely due to physical limitations on the device (200). Also, it cannot be reduced to the point where the width reaches zero. Therefore, when the maximum width and the minimum width of the text box are defined, they are referred to as the maximum width (max-wids) and the minimum width (min-wids). When the width of the text boxes is adjusted, the width of each text box is adjusted within the predefined maximum width and the predefined minimum width.

FIG. 7g illustrates that the widths of all text boxes have reached the maximum width of what is displayed in _Mk ^{d (k, d = 0,1,2, ...).}

Figure 7h illustrates the width of all text boxes have minimum width arrival of what is displayed by ^{_{m k d (k, d =}} 0,1,2 ....). If the maximum width and the minimum width is generally mentioned, it discarded superscript d, is displayed as M _k and m _k. Details of the maximum width and the minimum width will be described below.

FIG. 7i illustrates an exemplary method of how users (ie, users A to D in FIG. 7i) communicate in the IM illustrated in FIG. 7. In (1) of FIG. 7i, the user, that is, the user B receives a text message (710, a shaded text box) from the user A. In (2) of FIG. 7i, the user B responds to the received text message (710) (shaded text box) and sends the message (712) to the user A. The device (200) analyzes both the text message (710) and the received message (712) to determine the width of both text boxes. As shown, the width of the text box of user A's text message (710) is adjusted by the width of the received message (712) to have a predefined width. Then, the response text message (712) is placed below the user A's text message (710). Note that in FIG. 7i (2), the width of the response text message (712) is smaller than the width of the message box (ie, "Hi!"), And the right sides of both text boxes are aligned. In (3) of FIG. 7i, user B receives a text message (714, shaded text box) from user C. As shown, the width of the text box of the text messages of user A (710) and user B (712) is increased, and the text message (714) of user C, which is the response to the text message of user A, is the text message of user B. It is placed under the text message (712) of. In (4) of FIG. 7i, user B receives a text message (716, shaded text box) from user D. The width of the message (716) is the same as the message placed on it (ie, "Hey, how are you doing?" And "I hard you want Washington DC. Did you like?"). , Indicates that the text message (712, 714 and 716) is a response text message that responds directly to the message (710). That is, all three text messages (712, 714 and 716) are directly related to the first text message (ie, message (710)). In (5) of FIG. 7i, user B receives a text message (718, shaded text box) which is a response of the text message (712) from user A. In (6) of FIG. 7i, user C receives a text message (720, shaded text box) which is a response of the text message (714) from user A. Note that the two text messages (718 and 720) are even smaller in width than their "parent" text message and even smaller than the first text message. This indicates the different "depth" of the response, that is, the hierarchical relevance. In FIG. 7i (7), user A receives a text message (722, shaded text box), which is a response directly to the text message (718) from user B. In FIG. 7 (8), user B receives a text message (724, shaded text box), which is a response directly to the text message (722) from user A.

The above general description describes the width of the text box for each single event that occurs when the device (200) detects an incoming or outgoing text message in a situation where users send and receive text messages to each other. I explained how to adjust it. However, the core idea of how the device (200) identifies a text message (ie, an outgoing message from the device (200) or an incoming message from the device (200)) and places it in the correct position is explained. Not. The core idea is to assign a unique identifier to the first text message and a natural number to any response to the first text message.

When a group of text messages is structured, a unique number is assigned to each text message. The controller (106) generates an identifier (eg, a number, a letter, or a combination thereof) to identify each message, and the number identifies each text message, as illustrated in FIG. 8a. (Note that the identifier is internally assigned and invisible to the user). For example, the first box represents "x. Sentence" ("x. Statement"), sentence x (statement x), or main sentence (main status). The term "text" means the corresponding text message displayed in the corresponding text box. Here, the term sentence includes a text message (hereinafter, referred to as text for convenience of explanation) and a text box. Each sentence in FIG. 8a consists of a corresponding text and a text box surrounding the corresponding text.

When a group of sentences is grouped together as a hierarchical structure and an identifier is assigned to each sentence, such a group of sentences is called a layout. The group of sentences in FIG. 8a is referred to as a layout.

In the layout illustrated in FIG. 8a, the layout consists of a main sentence and child (or subordinate) sentences associated with a response that responds directly or indirectly to the main sentence. As an addition or alternative, the controller (106) is displayed on the touch screen (102) by specifying different identifiers such as w, x, y and z and indicating each main sentence of the layout. Can generate one or more other layouts.

The child sentences of the main sentence are sentence x. 1, x. 2 and x. It is 3. Sentence x. 3 does not have a child sentence, and the sentence x. 2 has one child sentence (sentence x.2.1). Sentence x. The child sentence of 1 is the sentence x. 1.1, and the sentence x. The child sentence of 1.1 is the sentence x. In 1.1.1, it is other. However, the sentence x. 1.1 is not a child sentence of sentence x.

Apart from this, the sentence x. 1, x. 2 and x. The parent sentence of 3 is the main sentence (sentence x). Therefore, the sentence x. The parent sentence of 1.1 is the sentence x. It is 1, and the sentence x. The parent sentence of 1.1.1 is sentence x. 1.1 and others. However, the sentence x is the sentence x. It is not the parent sentence of 1.1.

Any sentence except the main sentence is referred to as a subordinate sentence. Sentence x. 1.1, x. 1.1.1 and x. 1.1.1.1 is the sentence x. It is a subordinate sentence of 1. Sentence x. 1.1 is also sentence x. Note that it is a child sentence of 1. Sentence x. 2 is a subordinate sentence and a child sentence x. Has 2.1.

Apart from that, sentences x, x. 1, x. 1.1, x. 1.1.1 is the sentence x. It is a high-level sentence of 1.1.1.1. Sentence x. 1.1.1 also includes text x. Note that it is the parent text of 1.1.1.1. Sentence x. The upper sentences of 2.1 are sentences x and x. It is 2. Sentence x. The upper sentence of 3 is sentence x.

Sentence x. 1.1.1.1, x. 2.1 and x. A sentence that does not have any child sentences such as 3 is called a leaf sentence. That is, leaf sentences represent terminal sentences in a hierarchical structure, and these are derived from the disclosed sentences of each terminal sentence. The leaf sentence indicates the terminal sentence of each branch (or branch) of the sentence. For example, sentence x. 1.1.1.1 is a leaf sentence derived from the sentence x and disclosed thereafter. 2.1 is the sentence x. 2 and a leaf sentence derived from the sentence x and disclosed thereafter, and the sentence x. Reference numeral 3 denotes a leaf sentence derived from the sentence x and disclosed from the sentence x.

There are three branches in the layout. Sentences x, x. 1, x. 1.1, x. 1.1.1 and x. 1.1.1.1 forms the first branch of the layout of FIG. 8a. Sentences x, x. 2 and x. 2.1 forms the second branch of the layout of FIG. 8a. Sentences x and x. 3 forms a third branch of the layout of FIG. 8a.

Physically, the child sentences are arranged and arranged along with the predefined indentation derived from the parent sentence. Vertical and horizontal lines in a drawing configured to connect text boxes to emphasize such indentation to show their hierarchical correlation between incoming and outgoing text are referred to as indent lines.

All text has the depth defined in this application for convenience of explanation. That is, the depth of a sentence represents an indentation of how far the sentence is placed and arranged from the predefined alignment of its parent and main sentences. For example, assuming that the main sentence (or sentence x) is at depth 0, the sentence x. 1.1 and x. 2.1 and x. 3 is, for example, in the layout of FIG. 8a, at a depth of 1 from the position (or virtual alignment) where the main sentences are displayed and arranged. Sentence x. 1.1 and x. In 2.1, for example, in the layout of FIG. 8a, the main text is displayed and arranged at a depth of 2 from the position (or virtual alignment). Sentence x. 1.1.1 is located at depth 3 and the sentence x. 1.1.1.1 is located at depth 4, which is the deepest depth. Note that the higher the number, the deeper the depth, and the lower the number, the shallower the depth. Therefore, while the main sentence is at the shallowest depth, the sentence x. 1.1.1.1 is at the deepest depth.

The deepest depth is indicated by the letter d. Note that there is a limit to the depth d. This limit is represented by D, 0 ≦ d ≦ D. For example, in the layout of FIG. 8a, when the maximum allowable depth is set to 4 (D = 4), the sentence x. 1.1.1.1 is at the lowest depth, the user is writing, x. Respond to 1.1.1.1. Or, it is not permissible to make further responses derived from it.

The limit (or limit) on the number of child sentences derived from the parent sentence is expressed as a function M (・). For example, in a certain layout, if the sentence with the deepest allowable depth is 4 (D = 4), and if any sentence _{can be expressed by "x.a 1} .a ₂ .a ₃ .a ₄ ", the limit. Can be expressed as follows.

When D = 4, M (x) = 4, M (a ₁ ) = 3, M (a ₂ ) = 5, M (a ₃ ) = 2, M (a ₄ ) = 0

In this (M (x) = 4), the main sentence has a maximum of 4 child sentences, an arbitrary sentence of depth 1 has a maximum of 3 child sentences, and an arbitrary sentence of depth 2 has a maximum of 5. It has one child sentence, which means that any sentence of depth 3 can have up to two child sentences. Since the maximum depth allowed is 4 (D = 4), any sentence of depth 4 cannot have any child sentences, and therefore M (a ₄ ) = 0. Note the point.

As explained, each sentence has a unique identifier, for example, sentence x. 2.1 is assigned. Note that a positive integer is assigned to each sentence sequentially along with the dots. For example, when a sentence has a child sentence, the number ".1" is attached to the first child sentence, ".2" is attached to the second child sentence, and so on. Each sentence has a unique and independent number that distinguishes it from the other sentences. Not only the numbers themselves, but also the cushion that attaches the numbers to the identifier is called numbering. The numbering of the main sentence is assumed to be 0. That is, internally, the main sentence is the sentence x. It is 0. The numbering of the child sentences (sentences x.1, x.2, x.3) of the main sentence is 1, 2, and 3. Sentence x. The numbering of 1.1.1.1 is 1.1.1.1.

That is, in the layout of FIG. 8a, there are seven child sentences for the main sentence, three branches in the layout, and three leaf sentences. In addition, the four sentences that currently have the deepest depth are sentence x. 1.1.1.1, the deepest allowable depth is D, and the function M (.) Is x. a ₁ . .. .. It is defined for a _k (0 ≦ k ≦ D). Finally, the numbering of each sentence is unique.

The letter "x" plays an important role in the system. This character serves to uniquely identify the main sentence internally. When a user's device (eg, device (200)) sends a response text to or receives from another user's device, the receiving device identifies and responds to the incoming text. Position a single sentence received in an IM "Forum" or "Group" (eg, an active chat session) and the single sentence belongs within the various IM "Forums" or "Groups". Not only that, once the "large" position has been identified, the device (200) positions it to look for the correct position in the layout. Therefore, the letter x acts as an identifier, and the device (200) can use numbering to pinpoint its correct position. The character x can be realized by a combination of a user ID, a generation time of the main sentence (desirably less than a millisecond), and numbering as an example.

FIG. 8b illustrates the idea. As shown in the drawing, three parameters are concatenated: user ID, transmit (or receive) date and time and numbering. All three concatenated parameters are referred to as the main key, and this information serves as an "identifier". As shown in the drawing, the user ID linked to the transmission date and time is referred to as an ID that is simply displayed with the letter "x". Note that X and numbering are all displayed as "main keys" for the sake of brief description of the present invention.

When a user sends a text message to another user, the main key and other information are sent to the user. For example, assuming that user B sends a text message to user A and user C sends a text message to user D, when the device sends the text, it also sends the date and time of transmission and the sender's ID associated with numbering 0 (this information). Is also stored on User B's device). Therefore, the main keys received by the other three users are as follows.

UserB + 2016-Dec-28-13: 13: 01: 03 + 0

When the user A responds to the text received from the user, the device of the user A currently replaces the numbering (0) with 1, and a new main key is transmitted to another user. The main key transmitted by the device of user A is as follows.

UserB + 2016-Dec-28-13: 13: 01: 03 + 1

All the devices of the four users find a text message with the same ID and transmission date and time, and confirm that this is the first child sentence of the existing main sentence. Here, the transmission date and time is the transmission date and time of the main sentence. When User C responds to the text received from User A, User C's device currently replaces Membering 1 with 1.1 and a new main key is sent to other users. The main key transmitted by the device of user C is as follows.

UserB + 2016-Dec-28-13: 13: 01: 03 + 1.1

From the brief illustration of FIG. 7i, the layout is simply a "template" or "shale" in which the width of all text boxes in the layout changes while maintaining a particular phenomenon. A procedure for adjusting the width of the text box in the "template" (layout) is required, which will be explained in detail later. A number of "templates" are described below.

Figure 9a to Figure 11b is to control the later parameters (e.g., _{I 1} and _{I 0} alignment points _{P 1} and _{P 0,} delta ₁ and delta _{0, Wk,} alpha _k and beta _k, such as _C1k and _C0k) Is an exemplary layout of a text box containing incoming and outgoing text. The parameters are controlled and determined by the controller (106) or the processor (108).

FIG. 9a illustrates an exemplary “template” of the layout according to at least one exemplary embodiment of the invention. This template is a layout blueprint that works in a particular way. This layout is referred to as a generalized fixed angle layout (GFAL).

In FIG. 9a, there is a horizontal line (900), i.e., two virtual lines I ₁ and I ₀ that intersect the baseline. Lines I ₁ and I ₀ are alignment lines. This is a virtual line (or virtual line) that is invisible to the user. The point at which the alignment line intersects the baseline is indicated by the baseline. Therefore, the point P ₁ is the point where the alignment line I ₁ intersects the baseline, and the point P ₀ is the point where the alignment line I ₀ intersects the baseline. Delta ₀₁ and delta ₀ indicates the angle between the alignment lines _{I 1} and _{I 0} and the baseline. The delta ₁ and delta ₀ is referred to as alignment angles. These two angles are _{fixed values such that π> Δ 1} ≧ Δ ₀ > 0 (π = 180 °). Angle delta ₁ is set in delta ₀ or more angles.

In FIG. 9a, the rectangular box is a text box, which is placed between _{alignment lines I 1} and I _0. The width of each text box (hereinafter referred to as the width of the text box) is _Wk , k = 0,1,2,. .. .. , D is displayed. Therefore, w ₀ represents the width of the text box of the main sentence (depth 0), w ₁ represents the width of the text box of depth 1, and so on. In GFAL, _{the limitation of Δ 1} ≧ Δ ₀ means the following.

w ₀ ≧ w ₁ ≧ w ₂ ≧. .. .. w _d

Therefore, all text boxes decrease in width as the depth increases. The value _{w d} is not a parameter is a variable (variable). w _d represents the width of the text box at the depth of the deepest in the current layout. The character d represents the deepest depth in the displayed text because it is located at the lowest position. Most importantly, the width of all text boxes at depth k is the same. Therefore, _Wk (the width of the text box at k) applies to all sentences at depth k.

As shown in FIG. 9a, the height of each text box at the depth k (hereinafter, the height of the text box) is set as the default height h. The default height is the minimum possible height of the text box and is not set less than h. In this setting, all default heights in the layout are the same. There is a text box with a large number of text lines, which means that the height of the text box is greater than h. However, the illustrated template shows how the text boxes are aligned when the height of all the text boxes is set to the default height.

The vertical distance between text boxes is _{displayed as γ k} (k = 0,1,2, ..., d-1, γ: gamma). The value γ _k represents the distance from the midpoint of the text box at depth k (center of the side surface of the text box) to the midpoint of the text box at depth k + 1. In FIG. 9a, γ _d is not defined. Below the text box at depth k is the vertical distance σ _k (σ: sigma). Therefore, σ ₀ indicates the vertical distance from the bottom of the text box at depth 0.

The horizontal distance from the left midpoint of the text box to the left midpoint of its parent text box is indicated by α _k (k = 0,1,2, ..., d). Here, α ₀ = 0. The horizontal distance from the right midpoint of the text box to the right midpoint of its parent text box is _{displayed as β k} (k = 0,1,2, ..., d). Here, β ₀ = 0.

The horizontal distance from the left midpoint of the depth k text box to the alignment line I _{1 is displayed in C1K} , and the horizontal distance from the right midpoint of the depth K text box to the alignment line I ₀ is displayed in _C0K. NS. The controller (106) or processor adjusts or sets the values (ie, parameters) for displaying text boxes in a convex or concave shape on the two sides of the layout. _{By setting C1k} = _C0k = 0 (k = 1, 2, ..., D), the text boxes are set or arranged in a linear alignment.

When the width of the text box of the text of depth k is determined, the width of the other text boxes at different depths is adjusted based on the width of the text box determined at depth k. The width of the entire text box in the layout increases or decreases depending on the procedure (or algorithm). In GFAL, in this case, alpha _k, while maintaining the beta _{k, C1k} and values _C0k certain width of all text boxes increases or decreases. Therefore, the layout is changed and displayed in various linear shapes by shifting the _{two alignment lines I 1} and I _{0 in parallel to the left or right side.} For example, if the width of the text box increases, I ₁ shifts to the left, I ₀ shifts to the right, and if the width of the text box decreases, I ₁ shifts to the right. I ₀ is shifted to the left.

Note that as illustrated in the drawing, the alignment line I ₁ is shifted between the maximum alignment line I ₁ ^fmax and the minimum alignment line I ₁ ^fmin. Also, the alignment line I ₀ is shifted between the maximum alignment line I ₀ ^fmax and the first alignment line I ₀ ^fmin (superscripts fmax and fmin represent maximum and minimum in a fixed angle layout system). Therefore, if the alignment lines I ₁ and I ₀ match I ₁ ^fmax and I ₀ ^fmax , respectively, the width of all text boxes in the layout reaches their maximum width. Also, if the alignment lines I ₁ and I ₀ coincide with I ₁ ^fmin and I ₀ ^fmin , the width of all text boxes in the layout reaches their minimum width.

As shown in the drawing, the height of all text boxes has a default height, and the alignment line passes through the left and right midpoints (centers of both sides). The height of any text box is higher than the default height, depending on the length of the text. However, in FIG. 9a where the alignment lines are illustrated, the height of the text box is at the default height.

FIG. 9b illustrates a layout with a large number of branches where _C10 , _C00 , _C1d and _{C0d are set to 0.} As shown in the drawing, there are a number of alignment lines, all parallel to each other. In addition, the sentence x. 1.1 (902) As illustrated above, the alignment line is the text x. Does not form a straight line connected to 1.1.1. As described, such lines are illustrated under the assumption that the height of the text box is at the default height. Therefore, the alignment line is cut and the other line parallel to the original line is the sentence x. Pass the midpoint on the left and right sides of 1.1.1. As mentioned above, w _k indicates the width of the text box at depth k. In mathematics, the width w _k can be expressed as follows to emphasize that w _k is a function of k and the rest are parameters.

w _k = f (k, R, n, d, α _k , β _k , c _1k , c _0k )

or,

_Wk = f (k | R, n, d, α _k , β _k , c _1k , c _0k )

When the parameters α _k , β _k , c _{1 k} and c _{0 k} are set internally, it can be easily written as follows.

w _k = f (k, R, n, d) or w _k = f (k | R, n, d)

So far, we assume that the value of R is a real number that is not a negative number and n is an integer that is not a negative number and is determined by the processor using a formula, procedure, or set of algorithms. The formulas show that the width of all text boxes (w _k , k = 0,1,2, ..., d) is determined by one real value and the specified depth k. w ₀ ≧ w ₁ ≧ w ₂ ≧. .. .. Since ≧ w _d , the function f (k, R, n, d) increases as the depth becomes shallower.

FIG. 10a illustrates an exemplary "template" of a new layout according to at least one exemplary embodiment of the invention. This template is a layout blueprint that works in a particular way. This layout represents a generalized variable angle layout (GVAL).

In FIG. 10a, there is a horizontal line (1000), i.e., two virtual lines I ₁ and I ₀ that intersect the baseline. I ₁ and I ₀ indicate alignment lines. The point at which the alignment line intersects the baseline is called the rotation point. Therefore, the point P is the point where the alignment lines I ₁ and I ₀ intersect the baseline. There are two types of rotation points: fixed rotation points and immovable rotation points. These two rotation points will be described later. I ₁ and I ₀ indicate alignment lines. Delta ₁ and delta ₀ is the alignment angle between the alignment line and the baseline. One of these two angles is fixed, or none of these are fixed. Further, π> Δ ₁ ≧ Δ ₀ > 0 (π = 180 °).

In FIG. 10a, the rectangular box is a text box and is arranged between _{alignment lines I 1} and I _0. The width of the text box is w _k , k = 0,1,2,. .. .. , D is displayed. Therefore, w ₀ represents the text box of the main sentence (depth 0), w ₁ represents the width of the text box of depth 1, and so on. In GVAL, _{the limitation of Δ 1} ≧ Δ ₀ means the following.

w ₀ ≧ w ₁ ≧ w ₂ ≧. .. .. ≧ w _d

Therefore, all text boxes decrease in width as the depth increases. The value of w _d represents the width of the text box at the depth of the deepest in the current layout. The character d represents the deepest depth in that it is located at the lowest position in the displayed text. Most importantly, the width of all text boxes is the same at depth k. Therefore, w _k (the width of the text box at k) applies to all sentences at depth k.

As shown in FIG. 10a, the height of the text box at the depth k is set by the default height h. The default height is the minimum possible height of the text box and cannot be less than h. In this setting, all default heights are the same in the layout. There is a text box with a large number of lines of text, which means that the height of the text box is greater than h. However, as shown, the template represents how the text boxes are aligned if the heights of all the text boxes are set to the default height.

The vertical distance between the text boxes is _{displayed as γ k} (k = 0,1,2, ..., d-1, γ: gamma). The value of γ _k represents the distance from the midpoint of the text box at depth k (the center of the surface of the text box) to the midpoint of the text box at depth k + 1. In FIG. 10a, γ _d is not defined. Below the text box at depth k is the vertical distance σ _k (σ: sigma). Therefore, σ ₀ represents the vertical distance of the bottom of a text box with a depth of 0.

The horizontal distance from the left midpoint of the text box to the left midpoint of its parent text box is indicated by α _k (k = 0,1,2, ..., d). Here, α ₀ = 0. The horizontal distance from the right midpoint of the text box to the right midpoint of its parent text box is _{displayed in β k} (k = 0,1,2, ..., d). Here, β ₀ = 0. Unlike GFAL, in GVAL, the value of alpha _k and beta _k depends on the value of each delta ₁ and delta _0. That is, when α _k and β _k are functions of _{Δ 1} and Δ _{0 , respectively, α k} (Δ ₁ ) and β _k (Δ ₀ ) are more suitable.

The horizontal distance from the left midpoint of the depth k text box to the alignment line I _{1 is displayed as c 1k} , and the horizontal distance from the right midpoint of the depth k text box to the alignment line I _{0 is c 0 k.} Is displayed. In the drawings, c ₁₀ , c ₀₀ , c _1d and c _0d are set to 0. By adjusting these values (parameters), the text box will appear convex or concave on both sides of the layout. By setting c _1k = c _0k = 0 (k = 1, 2, ..., D), the text boxes are set or arranged in a linear alignment. If c _1k and c _0k are functions of _{Δ 1} and Δ ₀ , respectively, it is more appropriate to write _{c 1k} (Δ ₁ ) and c _0k (Δ _0).

When the width of the text box of the text of depth k is determined, the width of the other text box at other depths is adjusted based on the width determined at depth k. The width of the entire text box in the layout is increased or decreased by the procedure (or algorithm) performed by the processor or controller (106). In GVAL, which, every time the occurrence, or increased by all of the text box width value of delta ₁ and delta ₀ which is determined by the angle formed by the width of the text box that has been determined to pivot point P, Decrease. Thus, by controlling the two alignment lines I ₁ and I ₀ to rotate to the left or right like a fan, the respective text of the text message on the touch screen (ie, the display of device (200)). The layout for displaying the box can be changed in various ways. That is, the processor or controller (106) detects a user connection or touch on the touch screen (ie, one or both of the _{two alignment lines I 1} and I _{0) and two.} The layout can be changed by rotating the alignment lines I ₁ and I _{0 to the left or right.} When the width of the text box increases, I ₁ rotates from the left side, I ₀ rotates to the right side, and vice versa when the width of the text box decreases.

Note in the drawing that the alignment line I ₁ rotates between the maximum alignment run I ₁ ^vmax and the minimum alignment line I ₁ ^vmin. Also, the alignment line I ₀ ^rotates between the maximum alignment line I ₀ vmax and the minimum alignment line I ₀ ^vmin (superscripts vmax and vmin represent the maximum and minimum of the variable angle). Therefore, when the alignment lines I ₁ and I ₀ coincide with I ₁ ^vmax and I ₀ ^vmax , the width of all text boxes in the layout reaches their maximum width. Also, when the alignment lines I ₁ and I ₀ coincide with I ₁ ^vmax and I ₀ ^vmin , the width of all text boxes in the layout reaches their minimum width.

In the drawing, the height of all text boxes is at the default height, and the alignment line passes through the left and right midpoints (centers on both sides). The height of any text box is higher than the default height, depending on the length of the text. However, in FIG. 10a, when drawing the alignment line, the height of the text box is at the default height.

FIG. 10b illustrates a layout with a large number of branches (in FIG. 10b, the first branch of sentence x.1, the second branch of sentence x.2, and the third branch of sentence x.3), where c. ₁₀ , c ₀₀ , c _1d and c _0d are set to 0. There are many alignment lines in the drawing, all parallel to each other. In addition, the sentence x. 1.1 (1002) As illustrated above, the alignment line is the text x. Do not form a straight line connecting 1.1.1. As mentioned above, these lines are drawn under the assumption that the height of the text box is at the default height. Therefore, the alignment line is interrupted, and the other one parallel to the original is the sentence x. Pass the midpoints on the left and right sides of 1.1.1.

Mathematically, the width w _k can be expressed using the function v (・) as follows.

w _k = v (k, R, n, d, α _k (Δ ₁ ), β _k (Δ ₀ ), c _{1 k} (Δ ₁ ), c _{0 k} (Δ ₀ ))

Alternatively, _{to emphasize that w k} is a function of k and the rest are parameters, it can be expressed as follows.

w _k = v (k | R, n, d, αk (Δ ₁ ), β _k (Δ ₀ ), c _{1 k} (Δ ₁ ), c _{0 k} (Δ ₀ ))

FIG. 11a illustrates an exemplary “template” of a new layout according to at least one exemplary embodiment of the invention. This template is a layout blueprint that works in a particular way. This layout shows a generalized mixed angle layout (GMAL). From the name of the layout, GMAL is a hybrid of GFAL and GVAL.

In this layout, if the width of the text box is smaller than the predetermined width, the layout operates as GVAL, and if it exceeds the predetermined width, it operates as GFAL. When the layout operates as GFAL, the layout is in GFAL mode, and when the layout operates as GVAL, the layout is in GVAL mode. The drawing has two virtual lines I ₁ and I ₀ . It is called the alignment line of _{I 1} and I _0. Again, they are virtual lines that the user cannot see.

When the layout is in GVAL mode, the two alignment lines I 1 and I 0 rotate with respect to the left and right midpoints of the text at the deepest depth d. When the layout is in the GVAL mode, the width of the deepest depth of the sentence of the text box is a m d d. Otherwise, the layout is in GFAL mode. When the layout is in GVAL mode, the left rotation point is indicated by P 1 d and the right rotation point is indicated by P 0 d. The two alignment lines I 1 rotate between I 1 vmin and I 1 vmax. The alignment line I 0 rotates between I 0 vmin and I 0 vmax. The angles {I 1 vmin , I 1 vmax } and {I 0 vmin , I 0 vmax } of the two sets define the GVAL part of the layout. The alignment line I 1 is shifted in parallel between I 1 fmin and I 1 fmax , and the alignment line I 0 is shifted in parallel between I 0 fmin and I 0 fmax. The two sets of lines {I 1 fmin , I 1 fmax } and {I 0 fmin , I 0 fmax } define the GFAL portion of the layout. Note that a I 1 fmin = I 1 vmax and I 0 fmin = I 0 vmax. When the layout is in GFAL mode, the alignment line is fixed and intersects the baseline (1100).

Since GMAL is a mixture of GFAL and GVAL, there are two types of maximum and minimum widths, respectively. _{There are M k} ^{d, f} and m _k ^{d, f} for the GFAL part (the superscript f means fixed). Also, for the GVAL part, there are M _k ^{d, v} and m _k ^{d, v} (superscript v means change). Their maximum and minimum widths are determined by the alignment positions previously described.

Using the maximum width, the width of the text box of the deepest sentence is set by m (ie, w _d = m _d ^{d, v} = M _d ^{d, v} = m). _{If w k} ≤ M _k ^{d, v} (for all k = 0, 1, 2, ..., d), the layout behaves as GVAL. If this condition is not maintained, i.e. w _k > M _k ^{d, v} , the layout behaves as GFAL. When w _k ≤ M _k ^{d, v} , the two virtual alignment lines I ₁ and I ₀ rotate around the left and right midpoints of the respective deepest depth d text boxes. The alignment positions I ₁ ^vmin and I ₀ ^vmin are lines that determine the minimum width of the GVAL portion of the layout. Naturally, the alignment positions I ₁ ^vmax and I ₀ ^vmax are the lines that determine the maximum width of the GVAL portion of the layout. Therefore, the alignment line I ₁ rotates between I ₁ ^vmin and I ₁ ^vmax , and the alignment line I ₀ rotates between I ₀ ^vmin and I ₀ ^vmax . If the alignment lines I ₁ and I ₀ match I ₁ ^vmin and I ₀ ^vmin , this width defines M _k ^{d, v} , and the alignment lines I ₁ and I ₀ match I ₁ ^vmax and I ₀ ^vmax. If so, this width defines m _k ^{d, f} . If I ₁ is passed through the _I ^{1 vmax,} or when passing through the alignment line _{I 1} acts as GFAL, _{I 1} begins to be shifted parallel instead of rotating. When I ₀ passes through I ₀ ^vmax , the alignment line I ₀ acts as a GFAL and I ₀ begins to shift in parallel instead of rotating. Accordingly, I ₁ ^vmax is the same as I ₁ ^fmin, I ₀ ^vmax is the same as I ₀ ^fmin. In other words, m _k ^{d, f} = M _k ^{d, v} . Finally, when I ₁ and I ₀ are shifted in parallel, the positions that limit the shift are I ₁ ^fmax and I ₀ ^fmax . The distance between the two alignment lines defines _{M k} ^{d, f.}

FIG. 11b illustrates a layout with a large number of branches, where c ₁₀ , c ₀₀ , and c _{0 d} are set to 0. The drawing has a number of alignment lines, all parallel to each other.

_{If c 1k} = c _0k = 0 (for all k = 0, 1, 2, ..., D), then instead of using _{I 1} and I _{0 , use L 1} and L ₀ to them. Is called a linear alignment line. When c _1k and c _0k are set to form a smooth convex curve of alignment, C ^v ₁ and C ^v ₀ are used and it is referred to as the convex alignment curve. _{When c 1k} and c _0k are set so that the alignment forms a smooth concave curve ^{, C c} ₁ and C ^c ₀ are used and it is referred to as the concave alignment curve.

Three types of layouts, GFAL, GVAL and GMAL, were introduced. In all layouts, the width of the text box increases and decreases in a unique way. A special case is derived from such a generalized version. In all such special cases, all k = 0,1,2,. .. .. , D, c _1k = c _0k = 0.

Of the infinite cases that can be derived, there are five special cases (or subsets) of GFAL.

The first two are referred to as SWL (Same Wide Layout). This is an example in which _{the inclinations of the alignment lines L 1} and L ₀ are fixed so as to be parallel to each other (Δ ₁ = Δ ₀ ). The width of all text boxes in this layout is the same regardless of the depth of each sentence. When Δ ₁ = Δ ₀ = Δ> π / 2, the layout of this special case is referred to as SWL-LR (same width layout-from left to right). When Δ ₁ = Δ ₀ = Δ <π / 2, the layout of this special case is referred to as SWL-RL (layout of the same width-from right to left). The SWL-LR and SWL-RL are all illustrated in FIGS. 12a and 12b.

The last three are called FAL (Fixed Angle Layout). When _{only L 1} is shifted to the right or left, the inclination of the _{alignment line L 1 is Δ 1} > π / 2, and L ₀ is set to be vertical (Δ ₀ > π / 2). , The layout is called FAL-R (fixed angle layout-right alignment). If L ₁ and L ₀ all left or right (in opposite directions) is shifted, the inclination of the alignment line L ₁ is set such that Δ _1> π / 2, the inclination of the L ₀ is delta ₀ <when is set to be _{π / 2 (Δ 1 = π} -Δ 0), the layout is called FAL-C (fixed angle layout over center aligned). When _{only L 0} is shifted to the right or left, the alignment line L ₁ is vertical (Δ ₁ = π / 2), and the inclination of the _{alignment line L 0 is set to be Δ 0} <π / 2. At this time, the layout is referred to as FAL-L (fixed angle layout-left alignment). 12c, 12d and 12e show FAL-R, FAL-C and FAL-L, respectively.

Of the infinite cases, three special cases (or subsets) of GVAL can be derived.

When _{only L 1} is rotated clockwise or counterclockwise, the inclination of the _{alignment line L 1 is set to be Δ 1} > π / 2 and L ₀ is set to be vertical (Δ ₀ = π / 2). At this time, the layout is referred to as VAL-R (variable angle layout-right alignment). If L ₁ and L ₀ is rotated both with clockwise or counterclockwise direction (opposite direction), the inclination of the alignment line L ₁ is set such that Δ _1> π / 2, the inclination of the L ₀ When is set so that Δ ₀ <π / 2 (Δ ₁ = π − Δ ₀ ), the layout is referred to as VAL-C (variable angle layout-center alignment). When _{only L 0} rotates clockwise or counterclockwise, the alignment line L ₁ is vertical (Δ ₁ = π / 2), and the inclination of the _{alignment line L 0 is Δ 0} <π / 2. When set to, the layout is referred to as VAL-L (variable angle layout-left alignment). 12c, 12d and 12e illustrate VAL-R, VAL-C and VAL-L, respectively.

Finally, by combining FAL and VAL, three special cases (or subsets) of GMAL can be derived within an infinite number of cases. These special cases are referred to as MAL-R, MAL-C and MAL-L. 12c, 12d and 12e illustrate MAL-R, MAL-C and MAL-L, respectively. Note that the FAL, VAL and MAL stop drawings are the same, but their movements are not the same.

Note that SWL-RL, FAL-L, VAL-L and MAL-L are particularly useful for languages that write from right to left, such as Hebrew or Arabic.

That is, the structured IM satisfies the following conditions.
(1) The first text has the width of the largest text box and
(2) The width of all text boxes at the same depth is the same.
(3) Every time the device sends / receives text, the width of all text boxes is corrected.
(4) For the width w of all the text boxes at the depth k, M ₀ ≧ M ₁ ≧ M ₂ ≧. .. .. ≧ M _d and m ₀ ≧ m ₁ ≧ m ₂ ≧. .. .. When ≧ m _d , M _k ≧ w _k ≧ m _k . (Here, d represents the deepest depth).
It has (A) a mechanism for uniquely numbering all text, (B) a mechanism for adjusting all widths of a text box, and (C) a mechanism for placing text in its correct (intended) position. Means that. Therefore, the RMS is composed of a structured IM and all three mechanisms thereof.

From FIGS. 7a-12e, brief illustrations and various templates (GFAL, GVAL and GMAL) were provided. However, no mechanism was introduced to "work" the template. The "mechanism" for adjusting the width of the text box is referred to as the width adjustment of the text box (hereinafter, TWA).

All operations associated with FIG. 7i described herein are at least the controller (106) (or processor) (108) by communicating and controlling the other components illustrated in FIGS. 1-6. Alternatively, it is controlled and performed by a combination of both of them). For the purposes of brief description, the corresponding operations performed by the controller (106) and / or the processor (108) will be described below.

From now on, TWA will be described in detail.

As mentioned above, the first rule is that the width of all textbooks follows the following rule.

w ₀ ≧ w ₁ ≧ w ₂ ≧. .. .. ≧ w _d

The second rule is that the widths of all textbooks at the same depth have the same width. That is, it is as follows.

w _k ¹ = w _k ² = w _k ³ =. .. .. w _k ^s

Here, w _k represents the width of the text box at the depth k, and s represents the different sentences of the same depth (depth k). The value of w _k shall have during the minimum width _{m k} and the maximum width _{M k (m k ≦ w k} ≦ M k). The terms are defined below.

The character length of the text of the incoming or outgoing text is referred to as the text length. The length of the text can be arbitrary. As mentioned above, any unit (eg, pixels, millimeters, centimeters, inches, number of characters, etc.). The length of the text is less than _{m k and} larger _{than m k.} If the device sets the width of the textbox at depth _{k as} well as Mk and the length _{of the text is greater than Mk} , this means that the text will show up on a number of lines in the textbox. Also, even if the length of the text is smaller than _{m k , m k} is the width of the smallest possible text box at the depth k, so the text is when the width of the text box is m _k. It is displayed in the text box.

In TWA, each time the device detects an incoming or outgoing text (ie, a text message), the device begins adjusting the width of all text boxes in the layout. Therefore, the device selects the width of the "best" or "optimized" text box at depth n. As mentioned above, according to the second rule, this means that the width of all textboxes at depth n is the width of such newly calculated "best" or "optimized" textboxes. To be the same as. Also, if the width of this "best" or "optimized" text box is determined by the depth n, the depths are 0, 1, 2, ... .. .. , N-1, n + 1, ... .. .. The width of the text box is determined by the rest at, d, because GFAL, GVAL and GMAL obey geometric rules. The width of this "top" or "optimized" text box is the reference width at depth n and ^{is displayed as R (n)} (0 ≦ n ≦ d).

Assuming that R ⁽ⁿ⁾ is determined by an algorithm or mathematical formula, if the device operates on GFAL, the width of the remaining textbox can be calculated using a simple linear equation and the device is on GVAL. Once in operation, the width of the remaining text box can be calculated using simple trigonometric properties. For GMAL, the device calculates the width of the remaining text boxes based on the mode of layout.

The flow of ideas is illustrated in detail in FIGS. 13a and 13B.

FIG. 13a illustrates a detailed view of the TWA process. As appears at the top of the flow chart, the device length t _{k s} ^(this is a is the length of the s-th sentence of the text of the depth k) of the text incoming having or to detect the outgoing texts. After detection, the next step is to discover the width and depth of the reference. Finding the width of the reference involves two steps expressed in an equation. This set of equations that determines the reference width is called the reference width equation (Reference-Width Equation, RWE). The set of equations that determine the reference depth is called the reference depth equation (Reference-Deptence Equation, RDE). In general, RWE is divided into two stages. The first step is to simply calculate the value from a pool of text lengths at the same depth. This process is represented by a mathematical function and is referred to as the intra-depth equation (intra DE). Intra DE is a set of functions in which each function uses the length of text at the same depth as input. Each function is displayed as follows.

T _k = _fintra (t _k ¹ , t _k ² , t _k ³ , ..., t _k ^s )

Here, _fintra (・) is a function that uses the lengths of all (s) texts at a depth of k. t _k ^s represents the text length of the sth text message at depth k. The result of the function is a T _k is a number of values (real non-negative number). Intra DE is k = 0,1,2,. .. .. Calculate all T _k values for d. Therefore, the intra DE has d + 1 values {T ₀ , T ₁ , T ₂ , ... .. .. Generate T _d }. Note that the non-negative integer k is just an index representing the depth from 0 to d (where d is the deepest depth in the layout). There is only one main sentence, where T ₀ = f _intra (t ₀ ¹ ), and therefore for a text message of depth 1, T ₁ = f _intra (t ₁ ¹ , t ₁ ² ,. .. t ₁ ^a ) and depth 2 text message, T ₂ = _fintra (t ₂ ¹ , t ₂ ² , ... t ₂ ^b ), and the same for the remaining depth be. Therefore, after the intra DE has been applied to all text lengths, {T ₀ , T ₁ , T ₂ , ... .. .. , T _d } set exists.

Once the intra DE is calculated, the next step is to find the width of the reference using the inter-depth equation (inter DE). Unlike the intra DE, the inter DE is a set of values {T ₀ , T ₁ , T ₂ , ... .. .. , T _d } is used to compose a single function. The inter DE is displayed as follows.

R = f _inter (T ₁ , T ₂ , ..., T _d ).

Here, _finter (・) is a function that uses all (d + 1) values from the intra DE. The result of the inter-DE is indicated by R, which is the width of the reference. When the width of the reference is determined, the depth n of the reference is determined. There are various ways to determine the reference depth, such as n = d (d is the deepest depth) setting, n = 0 setting, random selection of reference depth, and so on. One "reasonable" method is to set the reference depth to the depth to which the maximum value is applied from the results of the intra DE. Mathematically

T _n = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d }.

To further generalize the procedure, RDE is expressed as:

n = f _RDE (t ₀ ¹ , t ₁ ¹ , t ₁ ² , ..., t ₁ ^a , t ₂ ¹ , t ₂ ² , ..., t ₂ ^b , t ₃ ¹ , t ₃ ² ,. ..., t ₃ ^c , ..., t _d ¹ , t _d ² , ..., t _d ^z )

or,

n = f _RDE (length of all text in layout)

This equation means that the reference depth n is determined based on the length of all the text in the layout. Once the reference width and reference depth have been calculated, the result is displayed in ^{R (n).}

As described above, the second process ^{checks whether the reference width R (n)} determined from the first process is between the minimum and maximum widths at the depth n. That is, it is inspected whether _mn ≤ R ⁽ⁿ⁾ ≤ M _n. If the reference width is _{less than mn} , the reference width R is adjusted by _mn. On the other hand, when the reference width is _{larger than M n} , the reference width R is adjusted by _{M n.} The purpose of this process is to ensure that the range of calculated criteria is within acceptable limits. The equation that performs this process is called the Min-Max Condition Equation (MCE). Mathematically, this is simply:

R = min {M _n , max { _mn , R}}

Once R ⁽ⁿ⁾ is calculated, the device determines the width of the text box with respect to the remaining text boxes in the layout. Since all text boxes of the same depth have the same text box width, the device determines only the width of d text boxes. ^{That is, when the reference width R (n)} of the text box having a depth of n is determined, the device has a depth of 0, 1, 2, ... .. .. , N-1, n + 1, ... .. .. , D Determine the width of the text box. This is the third process and is referred to as the Propagating Reference-width Equation (PRE). PRE is a function of depth i with R, n and d as parameters, and is displayed as follows.

w _i = f _RDE (i | R, n, d)

i = 0,1,2 ,. .. .. , N-1, n + 1, ... .. .. , D.

Since the alignment lines in GFAL are shifted in parallel, once R ⁽ⁿ⁾ is determined, the width of the remaining text boxes can be calculated using linear equations. On the other hand, in GVAL, since the alignment line rotates, the width of the remaining text box can be calculated using the characteristics of the trigonometry.

Finally, the final process involves placing the text inside the textbox and placing the textbox in their correct position.

Note that the flowchart in FIG. 13a is for GFAL and GVAL. However, in the case of GMAL, there are two sets of maximum and minimum widths- _Mk ^f , M _k ^v , m _k ^f and m _k ^v , so an additional step of inspecting the layout mode is needed. This is illustrated in the shading box (1300) of FIG. 13b. When R ⁽ⁿ⁾ is calculated, the device checks to see if it is greater than _{M n} ^v, which is the maximum width of ^{R (n) mode.} If R is _{greater than M n} ^v , the device confirms that the layout is in GFAL mode and checks for:

R = min {M _n ^f , R}

On the other hand, if R is M _n ^v or less, the device confirms that the layout is in GVAL mode and inspects the following:

R = max { _mn ^v , R}

The device performs PRE based on such information, including which mode the layout is in, and determines the width of the remaining text boxes.

There are numerous different types of RWE and RDE equations that determine the reference width and reference depth R ^(n). As mentioned above, the ^{process of determining R (n)} uses a pool of text lengths.

FIG. 14 illustrates a variety of RWEs and RDEs used as "plug-ins". Detailed description is provided here for the purposes of exemplifying RWE and RDE.

The first RWE in the table of FIG. 14 is the maximum (Maximum of Maximums, MoM) among the maximums. As the name implies, this process chooses the longest text length as the reference width. First, in the intra DE, the largest text length is selected among the text lengths at the same depth. This is expressed as follows.

_{^{T k = max {t k 1}} , t k 2, t k 3,. .. .. } (K = 0,1,2, ..., d)

The result is the next set.

{T ₀ , T ₁ , T ₂ , ... .. .. , T _d }

The Inter DE then selects the largest in the above set, which is expressed as:

R = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d }

From now on, the device selects the depth of the largest text length and selects the reference depth n. This is expressed as follows.

T _n = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d } n

Here, the width of the reference is R and the depth of the reference is n.

The second RWE in the table of FIG. 14 is the maximum average (Average of Maximums, AoM). As the name implies, this process chooses the largest text length at each depth and then averages them. This average is selected by the width of the reference. First, in the intra DE, the largest text length is selected among the text lengths at the same depth. This is expressed as

_{^{T k = max {t k 1}} , t k 2, t k 3,. .. .. } (K = 0,1,2, ..., d)

The result is the next set.

{T ₀ , T ₁ , T ₂ , ... .. .. , T _d }

The Inter DE then calculates the average of the above set, which is expressed as:

R = (T ₀ + T ₁ + T ₂ + ... + T _d ) / (d + 1)

The device selects the depth at which the length of the largest text appears as the reference depth n. This is expressed as follows.

T _n = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d } n

Here, the width of the reference is R and the depth of the reference is n.

The third RWE in the table of FIG. 14 is the maximum normalization (Normalization of Maximums, NoM). As mentioned above, any text box is less than or equal to the length of the text box of its parent text. Since the width of all text boxes is limited by the _{maximum width M k at depth k} , it is reasonable to normalize _{any text length t k} to its maximum length M k. For example, if t ₀ = 90, t ₁ = 90, M ₀ = 100 and M ₁ = 90, and normalized by the maximum width corresponding to the length of the text, the result would be:

t ₀ / M ₀ = 0.9 and t ₁ / M ₁ = 1.0

This means that the length of the text at depth 1 is greater than the length of the text at depth 0 compared to its maximum permissible width. This is the background of normalization. First, in the intra DE, the largest text length is selected among the text lengths at the same depth. This is expressed as

_{^{T k = max {t k 1}} , t k 2, t k 3,. .. .. } (K = 0,1,2, ..., d)

The result is the next set.

{T ₀ , t ₁ , t ₂ , ... .. .. , T _d }

The inter DE then selects the largest in the above set, and each value is normalized by the corresponding width, which is expressed as:

N = max {T ₀ / M ₀ , T ₁ / M ₁ , T ₂ / M ₂ , ... .. .. , T _d / M _d }

When the maximum of the normalized values is found, the process "cancels" the normalization, which is expressed as:

R = N ・_Mk

The device selects the depth at which the maximum length of the normalized text appears, and selects the reference depth n. This is expressed as follows.

T _n = max {T ₀ / M ₀ , T ₁ / M ₁ , T ₂ / M ₂ , ... .. .. , T _d / M _d } n

Therefore, the width of the reference is R and the depth of the reference is n.

The fourth RWE is the average of normalized maximums (AoNM). In intra DE, the length of the text length longest text of the same depth is selected which is expressed by T _k. Subsequently, the inter DE finds the average of the above normalized maximum values and expresses the value by N. After finding N, the device has the largest normalized text length max {T ₀ / M ₀ , T ₁ / M ₁ , T ₂ / M ₂ , ... .. .. , T _d / M _d }, and the depth from this length is calculated. From now on, the device multiplies N by the maximum length at the depth just calculated. Therefore, the reference width R is expressed as follows.

R = N ・_Mk

The device selects the depth at which the maximum length of the normalized text appears, and selects the reference depth n. It is expressed as follows.

T _n / M _n = max {T ₀ / M ₀ , T ₁ / M ₁ , T ₂ / M ₂ , ... .. .. , T _d / M _d } n

Therefore, the width of the reference is R and the depth of the reference is n.

The fifth RWE is the maximum of the average. This process is the opposite of the maximum average (AoM). In intra DE, to determine the average text length in the same depth, to express it in T _k. Subsequently, the inter DE finds the maximum value from the above values. Therefore, the width R of the reference is the above-mentioned maximum value, and the depth of the reference is T _n = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d }.

The sixth RWE is the average of the averages. In intra -DE, obtains the average of the text length in the same depth, it is expressed by T _k. The inter DE then finds the average of the above values. Therefore, the width R of the reference is the above-mentioned average value, and the depth of the reference is T _n = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d }. It should be noted here that in intra DE, the lengths of all texts at the same depth were added and then divided by the number of texts at that depth. On the other hand, in the inter DE, the value obtained by the intra DE is added and then divided by d + 1. This is to avoid the case where d = 0.

The seventh RWE is the average length of the text. In intra DE, determine the average length of the text in the same depth, it is expressed by T _k. The inter DE then finds the average of the above values. Therefore, the width R of the reference is the above-mentioned average value, and the depth of the reference is T _n = max {T ₀ , T ₁ , T ₂ , ... .. .. , T _d }.

Note that the final RWE in FIG. 14 is the width of the fixed text box (FTW). This is an example in which the width of the text box is fixed at each distinctive width at all depths k, regardless of the size of the incoming or outgoing text.

We will now explain how TWA is applied in different layouts. For exemplary purposes, MoM is used for the reference width equation.

FIG. 15a illustrates the results after TWA applied with GFAL. For example, SWL-LR is used.

In (1) of FIG. 15a, the user (that is, the user's device (200)) receives a sentence from the user A (that is, the device of the user A), and the sentence becomes the main sentence. It is assumed that the text length of the received text is a (numerical value), less than m, and therefore R ^{(0) = m.}

In (2) of FIG. 15a, the user receives a sentence from user B, and the sentence becomes a child sentence of the main sentence. Since the lengths of both texts are the same at a and less than m, it is therefore assumed that it does not matter if a sentence is the reference width. Here, the device selects the text of user B as the reference width, and therefore R ⁽¹⁾ = w ₁ = m. This means that the width of the remaining text box in the text is w0 = m.

In (3) of FIG. 15a, the user receives a sentence from user C, and this sentence becomes a child sentence of the sentence from user B. It is assumed that the text length of the received text is the same as the others. The device selects the text of user C as the reference width, and therefore R ⁽²⁾ = w ₂ = m. This means that the width of the text box at depths 0 and 1 is m (w ₀ = m ₁ = m).

In (4) of FIG. 15a, the user receives a sentence from the user D, and this sentence becomes a child sentence of the sentence from the user C and is arranged below the sentence received from the user C. It is assumed that the text length of the received text is the same as b and greater than m. The device selects the text of user D as the reference width and therefore R ⁽³⁾ = b. This means that the width of the remaining text boxes at depths 0, 1 and 2 is b (w ₀ = w ₁ = w ₂ = b).

In (5) of FIG. 15a, the user receives a sentence from user E, which is a child sentence of the sentence from user D, and is arranged below the sentence received from user D. It is assumed that the text length of the received text is a, which is less than m. The device still selects User D's text to the reference width, and thus R ⁽³⁾ = B. This means that the width of the text box at depths _{0, 1, 2, and 4} is b (w 0 = w 1 = w 2 = w 4 = b).

In (6) of FIG. 15a, the user receives a sentence from user F, which is a child sentence of the main sentence, and this is arranged below the sentence received from user E. It is assumed that the text length of the received text is c, which is larger than b. The device selects the text of user F to the reference width and therefore R ⁽¹⁾ = c. This adjusts the width of the text box at the remaining depth to be c (w ₀ = w ₂ = w ₃ = w ₄ = c).

Finally, in FIG. 15a (7), the user receives a sentence from user G, which is a child sentence of the sentence from user F, which is placed below the sentence received from user F. It is assumed that the text length of the received text is the same as d and greater than c and M. Since the width of the text box larger than M is unacceptable, the device is based on the text of user G and therefore R ⁽²⁾ = M. This adjusts the width of the text box at the remaining depth to be M (w ₀ = w ₁ = w ₃ = w ₄ = w ₅ = M).

From now on, note that the layout has reached its maximum possible width.

FIG. 15b illustrates the results after TWA has been applied in GFAL. For example, FAL-R is used. m _k on superscript d of ^d is, m _k ^d is how dependent on the depth of the current deepest text layout. Or note that it is used to explain it. Further, md ^d = m.

In (1) of FIG. 15b, the user receives a sentence from the user A, and the sentence becomes the main sentence. It is assumed that the text length of the received text is a (numerical value), less than m, and therefore R ⁽⁰⁾ = m ₀ ⁰ .

In (2) of FIG. 15b, the user receives a sentence from user B, and this sentence becomes a child sentence of the main sentence. It is assumed that the lengths of both texts are the same, so it does not matter which sentence is the reference width. However, the device selects the text of user B as the reference width, and therefore R ⁽¹⁾ = M ₁ ¹ . This means that the value of the width w _{0 of the text box is m 0} ¹ (w ₀ = m ₀ ¹ ). _{Note that the width of the text box for text at depth 0} is set at m ^{0 1} , and the width of the text box for text at depth ¹ is set at _{m 1 1.} In the main sentence is the only sentence (the depth of the deepest is 0), if the length of the text is less than m, width w ₀ of the text box is the same as m ₀ ¹ less than m _{⁰ 0.} Now, since the deepest depth is 1, the minimum width at depth 0 is m ₀ ¹ (≠ m ₀ ⁰ ).

In (3) of FIG. 15b, the user receives a sentence from the user C, and this sentence becomes a child sentence of the sentence from the user B. It is assumed that the text length of the received text is the same as the others. Device, the text of user C selects the width of the reference, ^therefore, the _{^{R (2) = m 2 2}} . This means that the width of the text box is w ₀ = m ₀ ² , w ₁ = m ₁ ² . When the deepest depth is 2, the minimum width for each depth is exemplified. That is, m ₀ ² > m ₀ ¹ > m ₀ ⁰ and m ₁ ² > m ₁ ¹ .

In (4) of FIG. 15b, the user receives a sentence from user D as a child sentence of the sentence from user C, which is placed below the sentence received from user C. It is assumed that the text length of the received text is the same as b and _{greater than m 3} ^3. The device selects the text of user D as the reference width, and therefore R ⁽³⁾ = b. This is the width of the text box w ₀ = 3a + b, w ₁ = 2a + b and w ₂ = a + b. The minimum width of each depth when the deepest depth is 3 is illustrated. That is, m ₀ ³ > m ₀ ² > m ₀ ¹ > m ₀ ⁰ , m ₁ ³ > m ₁ ² > m ₁ ¹ and m ₂ ³ > m ₂ ² .

In (5) of FIG. 15b, the user receives a sentence from user E, which is a child sentence of the sentence from user D, which is placed below the received sentence from user D. The length of the received text text is the same as a, assumed to be less than m ₄ ^4. Device again sentences user D selects the width of the reference, b is smaller than _m ^{3 4,} therefore reference width ^R (3) in ₌ a _m ^{3 4.} Thereby, the width of the text box is adjusted as _{w 0} = m ₀ ⁴ , w ₁ = m ₁ ⁴ , w ₂ = m ₂ ⁴ , w ₄ = m ₄ ^4.

In (6) of FIG. 15b, the user receives a sentence from user F, which is a child sentence of the main sentence, and is placed below the sentence received from user E. It is assumed that the text length of the received text is the same as C and greater than b. The device selects the text of user F as the reference width and therefore R ⁽¹⁾ = C. This means that the width of the text box is w ₀ = a + c, w ₂ = c-a, w ₃ = c-2a, w ₄ = c-3a.

Finally, in (7) of FIG. 15b, the user receives a sentence from user G, which is a child sentence of the sentence from user F, and is placed below it. The text length of the received text is the same as d, which is assumed to be greater than _{c or M 2.} The device selects the text of user G as the reference width, and therefore R ⁽²⁾ = M ₂ . This means that the width of the text box is w ₀ = M ₀ , w ₁ = M ₁ , w ₃ = M ₃ and w ₄ = M ₄ . Note that the maximum width M _k does not depend on the current deepest depth d. At that time, the layout reached its maximum possible width.

The focus will be on TWA applied to GVAL. There are two types of GVAL, namely fixed rotation point GVAL and immovable rotation point GVAL. As mentioned above, in GVAL, the alignment lines I ₁ and I ₀ rotate counterclockwise or clockwise. Therefore, as the name suggests, at the fixed rotation point, the rotation point is fixed, but the point at the immovable rotation point is shifted downward as the depth of the transmitted / received text becomes deeper. At the fixed rotation point GVAL, _{only the minimum width m k} ^d depends on the current deepest depth d, but at the immovable rotation point GVAL, both the maximum width M _k ^d and the minimum width m _k ^d are currently present. Depends on the deepest depth d of.

FIG. 15c illustrates the results after TWA has been applied to the fixed point GVAL. For example, a fixed point VAL-R is used. Note that the rotation point in this example is fixed at 7γ.

In (1) of FIG. 15c, the user receives a sentence from the user A, and the sentence becomes the main sentence. It is assumed that the text length of the received text is a (numerical value), less than m, and therefore R ⁽⁰⁾ = m ₀ ^0.

In (2) of FIG. 15c, the user receives a sentence from user B, and the sentence becomes a child sentence of the main sentence. It is assumed that the lengths of both texts are the same, so it does not matter if a sentence is the reference width. However, the device selects the text of user B as the reference width, and therefore R ⁽¹⁾ = m ₁ ¹ . This means that the width of the text box is w ₀ = m ₀ ¹ . Since the deepest depth is 1, the minimum width at depth 0 is m ₀ ¹ (≠ m ₀ ⁰ ).

In (3) of FIG. 15c, the user receives a sentence from the user C, and the sentence becomes a child sentence of the sentence from the user B. It is assumed that the text length of the received text is the same as the others. Device, the text of user C selects the width of the reference, ^therefore, the _{^{R (2) = m 2 2}} . This means that the width of the text box is w ₀ = m ₀ ² , w ₁ = m ₁ ² . The minimum width for each depth when the deepest depth is 2 is exemplified. That is, m ₀ ² > m ₀ ¹ > m ₀ ⁰ and m ₁ ² > m ₁ ¹ .

In (4) of FIG. 15c, the user receives another sentence from user D, which is a child sentence of the sentence from user C, which is placed below the sentence received from user C. Assume that the text length of the received text is the same as b and _{greater than m 3} ^3. The device selects the text of user D as the reference width and therefore R ⁽³⁾ = b. This is the width of the text box at depth 0, 1, 2, and 3 is the same as the length between the alignment lines L ₁ and L _{0. The widths w 0} , w ₁ and w ₂ of each remaining text box are calculated using the characteristics of trigonometry.

In (5) of FIG. 15c, the user receives a sentence from user E, which is a child sentence of the sentence from user D, and is placed below the sentence received from user D. Suppose the length of the received text text the same as a, assume that less than m ₄ ^4, the length of the text (= b) is less than ₃ ⁴ m Text "DEFG". Device is again selected sentences user D to the width of the reference, b is smaller than ^{_{m 3 4, R (3)}} = m 3 is ^4. This gives the width of the text box w ₀ = M ₀ ⁴ , w ₁ = M ₁ ⁴ , w ₂ = M ₂ ⁴ , w ₃ = M ₃ ⁴ , and w ₄ = M ₄ ⁴ . The minimum width of each text box when the current deepest depth is 4 is predetermined by the characteristics of trigonometry.

In (6) of FIG. 15c, the user receives a sentence from user F, which is a child sentence of the main sentence, and this is placed below the sentence received from user E. Another alignment line (1500) is drawn on the layout. The rotation point of this new alignment line is 5 units away from the received text (as the first rotation point is 5 units away from User B's text). Assume that the text length of the received text is the same as c and greater than b. The device selects the text of user F as the reference width and therefore R ⁽¹⁾ = C. This is the same as the length between the width of the text box in the remaining depth 0,1,2,3,4 is aligned lines _{L 1} and _{L 0.} Again, the width of each remaining text box is calculated by the characteristics of trigonometry.

Finally, in (7) of FIG. 15c, the user receives a sentence from user G, which is a child sentence of the sentence from user F, and is placed below it. It is assumed that the text length of the received text is the same as d, which is greater than c and M2. The device selects the text of user G by the reference width, so R ⁽²⁾ = M ₂ . This gives the width of the remaining text boxes w ₀ = M ₀ , w ₁ = M ₁ , w ₃ = M ₃ and w ₄ = M ₄ . Note that the layout has reached its maximum possible width.

FIG. 15d illustrates the results after TWA has applied to the immovable point GVAL. In this example, the immovable point VAL-R is used. Note that the rotation point in this example is initially located at 4γ.

In (1) of FIG. 15d, the user receives the sentence from the user A, and the sentence becomes the main sentence. It is assumed that the text length of the received text is a (numerical value), less than m, and therefore R ⁽⁰⁾ = m ₀ ^0.

In (2) of FIG. 15d, the user receives a sentence from user B, and the sentence becomes a child sentence of the main sentence. The rotation point moves down one unit to form a new alignment. It is assumed that the lengths of both texts are the same, so it does not matter if a sentence is the reference width. However, the device selects the text of user B as the reference width, and therefore R ⁽¹⁾ = m ₁ ¹ . This makes the width of the text box w ₀ = m ₀ ¹ . Since the deepest depth is 1, the minimum width at a depth of 0 is m ₀ ¹ (> m ₀ ⁰ ).

In (3) of FIG. 15d, the user receives a sentence from the user C, and the sentence becomes a child sentence of the sentence from the user B. The rotation point moves down one unit to form a new alignment. Assume that the text length of the received text is the same as the others. Device, the text of user C selects the width of the reference, therefore the _{^{R (2) = M 2 2}} . This gives the width of the text box w ₀ = m ₀ ² and w ₁ = m ₁ ² . The minimum width for each depth when the deepest depth is 2 is exemplified. That is, m ₀ ² > m ₀ ¹ > m ₀ ⁰ and m ₁ ² > m ₁ ¹ .

In (4) of FIG. 15d, the user receives another sentence from user D, which is a child sentence of the sentence from user C, which is placed below the sentence received from user C. The rotation point moves down one unit, forming a new alignment. Assume that the text length of the received text is the same as b and _{greater than m 3} ^3. The device selects the text of user D as the reference width, and therefore R ⁽³⁾ = b. This is the width of the text box at a depth 0, 1, 2 and 3 is the same as the length between the alignment lines L ₁ and L _{0. The widths w 0} , w ₁ and w ₂ of each remaining text box are calculated using the characteristics of trigonometry.

In (5) of FIG. 15d, the user receives a sentence from user E, which is a child sentence of the sentence from user D, which is placed below the sentence received from user D. The rotation point moves down one unit, forming a new alignment. The length of the received text text are the same as a, assuming that m ₄ ⁴ less than assumed text length of the text "DEFG" (= b) is to be less than ₃ ⁴ m. Device is selectively again sentence reference of the width of the user D, b _is smaller than ^{_{m 3 4, R (3)}} = m 3 is ^4. This gives the widths of the remaining text boxes w ₀ = m ₀ ⁴ , w ₁ = m ₁ ⁴ , w ₂ = m ₂ ⁴ and w ₄ = m ₄ ⁴ . The minimum width of each text box when the current deepest depth is 4 is predetermined by the characteristics of trigonometry.

In (6) of FIG. 15d, the user receives a sentence from user F, which is a child sentence of the main sentence, and is placed below the sentence received from user E. The rotation point does not move down because the text is not the new deepest depth. However, another alignment line (1502) is drawn on the layout. The rotation point of this alignment line is about 5γ away from the received text (as the first rotation point is 5 units away from User B's text). Assume that the text length of the received text is the same as c and greater than b. The device selects the text of user F as the reference width and therefore R ⁽¹⁾ = c. This is the same as the length between the width of the text box in the remaining depth 0,1,2,3,4 is aligned lines _{L 1} and _{L 0.} Again, the width of each remaining text box is calculated by the characteristics of trigonometry.

Finally, in (7) of FIG. 15D, the user receives a sentence from user G, which is a child sentence of the sentence from user F, which is placed below the sentence received from user F. The rotation point does not move down. The length of the received sentence text assumed larger than c and m ₂ ⁴ same as d. Device, the text of user G selected width of the reference, ^therefore, the ^{_{R (2) = m 2 4}} . This gives the width of the remaining text box w ₀ = m ₀ ⁴ , w ₁ = m ₁ ⁴ , w ₃ = m ₃ ⁴ , w ₄ = m ₄ ⁴ . Note that the layout has reached its maximum possible width.

Further, when the user receives a new sentence having a depth of 5, the maximum width M _i ⁵ (i = 1 to 5) is _{different from M j} ⁴ (j = 1 to 4). Note that _{M 0} ⁵ = M ₀ ⁴ regardless of the value of depth d. Therefore, in _general, it is _M ^{k a} ≧ _M ^{k b} becomes, a>b> 0. Therefore, in the case of the immovable point GVAL, the maximum width M _k ^d depends on the current deepest depth d.

FIG. 15e illustrates the results after TWA has been applied to the immovable point GMAL. For example, the immovable point MAL-R is used. This means that the immovable point VAL-R is used for the VAL part of the MAL-R.

In (1) of FIG. 15e, the user receives a sentence from A, and the sentence becomes the main sentence. It is assumed that the length of the text of the received text is a (numerical value), which is smaller than m, and therefore R ⁽⁰⁾ = m ₀ ^0.

In (2) of FIG. 15e, the user receives a sentence from user B, and the sentence becomes a child sentence of the main sentence. The rotation point is now at the midpoint on the left side of the new text, forming a new alignment. It is assumed that the lengths of both texts are the same, so it does not matter what text is the reference width. However, the device selects the text of user B as the reference width, and therefore R ⁽¹⁾ = m ₁ ¹ . This makes the width of the remaining text box w ₀ = m ₀ ¹ . Because the length of both the text is smaller than _m ^{0 1 v} and _m ^{1 1 v,} the layout is in the mode of VAL-R (superscript v indicates that the layout of VAL mode).

In (3) of FIG. 15e, the user receives a sentence from the user C, and the sentence becomes a child sentence of the sentence from the user b. The rotation point is now at the midpoint on the left side of the new text, forming a new alignment. Assume that the text length of the received text is the same as the others. The device selects the text of user C as the reference width and therefore R ⁽²⁾ = m ₂ ^2v . This gives the width of the remaining text boxes w ₀ = m ₀ ^2v and w ₁ = m ₁ ^2v . Since the length of all text _m ⁰ _2v, less than ^{m 1 2v} and _m ^{2 2v,} layouts still in VAL-R mode.

In (4) of FIG. 15e, the user receives another sentence from user D, which is a child sentence of the sentence from user C, which is placed below the sentence received from user C. The rotation point is now in the middle left of the new sentence, forming a new alignment. It is assumed that the length of the text of the received sentence is the same as b and _{larger than m 3} ^3v. The device selects the text of user d as the reference width and therefore R (3) = b. Note that the layout will be changed to FAL-R mode because b is _{greater than m 3} ^3v. This results in the widths of the remaining text boxes w ₀ = 3a + b, w ₁ = 2a + b and w ₂ = a + b.

In (5) of FIG. 15e, the user receives a sentence from user E, which is a child sentence of the sentence from user D, and is placed below the sentence received from user D. The length of the received text text are the same as a, assuming that m ₄ ^4v smaller than assumed text from the user D is an m ₃ ^4v smaller. This changes the layout to VAL-R mode and the rotation point is placed at the midpoint on the right side of the text from user E. Apparatus, selects again the width sentences criteria of user D, b _is smaller than ^{m 3 4v,} the ^{_{R (3) = M 3 4V}} . This is the rest of the width _W 0 ₌ ^M 0 4V text ^{_{boxes, W 1 = M 1 4V,}} W 2 = M 2 4V and W ^₄ = _{M 4} ^4V.

In (6) of FIG. 15a, the user receives a sentence from user F, which is a child sentence of the main sentence, and is placed below the sentence received from user E. It is assumed that the text length of the received text is the same as c and greater than B. Therefore, this changes the layout to FAL-R mode. Note that there is an empty text box below the new text. Such an "invisible" text box is to illustrate that the text is aligned with the linear alignment line (1504) that comes from the "virtual" text. The device selects the text of user F as the reference width and therefore R ⁽¹⁾ = c. This is the width of the text box w ₀ = a + c, w ₂ = c-a, w ₃ = c-2a and w ₄ = c-3a.

Finally, in FIG. 15e (7), the user receives a sentence from user G, which is a child sentence of the sentence from user F, which is placed below the sentence received from user F. It is assumed that the text length of the received text is _{larger than c and M 2 as well as d.} This means that the layout must still be in FAL-R mode. The device selects the text of user G as the reference width, and therefore R ⁽²⁾ = M ₂ ^4f . This makes the width of the text box w ₀ = M ₀ ^4f , w ₁ = M ₁ ^4f , w ₃ = M ₃ ^4f and w ₄ = M ₄ ^4f . Note that the layout has reached its maximum possible width.

TWA is feasible in a variety of situations.

The first situation is when the user rotates the device. It is assumed that most devices are rectangular and most users use the device in longitudinal mode. However, the user can rotate the device into transverse mode. This means that you can increase the maximum and minimum widths of the text box defaults due to the increased horizontal space. This process is referred to as TWA (TWA upon Rotation, hereinafter, TWA-R) during rotation.

The second situation is when a user communicates text with another user. In this case, the text length of the new sentence is added to the pool of existing text lengths and the process determines ^{R (k).} This process is referred to as TWA (TWA upon Send and Receive, hereinafter TWA-SR) when communicating.

The third situation is when the user decides not to display some text. In this case, the process ^{recalculates R (k)} and reverts to its original view when the user decides to display what is not visible. This process is referred to as TWA (TWA upon Collapse and Expand, hereinafter TWA-CE) for reduction and expansion.

The fourth situation is when the user deletes a sentence. In this case, the text length of the deleted text is excluded from the text length pool and R ^(k) is calculated again. This process is referred to as TWA (TWA upon Delete, hereinafter referred to as TWA-D) at the time of deletion.

Finally, the final situation is when the user modifies an existing sentence. In this case, modifying the existing text will affect the length of the text and the process will recalculate ^{R (k).} This process is referred to as TWA (TWA upon Modify, hereinafter, TWA-M) at the time of modification.

As explained so far, it can be seen that TWA plays an important role in RMS. This mechanism synchronizes and maintains the layout consistently, which is one of the purposes of RMS.

From now on, the characteristics of TWA (TWA-R) at the time of rotation will be described. So far, we've assumed that the layout is displayed on a physical screen in portrait mode. Each time the user changes the device to transverse mode, the device can run TWA again based on other values of M and m. Thus, in TWA-R, the term rotation means switching from longitudinal mode to transverse mode and vice versa. The device can be configured to perform TWA again upon rotation.

FIG. 16a illustrates two different display layouts, which are the same layout on the same device now displayed in different modes. Note that the numbers indicate the length of the text within each sentence (ie, each text message).

The layout of FIG. 16a (1) is in the vertical mode, and the layout of FIG. 16a (2) is in the horizontal mode. Since the values of M and m in the vertical mode are ^{smaller than the values of M *} and m ^{* in} the horizontal mode, the sentence (2) in FIG. 16a is wider than the sentence (1) in FIG. 16a. For example, the text length of the sentence (1600) is 100 and can be divided into three lines of text in the vertical mode. On the other hand, when the device is in horizontal mode, as shown in 1602, the text may fit in one line.

16b and 16c illustrate two flowcharts similar to FIGS. 13a and 13b. In FIG. 16b, each time the device detects a rotation from longitudinal mode to transverse mode, the TWA process is _{performed with values of maximum width M n} ^* and minimum width _mn ^* of the difference. In FIG. 16c, each time the device detects a rotation from horizontal mode to longitudinal mode, the TWA process is executed, with _{values of maximum width Mn} and minimum width _mn of the difference.

17a-17c are flowcharts for organizing and displaying instant messages in a variety of structured schemes according to at least one exemplary embodiment presented in FIGS. 1-16c of the present invention.

The device (200) is a user device group for participating in a plurality of user devices (for example, a chat session or a group text mode set exclusively for group members) through the I / O interface (306) and the network communication interface (302). ) To communicate. When device (200) receives or sends text messages (including, but not limited to, image messages and / or videos, messages) between group member devices to participate in a chat session, for example. One or more processors of the controller (106) of (200) are configured to organize and display messages on a display (eg, a touch screen display) in a hierarchically structured manner. Therefore, the present invention defines parameters used to organize and display messages (ie, outgoing and incoming messages), as shown in FIGS. 8a and 8b and 9a-11b. That is, the parameters (for example, the user ID in FIG. 8b, the date and time of transmission, and the numbering) are parameters associated with information for identifying whether the message is the main message or a sub-message derived from the main message (hereinafter, the parameters). However, for convenience of explanation, it is called "message parameter"). When the processor detects the occurrence event of a message (that is, an outgoing message or an incoming message during a chat session), the processor extracts the message parameters from the message and analyzes each parameter among the message parameters. By doing so, it is possible to identify whether the message is the main message or the sub-message.

In addition, the processor defines parameters (hereinafter, simply referred to as "layout parameters" for convenience of explanation) including information on how to organize or display messages in a hierarchically structured manner. For example, a "layout parameter" is a parameter for one or more alignment lines (eg, first alignment line l ₁ and second alignment line l ₀ in FIGS. 9a-11b, indent parameters (ie, depths D and d),. each of the minimum width and the minimum width of the alignment line parameters, slope parameters (e.g., point P ₁ and P _0, of course, the angle delta ₁ and delta ₀₎ including. processor, for example, in Figure 9a-11b of the present invention As shown, various layout modes for messages are defined by setting various combinations of message parameters and layout parameters. Here, for the sake of brevity, each parameter for message parameters and layout parameters is defined. Are integrated here, as exemplified above, exemplary in FIGS. 9a-11b.

FIG. 17a organizes outgoing and incoming messages exchanged by the user of device (200) during a chat session, selects a layout mode from among the various layout modes that the user wants to display, and sets the layout mode selected by the processor. The flowchart to be used is illustrated (S1700).

As mentioned above, each time the user sends the first message (or main text), the ID (user ID and date and time of sending) and numbering are sent along with the actual text message. For the first message, the numbering is simply 0, which means that the message is the first message. However, when the user responds to the first message (or any sub-message), the device (200) simply generates a new numbering and attaches it to the existing ID. Finally, this new information is sent to other users.

FIG. 17b is a flowchart illustrating a method of sending a message to another user. The user sends the first message. Alternatively, it responds to an existing message (S1702). In the former case, an ID (user ID + message transmission date and time) and numbering are generated. In the latter case, a new numbering is generated based on the message the user is responding to. In addition, other related parameters are generated (S1704). In the final stage, the parameters described above are stored and transmitted to another user (ie, another user's device) (S1706).

FIG. 17c is a flowchart illustrating how to process the detected message. When a message occurs, the processor detects the message, and the processor extracts the message parameters from the message and analyzes the information of the extracted message parameters, so that the attributes (or characteristics) of the message, that is, the message It identifies whether it is a first message or a sub-message with respect to the first message (S1708). The processor determines the width of the reference and the depth of the reference when outgoing or incoming messages occur in sequence (S1710). The processor determines the width of the text box of the existing message in the layout and determines the width of the text box of the retrieved message. The processor then readjusts the width of the existing text box in the layout (S1712). Finally, the processor reorganizes the layout containing the detected messages in a hierarchically structured manner (S1714).

The processor organizes currently occurring outgoing or incoming messages during a chat session based on each previously set parameter and the defined reference width and reference depth in the selected layout mode. .. The processor determines the size of the text box for outgoing or incoming messages to be displayed, based on the size of the text box for the defined reference width and the defined reference depth. For the selected layout mode, the processor is set from the maximum width of the first alignment line parameter and the minimum width of the second alignment line parameter, the indent parameter and the slope parameter, based on the layout parameters previously set. As described above, the size (that is, the width) of the text box of each message is determined and adjusted, and the message is displayed in a hierarchically structured manner.

For example, in FIG. 9a, when the slope parameter is fixed, the text box of the outgoing or incoming message has the maximum and minimum values of _{the first alignment line parameter I 1} and the maximum width and maximum of _{the second alignment line parameter I 0.} Organized and displayed in the range specified by the narrow width. That is, in FIG. 9a, the width of the text box for each message is organized and displayed within the range specified for the maximum and minimum widths of the first and second alignment parameters, respectively, which range is also the degree of slope. It is specified for the fixed angles set in the parameters of (ie, points P ₁ and P ₀ , Δ ₁ and Δ ₀ ). As another example, in FIG. 9b, if the inclination parameter is fixed, text boxes outgoing or incoming message, the first alignment line parameter I maximum width and minimum width and the second alignment line parameter I ₀ for ₁ top Organized and displayed in the range specified by the large and minimum widths. That is, in FIG. 9b, the width of the text box of each message is organized and displayed in the range specified by the values of the first and second alignment parameters, which range is also set in the slope parameter. It is designated as a fixed angle (ie, points P ₁ and P ₀ , Δ ₁ and Δ _0). Also, in FIG. 9b, the processor organizes and displays messages classified from each branch message (or parent message to the classified message) within a family range parallel to the previous range, and the resulting messages. The range of the family is set by the alignment line I ₁ shifted to the left and the alignment line I ₀ shifted to the right.

For example, in FIG. 10a, when the slope of the parameter points (delta ₁ and delta ₀₎ is variously set, text boxes outgoing or incoming message, the maximum width and minimum width of the first alignment line parameters I ₁ and the the second aligning parameters maximum width and minimum width of the I _0, the angle appears to organize a range that has been modified, the first and second alignment lines, set angle in inclination parameter (i.e., delta ₁ and delta _{At 0} ), each slope is provided at the center of the point P. Here, the processor controls the first and second alignment lines to rotate clockwise or counterclockwise within the preset maximum and minimum widths of the first and second alignment line parameters, respectively. ..

In an exemplary embodiment, the processor linearly shifts the first and second alignment lines to the left or right to adjust the width of the text box for each message, as illustrated in FIGS. 9a-9b. do. Alternatively, by adjusting the size, the message is reorganized and displayed in another hierarchical structured method.

In another exemplary embodiment, the processor angularly shifts the first and second alignment lines clockwise or counterclockwise to the width of the text box for each message, as illustrated in FIGS. 10a-11b. To adjust. Alternatively, the message can be reorganized and displayed in another hierarchical structure by adjusting the size.

Having defined a large number of layouts, it is clear that there must be a mechanism for managing layouts and text on the device. This is done by a feature of the invention that allows the user to manage the layout. 18 commands are exemplarily presented, which are referred to as commands (command (s)) relating to the display method of these sentences. Before displaying them, note that there are many ways in which the device can provide such instructions to the user. The methods by which the device provides commands are roughly classified into three methods.

The first method is referred to as internalized commands (ie, internalized type or state commands). In this way, the instructions are not visible to the user. The user should take the necessary steps to see the instruction set that he or she can apply to the layout or text.

FIG. 18a illustrates an internalized instruction. In (1) of FIG. 18a, the user uses the sentence x. A predefined hand gesture (or a predefined user gesture, such as finger touch, movement, tapping, etc. on the display) is applied to 1. When the device detects this hand gesture, the device displays an instruction set at 1800 as shown. This area is referred to as a prompt command display area (1800). As illustrated in FIG. 18a (2), when the device applies a predefined hand gesture to a particular sentence, the device inspects the sentence inside the sentence and displays it with all commands (Com1, Com2, etc.). Is displayed in the prompt command display area. The user sees the instruction and applies a hand gesture to the instruction that the user intends to apply.

The second method is referred to as externalized commands (ie, externalized type or state commands). In this method, the instruction is immediately displayed on each sentence. In this method, the instruction is immediately displayed on each sentence. Therefore, the user can apply the instruction immediately after seeing it.

FIG. 18b illustrates an externalized instruction. As illustrated in FIG. 18b (1), the instructions are immediately displayed on each sentence. In the drawing, all commands are displayed on the right side of each sentence. The area in which the command is displayed is referred to as a command display area (1802). Therefore, in an externalized instruction, the device keeps track of the internal state of each sentence each time the instruction is applied to the layout, and displays all applicable instructions (Com1, Com2, etc.) for each sentence. Will be) updated. Or update. Occasionally, instead of arranging applicable instructions in the instruction display area, symbols can be used to easily replace the displayed instructions. This idea is displayed in (2) of FIG. 18b. Only the position of this symbol is shown in 1804, 1806 and 1808. Each of these symbols substitutes for a particular instruction.

Finally, the last method is referred to as customized commands (ie, customization correspondence or state instructions). In this method, different hand gestures represent commands. Therefore, it is assumed that the user "knows" in advance a specific (customized) hand gesture that represents a specific instruction. If the instruction is customized, the instruction will not be displayed in any way.

FIG. 18c illustrates a customized instruction. The drawing shows that the user applies the customized hand gesture to the text in order to apply the instructions represented by the customized hand gesture.

That is, the idea of internalized and externalized instructions is basically the same, but in internalized instructions the user should take additional steps to actually see the applicable instructions. On the other hand, in an externalized instruction, such an instruction is used immediately. The idea of customized instructions is different from the other two, where specific instructions can be applied to the layout by specific (customized) hand gestures.

Before providing a detailed description of the 18 difference instructions, let us first explain how the text is transmitted.

FIG. 19 illustrates user B sending a sentence to another user. Assume that user B sends text to three other users, user A and user C, user D.

In (1) of FIG. 19, the user applies a hand gesture to the "message generation" button on the RMS screen to start generating a message. The software allows User B to send a message to other users he desires. He adds User A, User C and User D.

In (2) of FIG. 19, all users participating in the "chat room" created by user B are shown to 1900. Also, the user is presented with a soft keyboard (1902) that allows user B to generate a message. The user generates text in the text input area (1904), where 1906 is the cursor. The user applies a hand gesture to the send button (1908) when the message has been generated.

In FIG. 19 (3), upon detecting a hand gesture on the submit button, the device displays the user's text (1910) on the user's device and sends the text and other information to the other three users. .. The other three users receive the same message, as shown in the drawing. In the sentence name, the user who sent the sentence (owner of the sentence) and the transmission time are displayed in the sentence.

From now on, how the reply instruction is applied to the layout will be described.

Consider the situation in which the user responds to the text and how it is done. When responding, this means responding to or replying to the received text. Emphasize that a response command cannot exist without the received or transmitted text. Also, the response command will not be prompted unless you specify what text the user is trying to respond to. The act of responding is the same as sending, but with its own meaning. This is conceptually related to the text the user is responding to. When it comes to responding, as the name implies, it is a response to an existing sentence, and most importantly, it emphasizes that it is a sentence generated by applying a response instruction. The response instruction is a response to a specific message received from another user in a chat session, which activates the message composition window on the processor to send the message, because the specific message is selected. It is done when it is detected. The message composition window of the response instruction sets parameters (or options) for setting the expiration date and time of the message that responds to a specific message, and whether or not the recipient can send a response message to it. include. Here, the message compose window is activated to join a chat session, send an initial message to another invited user, or send a message in response to a previously received message from another user. Be made. The response instruction causes the processor to extract parameters in a specific message received from another user in a chat session, and the extracted parameters are the ID information of another user, the transmission date / time information of a specific message, and the message. Includes at least one piece of priority information and numbering information (information about the main key and numbering) for the order of messages. The response instruction is configured to update the extracted parameters based on the information analysis of the extracted parameters in a particular message. The response instruction is also configured to send a message with updated parameters in response to a particular message to another user.

FIG. 20a illustrates how the user responds to existing text. Here, it is assumed that user B responds to an existing sentence.

In (1) of FIG. 20a, the user selects an existing sentence and applies a response instruction.

In FIG. 20a (2), when the user applies a response command, the user is presented with a soft keyboard (2000) into which the user can enter text. The user inputs text in the text input area (2002). The user applies a hand gesture to the submit button (2004). When the device detects a hand gesture on the submit button, it sends the user's text and other textual information.

In (3) of FIG. 20a, the new text generated by user B (2006) is placed below the text that the user is willing to respond to. The other three users also receive the same text. It is desirable for all users, including senders and receivers, to share the same layout within the device. It is also assumed that the devices of both users apply TWA when sending or receiving (response) text.

Note that in any layout, there is a limit to the number of child sentences a sentence can have. If the layout reaches its limit, it assumes that it has reached its maximum capacity, in which case the device must prevent the user from responding (and the response instruction must be deactivated). Must).

For purposes of illustration, it is assumed that the device is configured as follows:

M (x) = M (a ₁ ) = M (a ₂ ) = M (a ₃ ) = 2 and D = 4

Here, M (・) is the maximum number of child sentences allowed in the sentence. This means that for any sentence, only two child sentences can be possessed, and the deepest depth of the sentence is 4. This layout has the same structure as a binary tree.

FIG. 20b illustrates the layout at its maximum capacity when M (x) = M (a ₁ ) = M (a ₂ ) = M (a _{3) = 2 and D = 4.} This means that, under the given constraints, there is no more space for the response text. Therefore, even if the user selects one of the sentences, the user must be in a situation where the response instruction cannot be applied. This also means that there must be an indication of whether or not the selected sentence can be responded to. It is assumed that the device keeps track of such internal conditions.

FIG. 20c illustrates a user response sequence based on the response constraints just given. A shaded sentence is a sentence in which the user cannot respond any further due to restrictions.

In (1) of FIG. 20c, the drawing illustrates a layout having a main sentence. It is assumed that this is User B's device and that other users, including User B, have interacted with each other. Therefore, this means that virtually all users will receive and respond to the text. In (2) of FIG. 20c, the drawing shows that the user responds to the main text. In (3) of FIG. 20c, the drawing shows that the user responds to the main text. The main sentence now has two sub-sentences, and the user cannot respond any further. In (4) of FIG. 20c, the drawing is described by the user as a sentence x. Indicates that it responds to 1. In (5) of FIG. 20c, the drawing is described by the user as a sentence x. Indicates that it responds to 1. Now, sentence x. Since there are two child sentences for 1, the user cannot respond to the sentence any more. In (6) of FIG. 20c, the drawing is described by the user as a sentence x. Shows that it responds to 1.2. In (7) of FIG. 20c, the drawing is described by the user as a sentence x. Shows that it responds to 1.2. Now, sentence x. Since there are two child sentences for 2.1, the user cannot respond to the sentence any more. In (8) of FIG. 20c, the drawing is described by the user as a sentence x. Indicates that it responds to 1.2.1. The child sentences are sentences x. It was 2.1.1, and the depth limit (D = 4) was reached. Therefore, the user can read the sentence x. I can't respond to 2.1.1 any more. In (9) of FIG. 20c, the drawing is written by the user. Indicates that it responds to 1.2.1. The child sentences are sentences x. It was 2.1.2, and the depth limit (D = 4) was reached. Therefore, the user can further read the sentence x. Unable to respond to 2.1.2. In addition, the sentence x. Since there are two child sentences for 1.2.1, the user cannot respond to the sentence any more.

From now on, the time expiration sentence (TES) will be explained.

The time-expired text does not necessarily have to be a command. Rather, it has the feature of being part of a text transmission (first sentence transmission) and a response command. Simply put, in a time-expiring sentence, the user can set the expiration time immediately before sending the sentence. This text is sent to a large number of users. At the expiration time, the text is deleted from the device of all users who received the time-expired text. That is, this feature allows extra text. For time-expired texts, only the owner of the text can apply the expiration time / date.

Before continuing, note that there are four cases of setting time-expiring sentences.

In type 1, which is the first case, only the main sentence (the first sentence of the layout) has expired, and the user can respond to it. In the second case, type 2, only the main sentence has expired and the user cannot respond to the main sentence. Therefore, in this case, the user cannot apply the response instruction to generate the time-expired sentence.

In the third case, type 3, an arbitrary sentence (main sentence or subordinate sentence) becomes a time-expired sentence, and the user can respond to it. Type 4 which is the fourth case is that an arbitrary sentence becomes a time-expired sentence and the user cannot respond to the main sentence and / or the lower sentence.

More details are provided below.

FIG. 21a illustrates how the user sets the expiration date of a sentence. The following procedure occurs when a user chooses to generate a message to another user or applies a response command to an existing sentence. Suppose you set an expiration time when the user responds to a sentence. In (1) of FIG. 21a, the user selects an existing sentence and applies a response instruction. In (2) of FIG. 21a, instead of the user generating a sentence and applying a hand gesture to the submit button, the user applies a hand gesture to the expiration setting and submit (2100) button. It is important to note that if the device allows only the main text to be the time-expired text, the expiration setting and send (2100) buttons will not appear when the user applies the response instruction. However, when all the sentences on the device are time-expired sentences, the expiration setting and send (2100) buttons appear regardless of the user generating the main sentence or responding to the existing sentences. When the hand gesture on 2100 is detected in (3) of FIG. 21a, the expiration date setting is displayed. This display allows the user to select the expiration time. As shown, the user is offered the option to enter the expiration time in years, months, weeks, days and hours. Suppose the user selects "24 hours". From now on, the user decides whether he can respond to the text that other users are trying to generate. The user can choose to allow the user response or block the user response. Thus, if the device allows only the main text to expire, it will have a Type 1 or Type 2 scenario, otherwise it will have a Type 3 and Type 4 scenario. The user selects 5 minutes (5 m) for notification (the device displays a message that the time-expired text will be deleted within 5 minutes). Finally, the user applies a hand gesture to the OK button. When the hand gesture on the OK button (2102) is detected, the time expiration sentence is displayed on the user's device in (4) of FIG. 21a, and the same sentence is transmitted to another user.

Since a time-expired sentence is a special sentence, it is useful to inform the user whether a sentence has expired. There are many ways to express this fact. By default, time-expired texts are assumed to have a different textbox color than other non-time-expired texts. Further, as shown in FIG. 21a (4), the expiration time is displayed in the upper right corner of the sentence (2104).

Finally, note that each time an expired sentence expires, the sentence itself and all its subordinate sentences are deleted again. In addition, the lower sentence of the time-expired sentence does not expire later than the upper sentence.

More detailed illustrations of the four types of differences are provided.

FIG. 21b illustrates the details of Type 1 and Type 2.

The drawings (1) to (3) of FIG. 21b show the details of type 1. In FIG. 21b (1), there are two layouts. No sentence in the first layout expires. However, the main sentence of the second layout is the time-expired sentence generated by the user A. Another user responded to the main text. In (2) of FIG. 21b, the device displays a notification that the main text and all its subtexts are deleted within 5 minutes. In (3) of FIG. 21b, the device deletes the sentence immediately after the expiration.

The drawings (4) to (6) of FIG. 21b illustrate the details of type 2. FIG. 21b (4) has two layouts. No sentence in the first layout expires. However, the main text of the second layout is generated by user A and the time expires. Other users cannot respond. In (5) of FIG. 21b, the user attempts to respond to the text. The device displays a message stating that the user cannot respond to this sentence. In (6) of FIG. 21b, the device displays a notification that the main text will be deleted within 5 minutes. When the text expires, the layout is shown in FIG. 21b (3).

FIG. 21c illustrates the details of Type 3 and Type 4.

The drawings (1) to (3) of FIG. 21c show the details of type 3. In (1) of FIG. 21c, user B responds to a main sentence whose time has not expired. User B sets the sentence as expired and allows other users to respond to it. As shown in the figure, the sentence x. 1 and all its sub-sentences (sentences x.1.1 and x1.1.1) are about to expire. In (2) of FIG. 21C, the device has a sentence x. Display a notification that 1 and all its subordinate sentences will be deleted. In (3) of FIG. 21C, the device deletes the device immediately after the expiration. As shown in the drawing, the text x. 1.1 and x. 1.1.1 is invisible anymore.

The drawings (4) to (6) of FIG. 21C illustrate the details of Type 4. In (4) of FIG. 21c, user B responds to a main sentence whose time has not expired. User B sets the sentence to expire and blocks the response of other users. In (5) of FIG. 21c, the user attempts to respond to the text. The device displays a message that the user is unable to respond to the text. In (6) of FIG. 21c, the device displays a notification that the main text will be deleted after 5 minutes. When the text expires, the layout is shown in (3) of FIG. 21c.

Now consider the situation where the user's device is turned off and the time-expired text has expired during this time. If the user has already read the expired text before the device is turned off, the device can delete the expired text when the user turns on the device. However, in this case, the device suspends the deletion of the expired text and confirms that the user has read it. Next, I will explain this idea.

FIG. 21d illustrates a situation in which the user turns off the device (or receives the time-expired text while the device is turned off) without reading the time-expired text, and then turns on the device after it expires. The drawing (1) of FIG. 21d shows a layout in which the main sentence expires. The user did not read the text or received the text after turning on the device. The drawing (2) of FIG. 21d illustrates that the device displays a message that all text has expired and is deleted. When the user applies a hand gesture to the OK button, the device deletes the layout.

From now on, we will explain how the reduction, extension, all reduction and all extension instructions are applied to the layout.

In some situations, the user may not want to see some text. This process is referred to as collapsing. For example, the user wants to shrink the subtext of the selected text. That is to execute the reduction instruction. If the text is scaled down, there must be a process to display the scaled down. That is, there should be a process to undo the shrinkage. This process is referred to as an extension (or "open"), which is what the extension instruction executes.

Not all sentences are reduced. Main sentences that do not have leaf sentences and subordinate sentences cannot be reduced. Therefore, there must be a given type of display to inform the user if a sentence can be reduced. A symbol indicating that a sentence can be reduced is called a reduced symbol. A rectangular box with a minus sign inside is used as a shrinkable symbol. In addition, there are situations where the text cannot be expanded. Therefore, there must also be a given type of display to inform the user if a sentence is extensible. A symbol that indicates that a sentence is extensible is called an extensible symbol. A square box with a positive sign inside is used as an expandable symbol. It can also be used as a modified symbol in which the number of subtexts to be reduced is displayed inside the symbol.

If the layout does not have reduced text, it is assumed that the layout is maximally or fully expanded. Clearly, this condition can be verified by simply inspecting the symbol. If there were only shrinkable symbols, the layout was completely expanded. On the other hand, when the main text is reduced, the layout is said to be maximally or completely reduced. In addition, it can be said that the text is in the state of being expanded to the maximum or completely reduced.

There are two types of shrink-extended behavior in reduced and expanded text. One is called a storage method, and the other is called a non-memory method. Simply put, the storage method internally stores the state of all sentences (reduced state or expanded state). On the other hand, in the non-memory method, such a state is not memorized. Such a concept will be described in more detail.

The reduction instruction will be described below.

FIG. 22a illustrates the result when the reduction instruction is applied. Note that the shrinkable symbol is placed in front of the text and the text can be shrunk as shown in 2200 of (1) of FIG. 22a.

In the drawing (1) of FIG. 22a, the user has set the text x. 1.1 (Shadow text box) is selected, and the case where the reduction command is applied is shown.

In the drawing of FIG. 22a (2), the user has set the text x. The layout after applying the reduction instruction to 1.1 is illustrated. As shown in the figure, the sentence x. Sub-sentences in 1.1 are no longer displayed. In addition, the sentence x. The shrinkable symbol that preceded 1.1 has now been changed to an expandable symbol with a reduced number of sentences displayed within symbol (2202). Sentence x. If the shrinkable symbol in front of 1.1 can detect the hand gesture and the user applies the hand gesture to the symbol, the user will see the sentence x. Note that we see the same effect as applying the reduction instruction to 1.1. From now on, the user will be asked to write x. Select 1 (Shadow text box) and apply the reduction command.

In the drawing of FIG. 22a (3), the user has set the text x. The layout after reducing 1 is illustrated. As shown, the subtext is no longer displayed and the shrinkable symbol has been changed to the now expandable symbol (2204). Note that the number 2 represents that there are two reduced sub-sentences. Sentence x. If the shrinkable symbol in front of one can detect the hand gesture and the user applies the hand gesture to the symbol, the user will see the sentence x. Note that we see the same effect as applying the reduction instruction to 1. From now on, the user selects the main text (shaded text box) and applies the reduction command.

The drawing (4) of FIG. 22a illustrates the layout after the user has reduced the main text. As shown, all subtexts of the main text are no longer displayed and the shrinkable symbols are now changed to expandable symbols. Note that the number 6 represents that there are 6 reduced sub-sentences.

The extension instruction will be described below.

FIG. 22b shows the result after applying the extension instruction.

The drawing of FIG. 22b (1) illustrates a case where the user selects the main sentence (shaded text) and applies the extension command.

The drawing (2) of FIG. 22b illustrates the layout after the user applies the extension command to the main sentence. As shown in the figure, the sub-sentences of the main sentence are displayed. Since the device operates in a storage manner, the device stores the state (appearance) of the layout before the main text is reduced. That is, the sentence x. 1 is a reduced state before the main sentence is reduced, and when the main sentence is expanded, the layout returns to the previous state. Also, the expandable symbol that preceded the main text has been changed to a now shrinkable symbol. Note that the expandable symbol in the main sentence is capable of detecting hand gestures, and if the user applies a hand gesture to the symbol, the user will see the same effect as applying the extension command to the main sentence. do. From now on, the user will be asked to write x. Select 1 (shaded text) and apply the extension command.

In the drawing of FIG. 22b (3), the user has set the text x. The layout after expanding 1 is illustrated. As shown, the subtext is displayed and the expandable symbol is now changed to a shrinkable symbol. Since the device operates in a mnemonic manner, the device is described in text x. The state (appearance) of the layout before 1 is reduced is saved. That is, the sentence x. Before 1 is reduced, sentence x. 1.1 is a reduced state, and the sentence x. When 1 is expanded, the layout returns to its original state. Sentence x. If the expandable symbol in front of 1 is capable of detecting hand gestures and the user applies a hand gesture to the symbol, the user will see the sentence x. Note that we see the same effect as applying the extension instruction to 1. From now on, the user will be asked to write x. Select 1.1 (Shadow Text Box) and apply the extension instruction.

In the drawing of FIG. 22b (4), the user has set the text x. The layout after expanding 1.1 is illustrated. As shown in the figure, the sentence x. 1.1.1, that is, sentence x. The sub-text of 1.1 was displayed, and the expandable symbol was changed to a shrinkable symbol.

The following describes how the layout changes when a user applies an extension instruction on a device that operates in a non-storage manner.

FIG. 22c illustrates the result after applying the extension instruction to the reduced main text when the device operates in a non-memory manner.

The drawing (1) of FIG. 22c shows a case where the user selects the main sentence (shaded text box) and applies the extension command.

The drawing (2) of FIG. 22c illustrates the layout after the user applies the extension command to the main sentence. As shown, all sub-sentences of the main sentence are displayed. Sentence x. 1 and x. In 1.1, the main sentence was reduced before it was reduced, but this fact is ignored and it is displayed in all subordinate sentences. In the non-memory method, when the user applies an extension instruction to the main sentence, the layout is maximized.

From now on, all reduction instructions will be described.

In the all-reduction instruction, the device basically applies the reduction instruction to the selected sentence and all its subordinate sentences (excluding leaf sentences). The order does not apply to leaf text.

FIG. 22d illustrates the result after applying all the reduction instructions.

The drawing (1) of FIG. 22d illustrates a case where the user selects a main sentence (shaded text box) and applies a reduction command to all of them.

From now on, it is assumed that the user has applied the reduction instruction to all the main sentences from the mnemonic and non-mnemonic quantities.

The drawing (2) of FIG. 22d illustrates the layout after the user has applied all the reduction instructions. As shown, all sub-sentences of the main sentence are no longer displayed. Also, the shrinkable symbol in front of the main text has been changed to an expandable symbol with the number of reduced texts now displayed inside the symbol.

From now on, we will consider two cases where the user applies the extension instruction to the reduced main sentence.

The drawings (3) and (4) of FIG. 22d illustrate the case where the device operates in a storage manner. It is assumed that the user selects the main sentence and applies the extension instruction in (2) of FIG. 22d. As shown in (3) of FIG. 22d, the main sentence is expanded, but all the subordinate sentences are in a reduced state. From now on, the user will be asked to write x. Apply the extension instruction to 1. As shown in (4) of FIG. 22d, the sentence x. Is expanded, but its subordinate sentences (sentence x.1.1) are in a reduced state.

If the device operates in a non-mnemonic way and the user applies the extension instruction to the main sentence that has been reduced using the reduction command, the fact that all sentences are in the reduced state is ignored and the device is simple. Display all sub-sentences of the main sentence in. That is, the layout is expanded to the maximum.

From now on, all extended instructions will be described.

In all extended instructions, the device basically applies the extended instruction to the selected sentence and all its sentences (leaf sentence exclusion). The order does not apply to leaf text.

FIG. 22e illustrates the results after all the extended instructions have been applied.

The drawing of FIG. 22e (1) shows a case where the user selects the main sentence and applies all the extension commands.

The drawing (2) of FIG. 22e illustrates the layout after the user applies all the extension commands to the main sentence. Since all extension instructions basically apply extension instructions to all sentences (excluding leaf sentences), the layout is maximized as shown in the figure. Note that if the device operates in a non-storage manner, there is no difference between extended and all extended instructions.

The following describes how the Hide, Show, Hide All and Show All instructions are applied to a layout.

When a user receives a text message, it has various lengths. The text is short enough to fit the text line, which is one of the text display areas, and occupies various text lines. All received text occupies many lines. If all the received text occupies a large number of lines, this will result in a text box with irregular heights in the layout, which induces disorder on the display of the device. When the device detects that the user has read the received text, it is desirable to hide certain parts of the text. For example, the layout is further organized when the user reads the text and then the height of all the text boxes in the layout shrinks to a predefined height. Also, in most cases, if the user reads the text, it is very unlikely that the user will return and read the text repeatedly. Therefore, it makes sense to hide certain parts of the text in order to organize the layout and maintain a better overall view.

If the text in the text looks maximal, then the text is considered visible (or hidden). On the other hand, when the height of the text box shrinks to its default height and the text is hidden to fit the reduced text box, the text is hidden (or visible).

Not all sentences can be hidden. You can't hide any text at the default height (the smallest possible textbox height). Therefore, there must be a certain kind of instruction to the user as to whether a sentence can be hidden. A symbol indicating that a sentence can be hidden is called a hidden symbol. A square box with a triangle pointing from the inside to the top is used as a concealable symbol. There must also be instructions for the user that when the user hides the text, the text can be displayed. A symbol indicating that a sentence can be displayed is called a displayable symbol. A square box with a triangle pointing from the inside to the bottom is used as a displayable symbol.

From now on, the hidden instruction will be explained.

FIG. 23b shows the result after applying the hidden instruction. Note that a hidden symbol (upward-pointing triangle) is placed in the upper right corner of the text, as illustrated in 2300 of (1) of FIG. 23a.

In the drawing of FIG. 23a (1), the user has set the text x. 1.1 (Shadow text box) is selected to show the case where the hidden command is applied. Sentence x. Note that 1 consists of only one text line, and the height of the textbooks is the same as the default height. The height of all text boxes can never be less than the default height. All text of the text on the device is in maximum visibility.

In the drawing of FIG. 23a (2), the user has set the text x. The layout after applying the hidden instruction to 1.1 is illustrated. As shown, the height of the text is reduced to the default height and some text parts are not displayed. In addition, the sentence x. 1.1 The hidden symbol on top has been changed to a symbol that can now be displayed (2302, a triangle pointing down). Sentence x. 1.1 The hidden symbol on is capable of detecting hand gestures, and if the user applies a hand gesture to the symbol, the user will see the sentence x. Note that you can get the same effect as applying the hidden command in 1.1. From now on, the user will be asked to write x. Select 1.1 (Shadow Text Box) to apply the hidden command.

In the drawing of FIG. 23a (3), the user has set the text x. The layout after hiding 1.1.1 is illustrated. As shown, the text height is reduced to the default height and some text parts are not displayed. In addition, the sentence x. 1.1.1 The hidden symbol above has now been changed to a visible symbol (2304, triangle pointing down). Sentence x. If the hidden symbol on 1.1.1 can detect a hand gesture and the user applies the hand gesture to the symbol, the user will see the sentence x. Note that you can get the same effect as applying the hidden command in 1.1.1. From now on, the user selects the main text (shaded text box) and applies the hidden command.

The drawing (4) of FIG. 23a illustrates the layout after the user hides the main text. As shown, the height of the text is reduced to the default height and some parts of the text are not displayed. Also, the hidden symbols in the main text have been changed to symbols that can be displayed from now on. Note that hidden symbols on the main text can detect hand gestures, and if the user applies a hand gesture to the symbol, the user will have the same effect as applying a hidden command to the main text. do.

The display command will be described below.

FIG. 23b illustrates the result after applying the display instruction.

The drawing (1) of FIG. 23b illustrates a case where a user selects a main sentence (shaded text box) and applies a display command.

The drawing (2) of FIG. 23b illustrates the layout after the user applies the display command to the main text. As shown, the height of the text is increased to the height of its original text box and the text is fully displayed. In addition, the symbol that can be displayed on the main text has been changed to a symbol that can be hidden from now on (2306, a triangle pointing up). The displayable symbol on the main text can detect hand gestures, and if the user applies a hand gesture to the symbol, the user will have the same effect as applying the display command to the main text. warn. From now on, the user will be asked to write x. Select 1.1.1 (Shadow Text Box) and apply the display command.

In the drawing of FIG. 23b (3), the user has set the text x. The layout after making to show 1.1.1 is illustrated. As shown, the height of the text is increased to the height of its original text box and the text is fully displayed. In addition, the sentence x. 1.1.1 The visible symbol above has been changed to a hidden symbol (2308, triangle pointing up). Sentence x. If the displayable symbol on 1.1.1 can detect a hand gesture and the user applies the hand gesture to the symbol, the user will see the sentence x. Note that we see the same effect as applying the display command in 1.1.1. From now on, the user will be asked to write x. Select 1.1.1 (Shadow Text Box) and apply the display command.

In the drawing of FIG. 23b (4), the user has set the text x. The layout after making 1.1 so that it can be seen is illustrated. As shown, the height of the text is increased to the height of its original text box and the text is fully displayed. In addition, the sentence x. 1.1 The visible symbols above have been changed to hidden symbols. Sentence x. 1.1 If the displayable symbol on is capable of detecting a hand gesture and the user applies the hand gesture to the symbol, the user will see x. 1.1 Note that the same effect as applying the display command to a sentence can be obtained.

From now on, all hidden instructions will be explained.

In an all-hidden instruction, the device basically applies the hidden instruction to the selected sentence and all its subordinate sentences.

FIG. 23c illustrates the result after applying all hidden instructions.

The drawing (1) of FIG. 23c illustrates a case where the user selects a main sentence (shaded text box) and applies all hidden commands. Note that the command is applicable because the selected text is visible.

The drawing (2) of FIG. 23c shows the layout after the user has applied all the hidden instructions. As shown, all subtexts of the main text have been reduced to the default height. In addition, the hidden symbols in the text have been changed to displayable symbols.

From now on, all the display commands will be described.

In all display commands, the device basically applies the display command to the selected sentence and all its subordinate sentences.

The result after applying all the display commands of FIG. 23d is illustrated.

The drawing (1) of FIG. 23d illustrates a case where the user selects a main sentence (shaded text box) and applies all display commands. Note that the command can be applied because the selected text is hidden.

The drawing (2) of FIG. 23d shows the layout after the user has applied all the display commands. As shown, all subtexts of the main text have been increased to the height of their original textbox. Also, the visible symbols in the text have changed to hidden symbols.

From now on, we will explain how the delete and delete all instructions are applied to the layout.

Sentences generally consist of text and text boxes. The purpose of the delete command is to erase or hide the text of the selected text (or the text itself) that the user intends to "delete". The purpose of the delete command is to apply the delete command to many sentences at once.

When the text in a sentence is deleted, the sentence is said to be in the deleted state. Most commands are inactive when the text is deleted. However, the response, reduction / extension, and inversion / return instructions are not deactivated. In addition, two types of deletion methods are presented, which are referred to as deletion method 1 and deletion method 2.

The deletion instruction will be described below.

The result after applying the deletion instruction of FIG. 24a is shown.

In the drawing of FIG. 24a (1), the user has set the text x. 1.1.1 (Shadow text box) is selected and the delete command is applied.

The drawing of FIG. 24a (2) shows the text x. The layout after applying the delete command to 1.1.1 is illustrated. As shown in the figure, the sentence x. The text in 1.1.1 is no longer displayed (has been deleted).

In the drawing of FIG. 24a (3), when the device operates by the deletion method 2, the user can read the text x. The layout after applying the delete command to 1.1.1 is illustrated. As shown in the figure, the text x. The text and text boxes in 1.1.1 are no longer displayed (deleted). However, although the text box is displayed in the deletion method 1, the text box is not displayed in the deletion method 2. However, if the device works with deletion method 1, then the text x. If 1.1 is deleted, only the text is deleted and the textbox remains in the layout, preserving the structure.

Define a new term. When a column of sentences containing a leaf sentence is deleted, the sentence forms an SDL-branch (SDL-) as forming a column of deleted sentences (a Streak of Deleted states to the Leaf-statement) for the leaf sentence. It is called Branch).

Therefore, it can be seen that every time the leaf sentence and its parent sentence are deleted (SDL-branch is formed), the sentence is not displayed by the deletion method 2. For example, sentence x. a ₁ . .. .. a _k-2 . a _k-1 . Suppose a _k is a leaf sentence. In addition, the sentence itself and its two parent sentences x. a ₁ . .. .. a _k-2 . a _k-1 and x. a ₁ . .. .. It is assumed that a _{k-2 is deleted.} Sentence x. a ₁ . .. .. a _k-1 and x. a ₁ . .. .. As _{long as all the sub-sentences of a k-2} are deleted, three sentences-sentence x. a ₁ . .. .. a _k-2 . a _k-1. a _k , x. a ₁ . .. .. a _k-2 . a _k-1 and x. a ₁ . .. .. a _k-2- is not displayed. However, the sentence x. a ₁ . .. .. a _{k-2 If a} sentence is deleted and one of its subordinate sentences is not deleted, the sentence x. a ₁ . .. .. Only the text box of a _{k-2 is displayed.}

Note that each time a sentence is deleted, the textbook height of the deleted sentence is reduced to the default height. This also means that hidden and visible symbols are not displayed.

That is, in the deletion method 1, there is no problem that the text box remains undeleted and only the text is deleted. In this way, the layout maintains its structure. However, in the deletion method 2, the branch is not displayed in a specific situation.

From now on, the Delete All instruction will be described.

In the all delete command, the device basically applies the delete command to the selected sentence and all its subordinate sentences.

FIG. 24b illustrates the result after applying the delete command.

In the drawing of FIG. 24b (1), the user has set the text x. Indicates the case where (Shadow text box) is selected and the delete command is applied to all.

In the drawing of FIG. 24b (2), when the device is operated by the deletion method 1, the user can read the text x. The layout after applying the delete command to 1 is illustrated. As shown in the figure, the sentence x. The text of 1 and all its subtexts is no longer displayed (has been deleted).

In the drawing of FIG. 24b (3), when the device operates by the deletion method 2, the user can read the text x. The layout after applying the delete command to 1 is illustrated. As shown in the figure, the sentence x. The text and text boxes of 1 and all its subtexts are no longer displayed (deleted). Since the series of deleted sentences contains leaf sentences and no sentence has subordinate sentences that are not in the deleted state (sentences x.1 and x.1.1 are in the deleted state). Therefore, it has only one subordinate sentence). Note that the branch is not displayed.

After the user applies the delete command to the main text, the text box is still displayed (the text is not displayed) because the main text has subtexts that are not in the deleted state.

From now on, we will consider what happens when a user receives a sentence after deleting the sentence.

In FIG. 24c, the user has a sentence x. 1, x. 1.1 and x. It is illustrated that a new sentence (sentence x.1.1.1.1) is received after deleting 1.1.1. The result of (1) of FIG. 24c shows the case where the device operates by the deletion method 1. In this case, it's easy and simple. The new text is placed in its correct position as shown in the drawing. The result of (2) of FIG. 24c shows the case where the device operates by the deletion method 2. Sentence x. 1, x. 1.1 and x. Note that after deleting 1.1.1, the three deleted texts (shaded and empty textboxes) are not displayed. However, the sentence x. Upon receiving 1.1.1.1, these three deleted sentences will be displayed. Therefore, every time a new sentence is received and the parent sentence is not displayed in the layout and is in the deleted state, the parent sentence of the new sentence must be displayed. In addition, when such a parent sentence is displayed, the condition that those child sentences are not deleted must be satisfied.

From now on, how the UBD (Ubiquitous Delete) and all UBD (UBD All) instructions are applied on the layout will be described.

Consider a situation where a user wants to delete a user-generated text. At the same time, the user wants to ask other users who receive the text to delete the same text. This is to delete ubiquitous, and this is called a UBD instruction.

The UBD instruction is a kind of delete operation. Every time the user applies ubiquitous deletion to a sentence, the same deletion procedure used in the deletion command is performed. The only difference between a UBD and a delete instruction is that when a user applies a UBD instruction to a sentence, other users who also receive the same sentence are also required to delete the sentence. Therefore, when a user applies a UBD instruction to a sentence, an additional procedure is performed to request another user to delete the sentence after the delete instruction is actually applied. There are restrictions on ubiquitous removal. Suppose the owner of the text can apply the UBD instruction. Of course, you can relax this restriction and allow any user to apply ubiquitous removal, but here we keep the restriction.

The UBD instruction will be described below. Here, it is assumed that there are four users interacting with each other and user B applies the UBD instruction.

In FIG. 25a, the user B describes the sentence x. It is illustrated that the UBD instruction is applied to 1. The device of user B is the sentence x. Apply the delete command to 1 and send a message to other users when each user tries to delete the text.

FIG. 25b illustrates the result after applying the UBD instruction. The drawings (1) to (4) of FIG. 25b are devices of user A, user B, user C, and user D. Sentence generated by user B x. Note that 1 has already been deleted by the application of the UBD instruction, as shown in (2) of FIG. 25b. As shown in (3) of FIG. 25b, the user B in the device, the sentence x. Before applying the UBD instruction to 1, user C wrote the sentence x. It is assumed that 1 has been deleted. In the case of other users, User A ((1) in FIG. 25b) and User D ((4) in FIG. 25b), they say their text x. Receive a question if you want to delete 1. When the user chooses to delete, the user's device applies the delete instruction to the text. The device does nothing unless the user chooses. In the case of user C, the device does not ask the user if the user wants to delete the text because the text has already been deleted. Suppose User A and User D agree to delete the text.

From now on, all UBD instructions will be described. Again, suppose there are four users interacting with each other, and user B applies all UBD instructions.

In FIG. 25c, the user B describes the document x. Explain that the UBD instruction is applied to all of 1. The device of user B is the sentence x. Apply the delete command to 1 and send a message to other users if each user wants to delete the document and all its subtexts.

FIG. 25d illustrates the result after applying the UBD instruction. The drawings (1) to (4) of FIG. 25d are devices of user A, user B, user C, and user D. Sentence generated by user B x. Note that 1 and all its subtexts have already been deleted by the application of the UBD instruction, as shown in (2) of FIG. 25d. When the user chooses to delete, the user's device applies the delete command to all text. The device does nothing unless the user chooses. It is assumed that User A and User D agree to delete the text, and User C refuses to delete the text.

From now on, what happens when a user who receives a request from user B makes a decision will be described.

FIG. 25e illustrates the device of user B after the user has applied the UBD and all UBD instructions. The drawing of FIG. 25e (1) is a case where a user applies a UBD instruction and all other users make a decision. As shown in the message box, user B is notified of decisions made by other users. The drawing of FIG. 25e (2) is a case where all the users apply the UBD instruction and all the other users decide. As shown in the message box, user B is notified of decisions made by other users. The drawing of FIG. 25e (2) is a case where all the users apply the UBD instruction and all the other users decide. As shown in the message box, user B is notified of decisions made by other users.

In short, the characteristic of ubiquitous removal is that each time a user applies a command, the device sends a signal to another user. This triggers a request to another user, and when the other user decides, the result (signal) is sent to the original user who requested it.

From now on, we will explain how the modification instructions are applied to the layout.

After a user generates a sentence and sends it to another user, the user who sent the sentence may want to "correct" the sentence sent by the user. The modification instruction can change the text of the sentence selected by the user.

The basic assumption of applying a modify instruction is that a user interacts with at least one other user and all users share the same text. Therefore, modifying the text means changing the text of the existing text on all the user's devices during the interaction. When modifying the text, the most important point is that only the owner can apply the modification instruction. Also, when a correction command is applied to a sentence, the same sentence is corrected from the device of another user who received the sentence.

FIG. 26a illustrates applying a correction instruction to a sentence when user B is the owner of the sentence. User B is assumed to be interacting with three other users, namely User A, User C and User D.

In (1) of FIG. 26a, the user B uses the sentence x. Apply the correction command to 1.1 (2600, shading text box). Suppose the user tries to modify the word "Word!" To "Word!".

In FIG. 26a (2), when the user applies a command, the soft keyboard is displayed (2602), the entire text is displayed in the text input area (2604) of the soft keyboard, and the user can modify the text. The user changes the word "Word!" To "Word!" And applies a hand gesture to the "Apply" button. When the user applies a hand gesture to the "Cancel" button, nothing happens.

If the user does not change the text or there is no text in the text input area (2604), the Apply button is deactivated.

FIG. 26b illustrates the result after applying the correction instruction. Modifications are projected to all users, as illustrated in all four drawings. Further, as shown in FIGS. 26b (1), (3) and (4), three users (excluding user b) receive a message notifying that user B has corrected the text.

From now on, how the layout invert and revert instructions are applied will be described.

If you have a layout with many sentences, it's a good idea to emphasize only the most recent sentences. Structurally, the most recent text is the leaf text (in the branch). When the layout inversion instruction is applied, the device displays only leaf text. This is the same as the device applying the bottom view of the layout to the user. The return instruction simply returns the layout to its original view. In order to indicate whether the layout is in the inverted state or the restored state, symbols are used and they are referred to as an inverted symbol and a recoverable symbol.

Note that the inversion and return instructions can be applied to all sentences, regardless of the state to which they belong.

The inversion instruction will be described.

FIG. 27a illustrates that the user applies flip and return instructions.

The drawing of FIG. 27a (1) illustrates two layouts, and as shown in 2700, an invertable symbol is arranged on the upper left side of each layout. This symbol indicates that the corresponding layout is inverted. Here, it is assumed that the user has applied the inversion instruction of the second layout. The user selects an arbitrary sentence and applies the command. Alternatively, if the flippable symbol can detect a hand gesture, the user applies the hand gesture to the symbol.

The drawing (2) of FIG. 27a illustrates the layout after the user applies the inversion instruction on the layout. As shown, only leaf text is displayed (with adjusted text box width). In addition, the invertable symbol has been changed to a symbol (2702) that can be restored from now on. This symbol indicates that the layout is flipped and you can return to the original view.

The drawing of FIG. 27a (3) illustrates two layouts, the second layout being inverted. Here, it is assumed that the user has applied the return instruction to the second layout. The user selects an arbitrary sentence and applies the command. Alternatively, if the recoverable symbol can detect a hand gesture, the user applies the hand gesture to the symbol.

The drawing (4) of 27a illustrates the layout after the user applies the return command on the layout. The layout has returned to its original view.

FIG. 27b illustrates the demonstration. The user has a sentence x. 1.1.1.1 and x. Suppose you have received two new sentences, 4. While showing that the user receives the text while the layouts of FIGS. 27b (1) and (3) are not inverted, (2) and (4) of FIG. 27b show that the user receives the text while the layout is inverted. Indicates that

In (1) of FIG. 27b, the user uses the sentence x. Received 1.1.1.1, which is the text x. Placed under 1.1.1. However, as shown in the figure, in (2) of FIG. 27b, a new sentence x. 1.1.1.1 (2704) is the parent sentence x. It replaces 1.1.1 and is displayed to the user. This is the sentence x. This is because 1.1.1 is no longer a leaf sentence.

In (3) of FIG. 27b, the user uses the sentence x. Received 4, which is the sentence x. Placed under 3. In (4) of FIG. 27b, x. Since 4 is a new leaf sentence, this is a sentence x. It is placed under 3 and displayed to the user.

From now on, how the Increase and Decrease instructions are applied on the layout will be described.

This is a relatively simple command that, when applied by the device, simply enlarges the entire text. Therefore, when the user applies the increase command, the device expands the text, and while the sentence is in the augmented state, when the user applies the decrease command, the device cancels the enlargement and the text is reduced (original). ) Return to the state.

FIG. 28 illustrates that the user applies the increase and decrease instructions.

The drawing of FIG. 28 (1) illustrates the layout and the increasing symbols are located in the upper right corner of each sentence as illustrated in 2800. This symbol indicates that the corresponding layout can be increased. Here, it is assumed that the user has applied the increase instruction to the leaf text (shaded text box). If the increasing symbol can detect a hand gesture, the user can apply the hand gesture to the symbol.

The drawing of FIG. 28 (2) illustrates the layout after the device has applied the instructions. As shown, the overall description is expanded. The width and height of the text box has increased, and the size of all other fonts in the text has also increased. The 2802 symbol is a decreasing symbol, and it is easy to understand that the increasing symbol changes to the decreasing symbol as the sentence becomes longer.

The drawing of FIG. 28 (3) shows that the user has applied the reduction instruction to the enlarged text. If the symptom symbol can detect a hand gesture, the user can apply the hand gesture to the symbol.

FIG. 28 (4) illustrates the layout after the device has applied the instructions. As shown, the enlarged text is returned to its original state of the layout without being displayed anymore. Also, the decreasing symbol has now been changed to an increasing symbol.

From now on, we will explain how all (All) instructions are applied on the layout.

There are eight instructions, all classified as instructions. The eight instructions are: Collapse All, Expand All, Hide All, Show All, Delete All, All UBD (UBD All), Invert and Restore. Is. In the settings presented, these instructions apply to all main text on the display.

FIG. 29a illustrates a device having a layout. Eight instructions are displayed at the top (2900). The user can apply one of these instructions at any time. For illustrative purposes, all three layouts are identical. The first layout is in a fully expanded state. The second layout is inverted.

From now on, we will explain what happens when the user applies a hand gesture to each command.

FIG. 29b illustrates the result after the user has applied the four instructions.

The drawing of FIG. 29b (1) illustrates the result after applying the reduction command to all the main sentences of FIG. 29a. As shown, the first layout has been changed to a completely reduced state. The second and final layouts remain unchanged.

The drawing of FIG. 29b (2) illustrates the result after applying the extension command to all the main sentences of FIG. 29a. As shown, the second layout has been changed to a fully expanded state, but the main text is still hidden. The first and last layouts remain unchanged.

The drawing of FIG. 29b (3) illustrates the result after applying the hidden instruction to all the main sentences of FIG. 29a. As shown, all text in the first layout has been changed to a hidden state. The leaf text in the final layout, which is still inverted, is changed to a hidden state.

The drawing of FIG. 29b (4) illustrates the result after applying the display command to all the main sentences of FIG. 29a. As shown, the main text of the second layout has been changed to the visible state. The first and last layouts remain unchanged.

FIG. 29c illustrates the result after the user has applied four other instructions.

The drawing of FIG. 29c (1) illustrates the result after applying the delete command to all the main sentences of FIG. 29a. As shown, all text is now in a deleted state. Also, the last layout that was flipped back to its original view.

The drawing of FIG. 29c (2) illustrates the result after applying the UBD instruction to all the main sentences of FIG. 29a. As shown, all text is now in a deleted state. Also, the last layout that was flipped back to its original view.

The drawing of FIG. 29c (3) illustrates the result after applying the reversal instruction to all the main sentences of FIG. 29a. As shown, all sentences are now in an inverted state.

The drawing of FIG. 29c (4) illustrates the result after applying the return command to all the main sentences of FIG. 29a. As shown, the final layout has been changed to its original view.

From now on, I will introduce the feature of automatic expansion (AE). This is not a command, but a process executed by the device when the user receives a new sentence and the superordinate sentence of the newly received sentence is in a reduced state. For example, when the main sentence is reduced, the new received sentence is numbering x. a ₁ . .. .. a _k . Having r, subsequently, clearly the main text should be extended to a given scheme. Here, we present four ways to extend the high-level text.

To explain the four different ways of extending the text, we first introduce the layout and explain how it was reduced.

FIG. 30a illustrates the layout and how it was reduced. Assume that the device acts as a storage method. In (1) of FIG. 30a, the layout is composed of eight sentences. In (2) of FIG. 30a, the user is x. 1.1 Reduce the text. In (3) of FIG. 30a, the user is x. 2 Reduce the sentence. In (4) of FIG. 30a, the user reduces the main sentence. Here, it is assumed that the user receives a new sentence.

The main sentence was completely reduced, but the user received the sentence while one of the subordinate sentences was also seen to be in a reduced state, as illustrated in FIG. 30a (5). Note that it is assumed that you will receive a new sentence.

FIG. 30b illustrates four automatic expansions. As mentioned above, it is assumed that the main text is reduced in the manner illustrated in FIG. 30a and the user receives the text.

FIG. 30b (1) illustrates the maintenance of the auto-expansion of the previous state (Maintain the Previous State Auto-Expand, MPS auto-expansion). In this way, each time the user receives a new sentence and the main sentence is expanded, the layout returns to its previous state before the main sentence was reduced. The user receives a new sentence (sentence x.3.1). Before the main sentence is reduced, the sentence x. 2.1 and x. Note that the sentence 2 was in a reduced state ((3) in FIG. 30a). Therefore, when the main sentence is expanded, the previous state is maintained, and the sentence x. 3.1 is placed where it should be.

FIG. 30b (2) illustrates a common depth auto-expansion (Common Depth Auto-Expand, CD auto-expansion). In this method, every time the user receives a new sentence and the main sentence is expanded, all the sentences having the same depth as the received sentence are reduced. The user receives a new sentence (sentence x.3.1). As shown in the figure, since the new sentence has a depth of 2, all the sentences at the depth 2 are in a reduced state.

FIG. 30b (3) illustrates one-branch automatic expansion (One Branch Auto-Expand, OB automatic expansion). In this method, each time the user receives a new sentence and the main sentence is expanded, only the branch to which the new sentence belongs is expanded, and the rest is in a reduced state. The user receives a new sentence (sentence x.1.1.1.1). As shown in the figure, the numbering of new sentences is x. Since it is 1.1.1.1, the sentence x. 1, x. 1.1 and x. 1.1.1 is expanded and new text is placed in its correct position. Sentence x. Note that other sentences such as 2 must be in a reduced state (if sentence x.3 has a subordinate sentence, the device will be in that sentence and also in a reduced state). Therefore, the numbering of new sentences is x. a. b. c. d. If it is 2 (the second child sentence of the x.ab.c.d sentence), the sentences x, x. a, x. a. b, x. a. b. c and x. a. b. c. All d are in the expanded state. However, the rest of the text with sub-text should be in a reduced state.

FIG. 30b (4) shows all extended automatic expansion (Expand All Auto-Expand, EA automatic expansion). In this way, the main text is completely expanded each time the user receives a new text. The user receives a new sentence (sentence x.1.1.1.1). As shown, the layout is completely expanded and new text is placed in its correct position.

We will now explain how the layout is displayed on the device each time the user sends or receives a sentence. We present three ways to display the layout.

FIG. 31a illustrates the first method. In this method, each time the user receives a sentence, the current layout is not changed and the new sentence is placed in the exact manuscript of the current layout. This is referred to as display method 1. In (1) of FIG. 31a, the user receives a sentence, that is, a sentence x. In (2) of FIG. 31a, the user can read the sentence x. To receive. As shown, the old layout (sentence x) is unchanged, but the new text is placed in the manuscript of the layout (sentence x). In FIG. 31a, the user can see the sentence x. 2 is received. In (4) of FIG. 31a, the user uses the sentence x. Receive 1.1. As shown in the figure, in the display method 1, the user can easily know how the interaction between the users is performed.

FIG. 31b illustrates the second method. In this method, unlike method 1, when the device receives a new sentence, it does not generate a manuscript of the layout. This is referred to as display method 2. To elaborate on the idea, assume that the user of the device sends a sentence to another user. In (1) of FIG. 31b, the user receives two sentences, that is, sentence x and sentence y, from user A and user D, respectively. In (2) of FIG. 31b, the user transmits a sentence (sentence x.1). As shown, the overall layout (the main sentence is sentence x) is treated as a new sentence and placed at the bottom of the screen. In (3) of FIG. 31b, the user receives the sentence z from the user C. As shown, it is placed at the bottom of the screen for new text. In (4) of FIG. 31b, the user can see the sentence x. Receive 1.1. Again, the entire layout is treated as a new sentence and placed at the bottom of the screen. As shown in the figure, in the display method 2, every time a lower sentence is added to the main sentence, the entire layout is treated as a sentence and displayed at the bottom of the screen.

So far, the instructions have only been explained independently. That is, I did not explain how they can be combined. In this session, we will combine all the instructions described so far and explain how they are displayed. As mentioned above, instructions can be internalized, externalized, or customized. Also, any instruction can be internalized, externalized and customized at the same time. The instructions presented here provide the user with instructions on how to execute the selected instruction. FIG. 32a illustrates all possible ways in which an instruction can be provided to a user.

The drawing of FIG. 32a (1) illustrates possible cases where instructions are internalized, externalized, or customized. For example, if an instruction is internalized, it is assigned a 1, otherwise it is assigned a 0. Therefore, as shown in the first row of the table, (0, 0, 1) means that the instruction is just customized. Also, as shown in the last row of the table, (1, 1, 1) means that the instruction is internalized, externalized and customized. For example, if the delete instruction is (1, 1, 1), the user can apply the instruction by internalizing, externalizing, or customized instructions. Assign a number to each tuple for easy reference. For simplicity, consider tuples as binary. Therefore, 5 is assigned to tuples (1, 0, 1), and so on.

The drawing of FIG. 32a (2) illustrates all possible cases in which all instructions are internalized, externalized, or customized in 19 pieces. Therefore, the number of possible combinations ^is 7 18 = 1,628,413,597,910,449 (1600 trillion higher). However, a characteristic of some instructions is that they perform specific tasks and undo execution. Therefore, mutually exclusive instructions can be grouped into one group. For example, the hidden and display instructions are mutually exclusive instructions. It cannot be applied to sentences at the same time. Therefore, we can see a pair of mutually exclusive instructions, which can be grouped into one instruction. Note that it is not necessary to group mutually exclusive instructions together. Hidden instructions are simply internalized, while display instructions can only be externalized.

The drawing of FIG. 32a (3) combines the same table from FIG. 32a (2), except that it combines the mutually exclusive instructions into one, which provides "instructions" for twelve. Illustrated. Therefore, the table commands the user for 7 ¹² = 13,841,287,201 (over 13 billion) possible ways and leaf sentences that provide instructions to the user for non-leaf sentences. ^{7 8} = 5,764,801 to provide. This means that mutually exclusive instructions are provided to the user in the same manner. For example, when a hidden instruction is externalized, the display instruction, which is a mutually exclusive instruction, is also externalized.

It provides specific settings from 1600 trillion ( ^{718) possible ways to set instructions.}

The following 18 combinations can be considered.

(5,2,2,2,4,4,4,4,1,1,4,4,4,4,4) ¹⁸

This means that the response instructions are internalized, customized and the combination is represented by the number 5. The shrink, expand, hide and display instructions are simply externalized and represented by the number 2. Delete, modify, UBD, invert and restore instructions are simply internalized and represented by the number 4. The increase and decrease instructions are simply customized and represented by the number 1. Finally, the rest of all instructions are represented by the number 4.

Using a combined version of a mutually exclusive instruction and 12 instructions, the combination can be expressed as follows.

(5,2,2,4,4,4,1,4,4,4,4) ¹²

FIG. 32b is illustrated as follows.

(5,2,2,4,4,4,1, ...) ¹²

Before continuing, define a "hand gesture" to prompt by pressing and holding the prompt command display area (press-and-hold). Moreover, since the response instruction is not only customized but also internalized, a left / right swipe is assigned to the customized response instruction. Allocate double steps for customized increase and decrease instructions. Also, the symbol is applicable to hand gestures, assigns a simple simple tap, and the device confirms the user's input.

As illustrated in FIG. 32b, the user applies push and hold to text (3200). When the device detects such a particular hand gesture, the device displays a prompt instruction display area (3202), displaying all internalized and applicable instructions. The displayed instructions are response, modify, delete, invert, all reduced, UBD and all UBD. Return, all extended, all hidden and all display instructions are internalized, but such instructions are not visible because they are not applicable.

These instructions are not displayed in the prompt instruction display area because the shrink, extend, hide, and display instructions are externalized. Also, instead of displaying these instructions on any text, symbols are used to indicate that the instructions are applicable. As shown, the externalized reduction instruction is replaced by a reduceable symbol (3204). When the user applies a simple tep on the symbol, the device shrinks the main text and the symbol turns into an extensible symbol. When the user easily applies a tep to an extensible symbol, the device extends the main text. This applies equally to hidden and display instructions. As shown, the externalized hidden instruction is replaced by a hidden symbol (3206). When the user applies a simple tep on the symbol, the device hides the leaf text and the symbol turns into a visible symbol. When a simple tep is applied to a user-displayable symbol, the device displays leaf text.

FIG. 32c is composed of an exemplary drawing representing an instruction display area having an internalized instruction displayed internally. Also, the externalized instructions are illustrated using symbols.

From now on, we will provide all the flowcharts of how the instructions are executed.

In some situations in the flow chart, it is assumed that the user applies the instruction to an arbitrary sentence, and that sentence x. a ₁ . .. .. Displayed by _ak.

FIG. 33a illustrates a flow chart of feature text width adjustment (TWA).

The flowchart of FIG. 33a (1) illustrates the core of TWA, which is referred to as the text width adjustment process. This process is applied when the device is in longitudinal mode. When this process is executed, the device selects the number of text lengths from all the text lengths. The reason is that in some situations the length of some text must be excluded when determining the width of the text box. ^{The device uses the length of the selected text to determine the reference width R (k)} at a depth k that depends on the algorithm or mathematical function (maximum width M and minimum width m determine the width of the text box). Note that the device uses those values when determining the reference width, as it plays an important role in the process). This means that the device can calculate (or determine) the width of the text box at all depths based on the layout (or model) used. For example, when the deepest depth of the layout is 4 and the reference width is R ⁽²⁾ , the width of the text box of the sentence of depth 2 is the same as R. Based on the value R at depth R, M, the device calculates the rest of the width of the text box at depths 0, 1, 3 and 4. Once the width of these text boxes is determined, the text of each sentence is displayed in the text box.

The flowchart of FIG. 33a (2) illustrates the core of the TWA during rotation, which is referred to as the text width adjustment process during rotation. This process applies when the device is in transverse mode. This process is the same as that in (1), except that the maximum width M and the minimum width m are even larger when the device is in transverse mode. Two larger values, M and m, are represented by ^{M * and m *, respectively.} Therefore, the device recalculates the reference width at depth k using ^{M *} and m ^*.

The flowchart of FIG. 33a (1) illustrates the steps performed by the device in detecting that the device has been converted from longitudinal mode to horizontal mode. In the flow chart, the device detects that the device has been switched from longitudinal mode to horizontal mode. The device then executes the TWA-R process and redraws the layout.

The flowchart of FIG. 33a (4) illustrates the steps performed by the device when it detects that the device has been converted from horizontal mode to longitudinal mode. In the flow chart, the device detects that the device has been converted from horizontal mode to longitudinal mode. The device then runs the TWA process and redraws the layout.

If the device finds and saves the width of the textbox for portrait and landscape modes in advance (every time the device receives a sentence), it skips the two processes and redraws when the device detects the mode change. You can get started.

FIG. 33b illustrates a flowchart in which a user sends a sentence to another user. First, the user applies a hand gesture to an instruction that allows the user to enter text. The user then selects the recipient to whom the user wants to send the text. When this task is complete, the device will display a soft keyboard. After entering the text, the user applies a hand gesture to the submit button or the expiration setting and submit button. When the user applies a hand gesture to the expiration setting and submit button, the device displays a small display where the user can enter the expiration time. The user enters an expiration time (or duration) and selects whether other users can respond to the time expiration text. The user applies a hand gesture to the OK button. The internal state of the instruction is then updated and the device confirms that the text expires. The device generates sentences. This is (1) the stage where the device generates an empty sentence, (2) the stage where the device assigns the main key to the sentence, (3) the stage where the device assigns the generated text to the empty sentence, (4) the device. It consists of a number of stages, such as the stage where is setting the internal state of the text and (5) the stage where the device stores other necessary information. When this step is complete, the device applies TWA to the pool of text lengths, determines the width and height of the new text box, and updates the internal text of the symbol. The layout is displayed using display method 1 or display method 2. Finally, the device sends the text and main key to the recipient. It also sends internal code, whether the text has expired, the sender's phone number, or other information such as a multimedia file.

FIG. 33c illustrates a flowchart in which a user receives a sentence from another user. First, the user receives a sentence from another user. In the next step (dotted box), the device checks to see if the parent text of the received text is displayed (this is about the case where the device operates with deletion method 2). In such cases, the device displays the deleted text box. If the device operates with deletion method 1, this step can be omitted. Then, as if the user sends a sentence, the device goes through the steps of generating a sentence with the received text, the device applies the TWA, updates all necessary information, and finally is received. Display the text to the user. The layout is displayed using display method 1 or display method 2. As mentioned above, if one of the higher-level sentences of the received sentence is in a reduced state, the device must extend the reduced sentence and place the new sentence in its correct position. This is an auto-extension, and four other types of auto-extension flowcharts will be applied later.

FIG. 33d illustrates a flowchart in which the device processes an expired sentence.

The flowchart of FIG. 33d (1) illustrates the case where the sentence expires while the RMS application is being executed. First, the sentence x. a ₁ . .. .. a _k expires. The device displays a note next to the expired text that the text will be deleted (displayed to the user minutes before the advance notice expires). The device waits for the user's response. When the device confirms the user's response, the device applies the delete instruction process (described later) to all expired sentences. This process deletes the selected sentence (in this case, the expired sentence) and all its subordinate sentences (if any). The physical properties of the layout are then updated to apply TWA and update the internal state.

The flowchart of FIG. 33d (2) represents the case where the text expires while the RMS application is not running (this includes the case where the device is turned off). First, the sentence x. a ₁ . .. .. _ak expires while the RMS application is not running. The user starts the RMS application. The device displays one note next to the expired sentence that the sentence will be deleted. The device waits for the user's response. When the device confirms the user's response, the device applies the delete instruction process to all expired sentences. This process deletes the selected sentence (in this case, the expired sentence) and all its subordinate sentences (if any). The physical properties of the layout are then updated to apply TWA and update the internal state.

It also provides flowcharts for 18 instructions. The flowchart presented is the core of the instruction. Later, we will show you how the user selects the text and applies the instruction.

FIG. 33e illustrates the core of the response instruction, which is referred to as the response instruction process. This process is basically the same as the process of sending a sentence.

FIG. 33f illustrates the core of reduction, expansion, all reduction and all expansion instructions.

The flowchart of FIG. 33f (1) illustrates the core of the reduction instruction, which is referred to as the reduction instruction process. When the process is executed, the device changes the internal state of the text to the reduced state. Subsequently, the shrinkable symbol before the sentence is changed to the expandable symbol (the number of subordinate sentences to be reduced is counted and displayed in the symbol). Subsequently, the device is described in sentence x. a ₁ . .. .. Do not display subordinate sentences of _ak. Finally, the text width adjustment (TWA-C) during reduction is performed (this step can be omitted). What TWA-C does is to apply TWA to a sentence without the sub-sentence of the sentence in the reduced state of the device.

The flowchart of FIG. 33f (2) illustrates the core of the storage expansion instruction, which is referred to as the expansion instruction (memory) process. When the process is executed, the device changes the internal state of the text to the extended state. Subsequently, the expandable symbol before the sentence is changed to a shrinkable symbol (the number of subordinate sentences to be reduced is no longer displayed in the symbol). After that, the device is written x. a ₁ . .. .. Display the subordinate sentences of a _k. In the mnemonic method, this is an iterative process. The device is the text x. a ₁ . .. .. _{All subtexts} of ak are inspected by the tree search method. The device is the text x. a ₁ . .. .. _{Start with one of the child sentences of ak} and check if it is in the extended state. In the expanded state, sentences and symbols are displayed. The same applies when the text is in a reduced state. However, when the text and symbol are displayed, it moves to another branch. Further, when the subordinate sentence is a leaf sentence, the device displays the sentence and moves to another branch. Therefore, if the subtext is in a reduced state or is a leaf text, the device considers it as the end point. Finally, the text width adjustment (TWA-E) during expansion is performed (this step can be omitted). The TWA-E process is the opposite of the TWA-C process. That is, TWA-applies to all texts in the layout, including the texts that have just been expanded.

The flowchart of FIG. 33f (3) illustrates the core of the non-memory extension instruction, which is referred to as the extension instruction (non-memory) process. When the process is executed, the device changes the internal state of the text to the extended state. Subsequently, the expandable symbol before the sentence is changed to a shrinkable thimble (the number of subtexts to be reduced is no longer displayed within the symbol). After that, the device is described in sentence x. a ₁ . .. .. Display the subordinate sentences of a _k. Finally, the text width adjustment (TWA-E) during expansion is performed (this step can be omitted).

The flowchart of FIG. 33f (4) all illustrates the core of the reduction instruction, and all of them are referred to as the reduction instruction process. When the process is executed, the device will see the text x. a ₁ . .. .. _{Change the internal state of ak} and all its subordinate sentences to the reduced state. Subsequently, the shrinkable symbol before the sentence is changed to the expandable symbol (the number of subordinate sentences to be reduced is counted and displayed in the symbol). Subsequently, the device is described in sentence x. a ₁ . .. .. Do not display subordinate sentences of _ak. Finally, the text width adjustment (TWA-C) at the time of reduction is performed (this step can be omitted).

The flowchart of FIG. 33f (5) all illustrates the core of the extension instruction, and all of them are referred to as the extension instruction process. When the process is executed, the device will see the text x. a ₁ . .. .. _{Change the internal state of ak} and all its subtexts to the extended state. Subsequently, the expandable symbol before the sentence is changed to a shrinkable symbol (the number of subordinate sentences to be reduced is no longer displayed in the symbol). After that, the device is described in sentence x. a ₁ . .. .. Display all sub-sentences of _ak. Finally, the text width adjustment (TWA-C) at the time of reduction is performed (this step can be omitted).

FIG. 33g illustrates a flow chart of four auto-expansions: previous state maintenance (MPS) auto-expansion, common depth (CD) auto-expansion, one-branch (OB) auto-expansion and all-expansion (EA) auto-expansion. ..

Note that the flowchart applies to storage or non-storage methods.

In addition, the received text is the text x. a ₁ . .. .. a _k. r, which is a higher-level sentence x. a ₁ . .. .. Suppose that it is a state where a _m is reduced. Clearly, sentence x. a ₁ . .. .. a _m, the sentence x. a ₁ . .. .. a _k. It is one of the parent sentences of r.

After the device completes the internal settings of the newly received text, the following four flowcharts are executed.

The flowchart of (1) in FIG. 33g illustrates MPS automatic expansion. When the device receives a new sentence (sentence _{x.a 1 ... a k. R)} , device, sentence x. a ₁ . .. .. starting from a _m, sentence x. a ₁ . .. .. a _k. Apply the extension command to the parent sentence of r. Therefore, this is because the extension instruction is the sentence x. a ₁ . .. .. a _m, x. a ₁ . .. .. It means that it is applied to a _{m + 1} etc. (up to sentence x.a ₁ ... a _k).

The flowchart of (2) in FIG. 33g illustrates the automatic expansion of a CD. Device, every time it receives a new sentence (sentence _{x.a 1 ... a k. R)} , device, sentence x. a ₁ . .. .. a _k. Apply extension instructions to all sentences deeper than r. After that, the device is described in sentence x. a ₁ . .. .. a _k. Apply the reduction command to all sentences at the same depth as r.

The flowchart of (3) in FIG. 33g illustrates OB automatic expansion. Every time the device receives a new sentence (sentence _{x.a 1 ... a k. R)} , device, sentence x. Starting from a ₁ , the sentence x. a ₁ . .. .. a _k. Apply the extension command to the parent sentence of r. Therefore, this is because the extension instruction is a sentence x. a ₁ , x. a _1. a ₂ , x. a _1. a ₂ . such as in a ₃ (sentence _x.a 1 ... _{a k.} to r) means applied it. The device then applies the reduction instruction to all sentences at depth _{1 (except sentence x.a1).} That is, it applies to all child sentences ( _{except sentence x.a 1) of the main sentence.}

The flowchart of (4) in FIG. 33g illustrates EA automatic expansion. Every time the device receives a new sentence (sentence _{x.a 1 ... a k. R)} , device applies all extended instruction in the main text.

FIG. 33h illustrates the core of the delete and all delete instructions.

The flowchart of (1) in FIG. 33h illustrates the core of the deletion command (deletion method 1), which is referred to as the deletion command process (method 1). When the process is executed, the device will read the text x. a ₁ . .. .. Change the internal state of _{ak to the deleted state.} Subsequently, the text of the text is not displayed, but the text box is still highlighted. Subsequently, the height of the text box is reduced to the default height. Subsequently, if the text is not in a deleteable state, no more applicable symbols (eg, hidden and visible symbols) are displayed. Finally, the text width adjustment (TWA-D) at the time of deletion is applied. What TWA-D does is apply the TWA to the rest of the text, excluding the text that the device is in the deleted state.

The flowchart of FIG. 33h (2) illustrates the core of the deletion command (deletion method 2), which is referred to as the deletion command process (method 2). When the process is executed, the device will read the text x. a ₁ . .. .. Change the internal state of _{ak to the deleted state.} The device then checks if the deleted text itself is part of the SDL branch. In such a case, the sentence is not displayed any more, and the sentence x. a ₁ . .. .. The symbol of a _k-1 (parent sentence of sentence x.a ₁ ... a _k ) is adjusted. This is necessary because the parent sentence (sentence x.a ₁ ... a _k-1 ) becomes a "visible" leaf sentence. On the other hand, if the deleted text does not form an SDL branch, the text of the text is simply not displayed and the text box is emphasized. Finally, the text width adjustment (TWA-D) at the time of deletion is executed.

The flowchart (3) of FIG. 33h illustrates the core of the deletion command (deletion method 1), and refers to the process of the deletion command (method 1). When the process is executed, the device will send a sentence sentence x. a ₁ . .. .. _{The internal state of ak} is changed, and all the subtexts thereof are set to the deleted state. Subsequently, the text of the sentence and its subordinate sentences is not displayed, but the text box is still highlighted. Subsequently, the height of the deleted text box is reduced to the default height. Subsequently, if the text is not in the deleted state, no more applicable symbols (eg, hidden and visible symbols) are displayed. Finally, the text width adjustment (TWA-D) at the time of deletion is applied.

The flowchart of (4) in FIG. 33h illustrates the core of the deletion command (deletion method 2), and refers to the process of the deletion command (method 2). When the process is executed, the device will read the text x. a ₁ . .. .. _{Change the internal state of ak} and all its subtexts to the deleted state. Then, the sentence x. a ₁ . .. .. Since _{all the subordinate sentences of ak} are SDL branches, all the subordinate sentences are not displayed. Subsequently, the device is described in sentence x. a ₁ . .. .. _{Check if ak} is part of the SDL branch. In such a case, sentence x. a ₁ . .. .. a _k is not displayed. Finally, the text width adjustment (TWA-D) at the time of deletion is executed.

FIG. 33i illustrates the core of the hidden, displayed, all hidden and all display instructions.

The flowchart of FIG. 33i (1) illustrates the core of the hidden instruction, which is referred to as the hidden instruction process. When the process is executed, the device will read the text x. a ₁ . .. .. Change the internal state of _{ak to the hidden state.} Subsequently, the height of the text box is reduced to the default height. The text then shrinks within the reduced text box. Finally, the hidden symbol is changed to a visible symbol.

The flowchart of FIG. 33i (2) illustrates the core of the display instruction, which is referred to as the display instruction process. When the process is executed, the device will read the text x. a ₁ . .. .. Change the internal state of _{ak to the visible state.} The height of the text box is then increased to its original height. The text is then completely displayed in the text box. Finally, the visible symbol is changed to a visible hidden symbol.

The flowchart of FIG. 33i (3) illustrates the core of all hidden instructions, which is referred to as the process of all hidden instructions. When the process is executed, the device will read the text x. a ₁ . .. .. _{Change the internal state of ak} and all its subtexts to a hidden state. Then, the sentence x. a ₁ . .. .. _{The height of the text box for ak} and all its subtexts is reduced to the default height. Then, the sentence x. a ₁ . .. .. _{The text of ak} and all its subtexts becomes smaller in the reduced text box. Finally, the hidden symbol is changed to a visible symbol.

The flowchart of FIG. 33i illustrates the core of all display instructions, which are all referred to as the display instruction process. When the process is executed, the device will read the text x. a ₁ . .. .. _{Change the internal state of ak} and all its subtexts to the visible state. Then, the sentence x. a ₁ . .. .. _{The height of the text box of ak} and all its subtexts is increased to its original height. Then, the sentence x. a ₁ . .. .. _{The text of ak} and all subtexts is fully displayed. Finally, the visible symbol is changed to a hidden symbol.

FIG. 33j illustrates the core of UBD and UBD instructions. As mentioned above, the UBD and UBD instructions are the same as the delete and all delete instructions, but at the end of the delete operation, the device sends a signal to other users to delete the text requested by the device owner. The difference is that it does. When another user receives the request and makes a decision, the device sends a feedback signal to the text owner.

The flowchart of FIG. 33j (1) illustrates a process in which an arbitrary deletion operation continues. As illustrated in the drawing, when the device executes the process of deletion instructions (deletion method 1 or deletion method 2), the device sends a UBD signal and related information to other users.

The flowchart of FIG. 33j (2) illustrates a process in which an arbitrary all-delete operation continues. As illustrated in the drawing, when the device executes the process of all delete instructions (deletion method 1 or delete method 2), the device sends all UBD signals and related information to other users.

The flowchart of FIG. 33j (3) illustrates a case where another user receives a request from the owner of the text. First, the user (recipient) receives the UBD signal and the text x. a ₁ . .. .. Receive the main key of _ak. The device first checks if the corresponding sentence is in the deleted state. If the text is in the deleted state, the device terminates the process without doing any work (this is considered to be another user's consent to the owner's request). If it is not in the deleted state, the device will read the text x. a ₁ . .. .. _{Inspect whether the upper sentence of ak} or the sentence itself is in a reduced state. In such cases, the device applies all extended instructions to the text. The device asks the user if they agree to delete the text. When the device detects the user's consent, the process of deletion instructions (method 1 or method 2) is applied to the text. The device then sends a user ID and an acceptance signal that the user has agreed to delete the text and has deleted the text. If the user does not agree to delete the text, the device sends a user ID and a rejection signal that the user does not agree to delete the text.

The flowchart of FIG. 33j (4) illustrates a case where another user receives a request from the owner of the text. First, the user (receiver) receives all UBD signals and sentences x. a ₁ . .. .. Receive the main key of _ak. The device first looks for non-overlapping sentences. When all deleted text overlaps with the text requested to be deleted, the device terminates the process without doing any work (this means that other users agree to the owner's request). Is considered). If there is at least one non-overlapping sentence, the device will see the sentence x. a ₁ . .. .. _{Inspect whether the upper sentence of ak} or the sentence itself is in a reduced state. In such cases, the device applies all extended instructions to the text. The device also inspects whether the subtext is in the deleted state. In such a case, the device is in the reduced state of the sentence x. a ₁ . .. .. Apply the extension command to all sub-sentences of _ak. The device asks the user if they agree to delete the text. When the device detects the user's consent, the process of the delete all (method 1 or method 2) instruction is executed. The device then sends a user ID and an acceptance signal that the user has agreed to delete the text. If the user does not agree to delete the text, the device sends a user ID and a rejection signal that the user does not agree to delete the text.

The flowchart of FIG. 33j (5) illustrates receiving a notification as to whether the owner has decided that another user has decided to delete the text. First, the device receives a user ID and an accept / reject signal from another user. Based on this information, the decision made by another user is then displayed to the owner.

FIG. 33k illustrates the core of the correction instruction.

The drawing of FIG. 33k (1) illustrates the core of the correction instruction, which is referred to as the correction instruction process. When the process is executed, the soft keyboard is displayed, the Cancel button is displayed on it, and the Apply button is deactivated. The device waits for the user's correction. When the device detects a change in text, it checks that the text is composed of at least one character. Otherwise, the device waits for user input. In such a case, the device activates the apply instruction. The user applies a hand gesture to the apply command. Sentence x. a ₁ . .. .. _{The text of ak} is replaced with the new text. Adjusting the width of the text at the time of correction (TWA-M) is executed at this point, and the width of the text box of all the sentences in the layout is adjusted with the new text. What TWA-M does is that the device applies TWA to all text, including newly modified text. Finally, the correction signal transmission process is executed. In this process, the device sends a correction signal, a main key and the corrected text to other users. The correction signal is a signal for notifying other users that the text owner has modified the text.

The drawing (2) of FIG. 33k illustrates a flowchart in the case where the user applies a correction instruction but selects to cancel the operation by applying a hand gesture to the cancel button.

The drawing of FIG. 33k (3) illustrates a flowchart in which the device receives the correction signal and applies the correction instruction to the same sentence as the owner has corrected. First, the user (recipient) receives a correction signal from the owner, a sentence x. a ₁ . .. .. Receive the main key of _{ak and the modified text.} The device first describes the sentence x. a ₁ . .. .. _{Inspect whether the upper sentence of ak} or the sentence itself is in a reduced state. In such cases, the device applies all extended instructions in the reduced text. The device then inspects whether the corresponding text has been deleted. When the text is deleted, the device terminates the process without performing any work. Otherwise, the device replaces the previous text with new (modified) text. The device then applies text width adjustment (TWA-M) to the layout with the new text during the modification. Finally, the recipient is notified that the owner of the text has modified the text.

FIG. 33l illustrates the core of the inversion and return instructions.

The flowchart of FIG. 33l (1) illustrates the core of the inversion instruction, which is referred to as the inversion instruction process. When the process is executed, all leaf sentences are identified. The device then sets the internal state of those leaf sentences to the inverted state. The device displays only the leaf text and changes the invertable symbol to a recoverable symbol. Finally, the text width adjustment (TWA Upon Invert, TWA-I) at the time of inversion is applied to those leaf sentences. TWA's job is for the device to apply TWA only to leaf text and determine the width of those text boxes.

The flowchart of FIG. 33l (2) illustrates the core of the return instruction, which is referred to as the return instruction process. When the process is executed, the device sets the internal state of such leaf text to the return state. The device returns the layout to the original view and changes the witable symbol to an invertable symbol. Finally, the text width adjustment (TWA Upon Revert, TWA-R) at the time of returning to the layout is applied. The job of the TWA-R is to apply the TWA to the original layout before the device flips.

Here, a flowchart for receiving a sentence is provided during the inverted state of the layout. Here, it is assumed that the layout is already inverted.

The flowchart of FIG. 33l (3) illustrates a flowchart for processing the received text while the layout is inverted. In the flowchart, the upper part (shading box) is the same as the part that processes the received text. When the internal settings are made, the device checks whether the parent text of the received text is in the restored state. If the parent sentence is in an inverted state, this means that the new sentence must be replaced by the parent sentence and the internal state of the parent sentence must return to the restored state. Otherwise, if the parent sentence is already in the restored state, this means that the received sentence is a new leaf sentence. After this setting is made, the device executes the process of inversion instructions.

FIG. 33m illustrates the core of the increase and decrease instructions.

The drawing of FIG. 33m (1) represents the core of the increase instruction, which is referred to as the increase instruction process. When the process is executed, the device will read the text x. a ₁ . .. .. Change the internal state of _{ak to the increasing state.} Subsequently, a new text box with a height and width larger (predefined) than the original text is generated. Subsequently, the same text as the original text with a larger (predefined) font is assigned to the new text box. Finally, the enlarged text is displayed on the device with a reduction symbol above it.

The drawing (2) of FIG. 33m illustrates the core of the reduction command, which is referred to as the reduction command process. When the process is executed, the device will see the document x. a ₁ . .. .. Change the internal state of _{ak to the decreasing state.} After that, the device does not display any further enlarged text.

So far, I have presented the core of each command. Presents how the user applies instructions in internalized, externalized and customized settings.

FIG. 33n illustrates a flow chart for internalized, externalized and customized instructions.

The drawing of FIG. 33n (1) is a flowchart of an internalized instruction. First, the user can read the sentence x. a ₁ . .. .. Apply a hand gesture (predefined) to _ak. The device inspects the internal settings of the text and activates all applicable instructions. The device displays the prompt command display area, and all activation commands are displayed in the corresponding area. The user applies a hand gesture to one of the instructions the user intends to apply. Finally, the process of the X instruction is executed (where X represents the instruction applied by the user).

The drawing of FIG. 33n (2) is a flowchart of an externalized instruction. First, the device inspects the internal settings of each sentence and activates all applicable instructions. The device displays all activation instructions in the instruction display area. The user applies a hand gesture to one of the instructions the user intends to apply. Finally, the process of the X instruction is executed (where X represents the instruction applied by the user).

FIG. 33n (3) is a flowchart of a customized instruction. First, the user can read the sentence x. a ₁ . .. .. Apply a customized hand gesture (predefined) to _ak. The device checks for predefined hand gestures. Otherwise, the device does no work. In such cases, the device identifies the instruction and checks its internal settings and applicable applicability. If the instruction is not applicable, the device does not do such work either. Otherwise, the device activates the command. Finally, the process of the X instruction is executed (where X represents the instruction applied by the user).

Although various exemplary embodiments of the invention have been described for illustrative purposes, techniques in this art are within the scope and ideas of the claimed invention as disclosed in the appended claims. It turns out that various modifications, additions and alternatives are possible. Therefore, the present invention is not limited to the examples disclosed herein. The scope of the claimed invention should be determined not only by the following claims but also by their equivalents. The specific terms used herein and in the drawings are for explanatory purposes and should not be considered as restrictions on the present invention.

Claims (20)

As a device for organizing and displaying messages, the device includes a processor, which comprises a processor.
Multiple layout modes for organizing and displaying the messages exchanged between the devices in a structured manner are set.
Of the multiple layout modes, one layout mode for the chat session is determined.
The message included in the chat session is displayed on the display from the determined layout mode.
The width of the text box of all the messages displayed every time a predetermined event occurs is adjusted by the above-mentioned structured method.
The event includes at least one of the rotation of the device, the transmission or reception of at least one message, and the input of at least one instruction to the message display method.
Message organization and display device. The message includes a response message generated by specifically selecting the target message to be responded to.
The message organizing and displaying device according to claim 1. The processor includes at least one message with a message expiration time set by the creator of the message, and the message with the message expiration time set is from the device of all users who participate in the chat session at the expiration time. Will be deleted
The message organizing and displaying device according to claim 2. A message for which the expiration time of the message is set can be set so that it cannot respond to the message.
The message organizing and displaying device according to claim 3. The processor sets an instruction set for the message display method as one type selected from a group composed of an internalized type, an externalized type, and a customized type.
The internalized type is a type in which the instruction set is displayed by inputting a user's hand gesture.
The externalized type is a type in which the instruction set is displayed together with each message.
The customization type is a type that is executed without displaying the command corresponding to the hand gesture by inputting the hand gesture of the user.
The message organizing and displaying device according to claim 2. The instruction set includes at least response, shrink, extend, delete, UBD, hidden, display, modify, invert, and restore instructions, each instruction being an independent internalization, externalization, or customization type. Can be set independently
The message organizing and displaying device according to claim 5. The instructions further include all shrink, all extend, all delete, all UBD, all hidden, all show, increase, decrease.
The message organizing and displaying device according to claim 6. The processor sets an instruction set for the message display scheme, the instruction set includes at least reduction, extension, all reduction and all extension instructions.
The reduction instruction reduces the processor so that subordinate sentences of the sentence to which the reduction instruction is applied are not displayed, and at the same time, displays an expandable symbol in the sentence to which the reduction instruction is applied.
In the extension instruction, the processor displays a subordinate sentence of the sentence to which the extension instruction is applied, and at the same time, displays a reduceable symbol in the sentence to which the extension instruction is applied.
In the all-reduction instruction, the processor applies the reduction instruction to the sentence to which the all-reduction instruction is applied and its subordinate sentences.
In the all-extended instruction, the processor applies the extended instruction to the sentence to which the all-extended instruction is applied and its subordinate sentences.
The message organizing and displaying device according to claim 2. The processor automatically expands only the higher-level sentences directly related to the received sentence, and restores the layout to the state before at least one of the higher-level sentences is reduced. MPS (previous state maintenance, Maintain the Preview State) ) Execute the automatic extension instruction,
The message organizing and displaying device according to claim 8. The processor automatically expands only the higher-level sentences directly related to the received sentence, and restores the layout to the state before at least one of the higher-level sentences is reduced. MPS (previous state maintenance, Maintain the Preview) State) Execute the automatic extension instruction,
The message organizing and displaying device according to claim 9. The processor automatically expands only higher-level sentences directly related to the received sentence, and reduces a sentence having the same depth as the received sentence. CD (Common Depth) automatic expansion instruction. To execute,
The message organizing and displaying device according to claim 9. The processor executes an OB (One Branch) automatic extension instruction that automatically expands only the upper sentence directly related to the received sentence and reduces the sentence outside the layout.
The message organizing and displaying device according to claim 9. The processor executes an EA (Expand All) auto-extension instruction that extends all reduced text in the layout to which the received text belongs.
The message organizing and displaying device according to claim 9. The processor sets instructions for the display scheme of the message, which includes at least hidden, display, all hidden and all display instructions.
In the hidden instruction, the processor adjusts the height of the text box of the sentence to which the hidden instruction is applied to the default height, and at the same time, the part of the sentence is not displayed, and at the same time, the sentence to which the hidden instruction is applied. Display the symbols that can be displayed on
In the display command, the processor adjusts the height of the textbooks of the text to which the display command is applied to the default height, displays all the text parts, and at the same time, the text to which the display command is applied. Display a hidden symbol in
In the all-hidden instruction, the processor applies the hidden instruction to the sentence to which the all-hidden instruction is applied and its subordinate sentences.
In the all-display instruction, the processor applies the display instruction to a sentence to which the all-display instruction is applied and a subordinate sentence thereof.
The message organizing and displaying device according to claim 2. The processor sets instructions for the message display scheme, which includes at least delete and all delete instructions.
The delete instruction causes the processor to delete the text of the text to which the delete instruction applies.
The deletion command includes a deletion method 1 in which the processor adjusts the text box of the text to which the deletion command is applied to the default height and displays the text box, and a text box of the text to which the deletion command is applied by the processor. Delete One of the deletion methods 2 is executed,
The all deletion command applies the deletion command to the sentence to which the deletion command is applied and its subordinate sentences.
When the deletion instruction executes the deletion method 2, the processor that receives the response message to the deleted text displays the deleted text box again. Alternatively, redisplay the deleted text box and the deleted text together.
The message organizing and displaying device according to claim 2. The processor sets instructions for the message display scheme, which includes at least UBD (Ubiquitous Delete) and all UBD (Ubiquitous Delete) instructions.
The UBD instruction sends a message requesting that the processor delete the text of the sentence to which the UBD instruction is applied, and at the same time, request another user who has received the sentence to delete the sentence.
In all the UBD instructions, the processor applies the UBD instruction to a sub-sentence of the sentence to which the UBD instruction is applied.
A device for organizing and displaying the message according to claim 2. When the UBD instruction is executed, the processor transmits the response of the other user to the request message to the user to whom the UBD instruction is applied.
The message organizing and displaying device according to claim 16. The processor sets an instruction for the message display method, and the instruction includes at least a correction instruction.
The modification instruction allows the processor to modify at least a part of the sentence to which the modification instruction is applied, and sends a message informing other users who have received the sentence that the sentence has been modified.
The message organizing and displaying device according to claim 2. The processor sets instructions for the message display scheme, which includes at least inversion and return instructions.
The inversion instruction displays only the leaf text of the layout to which the inversion instruction is applied, and at the same time, displays a symbol that can be restored to the layout to which the inversion instruction is applied.
The return instruction displays the text of the layout to which the return instruction is applied as it is, and at the same time displays an invertable symbol in the layout to which the return instruction is applied.
A device for organizing and displaying the message according to claim 2. The processor sets instructions for the message display scheme, which includes at least increase and decrease instructions.
The increase instruction causes the processor to increase the font, the width of the text box, and the size of the text box to which the increase instruction is applied, and at the same time, display a decrementable symbol in the sentence to which the increase instruction is applied. death,
The decrease instruction causes the processor to reduce the font, width of the text box, and size of the text box to which the decrease instruction is applied, and at the same time displays an increaseable symbol in the sentence to which the decrease instruction is applied. do,
The message organizing and displaying device according to claim 2.

Images