WO2016167517A1

WO2016167517A1 - Method for making emotional e-book using complex functions of terminal

Info

Publication number: WO2016167517A1
Application number: PCT/KR2016/003751
Authority: WO
Inventors: 라호준
Original assignee: 라호준
Priority date: 2015-04-12
Filing date: 2016-04-10
Publication date: 2016-10-20
Also published as: KR20150079501A

Abstract

Provided is a method using a user interface apparatus having a touch interface unit, a tilt detection unit, a sound collection unit, and a humidity collection unit. According to an embodiment of the present invention, the user interface apparatus detects a touch and the direction and speed of the touch by the touch interface unit, detects a tilt of the apparatus by the tilt detection unit, collects sounds around the apparatus by the sound collection unit, and collects the humidity around the apparatus by the humidity collection unit, so as to display a page turning animation on a display unit, which is matched to the value of the layer corresponding to a touched layer, when a touch applied to a layering configuration area has a value equal to or greater than a specified value. Here, the detected tilt, sound, and humidity affect the relationship between the value of a touch on the touch interface and the value of an animation on the display unit within the range between predetermined values.

Description

[Revision 21.06.2016] according to Rule 26. Method for producing emotional e-books using complex functions of terminal

The present invention provides a technology for implementing a visual, tactile and emotional user interface of a paper book through e-books driven by a touch device, a tilt sensor, a speaker capable of detecting sound, and a humidity device equipped with a humidity measuring device. to be.

The development and rapid expansion of various terminals such as smart phones, smart tablets, and e-book readers have led to the expansion of e-books.

Modern display technologies now support colors closer to natural colors and are integrated to fit more pixels into a smaller screen. In addition, touch interface technology has been developed and used, either individually or in combination of two technologies, electromagnetic induction and pressure sensing. In addition, prior art has been researched on an interface method that combines a layer of information displayed on a display and a touch interface as if turning a page of a paper book. On the other hand, in the past, the display may have a slight deflection that is not damaged due to its function, but recently, a terminal equipped with a flexible display having a more free bending has been widely introduced due to the development of material technology. The development of such industrial technologies and their equivalent benefits can also have a positive effect on the effects of the present invention.

Many smartphones and smart tablets have a built-in method for detecting device tilt. These methods operate independently of the acceleration sensor, gyro sensor, geomagnetic sensor, or a combination of these to detect tilt. Prior art has been researched on an interface method that detects a tilt and turns a page of a paper book.

Microphones on smartphones and tablets are used to collect not only the voice but also the surrounding sounds. The technology of collecting and analyzing sounds can be divided into two types. Among them, the volume analysis technology is applied to increase the call quality of smartphones by increasing the sound of speaking and listening according to the ambient noise. Another technology is the direction analysis of sound, which is usually applied to home appliances by detecting the direction of sound using the time difference of sound transmitted to two or more microphones.

Devices such as modern smartphones and smart tablets have a variety of sensors competitively embedded, and sensor technology is becoming more integrated and advanced. The present invention includes a device as an e-book reader such as a smart phone and a smart tablet incorporating a humidity measuring sensor.

The problem to be solved by the present invention is the experience of providing the physical characteristics of the paper book by using the display touch interface technology of the terminal, the tilt detection method for the direction of gravity, the collection and analysis technology of the ambient sound, the humidity measurement method comprehensively Feeling that feeling is to embody in the north.

The present invention implements the characteristics of the paper book in North Korea by measuring the humidity of the device and the effect of turning the pages by several pages according to the humidity to affect the extent of the pages in combination with the above solutions. .

The present invention utilizes the touch interface method of the display unit in the interface device to experience the elastic effect of the paper book, which is experienced in a paper book, when the pages of the book's corners are pulled out of the book in the opposite direction to the pulled direction. .

The present invention uses a tilt detection method of the interface device to effect the page turning by gravity when the book is held by the hand.

The present invention uses a method of influencing the page turning by analyzing the strength and direction of the sound collected by the microphone of the device to effect the effect of a paper book that turns the page when the wind blows.

The present invention combines the above means to implement a natural page effect of an irregular number of pages of a paper book, and sets and implements a detailed situation of an interface.

Ebooks are often considered more convenient than paper books in terms of movement and search. However, one of the fundamental reasons people are reluctant to buy e-books is that they cannot provide the emotional user experience that only paper books have. In this way, the emotional experiences of people reading paper books are embodied in e-books to enhance the user experience of e-books.

1 is a diagram illustrating a configuration of a user interface device having a touch interface unit, a tilt detector, a sound collector, and a humidity collector according to an exemplary embodiment.

2 is a diagram illustrating information for determining a touch by a touch interface unit according to an exemplary embodiment.

3 is a diagram illustrating a reference line for setting a position of a layering setting region in a user interface device according to an embodiment.

4 is a diagram illustrating an example of setting a position of a layering setting region in a user interface device according to an embodiment.

5 is a diagram illustrating another example of setting a position of a layering setting region in a user interface device according to an embodiment.

6 is a diagram illustrating an example of considering a value detected by a tilt detection unit in a user interface device according to an embodiment.

FIG. 7 is a diagram illustrating an example in which a sound collector collects sound according to a direction and a volume in a user interface device according to an embodiment.

FIG. 8 is a diagram illustrating an example in which a humidity collector collects humidity in a user interface device according to an exemplary embodiment.

FIG. 9 is a front view illustrating an example in which a user interface device senses a touch and controls information to display a result on a display. Referring to FIG.

10 is a later part of a flowchart illustrating an example in which a user interface device senses a touch and controls the information to display a result on a display.

11 is a flowchart illustrating an example of detecting an inclination and controlling the information of the user interface device to display a result on a display.

12 is a flowchart illustrating an example in which a user interface device detects and analyzes sound, controls its information, and displays a result on a display.

FIG. 13 is a flowchart illustrating an example in which a user interface device senses humidity, controls information, and displays a result on a display.

14 is a diagram illustrating an example of a portable terminal having a touch interface unit, a display unit, a tilt detector, a sound collector, and a humidity collector according to an embodiment.

Referring to FIG. 14, the portable terminal displays an animation of turning a page over to a display unit located below the touch interface unit, and displays a main body 1410 including all other components required for the present invention, a home button, and a camera. It can be seen that the general configuration provided.

Hereinafter, with reference to the accompanying drawings will be described in detail an embodiment of the present invention. In the following description of the present invention, if it is determined that detailed descriptions of related well-known functions or configurations may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the present invention, which may vary according to intention or custom of a user or an operator. Therefore, the definition should be made based on the contents throughout the specification.

Referring to FIG. 1, the user interface device 100 includes a touch interface unit 110, a controller 120, a tilt detector 130, a sound collector 140, a humidity collector 150, and a storage 160. And a display unit 170.

The touch interface unit 110 may include at least one, or at least one, of an ordinary film type electric film sensor that electrically changes a change in pressure, voltage, or both in response to a physical change applied from the outside. Can be used to detect physical changes.

If the touch interface unit 110 detects a physical change, the controller 120 determines at least one of a physical change range and a physical change direction. In this case, whether the tilt detection unit 130, the sound collecting unit 140 and the humidity collecting unit 150 is operated by the touch interface unit 110 may be controlled.

2 is a diagram illustrating information determined by a touch interface unit according to an exemplary embodiment.

Referring to FIG. 2, the controller 120 may determine a moving direction 210, a moving speed 220, a pressure 230, and the like collected by the touch interface unit 110. On the other hand, the touch interface unit 110 and the display unit 170 may be seen as a bundle to match the touch and the display.

The tilt detector 130 may detect a degree of inclination of the user interface device 100.

The sound collector 140 collects sounds around the user interface device 110.

The humidity collector 150 collects humidity around the user interface device 110.

The storage unit 160 stores an operating system, application programs corresponding to layers, and storage data for controlling the overall operation of the user interface device 100.

The touch interface 110, the tilt detector 130, the sound collector 140, and the humidity collector 150 may control the operation of other units. For example, when the preset application is driven, the touch interface unit 110 controls the tilt detector 130, the sound collector 140, and the humidity collector 150 to be operated, or the touch interface unit 110 is operated. When a touch is detected, an interface using the tilt detector 130, the sound collector 140, and the humidity collector 150 may be serviced.

When the touch interface 110 detects a touch in the preset layering setting area 210, the touch interface 110 detects a physical change of the touch, and the controller determines the detected information, and according to the result, the display 170 displays the touch interface unit. Layers may be hierarchically displayed in an area matching the layered setting area 210 of 110.

In this case, the hierarchically displayed layer may be each page of a book when the e-book app is executed, as well as all applications that can be displayed in a so-called card type interface that displays and stacks information hierarchically.

Referring to FIG. 3, the touch interface unit 110 may check the left or right direction to be displayed on the display unit 170 by using reference lines having X and Y axes. However, the baseline can be made anywhere on X and Y.

Using the above method, the touch interface unit 110 may set a preset range as a layering setting area based on a predetermined reference line, or set an edge such as e-book expressed on the display unit 170 as a layering setting area. It may be.

4 is a diagram illustrating an example of setting a position of a layering setting area 430 in a user interface device according to an exemplary embodiment.

Referring to FIG. 4, when the touch detected in the layering setting area 430 selects a plurality of layers, the touch interface unit 110 selects a layer corresponding to the highest layer among the selected plurality of layers. Alternatively, when the touch sensed by the layering setting area 430 selects a plurality of layers, the touch interface unit 110 may select a layer having the largest area touched among the plurality of selected layers.

3 and 4, as a result of determining the physical movement direction 410 following the touch detected by the touch interface unit 110, the movement direction 410 is distributed on the right side based on the Y axis of FIG. 3. In this case, if a touch followed by a scroll is applied to the control unit and the control unit determines the moving direction 410 to the right or the left, the control unit presses a layer of each page on a portion of the display unit 170 that matches the layering setting area 430. Pages that display the animations that are heard or heard, and at the same time have a value of a layer selected in the layering setting area 430 and released by moving on the left side of the display unit 170 corresponding to a portion except the layering setting area 430. From this, you can display animations that move sequentially to the left. At this time, the two animations on the left and the right may be undivided ones or may be divided into two parts and adjusted to be naturally connected to each page unit.

On the other hand, referring to Figures 3 and 4, the layout in the entire display of the layered setup area 430 may be four separate individual directions, including right, left, top, bottom, or any valid optional combination of directions, each The operation method according to the four-way corner may be applied by adjusting the method according to the right arrangement of the layered setting area 430 in a direction that is adapted to each arrangement.

4 and 5, the size of the left display surface excluding the layering setting area 420 may be a preset size or may be changed according to the number of layers that the layering setting area 430 has. In addition, when the touch interface unit 110 detects a physical change in a predetermined pressure, a moving direction, and a moving speed in a touched state as shown in FIG. 5, the layered setting area extends from the touch position 510 to the outside of the touch interface unit. It may be set to 520.

In this case, the outer edge of the layered setting area 520 may consider the moving direction 410 and the moving speed 420 including the right detected by the touch interface unit 110 as shown in FIG. 4, and the touch interface unit Consider the movement direction and the movement speed including the left side of 110.

Referring to FIG. 6, inclination information considering the gravitational direction 640 detected by the tilt detection unit 630 included in the user interface device 100 may be touched in the layered setting area 620 of the touch interface unit 110. It may be controlled so as to affect the information of the left layer other than the position 610 selected so as to display the animation on which the corresponding pages are skipped on the display unit 170. Meanwhile, even when no touch is applied, the information of the tilt may cause the display unit 170 to display an animation of turning pages.

Referring to FIG. 7, the sound outside the interface device 100 detected by the sound collector 730 is analyzed by the controller as the volume and the position of the sound, and is included in the layering setting area 720 of the touch interface 110. It may be controlled to operate on information of the left layer other than the touch position 710 and to display an animation of turning pages corresponding to the display unit 170. Meanwhile, even when no touch is applied, the sound volume and the position information of the sound may be controlled to display an animation of turning the pages on the display unit 170.

Referring to FIG. 8, when the ambient humidity information of the interface device 100 detected by the humidity collecting unit 830 is scrolled by selecting a touch location 810 of the layered setting area 820 of the touch interface 110. The weight may affect the extent to which the page of the animation displayed on the display unit 170 is skipped less or more than the scroll selection. On the other hand, when the page turning effect is activated by the tilt detector or the sound collector even when no touch is applied, the humidity information may affect the degree to which the pages of the animation are skipped.

As can be seen through Figures 5 to 8, when the present invention is applied to a book viewing application, the physical change detected by the touch interface unit 110 is holding the book in the hand and bounces the edges with the fingers to open the bookshelf. It may provide a visual repulsion when it is turned over, provide an intuitive visual experience and feel of flipping through the bookshelf by gripping the book and sliding the thumb, holding the book in your hand and supporting a portion of the edge with your thumb. And use the snaps on the wrist to flip through pages at once, or to flip through the book down to give the experience and the feeling of turning a large number of pages, or to break through the pages that are not well separated. You can blow the page apart or provide an experience where the surrounding wind blows and the page turns, Combining the control of humidity gathering information with the combination method of the effects on the screen, it is as if pages are stuck when the humidity is high, and it becomes difficult to count with fingers. Can be used to create unintended mistakes, such as turning pages in real books. As a result, the present invention embodies the unique experience that the paper book provides to the user and the unique sensibility felt in the book based on the interaction between the hand and the surrounding natural environment in real time.

The controller 120 may control the overall operation of the user interface device 100. The controller 120 may perform some of the functions of the touch interface 110, the tilt detector 130, the sound collector 140, and the humidity collector 150. You can also assign processing functions. The control unit 120, the touch interface unit 110, the tilt detection unit 130, the sound collecting unit 140, and the humidity collecting unit 150 are illustrated separately to explain each function. Accordingly, the controller 120 may include at least one processor configured to perform a part of each of the functions of the touch interface 110, the tilt detector 130, the sound collector 140, and the humidity collector 150. It may include.

Hereinafter, a user interface method using a display according to the present invention configured as described above will be described with reference to the drawings.

Referring to FIG. 9, in operation 910, the user interface device 100 checks whether a touch interface unit is touched.

As a result of checking in step 910, if a touch of the touch interface unit is detected, the user interface device 100 measures a physical change of the touch interface unit in step 912.

In operation 914, the user interface device 100 determines whether the measured information is greater than or equal to a preset value.

If the physical change of the touch interface unit is smaller than the preset value in step 914, the user interface device returns to step 910.

If the physical change of the touch interface unit is equal to or greater than the preset value in step 914, the user interface apparatus 100 sets a portion of the touch interface unit as a layered setting region in step 916 based on the preset reference line of the touch interface unit.

In this case, the user interface device 100 may set an outer layer of the touch interface unit as a layering setting region starting from the touched position.

In operation 918, the user interface device 100 hierarchically displays layers through a display unit that matches the layered setting area.

In operation 920, the user interface device 100 detects whether a touch is applied to the layered setting region. In this case, when the touch sensed in the layering setting area selects a plurality of layers, the user interface device 100 selects a layer corresponding to the highest layer among the selected plurality of layers.

Then, the user interface device 100 enters H. However, according to the user's setting, the user may directly enter step 922.

13, when the humidity collector is activated in step 1310, when the humidity is collected in step 1312, the humidity information is measured in step 1314, and the humidity information is greater than the preset value in step 1316. In the same case, the user interface device 100 obtains a weight for displaying an animation on the display more accurately in step 1318, or if the humidity information is greater than or equal to a preset value in step 1316, the user interface device 100 reads 1318. In step S, the weight is obtained to display the animation on the display part less accurately, and the process returns to R of FIG. In this case, when the humidity collecting unit is not activated in step 1310 or when the humidity is not collected in step 1312, the user interface device 100 ends the algorithm of FIG. 13 and returns to R of FIG. 9.

In operation 922, the UI apparatus 100 returning to R of FIG. 9 displays an animation in which a corner of a page is pressed or heard in a display unit that matches the layered setting region. In this case, the user interface device 100 may display the animation more accurately or less accurately by applying the weight obtained in

operation

1318 or 1320 of FIG. 13.

In operation 924, the user interface device 100 enters G1 when the tilt detector is activated, or enters S1 when the sound collector is activated, or both the tilt detector and the sound collector. In the active state, G1 and S1 can be entered in parallel at the same time. However, depending on the user's setting, you may enter A directly.

When the user interface device 100 enters G1 of FIG. 11 from G1 of FIG. 9, the user interface device 100 enters step 1110.

If the user interface device 100 detects the tilt in step 1110, if the tilt size information is measured in step 1112, if the information is determined in step 1114 and is greater than or equal to the preset value, the display unit in step 1116. In step 1118, a weighting value for displaying an animation is obtained, and the direction of entry into the algorithm of FIG. 11 is determined, and the process returns to F of FIG.

If the slope is not detected in step 1110 or the value determined in step 1114 is smaller than the preset value, the user interface device 100 ends the algorithm of FIG. 11 and returns to F of FIG. 9.

When the user interface device 100 enters S1 of FIG. 12 from S1 of FIG. 9, the user interface device 100 enters step 1210.

In addition, when the user interface device 100 collects the sound in step 1210, when the sound size and the sound direction information are measured in step 1212, when the information is determined in step 1214, the sound volume is greater than or equal to the preset value. In step 1216, when the information is determined and the sound direction is within the preset range value, a weighting value for displaying the animation on the display is obtained faster in step 1218, and the direction of entry into the algorithm of FIG. 12 is determined in step 1220. And return to F of FIG.

If the loudness is not detected in step 1210, the value determined in step 1214 is smaller than the preset value, or the value determined in step 1216 is larger than the preset value, the user interface device 110 terminates the algorithm of FIG. 11. The process then returns to F in FIG. 9.

When the user interface device 100 returns to F of FIG. 9, the user interface device 100 enters FIG. 10 through A of FIG. 9.

In operation 1010, the user interface device 100 may display the pressure of the scroll, or the direction and speed of the scroll, or the pressure, the direction, and the speed of the scroll, which are started without disconnection from the touch detected in the layering setting area of operation 920 of FIG. 9. If the three measurements are measured, and the information measured in step 1012 is greater than or equal to the preset value, in step 1014, the user interface device 100 displays an animation in which the page is turned over on the display unit that matches the portion other than the layered setting area. do. In this case, the user interface device 100 confirms that the algorithm has passed through H and R of FIG. 9 in step 1014, and may display the animation more accurately or less accurately using the weighting values obtained in

steps

1318 or 1320 of FIG. 13. For example, the animation may be displayed more quickly by using one of the weighting values for displaying the animation faster on the display obtained in

steps

1116 and 1218 of FIG. 11 or by accumulating both. In this case, the animation displayed on the display unit matched with the layered setting region of step 922 of FIG. 9 may be displayed more quickly.

The user interface device 100 may start the algorithm from the start step of FIG. 11 when the layering setting area is not activated by the touch. In this case, the user interface device 100 enters H of FIG. 11. However, depending on the user's setting, it may immediately enter step 1110.

When the user interface device 100 enters H of FIG. 13 through H of FIG. 11, when the humidity collecting unit is activated in operation 1310, when humidity is collected in operation 1312, humidity information is measured in operation 1314. If the humidity information is greater than or equal to the preset value in step 1316, the user interface device 100 obtains a weight for displaying an animation on the display more accurately in step 1318, or the humidity information is set in step 1316. If greater than or equal to, the user interface device 100 obtains a weight for displaying the animation on the display part less accurately in step 1318, and returns to R of FIG. In this case, when the humidity collecting unit is not activated in step 1310 or when the humidity is not collected in step 1314, the user interface device 100 ends the algorithm of FIG. 13 and returns to R of FIG. 11.

11, when the user interface device 100 returns to R of FIG. 11 and detects the tilt in step 1110, when the tilt size information is measured in step 1112, the information is determined in step 1114 to be greater than or equal to the preset value. In step 1116, a weighting value for displaying the animation is displayed on the display faster. However, depending on the user's setting, it may go directly to step 1120.

If the slope is not detected in step 1110 or the value determined in step 1114 is smaller than the preset value, the user interface device 100 may terminate the algorithm of FIG. 11.

When the user interface device 100 enters S2 of FIG. 12 from S2 of FIG. 11, when sound is collected in step 1210, when the loudness and sound direction information is measured in step 1212, the information is determined in step 1214. If the sound volume is greater than or equal to the preset value, the information is determined in step 1216. If the sound direction is less than or equal to the preset value, the weighted value for displaying the animation on the display is obtained faster in step 1218. In step 1222, the approaching direction of the algorithm is determined, and in step 1222, the page is displayed on the display unit matching the non-layered setting area. At this time, the user interface device 100 confirms that the algorithm has gone through the steps of FIG. 13 through H and R of FIG. 11 to display the animation more accurately or less accurately using the weighting values obtained in

steps

1318 or 1320 of FIG. In addition, one of the weighted values used to display the animation faster on the display obtained in

steps

1116 and 1218 of FIG. You can also accumulate everything and use it to display animation faster.

If the sound is not collected in step 1210, the value determined in step 1214 is smaller than the preset value, or the value determined in step 1216 is larger than the preset value, the user interface device 110 ends the algorithm of FIG. 12. Return to G2 in FIG.

The user interface device 100 may start from the start step in FIG. 12 when the layering setting area is not activated by the touch. In this case, it enters H of FIG. However, according to the user's setting, it may directly enter step 2110.

When the user interface device 100 enters H of FIG. 13 through H of FIG. 12, when the humidity collecting unit is activated in operation 1310, when humidity is collected in operation 1312, humidity information is measured in operation 1314. If the humidity information is greater than or equal to the preset value in step 1316, the user interface device 100 obtains a weight for displaying an animation on the display more accurately in step 1318, or the humidity information is set in step 1316. If greater than or equal to, the user interface device 100 obtains a weight for displaying the animation on the display part less accurately in step 1318, and returns to R of FIG. In this case, when the humidity collecting unit is not activated in step 1310 or when the humidity is not collected in step 1314, the user interface device 100 ends the algorithm of FIG. 13 and returns to step R of FIG. 12 without obtaining a weight. .

When the sound is collected in step 1210, when the loudness and sound direction information is measured in step 1212, when the information is determined in step 1214, and the sound size is greater than or equal to the preset value, the information is determined in step 1216. If the sound direction is less than or equal to the preset value, a weighting value for displaying the animation on the display part is obtained faster in step 1218, and the entry direction of the algorithm is determined in step 1220 to enter G2 of FIG. . However, depending on the user's setting, it may directly enter step 1222.

If the sound is not collected in step 1210, or the value determined in step 1214 is smaller than the preset value or the value determined in step 1216 is larger than the preset value, the user interface device 100 ends the algorithm of FIG. 12. Can also be.

When the user interface device 100 enters the G2 of FIG. 11 from the G2 of FIG. 12, when the tilt is detected in step 1110, when the tilt size information is measured in step 1112, the information is determined in step 1114 and is preset. If the value is greater than or equal to the value, in operation 1116, a weighted value for displaying the animation is displayed on the display faster. In operation 1120, the page is displayed on the display that matches the part other than the layered setting area. At this time, the user interface device 100 confirms that the algorithm has gone through the steps of FIG. 13 through H and R of FIG. 12, and more accurately or less accurately displays the animation using the weighting values obtained in

steps

1318 or 1320 of FIG. Alternatively, the animation may be displayed more quickly by using one of the weighting values for displaying the animation faster on the display obtained in

steps

1218 and 1116 of FIG. 12 or by accumulating both. .

If the tilt is not detected in step 1110 or the value determined in step 1114 is smaller than the preset value, the user interface device 100 ends the algorithm of FIG. 11 and returns to S2 of FIG. 12.

Among the unique physical properties of the paper book, which are due to the wide, thin, elastic, flexed and restored physical properties of the paper making up the conventional paper book, and generally caused by binding paper of the same size to one side One is to hold in the form of elasticity the effective repulsive force felt by the hand when the pages of the book are pulled and released in the opposite direction to the hand turning over the stacked corners to turn the pages. In addition, due to physical conditions, such as the smoothness of paper and the humidity of the surroundings, a paper book has a characteristic in which many pages are irregularly crossed instead of one when the pages are flipped. Also, if you quickly flip through the book's contents with your thumb, you can flip through the pages by the difference between the weight of the book and individual pages, the relationship between each gravity, irregular air pressure, and wind. It is difficult to control precisely by chapter. The two characteristics of paper books that cause repulsion in the hands and that it takes mental and physical effort to turn pages exactly one by one are that the readers of the paper book, along with the physical tension that passes through the hands, It provides a complex experience of two physical and mental experiences and the emotions that arise from it.

Claims

When attempting to simulate the experience of a paper book in an e-book, the display unit displays an animation of page flipping less accurately or more accurately based on humidity information around the interface device detected by the humidity collector built into the interface device. Interface method (method 1).
When attempting to simulate the experience of a paper book in an e-book, only when the method 1 of claim 1 is included.

The display unit corresponds to the left layer other than the touch position selected from the layering setting areas of the touch interface unit based on the sound volume and sound position information analyzed by the controller by analyzing the sound detected by the sound collector built in the interface device. A user interface method (method 2) for displaying an animation of turning over pages, or displaying an animation of turning over a currently displayed page corresponding to layers deselected as scrolling progresses.

A touch interface unit capable of measuring pressure, voltage, or both in response to external force applied thereto; A display unit which displays information when the touch interface unit is touched; And when a touch is detected in a preset layering setting area of the touch interface, a layer corresponding to the touched layer is hierarchically displayed on the display unit, and scrolling subsequent to the touch is performed so that a value measured in the touch interface is set to a preset pressure. Or a method of using an interface device having a touch interface unit configured to set a part of the touch interface unit as a layered setting area and display layers hierarchically through the display unit corresponding to the layered setting area when the moving direction and the moving speed are higher than each other. Method 3),

The display unit displays or scrolls an animation in which pages corresponding to the left layer other than the touch position selected in the layering setting area of the touch interface unit are skipped or scrolled based on the tilt information detected by the tilt detection unit built in the interface device. In this method, a method of displaying an animation in which a page corresponding to deselected layers is displayed more quickly (method 4),

A user interface method including all of the above-described methods 2, 3, and 4 and giving a total weight to the page turning.