TWI726795B - Multi-language virtual reading and touring system - Google Patents

Abstract

A multi-language virtual reading and touring system is applied for user to access through electronic display device. The system includes a database, a language module, and a processing module. The database stores a plurality of book information, each book information includes a plurality of virtual images and book content information. The language module sets the language by which the book content information is displayed. The processing module receives the reading command and language command of selected book content information from the electronic display device. According to the reading command, the book virtual image and book content information of the corresponding to the book information are retrieved. The language module switches the language for displaying the book content information according to the language command. The book content information of the switched language and the virtual image are displayed on the electronic display device.

Description

Multilingual virtual reading and tour system

The invention relates to a virtual reality system related field, in particular to a multilingual virtual reading and tour system.

At present, books on the market are generally published in large numbers, and the contents of the books purchased by everyone are the same, lacking innovation and uniqueness. In addition, general books on the market can only use text, pictures or sound to present the story of the book. Users can only imagine the book scene through the text and picture of the book, and cannot actually experience the feeling of the book scene and the environment in which the character is located. It lacks presence Sense and authenticity.

Furthermore, users can only obtain a single text, fixed pictures, and sounds in a single language from a book. It is not yet possible for the user to listen to or learn other languages while reading the book. In addition, since ordinary books are single fixed pictures and cannot be displayed in an animated manner: therefore, the learning effect that users can achieve by reading books is quite limited, and it is easy to lose the fun of learning, reading and leisure.

In addition, most of the travel books or online travel information currently on the market can only present tourist attractions in text, pictures or matching images. Users can only imagine the local scenery through the browsing process, and cannot actually experience travel. Feel.

In addition, traveling requires a certain amount of travel expenses, time and physical strength. For people or children with limited travel funds and limited mobility, there are many inconveniences and difficulties when traveling, and it is impossible to actually experience the travel experience.

In order to solve the above problems, the present invention provides a multilingual virtual reading and browsing system, which can present the scene and context of the book content in front of the user's eyes as a virtual image of the book, and increase the user's sense of reality and vividness in the process of reading the book. ; And it can choose the required language to be suitable for users of different language families, and it can also provide users to choose the language they want to learn to achieve the effect of language learning.

An embodiment of the present invention provides a multi-language virtual reading and browsing system, which is set up on a cloud server, and a user connects to the cloud server through an electronic display device network to use the multi-language virtual reading and browsing system; The Mandarin virtual reading and tour system includes: a database for storing plural book information, each book information having plural book virtual images and book content information corresponding to one of the book virtual images; a language module, which provides setting information The language of the book content information display; and a processing module that receives a reading command and a language command for selecting one of the book information sent from the electronic display device, wherein the processing module searches the database according to the reading command to obtain Corresponding to the book information, and extract the book virtual image and the book content information corresponding to the book information, the processing module sends the language command to the language module, and the book obtained through the language module The content information is converted into a language conforming to the language instruction, and the processing module displays the book content information after the language conversion and the virtual image of the book on an electronic display device.

Through the above, the present invention can present the scene and context of the book to the user's eyes as a virtual image of the book, providing the user with the scene of the content of the book during the reading process, and increasing the realism and vividness of reading.

Moreover, it can provide users with the choice of the language they need to read, so that it is suitable for users of different language families. At the same time, it can also provide users with the choice of multi-cultural content with different language connotations and the international communication they want to learn, so as to achieve the best language learning. The effect is to improve the shortcomings of only a single language in the conventional reading books, and effectively enhance the practicability and versatility of the present invention.

In one of the embodiments, each book content message has a plurality of audio messages and a complex number of screen messages, and each audio message corresponds to the subtitle message and the virtual image of the book, and the voice message and the subtitle message are matched with the subtitle message and the virtual image of the book. The virtual images of the books can be continuously connected to each other; thereby, the book information can cooperate with the virtual images of the books smoothly and uninterruptedly, and is provided to the user like an animation, thereby increasing the pleasure of reading.

In one embodiment, each book information is divided into a plurality of chapters, and each chapter is provided with a plurality of context content options, and each context content option is displayed on the electronic display device in conjunction with the virtual image of the book, and provides settings and generates a context Content command; the processing module searches the database according to the context content command to obtain the virtual image of the book and the book content information; thereby, the user can select different context directions, so that different books can be combined Context, and then increase the interactivity, innovation and uniqueness of reading.

In one of the embodiments, the present invention further has a playback control module, which has a playback unit and a speed unit. The playback unit provides setting playback, pausing or stopping the book information; the speed unit provides setting playback The playback speed of book information; this allows users to adjust the reading status according to reading needs, and can also adjust the reading speed according to reading habits, increasing the control of reading.

In one of the embodiments, the present invention further has an editing module, which is used to create new book information in the database or edit the book information stored in the database; thereby, provide users with Adjust the content of books to create different book content, thereby increasing the interactivity, innovation and uniqueness of reading.

In one of the embodiments, the database stores a plurality of travel information, each travel information has a plurality of travel virtual images and a travel content message corresponding to the travel virtual image; the language module provides a language for setting the display of the travel content information; and processing; The module receives the reading instruction and language instruction for selecting one of the travel information sent from the electronic display device, and the processing module searches the database according to the reading instruction to obtain the corresponding travel information, and extracts the corresponding travel information. The travel virtual image and the travel content information, the processing module transmits the language instruction to the language module, and the acquired travel content information is converted into a language conforming to the language instruction through the language module, and the processing module converts the language The travel content information is displayed on the electronic display device in conjunction with the travel virtual image; thereby, the present invention can present the travel scene and travel experience in front of the user's eyes as a virtual image, and provide the user with the viewing process. It feels like an immersive travel effect.

In one of the embodiments, the present invention further has a mode module, which provides for setting a book mode or a travel mode, and the processing module receives a mode signal generated by selecting the book mode or the travel mode, and matches the database to the mode The information of each book or travel information of the signal is displayed on the electronic display device; thereby, the present invention can provide users with a choice to read classic books or travel books, so that users can not only experience the content of the books and strengthen the reading effect, but also profoundly The in-depth travel experience can effectively enhance the application breadth of the present invention.

In order to facilitate the description of the central idea of the present invention expressed in the column of the above-mentioned summary of the invention, specific embodiments are used to express it. The various objects in the embodiment are drawn according to the proportion, size, deformation or displacement suitable for illustration, rather than drawn according to the proportion of the actual element, which will be described first.

Please refer to Figures 1 to 10, the present invention provides a multilingual virtual reading and tour system 100, which is set up on a cloud server 1, and a user 2 connects to the cloud server 1 via the Internet through an electronic display device, and further Using the multi-lingual virtual reading and tour system 100, the electronic display device is one of the head-mounted display 3, the smart mobile device 4, and the control sensor or a combination thereof. In the embodiment of the present invention, the electronic display device is the head Wearable display 3 and smart mobile device 4, head-mounted display 3 and smart mobile device 4 signal connection, and user 2 connects to the cloud server via the Internet through the smart mobile device 4, and uses multilingual virtual reading and browsing System 100.

The multilingual virtual reading and tour system 100 of the present invention includes:

A database 10 for storing plural book information 11 and plural travel information 12, each book information 11 has plural book virtual images 13 and book content information 14 corresponding to one of the book virtual images 13; each travel information 12 has plural numbers A travel virtual image 15 and a travel content information 16 corresponding to the travel virtual image 15, wherein the book virtual image 13 is a virtual reality image or an augmented reality image, and the book virtual image 13 uses virtual reality Virtual Reality (VR) or Augmented Reality (AR) technology is formed. When the book virtual image 13 is a virtual reality image, the book virtual image 13 is a virtual reality image by simulating a three-dimensional image of a specific space. The image 13 can be presented on the head-mounted display 3, as shown in FIG. 6. When the virtual book image 13 is an augmented reality image, the position and angle of the camera image of the smart mobile device 4 are calculated and the image is added The analysis technology allows the virtual image 13 of the book on the screen of the smart mobile device 4 to enter the real world scene to interact with real characters, as shown in FIG. 7.

The travel virtual image 15 is a virtual reality image or an augmented reality image, and the travel virtual image 15 is formed using virtual reality technology (Virtual Reality, VR) or augmented reality technology (Augmented Reality, AR) , Where, when the travel virtual image 15 is a virtual reality image, the travel virtual image 15 can be presented on the head-mounted display 3 by simulating a three-dimensional image of a specific space, as shown in FIG. 9; The image 15 is an augmented reality image. The position and angle of the camera image of the smart mobile device 4 are calculated and image analysis technology is added to allow the travel virtual image 15 on the screen of the smart mobile device 4 to enter the real world. The scene interacts with real characters, as shown in Figure 10.

Each book content information 14 has multiple audio information and multiple digital screen information 141. Each audio information corresponds to its own subtitle information 141 and book virtual image 13. Each audio information and each subtitle information 141 can be connected to each other with the book virtual image 13 Concatenate to form a continuous audio and video file.

Each travel content message 16 has a plurality of audio messages and a multi-number screen message 161. Each audio message corresponds to an exclusive subtitle message 161 and a travel virtual image 15. Each audio message and each subtitle message 161 can be connected with the travel virtual image 15 to be continuous with each other Concatenate to form a continuous audio and video file.

Furthermore, each book information 11 is divided into a plurality of chapters, and each chapter is provided with a plurality of contextual content options 111, and each contextual content option 111 can be displayed on the head-mounted display 3 of the electronic display device in conjunction with the virtual image 13 of the book. Each contextual content option 111 has a corresponding exclusive audio message, subtitle message 141, and book virtual image 13. That is, different contextual content options 111 will present different book virtual images 13 and book content information 14.

A language module 20, which is coupled to the database 10 and provides a language for setting the book content information 14 to be displayed on the electronic display device. The language module 20 has languages of various countries, such as: Chinese, English, and Japanese , Korean, French and other languages, the language module 20 can convert and translate the audio message and subtitle message 141 of the book content message 14 into different languages.

A processing module 30, which is coupled to the smart mobile device 4, the database 10 and the language module 20 of the electronic display device, the processing module 30 receives the information sent from the smart mobile device 4 and selects one of the book information 11 for viewing Command and a language command, the processing module 30 searches the database 10 according to the reading command to obtain the corresponding book information 11, and extracts the book virtual image 13 and the book content information corresponding to the book information 11 14. The processing module 30 transmits the language instruction to the language module 20, and the acquired book content information 14 is converted into a language conforming to the language instruction through the language module 20, and the processing module 30 matches the book content information 14 after the language conversion The virtual image 13 of the book is transmitted to the head-mounted display 3 through the smart mobile device 4 for display or displayed by the smart mobile device 4.

Furthermore, the processing module 30 will display the contextual content options 111 set in each chapter and the virtual image 13 of the book on the head-mounted display 3 or the smart mobile device 4 according to the chapters of the book information 11. 2 can select settings through the smart mobile device 4 to generate a context content command, and the processing module 30 searches the database 10 according to the context content command to obtain the virtual image 13 of the book and the book corresponding to the context content command Content message 14.

In addition, the processing module 30 can also receive a reading instruction and a language instruction for selecting one of the travel information 12 sent from the electronic display device. The processing module 30 searches the database 10 according to the reading instruction to obtain the corresponding travel information 12. And extract the travel virtual image 15 and the travel content information 16 corresponding to the travel information 12, the processing module 30 transmits the language command to the language module 20, and the travel content obtained through the language module 20 The message 16 is converted into a language that conforms to the language command, and the processing module 30 combines the travel content message 16 with the converted language with the travel virtual image 15, and transmits it to the head-mounted display 3 through the smart mobile device 4 for display or by smart Type 4 mobile device display.

A playback control module 40, which has a playback unit 41, a speed unit 42, and a selection unit 43. The playback unit 41 provides setting playback, pausing or stopping the book information 11; the speed unit 42 provides setting playback The playback speed of the book information 11; the selection unit 43 provides options for setting and playing one of the chapters of the book information 11 and selecting the context content option 111, wherein, through the selection unit 43, one of the chapters of the book information 11 is played At the same time, the contextual content options 111 of the corresponding chapters will be presented on the head-mounted display 3; furthermore, the selection unit 43 can provide setting whether to display the subtitle message 141 on the head-mounted display 3 or the smart mobile device 4.

A mode module 50, which is coupled to the database 10, the processing module 30, and the electronic display device. The mode module 50 displays on the electronic display device and provides the user 2 to set a book mode or a travel mode, as shown in FIG. 3 When the processing module 30 receives a mode signal generated by the user 2 selecting a book mode or a travel mode, it searches the database 10 for each book information 11 or each travel information 12 that matches the mode signal, and displays the corresponding content In the electronic display device (smart mobile device 4), that is, when the user 2 selects the book mode, a mode signal of the book mode will be generated, and the processing module 30 will display the information 11 of each book in the database 10 The smart mobile device 4 displayed on the electronic display device provides the user 2 to select one of the book information 11 to generate the corresponding reading instruction; if the user 2 selects the travel mode, the travel mode signal will be generated, and The processing module 30 displays each travel information 12 in the database 10 on the smart mobile device 4 of the electronic display device, and provides the user 2 to select one of the travel information 12 to generate a corresponding reading instruction.

For further description, please refer to Figures 2 to 10, the user 2 is connected to the cloud server via the Internet via the smart mobile device 4 to use the multilingual virtual reading and browsing system 100, and the mode module 50 is used in the smart mobile The device 4 displays and provides the user 2 to set a book mode or a travel mode. When the processing module 30 receives the mode signal generated by the user 2 selecting the book mode or the travel mode, the processing module 30 searches the database 10 for matching Each book information 11 or each travel information 12 of the mode signal, and the corresponding content is transmitted to the head-mounted display 3 through the smart mobile device 4 for display or displayed by the smart mobile device 4.

If the user 2 selects the book mode, the processing module 30 will display each book information 11 stored in the database 10 on the smart mobile device 4, and the user 2 can select one of the book information 11 according to the needs and use it The second selection will also generate a reading instruction, and the user 2 can select the language to be presented; then, the processing module 30 will search the database 10 according to the reading instruction, and obtain the corresponding book information 11, and then extract the corresponding book The virtual image 13 of the book in the information 11 and the associated book content information 14, and then the processing module 30 will also send the language instruction to the language module 20, and the acquired book content information 14 will be converted into a language instruction conforming to the language instruction through the language module 20 Language; then, the processing module 30 sends the converted language book content information 14 with the virtual book image 13 to the smart mobile device 4, and then sends it to the head-mounted display 3 for display or by the smart mobile device through the smart mobile device 4 4 displays, and the user 2 can browse through the head-mounted display 3 or the image projected by the smart mobile device 4. During the reading process, before the start of each chapter, the context content options of the chapter 111 will Presented on the head-mounted display 3 or the smart mobile device 4, the user 2 can select one of the context content options 111 through the smart mobile device 4, and the virtual image 13 of the book corresponding to the selected context content option 111 and the associated book content information 14 will be displayed on the head-mounted display 3 or projected by the smart mobile device 4. In this way, the context can be changed to view the context of different combinations of books.

When the user 2 views the selected book information 11 through the head-mounted display 3 or the smart mobile device 4, the playback unit 41 of the playback control module 40 can control whether the book information 11 is played or not, and the speed can also be used The unit 42 adjusts the playback speed of the book information 11, wherein the user 2 can further directly set and play one of the chapters of the book information 11 through the selection unit 43, and when the selected chapter is displayed, it matches the context of the chapter The content options 111 will be presented on the head mounted display 3 or smart mobile device 4 for projection. The user 2 can select one of the context content options 111 through the smart mobile device 4, and the virtual image 13 and the book corresponding to the selected context content option 111 The matched book content information 14 will be presented on the head-mounted display 3 or the smart mobile device 4. In particular, if the user 2 selects the travel mode, the processing module 30 can follow the aforementioned method to display the selected travel information 12 For electronic display devices.

An editing module 60 coupled to the database 10, the editing module 60 is used to create new book information 11 in the database 10, or edit the book information 11 stored in the database 10, The user 2 can control the editing module 60 through the electronic display device, and add the book information 11 and the virtual book image 13 corresponding to the book information 11 and the book content information 14 in the database 10 through the editing module 60 , Or modify and edit the book information 11 and the book virtual image 13 and the book content information 14 corresponding to the book information 11 that have been stored in the database 10.

In addition, the editing module 60 is used to create the new travel information 12 in the database 10, or edit the travel information 12 stored in the database 10. The user 2 can control the editing mode through the electronic display device. The group 60 adds the travel information 12 and the travel virtual image 15 and travel content information 16 corresponding to the travel information 12 to the database 10 through the editing module 60, or for the travel that has been stored in the database 10 The information 12 and the travel virtual image 15 corresponding to the travel information 12 and the travel content information 16 are modified and edited.

In summary, the present invention can achieve the following effects:

1. The present invention can present the scene and context of the book to the eyes of the user 2 as the virtual image 13 of the book, so that the user 2 can experience the scene of the book during the reading process, and increase the realism and vividness of reading.

2. The present invention can switch between various languages and provide users 2 to choose the language they need to read, so as to be suitable for users 2 of different language families. At the same time, it can also provide users 2 to choose the language they want to learn, so as to achieve the language learning. The effect further increases the practicability and versatility of the present invention.

3. The audio message and subtitle message 141 of the present invention can be continuously connected to each other with the virtual book image 13; thereby, the book information 11 can cooperate with the virtual book image 13 smoothly and uninterruptedly, and is provided to the user 2 like an animation, thereby increasing learning , Reading and leisure fun.

4. The present invention has multiple chapters in the book information 11 and a contextual content option 111 for each chapter, so that the user 2 can choose different contextual trends. In this way, different contexts of the book can be combined to increase reading The interactivity, innovation and uniqueness of time.

5. The playback control module 40 of the present invention can provide the user 2 to adjust the reading status according to the reading needs, and can also adjust the reading speed according to the reading habits, so as to increase the controllability of reading.

6. The editing module 60 of the present invention allows the user 2 to adjust the book content to create different book content, thereby increasing the interactivity, innovation and uniqueness of reading.

7. The present invention can present the travel scene and travel experience in front of the user 2 as a virtual image, providing the user 2 in the experience process, feeling like being in the environment, and increasing the depth of travel experience.

8. The present invention can provide the user 2 to choose to read classic books or travel books, so that the user 2 can not only experience the contents of the books, but also travel experience, effectively increasing the breadth of use.

The above-mentioned embodiments are only used to illustrate the present invention, and are not used to limit the scope of the present invention. All modifications or changes made without violating the spirit of the present invention fall within the scope of the present invention's intended protection.

1: Cloud server 2: User 3: Head-mounted display 4: Smart mobile device 100: Multilingual virtual reading and tour system 10: Database 11: Book information 111: Context content options 12: Travel Information 13: Virtual images of books 14: Book content information 141: Subtitle message 15: Traveling virtual image 16: Travel content information 161: Subtitle Message 20: Language Module 30: Processing module 40: Play control module 41: playback unit 42: Speed unit 43: select unit 50: Mode module 60: Edit Module

Figure 1 is a schematic diagram of the connection of the present invention. Figure 2 is a system architecture diagram of the present invention. Fig. 3 is a schematic diagram (1) of an embodiment of the present invention, showing that the user selects the book mode. FIG. 4 is a schematic diagram (2) of the embodiment of the present invention, showing that the user selects one of the book information. FIG. 5 is a schematic diagram (3) of an embodiment of the present invention, showing that a user browses book information through an electronic display device. FIG. 6 is a schematic diagram (4) of an embodiment of the present invention, showing that a virtual image of a book is displayed on an electronic display device using virtual reality technology. FIG. 7 is a schematic diagram (5) of an embodiment of the present invention, showing that virtual images of books are displayed on an electronic display device using augmented reality technology. Fig. 8 is a schematic diagram (6) of the embodiment of the present invention, showing that the user selects the travel mode. FIG. 9 is a schematic diagram (7) of an embodiment of the present invention, showing that a travel virtual image is displayed on an electronic display device using virtual reality technology. FIG. 10 is a schematic diagram (8) of an embodiment of the present invention, showing that a virtual travel image is displayed on an electronic display device using augmented reality technology.

100: Multilingual virtual reading and tour system

20: Language Module

10: Database

30: Processing module

11: Book information

40: Play control module

12: Travel Information

41: playback unit

13: Virtual images of books

42: Speed unit

14: Book content information

43: select unit

15: Traveling virtual image

50: Mode module

16: Travel content information

60: Edit Module

Claims (9)

A multilingual virtual reading and tour system, which is set up on a cloud server, and the user connects to the cloud server through an electronic display device network to use the multilingual virtual reading and tour system; the multilingual virtual reading The navigation system includes: a database for storing plural book information, each book information having plural book virtual images and book content information corresponding to one of the book virtual images, wherein each book information is divided into plural chapters, Each chapter is provided with a plurality of context content options, each of the context content options is displayed on the electronic display device in conjunction with the virtual image of the book, and provides settings and generates a context content command; a language module that provides settings for the The language of the book content information display; and a processing module that receives a reading command and a language command for selecting one of the book information sent from the electronic display device, wherein the processing module searches the database according to the reading command , To obtain the corresponding book information, and extract the book virtual image and the book content information corresponding to the book information, the processing module transmits the language command to the language module, through the language module The group converts the acquired book content information into a language that conforms to the language instruction, and the processing module displays the converted language of the book content information with the book virtual image on the electronic display device; the processing module is based on The context content command searches the database to obtain the virtual image corresponding to the book and the book content information. The multi-language virtual reading and tour system according to claim 1, wherein each book content message has plural audio messages and plural screen messages, and each audio message corresponds to the subtitle message and the virtual image of the book, so The audio message and the subtitle message can be continuously connected to each other in conjunction with the virtual image of the book. As described in claim 1, the multi-language virtual reading and tour system has a playing operation The control module has a playback unit and a speed unit. The playback unit provides setting playback, pause or stop of the book information; the speed unit provides setting playback speed of the book information. The multi-language virtual reading and tour system according to claim 3, wherein the playback control module further has a selection unit, and the selection unit provides setting to play one of the chapters of the book information; and play the book information One of the chapters also displays the content options of the context. The multi-language virtual reading and tour system according to claim 4, wherein the selection unit provides for controlling the subtitle information to be displayed on the electronic display device. The multi-language virtual reading and tour system according to claim 1, wherein the virtual book image is a virtual reality image or an augmented reality image. For example, the multi-language virtual reading and browsing system described in claim 1 further has an editing module for creating new information about the book in the database or editing the book stored in the database News. The multi-language virtual reading and tour system according to claim 1, wherein the database stores plural travel information, each of the travel information has plural travel virtual images and travel content information corresponding to one of the travel virtual images; the language model The group provides the language for setting the display of the travel content information; the processing module receives a reading instruction and a language instruction for selecting one of the travel information sent from the electronic display device, and the processing module searches the database according to the reading instruction , In order to obtain the corresponding travel information, and extract the travel virtual image and the travel content information corresponding to the travel information, the processing module transmits the language command to the language module, through the language module The group converts the obtained travel content information into a language that conforms to the language instruction, and the processing module displays the travel content information after the language conversion with the travel virtual image on the electronic display device. The multi-language virtual reading and tour system described in claim 8 has a mode A module, which provides setting of a book mode or a travel mode, the processing module receives a mode signal generated by selecting the book mode or the travel mode, and the database matches the book information or each of the mode signals The travel information is displayed on the electronic display device.

Images