TW201333753A - Transparent display having real-scene tour-guide function - Google Patents

Abstract

A transparent display having a real-scene tour-guide function is adapted for a vehicle having a transparent window. The transparent display determines if outside the vehicle there is a scenic spot having scenic-spot tour-guide information according to a positioning signal and geographic information. If yes, the transparent display adjusts a direction of capturing an image of a real scene according to a direction of a user head and fetches an image of the scenic spot from the image of the real scene so as to use augmented reality technology to generate a scenic-spot indicator corresponding to the image of the scenic spot and display the image of the scenic-spot indicator and the scenic-spot tour-guide information on transparent display. Accordingly, when a user looks out of the transparent display, he or she will see not only the real-scene outside the vehicle but also the image of the scenic-spot indicator and the scenic-spot tour-guide information corresponding to the scenic spot of the real-scene outside the vehicle so that it implements the real-scene tour-guide function in real time.

Description

Transparent display with real-life navigation

This invention relates to a transparent display, and more particularly to a transparent display incorporating augmented reality techniques.

The transparent display means that the display itself has a certain degree of transparency, allowing the user to view the image displayed on the display while still seeing the background behind the display to a certain extent. Currently, transparent displays are mainly used in applications that are not suitable for setting up displays, such as on shop windows to provide product information in the window, for use on bus or MRT windows to provide advertising or living information for use on car windshields. Provide navigation information. Of course, transparent displays can be used in existing applications such as televisions, monitors, notebook computers, and tablets, and thus have considerable applicability and growth potential.

Augmented Reality (AR) is a technology that combines real-world real-world images or images with corresponding virtual images on a display screen to combine and interact with virtual reality. At present, the AR technology can be roughly divided into two types: optical and video. The former is a transparent device. The user can directly see the real world through the transparent device, and then display or project the virtual image on the transparent device. It is an opaque device. The user sees a computer-processed image that combines real-world images and virtual images on the opaque device screen. AR technology can be widely used in geolocation, games, movies, browsers, shopping, social, advertising, education, life and other aspects.

It is an object of the present invention to provide a transparent display incorporating Augmented Reality (AR) technology that provides a live view navigation function on a transparent display.

In order to achieve the above object or other objects, the present invention provides a transparent display having a real-life navigation function suitable for a vehicle having a transparent window. The transparent display comprises a transparent display unit, a positioning receiving unit, a photographing unit, a storage unit, a head sensor and a processing unit, wherein the processing unit is electrically connected to the transparent display unit, the positioning receiving unit, the photographing unit, the storage unit and the head sensing Device. A transparent display unit is used to display images. The positioning receiving unit is configured to receive a positioning signal. The photography unit is used to instantly capture the real scene outside the vehicle. The storage unit is used for pre-existing maps, and the map includes a plurality of scenic guide information corresponding to the scenic spots, and the scenic guide information includes the name of the attraction, the introduction of the attraction, and the stereoscopic information of the scenic spot. The head sensor is used to sense the direction of the user's head. The processing unit is configured to determine, according to the positioning signal and the image, whether there is an attraction having sightseeing information outside the vehicle, and if yes, adjust the direction of the real scene taken by the camera according to the direction of the user's head sensed by the head sensor And determining an image of the scenic spot from the image of the real scene taken by the photographing unit to generate an attraction index corresponding to the image of the determined scenic spot by augmented reality (AR) technology, and controlling the transparent display unit to immediately display the scenic spot index And the image of the scenic guide information.

In an embodiment of the invention, the transparent display further includes a touch sensor, wherein the touch sensor is electrically connected to the processing unit. The touch sensor is for receiving a touch input from a user. The processing unit further controls the transparent display to perform an operation corresponding to the touch input according to the touch input.

In an embodiment of the invention, the transparent display further includes a brightness sensor and an auxiliary backlight, wherein the brightness sensor and the auxiliary backlight are electrically connected to the processing unit. A brightness sensor is used to sense the ambient light intensity outside the vehicle. The auxiliary backlight is used to activate the backlight to provide a secondary backlight to the transparent display unit when the processing unit determines that the ambient light intensity is insufficient.

In an embodiment of the invention, the transparent display further includes a wireless transmitter, wherein the wireless transmitter is electrically coupled to the processing unit. Wireless transmitters are used to provide audio navigation to users with wireless receivers.

The invention combines the geolocation, the augmented reality (AR) and the user's head-to-sense sensing technology to instantly display the image of the attraction index and the scenic guide information on the transparent display, so that the user will simultaneously see through the transparent display. The real-life and its scenic spots correspond to the sight indicators and the information of the scenic guide information, thus providing users with real-life navigation.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

1 is a circuit block diagram of a transparent display with a live view navigation function according to a preferred embodiment of the present invention. Referring to FIG. 1 , the transparent display 1 includes a transparent display unit 10 for displaying an image. The transparent display unit 10 is, for example, an Organic Light-Emitting Diode (OLED) display unit. The transparent display 1 is suitable for vehicles having transparent windows, such as attaching the transparent display unit 10 to a transparent window of a vehicle or directly as a transparent window to provide a user's live view function. The vehicle is preferably a vehicle with a fixed route, such as a land vehicle, a tour bus, a tram, a train, or the like, or a watercraft such as a yacht or a cruise ship, or an airplane, a helicopter, a balloon, an aerial cable car, and the like. Vehicles, or underwater vehicles such as submarines and underwater cable cars.

The transparent display 1 further includes a positioning receiving unit 11, a photographing unit 12, a storage unit 13, a head sensor 14, a processing unit 15, a touch sensor 16, a brightness sensor 17, an auxiliary backlight 18, and a wireless transmitter. 19, wherein the processing unit 15 is electrically connected to the transparent display unit 10, the positioning receiving unit 11, the photographing unit 12, the storage unit 13, the head sensor 14, the touch sensor 16, the brightness sensor 17, and the auxiliary backlight. 18 and wireless transmitter 19.

The positioning receiving unit 11 is configured to receive a positioning signal. The positioning receiving unit 11 is, for example, a positioning receiving unit that performs positioning using a satellite and/or an action base station. Among them, a system for positioning by satellite is, for example, a Global Positioning System (GPS), and a system for positioning using an action base station is, for example, a Global System for Mobile communications (GSM), using a satellite and an action base. The system for positioning the station is, for example, an Assisted Global Positioning System (AGPS).

The photographing unit 12 is used to instantly take in a real scene outside the vehicle. The photographing unit 12 is, for example, a Charge-Coupled Device (CCD) image sensor or a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor.

The storage unit 13 is configured to pre-store the maps, and the map includes a plurality of attraction guide information corresponding to the scenic spots. The attraction guide information includes information such as a name of the attraction, an introduction of the attraction, a stereoscopic information of the attraction, and the like for displaying on the transparent display unit 10, for example, the name of the attraction includes the Taipei 101 building, and the stereoscopic information of the attraction includes the use of each floor of the Taipei 101 building or Company line number name and its introduction. In addition, the attraction guide information further includes information such as the latitude and longitude of the attraction, the feature of the attraction, and the like for comparing to determine whether the real scene taken by the photographing unit 12 includes the scenic spot or the scenic spots, for example, the scenic spot features include a street, a building, and a mountain. Or contours and dimensions such as the sea. The storage unit 13 is, for example, a non-volatile memory such as an electrically erasable programmable read-only memory (EEPROM) or a flash memory.

The head sensor 14 is used to sense the direction of the user's head. The head sensor 14 is, for example, an in-vehicle CCD or CMOS image sensor that picks up the user's head and passes the judging unit to determine the direction of the user's head.

The processing unit 15 is configured to determine, according to the positioning signal received by the positioning receiving unit 11 and the image stored in the storage unit 13 when the real-time navigation function is activated, whether there is an attraction having the attraction navigation information outside the vehicle. If there is an attraction having the attraction information outside the vehicle, the processing unit 15 adjusts the direction of the real scene taken by the photographing unit 12 according to the direction of the user's head sensed by the head sensor 14 and is taken from the photographing unit 12. The image of the scenic spot is determined in the image of the real scene, and the scenic spot index corresponding to the image of the determined scenic spot is generated by the augmented reality (AR) technology, and the transparent display unit 10 is controlled to instantly display the scenic spot index and the scenic spot guiding information. The image allows the user to see the scene of the attraction and the name of the attraction corresponding to the scenic spot outside the vehicle through the transparent display unit 10, and the image of the attraction index and the name of the attraction and the scenic spot. Tight fit. If there is no attraction with the attraction navigation information outside the vehicle, the processing unit 15 of course does not further process, and continues to monitor whether there is an attraction with the attraction navigation information outside the vehicle.

The touch sensor 16 is configured to receive a touch input from a user. The touch sensor 16 is, for example, a capacitive touch sensor or a wave touch sensor, wherein the capacitive touch sensor is on a conductive layer coated with a thin glass of a transparent display unit 10 by a finger. The electric field generates capacitive coupling and absorbs a small current to sense. The wave touch sensor senses a standing wave pattern of sound waves or infrared rays that block the surface of the entire transparent display unit 10 by fingers or contacts. . The processing unit 15 further controls the transparent display 1 to perform an operation corresponding to the touch input according to the touch input received by the touch sensor 16, for example, when the user displays the image on the transparent display unit 10 with a finger or a contact. When clicking on the image of the attraction name, the processing unit 15 also controls the transparent display unit 10 to further display the image of the attraction introduction next to the name of the attraction.

The brightness sensor 17 is used to sense the ambient light intensity outside the vehicle. The auxiliary backlight 18 is used to activate the backlight to provide the auxiliary backlight to the transparent display unit 10 when the processing unit 15 determines that the ambient light intensity is insufficient.

The wireless transmitter 19 is used to provide an audio guide to a user who is equipped with a wireless receiver. The wireless transmitter 19 and the wireless receiver are, for example, a Bluetooth transmitter and a Bluetooth receiver, respectively, and the Bluetooth receiver is disposed on an audio navigation device such as a headset, and the user provides an audio guide with a Bluetooth receiver. The device receives an audio guide transmitted by the wireless transmitter 19.

In one embodiment, the vehicle is attached or directly employed with the transparent display 1 of the present invention on a transparent window for windshield in front of the driver's seat and on a transparent window adjacent to the passenger seat. At this time, all the transparent displays 1 disposed in front of the driver's seat and next to the passenger seat in the vehicle may share one positioning receiving unit 11 and one storage unit 13. The transparent display 1 provided in front of the driver's seat may have some main control functions, for example, the real-life navigation function for controlling all the transparent displays 1 provided beside the passenger seat is turned on or off. In order to avoid driver distraction, the live view function of the transparent display 1 provided in front of the driver's seat can be constantly turned off and the live view navigation function can be provided. The transparent display 1 disposed in front of the driver's seat has its camera unit 12 fixedly ingesting the front road condition, and its head is redirected to the sensor 14 to fix the driving situation with the image sensor so that the passenger can select and view through the respective transparent display 1. In front of the road and the driver's situation, it can help when the driver's situation is not normal.

2 is a control flow diagram of a transparent display with a live view navigation function according to a preferred embodiment of the present invention. Taking the transparent display 1 shown in FIG. 1 as an example, referring to FIG. 2, in step S21, the processing unit 15 determines whether the live view navigation function is activated. If the live view function is not activated, the processing unit 15 ends the flow. If the live view function is activated, the processing unit 15 performs step S22.

In step S22, the processing unit 15 determines whether there is an attraction having the attraction navigation information outside the vehicle according to the positioning signal received by the positioning receiving unit 11 and the image stored in the storage unit 13. If there is no attraction having the attraction guide information, the processing unit 15 of course does not perform further processing, and returns to step S21 to continue the flow. If there is an attraction having the attraction guide information, the processing unit 15 performs step S23.

In step S23, the processing unit 15 senses the ambient light intensity outside the vehicle according to the brightness sensor 17 to determine whether the ambient light intensity outside the vehicle is sufficient. If the ambient light intensity is insufficient, the processing unit 15 performs step S24 to activate the auxiliary backlight 18 to provide an auxiliary backlight to the transparent display unit 10, and then proceeds to step S25. If the ambient light intensity is sufficient, the processing unit 15 directly performs step S25.

In step S25, the processing unit 15 adjusts the direction in which the photographing unit 12 picks up the real scene according to the head direction of the user sensed by the head sensor 14. Next, in step S26, the processing unit 15 determines an image of the attraction from the image of the real scene taken by the photographing unit 12 to generate a corresponding sight indicator by the augmented reality (AR) technique. Next, in step S27, the processing unit 15 controls the transparent display unit 10 to instantly display the image of the attraction index and the attraction name. Here, the direction in which the photographing unit 12 takes in the real scene is adjusted according to the direction of the user's head, so that the image of the sight indicator and the name of the spot displayed by the transparent display unit 10 is closely matched with the sight.

Then, in step S28, the processing unit 15 receives the touch input from the user according to the touch sensor 16 to determine whether there is a touch input at the name of the spot displayed by the transparent display unit 10 immediately. If there is no touch input at the name of the attraction, the processing unit 15 returns to step S21 to continue the flow. If there is a touch input at the name of the attraction, indicating that the user clicks on the image of the name of the spot displayed by the transparent display unit 10 with the finger or the contact, the processing unit 15 performs step S29 to control the transparent display unit 10 at the scenic spot. The image of the attraction introduction is further displayed next to the name, and then returns to step S21 to continue the process.

3A and 3B show that the direction of the user's head is forward and outward, and FIGS. 4A and 4B are oblique directions of the user's head, and the real scene and the scenic spot corresponding to the scenic spot are seen through the transparent display of the present invention. Schematic diagram of the image of the tour guide information. Taking the transparent display 1 shown in FIG. 1 as an example, please refer to FIG. 3A and FIG. 3B at the same time, the wall panel 21 of the vehicle 2 is embedded with a transparent window 22 beside the passenger seat, and the transparent display unit 10 is attached to the transparent window. 22 on. When the user's head is facing outward, the user can see the real scene 31 behind the display through the transparent display unit 10 (in this embodiment, the attractions of the real scene 31 include the Taipei 101 building and the Taipei World Trade Center 1). The image 32 of the scenic spot index and the scenic spot guiding information corresponding to the scenic spot of the real scene 31 displayed on the transparent display unit 10 can also be seen (in the embodiment, the image 32 of the scenic spot index and the scenic spot guiding information includes the scenic spot index. Image 321 and image of the name of the attraction 322). At this time, the user actually sees through the transparent display unit 10 a real-life navigation screen 33 in which the real scene 31 and its scenic spot corresponding to the scenic spot and the scenic guide information 32 are superimposed.

In addition, when the user clicks on the image 322 of the scenic spot name displayed by the transparent display unit 10 with the finger or the contact, the processing unit 15 also controls the transparent display unit 10 to be in the name of the scenic spot according to the image stored by the storage unit 13 . An image 323 of the attraction introduction is further displayed next to the image 322, as shown in FIG. 3C. At this time, the image 32 of the attraction index and the scenic guide information includes the image 321 of the attraction index, the image 322 of the attraction name, and the image 323 of the attraction introduction.

Furthermore, when the user sets the attraction guide information displayed by the transparent display 1 to include the stereoscopic information of the attraction and sets only (but not limited to) the stereoscopic information about the attraction of the bank, the processing unit 15 is further configured according to the storage unit 13 The stored image control unit 10 further displays an image 324 of the bird's-eye view information and its corresponding image of the attraction index 321 as shown in FIG. 3D. At this time, the image 32 of the attraction index and the scenic guide information includes the image 321 of the scenic spot index, the image 322 of the scenic spot name, and the image 324 of the scenic spot stereo information.

Referring to FIG. 4A and FIG. 4B simultaneously, when the direction of the user's head is obliquely outward, the user can see the real scene 41 behind the display through the transparent display unit 10 (in the embodiment, the scenic spots of the real scene 31 include The Taipei 101 Building and the Taipei World Trade Center 1) can also see the image of the attraction index and the scenic guide information corresponding to the scenic spot 31 displayed on the transparent display unit 10 (in the present embodiment, the attraction index and The image of the scenic guide information 42 includes an image 421 of the attraction index and an image of the name of the attraction 422). At this time, the user actually sees through the transparent display unit 10 the real-life navigation screen 43 which is superimposed on the real scene 41 and the scenic spot index corresponding to the scenic spot and the scenic spot guide image 42 .

In summary, the present invention combines geolocation, augmented reality (AR), and user head direction sensing technology to instantly display an image of a sight indicator and an attraction guide information on a transparent display, so that the user transparently The display will also see the image of the scenic spot and the scenic spot information (such as the name of the attraction) corresponding to the real scene and its attractions, thus providing users with a real-life navigation function. In addition, the scenic spot navigation information displayed by the transparent display may also include the stereoscopic information of the scenic spot, so that the user can directly know the stereoscopic information of the scenic spot through the transparent display, thereby providing the user with a more intuitive real-life navigation function.

While the present invention has been described above in terms of the preferred embodiments thereof, it is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

1. . . Transparent display

10. . . Transparent display unit

11. . . Positioning receiving unit

12. . . Photography unit

13. . . Storage unit

14. . . Head sensor

15. . . Processing unit

16. . . Touch sensor

17. . . Brightness sensor

18. . . Auxiliary backlight

19. . . Wireless transmitter

2. . . Transportation

twenty one. . . Siding

twenty two. . . Transparent window

31, 41. . . Real scene

32, 42. . . Image of scenic spots and attractions guide information

321,421. . . Image of scenic spots

322, 422. . . Image of the name of the attraction

323. . . Image of scenic spots

324. . . Sightseeing stereo image

33, 43. . . Real-life navigation screen

S21. . . Whether the live view function is activated

S22. . . Is there any attraction outside the vehicle?

S23. . . Is the ambient light intensity outside the vehicle sufficient?

S24. . . Start auxiliary backlight

S25. . . Adjust the direction of the live view taken by the camera unit according to the direction of the user's head

S26. . . Judging the image of the scenic spot from the image of the real scene taken to generate the corresponding scenic spot index through the augmented reality technology

S27. . . Control the transparent display unit to instantly display the image of the sight indicator and the name of the attraction

S28. . . Is there a touch input at the name of the attraction?

S29. . . The control transparent display unit also displays the image of the attraction introduction

1 is a circuit block diagram of a transparent display with a live view navigation function according to a preferred embodiment of the present invention.

2 is a control flow diagram of a transparent display with a live view navigation function according to a preferred embodiment of the present invention.

FIG. 3A and FIG. 3B are schematic diagrams showing images of the real and the scenic guide information seen by the user's head in the forward direction and through the transparent display of the present invention.

FIG. 3C and FIG. 3D are respectively schematic diagrams showing an image of a scenic spot and a stereoscopic information of a scenic spot of the transparent display of the present invention.

4A and 4B are schematic diagrams showing images of the real scene and the scenic spot navigation information seen obliquely outward from the user's head and through the transparent display of the present invention.

1. . . Transparent display

10. . . Transparent display unit

11. . . Positioning receiving unit

12. . . Photography unit

13. . . Storage unit

14. . . Head sensor

15. . . Processing unit

16. . . Touch sensor

17. . . Brightness sensor

18. . . Auxiliary backlight

19. . . Wireless transmitter

Claims (10)

A transparent display with a real-life navigation function, suitable for a vehicle having a transparent window, the transparent display comprising:
a transparent display unit for displaying an image;
a positioning receiving unit, configured to receive a positioning signal;
a photographing unit for instantly taking in a real scene outside the vehicle;
a storage unit for pre-storing a picture, the picture includes a plurality of scenic guide information corresponding to the scenic spot, the attraction information includes the name of the attraction, the introduction of the attraction and the stereoscopic information of the attraction;
a head sensor for sensing a direction of a user's head; and a processing unit electrically connecting the transparent display unit, the positioning receiving unit, the photographing unit, the storage unit, and the head sensor for Determining, according to the positioning signal and the map, whether there is an attraction having sightseeing information outside the vehicle, and if so, adjusting the direction of the user's head sensed by the head to the sensor to adjust the actual scene taken by the photographing unit. Direction, and determining an image of the scenic spot from the image of the real scene taken by the photographing unit to generate an attraction index corresponding to the image of the determined scenic spot by augmented reality technology, and controlling the transparent display unit to immediately display the scenic spot index And the image of the scenic guide information. The transparent display having the real-life navigation function as described in claim 1 further includes a touch sensor electrically connected to the processing unit for receiving a touch input from the user, the processing unit further And controlling the transparent display to perform an operation corresponding to the touch input according to the touch input. The transparent display with the real-life navigation function as described in claim 1 further includes a brightness sensor and an auxiliary backlight electrically connected to the processing unit, wherein the brightness sensor is used to sense the vehicle. An ambient light intensity, the auxiliary backlight is configured to be activated to provide an auxiliary backlight to the transparent display unit when the processing unit determines that the ambient light intensity is insufficient. A transparent display having a live view function as described in claim 1 of the patent application, further comprising a wireless transmitter electrically connected to the processing unit for providing an audio guide to a user who is equipped with a wireless receiver. A transparent display having a live view function as described in claim 1 wherein the vehicle is a vehicle having a fixed route. A transparent display having a live view function as described in claim 1 wherein the vehicle is a land, water, air or underwater vehicle. A transparent display having a real-life navigation function as described in claim 1, wherein the transparent display unit is an organic light-emitting diode display unit. A transparent display having a real-life navigation function as described in claim 1, wherein the positioning receiving unit is a positioning receiving unit that uses a satellite and/or a mobile base station for positioning. A transparent display having a real-life navigation function as described in claim 1, wherein the photographing unit is a charge coupled device or a complementary metal oxide semiconductor image sensor. The transparent display having the real-life navigation function as described in claim 1, wherein the touch sensor is a capacitive or wave touch sensor.