WO2022128202A1 - An entertainment system for a motor vehicle and method thereof - Google Patents

An entertainment system for a motor vehicle and method thereof Download PDF

Info

Publication number
WO2022128202A1
WO2022128202A1 PCT/EP2021/078289 EP2021078289W WO2022128202A1 WO 2022128202 A1 WO2022128202 A1 WO 2022128202A1 EP 2021078289 W EP2021078289 W EP 2021078289W WO 2022128202 A1 WO2022128202 A1 WO 2022128202A1
Authority
WO
WIPO (PCT)
Prior art keywords
motor vehicle
transparent display
picture
motion signal
interactive
Prior art date
Application number
PCT/EP2021/078289
Other languages
French (fr)
Inventor
Fook Wai LEE
Arvind DUBEY
Kuan Fang Henry Lim
Jason Choon Leng TAN
Chee Wei LEE
Original Assignee
Continental Automotive Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive Gmbh filed Critical Continental Automotive Gmbh
Publication of WO2022128202A1 publication Critical patent/WO2022128202A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/38—Releasing-devices separate from shutter
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/001—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles integrated in the windows, e.g. Fresnel lenses
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0229—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
    • B60R11/0235—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes of flat type, e.g. LCD
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
    • B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
    • B60R2011/0026—Windows, e.g. windscreen
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/101—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using cameras with adjustable capturing direction
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used

Definitions

  • This disclosure relates to motor vehicles and in particular to an entertainment system of a motor vehicle.
  • Motor vehicles are typically installed with glass on various parts of the vehicle body to function as windows.
  • vehicle windows are a form of restrain system, to shield occupants seating within the motor vehicle from bad weather and to keep debris out of the motor vehicle while allowing visibility.
  • Conventional vehicle windows are made of glass which has been treated, for example tempered glass, which is also known as safety glass. In the event of traffic accident, vehicle windows will shatter into small, round pieces, to prevent causing injuries to the occupants in the motor vehicle.
  • motor vehicle widows may help to provide ventilation during hot weather, or when the heating, ventilation, and air conditioning (HVAC) system is not functioning.
  • HVAC heating, ventilation, and air conditioning
  • An alternative source of entertainment during road trips may be vehicle infotainment system.
  • loud music may be enjoyable for passengers, it may pose a danger to a driver who needs to focus on the road.
  • a microcontroller operable to o identify a motion signal and o execute a command to take a picture based on the motion s ignal identified, wherein the interactive transparent display is further operable to
  • An advantage of the above described aspect of this di sclosure yields an entertainment system for implementation in a motor vehicle having an interactive transparent display for providing a view outside the motor vehicle, for taking pictures. Therefore, the entertainment system disclosed provides entertainment to the motor vehicle passengers during road trips. Since the integrated transparent display allows a viewer to view outside the motor vehicle, the integrated transparent display also operates as a motor vehicle window.
  • the advantage of the above aspect of this disclosure is to utilize the integrated transparent display as an interface to receive motion signals from a user, to execute a function of taking a picture.
  • the content of the picture may be a scene outside the motor vehicle, or at least a part of (e.g. a subject of interest) the scene outside the motor vehicle, which the user may crop out using motion signals received by the integrated transparent display.
  • the content or a subject of interest to be cropped out may be defined by coordinates of the motion signal received by the integrated transparent display.
  • An example of a subject of interest may be an object, a building, or a person within the view outside the motor vehicle.
  • the advantage of the above aspect of this disclosure is a confirmation feature by the entertainment system, to display a picture taken or a resultant picture according to the motion signal received by integrated transparent display, as a confirmation the picture taking task is completed.
  • the advantage of the above aspect of this disclosure is to allow the user to magnify, (i.e. to zoom-in) or minimize (i.e. to zoom-out) the subject of interest displayed on the interactive transparent display, to provide different photography or cinematography applications, thereby heightening user' s experience .
  • the advantage of the above aspect of this disclosure is to allow the user to swivel the image sensing device such that the resultant picture changes orientation in different position, direction, or angle.
  • the advantage of the above aspect of this disclosure is to allow the user to swivel or adjust a spatial arrangement of the at least one image sensing device, to achieve different photography and/or cinematography applications, for example rolling, panning and tilting. Therefore, functionality of the entertainment system is increased .
  • the interactive transparent display further comprises
  • the advantage of the above aspect of this disclosure is to create a display area (i.e. an area of the digital mirror) for displaying the resultant picture on the interactive transparent display.
  • the resultant picture displayed on the digital mirror may provide a confirmation step.
  • the advantage of the above aspect of this disclosure yields an entertainment system for implementation in a motor vehicle which allows picture taking to produce still pictures, i.e. non-moving images such as a photo, or a motion pictures such a video clips.
  • a transparent sheet may be a sheet of glass used as vehicle window glass.
  • the vehicle window glass may be replaced or modified to achieve an integrated transparent display to provide entertainment.
  • the advantage of the above aspect of this disclosure enables capturing images of a view outside on either side of the motor vehicle, such that photography and/or cinematography applications can be applied, thereby achieving augmented reality in real-time .
  • the advantage of the above aspect of this disclosure enables capturing images of a rearview of the motor vehicle, such that photography and/or cinematography applications can be applied, thereby achieving augmented reality in real-time.
  • the motor vehicle comprises: a passenger car; an aircraft; a trailer; a truck; a train, a bus, a yacht, or a vessel.
  • the interactive transparent display comprises :
  • the advantage of the above aspect of this disclosure enables replacement of existing vehicle windows with an interactive transparent di splay, or modification of an existing sheet of gla s s ( used as a vehicle window glas s ) by providing an additional transparent touchs creen display layer .
  • the obj ective of this di sclosure is solved by a method for operating an entertainment system implemented in a motor vehicle , preferably according to a method for operating an entertainment system implemented in a motor vehicle according to any one of the preceding claims , comprising : providing a view outside the motor vehicle through an interactive transparent display; executing detecting a motion signal on the interactive transparent di splay, wherein the motion signal triggers the executing a command to carry out taking a picture containing the view outs ide the motor vehicle ; and displaying an image resulting from the command to carry out taking a picture , a s defined by the motion signal executed on the interactive transparent display .
  • An advantage of the above described aspect of this disclosure yields a method of operating an entertainment system implemented in a motor vehicle , the method for taking pictures of a view outside the motor vehicle , to solve the problem of boredom during road trips .
  • Fig 1. shows a system block diagram of an entertainment system in accordance to a preferred embodiment.
  • Fig. 2a shows an exemplary embodiment of an entertainment system in accordance to a preferred embodiment.
  • Fig. 2b shows an exemplary embodiment of an image captured by an entertainment system in accordance to a preferred embodiment.
  • Fig. 3a shows a top view of a motor vehicle in accordance to a preferred embodiment.
  • Fig. 3b shows an image outside in accordance to a preferred embodiment .
  • Fig. 4 shows a perspective view of a motor vehicle in accordance to a preferred embodiment.
  • Fig. 5 shows an exemplary image sensing device having different orientations .
  • Fig. 6 shows an exemplary system workflow diagram in accordance to a preferred embodiment.
  • a transparent display refers to a display apparatus having transparent properties, such that background of the display apparatus are observable.
  • a transparent display apparatus allows the user to see both the image displayed from the display apparatus and the background view behind the display apparatus, i.e. the background behind the transparent display apparatus can be seen through. This is because a transparent display apparatus transmits incident light rays onto a back surface of the transparent display apparatus directly to a viewer' s eye due to light transmittance. Since the light incident onto the back surface is transmitted directly to the user's eye, the user can see an object beyond the back surface, thus achieving see-through effect.
  • a liquid-crystal display uses two polarizing plates, the liquid-crystal display has low transmittance, so that it is difficult to be used as a transparent display apparatus.
  • a suitable type of display for manufacturing a transparent display will be realized by using an organic light-emitting display device (OLED) capable of self -emitting .
  • OLED organic light-emitting display device
  • Such a transparent display apparatus may function as a glass-like surface, while at the same time, provide desired information to a user. Therefore, the term “interactive display” refers to display apparatus enabled with touchscreen interaction.
  • the term “interactive transparent display” refers to a transparent display having transparent properties, with enabled with touchscreen interaction.
  • a transparent display apparatus has a transparent display, wherein the transparency of the display is defined by the percentage of light which hits the surface of the display vertically, wherein the transmittance is preferably in the range between 5% and 90% more preferably between 10% and 85%, even more preferably 15% and 80%, in particular more preferable 20 % and 75%, most preferable 25% and 70%.
  • the transparent display is defined by a percentage of transmittance within a range preferably between 20% to 30%, more preferably 23% - 28% and most preferably 25%.
  • positions suitable for placement of transparent display falling within the aforesaid ranges includes a motor vehicle window on a rear side of a motor vehicle, a motor vehicle sunroof and/or a vehicle windshield on a rear side of a motor vehicle.
  • the transparent display is defined by a percentage of transmittance within a range preferably between 65% and 75%, more preferably 68% and 72% and most preferably 70%.
  • positions suitable for placement of transparent display falling within the aforesaid ranges includes a motor vehicle front windshield and/or motor vehicle windows on a front side of a motor vehicle.
  • a signal refers to an electrical pulse or electrical wave to be transmitted or received, while “motion” an act or movement by at least a part of a body. Examples of motion includes a pinching motion, a spreading motion, a point-and-drag motion, a tapping motion, or a circling motion.
  • motion signal may include a hand movement, a gesture, a touch received by an input peripheral, that is converted into electrical pulse and transmitted to the entertainment system to convey an information or message, for e.g. a command.
  • the term “microcontroller” may refer to a combination of processing devices, e.g a combination of a DSP and a microprocessor such as a graphics processor, or any other such configuration as required.
  • coordinates denotes a set of values that shows an exact point, line, or position.
  • the term “coordinates” refers to an area or location defined by a motion or movement contacted on a user interface, for example a touchscreen. Therefore, the term “coordinates defined by a motion signal” refers to an area contacted by a user on a user interface.
  • the area contacted by a user on a user interface may be a motion contacting a surface of the user interface, such as using two or more fingers to create a pinching motion using two or more fingers to create a spreading out motion and so forth.
  • the system block diagram 100 includes an interactive transparent display 102, at least one image sensing device 108 and a microcontroller 112.
  • the interactive transparent display 102 provides a view of a background of the interactive transparent display 102, due to its transparent properties.
  • the image sensing device 102 captures one or more images of the background of the interactive transparent display 102. Examples of suitable image sensing device includes a camera or an image sensor.
  • the microcontroller 112 may be programmed to identify a motion signal and execute a command to take a picture based on the motion signal identified. A viewer may input a motion signal through the interactive transparent display 102.
  • the in- teractive transparent display 102 works as an interface for receiving motion signals to execute a command to take a picture of at least a part of the background of the interactive transparent display 102, which may be viewed through the interactive transparent display 102 due to its transparent properties .
  • the interactive transparent display 102 may be made up of a transparent sheet 104, for example a sheet of glass and a transparent touchscreen display layer.
  • a suitable type of display layer will be an OLED display layer.
  • the interactive transparent display 102 possess transparent properties, it can be used as a glass or window when the display function is an inactive mode.
  • microcontroller 112 may further comprises a graphics processor 116, which function to process graphical images captured by the image sensing device 108, for example, applying filters, post-image processing to improve quality of image or picture taken.
  • the microcontroller 112 interprets and identify the motion signals received on the interactive transparent display 102 to execute a command to take a picture based on the one or more images captured by the image sensing device 108.
  • the microcontroller 112 is part of the entertainment system 100.
  • the microcontroller 112 is part of a separate system, which may transmit the information to the entertainment system through a network protocol suitable for motor vehicle. Examples of suitable network protocols include Controller Area Network (CAN) bus, Local Interconnect Network (LIN) and FlexRay, but shall not be limited thereto.
  • CAN Controller Area Network
  • LIN Local Interconnect Network
  • FlexRay but shall not be limited thereto.
  • the entertainment system 200a include amongst others, an interactive transparent display 202 provided as a motor vehicle window.
  • an interactive transparent display 202 When viewed from inside passenger cabin of a motor vehicle, a viewer may observe a view outside the motor vehicle through the interactive transparent display 202, due to the transparent properties of the interactive transparent display 202.
  • the interactive transparent display 202 function as an interface to receive motion signals from a viewer, to crop an image out of the view outside the motor vehicle, of which the image is viewed through the interactive transparent display 102.
  • a subject of interest 204 which is defined by coordinates of the motion signal received on the interactive transparent display 202, is cropped.
  • the term "subject of interest” may include an object, a scenery, or a person within the view outside the motor vehicle.
  • a display region of the resultant picture 206 corresponds to an active region of a digital mirror 114 of the interactive transparent display 102, as shown in Fig. 1.
  • the aforesaid configuration yields an entertainment system for implementation in a motor vehicle having an interactive transparent display for providing a view outside the motor vehicle, for taking pictures.
  • the integrated transparent display also operates as a motor vehicle window, due to the transparent properties of the integrated transparent display.
  • a motion signal executes a command to magnify a subject of interest 204 displayed or viewed through the interactive transparent display 202, to zoom-in on specific object, scenery or person outside the motor vehicle.
  • the magnified image may be displayed on the interactive transparent display 202 as a resultant picture 206.
  • a separate motion signal is required to take a picture of the magnified image.
  • the viewer takes a picture (as illustrated in Fig. 2a) and magnify the resultant picture 206 after the resultant picture is displayed on the interactive transparent display 202.
  • an example of a suitable motion signal may be using two or more fingers to open out or increasingly extend an area on the interactive transparent display 202, to crop an image out of the view outside the motor vehicle, of which a resultant picture 206' shows a subject of interest which is magnified, as shown in Fig. 2b.
  • a motion signal executes a command to minimise the subject of interest 204 to zoom-out the subject of interest such that it appears smaller compared to the view outside of the motor vehicle.
  • the minimised image may be displayed on the interactive transparent display 202 as a resultant picture 206.
  • the viewer may execute another motion signal to take a picture of the minimised image.
  • the viewer takes a picture (as illustrated in Fig. 2a) and minimise the resultant picture 206 after the resultant picture is displayed on the interactive transparent display 202.
  • an example of a suitable motion signal may be using two or more fingers to close-in or increasingly reduce an area on the interactive transparent display 202, to crop an image out of the view outside the motor vehicle.
  • An advantage of enabling a viewer to magnify and/or minimise the subject of interest or a resultant picture 206 allows the viewer to style the pictures or focus on specific objects, scenery, or person to heighten photography experience. It shall be understood by a skilled practitioner, different motion signals received by the interactive transparent display may still execute the same functions as disclosed above, without departing from the scope and spirit of this disclosure.
  • the interactive transparent display may also operate as a window of a motor vehicle when the display is in an inactive mode, to provide a view outside the motor vehicle.
  • the term "motor vehicle” shall encompass transportations capable of ferrying passengers, for example, a passenger car, a trailer, a bus, an aircraft, a train, a yacht and a vessel, all of which has one or more windows for viewing outside the motor vehicle.
  • the microcontroller 112 may be part of the entertainment system 100, 200a, 200b or in a separate system within the motor vehicle as described above.
  • Fig. 3a shows a top view of a motor vehicle 300a in accordance to a preferred embodiment.
  • the motor vehicle 300a comprises a motor vehicle window 302, a motor vehicle roof top with at least a portion of the motor vehicle rooftop having a window or a sunroof 304, a motor vehicle windshield 306, 306' and side rear view mirrors 308, 308' , all of which are parts of a motor vehicle body which may be installed with an interactive transparent glass display as disclosed herein.
  • the interactive transparent display comprises a transparent sheet and a transparent touchscreen display layer.
  • the transparent sheet may be a sheet of glass or tempered glass.
  • the vehicle glass is coupled with a transparent touchscreen display layer.
  • the transparent touchscreen display layer comprises touch sensors to receive the motion signals.
  • touch sensors includes capacitive touch sensor or optoelectronic sensor to detect finger or hand contact points on the interactive transparent display.
  • the side rear view mirrors 308, 308' is replaced with an image sensing device 310.
  • the image sensing device 310 is operable to capture one or more images outside the motor vehicle 300a.
  • the image sensing device 310 captures one or more images outside the motor vehicle 300a, and particularly behind the motor vehicle 300a.
  • An advantage of using the rear-view mirror 308, 308' is to capture images or scenery behind the motor vehicle 300a.
  • Fig. 4 shows a perspective view of a motor vehicle in accordance to a preferred embodiment, of which the motor vehicle 402 comprises vehicle glass located at motor vehicle window 404, a motor vehicle roof top with at least a portion of the motor vehicle rooftop having a window or a sunroof 406, a motor vehicle windshield 408, 408' and side rear view mirrors 308, 308' .
  • the aforesaid locations of vehicle glass are parts of a motor vehicle body which may be installed with an interactive transparent display as disclosed herein.
  • Suitable locations for installing or embedding one or more image sensing device 410, 410' , 410' ' in a motor vehicle 403 includes a frame of the vehicle glass locations, for example a frame for holding a glass of a windshield, a frame for holding a glass of a vehicle window or a frame for holding a glass of a sunroof. It shall be understood by a skilled practitioner that the position of the image sensing devices are non-limiting, and the image sensing devices may be positioned along a peripheral of the frame as indicated in dotted lines, for capturing images outside the motor vehicle without departing from the scope and spirit of this disclosure.
  • the present disclosure provides an advantage of flexibility to the implementation of the en- tertainment system, since the interactive transparent display may replace any vehicle glass and the image sensing device may be located at any position along a frame holding the interactive transparent display.
  • Fig. 5 shows an exemplary image sensing device 500 operable to change different orientations.
  • the image sensing device is equipped with a positioner system for position tracking, to adjust direction of a field of view (FOV) of the image sensing device, namely pan 502, i.e. moving the FOV of the image sensing device at 180 degrees to a vertical plane, tilt 504, i.e. moving the FOV of the image sensing device at a 90 degrees to a horizontal plane) , and roll 506, i.e. rotating the FOV of the image sensing device through an angle of 360 degrees.
  • FOV field of view
  • This function enables changing the orientation of the subject of interest or the resultant picture 206, 206' according to the motion signal received by the interactive transparent display 102, 202 as explained in Fig. 1 and Fig. 2a above, for example to re-focus or re-select a subject of interest as well as magnify or minimize the subject of interest.
  • allowing the viewer to change orientation of the view outside the motor vehicle and resizing the pictures taken increases functionality of the entertainment system.
  • the image sensing device 108 may capture the images continuously, frequently or when the entertainment is activated, according to design specification.
  • the image sensing device 500 may continuously or without interruption, capture images of the view outside the motor vehicle throughout the motor vehicle' s journey. However, if a motion signal is received, the microcontroller 112 of the entertainment system executes a command correspond to the motion signal identified.
  • the image sensing device 500 frequently captures the view outside the motor vehicle in a fixed cycle, for example at every two hours interval, every three hours interval, every four hours interval and so forth.
  • the image sensing device 500 begins capturing one or more images of the view outside the motor vehicle when the interactive transparent display 102,202 is activated.
  • Fig. 6 shows an exemplary system workflow diagram 600 in accordance to a preferred embodiment.
  • the interactive transparent display 102, 202 operates as a window, or the interactive transparent display 102, 202 is in an inactive mode.
  • a motion signal is received by the interactive transparent display 102, 202, thus activating the interactive transparent display 102, 202 to operate as an interface for the entertainment system 100, 200a, 200b.
  • a viewer input a motion signal to crop a subject of interest within a view of the outside motor vehicle displayed on the interactive transparent display 102, 202 to take a picture, at 612.
  • the microcontroller 112 adjusts at least one image sensing device 108, to correspond to the motion signal identified, and execute a command to take a picture of the subject of interest, according to the coordinates defined by the motion signal.
  • a viewer input a motion signal to magnify a subject to interest showing on the interactive transparent display 102, 202, at 606.
  • the microcontroller 112 adjusts at least one image sensing device 108, to correspond to the motion signal identified, and execute a command to magnify the subject of interest, according to the coordinates defined by the motion signal.
  • the viewer then repeats a motion signal for cropping an image of the subj ect of interest to take a picture .
  • a resultant picture i . e . the picture taken is displayed on the interactive transparent display 102 , 202 upon executing the command to take a picture by the microcontroller 112 .
  • the resultant picture may be a still image such as a picture , or a motion image such as a video clip , depending on the settings of the one or more image sensing device .
  • the microcontroller 112 interprets that there is no intention to continue using the exertainment system 100 , 202a , 202b and the interactive transparent display 102 , 202 goe s into an inactive mode at 610 .
  • a method of operating an entertainment system for implementation in a motor vehicle is achieved .
  • the problem of boredom during road trips is solved by providing an entertainment system for taking pictures .
  • the entertainment system disclosed uses an interactive transparent display a s an interface for receiving motion signals to execute picture ta king function when activated, yet at the same time function as a window when the display function is in an inactive mode .
  • an entertainment system for implementing in a motor vehicle and method of operating the same having an integrated transparent display operable to provide a view outs ide the motor vehicle and receive a motion signal to ta ke a picture
  • Such an entertainment system may be implemented in motor vehicles for transporting pas sengers , and provide entertainment for the pas sengers , to solve the problem of boredom during road trips , without distracting the driver or operator . While exemplary embodiments have been presented in the foregoing detailed de scription of the disclosure , it should be appreciated that a vast number of variations which achieves the same purpose exist .
  • the exemplary embodiments are only examples , and are not intended to limit the s cope , applicability, operation , or conf iguration of the dis closure in any way . Rather, the foregoing detailed description will provide those s killed in the art with a convenient road map for implementing an exemplary embodiment of the disclosure , it being understood that various changes may be made in the function and arrangement of element s and method of operation de scribed in the exemplary embodiment without departing from the scope of the dis closure as set forth in the appended claims .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

An entertainment system for implementation into a motor vehicle is disclosed. The entertainment system includes an interactive transparent display, at least one image sensing device and a microcontroller.The interactive display is operable to provide a view outside the motor vehicle. The at least one image sensing device captures one or more images of the view outside the motor vehicle. The microcontroller is operable to identify a motion signal and execute a command to take a picture based on the motion signal identified.The interactive transparent display operates as an interface to receive the motion signal to take the picture. A method of operating the entertainment system is also disclosed.

Description

An Entertainment System For A Motor Vehicle and Method Thereof
Technical Field
This disclosure relates to motor vehicles and in particular to an entertainment system of a motor vehicle.
Background
Motor vehicles are typically installed with glass on various parts of the vehicle body to function as windows. Typically, vehicle windows are a form of restrain system, to shield occupants seating within the motor vehicle from bad weather and to keep debris out of the motor vehicle while allowing visibility. Conventional vehicle windows are made of glass which has been treated, for example tempered glass, which is also known as safety glass. In the event of traffic accident, vehicle windows will shatter into small, round pieces, to prevent causing injuries to the occupants in the motor vehicle.
Occasionally, motor vehicle widows may help to provide ventilation during hot weather, or when the heating, ventilation, and air conditioning (HVAC) system is not functioning. During road trips, motor vehicle windows allow passengers a simple form of entertainment to view outside the motor vehicle. An alternative source of entertainment during road trips may be vehicle infotainment system. However, while loud music may be enjoyable for passengers, it may pose a danger to a driver who needs to focus on the road.
There is therefore a need to provide an entertainment system that overcomes, or at least ameliorates, the problems described above. Furthermore, other desirable features and characteristics will become apparent from the subsequent detailed description and the appended claims , taking in conj unction with the accompanying drawings and this background of the di sclosure .
Summary
A purpose of thi s disclosure i s to ameliorate the problem of boredom during road trips , while ensuring safety of the driver , by providing the subj ect-matter of the independent claims .
The obj ective of this di sclosure i s solved by an entertainment system for implementation into a motor vehicle compri sing :
• an interactive transparent display operable to provide o a view outside the motor vehicle ;
• at least one image sensing device for o capturing one or more images of the view outs ide the motor vehicle ; and
• a microcontroller operable to o identify a motion signal and o execute a command to take a picture based on the motion s ignal identified, wherein the interactive transparent display is further operable to
• receive the motion signal to take the picture containing the view outs ide the motor vehicle .
An advantage of the above described aspect of this di sclosure yields an entertainment system for implementation in a motor vehicle having an interactive transparent display for providing a view outside the motor vehicle, for taking pictures. Therefore, the entertainment system disclosed provides entertainment to the motor vehicle passengers during road trips. Since the integrated transparent display allows a viewer to view outside the motor vehicle, the integrated transparent display also operates as a motor vehicle window.
Preferred is an entertainment system as described above or as described above as being preferred, in which:
• the motion signal received by the interactive transparent display executes the command to o crop a subject interest within the view outside the motor vehicle,
■ the subject interest defined by coordinates of the motion signal received on the interactive transparent display .
The advantage of the above aspect of this disclosure is to utilize the integrated transparent display as an interface to receive motion signals from a user, to execute a function of taking a picture. Since the integrated transparent display provides an interface to receive motion signals, the content of the picture may be a scene outside the motor vehicle, or at least a part of (e.g. a subject of interest) the scene outside the motor vehicle, which the user may crop out using motion signals received by the integrated transparent display. The content or a subject of interest to be cropped out may be defined by coordinates of the motion signal received by the integrated transparent display. An example of a subject of interest may be an object, a building, or a person within the view outside the motor vehicle.
Preferred is an entertainment system as described above or as described above as being preferred, in which: • the interactive transparent display is operable to o display a resultant picture upon completion of taking the picture in accordance to the motion signal received.
The advantage of the above aspect of this disclosure is a confirmation feature by the entertainment system, to display a picture taken or a resultant picture according to the motion signal received by integrated transparent display, as a confirmation the picture taking task is completed.
Preferred is an entertainment system as described above or as described above as being preferred, in which: the motion signal received by the interactive transparent display cause the microcontroller to execute the command to
• magnify the subject of interest displayed; and/ or
• minimize the subject of interest displayed on the interactive transparent display.
The advantage of the above aspect of this disclosure is to allow the user to magnify, (i.e. to zoom-in) or minimize (i.e. to zoom-out) the subject of interest displayed on the interactive transparent display, to provide different photography or cinematography applications, thereby heightening user' s experience .
Preferred is an entertainment system as described above or as described above as being preferred, in which: the motion signal received by the interactive transparent display causes the microcontroller to execute the command to
• change an orientation of the resultant picture.
The advantage of the above aspect of this disclosure is to allow the user to swivel the image sensing device such that the resultant picture changes orientation in different position, direction, or angle.
Preferred is an entertainment system as described above or as described above as being preferred, in which: the orientation of the resultant picture comprises
• an alignment of the resultant picture in o a roll direction; o a pan direction; o a tilt direction, or any combination thereof.
The advantage of the above aspect of this disclosure is to allow the user to swivel or adjust a spatial arrangement of the at least one image sensing device, to achieve different photography and/or cinematography applications, for example rolling, panning and tilting. Therefore, functionality of the entertainment system is increased .
Preferred is an entertainment system as described above or as described above as being preferred, in which: the interactive transparent display further comprises
• a digital mirror for displaying the resultant picture.
The advantage of the above aspect of this disclosure is to create a display area (i.e. an area of the digital mirror) for displaying the resultant picture on the interactive transparent display. The resultant picture displayed on the digital mirror may provide a confirmation step.
Preferred is an entertainment system as described above or as described above as being preferred, in which:
• the resultant picture is a still image; or
• the resultant picture is a motion image.
The advantage of the above aspect of this disclosure yields an entertainment system for implementation in a motor vehicle which allows picture taking to produce still pictures, i.e. non-moving images such as a photo, or a motion pictures such a video clips.
Preferred is an entertainment system as described above or as described above as being preferred, in which: the interactive transparent display is
• a motor vehicle window;
• at least a portion of a motor vehicle rooftop
• a motor vehicle windshield or any combination thereof.
The advantage of the above aspect of this disclosure allows the integrated transparent display to be installed on frames of a motor vehicle where windows are normally positioned, functioning as a vehicle window. Therefore, a transparent sheet may be a sheet of glass used as vehicle window glass. The vehicle window glass may be replaced or modified to achieve an integrated transparent display to provide entertainment.
Preferred is an entertainment system as described above or as described above as being preferred, in which: the at least one image sensing device is positioned at
• a motor vehicle window;
• at least a portion of a motor vehicle rooftop
• a motor vehicle windshield,
• a motor vehicle side view mirror, or any combination thereof.
The advantage of the above aspect of this disclosure enables capturing images of a view outside on either side of the motor vehicle, such that photography and/or cinematography applications can be applied, thereby achieving augmented reality in real-time .
Preferred is an entertainment system as described above or as described above as being preferred, in which: the at least one image sensing device is
• a side view mirror.
The advantage of the above aspect of this disclosure enables capturing images of a rearview of the motor vehicle, such that photography and/or cinematography applications can be applied, thereby achieving augmented reality in real-time.
Preferred is an entertainment system as described above or as described above as being preferred, in which: the motor vehicle comprises: a passenger car; an aircraft; a trailer; a truck; a train, a bus, a yacht, or a vessel.
The advantage of the above aspect of this disclosure yields an entertainment system that is implemented in motor vehicles suitable for transporting passengers. Preferred is an entertainment system as described above or as des cribed above as being preferred, in which : the interactive transparent display comprises :
• a transparent sheet ; and
• a transparent touchs creen display layer .
The advantage of the above aspect of this disclosure enables replacement of existing vehicle windows with an interactive transparent di splay, or modification of an existing sheet of gla s s ( used as a vehicle window glas s ) by providing an additional transparent touchs creen display layer .
The obj ective of this di sclosure is solved by a method for operating an entertainment system implemented in a motor vehicle , preferably according to a method for operating an entertainment system implemented in a motor vehicle according to any one of the preceding claims , comprising : providing a view outside the motor vehicle through an interactive transparent display; executing detecting a motion signal on the interactive transparent di splay, wherein the motion signal triggers the executing a command to carry out taking a picture containing the view outs ide the motor vehicle ; and displaying an image resulting from the command to carry out taking a picture , a s defined by the motion signal executed on the interactive transparent display .
An advantage of the above described aspect of this disclosure yields a method of operating an entertainment system implemented in a motor vehicle , the method for taking pictures of a view outside the motor vehicle , to solve the problem of boredom during road trips . Brief Description of Drawings
Other objects and aspects of this disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings in which:
Fig 1. shows a system block diagram of an entertainment system in accordance to a preferred embodiment.
Fig. 2a shows an exemplary embodiment of an entertainment system in accordance to a preferred embodiment.
Fig. 2b shows an exemplary embodiment of an image captured by an entertainment system in accordance to a preferred embodiment.
Fig. 3a shows a top view of a motor vehicle in accordance to a preferred embodiment.
Fig. 3b shows an image outside in accordance to a preferred embodiment .
Fig. 4 shows a perspective view of a motor vehicle in accordance to a preferred embodiment.
Fig. 5 shows an exemplary image sensing device having different orientations .
Fig. 6 shows an exemplary system workflow diagram in accordance to a preferred embodiment.
In various embodiments described by reference to the above figures, like reference signs refer to like components or elements in several perspective views and/or configurations. Detailed Description
The following detailed description is merely exemplary in nature and is not intended to limit the disclosure or the application and uses of the disclosure. Furthermore, there is no intention to be bound by any theory presented in the preceding background of the disclosure or the following detailed description. It is the intent of this disclosure to present an entertainment system for implementation in a motor vehicle.
Hereinafter, "a transparent display" refers to a display apparatus having transparent properties, such that background of the display apparatus are observable. A transparent display apparatus allows the user to see both the image displayed from the display apparatus and the background view behind the display apparatus, i.e. the background behind the transparent display apparatus can be seen through. This is because a transparent display apparatus transmits incident light rays onto a back surface of the transparent display apparatus directly to a viewer' s eye due to light transmittance. Since the light incident onto the back surface is transmitted directly to the user's eye, the user can see an object beyond the back surface, thus achieving see-through effect. Since a liquid-crystal display (LCD) uses two polarizing plates, the liquid-crystal display has low transmittance, so that it is difficult to be used as a transparent display apparatus. A suitable type of display for manufacturing a transparent display will be realized by using an organic light-emitting display device (OLED) capable of self -emitting . Such a transparent display apparatus may function as a glass-like surface, while at the same time, provide desired information to a user. Therefore, the term "interactive display" refers to display apparatus enabled with touchscreen interaction. In the context herein, the term "interactive transparent display" refers to a transparent display having transparent properties, with enabled with touchscreen interaction.
In a preferred embodiment a transparent display apparatus has a transparent display, wherein the transparency of the display is defined by the percentage of light which hits the surface of the display vertically, wherein the transmittance is preferably in the range between 5% and 90% more preferably between 10% and 85%, even more preferably 15% and 80%, in particular more preferable 20 % and 75%, most preferable 25% and 70%. In a preferred embodiment disclosed herein, the transparent display is defined by a percentage of transmittance within a range preferably between 20% to 30%, more preferably 23% - 28% and most preferably 25%. Examples of positions suitable for placement of transparent display falling within the aforesaid ranges includes a motor vehicle window on a rear side of a motor vehicle, a motor vehicle sunroof and/or a vehicle windshield on a rear side of a motor vehicle. In another preferred embodiment disclosed herein, the transparent display is defined by a percentage of transmittance within a range preferably between 65% and 75%, more preferably 68% and 72% and most preferably 70%. Examples of positions suitable for placement of transparent display falling within the aforesaid ranges includes a motor vehicle front windshield and/or motor vehicle windows on a front side of a motor vehicle.
"A signal" refers to an electrical pulse or electrical wave to be transmitted or received, while "motion" an act or movement by at least a part of a body. Examples of motion includes a pinching motion, a spreading motion, a point-and-drag motion, a tapping motion, or a circling motion. In the context herein, the term "motion signal" may include a hand movement, a gesture, a touch received by an input peripheral, that is converted into electrical pulse and transmitted to the entertainment system to convey an information or message, for e.g. a command. A "microcontroller" used it the context herein shall be interpreted broadly to encompass a general-purpose processor, a central processing unit (CPU) , a microprocessor, a digital signal processor (DSP) , a controller and so forth. The term "microcontroller" may refer to a combination of processing devices, e.g a combination of a DSP and a microprocessor such as a graphics processor, or any other such configuration as required.
The term "coordinates" denotes a set of values that shows an exact point, line, or position. In the context used herein, the term "coordinates" refers to an area or location defined by a motion or movement contacted on a user interface, for example a touchscreen. Therefore, the term "coordinates defined by a motion signal" refers to an area contacted by a user on a user interface. By way of example, the area contacted by a user on a user interface may be a motion contacting a surface of the user interface, such as using two or more fingers to create a pinching motion using two or more fingers to create a spreading out motion and so forth.
Referring to Fig 1 which shows a system block diagram 100 of an entertainment system in accordance to a preferred embodiment, the system block diagram 100 includes an interactive transparent display 102, at least one image sensing device 108 and a microcontroller 112. The interactive transparent display 102 provides a view of a background of the interactive transparent display 102, due to its transparent properties. The image sensing device 102 captures one or more images of the background of the interactive transparent display 102. Examples of suitable image sensing device includes a camera or an image sensor. The microcontroller 112 may be programmed to identify a motion signal and execute a command to take a picture based on the motion signal identified. A viewer may input a motion signal through the interactive transparent display 102. Advantageously, the in- teractive transparent display 102 works as an interface for receiving motion signals to execute a command to take a picture of at least a part of the background of the interactive transparent display 102, which may be viewed through the interactive transparent display 102 due to its transparent properties .
The interactive transparent display 102 may be made up of a transparent sheet 104, for example a sheet of glass and a transparent touchscreen display layer. As described above, a suitable type of display layer will be an OLED display layer. Advantageously, since the interactive transparent display 102 possess transparent properties, it can be used as a glass or window when the display function is an inactive mode.
In some embodiments, microcontroller 112 may further comprises a graphics processor 116, which function to process graphical images captured by the image sensing device 108, for example, applying filters, post-image processing to improve quality of image or picture taken. The microcontroller 112 interprets and identify the motion signals received on the interactive transparent display 102 to execute a command to take a picture based on the one or more images captured by the image sensing device 108. In some embodiments, the microcontroller 112 is part of the entertainment system 100. In some embodiments, the microcontroller 112 is part of a separate system, which may transmit the information to the entertainment system through a network protocol suitable for motor vehicle. Examples of suitable network protocols include Controller Area Network (CAN) bus, Local Interconnect Network (LIN) and FlexRay, but shall not be limited thereto.
With reference to Fig. 2a which shows an exemplary embodiment of an entertainment system 200a in accordance to a preferred embodiment implemented in a motor vehicle, the entertainment system 200a include amongst others, an interactive transparent display 202 provided as a motor vehicle window. When viewed from inside passenger cabin of a motor vehicle, a viewer may observe a view outside the motor vehicle through the interactive transparent display 202, due to the transparent properties of the interactive transparent display 202.
Also illustrated in Fig. 2a, the interactive transparent display 202 function as an interface to receive motion signals from a viewer, to crop an image out of the view outside the motor vehicle, of which the image is viewed through the interactive transparent display 102. A subject of interest 204, which is defined by coordinates of the motion signal received on the interactive transparent display 202, is cropped. The term "subject of interest" may include an object, a scenery, or a person within the view outside the motor vehicle. Upon completion of executing a command to take a picture by the microcontroller 112, a resultant picture 206, i.e. the picture captured, is displayed on the interactive transparent display 202. For clarity, a display region of the resultant picture 206 corresponds to an active region of a digital mirror 114 of the interactive transparent display 102, as shown in Fig. 1. Advantageously, the aforesaid configuration yields an entertainment system for implementation in a motor vehicle having an interactive transparent display for providing a view outside the motor vehicle, for taking pictures. The integrated transparent display also operates as a motor vehicle window, due to the transparent properties of the integrated transparent display.
In another exemplary embodiment as shown in Fig. 2b, a motion signal executes a command to magnify a subject of interest 204 displayed or viewed through the interactive transparent display 202, to zoom-in on specific object, scenery or person outside the motor vehicle. The magnified image may be displayed on the interactive transparent display 202 as a resultant picture 206. A separate motion signal is required to take a picture of the magnified image. In yet another embodiment, the viewer takes a picture (as illustrated in Fig. 2a) and magnify the resultant picture 206 after the resultant picture is displayed on the interactive transparent display 202. In both exemplary embodiments, an example of a suitable motion signal may be using two or more fingers to open out or increasingly extend an area on the interactive transparent display 202, to crop an image out of the view outside the motor vehicle, of which a resultant picture 206' shows a subject of interest which is magnified, as shown in Fig. 2b.
In another exemplary embodiment, a motion signal executes a command to minimise the subject of interest 204 to zoom-out the subject of interest such that it appears smaller compared to the view outside of the motor vehicle. The minimised image may be displayed on the interactive transparent display 202 as a resultant picture 206. The viewer may execute another motion signal to take a picture of the minimised image. In yet another embodiment, the viewer takes a picture (as illustrated in Fig. 2a) and minimise the resultant picture 206 after the resultant picture is displayed on the interactive transparent display 202. In the above exemplary embodiments, an example of a suitable motion signal may be using two or more fingers to close-in or increasingly reduce an area on the interactive transparent display 202, to crop an image out of the view outside the motor vehicle. An advantage of enabling a viewer to magnify and/or minimise the subject of interest or a resultant picture 206 allows the viewer to style the pictures or focus on specific objects, scenery, or person to heighten photography experience. It shall be understood by a skilled practitioner, different motion signals received by the interactive transparent display may still execute the same functions as disclosed above, without departing from the scope and spirit of this disclosure.
One of the technical advantages of the entertainment system disclosed herein is the use of an interactive transparent display as an interface to receive signals for executing picture taking, to provide entertainment. Yet at the same time, due to the transparent properties of the interactive transparent display, the interactive transparent display may also operate as a window of a motor vehicle when the display is in an inactive mode, to provide a view outside the motor vehicle. The term "motor vehicle" shall encompass transportations capable of ferrying passengers, for example, a passenger car, a trailer, a bus, an aircraft, a train, a yacht and a vessel, all of which has one or more windows for viewing outside the motor vehicle. In such embodiments where the entertainment system 100, 200a, 200b is implemented in a motor vehicle, the microcontroller 112 may be part of the entertainment system 100, 200a, 200b or in a separate system within the motor vehicle as described above.
By way of an example, Fig. 3a shows a top view of a motor vehicle 300a in accordance to a preferred embodiment. The motor vehicle 300a comprises a motor vehicle window 302, a motor vehicle roof top with at least a portion of the motor vehicle rooftop having a window or a sunroof 304, a motor vehicle windshield 306, 306' and side rear view mirrors 308, 308' , all of which are parts of a motor vehicle body which may be installed with an interactive transparent glass display as disclosed herein. The interactive transparent display comprises a transparent sheet and a transparent touchscreen display layer. The transparent sheet may be a sheet of glass or tempered glass. In an alternative embodiment, the vehicle glass is coupled with a transparent touchscreen display layer. Preferably, the transparent touchscreen display layer comprises touch sensors to receive the motion signals. Examples of touch sensors includes capacitive touch sensor or optoelectronic sensor to detect finger or hand contact points on the interactive transparent display. In an exemplary embodiment, the side rear view mirrors 308, 308' is replaced with an image sensing device 310. The image sensing device 310 is operable to capture one or more images outside the motor vehicle 300a. In accordance to a preferred embodiment as illustrated in Fig. 3b, the image sensing device 310 captures one or more images outside the motor vehicle 300a, and particularly behind the motor vehicle 300a. An advantage of using the rear-view mirror 308, 308' is to capture images or scenery behind the motor vehicle 300a.
Fig. 4 shows a perspective view of a motor vehicle in accordance to a preferred embodiment, of which the motor vehicle 402 comprises vehicle glass located at motor vehicle window 404, a motor vehicle roof top with at least a portion of the motor vehicle rooftop having a window or a sunroof 406, a motor vehicle windshield 408, 408' and side rear view mirrors 308, 308' . The aforesaid locations of vehicle glass are parts of a motor vehicle body which may be installed with an interactive transparent display as disclosed herein. Suitable locations for installing or embedding one or more image sensing device 410, 410' , 410' ' in a motor vehicle 403 includes a frame of the vehicle glass locations, for example a frame for holding a glass of a windshield, a frame for holding a glass of a vehicle window or a frame for holding a glass of a sunroof. It shall be understood by a skilled practitioner that the position of the image sensing devices are non-limiting, and the image sensing devices may be positioned along a peripheral of the frame as indicated in dotted lines, for capturing images outside the motor vehicle without departing from the scope and spirit of this disclosure. As can be seen from the aforesaid description, the present disclosure provides an advantage of flexibility to the implementation of the en- tertainment system, since the interactive transparent display may replace any vehicle glass and the image sensing device may be located at any position along a frame holding the interactive transparent display.
To enable changing an orientation of the resultant picture 206, 206' according to the exemplary embodiments as described above (Fig.2a and Fig. 2b referred) , Fig. 5 shows an exemplary image sensing device 500 operable to change different orientations. To achieve changing of orientation, the image sensing device is equipped with a positioner system for position tracking, to adjust direction of a field of view (FOV) of the image sensing device, namely pan 502, i.e. moving the FOV of the image sensing device at 180 degrees to a vertical plane, tilt 504, i.e. moving the FOV of the image sensing device at a 90 degrees to a horizontal plane) , and roll 506, i.e. rotating the FOV of the image sensing device through an angle of 360 degrees. This function enables changing the orientation of the subject of interest or the resultant picture 206, 206' according to the motion signal received by the interactive transparent display 102, 202 as explained in Fig. 1 and Fig. 2a above, for example to re-focus or re-select a subject of interest as well as magnify or minimize the subject of interest. Advantageously, allowing the viewer to change orientation of the view outside the motor vehicle and resizing the pictures taken increases functionality of the entertainment system.
The image sensing device 108 may capture the images continuously, frequently or when the entertainment is activated, according to design specification. By way of an example, the image sensing device 500 may continuously or without interruption, capture images of the view outside the motor vehicle throughout the motor vehicle' s journey. However, if a motion signal is received, the microcontroller 112 of the entertainment system executes a command correspond to the motion signal identified. In another embodiment, the image sensing device 500 frequently captures the view outside the motor vehicle in a fixed cycle, for example at every two hours interval, every three hours interval, every four hours interval and so forth. In yet another embodiment, the image sensing device 500 begins capturing one or more images of the view outside the motor vehicle when the interactive transparent display 102,202 is activated.
Fig. 6 shows an exemplary system workflow diagram 600 in accordance to a preferred embodiment. At 602, the interactive transparent display 102, 202 operates as a window, or the interactive transparent display 102, 202 is in an inactive mode. At 604, a motion signal is received by the interactive transparent display 102, 202, thus activating the interactive transparent display 102, 202 to operate as an interface for the entertainment system 100, 200a, 200b.
In an exemplary embodiment, a viewer input a motion signal to crop a subject of interest within a view of the outside motor vehicle displayed on the interactive transparent display 102, 202 to take a picture, at 612. At 608, the microcontroller 112 adjusts at least one image sensing device 108, to correspond to the motion signal identified, and execute a command to take a picture of the subject of interest, according to the coordinates defined by the motion signal.
In another embodiment, a viewer input a motion signal to magnify a subject to interest showing on the interactive transparent display 102, 202, at 606. The microcontroller 112 adjusts at least one image sensing device 108, to correspond to the motion signal identified, and execute a command to magnify the subject of interest, according to the coordinates defined by the motion signal. The viewer then repeats a motion signal for cropping an image of the subj ect of interest to take a picture . In both exemplary embodiments described above , a resultant picture , i . e . the picture taken is displayed on the interactive transparent display 102 , 202 upon executing the command to take a picture by the microcontroller 112 . The resultant picture may be a still image such as a picture , or a motion image such as a video clip , depending on the settings of the one or more image sensing device . In the event no motion signal is received by the integrated transparent di splay 102 , 202 , the integrated transparent display 102 , 202 , the microcontroller 112 interprets that there is no intention to continue using the exertainment system 100 , 202a , 202b and the interactive transparent display 102 , 202 goe s into an inactive mode at 610 . Advantageously, a method of operating an entertainment system for implementation in a motor vehicle is achieved . The problem of boredom during road trips is solved by providing an entertainment system for taking pictures . More advantageously, the entertainment system disclosed uses an interactive transparent display a s an interface for receiving motion signals to execute picture ta king function when activated, yet at the same time function as a window when the display function is in an inactive mode .
Thus , it can be seen that an entertainment system for implementing in a motor vehicle and method of operating the same having an integrated transparent display operable to provide a view outs ide the motor vehicle and receive a motion signal to ta ke a picture has been provided . Such an entertainment system may be implemented in motor vehicles for transporting pas sengers , and provide entertainment for the pas sengers , to solve the problem of boredom during road trips , without distracting the driver or operator . While exemplary embodiments have been presented in the foregoing detailed de scription of the disclosure , it should be appreciated that a vast number of variations which achieves the same purpose exist . It should further be appreciated that the exemplary embodiments are only examples , and are not intended to limit the s cope , applicability, operation , or conf iguration of the dis closure in any way . Rather , the foregoing detailed description will provide those s killed in the art with a convenient road map for implementing an exemplary embodiment of the disclosure , it being understood that various changes may be made in the function and arrangement of element s and method of operation de scribed in the exemplary embodiment without departing from the scope of the dis closure as set forth in the appended claims .
List of Reference Signs
100 - system block diagram
102 - interactive transparent display
104 - a transparent sheet
106 - transparent touchscreen display layer
108 - image sensing device
112 - A microcontroller (block diagram)
114 - digital mirror
116 - graphics proces sor
200a , 200b - entertainment system in motor vehicle
202 - interactive transparent display
204 - a subj ect of interest
206 - a resultant picture
208 - a view outside motor vehicle
200b - motor vehicle application
206 ' - magnif ied resultant picture
300a - top view of a motor vehicle
302 - motor vehicle window
304 - motor vehicle roof top - motor vehicle windshield - side rear view mirror b - one or more image captured - an image sensing device - perspective view - motor vehicle -window - roof top - windshield , 410' , 410" - image sensing device - Image sensing device orientations - pan - tilt - roll - system workflow diagram - window mode (inactive) - motion signal detected (display mode active) - user zooms for view - microcontroller adjusts image sensing device - no motion signal received (intent to stop) - take a picture

Claims

23 Patent claims
1. An entertainment system for implementation into a motor vehicle comprising:
• an interactive transparent display operable to provide o a view outside the motor vehicle;
• at least one image sensing device for o capturing one or more images of the view outside the motor vehicle; and
• a microcontroller operable to o identify a motion signal and o execute a command to take a picture based on the motion signal identified, wherein the interactive transparent display is further operable to
• receive the motion signal to take the picture containing the view outside the motor vehicle.
2. The system of claim 1, wherein
• the motion signal received by the interactive transparent display executes the command to o crop a subject of interest within the view outside the motor vehicle,
■ the subject of interest defined by coordinates of the motion signal received on the interactive transparent display.
3. The system of any one of claims 1 - 2, wherein • the interactive transparent display is operable to o display a resultant picture upon completion of taking the picture in accordance to the motion signal received. The system of any one of claims 1 -3, wherein the motion signal received by the interactive transparent display causes the microcontroller to execute the command to
• magnify the subject of interest displayed; and/ or
• minimize the subject of interest displayed on the interactive transparent display. The system of any one of claims 1-4, wherein the motion signal received by the interactive transparent display causes the microcontroller to execute the command to a. change an orientation of the resultant picture. The system of claim 5, wherein the orientation of the resultant picture comprises
• an alignment of the resultant picture in o a roll direction; o a pan direction; o a tilt direction, or any combination thereof. The system of according to any one of the preceding claims, wherein the interactive transparent display further comprises a. a digital mirror for displaying the resultant picture. The system according to any one of the preceding claims, wherein
• the resultant picture is a still picture; or
• the resultant picture is a motion picture. The system according to any one of the preceding claims, wherein the interactive transparent display is
• a motor vehicle window;
• at least a portion of a motor vehicle rooftop
• a motor vehicle windshield or any combination thereof. The system according to any one of the preceding claims, wherein the at least one image sensing device is positioned at
• a motor vehicle window;
• at least a portion of a motor vehicle rooftop
• a motor vehicle windshield,
• a motor vehicle side view mirror, or any combination thereof. The system according to any one of the preceding claims, wherein the at least one image sensing device is
• a side view mirror. The system according to any one of the preceding claims, wherein the motor vehicle comprises: a passenger car; an aircraft; a trailer; a truck; a train, a bus, a yacht, or a vessel. 2 6 The system according to any one of the preceding claims , wherein the interactive transparent display comprise s :
• a transparent sheet ; and
• a transparent touchs creen display layer . A method for operating an entertainment system implemented in a motor vehicle , preferably according to a system according to any one of the preceding claims , comprising : providing a view outside the motor vehicle through an interactive transparent display; detecting a motion signal on the interactive transparent di splay, wherein the motion signal triggers the executing a command to carry out taking a picture containing the view outs ide the motor vehicle ; and displaying an image resulting from the command to carry out ta king a picture , a s defined by the motion signal executed on the interactive transparent display .
PCT/EP2021/078289 2020-12-17 2021-10-13 An entertainment system for a motor vehicle and method thereof WO2022128202A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB2019924.6A GB2602262A (en) 2020-12-17 2020-12-17 An entertainment system for a motor vehicle and method thereof
GB2019924.6 2020-12-17

Publications (1)

Publication Number Publication Date
WO2022128202A1 true WO2022128202A1 (en) 2022-06-23

Family

ID=74221356

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2021/078289 WO2022128202A1 (en) 2020-12-17 2021-10-13 An entertainment system for a motor vehicle and method thereof

Country Status (2)

Country Link
GB (1) GB2602262A (en)
WO (1) WO2022128202A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009026223A2 (en) * 2007-08-16 2009-02-26 Gentex Corporation Vehicle rearview assembly including a display for displaying video captured by a camera and user instructions
EP3208650A1 (en) * 2016-02-18 2017-08-23 Sony Corporation Active vehicle window for presenting information and virtual reality
US20170349098A1 (en) * 2014-12-10 2017-12-07 Lg Electronics Inc. Vehicle display device and vehicle comprising same
US20190236999A1 (en) * 2016-07-12 2019-08-01 Audi Ag Method for operating a display device of a motor vehicle
US20200017026A1 (en) * 2018-07-10 2020-01-16 Samsung Electronics Co., Ltd. Method and system of displaying multimedia content on glass window of vehicle
US10665155B1 (en) * 2017-03-22 2020-05-26 Accelerate Labs, Llc Autonomous vehicle interaction system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120287323A1 (en) * 2011-05-09 2012-11-15 John Norvold Border Imaging apparatus with dual switchable beam deflectors
JP2012257099A (en) * 2011-06-09 2012-12-27 Nikon Corp Electronic camera
KR101882442B1 (en) * 2011-12-21 2018-07-26 엘지전자 주식회사 Mobile terminal, server, method for controlling of the mobile terminal, mehtod for controlling of the server
KR101992189B1 (en) * 2012-09-19 2019-06-24 엘지전자 주식회사 Mobile terminal and method for controlling thereof
KR101687543B1 (en) * 2015-04-27 2016-12-19 엘지전자 주식회사 Display apparatus and method for controlling the same
KR101743888B1 (en) * 2016-10-19 2017-06-05 (주)잼투고 User Terminal and Computer Implemented Method for Synchronizing Camera Movement Path and Camera Movement Timing Using Touch User Interface
US10290120B2 (en) * 2017-03-20 2019-05-14 SK Commercial Construction, Inc. Color analysis and control using an electronic mobile device transparent display screen

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009026223A2 (en) * 2007-08-16 2009-02-26 Gentex Corporation Vehicle rearview assembly including a display for displaying video captured by a camera and user instructions
US20170349098A1 (en) * 2014-12-10 2017-12-07 Lg Electronics Inc. Vehicle display device and vehicle comprising same
EP3208650A1 (en) * 2016-02-18 2017-08-23 Sony Corporation Active vehicle window for presenting information and virtual reality
US20190236999A1 (en) * 2016-07-12 2019-08-01 Audi Ag Method for operating a display device of a motor vehicle
US10665155B1 (en) * 2017-03-22 2020-05-26 Accelerate Labs, Llc Autonomous vehicle interaction system
US20200017026A1 (en) * 2018-07-10 2020-01-16 Samsung Electronics Co., Ltd. Method and system of displaying multimedia content on glass window of vehicle

Also Published As

Publication number Publication date
GB202019924D0 (en) 2021-02-03
GB2602262A (en) 2022-06-29

Similar Documents

Publication Publication Date Title
US10029621B2 (en) Rear view camera system using rear view mirror location
JP5093611B2 (en) Vehicle periphery confirmation device
JP2014534697A (en) Virtual display system for vehicles
JP2010130646A (en) Vehicle periphery checking system
JP2009100180A (en) Vehicular rear monitoring device
JP2004064131A (en) Display for vehicle
WO2017145645A1 (en) Driving assistance apparatus, driving assistance method, and driving assistance program
JP2009227245A (en) Operation device for on-vehicle equipment
JP2008044603A (en) Glare-proof device for vehicle
JP2010179850A (en) Vehicular display device
JP4798015B2 (en) Anti-glare control device
US20190339535A1 (en) Automatic eye box adjustment
JP2015174643A (en) display control device
CN107531180B (en) Monitoring device for a motor vehicle
JP2018022958A (en) Vehicle display controller and vehicle monitor system
CN111556281B (en) Vehicle safety system and operation method thereof
JP2017056909A (en) Vehicular image display device
TW202033394A (en) Augmented reality glasses auxiliary device for vehicles
JP5797155B2 (en) Driving support display device for rear window
CN108202666A (en) Display method capable of synchronously displaying rear panorama and turning picture during vehicle turning
WO2022128202A1 (en) An entertainment system for a motor vehicle and method thereof
JP2008162550A (en) External environment display device
US9283893B2 (en) Vision-controlled interaction for data spectacles
JP6439233B2 (en) Image display apparatus for vehicle and image processing method
TW201221390A (en) Real-time imaging system and method for vehicle rear viewing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21794489

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21794489

Country of ref document: EP

Kind code of ref document: A1