DE102014108656B4 - Customize a transparent display with an image capture device - Google Patents

Abstract

A system (200) for adapting a transparent display (250) to an image capture device (260), comprising: a data store (106) comprising a computer readable medium storing a program with instructions for adjusting the transparent display (250); a processor (102) executing the program with instructions; an image receiving module (210) for receiving an image from the image capture device (260), the image capture device (260) located behind the transparent display (250) facing an observer, the image capture device (210) 260) for detecting the content of the transparent display (250) and the viewer of the transparent display (250); an interface module (220) for forming an interface to the transparent display (250); an analysis module (230) for analyzing the received image Image to perform an analysis; andan output module (240) for performing display modification or error indication based on the analysis, the analysis module (230) including an error detection module (232) for detecting an error based on the analysis, wherein a detected error is a difference between information received from the analysis Image and another sensor, where the sensor is a tachometer and wherein the detected error is a software error.

Description

background

Transparent displays, such as a transparent light-emitting indicator (LED), can be provided to supplement existing display units. The transparent display allows a viewer to peer through the transparent display while receiving information presented on the display.

The transparent display may be implemented in a vehicle. The vehicle is ideal for a transparent display because the transparent display allows the driver of the vehicle to view mechanical components located on a back side of the display (example: gauges) while at the same time providing information on the transparent display.

The transparent display may convey information, such as information about road conditions, weather, vehicle status, and the like. In this way, the driver of the vehicle can rely on the display of the transparent display for safe and efficient control of the vehicle.

Vehicles can also have cameras. Cameras or image capture devices can assist the driver in various operations. The camera may be located at the rear of the vehicle, thereby alerting the vehicle driver to obstacles that are in the path of the vehicle.

From the US 8 116 937 B2 For example, a vehicle display device is known. There is described a vehicle display device that allows the operator to operate an image display device that is integrated with an instrument panel, has good visibility, and is located at a remote position from an operator and so can not be accessed by the operator. The operation of the image display device takes place here by means of a transparent input device, which is arranged in the vicinity of the operator.

From the US 2004/0 254 699 A1 For example, there is known an operation input device configured to identify, based on a movement of a user's hand, an operation command issued by the user and to output the identified operation command to an apparatus to be operated.

Furthermore, in the US Pat. No. 6,496,117 B2 a vision system for a vehicle is described, which refers in particular to a system that monitors the driver's attention when driving a motor vehicle.

Summary

Provided is a system for adjusting a transparent display according to claim 1.

Brief description of the drawings

• 1 ein Blockdiagramm, das einen Beispielcomputer aus dem Stand der Technik veranschaulicht.
• 2 ein Beispiel eines Systems zum Anpassen einer transparenten Anzeige mit einer Bilderfassungsvorrichtung.
• 3-5 Beispielimplementierungen des Systems aus 2.

The detailed description refers to the following drawings, wherein like numerals denote like elements; show it:

• 1 a block diagram illustrating a sample computer of the prior art.
• 2 an example of a system for adjusting a transparent display with an image capture device.
• 3 - 5 Example implementations of the system 2 ,

Detailed description

Transparent displays allow a viewer of the transparent display to see an environment while at the same time being presented with information contained on the transparent display. The transparent display can be implemented in different places. One such example is a vehicle, and more particularly a dashboard area of a vehicle.

However, in certain cases, the information presented on the transparent display may be erroneous. For example, the information may present data that is misleading to the driver (i.e., present the wrong vehicle speed or physical location). This may be because a machine that runs the transparent display contains errors or does not work properly.

In other cases, the transparent display may be difficult to read. This can be caused by environmental conditions such as too much or too little light. In this way, the transparent display is difficult to recognize for the vehicle driver.

Furthermore, the transparent display can be operated by keys or physical inputs. Therefore, the buttons or physical inputs may cause the vehicle driver to reach out and press one of the buttons or physical inputs. The act of extending the limbs to this task can be annoying and dangerous in certain cases.

Disclosed are systems and methods for integrating a camera behind a transparent display. The camera integrated with the transparent display can be achieved according to aspects disclosed herein by placing the camera behind the transparent display on one side opposite the viewer of the display. In this way, the camera can not only view the viewer of the display but also the content displayed on the transparent display.

Further, the aspects disclosed herein may be implemented in a vehicle. For reasons to be discussed below, applying the disclosed aspects results in a safer, more comfortable, and improved driving experience.

1 is a block diagram illustrating a sample computer 100 illustrated by the prior art. The computer 100 has at least one processor 102 on top of a chipset 104 is coupled. The chipset 104 has a memory control hub 120 and an input / output (I / O) control hub 122. A store 106 and a graphics adapter 112 are to the storage control hub 120 coupled, and an ad 118 is to the graphics adapter 112 coupled. A storage device 108 , a keyboard 110 , a pointing device 114 and a network adapter 116 are coupled to the I / O control hub 122. Other embodiments of the computer 100 can have different architectures.

The storage device 108 is a non-transitory computer-readable storage medium such as a hard disk, a compact disk read-only memory (CD-ROM), a DVD or a solid-state storage device. The memory 106 contains instructions and data provided by the processor 102 to be used. The pointing device 114 is a mouse, trackball, or other type of pointing device, and is used in combination with the keyboard 110 used to data in a computer system 100 enter. The graphics adapter 112 displays images and other information on the display 118 at. The network adapter 116 couples the computer system 100 to one or more computer networks.

The computer 100 is configured to execute computer program modules for providing the functions described herein. As used herein, the term "module" refers to computer program logic used to provide the particular function. Thus, a module may be implemented in hardware, firmware, and / or software. In one embodiment, program modules are on the storage device 108 stored in the memory 106 loaded and from the processor 102 executed.

The types of computers used by the disclosed entities and processes may vary depending on the embodiment and processing performance of the entity. The computer 100 may be a mobile device, a tablet, a smartphone, or any type of computing element with the elements listed above. For example, a video body, such as a hard disk, a solid state memory, or a storage device, may be stored in a distributed database system that includes a plurality of blade servers that work together to provide the functions described herein. The computers may lack some of the components described above, such as keyboards 110 , Graphics adapter 112 and displays 118.

2 shows an example of a system 200 to customize a transparent ad 250 with an image / video capture device 260 , The system 200 can be considered a device such as a computer 100 be executed. The system 200 has an image receiving module 210 , an interface module 220 , an analysis module 230 and an output module 240 on. The image receiving module 210 may be implemented with an image video capture device 260 to communicate. In the image / video capture device 260 It can be any type of image / video capture device 260 such as a digital camera, a digital video recorder or the like. Alternatively, the system can 200 with the image capture device 260 , the transparent ad 250 or a combination thereof.

3 - 5 show example implementations of the system 200 ,

The image video capture device 260 Can in a position behind the transparent display 250 be aligned. The image / video capture device 260 may be oriented to reflect the content displayed on the transparent display 250 displayed to the viewer of the transparent display 250 and any other objects in an environment detected in the image / video capture device 260 and the transparent display 250 are implemented. The transparent display 250 , the image / video capture device 260 and the system 200 may be implemented in an environment such as the dashboard of a vehicle.

The image receiving module 210 receives images or videos from the image / video capture device 260 , The image receiving module 210 The pictures or videos can be taken at pre-set intervals, in real time or at the instigation of detecting a process of the vehicle or a motion detected by the image video capture device 260. The image receiving module 210 can save the pictures or videos in a frame buffer 205 to save.

The display interface module 220 forms an interface to the transparent display 250 , The transparent display 250 can monitor the current content on the transparent display 250 is shown. Alternatively, the transparent display 250 interact with a buffer that matches the transparent display 250 is implemented, and retrieve content already on the transparent display 250 were displayed.

The analysis module 230 has a face recognition module 231 , an error detection module 232 , an environment detection module 233 and a gesture recognition module 234 on. Depending on the implementation of the system 200 can use different combinations of elements 231 - 234 available. The different elements of the analysis module 230 can with the image / video capture device 260 and the transparent display 250 interact to perform the various operations described below.

The face recognition module 231 analyzes the image / video from the image-receiving module 210 was recorded. The face recognition module 231 determines if the image is the viewer of the transparent display 250 contains. The face recognition module 231 may further identify the face of the observer or even identify features of the face. For example, the eyes of the viewer may be an identified feature. After identification of the feature, the face recognition module 231 determine a state of the viewer's eyes, such as whether the eyes are closed, blinking, or wide open.

The error detection module 232 can be based on the from the display interface module 220 retrieved content determines whether the operation of the transparent display 250 currently is faulty. For example, if the driver logic is the transparent display 250 contains an error and the transparent display 250 does not display the correct information or the like, the fault detection module may 232 record this error or mismatch. The error detection module 232 is configured by arranging the image / video capture device 260 in a position where you can see the transparent display 250 directly viewed.

In another example, the fault detection module 232 the rate of update / replay on the transparent display 250 to verify. If the error detection module 232 detects that the rate of update / replay is not within a pre-determined threshold of an acceptable rate, the fault detection module may 232 record that an error has occurred.

In another example, the fault detection module 232 form an interface with a sensor or other image / video capture device associated with the location where the system is located 200 is implemented. For example, if the system 200 implemented in a vehicle, an external camera / sensor associated with the vehicle may determine that the speed of the vehicle 100 Kilometers per hour (km / h) should be or amounts to. The image / video capture device 260 can simultaneously determine that the transparent display 250 indicates a speed of 90 km / h. In this situation, the error detection module 232 realize that the transparent display 250 erroneously indicates incorrect data.

The environment detection module 233 can recognize a certain aspect of the environment, the quality of the transparent display 250 can affect. The environment detection module 233 may determine that the conditions of the environment are affected by a large amount of ambient light. In another example, the environment recognition module may 233 determine that the external conditions are influenced by a cloudy sky. The environment detection module 233 This condition can be stored in the data store 205 and update this record periodically at each pre-set interval. For example, if the vehicle in which the system 200 is implemented, moves to a dark place, such as a tunnel, and then leaves the tunnel, the environment detection module 233 update its external environment record based on this measurement.

The gesture recognition module 234 can be a gesture of the viewer of the transparent display 250 record. For example, if the user is in front of the image / video capture device 260 with the hand beckons, the gesture recognition module 234 recognize this wave and then translate that movement or action into a command.

The output module 240 translates the various monitored data associated with the elements described above and either provides information for detecting an error or modifies the transparent display 250 , If an error is specified, the error may be sent to a Processor are sent to the operation of the transparent display 250 is assigned, or alternatively on the transparent display 250 are displayed. The output module 240 has a display modification module 241 and an error indication module 242 on.

The display modification module 241 modifies the transparent display 250 based on the various data analyzes of the analysis module 230 , For example, if the face recognition module 231 recognizes that the eyes of the viewer of the transparent display 250 can blink, the transparent display 250 be adjusted accordingly. An example is in 3 shown.

In another example, the display modification module 241 the transparent display 250 based on the gesture recognition module 234 modify recognized gesture. The gesture recognition module 234 can determine that one hand in front of the transparent display 250 is moved. The hand gesture can be translated into a process that takes place at the transparent display 250 is performed.

Alternatively, the gesture recognition module 234 in response to that system 200 implemented in a vehicle, recognize that a hand has been removed from a steering wheel. In response to the viewer's hand being removed from the steering wheel, the transparent display may 250 be controlled so that it displays a simpler display. One reason for this is that the system 200 determines that the viewer drives the vehicle and could be helped by a simpler user interface. An example of this is in 4 shown.

If the system 200 In another example, in a location that is subject to dynamic environments, such as a vehicle, the display modification module may be implemented 241 the transparent display 250 change based on the current environment. Due to excessive sunlight or too little light, for example, the transparent display 250 a contrast of the transparent display 250 based on recognition of the environment recognition module 233 to change. An example of this is in 5 shown.

The error indication module 242 gives an error based on the error detection module 232 recognized error. The error indication module 244 can the error in the data store 205 record or report the error to a central processing unit (computer 100 ) transfer. Alternatively, the error indication module 242 may be the transparent display 250 cause to display the error.

Certain devices 1 include a computing system. The computing system includes a processor (CPU) and a system bus that couples various system components including a system memory such as a read only memory (ROM) and a random access memory (RAM) to the processor. Other system memory may be available for use. The computing system may include more than one processor or a group or cluster of computing systems that are networked together to provide more processing capability. The system bus may be any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, and a local bus using various bus architectures. A basic input / output (BIOS) stored in ROM or the like may provide basic utilities that help transmit information between items in the computing system, such as during startup. The computing system also includes data stores that maintain a database in accordance with known database management systems. The data storage may be in many forms, such as a hard disk drive, a magnetic disk drive, an optical disk drive, a tape drive, or any other type of computer readable media capable of storing data accessible to the processor, such as such as magnetic cassettes, flash memory cards, DVDs, cassette magnetic tapes, random access memories (RAMs) and read-only memory (ROM). The data memories can be connected to the system bus via a drive interface. The data stores provide non-volatile storage of computer readable instructions, data structures, program modules, and other data for the computing system.

To facilitate interaction with human (and in some cases machine) users, the computing system may include an input device, such as a voice and sound microphone, a touch screen for gestures or graphical inputs, keyboard, mouse, motion input, and so forth. An output device may include one or more of a number of dispensing mechanisms. In some cases, multimodal systems allow a user to provide multiple types of input to communicate with the computing system. A communication interface generally allows the computing device system to communicate with one or more computing devices via various communication and network protocols.

Embodiments disclosed herein may be implemented in digital electronic circuits or in computer software, firmware, or hardware, including the structures disclosed herein and their equivalents. Some embodiments may be implemented as one or more computer programs, i. H. one or more modules of computer program instructions encoded on a tangible computer storage medium for execution by one or more processors. A computer storage medium may be or may be included in a computer readable storage device, a computer readable storage substrate, or a read / write memory or serial access memory. The computer storage medium may also be one or more separate tangible components or media, such as multiple CDs, discs, or other storage devices, or included therein. The computer storage medium has no transitory signal.

As used herein, the term processor encompasses all types of devices, devices and machines for processing data, including, for example, a programmable processor, a computer, a system on a chip or more, or combinations of the foregoing. The processor may include specialized logic circuits, e.g. As an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit). The processor may include hardware other than code that provides an execution environment for the particular computer program, e.g. Code that forms a processor firmware, a protocol stack, a management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more thereof.

A computer program (also referred to as program, module, engine, software, software application, script or code) may be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and the program may be set up in any form including, as an independent program or module, component, subroutine, object, or other entity suitable for use in a computing environment. A computer program may or may not be equivalent to a file in a file system. A program may be stored in a portion of a file containing other programs or data (eg, one or more scripts stored in a document in markup language), in a single file specific to that program, or in multiple coordinated files (eg files that store one or more modules, subroutines or pieces of code). A computer program may be configured or executed on one or more computers located at one site or distributed over multiple sites and connected via a communications network.

To provide for interaction with an individual, the embodiments disclosed herein may be implemented using an interactive display, such as a graphical user interface (GUI). Such GUIs may have interactive functions, such as pop-up or pull-down menus or lists, selection tabs, scannable features, and other functions that can receive human input.

The computing system disclosed herein may include clients and servers. A client and a server are generally distant from each other and usually interact through a communications network. The relationship between client and server is determined by the computer programs that run on each computer and that are in client-server relationship. In some embodiments, a server transmits data (eg, an HTML page) to a client device (eg, to display data and to receive user input from a user interacting with the client device). Data generated at the client device (eg, a result of user interaction) may be received by the client device at the server.

Claims (12)

A system (200) for adapting a transparent display (250) to an image capture device (260), comprising: a data store (106) comprising a computer readable medium storing a program with instructions for adjusting the transparent display (250); a processor (102) executing the program with instructions; an image receiving module (210) for receiving an image from the image capture device (260), wherein the image capture device (260) is disposed behind the transparent display (250) facing an observer, the image capture device (260) being aligned to read the content of the transparent display (260). 250) and the viewer of the transparent display (250); an interface module (220) for interfacing with the transparent display (250); an analysis module (230) for analyzing the received image to perform an analysis; and an output module (240) for performing a display modification or an error indication based on the analysis, wherein the analysis module (230) includes an error detection module (232) for detecting an error based on the analysis, wherein a detected error is a difference between information from the received image and another sensor, the sensor being a tachometer and wherein the detected one Error is a software error. System after Claim 1 wherein the analysis module (230) comprises a face recognition module (321) for recognizing a face that is watching the transparent display. System after Claim 2 wherein the output module (230) performs the display modification based on a recognized indication. System after Claim 3 where a recognized facial feature are eyes of the face that blink. System after Claim 1 wherein the analysis module (230) includes an environment detection module (233) for detecting an outside environment condition, wherein the outside environment condition is external lighting, and the display module (230) modifies the transparent display (250) based on the outside environment condition. System after Claim 1 wherein the analysis module (230) further comprises a gesture recognition module (231) for detecting a gesture of a user in front of the transparent display (250). A system for adjusting a transparent display (250) with an image capture device (260), comprising: a data store (106) comprising a computer readable medium storing a program with instructions for adjusting the transparent display (250); a processor (102) executing the program with instructions; an image receiving module (210) for receiving an image from the image capture device (260), wherein the image capture device (260) is disposed behind the transparent display (250) facing an observer, the image capture device (260) being aligned to read the content of the transparent display (260). 250) and the viewer of the transparent display (250); an interface module (220) for interfacing with the transparent display (250); an analysis module (230) for analyzing the received to perform an analysis; and an output module (240) for performing a display modification or an error indication based on the analysis, wherein the analysis module (230) comprises an error detection module (232) for detecting an error based on the analysis, wherein a detected error is a difference between information from the received image and another sensor, the sensor being a tachometer, and wherein the detected error is a software error, the system being installed in a vehicle. System after Claim 7 wherein the analysis module (230) comprises a face recognition module (321) for recognizing a face that is watching the transparent display (250). System after Claim 8 wherein the output module (240) performs the display modification based on a recognized indication. System after Claim 9 where a recognized facial feature are eyes of the face that blink. System after Claim 7 wherein the analysis module (230) includes an environment detection module (233) for detecting an outside environment condition, wherein the outside environment condition is external lighting, and the display module (230) modifies the transparent display (250) based on the outside environment condition. System after Claim 7 wherein the analysis module (230) further comprises a gesture recognition module (231) for detecting a gesture of a user in front of the transparent display (250).

Images