SE537730C2 - Projected virtual vehicle entry system - Google Patents
Projected virtual vehicle entry system Download PDFInfo
- Publication number
- SE537730C2 SE537730C2 SE1250488A SE1250488A SE537730C2 SE 537730 C2 SE537730 C2 SE 537730C2 SE 1250488 A SE1250488 A SE 1250488A SE 1250488 A SE1250488 A SE 1250488A SE 537730 C2 SE537730 C2 SE 537730C2
- Authority
- SE
- Sweden
- Prior art keywords
- input
- vehicle
- touch screen
- virtual touch
- projector
- Prior art date
Links
- 230000004913 activation Effects 0.000 claims abstract description 25
- 230000000694 effects Effects 0.000 claims abstract description 19
- 238000000034 method Methods 0.000 claims description 15
- 230000003287 optical effect Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 3
- 230000001419 dependent effect Effects 0.000 claims description 2
- 230000000977 initiatory effect Effects 0.000 claims description 2
- 239000000725 suspension Substances 0.000 description 5
- 238000010438 heat treatment Methods 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/143—Touch sensitive instrument input devices
- B60K2360/1438—Touch screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/21—Optical features of instruments using cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/33—Illumination features
- B60K2360/334—Projection means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
537 7 Sammandrag Ett inmatningssystem (2) for ett fordon, innefattande ett projektorsystem (4), ett detektorsystem (6), vilka är anpassade att kommunicera med en styrenhet (8). Projektorsystemet (4) är anpassat att generera en virtuell pekskarm (10) innefattande en installbar inmatningsmeny anpassad for inmatning av styrinstruktioner for styrning av ett eller flera system for fordonet, varvid projektorsystemet (4) är anpassat att projicera den virtuella pekskarmen pa en visningsyta i eller vid fordonet. Inmatningssystemet (2) är anpassat att vara i atminstone tva tillstand, ett vilotillstand och ett anvandningstillstand, varvid inmatningssystemet (2) är anpassat att: A - detektera en forsta aktiveringatgard med namnda detektorsystem (6), B - initiera anvandningstillstandet, C - valja och bestamma en visningsyta for den virtuella pekskarmen (10), D - generera och projicera den virtuella pekskarmen med anvandning av namnda projektorsystem (4) pa vald visningsyta, E - ta emot, med anvandning av namnda detektorsystem (6), inmatningar av styrinstruktioner i form av inmatningsaktiviteter via namnda projicerade inmatningsmeny och generera en inmatningssignal (12) i beroende darav, F - styra ett eller flera system i beroende av namnda inmatningssignal (12). 537 7 Summary An input system (2) for a vehicle, comprising a projector system (4), a detector system (6), which are adapted to communicate with a control unit (8). The projector system (4) is adapted to generate a virtual touch screen (10) comprising an installable input menu adapted for inputting control instructions for controlling one or more systems for the vehicle, the projector system (4) being adapted to project the virtual touch screen onto a display surface in or at the vehicle. The input system (2) is adapted to be in at least two states, a dormant state and a state of use, the input system (2) being adapted to: A - detect a first activation action with said detector system (6), B - initiate the state of use, C - select and determine a display area for the virtual touch screen (10), D - generate and project the virtual touch screen using said projector system (4) on the selected display area, E - receive, using said detector system (6), inputs of control instructions in the form of input activities via said projected input menu and generating an input signal (12) depending thereon, F - controlling one or more systems depending on said input signal (12).
Description
537 7 Titel Projicerat virtuellt inmatningssystem fOr fordon Uppfinningens omrAde Foreliggande uppfinning avser ett inmatningssystem, och en metod i samband med ett sadant inmatningssystem, enligt ingressema fOr de oberoende patentkraven. FIELD OF THE INVENTION The present invention relates to an input system, and a method in connection with such an input system, according to the preambles of the independent claims.
Speciellt avser uppfinningen ett inmatningssystem och en metod for ett fordon som underldttar kontrollen av system och funktioner pa fordonet. In particular, the invention relates to an input system and a method for a vehicle which facilitates the control of systems and functions on the vehicle.
Bakgrund till uppfinningen I en modern lastbil finns det flera system eller funktioner som fOraren, eller en passagerare, viii kunna anvdnda fran fOrarplatsen, fran passagerarplatsen eller fran andra stallen i, och i anslutning till, fordonet, exempelvis fran sangen eller utanfOr fordonet. Exempel pA sadana system eller funktioner är belysning, uppvarmningssystem, radio, tv, multimedia, men dven t.ex. installning av luftfjadringen fOr lastbilen, exempelvis i samband med att ett sldp kopplas pa. Background of the Invention In a modern truck, there are several systems or functions that the driver, or a passenger, can use from the driver's seat, from the passenger seat or from other stables in, and adjacent to, the vehicle, for example from the song or outside the vehicle. Examples of such systems or functions are lighting, heating systems, radio, television, multimedia, but also e.g. installation of the air suspension for the truck, for example in connection with a sldp being switched on.
Detta onskemal har idag uppfyllts genom att anordna knappar och reglage pa ett antal stallen i, och i anslutning till, fordonet som medger att systemen och funktionerna kan anvandas dven om anvandaren inte sitter pa fOrarplatsen. Exempelvis kan innerbelysningen styras fran en panel i anslutning till sangen. Ett annat exempel ãr att en fjarrkontroll fOr att stalla in luftfjadringen finns tillgänglig vid passagerarplatsen sa att den kan tas ut dA en kontroll sker. En sadan fjdrrkontroll är ofta ansluten via en kabel. This wish form has today been fulfilled by arranging buttons and controls in a number of stalls in, and in connection with, the vehicle which allows the systems and functions to be used even if the user is not in the driver 's seat. For example, the interior lighting can be controlled from a panel adjacent to the song. Another example is that a remote control for adjusting the air suspension is available at the passenger seat so that it can be removed when a control takes place. Such a remote control is often connected via a cable.
Det finns en rad exempel pa inmatningsgrdnssnitt fOr anvdndning i fordon och i det fiiljande kommer ett antal olika system att kortfattat diskuteras. There are a number of examples of input interfaces for use in vehicles and in the following a number of different systems will be briefly discussed.
US-7,248,151 avser ett virtuellt tangentbord fOr ett fordon som anvdnds i samband med att styra olika funktioner fOr fordonet, exempelvis fOr att lasa upp fordonet. Ett tangentbord projicieras exempelvis pa en sidoruta av fordonet. En detektor och en processor finns anordnade far att detektera gester och identifiera de gester som utfOrs pa tangentbordet. US-7,248,151 relates to a virtual keyboard for a vehicle which is used in connection with controlling various functions for the vehicle, for example for unlocking the vehicle. For example, a keyboard is projected on a side window of the vehicle. A detector and a processor are provided to detect gestures and identify the gestures performed on the keyboard.
Detektom kan exempelvis utgoras av en kamera eller en infraroddetektor. 1 537 7 US-7,050,606 avser ett system fcir att detektera och identifiera handgester som i syrmerhet är lampade fir att styra olika funktioner for ett fordon. Dessa funktioner avser exempelvis uppvarmning, luftkonditionering, belysning, CD/radioinstallningar, etc. The detector can, for example, be a camera or an infrared detector. US-7,050,606 relates to a system for detecting and identifying hand gestures which in particular are lit to control various functions of a vehicle. These functions relate to, for example, heating, air conditioning, lighting, CD / radio installations, etc.
I US-2011/0286676 beskrivs system och relaterade metoder avsedda for fordon fir att detektera och identifiera gester i tre dimensioner. Enligt en av metoderna ingar stegen att mottaga en eller flera obehandlade ramar med bilddata fran en sensor, att bearbeta och sla samman flera ramar for att identifiera kroppsdelar for anvandaren i fordonet, att berakna positionen for anden av handen fir anvandaren, att bestamma om handen har genomfort en dynamisk eller en statisk gest, att mottaga ett kommando som motsvarar en av ett antal lagrade gester, och att genomfora kommandot. US-2011/0286676 describes systems and related methods intended for vehicles for detecting and identifying gestures in three dimensions. According to one of the methods, the steps include receiving one or more raw frames with image data from a sensor, processing and merging several frames to identify body parts for the user in the vehicle, calculating the position of the spirit of the hand for the user, determining whether the hand has performed a dynamic or static gesture, to receive a command corresponding to one of a number of stored gestures, and to execute the command.
Har hanvisas aven till artikeln "Natural and Intuitive Hand Gestures: A Substitute for Traditional Vehicle Control", av A. Riener och M. Rossbory, publiserad i AutomotiveUI '11, November 29-December 2, 2011, Salzburg, Osterrike, Adjunct Proceedings. I artikeln beskrivs ett fors& ddr en forare via gester ger instruktioner for att styra ett antal funktioner. Vid forsoket har mycket av teknologin som anvands vid dataspel utnyttjats och da i synnerhet Microsoft Kinect som anvands for spelkonsolen Xbox. I forsoket har gester av handen utforda dá handen halls i narheten av vaxelspaken identifierats. En detektor i form av en kamera var monterad i taket och installd fir att infanga handrorelser i omradet runt vaxelspaken. He has also been referred to the article "Natural and Intuitive Hand Gestures: A Substitute for Traditional Vehicle Control", by A. Riener and M. Rossbory, published in AutomotiveUI '11, November 29-December 2, 2011, Salzburg, Austria, Adjunct Proceedings. The article describes a fors & ddr a driver via gestures gives instructions to control a number of functions. In the experiment, much of the technology used in computer games has been used, especially Microsoft Kinect, which is used for the Xbox game console. In the experiment, gestures of the hand were challenged when the hand held near the gear lever was identified. A detector in the form of a camera was mounted on the ceiling and installed to capture hand movements in the area around the gear lever.
Microsoft Kinect är saledes ett system som i forsta hand är anpassat for spelindustrin och som innebar att sensorer är anordnade i anslutning till en display ddr sensorerna omfattar en kamera och en 3D-sensor som kan, med stod av speciell mjukvara, detektera rorelser hos en anvandare i tre dimensioner och bland annat identifiera ansikten. Kinect-systemet anvands alltsa bland annat i spelkonsolen Xbox. Sensorn fOr tre dimensioner bestar av en infrarodlaserprojektor kombinerad med en monokrom CMOS-sensor, som kan detektera videodata i tre dimensioner i dagsljusferhallanden. Avkanningsavstandet kan stallas in for 3D-sensorn, och mjukvaran kan automatiskt kalibrera sensorn i beroende av vilket spel som spelas och spelarens fysiska omgivning, ddr hansyn kan tas till mobler och andra hinder. Systemet mojliggor avancerad rorelseigenkanning och kan samtidigt fOlja 2 537 7 rorelserna hos tva aktiva spelare dar rorelseanalysen kan ske genom att bedoma rorelsemoment fran upp till tjugo leder per spelare. Microsoft Kinect is thus a system that is primarily adapted for the gaming industry and which means that sensors are arranged in connection with a display where the sensors comprise a camera and a 3D sensor that can, with the help of special software, detect the movements of a user in three dimensions and, among other things, identify faces. The Kinect system is thus used in the Xbox game console, among other things. The three-dimensional sensor consists of an infrared laser projector combined with a monochrome CMOS sensor, which can detect video data in three dimensions in daylight conditions. The scanning distance can be set for the 3D sensor, and the software can automatically calibrate the sensor depending on the game being played and the player's physical environment, where he can take into account furniture and other obstacles. The system enables advanced motion recognition and can simultaneously follow the movements of two active players where the motion analysis can take place by assessing motion moments from up to twenty joints per player.
Kinect-systemets sensor matar ut videosignalen med en ramhastighet av 30 Hz. VideostrOmmen med RGB-signalen anvander en 8-bitars VGA-upplosning (640 x 480 pixlar) med ett fargfilter, medan den monokroma videostrommen for 3D-effekter har en VGA-upplosning (640 x 480 pixlar) pa 11 bitar, som ger en kanslighet i 2048 niva.er. Kinect-sensom fungerar pa avstand Mom omradet 1,2-3,5 meter da den anvands i samband med mjukvaran till Xbox, men kan ra ett utokat omrade som ligger inom 0,7-6,0 meter. Sensom har en horisontell detektionsvinkel ph 570 och en vertikal som är 43°. Sensom kan sedan vridas 27° i horisontell led. The Kinect system sensor outputs the video signal at a frame rate of 30 Hz. The video stream with the RGB signal uses an 8-bit VGA resolution (640 x 480 pixels) with a color filter, while the monochrome video stream for 3D effects has a VGA resolution (640 x 480 pixels) of 11 bits, which gives a possibility i 2048 niva.er. The Kinect sensor works at a distance of Mom in the range of 1.2-3.5 meters as it is used in connection with the software for the Xbox, but can be an extended range that is within 0.7-6.0 meters. The sensor has a horizontal detection angle ph 570 and a vertical that is 43 °. The sensor can then be rotated 27 ° horizontally.
For att ge foraren av ett fordon mojlighet att utnyttja de manga olika system och funktioner som idag finns i en modern lastbil finns ett flertal knappar och reglage anordnade i fordonet, inte bara i anslutning till fOrarplatsen utan exempelvis vid sangen och i form av fjarrkontroller. Dessa knappar och reglage haver ofta separata kabeldragningar vilket gör monteringen komplicerad och innebar hoga kostnader. Dessutom kan det ibland vara svart for fordonsforaren att veta var knappama sitter for en specifik funktion. To give the driver of a vehicle the opportunity to use the many different systems and functions that are present in a modern truck, there are several buttons and controls arranged in the vehicle, not only in connection with the driver's seat but for example at the song and in the form of remote controls. These buttons and controls often have separate wiring, which makes installation complicated and entails high costs. In addition, it can sometimes be difficult for the driver to know where the buttons are for a specific function.
Syftet med foreliggande uppfinning ãr att astadkomma ett forbattrat inmatningsgranssnitt som bade är mera anvandarvanligt och som innebar en kostnadsbesparing fOr fordonstillverkaren. The object of the present invention is to provide an improved input interface which is both more user-friendly and which entailed a cost saving for the vehicle manufacturer.
Sammanfattning av uppfinningen Ovan namnda syften astadkommes med uppfinningen definierad av de oberoende patentkraven. SUMMARY OF THE INVENTION The above objects are achieved by the invention defined by the independent claims.
Foredragna utforingsformer definieras av de beroende patentkraven. 3 537 7 Genom inmatningssystemet enligt foreliggande uppfinning kombineras ett projektorsystem och ett detektorsystem som är anpassat att detektera en persons kroppsrorelse. Preferred embodiments are defined by the dependent claims. The input system of the present invention combines a projector system and a detector system adapted to detect a person's body motion.
Vid implementeringen av inmatningssystemet enligt uppfinningen anvands miniatyrprojektorer och kamerasystem som bland annat awn anvdnds i samband med datorspel, exempelvis Microsoft Kinect som anvands i spelkonsolen Xbox (som beskrivits ovan). In the implementation of the input system according to the invention, miniature projectors and camera systems are used which, among other things, are used in connection with computer games, for example Microsoft Kinect which is used in the Xbox game console (as described above).
Enligt uppfinningen projiceras en virtuell pekskdrm pa en onskad yta i eller utanfor 10 lastbilen och anvands vid inmatning av styrinstruktioner till system och fimktioner i fordonet. Systemet anordnas exempelvis i innertaket av lastbilen sa att den virtuella skarmen kan projiceras pa varje tankbar position. According to the invention, a virtual touch screen is projected on a desired surface inside or outside the truck and is used in inputting control instructions to systems and functions in the vehicle. The system is arranged, for example, in the roof of the truck so that the virtual screen can be projected at any conceivable position.
Pekskdrmen kan exempelvis projiceras pa vaggen vid sidan av sdngen, pa madrassen, pa sdngen, pa golvet eller pa vaggar. Star man utanfor fordonet kan man projicera den virtuella pekskdrmen pa en platta man hailer i handen eller exempelvis pa dorrens insida eller pa insteget. The touch screen can, for example, be projected on the cradle next to the bed, on the mattress, on the bed, on the floor or on the cradles. If you stand outside the vehicle, you can project the virtual touch screen on a plate you hold in your hand or, for example, on the inside of the door or on the entrance.
Ddrigenom kan man ersatta flera knappar i lastbilen, till exempel fjarrkontrollen for luftfjddringen, belysningsknappar och kontrollenheten for uppvarmningssystemet. Vidare 20 finns mojligheten att sjdlv kunna definiera vilka system och funktioner som skall kunna kontrolleras via den virtuella pekskarmen. This allows you to replace several buttons in the truck, such as the remote control for the air suspension, lighting buttons and the control unit for the heating system. Furthermore, there is the possibility of being able to define which systems and functions can be controlled via the virtual touch screen.
Vid tillampning av foreliggande uppfinning erhalls ett system som dels är mera anvandarvanligt genom att tillgangligheten for styrning av fordonets olika system akar. 25 DeIs innebar det en kostnadsbesparing for tillverkaren av fordon eftersom exempelvis mindre kabeldragning kravs och farre knappar och styrenheter behovs. In the application of the present invention, a system is obtained which is partly more user-friendly in that the accessibility for controlling the various systems of the vehicle increases. 25 DeIs meant a cost saving for the manufacturer of vehicles because, for example, less cabling is required and fewer buttons and control units are needed.
Kort ritningsbeskrivning Figur 1 är ett blockschema som schematiskt illustrerar foreliggande uppfinning. Brief Description of the Drawings Figure 1 is a block diagram schematically illustrating the present invention.
Figur 2 visar ett flodesschema som illustrerar foreliggande uppfinning. 4 537 7 Detaljerad beskrivning av foredragna utfaringsformer av uppfinningen Foreliggande uppfinning kommer nu att beskrivas med hanvisning till de bifogade ritningarna och forst med hanvisning till blockschemat i figur 1. Figure 2 shows a flow chart illustrating the present invention. Detailed Description of Preferred Embodiments of the Invention The present invention will now be described with reference to the accompanying drawings and first with reference to the block diagram of Figure 1.
Foreliggande uppfinning avser ett inmatningssystem 2 far ett fordon, foretradesvis en lastbil, en buss, en husbil, men aven far personbilar. Inmatningssystemet innefattar ett projektorsystem 4, ett detektorsystem 6, vilka är anpassade att kommunicera med en styrenhet 8. The present invention relates to an input system 2 for a vehicle, preferably a truck, a bus, a motorhome, but also for passenger cars. The input system comprises a projector system 4, a detector system 6, which are adapted to communicate with a control unit 8.
Projektorsystemet 4 är anpassat att generera en virtuell pekskarm 10 innefattande en installbar inmatningsmeny anpassad for inmatning av styrinstruktioner for styrning av ett eller flera system for fordonet, varvid projektorsystemet 4 är anpassat att projicera den virtuella pekskarmen pA en visningsyta i eller vid fordonet. Projektorsystemet 4 ãr faretradesvis anordnat i innertaket av fordonets hytt. The projector system 4 is adapted to generate a virtual touch screen 10 comprising an installable input menu adapted for inputting control instructions for controlling one or more systems for the vehicle, the projector system 4 being adapted to project the virtual touch arm onto a display surface in or near the vehicle. The projector system 4 is arranged dangerously in the ceiling of the vehicle's cabin.
Projektorsystemet 4 innefattar atminstone minst en av en bildgenerator, exempelvis ett katodstraleror (CRT), en digital ljusbearbetningsenhet, och en optisk projiceringsenhet som bland annat innefattar optiska projektionslinser far att projicera en genererad WM. Projektorsystemet kan awn utgtiras av en laseranordning som "ritar" upp den virtuella pekskarmen. The projector system 4 comprises at least one of an image generator, for example a cathode ray tube (CRT), a digital light processing unit, and an optical projection unit which among other things comprises optical projection lenses for projecting a generated WM. The projector system can be operated by a laser device that "draws" the virtual touch screen.
I utforingsformen som visas i figuren bestAr projektorsystemet av tre enheter som är placerade pa olika positioner i och/eller omkring fordonet for att mojliggora projicering pa sa mAnga stallen som mojligt. Ett system med enbart en enhet är ocksa mojligt och dA kan enheten exempelvis vara placerade for projicering i anslutning till sangen. In the embodiment shown in the figure, the projector system consists of three units that are placed in different positions in and / or around the vehicle to enable projection on as many places as possible. A system with only one unit is also possible and dA the unit can, for example, be placed for projection in connection with the song.
Aven detektorsystemet 6 är foretradesvis anordnat i innertaket av fordonets hytt och kan ldmpligen vara anordnat i anslutning till projektorsystemet. I utforingsformen visad i figuren innefattar detektorsystemet tre enheter som vardera innefattar Atminstone minst en av en optisk datainsamlingsenhet, exempelvis en kamera eller en infraroddetektor. Foretradesvis innefattar detektorsystemet aven en ljuddetektor anpassad att detektera aktiveringsatgarder och inmatningsaktiviteter i form av ljud, exempelvis fran roster eller knackningar. 537 7 I samband med tillampning av uppfinningen är inmatningssystemet 2 anpassat att vara i atminstone tva tillstand, ett vilotillstand (standby-tillstand) och ett anvandningstillstand. The detector system 6 is also preferably arranged in the ceiling of the vehicle cab and may, in general, be arranged in connection with the projector system. In the embodiment shown in the figure, the detector system comprises three units, each of which comprises at least one of an optical data acquisition unit, for example a camera or an infrared detector. Preferably, the detector system also comprises a sound detector adapted to detect activation guards and input activities in the form of sound, for example from grids or knocks. In connection with the application of the invention, the input system 2 is adapted to be in at least two states, a rest state (standby state) and a use state.
Naturligtvis ãr inmatningssystemet aven i ett helt passivt tillstand da systemet är avstangt. Of course, the input system is also in a completely passive state when the system is switched off.
Inmatningssystemet 2 ãr saledes anpassat att: A - detektera en farsta aktiveringsatgard med namnda detektorsystem 6, och om en sadan forsta aktiveringsatgard detekteras, att B - initiera anvandningstillstandet. The input system 2 is thus adapted to: A - detect a first activation action with said detector system 6, and if such a first activation action is detected, to B - initiate the state of use.
I anvandningstillstandet bar systemet oppnats upp for anvandaren att valja var den virtuella pekskarmen skall projiceras. Anvandaren astadkommer detta genom att C - valja och bestamma en visningsyta for den virtuella pekskarmen 10. In the use state, the system was reached for the user to choose where the virtual touch screen should be projected. The user accomplishes this by C - selecting and determining a display area for the virtual touch screen 10.
Enligt en utforingsform avvaktar systemet pa att anvandaren skall bekrafta var pekskarmen skall projiceras bekraftas detta genom att anvandaren genomfor en andra aktiveringsatgard. Systemet är, enligt denna utfOringsform anpassat att - detektera en andra aktiveringsatgard med namnda detektorsystem 6. According to one embodiment, the system waits for the user to confirm where the touch screen is to be projected, this is confirmed by the user performing a second activation action. According to this embodiment, the system is adapted to - detect a second activation action with said detector system 6.
Darmed är inmatningssystemet klart att ta emot styrinstruktioner via den virtuella pekskarmen som projiceras pa den valda visningsytan. Detta sker genom stegen att: D - generera och projicera den virtuella pekskarmen med anvandning av namnda projektorsystem 4 pa vald visningsyta, E - ta emot, med anvandning av narnnda detektorsystem 6, inmatningar av styrinstruktioner i form av inmatningsaktiviteter via namnda projicerade inmatningsmeny och generera en inmatningssignal 12 i beroende darav, F - styra ett eller flera system i beroende av namnda inmatningssignal 12. Thus, the input system is ready to receive control instructions via the virtual touch screen projected on the selected display area. This is done by the steps of: D - generating and projecting the virtual touch screen using said projector system 4 on the selected display area, E - receiving, using said detector system 6, inputting control instructions in the form of input activities via said projected input menu and generating a input signal 12 depending thereon, F - controlling one or more systems depending on said input signal 12.
I figuren har styrningen av systemen och funktionerna for fordonet indikerats med en dubbelpil fran styrenheten 8. Styrenheten är foretradesvis kopplad till fordonets buss- system och styrsignalema som den genererar hanteras av fordonet pa normalt satt och behover darfor inte ytterligare beskrivas har. 6 537 7 Exempel pa system eller funktioner som ldmpligen kan styras via inmatningssystemet är belysning, uppvarmningssystem, radio, tv, multimedia, men aven t.ex. installning av luftfjddringen for lastbilen, exempelvis i samband med att ett slap kopplas pa. In the figure, the control of the systems and functions of the vehicle is indicated by a double arrow from the control unit 8. The control unit is preferably connected to the vehicle's bus system and the control signals it generates are handled by the vehicle normally and need not be further described. 6 537 7 Examples of systems or functions that can simply be controlled via the input system are lighting, heating systems, radio, television, multimedia, but also e.g. installation of the air suspension for the truck, for example in connection with a slack being switched on.
De forsta och, i forekommande fall, andra aktiveringsatgarderna innefattar en eller flera av ett fdrutbestamt rorelsemonster (en gest); en fingerknappning eller en knackning. Den forsta aktiveringsatgarden kan exempelvis vara att knacka tva ganger for att initiera anvandningstillstandet och sedan, enligt en utforingsform, genom att peka pA vald visningsyta genom en tydlig pekning med ett finger, som da utgor den andra aktiveringsatgarden, fa systemet att visa den virtuella pekskdrmen. The first and, where appropriate, the second activation measures include one or more of a predetermined motion pattern (a gesture); a finger tap or a tap. The first activation action may, for example, be to tap twice to initiate the use state and then, according to one embodiment, by pointing to the selected display area by a clear point with a finger, which then constitutes the second activation action, cause the system to display the virtual touch screen.
I anvdndningstillstandet projiceras inmatningsmenyn pa den virtuella pekskarmen. Exempelvis kan startmenyn, dvs. den forst visade inmatningsmenyn, vara beroende av var den virtuella pekskarmen projiceras. Om exempelvis pekskdrmen skall projiceras vid sangen visas en meny for att reglera belysning och radion. In use mode, the input menu is projected on the virtual touch screen. For example, the start menu, ie. the input menu first displayed, depending on where the virtual touch screen is projected. If, for example, the touch screen is to be projected at the song, a menu is displayed to adjust the lighting and the radio.
Inmatningsmenyn innefattar fciretradesvis ett flertal inmatningsmenyer uppbyggda i ett hierarkiskt system, ddr aktivering av en funktion sker genom specificerad inmatningsaktivitet. En inmatningsaktivit innefattar exempelvis att trycka pa ett fordefinierat inmatningsomrade pa inmatningsmenyn genom att halla handen/fingret minst en forutbestdmd tid (i storleksordningen delar av en sekund upp till flagon sekund) i inmatningsomradet. The input menu preferably comprises a plurality of input menus built up in a hierarchical system, in which activation of a function takes place through specified input activity. An input activity includes, for example, pressing a predefined input area on the input menu by holding the hand / finger for at least a predetermined time (on the order of parts of a second up to a flag second) in the input area.
For att veta att en inmatningsaktivitet accepteras av systemet är systemet anpassat att generera en forutbestamd kvittens som utgors av en eller flera av att inmatningsomradet (knappen) andrar farg eller form, och att en akustisk signal genereras. To know that an input activity is accepted by the system, the system is adapted to generate a predetermined acknowledgment which consists of one or more of the input area (button) changing color or shape, and that an acoustic signal is generated.
Foreliggande uppfinning innefattar aven en metod i samband med ett inmatningssystem for ett fordon, ddr inmatningssystemet innefattar ett projektorsystem och ett detektorsystem, vilka är anordnade att kommunicera med en styrenhet. Metoden kommer nu att kortfattat beslcrivas med hanvisning till flodesschemat i figur 2. Vidare hanvisas till relevanta delar av beskrivningen ovan av inmatningssystemet. 537 7 Projektorsystem är saledes anpassat att generera en virtuell pekskarm innefattande en installbar inmatningsmeny anpassad for inmatning av styrinstruktioner for styming av ett eller flera system for fordonet, varvid projektorsystemet är anpassat att projicera den virtuella pekskarmen pa en visningsyta i eller vid fordonet. The present invention also comprises a method in connection with an input system for a vehicle, the input system comprising a projector system and a detector system, which are arranged to communicate with a control unit. The method will now be briefly described with reference to the flow chart in Figure 2. Furthermore, reference is made to relevant parts of the above description of the input system. 537 7 The projector system is thus adapted to generate a virtual touch screen comprising an installable input menu adapted for inputting control instructions for controlling one or more systems for the vehicle, the projector system being adapted to project the virtual touch screen onto a display surface in or near the vehicle.
Inmatningssystemet är anpassat att vara i atminstone tva tillstand, ett vilotillstand och ett anvandningstillstand, varvid metoden innefattar stegen att: A - detektera en fOrsta aktiveringsatgard, B - initiera anvandningstillstandet, C - valja och bestamma en visningsyta for den virtuella pekskarmen, D - generera och projicera den virtuella pekskarmen med anvandning av namnda projektorsystem pa vald visningsyta, E - ta emot, med anvandning av namnda detektorsystem, inmatningar av styrinstruktioner i form av inmatningsaktiviteter via namnda projicerade inmatningsmeny och generera en inmatningssignal i beroende darav, F - styra ett eller flera system i beroende av namnda inmatningssignal (12). The input system is adapted to be in at least two states, a idle state and a use state, the method comprising the steps of: A - detecting an initial activation action, B - initiating the use state, C - selecting and determining a display area for the virtual touch screen, D - generating and projecting the virtual touch screen using said projector system on the selected display area, E - receiving, using said detector system, inputting control instructions in the form of input activities via said projected input menu and generating an input signal depending thereon, F - controlling one or more systems depending on said input signal (12).
Enligt en utfOringsform innefattar metoden att detektera en andra aktiveringsatgard med namnda detektorsystem, och att genomfOra steg D, och de efterfOljande stegen, forst da 20 namnda andra aktiveringsatgard detekterats. I figur 2 har detta valfria steg streckrnarkerats. According to one embodiment, the method comprises detecting a second activation action with said detector system, and performing step D, and the subsequent steps, only after said second activation action has been detected. In Figure 2, this optional step has been dashed.
De fOrsta och, om tillampligt, andra aktiveringsatgarderna innefattar exempelvis en eller flera av ett fOrutbestamt rorelsemonster (en gest), en knackning. The first and, if applicable, second activation measures include, for example, one or more of a predetermined motion pattern (a gesture), a knock.
Nar den virtuella pekskarmen är aktiverad och en inmatningsmeny visas kan olika funktioner aktiveras genom att generera olika inmatningsaktiviteter som innefattar att trycka pa ett fOrdefinierat inmatningsomrade genom att halla en hand/ett finger minst en forutbestamd tid i inmatningsomradet. Inmatningsmenyn innefattar foretradesvis ett flertal inmatningsmenyer uppbyggda i ett hierarkiskt system, och dar aktiveringen av en funktion sker genom en specificerad inmatningsaktivitet. En inmatningsaktivitet accepteras genom en forutbestamd kvittens som utgors av en eller flera av att inmatningsomradet (knappen) 537 7 andrar farg eller form, och att en akustisk signal genereras. When the virtual touch screen is activated and an input menu is displayed, different functions can be activated by generating different input activities which include pressing a predefined input area by holding a hand / finger for at least a predetermined time in the input area. The input menu preferably comprises a plurality of input menus constructed in a hierarchical system, and where the activation of a function takes place through a specified input activity. An input activity is accepted by a predetermined acknowledgment consisting of one or more of the input area (button) 537 7 changing color or shape, and an acoustic signal being generated.
Enligt en tillampning av uppfinningen skall projektorsystemet och detektorsystemet vara sá placerade att den virtuella pekskarmen projiceras sa att operatoren kan sta utanfor fordonet och justera exempelvis luftfiddringen for bakaxeln. According to an application of the invention, the projector system and the detector system should be positioned so that the virtual touch screen is projected so that the operator can stand outside the vehicle and adjust, for example, the air suspension for the rear axle.
I en ytterligare variant av insamlingssystemet enligt uppfinningen är det medligt att ldgga till vilka funktioner som systemet skall styra, och att dessutom paverka skarmutseendet till den funktionalitet som onskas. In a further variant of the collection system according to the invention, it is possible to add to which functions the system is to control, and also to influence the screen appearance to the functionality that is desired.
I samband med att projektorsystemet far instruktioner om var den virtuella pekskarmen skall projiceras kan den anpassa projektionen sa att pekskarmen far ett onskat utseende. Exempelvis tas hansyn till om visningsytan inte är vinkelrat i fOrhallande till den genererade bild sa att pekskarmen farvrangs. Detta kan astadkommas automatiskt genom en korrigeringsfunktion. In connection with the projector system receiving instructions on where the virtual touch screen is to be projected, the custom projection can be said to give the touch screen a desired appearance. For example, consideration is given to whether the display surface is not perpendicular in relation to the generated image so that the touch screen is colored. This can be achieved automatically through a correction function.
Foreliggande uppfinning är inte begransad till ovan-beskrivna foredragna utforingsformer. Olika alternativ, modifieringar och ekvivalenter kan anvandas. Utforingsformerna ovan skall ddrfar inte betraktas som begransande uppfinningens skyddsomrang vilket definieras av de bifogade patenticraven. The present invention is not limited to the above-described preferred embodiments. Various alternatives, modifications and equivalents can be used. The above embodiments are, therefore, not to be construed as limiting the scope of the invention as defined by the appended claims.
Claims (1)
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
SE1250488A SE537730C2 (en) | 2012-05-14 | 2012-05-14 | Projected virtual vehicle entry system |
BR112014028380A BR112014028380A2 (en) | 2012-05-14 | 2013-05-08 | input system ". |
RU2014150517A RU2014150517A (en) | 2012-05-14 | 2013-05-08 | INPUT SYSTEM |
PCT/SE2013/050519 WO2013172768A2 (en) | 2012-05-14 | 2013-05-08 | Input system |
CN201380025231.1A CN104508598A (en) | 2012-05-14 | 2013-05-08 | A projected virtual input system for a vehicle |
EP13790166.6A EP2850506A4 (en) | 2012-05-14 | 2013-05-08 | A projected virtual input system for a vehicle |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
SE1250488A SE537730C2 (en) | 2012-05-14 | 2012-05-14 | Projected virtual vehicle entry system |
Publications (2)
Publication Number | Publication Date |
---|---|
SE1250488A1 SE1250488A1 (en) | 2013-11-15 |
SE537730C2 true SE537730C2 (en) | 2015-10-06 |
Family
ID=49584416
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
SE1250488A SE537730C2 (en) | 2012-05-14 | 2012-05-14 | Projected virtual vehicle entry system |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP2850506A4 (en) |
CN (1) | CN104508598A (en) |
BR (1) | BR112014028380A2 (en) |
RU (1) | RU2014150517A (en) |
SE (1) | SE537730C2 (en) |
WO (1) | WO2013172768A2 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104020878A (en) | 2014-05-22 | 2014-09-03 | 小米科技有限责任公司 | Touch input control method and device |
DE102014226546A1 (en) * | 2014-12-19 | 2016-06-23 | Robert Bosch Gmbh | Method for operating an input device, input device, motor vehicle |
IT201700091628A1 (en) * | 2017-08-08 | 2019-02-08 | Automotive Lighting Italia Spa | Virtual man-machine interface system and corresponding virtual man-machine interface procedure for a vehicle. |
US11144153B2 (en) | 2017-12-07 | 2021-10-12 | Elliptic Laboratories As | User interface with acoustic proximity and position sensing arrangements |
IT201800003722A1 (en) * | 2018-03-19 | 2019-09-19 | Candy Spa | APPLIANCE WITH USER INTERFACE |
DE102018216662A1 (en) * | 2018-09-27 | 2020-04-02 | Continental Automotive Gmbh | Dashboard layout, procedure and use |
DE102019200632B4 (en) * | 2019-01-18 | 2021-11-25 | Audi Ag | Control system with portable interface unit and motor vehicle with the control system |
DE102020201235A1 (en) | 2020-01-31 | 2021-08-05 | Ford Global Technologies, Llc | Method and system for controlling motor vehicle functions |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7050606B2 (en) | 1999-08-10 | 2006-05-23 | Cybernet Systems Corporation | Tracking and gesture recognition system particularly suited to vehicular control applications |
AU2003291304A1 (en) * | 2002-11-06 | 2004-06-03 | Julius Lin | Virtual workstation |
US20060072009A1 (en) * | 2004-10-01 | 2006-04-06 | International Business Machines Corporation | Flexible interaction-based computer interfacing using visible artifacts |
US7248151B2 (en) | 2005-01-05 | 2007-07-24 | General Motors Corporation | Virtual keypad for vehicle entry control |
US20060158616A1 (en) * | 2005-01-15 | 2006-07-20 | International Business Machines Corporation | Apparatus and method for interacting with a subject in an environment |
DE102005059449A1 (en) * | 2005-12-13 | 2007-06-14 | GM Global Technology Operations, Inc., Detroit | Control system for controlling functions, has display device for graphical display of virtual control elements assigned to functions on assigned display surface in vehicle, and detection device for detecting control data |
DE112008001396B4 (en) * | 2007-06-05 | 2015-12-31 | Mitsubishi Electric Corp. | Vehicle operating device |
US8396252B2 (en) | 2010-05-20 | 2013-03-12 | Edge 3 Technologies | Systems and related methods for three dimensional gesture recognition in vehicles |
-
2012
- 2012-05-14 SE SE1250488A patent/SE537730C2/en unknown
-
2013
- 2013-05-08 EP EP13790166.6A patent/EP2850506A4/en not_active Withdrawn
- 2013-05-08 RU RU2014150517A patent/RU2014150517A/en unknown
- 2013-05-08 CN CN201380025231.1A patent/CN104508598A/en active Pending
- 2013-05-08 BR BR112014028380A patent/BR112014028380A2/en not_active Application Discontinuation
- 2013-05-08 WO PCT/SE2013/050519 patent/WO2013172768A2/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
SE1250488A1 (en) | 2013-11-15 |
RU2014150517A (en) | 2016-07-10 |
WO2013172768A2 (en) | 2013-11-21 |
WO2013172768A3 (en) | 2014-03-20 |
EP2850506A4 (en) | 2016-09-28 |
CN104508598A (en) | 2015-04-08 |
EP2850506A2 (en) | 2015-03-25 |
BR112014028380A2 (en) | 2017-06-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
SE537730C2 (en) | Projected virtual vehicle entry system | |
US11094132B2 (en) | System and method for presentation and control of augmented vehicle surround views | |
EP1725035B1 (en) | Image display apparatus and method for a vehicle | |
CN101379455B (en) | Input device and its method | |
US8854304B2 (en) | Image generation system, image generation method, and information storage medium | |
KR102176998B1 (en) | Amusement park amusement control management system and method | |
EP2659336B1 (en) | User interface, apparatus and method for gesture recognition | |
JP2010085186A (en) | Calibration device for on-vehicle camera | |
JPH05184A (en) | Video synchronizing device for competition game machine | |
CN103809876A (en) | Vehicle image system and image display control method thereof | |
JP2011039600A (en) | Device and method for supporting parking | |
JP2016038621A (en) | Space input system | |
US20200282909A1 (en) | Vehicle imaging system and method for a parking solution | |
WO2018061603A1 (en) | Gestural manipulation system, gestural manipulation method, and program | |
CN112905004B (en) | Gesture control method and device for vehicle-mounted display screen and storage medium | |
US10853962B2 (en) | Device, system, and method of determining reclining state | |
KR20100120767A (en) | Device and method for controlling avn of vehicle | |
CA3141141A1 (en) | Contextually significant 3-dimensional model | |
KR102304391B1 (en) | vehicle and control method thereof | |
JP2016029532A (en) | User interface | |
US20120281097A1 (en) | Vehicle media system | |
CN102970460A (en) | Method and system for adjusting vehicle imaging device | |
GB2526515A (en) | Image capture system | |
JP4368233B2 (en) | Spatial input system | |
CN115442581B (en) | Vehicle-mounted VR glasses control method and device and computer equipment |