WO2005066750A1 - Systeme d'exploitation pour vehicule - Google Patents

Systeme d'exploitation pour vehicule Download PDF

Info

Publication number
WO2005066750A1
WO2005066750A1 PCT/EP2004/013210 EP2004013210W WO2005066750A1 WO 2005066750 A1 WO2005066750 A1 WO 2005066750A1 EP 2004013210 W EP2004013210 W EP 2004013210W WO 2005066750 A1 WO2005066750 A1 WO 2005066750A1
Authority
WO
WIPO (PCT)
Prior art keywords
entries
keywords
menu
display area
operating system
Prior art date
Application number
PCT/EP2004/013210
Other languages
German (de)
English (en)
Inventor
Rainer Daude
Original Assignee
Daimlerchrysler Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Daimlerchrysler Ag filed Critical Daimlerchrysler Ag
Priority to JP2006545944A priority Critical patent/JP2007522488A/ja
Priority to US10/584,459 priority patent/US20070256027A1/en
Publication of WO2005066750A1 publication Critical patent/WO2005066750A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/148—Instrument input by voice

Definitions

  • the invention relates to an operating system for a vehicle according to the preamble of patent claim 1.
  • DE 197 52 056 AI describes an operating system for a motor vehicle.
  • two display areas are displayed on a screen in a menu structure with several menu levels.
  • a first display area is arranged as a frame around the second display area.
  • eight fields with entries that correspond to executable applications and are arranged vertically and horizontally are displayed in the first display area.
  • An entry is selected by sliding or tilting the manual actuating means with several degrees of freedom of adjustment in the direction of the position of the corresponding entry in the first display area.
  • a selected entry is activated by pressing the manual control.
  • several vertically arranged entries are displayed in a second menu level in the second display area, which are assigned to the activated entry in the first menu level.
  • the one in the second Entries shown in the display area are selected by rotating the manual actuation means and activated by pressing the manual actuation means.
  • the activated second display area and the second menu level are exited by the sliding or tilting movement of the manual actuating means in the direction of a position of one of the entries in the first display area.
  • the operating system is then again in the first display area on the first menu level.
  • EP 1 342 605 AI describes an operating system for a motor vehicle with a screen display, a manual actuating means with several degrees of freedom of adjustment and means for voice control.
  • the screen display comprises several display areas for displaying entries of a menu structure with several menu levels, the entries of the menu structure being selectable and / or activatable by the manual actuation means and / or the voice control means.
  • the entries of the menu structure shown on the screen display simultaneously form the keywords that can currently be entered for voice-operated menu navigation.
  • No. 4,827,520 describes an operating system for a motor vehicle with a screen display, a plurality of manual actuating means which are arranged in the vicinity of the screen display, and means for voice control.
  • the screen display comprises several display areas for displaying entries of a menu structure with several menu levels, wherein the entries of the menu structure can be selected and / or activated by the manual actuation means and / or the voice control means.
  • the entries in the menu structure shown on the screen display or on the manual actuating means form simultaneously the currently enterable keywords for voice-operated menu navigation.
  • US 4,797,924 describes an operating system for a motor vehicle with a screen display, several manual actuating means and means for voice control.
  • the various vehicle components such as telephone system, radio, etc. can be operated both via the manual actuation means and via the voice control means.
  • voice control the terms that can be entered are hierarchically arranged in a command structure with a plurality of command levels, wherein only terms of a current command level can be entered and understood and executed by the voice control means.
  • the object of the invention is to provide an improved operating system for a vehicle, by means of which an intuitive voice control is made possible and the operating comfort is improved.
  • the invention solves this problem by providing an operating system for a vehicle with the features of claim 1.
  • the invention is based on the idea of dividing entries of a menu structure represented on a screen display with several menu levels into different groups, a first group comprising entries which can only be selected and / or activated with a manual actuating means.
  • a second group comprises entries which are selected using the manual actuation means and / or voice control means. cash and / or can be activated.
  • the entries of the second group are divided into at least two groups of terms, which can be determined by simple rules and which determine which keywords for menu navigation can currently be entered, ie in the current menu level and / or in the currently active display area, by means of language.
  • the operating system enables a user to operate the menu structure with several menu levels by means of voice control means and / or the manual actuation means.
  • the entries assigned to the first group include, for example, setting processes for changeable parameters such as volume, balance, bass, treble, fade, station selection of an analogue animated treadmill or cursor for a radio application, etc., which are most easily set using the manual actuating means, for example by means of a continuous adjustment movement can be.
  • the entries assigned to the second group which can be operated using the voice control means and / or the manual actuating means, are simultaneously used as a possible keyword for voice control and, according to the invention, are divided into several groups of terms in order to enable the user to quickly switch between applications and / or the menu levels enable.
  • the entries can be divided, for example, depending on the different display areas and / or menu levels.
  • a possible rule is, for example, all entries in a first display area can only be operated manually, all entries in a second, fourth and fifth display area can be operated manually and / or by voice and the entries in a third operating area are manual in a first and second menu level and / or can be operated by voice and can only be operated manually in a third menu level.
  • the voice control means can be adapted to the needs of different users.
  • the definition rules allow the keywords to be assigned to different term groups, for example the keywords currently displayed in an active display area of the screen display can be assigned to a first term group, which are available to the voice control means as a first partial vocabulary.
  • These keywords indicate, for example, to a user what input is expected from him in the currently active display area and / or in the current menu level.
  • local keywords can be assigned to a second term group, which are available as a second partial vocabulary to the voice control means in addition to the first partial vocabulary, the local keywords that can be entered being dependent on the current menu level. This makes it possible for a user with more practice to enter keywords by voice that are not in the currently active display area are represented by entries, but belong to the direct environment of a selected application.
  • global keywords can be assigned to a third term group, which are available as a third sub-vocabulary in addition to the first and second sub-vocabulary and are independent of the current menu level.
  • an inexperienced user is able to easily and reliably record the possible keywords in the currently displayed screen display and to be able to select and activate the associated entries, which improves the intuitive voice control and the ease of use for the inexperienced user increases.
  • the additional global and local keywords enable an experienced user in voice control to skip menu levels within the menu structure and to enter terms that are not visible on the current screen display using voice, since it can be assumed that the experienced user at least has internalized selected keywords or keyword combinations after a certain period of use.
  • the division into different groups can also ensure that the function suitable for the current menu level or for the active display area of the screen display is carried out if different functions or different functions are assigned to a keyword in different menu levels. This increases the ease of use even for an experienced user.
  • the same functionality can be triggered by the voice input of an entry as in the case of a corresponding manual input with the manual actuating means, for example in the voice input of a keyword from the third group of terms.
  • the functionality after a voice input can be restricted compared to a manual input, for example when voice inputting a keyword from the first or second term group, the restriction of the functionality depending on the current menu level and / or the active display area.
  • a voice input selects a specific entry, i.e. places a cursor on this entry, the entry is activated by an additional manual operation, for example by pressing the manual actuating means.
  • the opened display area can only be closed by manual input and remain open after a voice input.
  • entries from a list that can be input by voice are identified, for example, by a preceding or trailing numbering.
  • the entry identified by the numbering can then be used as p, the corresponding number of the numbering can also be entered using language.
  • the entries that can be entered using speech can be identified by a special optical display on the screen, in which the entries that can be entered by speech can be identified by a different color and / or a different intensity and / or a different size and / or another Shape are marked.
  • the third group of terms each includes, for example, a key word for application groups that can be operated in the vehicle, such as navigation system, audio system, telephone / communication system, video / TV system, air conditioning and / or vehicle comfort systems such as the persistence of the interior lighting, Seat adjustment, etc., with which the respective application group can be selected and / or activated.
  • the third term group can include keywords for applications of these application groups, which can be selected from the corresponding application menus.
  • the associated audio application menu includes, for example, the radio, CD, DVD, etc. sub-applications, which can then be selected using a global keyword.
  • global keywords for returning to the previous screen display for example "back", and for canceling the eye Visible voice input, such as "error" or "abort” provided.
  • the second group of terms includes, for example, all keywords for functions that are assigned to the respective application and that can be entered by means of language, regardless of whether they are currently displayed in the active display area or not.
  • Keywords of the first term group are preferably all entries for sub-functions of the selected function that are displayed in the currently active display area.
  • the keywords from the three groups of terms can also include dynamic entries which, due to changing boundary conditions, e.g. Names of currently receivable radio stations, or changing system states, e.g. Executable functions and / or sub-functions and / or options that depend on the current system status change.
  • FIG. 1 shows a block diagram of an operating system for a motor vehicle
  • FIG. 2 shows a schematic illustration of a screen display from FIG. 1 in a first menu level
  • FIG. 3 shows a schematic illustration of the screen display from FIG. 1 in a third menu level
  • FIG. 4 shows a schematic illustration of the screen display from FIG. 1 in a second menu level
  • FIG. 5 shows a schematic illustration of the screen display from FIG. 1 in a third menu level
  • FIG. 6 shows a schematic illustration of the screen display from FIG. 1 in a fourth menu level
  • FIG. 7 shows a schematic illustration of the screen display from FIG. 1 in a fifth menu level
  • FIG. 8 shows a schematic illustration of the screen display from FIG. 1 in a second menu level
  • the operating system 1 for a motor vehicle comprises a screen display 2, a manual actuating means 3, a control and evaluation unit 4, voice control means 6 and several vehicle systems, such as a navigation system, a heating and air conditioning system, a mobile phone, a video system, an audio system, etc., which are shown collectively as an element 5.
  • vehicle systems transmit signals to the evaluation and control unit 4, from which the control and evaluation unit 4 determines current system states. All applications and / or functions and / or subfunctions and / or options and / or status displays in different menu levels of a menu structure are operated by the manual actuating means 3.
  • predetermined applications and / or functions and / or subfunctions and / or options and / or status displays in different menu levels of the menu structure, redundant for operation with the manual actuating means 3, can be operated with the voice control means 6 by means of a corresponding voice input.
  • the voice control means 6 comprise, for example, voice input means 6.2, for example at least one microphone, a voice recognition unit 6.1, voice output tel 6.3, for example at least one speaker and at least one storage unit 6.4.
  • keywords for the voice control means 6 are divided into at least two groups of terms, which can be determined by simple rules and which determine which keywords can currently be entered for menu navigation.
  • a first term group currently comprises entries which are displayed in an active display area of the screen display 2 and which at the same time provide a first partial vocabulary to the voice control means 6 as keywords.
  • the keywords of the first group of terms are therefore dependent on the active display area and / or on the menu level.
  • a second group of terms includes local keywords that are available to the voice control means 6 as a second sub-vocabulary in addition to the first sub-vocabulary and are dependent on the current menu level.
  • a third term group comprises global keywords which are available to the voice control means 6 as a third sub-vocabulary in addition to the first and second sub-vocabulary and are independent of the current menu level and / or of the active display area.
  • the entries shown on the screen display 2 which can be input by means of speech, can have an identification, which is implemented, for example, as a special optical representation and by a different color and / or a different intensity and / or a different size and / or a different shape is achievable. 2 to 8, this is shown in bold.
  • the manual actuating means 3 has seven degrees of adjustment freedom for the selection and / or activation of entries shown in an active display area. It can be pushed in four directions as shown by the arrow in FIG. 1, ie in a positive x direction, a negative x direction, in a positive y direction or in a negative y direction. In addition, it can be rotated clockwise or counterclockwise about a z axis, not shown, perpendicular to the plane of the drawing and pushed in the direction of the negative z direction, ie into the plane of the drawing.
  • the selection and / or activation of an entry shown on the screen display 2 takes place by pushing or rotating the manual actuating means 3. Redundant for vertical pushing along an axis, ie for Pushing in the y direction, or for pushing horizontally along an axis, ie for pushing in the x direction, the manual actuating means 3 can be rotated about the z axis.
  • the slide direction for selecting an entry corresponds to the orientation of the entries shown in the active display area.
  • the shift direction that is orthogonal to the selection slide direction leads to leaving the active display area.
  • the activation of a selected entry may require the manual actuation means 3 to be pressed.
  • the screen display 2 comprises in a first menu level a graphical basic structure of five vertically arranged, horizontal display areas 210 to 250. This graphical basic structure is constant over the majority of the different menu levels of the menu structure.
  • the screen display 2 is designed, for example, as an eight inch screen with an aspect ratio of 15: 9.
  • the graphical basic structure of the display area 230 is variable as a function of an activated application and / or function and / or subfunction and / or option and / or status display across the majority of the different menu levels of the menu structure, i.e. the graphic design of this central display area 230 can be very different.
  • the display areas 210, 220, 240 and 250 each comprise a different number of entries in the first menu level.
  • the first display area thus comprises 210 five entries 1.1 to 1.5
  • the second display area 220 five entries 2.1 to 2.5
  • the fourth display area comprises no entry
  • the fifth display area comprises seven entries 5.1 to 5.7. 2
  • the second display area 220 is activated and the hatched entry 2.1 (navigation system) is selected.
  • the hatched representation should indicate that the cursor is on entry 2.1.
  • the entries 1.1 to 5.7 of the display areas 210 to 250 shown on the screen display 2 can be arranged according to their content-related importance or frequency of use.
  • the schematic representation of the screen display 2 in FIGS. 2 to 8 is adapted to the operation for a motor vehicle with special entries.
  • the first display area 210 is designed as a status line which displays various status displays 1.1 to 1.5 from different applications.
  • the main function of the status line is the representation of important current system states, which are determined by the control and evaluation unit 4 as a function of signals from the vehicle systems 5.
  • the entries or status displays 1.1 to 1.5 can only be selected and activated with the manual actuating means 3.
  • the signals from the navigation system with the locating unit, from the heating and air conditioning system, from the mobile phone, from the video system, from the audio system, etc. are evaluated.
  • the status line shows, for example, whether a traffic information station is activated, whether the heating and air conditioning system works in recirculation or fresh air mode, whether the activated carbon filter is activated, etc.
  • the first display area 210 which is designed as a status line, can contain a plurality of operable and non-operable entries 1.1 to 1.5, which are shown or hidden depending on the system state. The operability of some entries can allow direct access to important functions without requiring a change of application. If an entry is selected from the status line, this can immediately lead to an associated function. For example, by activating a letter symbol, a display area can be activated and opened in a ComTel application, ie in a communication or telephone application.
  • Activating a telephone symbol can activate and open another display area in the ComTel application group.
  • the activation of a TP symbol deactivates a traffic program, ie a traffic information station.
  • a traffic program ie a traffic information station.
  • various status indicators that cannot be selected such as a satellite dish for displaying GPS reception or a field strength, can be displayed.
  • the second display area 220 is designed as an application line for displaying different selectable and predefinable application groups 2.1 to 2.5, in particular a navigation (Navi), an audio, a telephone / communication (Tel / Com), a video and a vehicle application group , wherein the number and position of the entries to be displayed, ie the application groups 2.1 to 2.5, are constant and the graphical representation of the entries to be displayed is variable depending on an activated application group.
  • the activation of one of the application groups 2.1 to 2.5 which is not already active, leads to a change to the associated application and to an activation of the fourth Display area 240 for displaying functions and / or subfunctions belonging to the activated application. If an application does not have functions or subfunctions, then by activating this application in the second display area 220, the third display area 230 can be activated and the options for operation associated with this application can be displayed.
  • the arrangement of the application groups in the second display area 220 is constant and can be determined from left to right according to frequency of use or importance. Selecting an application or application group leads to an immediate activation of at least one other display area and can be carried out by manual input with the manual actuating means 3 or by voice input via the voice control means.
  • the entries 2.1 through 2.5 of the application line 220 identified by boldface are assigned as keywords to the first term group, which includes keywords of the active display area. Since none of the entries from one of the five display areas has yet been activated, the entire screen in FIG. 2 corresponds to the active display area.
  • entries 2.1 to 2.5 are assigned as global keywords to the third group of terms.
  • the third display area 230 is designed as an application area for displaying details and operating a selected and activated application.
  • the number and the position as well as the graphical representation of the entries to be displayed depend on the activated application 2.1 to 2.5.
  • the graphic representation and operability speed of the third display area 230 is variable and can therefore be adapted well to a strongly varying functionality or requirements of the different applications 2.1 to 2.5.
  • the fourth display area 240 is designed as a function line for displaying and selecting functions and / or sub-functions and / or options of an activated application 2.1 to 2.5.
  • the number and the position and the graphical representation of the entries to be displayed, i.e. The functions and / or sub-functions depend on the activated application 2.1 to 2.5 and / or on the menu level.
  • the basic graphic structure is constant across all menu levels of the menu structure.
  • the fifth display area 250 is designed as a main application line.
  • a presettable application can be displayed in this display area 250.
  • the number and the position of the entries 5.1 to 5.7 to be displayed are constant for the preset application and the content and the graphic representation of the entries 5.1 to 5.7 to be displayed are variable and / or constant depending on current system states.
  • the preset application is preferably used to operate an air conditioning system in the vehicle.
  • the entry 5.1 (climate) which can be selected and / or activated by voice input is identified in bold and assigned to the first and third groups of terms.
  • the displayed values of a set parameter such as air temperature, blower strength, etc., can vary.
  • the current system states relate in particular to relevant states for temperature control in the vehicle interior, such as, for example, outside temperature, intensity of solar radiation, interior temperature, air humidity, etc. 4 shows the screen display 2 in a further menu level after the entry 2.2 (audio) in the second display area 220 has been selected by pushing the manual actuating means 3 in the positive x direction and activated by pressing the manual actuating means 3 or by voice input of the Entry 2.2 "Audio" was selected and activated.
  • Activation of entry 2.2 opens and activates the application menu assigned to entry 2.2 in display area 220.1.
  • application menu 220.1 six entries are shown as examples, which are assigned to the third group of terms and of which an entry "Radio "is selected. This is indicated by the circle in front.
  • the entries in the application menu 220.1 in this menu level are additionally assigned to the first term group.
  • the entries 4.1 to 4.4 of the function line belonging to the radio application selected in the application menu 220.1 are displayed in the fourth display area 240.
  • the entries 4.1 to 4.4 of the function line are assigned to the second term group as local keywords belonging to the radio application.
  • the display area 230.1 belonging to the selected radio application is opened in the third display area 230.
  • the entries Senderl to Sender5 shown in the open display area 230.1 correspond to selectable radio stations.
  • the entries of the currently active application menu 220.1 can be selected and activated with the manual actuating means 3 by means of a corresponding adjustment movement.
  • the active display area 220.1 can be exited by a corresponding adjustment movement be closed again.
  • An entry from the display area 220.1 can be selected and activated by a voice input in the screen display 2 shown in FIG. 4, as a result of which the application menu is subsequently closed and closed.
  • the third concept area which includes the entries of the application line 2.1 to 2.5, the main application line 250 that can be entered by voice, and the entries of the application menus assigned to the respective applications, which can be entered by voice, it is possible to switch to another display area.
  • the voice input of one of the keywords from the application line 220 can be used to switch to an application menu assigned to the entered entry for further operation, as a result of which the currently active display area 220.1 is also exited and closed.
  • a voice input from one of the local keywords from the second term group for example from one of the entries from the display area of the function line 240, leads to an activation of the assigned function; This makes it clear how a quick change between the applications and thus between the individual menu levels is possible through the grouping of the keywords according to the invention without having to go back through the menu structure.
  • the other display areas can be withdrawn, for example displayed darker and / or the application menu 220.1 can be visually highlighted, for example displayed lighter.
  • the user also gets to the screen display shown in FIG. 3 if he enters the global keyword “radio” via a voice input in the first menu level from FIG. 2.
  • the application group 2.2 is “audio” in the application line 220 selected and the "Radio" function assigned to the "Radio” application is selected in the function line 240.
  • the entry "Sender3" in the display area 230.1 is selected and activated by the cursor shown as a vertical bar.
  • the transmitter setting can be carried out by a corresponding manual adjustment process using the manual actuating means 3 or by entering the local keyword "next transmitter".
  • the currently displayed keywords of the first term area are the entries 4.1 to 4.4 of the function line 240, which are marked in bold and which are opened when one of the functions is activated by a corresponding selection and activation of the assigned entry from the function line 240.
  • the entries in the display area 230.1 cannot be operated by voice input, since the rule applies that within the display area 230 only entries displayed as a vertical or horizontal list can be operated by voice input. In an alternative embodiment, however, it can be provided that all text entries of the third display area 230 can be operated by voice input.
  • the keyword "radio” is an example of different functionalities that can be assigned to a keyword.
  • the radio application is activated, the application menu 220.1 is closed and switched to the display according to FIG. 3.
  • a function menu (not shown) of the radio application is opened for further operation, it being possible to select and / or activate a station search, station storage etc. in this function menu.
  • the screen display 2 from FIG. 5 is reached. This screen display is also reached when in the application menu 220.1 from FIG. 4, the “CD” entry shown there is selected and activated by means of voice input or manual input.
  • the subapplication “CD” is carried out with the settings that were made before the last exit of the subapplication.
  • the application “audio” in the application line 220 and the entry “CD” in the function line 240 are selected
  • the display area 23.0 shows two further display areas 230.2 and 230.3, which display the settings of the “CD” sub-application.
  • the entries in the application line 2.1 to 2.5, the function line 4.1 to 4.4 and the entry 5.1 of the main application "Climate" are marked in bold on the screen and can be entered as keywords by voice input all local and global keywords can be entered.
  • the screen display 2 changes to the menu level from FIG. 6.
  • four display areas 230.4 "heights” are shown in this menu level. , 230.5 “Basses”, 230.6 “Balance / Fader” and 230.7 “Surround sound” for selection and / or activation and / or setting of associated sub-functions in the active third display area 230.
  • the activated application 2.2 "Audio" is in the second menu line 220 activated, which is shown by the hatched representation of the associated field.
  • the selected sub-function 3.1 “heights” is marked accordingly by a hatched representation
  • the local and global keywords already mentioned can be entered.
  • another global keyword "back” is displayed in the subfunction line 240. This keyword leads to a return to the previous display on the screen display 2 in all menu levels. If, in the screen display 2 shown in FIG. 6, the sub-function "basses” is selected and activated, for example by manual input or by voice input, the screen display 2 shows the representation according to FIG. 7.
  • the display area 230.5 for setting the parameter of the sub-radio The "bass" function is activated. This is indicated to the user by a display area 230.5 which is enlarged compared to the representation from FIG. 6.
  • the setting of the subfunction can now be carried out with the manual actuating means 3; 0 set. If a submenu is implemented as a list with text entries as in FIG. 7 or 8, the number of entries can be unlimited, the number of maximally visible entries being limited, for example to nine entries. If there are more than nine entries, an entry can be selected by scrolling. Arrows can be used to indicate that there are other invisible entries. In order to be able to scroll using voice input, a corresponding key word can be displayed next to the arrow, for example “continue” or “back”.
  • FIG. 8 shows an illustration of the screen display in the menu level from FIG. 3, in which, in contrast to the illustration from FIG. 3, the individual list elements of the application menu 220.1 are identified by a preceding numbering.
  • the numbering is implemented by an ascending sequence of numbers. Alternatively, letters can also be used to identify the individual list elements. The numbering can also be placed after the individual list elements.
  • the numbering on the one hand indicates to the user that the list elements can be selected and / or activated by voice input and that the selection and / or activation can also be carried out by voice input of the corresponding number, ie number or letter, which is assigned to the desired list element , In principle, all of the displayed entries 1.1 to 5.7 can be selected with the manual actuating means 3.
  • the cursor is not an independent object on the screen display 2, but takes the form of the field on which it is placed. In the described embodiment, this applies to the first, second, fourth and fifth display areas 210, 220, 240, 250.
  • the cursor is displayed by changing the graphic display of the field on which it is placed, for example by changing the color of the respective entry 1.1 to 5.7, in which the color of the entry 1.1 to 5.7 is inverted.
  • the placement of the cursor on a field represents the selection of the entry belonging to this field.
  • This display can be deviated if a parameter setting can already be made by turning or moving the cursor or if the entry is displayed graphically instead of text. In this case the cursor is displayed in a different graphic form. That kind of Cursor display can be spatially limited to the third display area 230.
  • the cursor is always within a so-called active display area 210 to 250, i.e. in an immediately operable display area 210 to 250, in which one of the entries can be selected and / or activated by rotating and depending on the orientation of the entries 1.1 to 5.7, either horizontally or vertically sliding the manual actuating means 3.
  • This active display area 210 to 250 is oriented either vertically or horizontally.
  • the entries in the active display area 210 to 250 can be highlighted in color, for example by means of a light font and / or icons and / or graphics on a dark background, text entries corresponding to the keywords that can be entered by means of speech.
  • this display area can be delimited by a horizontal or vertical bright line, which serves, for example, to illustrate the direction of rotation.
  • the activation state can be displayed via a highlighted entry and / or via the highlighted cursor.
  • the display areas 210 to 250 which are not directly active, can be shown graphically withdrawn, for example by a different color and / or by a different intensity. These non-activated display areas 210 to 250 can be selected by pushing the manual actuating means 3 orthogonally in relation to the alignment of the entries in the active display area 210 to 250. In addition, a selection of the inactive display areas 210 to 250 is made by a corresponding voice input of local or global keywords from the second or third term group possible.
  • Entries that cannot be selected at times can still be displayed, for example in a color-contrasting and weakened form.
  • the cursor cannot be moved to such entries.
  • These entries can be skipped, for example, or the movement of the manual actuating means 3 can be limited, for example, in the form of a stop which prevents the cursor from being moved onto the non-selectable field. If such an entry is accidentally entered by voice input, the user receives the visual and / or acoustic message that the entry is not available at the moment. Voice inputs for a selection of components that have not been implemented can also be answered.
  • possible global keywords of the third term group are the entries for the application groups navigation system 2.1, audio system 2.2, telephone / communication system 2.3, TV / video system 2.4, vehicle systems 2.5 and heating and air conditioning 5.1.
  • the entries in the application menus assigned to the application groups are global keywords from the third term group.
  • the navigation application menu includes global keywords for the selectable applications or options such as start route guidance, cancel route guidance, map display, dynamization, etc.
  • the audio application menu includes global keywords for the selectable applications or options such as radio, CD, audio DVD, MP3, audio out, etc.
  • That Telephone / communication application menu includes, for example, global keywords for the selectable applications or options such as browser, address book, notebook, telephone, news, radio services, telephone, etc.
  • the TV / video application menu includes, for example, global keywords for the selectable applications or options such as DVD, TV, video off, etc.
  • the vehicle system application menu includes, for example, global keywords for the selectable applications or options such as exterior mirror setting, afterglow time, ambient lighting, trunk lid limitation, etc.
  • the global keywords are, as already explained above, by the voice control means 6 recognized in all menu levels and passed on to the evaluation and control unit 4 for executing the assigned functionality.
  • Possible local keywords for entries of the second term group are the entries assigned to the applications in the function line 240.
  • the navigation application group in the function line includes local keywords for the selectable functions or options such as position, destination, full screen etc. when route guidance is switched off
  • the navigation application group in the function line 240 includes, for example, local keywords for the functions or options such as route, position, repeat driving directions, destination, full screen, etc.
  • the audio application group in the function line 240 for the radio application selected for example, includes local keywords for the selectable functions or Options such as radio, memory, sound, FM, etc.
  • the function line 240 includes, for example, local keywords for the selectable functions or options such as CD, track list, changer, sound, etc.
  • For the selected one Application MP3 includes function line 240, for example local keywords for the selectable functions or options MP3, title, folder, changer and sound.
  • the telephone / communication application group includes, for example, local keywords for the selectable functions or options such as search and new entry.
  • the selected messages application comprises, for example, local keywords for the selectable functions or options such as input, new, drafts, output, messages, etc.
  • the TV / video application group includes, for example, local keywords for the selectable functions or options such as memory, teletext, sound, etc.
  • the vehicle system application group includes, for example, local keywords for the selectable functions or options system settings and user profiles.
  • the local keywords are, as already explained above, by the voice control means 6 depending on the menu level, i.e. recognized and activated by the selected application group and passed on to the evaluation and control unit 4 for executing the assigned functionality.
  • Possible keywords for entries in the first term group are the entries assigned to the functions in the associated function menu.
  • the first term group includes keywords for a function menu for entering addresses such as entering a place, street, house number, starting route guidance, etc. and, for a function menu for the destination memory, the keywords delete, change , etc.
  • the audio group includes, for example, keywords for a function menu such as treble, bass, balance / fader, etc.
  • the first group includes, for example, keywords for a teletext function menu.
  • the first group includes, for example, keywords for a function menu, password entry or for a function menu, seat.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un système d'exploitation pour un véhicule, qui comprend un système d'affichage par écran (2) comportant plusieurs zones de représentation pour représenter des entrées d'une structure de menu à plusieurs plans, un moyen d'actionnement manuel (3) pour sélectionner et/ou activer au moins une entrée dans un plan de menu présent, de la structure de menu, des moyens de commande vocale (6) pour une sélection redondante et/ou une activation d'au moins une entrée de la structure de menu, qui constitue simultanément un mot de passe pour les moyens de commande vocale (6). Selon l'invention, les entrées de la structure de menu sont réparties en différents groupes, un premier groupe comprenant des entrées ne pouvant être sélectionnées et/ou activées que par le moyen d'actionnement manuel (3), un second groupe comprenant des entrées pouvant être sélectionnées et/ou activées par le moyen d'actionnement manuel (3) et/ou les moyens de commande vocale (6). Le second groupe est réparti en au moins deux groupes de concepts, qui peuvent être fixés par réglage simple et qui déterminent les mots de passe à introduire au moment présent pour la mise en oeuvre du menu.
PCT/EP2004/013210 2003-12-23 2004-11-20 Systeme d'exploitation pour vehicule WO2005066750A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2006545944A JP2007522488A (ja) 2003-12-23 2004-11-20 車両用の制御システム
US10/584,459 US20070256027A1 (en) 2003-12-23 2004-11-20 Control System for a Motor Vehicle

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE10360655.6 2003-12-23
DE10360655A DE10360655A1 (de) 2003-12-23 2003-12-23 Bediensystem für ein Fahrzeug

Publications (1)

Publication Number Publication Date
WO2005066750A1 true WO2005066750A1 (fr) 2005-07-21

Family

ID=34683785

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2004/013210 WO2005066750A1 (fr) 2003-12-23 2004-11-20 Systeme d'exploitation pour vehicule

Country Status (4)

Country Link
US (1) US20070256027A1 (fr)
JP (1) JP2007522488A (fr)
DE (1) DE10360655A1 (fr)
WO (1) WO2005066750A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007097669A (ja) * 2005-09-30 2007-04-19 Konami Digital Entertainment:Kk 項目決定装置、項目決定方法、ならびに、プログラム
JP2008030674A (ja) * 2006-07-31 2008-02-14 Mazda Motor Corp 車両用情報処理装置
EP1953029A2 (fr) 2007-02-01 2008-08-06 Volkswagen Aktiengesellschaft Dispositif d'affichage et de commande doté de possibilités de sélection améliorées d'un contexte d'affichage et d'utilisation actuel
DE102007023290A1 (de) 2007-05-16 2008-11-20 Volkswagen Ag Multifunktionsanzeige- und Bedienvorrichtung und Verfahren zum Betreiben einer Multifunktionsanzeige- und Bedienvorrichtung mit verbesserter Auswahlbedienung

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5007510B2 (ja) * 2006-02-13 2012-08-22 コニカミノルタビジネステクノロジーズ株式会社 文書処理装置および文書処理システム
US7788600B2 (en) * 2006-08-22 2010-08-31 Harman International Industries, Incorporated User interface for multifunction device
DE102007012595B4 (de) * 2006-10-23 2014-02-13 Johnson Controls Gmbh Verfahren und Vorrichtung zur Bedienung von in ein Kraftfahrzeug integrierten elektrischen Geräten
US9471333B2 (en) * 2006-11-03 2016-10-18 Conceptual Speech, Llc Contextual speech-recognition user-interface driven system and method
DE102006060520B4 (de) * 2006-12-21 2020-03-26 Daimler Ag Bedien- und Anzeigesystem für ein Fahrzeug, insbesondere für einen Reisebus oder ein Nutzfahrzeug
DE102007026542A1 (de) * 2007-06-08 2008-12-11 Volkswagen Ag Vorrichtung und Verfahren zum Einstellen eines Klangortes eines Audiosystems im Innenraum eines Kraftfahrzeugs
DE102007036425B4 (de) 2007-08-02 2023-05-17 Volkswagen Ag Menügesteuertes Mehrfunktionssystem insbesondere für Fahrzeuge
DE102008046092A1 (de) * 2007-09-06 2009-09-03 Bernd Hopp Endloser Navigator
DE102007051010A1 (de) 2007-10-25 2009-04-30 Bayerische Motoren Werke Aktiengesellschaft Verfahren zur Anzeige von Information
DE102007052345A1 (de) 2007-11-02 2009-05-07 Volkswagen Ag Verfahren und Vorrichtung zum Bedienen einer Einrichtung eines Fahrzeugs mit einer Sprachsteuerung
KR101564318B1 (ko) * 2008-10-14 2015-11-02 삼성전자주식회사 디스플레이장치 및 그의 사용자 인터페이스 표시방법
DE102008052442A1 (de) 2008-10-21 2009-06-10 Daimler Ag Verfahren und Bedienvorrichtung zur Bedienung mehrerer Funktionseinheiten in einem Kraftfahrzeug
US9108513B2 (en) 2008-11-10 2015-08-18 Volkswagen Ag Viewing direction and acoustic command based operating device for a motor vehicle
US8700332B2 (en) 2008-11-10 2014-04-15 Volkswagen Ag Operating device for a motor vehicle
DE102009018590B4 (de) 2009-04-23 2022-11-17 Volkswagen Ag Kraftfahrzeug mit einer Bedienvorrichtung und dazugehöriges Verfahren
US9727132B2 (en) * 2011-07-01 2017-08-08 Microsoft Technology Licensing, Llc Multi-visor: managing applications in augmented reality environments
DE102011121110A1 (de) * 2011-12-14 2013-06-20 Volkswagen Aktiengesellschaft Verfahren zum Betreiben eines Sprachdialogsystems in einem Fahrzeug und dazugehöriges Sprachdialogsystem
DE102012010490A1 (de) * 2011-12-17 2013-06-20 Volkswagen Aktiengesellschaft Verfahren und Bedienvorrichtung zum Einstellen von Fahrzeugfunktionen
KR20130078486A (ko) * 2011-12-30 2013-07-10 삼성전자주식회사 전자 장치 및 그의 제어 방법
JP5790578B2 (ja) * 2012-04-10 2015-10-07 株式会社デンソー 表示システム、表示装置、及び操作装置
WO2014063099A1 (fr) * 2012-10-19 2014-04-24 Audience, Inc. Placement de microphone pour l'élimination de bruit dans des véhicules
US9508345B1 (en) 2013-09-24 2016-11-29 Knowles Electronics, Llc Continuous voice sensing
US9953634B1 (en) 2013-12-17 2018-04-24 Knowles Electronics, Llc Passive training for automatic speech recognition
US9437188B1 (en) 2014-03-28 2016-09-06 Knowles Electronics, Llc Buffered reprocessing for multi-microphone automatic speech recognition assist
US10289260B2 (en) * 2014-08-27 2019-05-14 Honda Motor Co., Ltd. Systems and techniques for application multi-tasking
US10297251B2 (en) * 2016-01-21 2019-05-21 Ford Global Technologies, Llc Vehicle having dynamic acoustic model switching to improve noisy speech recognition
US10402161B2 (en) 2016-11-13 2019-09-03 Honda Motor Co., Ltd. Human-vehicle interaction
US20190019516A1 (en) * 2017-07-14 2019-01-17 Ford Global Technologies, Llc Speech recognition user macros for improving vehicle grammars
DE102017219616B4 (de) 2017-11-06 2022-06-30 Audi Ag Sprachsteuerung für ein Fahrzeug
JP6962158B2 (ja) * 2017-12-01 2021-11-05 ヤマハ株式会社 機器制御システム、機器制御方法、及びプログラム
JP7004955B2 (ja) * 2017-12-11 2022-01-21 トヨタ自動車株式会社 サービス提供装置、サービス提供プログラム及び音声認識によるサービスを提供する方法
JP7266432B2 (ja) * 2019-03-14 2023-04-28 本田技研工業株式会社 エージェント装置、エージェント装置の制御方法、およびプログラム
DE102022000387A1 (de) 2022-02-01 2023-08-03 Mercedes-Benz Group AG Verfahren zur Verarbeitung von Spracheingaben und Bedieneinrichtung zur Steuerung von Fahrzeugfunktionen

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19752056A1 (de) * 1997-11-25 1999-05-27 Bayerische Motoren Werke Ag Vorrichtung zur Steuerung einer Bildschirmanzeige
FR2783625A1 (fr) * 1998-09-21 2000-03-24 Thomson Multimedia Sa Systeme comprenant un appareil telecommande et un dispositif de telecommande vocale de l'appareil
WO2000055717A1 (fr) * 1999-03-16 2000-09-21 Telefonaktiebolaget Lm Ericsson Appareil de communication portable a systeme de menu hierarchise et menu dynamique
WO2001097211A2 (fr) * 2000-06-16 2001-12-20 Healthetech, Inc. Dispositif de reconnaissance vocale pour assistant numerique
WO2002010900A2 (fr) * 2000-07-28 2002-02-07 Siemens Automotive Corporation Interface utilisateur pour systemes de telematique
EP1342605A1 (fr) * 2002-03-04 2003-09-10 Ford Global Technologies, Inc., A subsidiary of Ford Motor Company Dispositif de commande d'écran de visualisation

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4797924A (en) * 1985-10-25 1989-01-10 Nartron Corporation Vehicle voice recognition method and apparatus
US4827520A (en) * 1987-01-16 1989-05-02 Prince Corporation Voice actuated control system for use in a vehicle
US6819990B2 (en) * 2002-12-23 2004-11-16 Matsushita Electric Industrial Co., Ltd. Touch panel input for automotive devices

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19752056A1 (de) * 1997-11-25 1999-05-27 Bayerische Motoren Werke Ag Vorrichtung zur Steuerung einer Bildschirmanzeige
FR2783625A1 (fr) * 1998-09-21 2000-03-24 Thomson Multimedia Sa Systeme comprenant un appareil telecommande et un dispositif de telecommande vocale de l'appareil
WO2000055717A1 (fr) * 1999-03-16 2000-09-21 Telefonaktiebolaget Lm Ericsson Appareil de communication portable a systeme de menu hierarchise et menu dynamique
WO2001097211A2 (fr) * 2000-06-16 2001-12-20 Healthetech, Inc. Dispositif de reconnaissance vocale pour assistant numerique
WO2002010900A2 (fr) * 2000-07-28 2002-02-07 Siemens Automotive Corporation Interface utilisateur pour systemes de telematique
EP1342605A1 (fr) * 2002-03-04 2003-09-10 Ford Global Technologies, Inc., A subsidiary of Ford Motor Company Dispositif de commande d'écran de visualisation

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007097669A (ja) * 2005-09-30 2007-04-19 Konami Digital Entertainment:Kk 項目決定装置、項目決定方法、ならびに、プログラム
JP2008030674A (ja) * 2006-07-31 2008-02-14 Mazda Motor Corp 車両用情報処理装置
EP1953029A2 (fr) 2007-02-01 2008-08-06 Volkswagen Aktiengesellschaft Dispositif d'affichage et de commande doté de possibilités de sélection améliorées d'un contexte d'affichage et d'utilisation actuel
DE102007005026A1 (de) 2007-02-01 2008-08-07 Volkswagen Ag Anzeige- und Bedienvorrichtung mit verbesserter Auswahlmöglichkeit eines aktuellen Anzeige- und Bedienkontextes
DE102007023290A1 (de) 2007-05-16 2008-11-20 Volkswagen Ag Multifunktionsanzeige- und Bedienvorrichtung und Verfahren zum Betreiben einer Multifunktionsanzeige- und Bedienvorrichtung mit verbesserter Auswahlbedienung
US8766911B2 (en) 2007-05-16 2014-07-01 Volkswagen Ag Multifunction display and operating device and method for operating a multifunction display and operating device having improved selection operation

Also Published As

Publication number Publication date
DE10360655A1 (de) 2005-07-21
JP2007522488A (ja) 2007-08-09
US20070256027A1 (en) 2007-11-01

Similar Documents

Publication Publication Date Title
WO2005066750A1 (fr) Systeme d'exploitation pour vehicule
EP1195673B1 (fr) Système multimédia pour un vehicule avec fonction d'affichage animé
DE10360656A1 (de) Bediensystem für ein Fahrzeug
DE10393781T5 (de) Duales haptisches Fahrzeugsteuerungs- und -anzeigesystem
EP1953029B1 (fr) Dispositif d'affichage et de commande doté de possibilités de sélection améliorées d'un contexte d'affichage et d'utilisation actuel
DE102006018672A1 (de) Multifunktionsbedieneinrichtung und Radionavigationssystem für ein Kraftfahrzeug
EP3282352B1 (fr) Procédé et dispositif de commande permettant la commande d'un dispositif
WO2012143068A1 (fr) Procédé et dispositif pour la fourniture d'une interface utilisateur, en particulier dans un véhicule
DE10328200B4 (de) Navigationsgerät für ein Kraftfahrzeug
EP1442920B1 (fr) Dispositif et procédé d'accès à une fonction d'un automobile
DE10245333A1 (de) Eingabevorrichtung
EP2925552B1 (fr) Procédé de commande et système de commande dans un véhicule automobile
WO2005066751A1 (fr) Systeme d'utilisation d'un vehicule
EP1966678B1 (fr) Dispositif de commande pour appareil electronique, en particulier dispositif d'information au conducteur
DE19941945A1 (de) Verfahren und Vorrichtung zum Darstellen aktivierter Bedien- und Anzeigebereiche
DE10026760A1 (de) Verfahren zur Zuordnung von Bedienfunktionen zu Bedienelementen einer elektronischen Vorrichtung, welche umschaltbar die Funktionen mehrerer elektronischer Geräte, insbesondere Geräte der Kraftfahrzeug-Komfortelektronik, ausüben kann, und entsprechende Vorrichtung
EP1555608A1 (fr) Système de reconnaissance de parole pour un appareil électronique, en particulier dans un véhicule
DE10360661A1 (de) Bediensystem für ein Kraftfahrzeug
DE10360660A1 (de) Bediensystem für ein Kraftfahrzeug
DE102004029824A1 (de) Bediensystem für ein Fahrzeug
EP3364283A1 (fr) Système d'exploitation, procédé de fonctionnement d'un système d'exploitation et véhicule doté d'un système d'exploitation
DE102006060841A1 (de) Bediensystem für ein Kraftfahrzeug
DE10360658A1 (de) Bediensystem für ein Kraftfahrzeug
EP2927043B1 (fr) Procédé et système de commande dans un véhicule
DE10339525A1 (de) Vorrichtung und Verfahren zur Eingabe von Begriffen und/oder Befehlen

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006545944

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase
WWE Wipo information: entry into national phase

Ref document number: 10584459

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 10584459

Country of ref document: US