JP6280134B2 - Helmet-based navigation notification method, apparatus, and computer program - Google Patents

Description

  Exemplary embodiments of the present invention relate generally to user interface technology, and more particularly to a method, apparatus, and computer program for displaying a navigation notification suitable for a helmet within the helmet. Is.

background

  Current communication technology has led to a significant expansion of wired and wireless networks. While mobile radio network technology meets demand, it has provided flexibility and instantaneousness of information transmission. With the expansion of network technology, computing power has also expanded, and affordable computing devices that can use services realized by the latest network technology have been developed. This expansion in computing power has led to smaller computing devices, and a new generation of portable devices that can implement functionality that would require the processing power of modern desktop computers a few years ago. Producing. As a result, portable computing devices with small form factors have become established and used by almost all socio-economic background consumers to access network application services.

Abstract

  Furthermore, embodiments of the apparatus, method and computer program product according to the present invention are disclosed. These devices, methods, and computer program products provide a helmet-based display interface that displays navigation information tailored for display within a helmet. In particular, an embodiment of an apparatus for providing a helmet-based display interface may comprise at least one processor and at least one memory storing computer program code. The at least one memory and the computer program code, in conjunction with the processor, determining that a helmet is worn on a user while the navigation event is occurring on the device; and associated with the navigation event; Determining a set of navigation notifications; causing the set of navigation notifications to be displayed in the helmet. The set of navigation notifications can be adjusted for display in the helmet.

  The set of navigation notifications is a first set of navigation notifications, and the memory and the computer program code are further different from the second set of navigation notifications associated with the navigation event in the device, together with the processor. Determining the first set of navigation notifications to determine to determine the first set of navigation notifications. Here, the second set of navigation notifications is not adjusted for display within the helmet. The memory and the computer program code further, together with the processor, determine the set of navigation notifications such that the device includes fewer navigation notifications than the second set of navigation notifications associated with the navigation event. To determine to determine the first set of navigation notifications.

  In some embodiments, the memory and the computer program code are further coupled with the processor to determine the set of navigation notifications by determining the set of navigation notifications so that the device does not include a map display. Configured to perform the determination. The memory and the computer program code further determine, with the processor, the set of navigation notifications by determining the set of navigation notifications so that the device includes at least one motorcycle-specific notification. Configured to run. Here, the at least one motorcycle-specific notification includes at least one of a next curve angle, a next slope, and a weather condition. Additionally or alternatively, the memory and the computer program code are further coupled with the processor to determine the set of navigation notifications based on a set of navigation notifications set by the user on the device. Configured to perform determining a set of notifications.

  In some embodiments, the memory and the computer program code further determine, in conjunction with the processor, the set of navigation notifications based on a display area of a plurality of notification information within the helmet. To determine the set of navigation notifications. Determining the set of navigation notifications may include determining how to assign the set of navigation notifications within a display area of notification information within the helmet. Further, determining the set of navigation notifications determines how to allocate the set of navigation notifications within a display area of notification information in the helmet based on an allocation setting set by a user. You may include that.

  In some other embodiments, an apparatus and computer program product determines that a user is wearing a helmet while a navigation event is occurring; navigation notifications associated with the navigation event; Determining a set; and causing the set of navigation notifications to be displayed within the helmet is described with respect to providing a helmet-based display interface. The set of navigation notifications can be adjusted for display in the helmet.

  In some cases, the set of navigation notifications is a first set of navigation notifications, and determining the first set of navigation notifications is different from the second set of navigation notifications associated with the navigation event. Determining a first set of said navigation notifications. Determining the first set of navigation notifications such that determining the first set of navigation notifications includes fewer navigation notifications than the second set of navigation notifications associated with the navigation event. May be included.

  In some embodiments, determining the set of navigation notifications may include determining the set of navigation notifications so as not to include a map display. Additionally or alternatively, determining the set of navigation notifications includes determining the set of navigation notifications to include at least one motorcycle-specific notification, wherein the at least one motorcycle-specific notification The notification may include one or more of the following curve angle, the next slope of the slope, and weather conditions. In still other embodiments, determining the set of navigation notifications may include determining the set of navigation notifications based on navigation notifications set by a user.

  Determining the set of navigation notifications may include determining the set of navigation notifications based on a display area of a plurality of notification information in the helmet. Determining the set of navigation notifications may include determining how to assign the set of navigation notifications within a display area of notification information within the helmet. Further, determining the set of navigation notifications includes determining allocation of the set of navigation notifications within a display area of notification information in the helmet based on an allocation setting set by a user. There is a case.

  In still other embodiments, an apparatus for providing a helmet-based display interface is disclosed. The apparatus includes: means for determining that a user is wearing a helmet while a navigation event is occurring; means for determining a set of navigation notifications associated with the navigation event; Means for displaying in the helmet. As will be described later, the set of navigation notifications can be adjusted for display in the helmet.

Having generally described embodiments of the present invention, reference will now be made to the accompanying drawings. Note that the scale of the drawing is not always accurate.
FIG. 3 depicts a block diagram of an apparatus with a user interface according to an exemplary embodiment. FIG. 2 is a schematic block diagram of a mobile terminal according to an exemplary embodiment. 1 depicts an example of a helmet with a visor equipped with a pass-through display according to an exemplary embodiment of the present invention. FIG. 6 depicts an example of a landscape through a visor having a display area according to an exemplary embodiment of the present invention. FIG. 6 depicts a touch screen on a device used to obtain navigation data in accordance with the exemplary embodiments described herein. FIG. 6 depicts navigation data displayed to a user via the touch display of FIG. 5 in accordance with an exemplary embodiment described herein. FIG. 6 depicts a set of navigation notifications in accordance with the exemplary embodiments described herein. FIG. 4 illustrates a portion of a display area navigation notification provided to a visor according to an exemplary embodiment described herein. FIG. 6 depicts a view through a pass-through display according to an exemplary embodiment described herein. FIG. 6 depicts a flow diagram according to an exemplary method for navigation notification adapted to a helmet for display within the helmet, in accordance with an exemplary embodiment described herein. FIG. 6 depicts a flow diagram according to another exemplary method for navigation notification adapted to a helmet for display within the helmet, in accordance with an exemplary embodiment described herein.

Detailed explanation

  Hereinafter, exemplary embodiments of the present invention will be described in more detail with reference to the accompanying drawings.

  Note that not all embodiments of the present invention are introduced. Indeed, since the invention may be implemented in a variety of forms, it should not be considered that the embodiments of the invention are limited to the embodiments introduced herein. Rather, the embodiments introduced herein are introduced so that this specification will satisfy legal requirements. Like numbers represent like elements throughout the specification and drawings.

  As used herein, “data”, “content”, “information” and like terms are one or more of the terms that may be transmitted, received, and stored in various exemplary embodiments. Used interchangeably to refer to data. For this reason, such terms should not be considered as limiting the scope or technical spirit of the present disclosure.

  The term “computer-readable medium” as used herein may be any medium that can provide information, including execution instructions, to a processor. Such a medium may take a variety of forms and includes volatile or non-volatile non-transitory computer readable storage media and transmission media. However, it is not limited to these. The transmission medium can be, for example, a coaxial cable, a copper wire, an optical fiber cable, a carrier wave that travels through space without going through a wire or cable, and the carrier wave includes a sound wave or an electromagnetic wave. , And infrared. The signal includes artificial and transient fluctuations related to amplitude, frequency, phase, polarization and other physical characteristics transmitted through the transmission medium. Examples of non-transitory computer-readable media include magnetic computer-readable media such as flexible disks, hard disks, magnetic tapes, and other magnetic media, compact disks, read-only memory (CD-ROM), digital versatile disks (DVD), Optical computer readable media such as Blu-ray Disc, random access memory (RAM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), flash EPROM, or other non-transitory media that the computer can read Including. As used herein, the term computer readable storage medium refers to any computer readable medium except transmission media. However, it should be understood that other types of computer readable media may be substituted or used in addition to computer readable storage media in embodiments described as using computer readable storage media. It is also possible to do.

  Further, in this specification, the term “circuitry” refers to (a) a circuit implemented only by hardware (for example, an analog circuit and / or digital circuit), or (b) one or more computers. A combination of software and / or firmware and circuitry recorded in a readable memory that causes the apparatus to perform one or more of the functions described herein in a coordinated manner; (c) for example one Software or firmware (even if not physically present) to operate as one or more circuits, such as those of the above microprocessors or one or more microprocessors A circuit that needs to be expressed. This definition of “circuitry” is to be applied throughout the specification and claims. By way of further example, as used herein, the term “circuitry” refers to one or more processors and / or one or more portions thereof and the software and / or firmware associated therewith. Including implementations. By way of further example, as used herein, the term “circuitry” can mean, for example, a baseband integrated circuit or an application processor integrated circuit for a mobile phone, and It can mean similar integrated circuits in servers, cellular network devices, other network devices, and other computing devices.

  Conventional navigation equipment and systems are not optimized for use by motorcycle riders. Most of the conventional devices are devices that are held and operated by hand, and are attached to a motorcycle handlebar or attached to a motorcycle tank. Attached to this motorcycle tank, the rider must keep an eye on the road to see the displayed navigation information. Road attention is important for the safety of all types of vehicle drivers, but is especially important for motorcycles because motorcycles tend to be driven at high speeds. And motorcycle riders are particularly vulnerable to even small changes in road surface and environmental conditions. Thus, anything that distracts a motorcycle driver can have disastrous consequences, and any delay in the driver's reaction time can put the driver at great risk.

  Conventional navigation equipment, such as Global Positioning System (GPS) equipment, is configured to provide a very rugged display and interaction model. And this conventional navigation apparatus provides abundant information to a user. Some of this information may not be necessary or useful for motorcycle drivers, and in fact may distract the driver's attention or unnecessarily disturb the driver's forward view . Traditional head-mounted displays may allow information to be displayed across some helmet visors, and motorcycle operators especially benefit from getting minimal information while driving be able to.

  Furthermore, embodiments of the present invention are configured to allow a motorcycle or other driver's attention to be concentrated on the road by providing a helmet-based display interface. Here, the helmet-based display interface displays navigation information suitable for display within the helmet. Thus, according to the apparatus, system, and method of the present invention, when a helmet capable of display is connected to a navigation device, the user is provided with a specific set of navigation guidance information adapted to the needs of the motorcycle driver. It is explained that it is generated and displayed. Furthermore, embodiments of the present invention also provide for the measurement and display of additional navigation information. This additional navigation information may not be applicable to normal navigation and may not be useful, but may be important to motorcycle drivers. This additional information can include information regarding the angle of the curve of the road that passes next, the elevation angle and inclination of the slope. Furthermore, as will be described later in detail, the embodiment of the present invention can customize the display information to meet the needs of the user.

  FIG. 1 depicts a block diagram of a device 102 for adapting navigation notifications for display in a helmet. The device 102 is merely an example of an embodiment, and should not be considered as limiting the scope of the technical idea of the present invention in any way. In this regard, it should be noted that the technical ideas disclosed herein include many possible implementations in addition to the embodiments described and illustrated in the specification and drawings. Although FIG. 1 illustrates one example configuration of a device that facilitates interaction with a user interface, many other configurations may be used to implement embodiments of the present invention.

  The device 102 may be a fixed device or a portable device. Here, there are desktop computers and the like as fixed devices, and laptop computers, mobile terminals, portable computers, mobile phones, portable communication devices, game devices, digital cameras, video cameras, audio players as portable devices. , Video players, television sets, radio receivers, digital video recorders, positioning devices, chipsets, computer devices with chipsets, any combination thereof, and the like. In this regard, the apparatus 102 can comprise any computer device, such as a computer device comprising a display, a computer device operable in communication with the display. In some exemplary embodiments of the invention, apparatus 102 is implemented as a portable computing device such as the mobile terminal illustrated in FIG.

  Here, FIG. 2 depicts a block diagram of the mobile terminal 10 representing an example of an embodiment of the device 102. However, the device 100 depicted in this figure and described below is merely illustrative of one type of apparatus 102 that may be implemented (and / or may benefit according to) various exemplary embodiments of the invention. Therefore, it should not be construed as limiting the scope of the matter disclosed herein. Several implementations of electronic devices are depicted here and described for illustration, but other types of electronic devices such as mobile phones and portable computers, personal digital assistants (PDAs), pagers, etc. Various types of electronic systems, such as laptop computers, desktop computers, gaming devices, positioning devices, tablet computers, televisions, electronic newspapers, etc., may use various implementations of the invention.

  As shown, the mobile terminal 10 may include an antenna (s) 12 that cooperates with a transmitter 14 and a receiver 16. The mobile terminal 10 may comprise a processor 20 configured to exchange signals with a transmitter and a receiver. The processor 20 can be embodied as various means, for example. Such means include, for example, circuitry, one or more microprocessors with cooperating DSPs, one or more processors without DSPs, one or more coprocessors, processing circuits, One or a plurality of computers and various other processing elements are included. The “other various processing elements” include, for example, integrated circuits such as ASICs, FPGAs, and combinations thereof. In FIG. 2, the processor 20 is depicted as a single processor, but may be a plurality of processors in some embodiments. Signals exchanged by the processor 20 may include available cellular systems and signaling information in accordance with various wired / wireless network technology standards. Non-limiting examples of such technologies include Wi-Fi and wireless local area network (WLAN) technologies such as IEEE 802.11 and IEEE 802.16 standards. Further, such signals may include voice data, data generated by the user, data requested by the user, and the like. In this regard, the mobile terminal may be operable according to one or more radio interface standards, communication protocols, modulation types, and access types. More specifically, the mobile terminal can use various communication protocols such as first generation (1G), second generation (2G), 2.5G, third generation (3G), fourth generation (4G), SIP, It may have the ability to operate with IMS communication protocols such as. For example, the mobile terminal operates with IS-136 (Time Division Multiple Access (TDMA)), GSM (registered trademark), IS-95 (Code Division Multiple Access (CDMA)), etc., which are second generation wireless communication protocols. May have the ability to Further, for example, the mobile terminal may have a capability of operating with GPRS (General Packet Radio Service), which is a 2.5 generation radio communication protocol, or with Enhanced Data GSM Environment (EDGE). Further, for example, the mobile terminal may have the capability of operating in UMTS (Universal Mobile Telecommunications System), CDMA2000, WCDMA (registered trademark), TD-SCDMA, etc., which are third generation wireless communication protocols. The mobile terminal may have a capability of operating in Long Term Evolution (LTE), E-UTRAN (Evolved Universal Terrestrial Radio Access Network), which is a 3.9th generation wireless communication protocol. Further, for example, the mobile terminal may have a capability of operating with a fourth generation (4G) wireless communication protocol or a similar wireless communication protocol that will be developed in the future.

  Narrow-band Advanced Mobile Phone System (NAMPS) for dual mode or higher mode phones (for example, phones with digital and analog modes, phones with TDMA and CDMA, analog modes) In addition, TACS (Total Access Communication System) may also benefit from the realization of the present invention. Furthermore, the mobile terminal 10 may have a capability of operating according to a Wi-Fi (Wireless Fidelity) protocol or a WiMAX (registered trademark) protocol.

  The processor 20 may include a circuit that implements the audio / video function and logic function of the mobile terminal 10. Further, the processor 20 may include a DSP device, a microprocessor device, an A / D converter, a D / A converter, and the like. The mobile terminal signaling and information processing functions may be assigned in these devices according to their capabilities. The processor may include a built-in speech encoder (VC) 20a, a built-in data modem (DM) 20b, and the like. Further, the processor may have the ability to execute one or more software programs (such as applications) that can be recorded in memory. For example, the processor 20 may have a capability of executing a communication program such as a web browser. Such a communication program enables the mobile terminal 10 to transmit and receive Web content. Such Web content includes location-based content according to protocols such as WAP (Wireless Application Protocol) and HTTP (Hypertext Transfer Protocol). The mobile terminal 10 may have a capability of using TCP / IP (Transmission Control Protocol / Internet Protocol) in order to transmit / receive WEB content to / from the Internet or other networks.

  The mobile terminal 10 may also include, for example, an earphone or speaker 24, a ringer 22, a microphone 26, a display 28, and a user interface including a user input interface, all of which are controllably connected to the processor 20. Also good. In this regard, the processor 20 may comprise a user interface circuit configured to control at least one of one or more user interface elements such as the speaker 24, the ringer 22, the microphone 26, the display 28, and the like. The processor 20 and / or user interface circuitry including the processor 20 may be configured to control one or more functions of one or more elements of the user interface through computer program instructions. Such computer program instructions may be, for example, software and / or firmware stored in a memory accessible to the processor 20, such as volatile memory 40 or non-volatile memory 42. Although not shown, the mobile terminal may include a battery that supplies electricity to its various circuits. Such circuits include, for example, circuits that provide mechanical depth as a perceptible output. The display 28 of the mobile terminal may be of any type as long as it is suitable for the target electronic device. This target electronic equipment includes, for example, a plasma display panel (PDP), a liquid crystal display (LCD), a light emitting diode (LED), an organic light emitting diode (OLED), a pass-through display, a projector, a holographic display, etc. Includes similar items. For example, the display 28 includes a three-dimensional touch display. This exemplary description will be described in detail later. The user input interface may comprise several devices that allow the mobile terminal to receive data. Such devices include, for example, keypad 30, touch display (in some exemplary embodiments, display 28 is configured as a touch display), joystick (not shown), and other input devices. Exists. In an embodiment including a keypad, the keypad may have 0-9 numeric keys, related keys (#, *), and other keys for operating the mobile terminal 10. Alternatively or in addition, the keypad 30 may comprise a general QWERTY keypad.

  The mobile terminal 10 may include a memory such as a subscriber identification module (SIM) 38 and a removable user identification module (R-UIM). These may store information elements related to the subscriber of the mobile terminal. In addition to SIM, the mobile terminal may include other removable memory or built-in memory. The mobile terminal 10 may include a volatile memory 40 and / or a nonvolatile memory 42. For example, volatile memory may include random access memory (RAM), and may include dynamic and / or static RAM, on-chip or off-chip cache memory, and the like. The nonvolatile memory 42 may be a built-in and / or detachable nonvolatile memory, and may be a read only memory, a flash memory, a magnetic storage device (for example, a hard disk, a flexible disk drive, a magnetic tape, etc.), An optical disk drive and / or an optical disk medium, a nonvolatile random access memory (NVRAM), and the like may be included. Similar to volatile memory 40, non-volatile memory 42 may include a cache area for temporary storage of data. These memories may store one or a plurality of software programs, instructions, information pieces, data, and the like that can be used by the mobile terminal to perform functions as the mobile terminal. For example, these memories may store identification information such as an international mobile device identification code (IMEI code) that can uniquely identify the mobile terminal 10.

  Returning to FIG. In certain exemplary embodiments, device 102 comprises various means for performing various functions described herein. These means may include one or more of processor 110, memory 112, communication interface 114, user interface 116, sensor 118, user interface (UI) control circuitry 122. As described herein, these means of the apparatus 102 include, for example, circuitry, hardware elements (eg, appropriately programmed processors, combinations of logic circuits, etc.), products based on computer programs, these It may be embodied as a combination. Note that a product based on a computer program is a computer-readable computer-readable program instruction (for example, software or firmware) executed by an appropriately configured processing device such as the processor 110, and is a computer-readable medium. (For example, the memory 112).

  In certain embodiments, one or more means depicted in FIG. 1 may be embodied as a chip or chipset. In other words, the apparatus 102 may include one or more physical packages (chips or the like) that include materials, components, wiring, and the like in structural assembly components such as a substrate. The structural assembly may provide physical strength and size integrity and may serve to reduce electrical interaction of the component circuits. In this regard, the processor 110, the memory 112, the communication interface 114, the user interface 116, and the UI control circuit 122 may be embodied as a chip or a chip set. Accordingly, the apparatus 102 may be configured to implement embodiments of the present invention on a single chip or a single system on chip (SoC) in some cases, and Components configured to implement the embodiments may be provided. Thus, in some cases, a chip or chipset may constitute a means for performing one or more processes that implement the functions described herein, and / or Means for navigating the user with respect to the functions and services described may be configured.

  The processor 110 can be embodied as various means, for example. Such means include, for example, one or more microprocessors with cooperating DSPs, one or more processors without DSPs, one or more coprocessors, one or more multi-core processors, One or a plurality of control devices, a processing circuit, one or a plurality of computers, and various other processing elements are included. The “other various processing elements” include, for example, an integrated circuit such as an ASIC or FPGA, one or more other types of hardware processing devices, or a combination thereof. Therefore, although the processor 110 is depicted as a single processor in FIG. 1, it may be a plurality of processors in some embodiments. The multiple processors may communicate with each other and may be configured to perform one or more functions of the device 102 together, as described herein. The plurality of processors may be mounted on a single computing device, but may be distributed and mounted across a plurality of computing devices. The plurality of computing devices are configured to function together as device 102. In embodiments where the device 102 is embodied as the mobile terminal 10, the processor 110 may be embodied as the processor 20 or may include the processor 20 (shown in FIG. 2). In certain exemplary embodiments, processor 110 may be configured to execute instructions stored in memory 112. Alternatively, the processor 110 may be configured to execute instructions that it can access. These instructions, when executed by processor 110, may cause device 102 to perform one or more of its functions described herein. As described above, the processor 110 has the ability to execute the processing according to the embodiment of the present invention regardless of whether the processor 110 is configured by hardware, software, or a combination thereof. It may be configured as an element. For example, when the processor 110 is embodied by something like an ASIC or FPGA, the processor 110 is hardware specially configured to perform one or more processes described herein. May be. In another example, the processor 110 is embodied as an execution body of an instruction that may be stored in the memory 112, for example. The instructions may be specifically configured to cause the processor 110 to execute one or more of the algorithms and processes disclosed herein.

  For example, the memory 112 may be configured as a volatile memory, a nonvolatile memory, or a combination thereof. In this regard, the memory 112 may be a non-transitory computer readable storage medium. Although shown as a single memory in FIG. 1, the memory 112 may be comprised of a plurality of memories. The plurality of memories may be mounted on a single computing device, or may be distributed and mounted across a plurality of computing devices. The plurality of computing devices are configured to function together as device 102. In various exemplary embodiments, the memory 112 may comprise a hard disk, random access memory, cache memory, flash memory, CD-ROM, DVD-ROM, optical disk, circuitry configured to store information, combinations thereof, and the like. May be included. In embodiments where the device 102 is embodied as a mobile terminal 10, the memory 112 may comprise a volatile memory 40 and / or a non-volatile memory 42 (shown in FIG. 2). Memory 112 may be configured to store information, data, files, applications, instructions, and the like to allow device 102 to perform many functions in accordance with various exemplary embodiments. . For example, in some embodiments, the memory 112 is configured to buffer input data processed by the processor 110. Additionally or alternatively, the memory 112 may be configured to store program instructions that are executed by the processor 110. The memory 112 may store information as a static form and / or as a dynamic form. Stored information can include, for example, images, content, media content, user data, application data, and the like. The stored information may be stored or used when the UI control circuit 122 performs its function.

  The communication interface 114 is embodied as a circuit, hardware, a product based on a computer program, a combination thereof, or the like, and is configured as any device or means configured to be able to transmit and receive data to and from other computing devices. May be implemented. Here, a computer program based product comprises a computer readable medium (eg, memory 112) that stores computer readable program instructions to be executed by a suitably configured processing device, such as processor 110. In some exemplary embodiments, communication interface 114 may be implemented such that at least a portion thereof is implemented by processor 110 or controlled by processor 110. In this regard, the communication interface 114 may be in communication with the processor 110 via a bus or the like. The communication interface 114 may comprise, for example, an antenna, transmitter, receiver, transceiver, and / or support hardware to enable communication with one or more other computing devices, Software may be provided. In embodiments where the device 102 is embodied as a mobile terminal 10, the communication interface 114 may be embodied as a transmitter 14 and a receiver 16 or may include a transmitter 14 and a receiver 16 (see FIG. 2). Show). The communication interface 114 may be configured to send and receive data using any protocol used to communicate between computing devices. In this regard, the communication interface 114 may be configured to send and receive data using any protocol that can be used to send data via a wireless network, a wired network, combinations thereof, and the like. This allows the device 102 to communicate with other computing devices. By way of example, the communication interface 114 may receive content (eg, web page content, streaming media content, etc.) over a network from a server or other content source, or otherwise access. Can be configured. The communication interface 114 may further be in communication with the memory 112, the user interface 116, the sensor 118, and / or the UI control circuit 122 via a bus or the like.

  Sensor 118 may be in communication with processor 110, user interface 116, sensor 118, and / or UI control circuit 122. In embodiments where device 102 is embodied as mobile terminal 10, sensor 118 may be embodied as sensor 18 or may include sensor 18 (shown in FIG. 2). In some embodiments, the sensor 118 can be configured to monitor the user's eyes, for example, by tracking the user's viewpoint, detecting the user's eye position and / or focus, and the like. For example, the sensor 118 can be configured to transmit a light beam or other signal (such as infrared) that reflects the user's eyes (or eyelids). The sensor 118 can also be configured to receive light or other signals. Additionally or alternatively, the sensor 118 can monitor the user's eyes (or eyelids) using other functionalities. The other function is, for example, taking a picture and / or video using a camera. Similarly, the sensor 118 can be configured to sense the user's pupil size to determine the user's focus within the three-dimensional environment (eg, the depth of the user's focus). Similarly, sensor 118 can be configured to monitor other characteristics of the user. Examples of other user features include, among other things, the user's viewpoint movement and the user's eyelid movement. In some embodiments, the sensor 118 may include a viewpoint tracking unit.

  Additionally or alternatively, in some embodiments, the sensor 118 can comprise other types of sensors. Other types of sensors are, for example, proximity sensors, optical sensors, gyroscopes, cameras, heart rate monitors, magnetic detectors, and / or accelerometers. In this regard, the sensor 118 may comprise an inertial measurement unit (IMU) or other electronic device. These inertial measurement units (IMUs) and other electronic devices measure and provide data relating to velocity, geometric position, and gravity of (or in addition to) sensors or objects to which they are attached. For example, in some embodiments, sensor 118 may be placed on a helmet worn by the user. In some cases, a sensor 118, such as via an IMU, can be configured to sense helmet movement relative to a reference position. The reference position is, for example, a position when the helmet is in a steady state, such as when a user who is not moving or slowly moving (when walking or standing) is holding or wearing the helmet. It can be. For example, the sensor 118 may be configured to sense whether a moving user (a user riding a motorcycle or other vehicle) is wearing a helmet. In other embodiments, for example, if the sensor includes a proximity sensor, an optical sensor, and / or a thermal sensor, it may detect when the helmet surrounds the user's head, regardless of the user's movement. Can be configured.

  In some embodiments, the sensor 118 can provide an output (signal, light, image, video, etc.) to the processor 110, and the processor 110 can be configured to determine a specific situation regarding the user's condition. . These specific situations regarding the user's state are, for example, whether the user is wearing a helmet and / or whether the user is driving (e.g. riding a motorcycle). This information can be used to determine any characteristics associated with the user. For example, in the case of viewpoint detection, this information can be used to determine that the user's eyes are moving toward a surrounding target of interest. Similarly, this information can be used to determine that the user is indicating user input related to the surrounding subject of interest. Furthermore, this information can be used to determine data suitable for presentation to the user (such as visual data). This determination is made, for example, by considering whether or not the user is driving a motorcycle when presenting data, as will be described in more detail later.

  The user interface 116 may be in communication with the processor 110 to receive information indicative of user input, provide audio or visual output, and provide mechanical or other output to the user. The user interface 116 may include, for example, any one or more of a keyboard, a mouse, a joystick, a display, a touch screen display, a microphone, a speaker, and other input or output mechanisms. In some embodiments, a display refers to a display on a screen, a display on a wall, a glasses or visor display (such as a display in the immediate vicinity of the eye), an aerial display, and the like. In some embodiments, the user interface 116 may comprise two or more displays, such as a main display and at least one peripheral display. Similarly, the user interface 116 can include any display (such as a main display and / or a peripheral display). In embodiments where device 102 is embodied as mobile terminal 10, user interface 116 may be embodied as display 28 and keypad 30 or may include display 28 and keypad 30 (shown in FIG. 2). . The user interface 116 may be in communication with the memory 112, the communication interface 114, the sensor 118, and / or the UI control circuit 122 via a bus or the like.

  In some embodiments, the user interface 116 may include a pass-through display. Similarly, in embodiments where the device 102 is embodied as the mobile terminal 10, the display 28 may be embodied as a pass-through display. In some embodiments, the pass-through display is at least partially transparent so that it can be viewed through the displayed image (text, icons, photos, videos, visual attractant, etc.). An image can be displayed on a form (image overlay or the like). Transparency can vary from completely transparent to opaque (or between them). Here, the image is not shown. Further, in some embodiments, the transparency can be changed at various points throughout the screen.

  For example, in some embodiments, when the user wears a helmet, the user interface allows the user to see objects in front of the user through the visor while viewing images and information displayed on a portion of the display. 116 may comprise one or more pass-through displays provided on the helmet visor. Although some exemplary embodiments are described herein for pass-through displays, other user interfaces are contemplated. Examples of the other user interfaces include a presentation screen and a projection display.

  Similarly, some exemplary embodiments may provide a device (such as device 102) for displaying information through a device that includes a display, such as the helmet 150 shown in FIG. A device with a pass-through display can provide a visual overlay of the image on a sufficiently transparent display surface, such as through a helmet visor 160 such as a standard visor. This visual overlay allows the user to see objects and people in the user's standard (non-opaque) field of view while providing additional images that can be displayed on a pass-through display. Enable. The visual overlay of the image may vary in opacity between transparent (or 0% opacity) and opaque (or 100% opacity). For example, in some cases, the image displayed on the pass-through display may completely block the user's view beyond the display. In this case, the user's field of view is blocked by at least a part of the display on which the image is displayed (for example, the periphery of the visor 160 on which information is displayed). Referring to FIG. 3, for example, the visor 160 provides a straight line of sight to the user so that the user's view through the visor is not compromised in most parts, even when an image is displayed in the notification information display area. Two notification information display areas 162 and 164 positioned above may be provided. In some embodiments, the displayed image can be partially transparent so that the user can see the environment beyond the pass-through display (eg, through the displayed image).

  In an exemplary embodiment, information placed at the end of the pass-through display can be displayed. In another exemplary embodiment, information that spans the center of the display can be displayed. The central portion of the display is sufficiently transparent, and an image having low transparency and possibly opaque is displayed around the sufficiently transparent central portion. As described above, some embodiments can make it possible to visually recognize the user's surrounding environment while providing an image that the user visually recognizes. For example, in FIG. 3, the transparency of a portion of the visor 160 that is in the user's straight line of sight is maintained, allowing the user to see through the visor at all times (such as looking forward while driving a motorcycle) . On the other hand, in order to display an image that conveys specific information to the user, the notification information display areas 162 and 164 may be provided near the upper end of the visor (for example, above the line of sight when the user is facing directly in front). it can.

  Devices with pass-through displays allow for the display of two-dimensional (2D) and three-dimensional (3D) visual elements. Two-dimensional graphic elements displayed on the surface of the display can be viewed on a standard computer screen or display of the mobile terminal (eg, display 28 of mobile terminal 10), user interface, status elements, etc. It can be presented to the user using the information. These 2D elements can communicate messages, alert users with notification information, present applications currently in use, and the like. In addition, the 2D element can provide an image of the object that the user of the pass-through display is viewing through the display, such as identifying a point of interest or landmark that the user is viewing. The above identification is realized by various means. These various means are in communication with the object authentication software, the object identification combined with the position identification of the device (eg device 102) (eg the Global Positioning System (GSP) signal), the mobile terminal 10 etc. Equipment is included. The three-dimensional element is displayed above the scene that the user is looking at and can be viewed through a pass-through display, identifying objects, providing navigation, and the like.

  3 and 4 depict a helmet 150 as an example of a device with a pass-through display (eg, device 102). As shown, the helmet 150 may include an opaque body portion 155, visor 160, or other transparent lens portion. Here, the body part 155 may be opaque and can protect the user's head, and thus is configured to surround the user's head. The visor 160 or other transparent lens portion is also configured to protect the user's eyes from wind and dust so that the user can look forward while driving the vehicle. In some embodiments, the helmet 150 can include (or be in communication with) a processor (eg, processor 110) configured to control image display within the helmet. For example, in the illustrated embodiment of helmet 150, the processor can be configured to control the display of images in the notification information display areas 162 and 164. Here, the display areas 162 and 164 may be a single display or a multi-display. In some embodiments, the images displayed in the notification information display areas 162 and 164 may be independent of each other and / or complementary to each other. Further, the processor (eg, processor 110) may in some cases be embodied by a helmet (such as when the processor is incorporated into or supported by the body 155 of the helmet). On the other hand, in some cases, the processor is different from the helmet, but may be embodied in a device that communicates with the helmet (such as the mobile terminal of FIG. 2, such as a user's mobile phone).

  As shown in FIG. 4, a user (not shown) can see through the visor 160 and can see the building outline 170 in front of the user when riding a motorcycle down the road. In some embodiments, the helmet 150 may be configured to display an image in one or both of the notification information display areas 162 and 164. In the illustrated embodiment, for example, a display 180 “CITY AVENUE” is displayed in a display area 162 that is one of the notification information display areas for the user, and the user is down to the main street of the city. (For example, the current position of the user is confirmed using GPS technology). Although words are illustrated as being displayed on the display, embodiments of the present invention represent other types of images (eg, photos, videos, maps, notification information, visual attention). Also consider. Furthermore, although the words illustrated in FIG. 4 are not transparent, embodiments of the present invention also contemplate a display that is at least partially transparent on the display.

  3 and 4 each illustrate an example of a device having a pass-through display, many other devices configured with a pass-through display are contemplated for embodiments of the present invention (eg, motorcycles). Windshield, glasses etc.). Furthermore, embodiments of the present invention are not meant to be limited to devices having pass-through displays. The invention is useful with other exemplary devices, such as any device 102 described herein (eg, portable computer devices, fixed computer devices, etc.).

  Returning to FIG. 1, the UI control circuit 122 may be implemented as various means such as a circuit, hardware, a product based on a computer program, or a combination thereof. Here, a product based on a computer program comprises a computer-readable medium (eg, memory 112) that stores computer-readable program instructions that are executed by a processing device such as processor 110. In some embodiments, the UI control circuit 122 may be embodied by or controlled by the processor 110. In some embodiments, the UI control circuit 122 is implemented separately from the processor 110 and is in communication with the processor 110. The UI control circuit 122 may be in communication with one or more of the memory 112, the communication interface 114, the sensor 118, and / or the user interface 116 via a bus or the like.

  The UI control circuit 122 can be configured to accept input from a user interface 116 such as a touch display. The user input or signal can propagate position information indicative of the user input. In this regard, the positions described above can include the position of user input in a two-dimensional space that may be associated with a user interface on the surface of the touch display. For example, the positions can include coordinate positions (eg, X and Y axes) associated with a two-dimensional coordinate system from which the position can be determined. Furthermore, the UI control circuit 122 can determine the location of this user input, such as to determine the portion of the display that correlates with the user input.

  The touch display can also be configured to allow detection of hovering gesture input. Gesture input by hovering can include gesture input to the touch display without physical contact with the surface of the touch display. Gestures are made, for example, on the display and / or at some distance in front. As an example, the touch display may include a projected capacitive touch display. This projected capacitive touch display can be configured to detect the capacitance of a finger or other input object so that the finger or other input object does not physically touch the display surface. , Can make a gesture. As another example, the touch display can be configured to detect gesture input by hovering using acoustic wave sensor technology. However, in addition to the acoustic wave sensor technology, an electromagnetic touch detection technology, a near field imaging technology, a light detection technology, an infrared proximity detection technology, a combination thereof, or the like can also be used. The UI control circuit 122 and the touch display can be embodied in the helmet 150 shown in FIG. 3 or in the mobile terminal 10 shown in FIG. For example, the touch display may be a touch display of a user's mobile phone, or the phone may be in communication with the user's helmet. Thus, by interacting with the touch display of the mobile phone, the user may be able to display an image on the helmet and / or configure the image display.

  Referring to FIG. 5, a device 102 with a touch screen display 200 is generally depicted. This apparatus may be embodied as the mobile terminal 10 (for example, a mobile phone) of FIG. As described above, the apparatus 102 includes at least one processor (eg, processor 110 of FIG. 1) and at least one memory (eg, memory 112 of FIG. 1) that stores computer program code. These at least one memory and computer program code, together with the processor, cause device 102 to determine that the user is wearing a helmet (such as helmet 150 in FIG. 3) at least during a navigation event. May be configured. Further, the device 102 may be made to determine a set of navigation notifications related to navigation events. As will be described later, the set of navigation notifications can be adjusted for display in the helmet. In addition, the at least one memory and computer program code may be configured to cause the device 102 to display a navigation notification in the helmet along with the processor.

  For example, before going on a trip, the user interacts with the display 220 of his telephone 102 (as shown in FIG. 5) or other navigation device, and from point A (user's current location) to point B (user's current location). The travel directions to the desired destination) can be obtained. As a result, specific navigation data can be obtained (such as via GPS) and presented to the user on the touch display 200 as illustrated in FIG. For example, the resulting navigation data may include a map 250 of the area to travel, a route 260, one or more waypoints 270 or other points of interest along the route. Further, the navigation data may include text 280 describing where to turn, travel distance and / or travel time associated with each step of the route. As shown in the drawings, directions indicating where to turn may be presented in a list. Further, the navigation data can include one or more travel summaries. One travel summary 282 can indicate the remaining travel distance to reach the destination (1.5 miles in the depicted example). Another travel summary 284 can convey the estimated travel distance to reach the destination (5 minutes in the depicted example). Other information such as nearby restaurant locations, gas station locations, hotel locations, etc. can also be designed and provided to facilitate movement from point A to point B. In some cases, the navigation data may include advertisements along the calculated route and / or recommended attractions.

  While it is useful to provide the user with the context of the acquired route and additional information about the planned route, the display of the navigation data (eg, the navigation data shown in FIG. 6) from point A Simultaneously with the movement to the point B, it may become a burden on the user driving the motorcycle. For example, the display of the map 250 is complex and may require excessive attention from the user to understand. The display of the map 250 may leave the user's focus many times away from the running road, putting the user at risk of encountering an accident. For example, when looking at a map 250 or list 280 showing where to turn, displayed on the touch display 200 of the user's phone, the user is in a car or other obstacle in his path. I can't see things. In addition (or) it is not possible to respond immediately to other changes in driving conditions (e.g., animals, road conditions, weather conditions, etc.), which may harm user safety.

  Furthermore, embodiments of the present invention can provide the helmet 150 with a sensor 190 (such as the sensor 118 of FIG. 1). This sensor 190 detects that the user is wearing a helmet during a navigation event (eg, via a proximity sensor) and / or detects that the user is riding a motorcycle ( For example, via the IMU). The navigation event receives, for example, a user request for a route from point A to point B via the device 102 or information from the user indicating that the user's navigation device (eg, device) is in navigation mode. May be activated. If the device 102 is implemented as a user's phone and the helmet can be viewed as an external display device, the signal from the sensor 190 can be received by the user's phone and a navigation event occurs. While the phone's processor can determine that the user is wearing a helmet. Similarly, in embodiments where the device is implemented by a helmet 150, the helmet 150 may be equipped with a processor. The helmet 150 then communicates with a sensor 190 that directs the navigation event and a navigation device (eg, the user's phone) to determine that the user is wearing the helmet while the navigation event occurs. .

  In response to a determination that the user is wearing a helmet and is in a navigation event, a set of navigation notifications 300 (shown in FIG. 7) associated with the navigation event can be determined. The set of navigation notifications can be adjusted for display within the helmet (eg, display via the pass-through display of the visor 160). For example, each navigation notification may include one step of directions that indicate where to turn. This step has undergone formatting, editing, shortening, simplification, and other optimization processes, and can provide the user with a concise guidance on the next step in the route of travel. In other words, the set of navigation notifications 300 is the first set of navigation notifications. At least one memory and computer program code may then be configured with the processor to cause the device 102 to determine a first set of navigation notifications 300. This first set of navigation notifications 300 is different from the second set of navigation notifications associated with navigation events, where the second set of navigation notifications is adapted for display in a helmet. Is not adjusted.

  For example, the second set of navigation notifications may include the navigation data shown on the user's telephone or navigation device display 200 (described in FIG. 6). This second set of navigation notifications (which may be determined before, after, or at the time of the determination of the first set of navigation notifications) is different compared to the first set of navigation notifications. May have appearance and different context. For example, a set of navigation notifications adjusted for display in a helmet can include changes to the text itself as well as changes to the visual representation of the guidance. For example, in connection with FIGS. 6 and 7, the set of navigation notifications can be tailored for display within the helmet by including fewer navigation notifications. For example, the directions shown in FIG. 6 that indicate where to turn (eg, the second set of navigation notifications) may be briefly described to format the first set of navigation notifications. . In other words, the guidance for "Merge onto I-77 N / US-21 N via EXIT 1C toward Statesville. 1.6 mi" in the second set (Fig. 6) is "EXIT 1C 1.6 mi I-77 in the first set. N / US-21 N "(Fig. 7) Additionally or alternatively, the set of navigation notifications displayed within the helmet cannot include a map representation.

  In some embodiments, navigation data adjustments made to determine a navigation notification for display on a helmet include turning corners, avoiding corners, changing lanes, margining, etc. Providing visual guidance of the navigation information can be included. These visual guidance may be provided when there is no information that provides a broad context, such as a map or a complete guidance list for navigating the desired route. For example, referring to FIG. 9, in the absence of information regarding the context (such as a map or street name), the visual guidance may include an arrow 310 indicating a left turn. In the illustrated example, the navigation information (for example, the timing of turning to the left) is approaching by indicating the travel distance 320 to the next navigation information (for example, how many miles to the corner). It is. In some cases, the arrow 310 or the visual guidance of the navigation information can begin to flash or change color when the user approaches the position to perform the operation.

  In some embodiments, the set of navigation notifications may be based on a number of navigation display areas within the helmet. For example, referring to FIG. 8, two navigation display areas 162 and 164 are provided on the display of the visor 160. At least one memory and computer program code may be configured with the processor to cause the device 102 to determine a set of navigation notifications based on a number of notification information display areas within the helmet. For example, as two notification information display areas 162 and 164 are provided in FIG. 8, a set of navigation notifications includes a description of the navigation information 182 and a travel distance 184 ("Exit 1C in 1.6 mi") to the navigation information. May be determined to include. This is the same as the case where the street name 186 is included in the navigation information ("I-77 N / US-21 N").

  Further, the at least one memory and computer program code may be configured with the processor to cause the device 102 to determine the assignment of a set of navigation notifications between the notification information display areas 162 and 164 in the helmet. . This is to make the display of information the most user-friendly and not divert the user's attention. In the example shown in FIG. 8, the description of the navigation information 182 and the movement distance 184 related thereto are displayed in the notification information display area 162 on the left side. On the other hand, the street name 186 related to the navigation information is displayed in the notification information display area 164 on the right side. The two notification information display areas 162 and 164 are provided near the upper end of the visor 160 in the illustrated example, but many notification information display areas can be provided in any arrangement on the visor.

  In this regard, in some embodiments, the user may be able to configure how to assign a set of navigation notifications and / or navigation notifications within the notification information display area within the helmet. For example, in the illustrated embodiment, the user can interact with the settings screen displayed on the touch display of the user's phone and make input regarding options. The input regarding this option includes, for example, the desired number of notification information display areas, the position of the notification information display area, the size of the notification information display area, the opacity of the notification information display area, and the navigation data displayed in the notification information display area. The type. For example, the user sees only navigation notifications 310, 320 regarding navigation information to be performed (eg, turning ahead) and point-of-interest information 330, 340 (eg, gas stations along a planned route, etc.). May want. Further, referring to FIG. 9, the user always likes to view the attention point information 330, 340 provided in a specific notification information display area (for example, the area 162), and another notification information display area There is a case where the user prefers to see the navigation information information 310, 320 provided in (for example, the area 164) and further sets the apparatus accordingly. In response to such user input, the at least one memory and computer program code, together with the processor, determines the set of navigation notifications to the device 102 based on the set of navigation notifications set by the user; And / or may be configured to perform determining allocation of a set of navigation notifications in a notification information display area within the helmet based on an allocation setting set by the user.

  Further, in some embodiments, the at least one memory and computer program code are configured with the processor to cause the device 102 to determine a navigation notification to include at least one motorcycle-specific notification information. There is a case. For example, the user can set the device to display navigation notifications that are of interest to the user as a motorcycle driver. However, this navigation notification may not be of interest to cars, bus drivers, pedestrians, and the like. Such motorcycle-specific notification information may include the next curve angle, the next slope of the slope, and / or weather conditions (eg, temperature, freeze warning, wind speed, etc.). In some cases, the notification information display area may be dynamically set by the user so that one type of information may be replaced with another type of information under specific conditions. For example, the notification information display areas 162 and 164 can be set to display the information on the point of interest. However, since the user approaches the corner on the road, the information on the point of interest may be replaced with the angle of the corner. is there.

  In some embodiments, such as when the device 102 is implemented by a user's mobile terminal and the device 102 is separated from the user's helmet and a pass-through display provided on the helmet, the device (e.g., mobile Terminal) can communicate with the helmet display via wired or wireless communication. In this example, through the interface of the mobile terminal, the user can obtain navigation data relating to a desired travel route, and can set the type of information displayed via the helmet display while riding as described above. . In the above case, the device is considered to be in active mode. Once the configuration is complete and a navigation event is activated (eg, the user is riding a motorcycle and wearing a helmet), the device 102 is considered to enter passive mode. As described above and in the drawings, in the passive mode, desired information is displayed to the user via the helmet visor according to the setting made by the user via the user interface of the mobile terminal. In some embodiments, both the mobile terminal display 200 (FIG. 5) and the helmet display 160 (FIG. 9) can display navigation data (such as navigation notifications). However, the type of data displayed on each device may differ as shown. For example, the display 200 of the mobile terminal can display complete navigation data including a map 250 and a complete guidance list (shown in FIG. 6). Here, the display 160 of the helmet can display a set of navigation notifications adjusted for display on the helmet (shown in FIG. 9). On the other hand, in other cases, the device can be configured such that both displays 200 and 160 display the same navigation notification.

  Embodiments of the present invention relate to a method, apparatus, and computer program product for displaying a navigation notification suitable for a helmet within the helmet. With reference to FIGS. 10 and 11, various operational examples implemented in accordance with embodiments of the present invention are provided.

  FIG. 10 depicts a flow diagram according to an exemplary method 400 for adapting navigation notifications for display within a helmet. The process depicted in FIG. 10 and described in connection with this figure is, for example, with the assistance of one or more of processor 110, memory 112, communication interface 114, use interface 116, sensor 118, UI control circuit 122. And / or by one or more of these controls. Process 402 can include determining that a user is wearing a helmet while a navigation event is occurring. For example, any one or more of the processor 110, the communication interface 114, and / or the sensor 118 may form a means for performing the process 402. Process 404 can include determining a set of navigation notifications associated with the navigation event. For example, the processor 110 may form a means for executing the process 404. Process 406 can include displaying a set of navigation notifications in the helmet. For example, any one or more of the processor 110, the communication interface 114, the user interface 116, and / or the UI control circuit 122 may form means for executing the process 406.

  FIG. 11 depicts a flow diagram according to another example method 500 for adapting navigation notifications for display within a helmet. The process depicted in FIG. 11 and described in connection with this figure is performed with the aid of one or more of, for example, processor 110, memory 112, communication interface 114, use interface 116, sensor 118, UI control circuit 122. And / or by one or more of these controls. Process 502 can include determining a set of navigation notifications associated with the navigation event that are not helmet specific. Here, the set of navigation notifications not specific to the helmet is not adjusted for display in the helmet. For example, the processor 110 may form a means for executing the process 502. Process 504 can include determining that the user is wearing a helmet while a navigation event is occurring. For example, any one or more of the processor 110, the communication interface 114, and / or the sensor 118 may form a means for performing the process 504. Process 506 can include determining a set of navigation notifications associated with the navigation event. For example, the processor 110 may form a means for executing the process 506. Process 508 can include displaying a set of navigation notifications in the helmet. For example, any one or more of the processor 110, the communication interface 114, the user interface 116, and / or the UI control circuit 122 may form means for executing the process 508.

  Each of FIGS. 10-11 depicts a flow diagram of a system, method, and computer program product according to an exemplary embodiment of the present invention. It should be noted that the individual blocks of the flowchart and the combinations of the blocks of the flowchart are implemented by various means. Such means include hardware and computer program products including one or more computer program instructions. For example, one or more processes described herein may be embodied by computer program instructions for a product based on a computer program. In this regard, a computer program that embodies the processing described herein may be stored in one or more memories (eg, memory 112) of a computing device such as a mobile terminal or server, and these It may be executed by a processor (eg, processor 110) of the computing device. In some embodiments, computer program instructions, including computer programs that embody the processes described herein, may be stored in multiple memory devices of multiple computing devices. Of course, such computer programs are loaded into a computer or other programmable device (eg, device 102) to configure the machine. That is, the instructions executed by a computer or programmable device embody means for implementing the functionality specified by the block (s) in the flowchart. A product based on a computer program may comprise one or more computer-readable memories, in which computer program instructions may be stored. Thereby, one or more computer-readable memories can instruct a computer or other programmable device to function in a particular manner. Thus, the computer program product is configured as a product that implements the function specified by the block of the flowchart. Computer program instructions of one or more computer program products are loaded into a computer or other programmable device (eg, device 102), and the computer or other programmable device causes a series of operations to be performed on the computer. Generate the implementation process. That is, the functions specified by one or more of the flowchart blocks are implemented by executing instructions on a computer or other programmable device.

  Thus, the flowchart blocks support a combination of means for performing the specified functions. The combination of one or more blocks of the flowchart and the plurality of blocks of the flowchart may be a combination of a specific-purpose hardware-based computer system or a specific-purpose hardware and a computer program product that performs a specific function It should also be understood that may be implemented by:

  The functions described above can be performed in various ways. For example, suitable means for performing each of the functions described above may be used to perform the embodiments of the present invention. In one embodiment, a suitably configured processor (eg, processor 110) may be all or part of the elements described above. In other embodiments, all or some of the above-described elements may be configured to be executed under the control of a computer program product. Computer program products that perform the methods according to exemplary embodiments of the invention include computer readable storage media, such as memory 112, which may be non-volatile storage media. The product may also comprise computer readable program code portions, such as a series of computer instructions, embodied in a computer readable storage medium.

Many variations and other embodiments of the invention described herein will occur to those skilled in the art that may benefit from the teachings presented in the foregoing description and the associated drawings. Therefore, it should not be understood that the embodiments of the present invention are limited to the specific embodiments disclosed herein, and the above-described modifications and other embodiments should be included in the scope of the present invention. is there. Moreover, while the foregoing description and related drawings have described exemplary embodiments in the context of certain exemplary combinations of elements and functions, other embodiments may be used without departing from the scope of the present invention. Note that different combinations of elements and functions are possible. For example, the above drawings and examples refer to pass-through displays on helmet visors, but other pass-through displays will benefit from embodiments of the present invention (such as glasses, protective glasses, windshields and the like). Can do. Furthermore, although the motorcycle example is used above, embodiments of the present invention may also be used by users operating off-road cars (ATVs), boats, snowmobiles, cars, jet skis, and other vehicles. . In this context, for example, the scope of the invention contemplates other than the elements and / or functions specified above. Although specific terms are used in this application, they are used for general explanation purposes and not for limitation purposes.

Claims (26)

Determining navigation guidance information associated with the navigation event by the processor;
Determining that the user is wearing a helmet while the navigation event occurs;
Determining a set of navigation notifications including a plurality of navigation notifications from the navigation guidance information associated with the navigation event based on a plurality of notification information display regions in the helmet, wherein each of the notification information display regions Determining which one of the plurality of navigation notifications can be displayed;
Adjusting the set of navigation notifications for display in the helmet;
Providing the set of navigation notifications for display within the helmet for display over at least a portion of the surrounding environment currently viewed by the user through the helmet;
The set of navigation notifications displayed within the helmet is translucent so that the user can see the surrounding environment currently being viewed through the set of navigation notifications displayed within the helmet. A way you can. The set of navigation notifications is a first set of navigation notifications,
Determining the first set of navigation notifications includes determining the first set of navigation notifications different from the second set of navigation notifications associated with the navigation event, wherein the navigation notifications The second set of is not adjusted for display in the helmet,
The method of claim 1.   Determining the first set of navigation notifications such that determining the first set of navigation notifications includes fewer navigation notifications than the second set of navigation notifications associated with the navigation event. The method of claim 2 comprising:   The method of claim 1, wherein determining the set of navigation notifications includes determining the set of navigation notifications to not include a map display. Determining the set of navigation notifications includes determining the set of navigation notifications to include at least one motorcycle-specific notification;
Here, the at least one motorcycle-specific notification includes any one or more of the following curve angle, the next slope of the slope, and the weather condition.
The method of claim 1.   The method of claim 1, wherein determining the set of navigation notifications includes determining the set of navigation notifications based on a set of navigation notifications set by a user. Further determining how to assign the set of navigation notifications within the notification information display area within the helmet;
Wherein providing the set of navigation notifications further comprises providing the assignment of the set of navigation notifications in the notification information display area within the helmet,
The method of claim 1.   The method of claim 7, wherein determining how to assign the set of navigation notifications within a notification information display area within the helmet is based on an assignment setting set by a user.   The method of claim 1, wherein the helmet is connected to a navigation device.   The method of claim 1, wherein the processor is mounted on a mobile terminal and the helmet comprises an external display configured to display the set of navigation notifications. The method of claim 10, wherein
Providing the set of navigation notifications for display within the helmet includes displaying the set of navigation notifications adjusted for display by the helmet on the display of the helmet;
The method further includes causing navigation data to be displayed on the display of the mobile terminal in addition to the set of navigation notifications.
Method.   Providing the set of navigation notifications for display within the helmet means that at least one visible object in the scenery that the user is currently viewing is hidden by the display of the set of navigation notifications. The method of claim 1, comprising providing the set of navigation guidance information so as not to be. Means for determining navigation guidance information associated with the navigation event;
Means for determining that the user is wearing a helmet while the navigation event occurs;
Means for determining a set of navigation notifications including a plurality of navigation notifications from the navigation guidance information related to the navigation event based on a plurality of notification information display regions in the helmet, wherein each of the notification information display regions The means for determining, capable of displaying one of the plurality of navigation notifications;
Means for adjusting the set of navigation notifications for display in the helmet;
Means for providing the set of navigation notifications for display within the helmet for display over at least a portion of the surrounding environment currently viewed by the user through the helmet;
The navigation notification set displayed in the helmet is translucent so that the user can see the surrounding environment currently viewed through the navigation notification set displayed in the helmet. A device that can do. The set of navigation notifications is a first set of navigation notifications,
Determining the first set of navigation notifications includes determining the first set of navigation notifications different from the second set of navigation notifications associated with the navigation event, wherein the navigation notifications The second set of is not adjusted for display in the helmet,
The apparatus of claim 13.   Determining the first set of navigation notifications such that determining the first set of navigation notifications includes fewer navigation notifications than the second set of navigation notifications associated with the navigation event. The apparatus of claim 14, comprising:   14. The apparatus of claim 13, wherein determining the set of navigation notifications includes determining the set of navigation notifications so as not to include a map display. Determining the set of navigation notifications includes determining the set of navigation notifications to include at least one motorcycle-specific notification;
Here, the at least one motorcycle-specific notification includes any one or more of the following curve angle, the next slope of the slope, and the weather condition.
The apparatus of claim 13.   The apparatus of claim 13, wherein determining the set of navigation notifications includes determining the set of navigation notifications based on a set of navigation notifications set by a user. Means for determining how to allocate the set of navigation notifications in the notification information display area in the helmet;
Wherein providing the set of navigation notifications further comprises providing the assignment of the set of navigation notifications in the notification information display area within the helmet,
The apparatus of claim 13.   The apparatus of claim 19, wherein determining how to assign the set of navigation notifications within a notification information display area within the helmet is based on an assignment setting set by a user.   The apparatus of claim 13, wherein the helmet is connected to a navigation device.   14. The device of claim 13, embodied as a mobile terminal, wherein the helmet comprises an external display configured to display the set of navigation notifications. The apparatus of claim 22.
Providing the set of navigation notifications for display within the helmet includes displaying the set of navigation notifications adjusted for display by the helmet on the display of the helmet;
The apparatus further comprises means for displaying navigation data on the display of the mobile terminal in addition to the set of navigation notifications.
apparatus.   Providing the set of navigation notifications for display within the helmet means that at least one visible object in the scenery that the user is currently viewing is hidden by the display of the set of navigation notifications. 14. The apparatus of claim 13, comprising providing the set of navigation guidance information so as not to be.   13. An apparatus comprising processing means and storage means, wherein the storage means stores program instructions, and when the program instructions are executed by the processing means, the apparatus is provided with any one of claims 1 to 12. An apparatus configured to perform the described method.   A computer program comprising program instructions configured to cause the apparatus to perform the method of any of claims 1 to 12 when executed by a processing means of the apparatus.

Images