US20180246348A1 - Glasses type information terminal, information processing device, computer program and recording medium - Google Patents
Glasses type information terminal, information processing device, computer program and recording medium Download PDFInfo
- Publication number
- US20180246348A1 US20180246348A1 US15/964,278 US201815964278A US2018246348A1 US 20180246348 A1 US20180246348 A1 US 20180246348A1 US 201815964278 A US201815964278 A US 201815964278A US 2018246348 A1 US2018246348 A1 US 2018246348A1
- Authority
- US
- United States
- Prior art keywords
- glasses
- light
- information terminal
- type information
- light emission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/10—Electronic devices other than hearing aids
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/04—Supports for telephone transmitters or receivers
- H04M1/05—Supports for telephone transmitters or receivers specially adapted for use on head, throat or breast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
- H04R1/028—Casings; Cabinets ; Supports therefor; Mountings therein associated with devices performing functions other than acoustics, e.g. electric candles
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/04—Illuminating means
Definitions
- the present invention relates to a glasses type information terminal capable of delivering information to a wearer based on signal light and sound as well as sending out information to a surrounding area of the wearer, and an information processing device and components thereof configured to operate in cooperation with the glasses type information terminal.
- a glasses type information terminal configured to represent information based on a sensation of wearing ordinary glasses.
- a liquid crystal display panel is arranged at a portion corresponding to a glasses lens, and the liquid crystal display panel is configured to be connected to a computer device.
- the video display device disclosed in Patent Literature 2 light having a brightness that has been changed in accordance with an input video signal is converted into beam light.
- the beam light is two-dimensionally scanned, and the scanned beam light is guided to an eyeball of the wearer via an integrated mirror arranged at a site corresponding to a glasses lens.
- a display panel for displaying an image or video (hereinafter referred to as “image”) is formed, or appears to the wearer as if it is formed, on a site corresponding to the glasses lens. Therefore, a processing module for image processing and an optical mechanism for displaying the image are required, which not only place a burden on the body of the wearer, but also appear weird to a person seeing the wearer. Normally, a person cannot directly view the image with one eye and the surrounding area of the person with another eye. Therefore, the wearer of a related-art glasses type information terminal such as that disclosed in Patent Literature 1 or 2 may be unable to concentrate on his or her surrounding area when the image is displayed, and hence his or her everyday activities may be hindered.
- a display unit is arranged at a position inside a field of view of a user and outside the field of view visible through the glasses lens when the user wears the glasses, and reception of information is notified to the user via light emitted by the display unit.
- the head-worn information notification device disclosed in Patent Literature 3 is configured to notify reception of information only to the user, and to prevent the reception of information from being perceived in the surrounding area. Therefore, there is a disclosure that it is necessary for a light-emitting unit to be arranged in a region from about 68 degrees to about 100 degrees on the ear side with respect to a visual axis of the user.
- the light-emitting unit prefferably configured so as to have directivity, and for an irradiated region of exit light to be a region enclosed by the portions at both end surfaces of the head of the user (wearer) as viewed from an exit portion, namely, to be a region in which irradiation light is blocked by the head.
- each wearer has a different field of view and range of view. Therefore, glasses frames in which the position of the light-emitting unit is fixedly determined cannot be mass produced, and hence glasses frames are so-called special order products. As a result, it is difficult to reduce manufacturing costs.
- weak light that is not perceived in the surrounding area, such light may also not be perceived by the wearer himself or herself. This is particularly the case when the attention of the wearer is focused on his or her range of view in front, such as during walking (traveling), or when the eyes of the user are shut. Further, because the light is emitted at a position away from the wearer, there is always an influence by the emitted light.
- Another object of the present invention is to provide an information processing device suited to being in cooperation with the above-mentioned glasses type information terminal, and a computer program and a recording medium for implementing such an information processing device.
- a glasses type information terminal including: a glasses frame configured to hold a glasses lens; a light-emitting source of signal light; and a control module configured to perform, when triggered by input of information representing a light emission mode of the signal light, light emission control of the light-emitting source based on the information, the glasses type information terminal being configured such that a signal light of the light emission mode is propagated from the light-emitting source toward at least one of the glasses frame and an edge surface of the glasses lens.
- an information processing device including: communication means for performing communication to and from the glasses type information terminal; monitoring means for monitoring an execution situation of a loaded application; setting means for setting a light emission mode of the light-emitting source in accordance with the monitored execution situation; and control means for generating the light emission control information based on content set by the setting means, and transmitting the generated light emission control information to the glasses type information terminal via the communication means.
- a computer program for causing a computer including a communication function to operate as the information processing device, and a recording medium having the computer program stored thereon.
- the glasses type information terminal is configured to propagate signal light from a light-emitting source toward an edge surface of a glasses lens or a glasses frame.
- information may be delivered to the wearer via the signal light without impairing the range of view of the wearer.
- information from the wearer can be sent out to the surrounding area by using light that has reached the glasses frame or an edge surface of the glasses lens.
- the content of the representation of information by the glasses type information terminal is capable of being set at a position away from the glasses type information terminal.
- FIG. 1A is a front view of a glasses type information terminal according to an embodiment of the present invention
- FIG. 1B is a side view of the glasses type information terminal.
- FIG. 2A is a top view of the glasses type information terminal
- FIG. 2B is a perspective view of the glasses type information terminal.
- FIG. 3 is an enlarged partial view of a rim on a right eye portion of a wearer.
- FIG. 4 is a function configuration diagram of a control module.
- FIG. 5 is an explanatory diagram of a content example of an association table.
- FIG. 6 is an explanatory diagram of a content example of the association table.
- FIG. 7 is an explanatory diagram of a content example of a table stored in a data storage unit.
- FIG. 8 is a function configuration diagram of an information processing device.
- FIG. 9 is a setting procedure explanatory diagram of an APP to be monitored.
- FIG. 10 is an explanatory diagram of a setting menu screen.
- FIG. 11 is an explanatory diagram of a selection screen of the APP to be set.
- FIG. 12 is an explanatory diagram of a setting content screen for an E-mail.
- FIG. 13 is a procedure explanatory diagram of generation and transmission of action information by the information processing device.
- FIG. 14 is an explanatory diagram of a control procedure by the glasses type information terminal based on the action information.
- FIG. 15 is an explanatory diagram of a control procedure by the glasses type information terminal based on a sensor result.
- the mobile terminal is a computer, such as a smartphone, a tablet terminal, or a laptop computer. From the perspective of the glasses type information terminal, the mobile terminal is an external device. A plurality of types of applications (services implemented by execution of an application program; hereinafter referred to as “APP”) are loaded (installed) in the mobile terminal in advance.
- APP application program
- FIG. 1A is a front view of the glasses type information terminal according to this embodiment
- FIG. 1B is a side view of the glasses type information terminal
- FIG. 2A is a top view of the glasses type information terminal
- FIG. 2B is a perspective view of the glasses type information terminal.
- the glasses type information terminal 1 includes a glasses frame 10 .
- the glasses frame 10 is built from a color-emitting member.
- Various types of electronic components are accommodated in the glasses frame 10 .
- the color-emitting member is a member configured to emit a color in accordance with the color of input light.
- a translucent resin such as acrylic, that emits a milky-white color, a specific achromatic color or chromatic color, or a mixed color thereof, may be used for the color-emitting member. Wearing the glasses type information terminal 1 has the same meaning as wearing the glasses frame 10 .
- the glasses frame 10 includes a rim 11 configured to hold a part of an upper edge portion and a side end portion of each of a pair of left and right glasses lenses 20 a and 20 b.
- a pair of grooves referred to as rim lines, are dug into a edge surface that is on a lower side when the glasses frame 10 is worn and a side edge surface closer to the center.
- An upper edge surface of the glasses lenses 20 a and 20 b is fitted into those grooves, and the glasses lenses 20 a and 20 b are held by the elasticity of the rim 11 .
- the glasses lenses 20 a and 20 b may also be fixed to the rim 11 by applying an adhesive to those edge surfaces.
- Temple portions (also referred to as arms or cranes) 13 a and 13 b are respectively attached to left and right end pieces 12 a and 12 b of the rim 11 via a hinge.
- the tips of the temple portions 13 a and 13 b are integrally formed in the shape of ear pads, which are referred to as “ear pieces”.
- Nose pads 14 a and 14 b for sitting on the nose of the wearer are also formed on the rim 11 .
- the nose pads 14 a and 14 b are each joined to the rim 11 by part referred to as a pad arm.
- Typical glasses lenses used in everyday activities by the wearer may be used for the glasses lenses 20 a and 20 b.
- the glasses type information terminal 1 is completed by the wearer procuring glasses lenses for himself or herself, and mounting those glasses lenses in the glasses frame 10 .
- FIGS. 1A, 1B, 2A and 2B Various electronic components are accommodated in the glasses frame 10 at sites indicated by the dashed lines in FIGS. 1A, 1B, 2A and 2B .
- One of the electronic components is color chip light-emitting diodes (LEDs) 30 a, 30 b, 30 c, 30 d, 30 e, and 30 f, which are each independently capable of light emission control.
- the color chip LEDs are abbreviated as chip LEDs 30 .
- the chip LEDs 30 are each a light-emitting device capable of emitting color light in one or more colors.
- multicolor light can be emitted by mounting on one chip LEDs in the three primary colors, namely, red, blue, and yellow, and selectively driving any one of those colors or two or more of those colors at a predetermined light intensity.
- chip LEDs 30 for example, “LL-S197BRGBC”, manufactured by the Chinese company Lucky Light Electronic Co., Ltd., may be used.
- the chip LEDs 30 are used as a light-emitting source configured to emit signal light in a predetermined direction in cooperation with an opening 111 b, which is described later.
- the term “signal light” refers to light representing information. Regardless of whether the light is blinking light or is continuous light, as long as the light includes information, such light may be considered to be signal light.
- Three chip LEDs 30 are arranged for each of the left and right glasses lenses 20 a and 20 b at a portion slightly above the grooves formed in the rim 11 . As a result, multicolor light may be emitted in accordance with the information.
- a piezoelectric speaker 40 in addition to the chip LEDs 30 , a piezoelectric speaker 40 , an environment sensor 50 , a communication module 60 , a control module 70 , a switch 80 , and a battery 90 are used as electronic components. Those electronic components are also accommodated in predetermined sites of the glasses frame 10 .
- the piezoelectric speaker 40 is arranged on an inner side of the ear piece of the temple portion 13 b, namely, at a site directing to the ear of the wearer.
- FIGS. 1A, 1B, 2A and 2B an example is illustrated in which one piezoelectric speaker 40 is used.
- the piezoelectric speaker 40 may also be arranged on the temple portion 13 a as well. Ultra-compact products 0.5 [mm] thin and about 1 [mm] square are currently being sold, and hence such a product may be used.
- the environment sensor 50 which is a sensor configured to detect a change in a surrounding environment of the glasses frame 10 , is arranged near a center portion of the rim 11 .
- any one of, or a combination of, an acceleration sensor, an air pressure sensor, a temperature sensor, a humidity sensor, a distance sensor, and an illuminance sensor may be removably mounted.
- the description is based on the assumption that an illuminance sensor is used as the environment sensor 50 .
- the communication module 60 uses a multi-purpose module configured to use near field communication based on “Bluetooth”.
- Near field communication is a communication standard that uses a small amount of power and that has been determined in accordance with international standards.
- the reason why near field communication is employed is in order to avoid interference with another information terminal.
- the reason why “Bluetooth” is employed is because with the reductions in module size, modules using “Bluetooth” are more suited to being accommodated in the glasses frame 10 .
- near field communication other than “Bluetooth”, for example, infrared communication may also be employed.
- a communication module configured to employ wireless communication other than near field communication or wired communication may also be used.
- the control module 70 is described later.
- the switch 80 is a switch for stopping and restarting operation of the chip LEDs 30 and the piezoelectric speaker 40 .
- the battery 90 is, for example, a lithium ion battery or a button battery.
- An adjustment button (not shown) configured to adjust the light intensity of the chip LEDs 30 or a volume level of the piezoelectric speaker 40 is also arranged.
- Each of the electronic components is mounted to the glasses frame 10 via one or a plurality of film-like circuit boards on which a wiring pattern is formed.
- the circuit boards between the rim 11 and the pair of temple portions 13 a and 13 b are connected to each other by individual wires.
- an electronic circuit is formed over the overall glasses frame 10 .
- Each electronic component has a horizontal size and a vertical size of about 0.5 [mm] to about 5 [mm], or less.
- FIG. 3 is an enlarged partial view of the rim 11 on a right eye portion of the wearer.
- a light-emitting surface (surface emitting light) of the chip LED 30 b in the center faces an edge surface of a peripheral edge of the glasses lens 20 a.
- the light-emitting surfaces of the chip LEDs 30 a and 30 c on either side of the chip LED 30 b face in the opposite direction to the chip LED 30 b.
- the opening 111 b configured to form the emitted light into a beam and to determine the emission direction of the light is formed in a portion for housing the center chip LED 30 b.
- the opening 111 b is formed in a shape directing to an edge surface that, of the edge surface of the glasses lens 20 b, is slightly lower than the eye level of the wearer. In general, regardless of what type of glasses lens is held, the angle with respect to the glasses frame is almost constant. As a result, there is no problem even if, like in this embodiment, the opening 111 b is formed in advance in the manner described above. In other words, the signal light emitted from the chip LED 30 b is propagated toward the above-mentioned edge surface even when an arbitrary glasses lens selected by the wearer is held in the glasses frame 10 .
- a main role of the chip LEDs 30 a and 30 c that are not in the center is to change the coloration of the glasses frame 10 . Therefore, the light-emitting surfaces of the chip LEDs 30 a and 30 c are arranged so as to emit light toward an inner portion of the glasses frame 10 .
- FIG. 3 an example is illustrated in which, when the glasses frame 10 is worn, the chip LEDs 30 a and 30 c are in a direction directing directly upward. However, this is merely one example. Obviously, depending on the shape of the rim 11 , when the glasses frame 10 is worn, the chip LEDs 30 a and 30 c may be also arranged at a slight angle from the horizontal.
- the light emitted by the light-emitting surfaces of the chip LEDs 30 a and 30 c is propagated while being repeatedly reflected in the inner portion of the rim 11 . During that process, the rim 11 emits a color. That light is also propagated to the temple portions 13 a and 13 b.
- the overall glasses frame 10 can be changed from its original color. When a fluorescence agent is mixed in the glasses frame 10 , there are advantages in that a light emission quantity is increased and synthesis of a desired color is easier.
- the edge surface of the glasses lens 20 a becomes a scattering surface during lens processing.
- the light that has reached the edge surface of the glasses lens 20 a arrives at the eye of the wearer via the light propagating through the edge surface and the surface of the glasses lens 20 a. It is easier for a person to look below eye level than above eye level. Therefore, even when the light intensity of the signal light is small, information can be delivered to the wearer at least via the edge surface lower than eye level.
- a display mode in which the signal light blinks is also possible. In this case, even when the wearer is focused on a task, or is walking or running, the signal light can be reliably delivered. In whichever case, because the signal light only travels toward the edge surface of the glasses lens 20 a, the range of view of the wearer is not impaired.
- FIG. 3 is an illustration of a structure of the rim 11 of the right eye portion of the wearer.
- the left eye portion of the rim 11 also has the same structure.
- the shape of the opening 111 b may be appropriately changed in accordance with the shape and structure of the chip LED 30 b, in particular, the light-emitting surface of the chip LED 30 b.
- those parts are referred to as “glasses lenses 20 ”.
- control module 70 operating in a lead role.
- the control module 70 is built from a processor, a computer program, and firmware loaded with digital data.
- firmware a small-scale complex programmable logic device (CPLD), a field-programmable gate array (FPGA), may be used.
- CPLD complex programmable logic device
- FPGA field-programmable gate array
- FIG. 4 A function configuration example of the control module 70 is illustrated in FIG. 4 .
- the control module 70 includes an input/output control unit 711 , a timer 712 , a plurality of association tables 713 , a data storage unit 714 , and a main control unit 715 configured to control operation of each unit in an integrated manner.
- the input/output control unit 711 is configured to control input and output of information to and from the main control unit 715 and the chip LEDs 30 , the piezoelectric speaker 40 , the environment sensor 50 , and the communication module 60 .
- the timer 712 is configured to output a measurement result of the current time to the main control unit 715 .
- the timer 712 is used to, for example, determine the time and to determine a start and an end of a time period.
- the association tables 713 are tables configured to show drive patterns of the chip LEDs 30 and the piezoelectric speaker 40 by the main control unit 715 .
- the drive patterns are set in accordance with various control information.
- the control information described in this embodiment is as follows.
- Light emission control information representing the light emission mode of the light-emitting source determined in accordance with a detection result of the environment sensor 50 .
- Light emission control information (third light emission control information: received from smartphone) representing the light emission mode of the light-emitting source determined in accordance with the detection result of the environment sensor 50 .
- action information when it is not necessary to distinguish among the various pieces of control information, the various control information is collectively referred to as “action information”.
- the action information is unique to the wearer.
- the content of the action information may be freely set and changed as appropriate by the wearer or a concerned party via the smartphone, for example. The setting and changing methods are described in detail later.
- emission mode of the light-emitting source refers to, for example, an emission color (a combination in the case of mixed colors) achieved by controlling a drive timing of the chip LEDs 30 , whether or not the light is blinking, or a blinking pattern (such as period, duration). Flashing is also one mode of a blinking pattern.
- output mode of a sound refers to, for example, whether or not there is sound source data to be used in order to drive the piezoelectric speaker 40 , a sound source pattern (whether or not the sound is intermittent, or a combination of sound source data), and a message pattern (a combination of sound source data).
- the message pattern may include patterns of combinations of synthetic speech.
- Content examples of the association tables 713 of this embodiment are shown in FIG. 5 to FIG. 7 .
- a pattern identification is associated with the type (color) of light to be used, the blinking pattern, the sound source pattern, and the message pattern.
- the main control unit 715 is configured to control the chip LEDs 30 and the piezoelectric speaker 40 based on the content of the identified pattern ID.
- LED #1 corresponds to the chip LED 30 a
- LED #2 corresponds to the chip LED 30 b
- LED #3 corresponds to the chip LED 30 c
- LED #4 corresponds to the chip LED 30 d
- LED #5 corresponds to the chip LED 30 e
- LED #6 corresponds to the chip LED 30 f.
- the symbol “ ⁇ ” indicates that the relevant chip LED 30 is not driven.
- the symbols “L1”, “L2”, and “L3” each indicate a different emission color of the chip LEDs 30 .
- “L1, L3” represents a mixed color.
- the symbol “ ⁇ ” indicates the blinking pattern of the LED #1 to LED #6, and the numeral “0” indicates that blinking is not performed, namely, the chip LEDs 30 are caused to emit bursts of light as a result of the chip LEDs 30 being driven for a given duration.
- the blinking patterns “1” to “4” each have a different blinking interval or speed.
- the pattern ID “A-001” of FIG. 5 indicates that all of “LEDs #1, #3, #4, and #6” are “L1”, namely, all of the chip LEDs 30 a, 30 c, 30 d, and 30 f continuously emit the color corresponding to L1 (e.g., green).
- L1 e.g., green
- the symbol “ ⁇ ” indicates the pattern to be output
- the numeral “0” indicates that sound source data is not used (sound is not output).
- the sound source patterns “1” to “5” and the message patterns “1” to “5” are each a combination pattern of different sound source data or different messages.
- the other pattern IDs, chip LEDs 30 , and the piezoelectric speaker 40 also have a similar content.
- the pattern IDs may be added to, changed, or deleted.
- FIG. 6 an example is shown of the light emission mode and the output mode controlled in accordance with the detection result of the environment sensor 50 .
- the light emission mode and the output mode are associated with a change ID.
- the change ID represents, when the illuminance sensor is used as an example, a level of illuminance change of the surrounding area of the glasses type information terminal 1 .
- a reference range of each illuminance change is set. The change IDs are set so that when the illuminance change is in a given reference range, the change ID is “KA-001”, and when the illuminance change is more than the reference range, the change ID is “KA-002”, for example.
- the illuminance change is a change by an amount corresponding to the change ID “KA-001”, among the chip LEDs 30 , the light intensity of the LED #1, the LED #3, the LED #4, and the LED #6 (chip LEDs 30 a, 30 c, 30 d, and 30 f ) is changed by ⁇ a (lux).
- the symbol “ ⁇ ” in “Sound Source” indicates that no sound or message is output from the piezoelectric speaker 40 .
- the symbol “ ⁇ ” is set. In such a case, as shown in FIG. 5 , any one of “1” to “5” is selected.
- the change ID may be added to, changed, or deleted.
- FIG. 7 an example of the control content for each APP is shown.
- the “APP-ID” represents the ID of each APP that is loaded in the smartphone and that is set so that the execution situation of the APP can be monitored.
- the “Pattern ID” represents the content shown as an example in FIG. 5 .
- the “Change ID” is, for example, KA-001 shown as an example in FIG. 6 . In the example shown in FIG. 7 , this means that for a given APP (APP-05), with the light emission mode and the output mode identified by the pattern ID “B-001” as a base, the light intensity is adjusted based on the pattern identified by the change ID “KB-001”.
- the APP-ID FIG. 7
- the APP-ID includes a pattern ID ( FIG. 5 ) and a change ID ( FIG. 6 ), and the APP-ID may include only a pattern ID. In another case, another pattern (ID) may also be added to the APP-ID.
- the digital data required by the main control unit 715 to implement the light emission mode of the chip LEDs 30 and the output mode of the piezoelectric speaker 40 , and the setting content of each APP, are stored in the data storage unit 714 .
- the digital data is, for example, a control parameter for light emission control based on a specification of the chip LEDs 30 , and a plurality of types of sound source data for determining the content of the sound to be output from the piezoelectric speaker 40 .
- the sound source data may also be synthetic speech for building message data.
- the digital data is obtained from the smartphone, for example, and stored.
- One operation of the main control unit 715 is performing light emission control of the chip LEDs 30 and output control of the piezoelectric speaker 40 in accordance with the execution situation of an APP loaded in the smartphone or the detection result of the environment sensor 50 . Those controls are performed based on the action information.
- the action information is received from the smartphone that generated the action information via the communication module 60 .
- the second light emission control information and warning information such information is not received from the smartphone, but it is generated by the main control unit 715 itself.
- the content corresponding to the association tables 713 shown as examples in FIG. 5 to FIG. 7 is also included in the smartphone. Therefore, in this embodiment, the real action information received from the smartphone is the APP-ID shown in FIG. 7 .
- the action information (second light emission control information, for example) that has no relation to the execution situation of the smartphone, a fixed APP-ID is set for such action information in advance by the smartphone.
- the main control unit 715 is configured to identify the pattern ID ( FIG. 5 ) and the change ID ( FIG. 6 ) based on the acquired action information (APP-ID: FIG. 7 ).
- the chip LEDs 30 and the piezoelectric speaker 40 are driven via the input/output control unit 711 by using, among the digital data stored in the data storage unit 714 , the control parameter and so on.
- the smartphone is a known mobile computer including, for example, a communication function, such as data communication and telephone calls using a public telecommunications network, an information display function, such as a display, an information input function, such as a keyboard, sound source data, and a speaker.
- the information display function and the information input function may be implemented by a touch panel.
- the communication function includes, in addition to typical communication via a public telecommunications network, a function for performing one-to-one near field communication to and from the glasses type information terminal 1 .
- FIG. 8 is a configuration diagram of the function blocks implemented in the smartphone.
- a smartphone 5 is configured to function as a control unit 50 , a monitoring unit 51 , a setting unit 52 , a communication unit 53 , and a data storage unit 54 that those function blocks refer to as appropriate.
- the communication unit 53 is configured to perform, similar to the glasses type information terminal 1 , near field communication based on “Bluetooth”.
- the data storage unit 54 is configured to store, for example, information on the glasses type information terminal 1 , which is the other party in the near field communication, and tables including the same content as the association tables 713 ( FIG. 5 to FIG. 7 ) included in the glasses type information terminal 1 .
- the content of the tables is synchronized at a point when near field communication to and from the glasses type information terminal 1 has been enabled by the communication unit 53 .
- the monitoring unit 51 is configured to monitor the execution situation of an APP loaded in the smartphone.
- the APP to be monitored is freely determined by the wearer, and the ID of that APP (APP-ID) is set in the tables in the data storage unit 54 .
- the execution situation of the APP is a call notification, a mail notification, a message exchange service notification, a notification of various information guidance, and relaxation.
- Each notification is detected as one execution situation of an APP already loaded in the smartphone, such as a mail APP, an internet communication APP, and not as an execution situation of the communication unit 53 .
- the setting unit 52 is configured to set the light emission mode of the chip LEDs 30 and/or the output mode of the piezoelectric speaker 40 to be determined in accordance with the execution situation of the APP monitored by the monitoring unit 51 . Specifically, a setting screen is displayed on the touch panel, and setting content input by a touch operation or the like is transmitted to the control unit 50 .
- the control unit 50 is configured to create or update the content of the tables stored in the data storage unit 54 based on the content set by the setting unit 52 .
- the action information is generated based on the monitoring result of the execution situation of the APP by the monitoring unit 51 .
- the generated action information is transmitted to the glasses type information terminal 1 via the communication unit 53 .
- the control unit 50 is configured to refer to the tables in the data storage unit 54 when generating the action information. In this embodiment, by the time that the APP to be monitored is set, the control unit 50 has grasped the APP-ID for that APP. Therefore, in this embodiment, the APP-ID (or with accompanying information) may be generated as the action information, and the generated APP-ID may be transmitted to the glasses type information terminal 1 .
- FIG. 9 is a procedure explanatory diagram when setting an APP whose execution situation is to be monitored.
- the setting unit 52 displays a setting menu screen 1001 illustrated in FIG. 10 on the touch panel (Step S 102 ).
- icons of the APPs already set as an APP whose execution situation is to be monitored, and a “setting” icon 1002 for enabling a new setting or already-set content to be changed, are displayed.
- the APP icons displayed on the screen of FIG. 10 correspond to “Timer”, “Tempo”, and “Relax”.
- the “Timer” icon represents an APP configured to output as the action information a time that the wearer is to pay attention to.
- the “Tempo” icon represents an APP configured to output as the action information a trigger for each fixed time interval to be used for a pace determination, for example.
- the “Relax” icon represents a so-called relaxation APP.
- the relaxation APP is configured to output action information for implementing a display mode that is easy on the eyes or that delivers a lot of relaxing emission colors to the eyes of the wearer.
- the touch panel screen switches to an APP setting screen 1101 like that illustrated in FIG. 11 .
- APPs that have already been set are indicated as being “On”, and APPs that have not been set are indicated as being “Off”.
- the setting content may be changed.
- an “Off” APP is selected, the execution situation of the APP corresponding to that icon becomes a new monitoring target.
- the icons that are illustrated in FIG. 11 are the above-mentioned “Timer”, “Tempo”, and “Relax” icons. Examples of other APPs include the following.
- Morse Code Morse communication
- the APP setting screen 1101 illustrated in FIG. 11 when the “Mail” icon 1102 is selected, the additional note changes from “Off” to “On”, and the touch panel screen switches to a setting content screen 1201 for the mail notification illustrated as an example in FIG. 12 .
- the setting content screen 1201 On the setting content screen 1201 , the following icons and buttons are displayed.
- Step S 104 determines whether or not the received input is content that has already been transmitted to the glasses type information terminal 1 . More specifically, the control unit 50 determines whether or not the received input is a transmission (change transmission) for changing already-set content or for releasing an unset state based on a transmission history to the glasses type information terminal 1 .
- Step S 103 No
- Step S 104 the control unit 50 returns the processing to Step S 103 .
- Step S 104 When the received input is a change transmission (Step S 104 : YES), the control unit 50 identifies and corrects the pattern ID corresponding to the input setting content, or newly generates a pattern ID, and as a result of that processing generates setting information associating the APP-ID to be monitored and the pattern ID (Step S 105 ). Then, the control unit 50 stores the generated setting information in the tables of the data storage unit 54 (Step S 106 ). When there is another input (Step S 107 : Yes), the control unit 50 returns the processing to Step S 102 . When there are no other inputs (Step S 107 : No), the control unit 50 ends the setting processing. The stored setting information is transmitted to the glasses type information terminal 1 when near field communication to and from the glasses type information terminal 1 is enabled, and the transmitted setting information is synchronized with the association tables 713 .
- the control unit 50 generates the action information and transmits the generated action information to the glasses type information terminal 1 based on the monitoring result of the monitoring unit 51 and the stored setting information.
- a procedure explanatory diagram in such a case is illustrated in FIG. 13 .
- an example is illustrated of a case in which, in the smartphone 5 , a mail notification from outside or a notification based on Internet communication is monitored.
- the control unit 50 waits for a notification from outside by using the monitoring unit 51 (Step S 201 : No).
- Step S 201 When a notification is detected (Step S 201 : Yes), the control unit 50 determines whether or not that notification is addressed to a set APP, namely, is a notification addressed to an APP set as a monitoring target (Step S 202 ). When the notification is not addressed to a set APP (Step S 202 : No), the control unit 50 returns the processing to Step S 201 .
- Step S 202 When the notification is addressed to a set APP (Step S 202 : Yes), the control unit 50 reads the “APP-ID” of the APP to be monitored (Step S 203 ). Then, the control unit 50 generates action information based on, for example, the read “APP-ID”. (Step S 204 ), and transmits the generated action information to the glasses type information terminal 1 (Step S 205 ). After the action information has been transmitted, the control unit 50 stores the transmission history in the data storage unit 54 , and ends the processing.
- a predetermined event including an instruction from the wearer
- a non-notification APP such as “Relax” and “Timer”
- the processing is not limited to the processing described above.
- the control unit 50 measures time with an internal clock, identifies the “APP-ID” corresponding to “Timer” when the current time arrives at the time set by the wearer, and then performs the processing of Step S 204 onwards.
- the control unit 50 immediately identifies the “APP-ID” corresponding to “Tempo”, and then performs the processing of Step S 204 onwards. The same processing as this is also performed when the APP is “Relax”.
- the glasses type information terminal 1 performs light emission control of the chip LEDs 30 and/or output control of the piezoelectric speaker 40 based on the procedure illustrated in FIG. 14 . Specifically, after the switch 80 ( FIG. 2A ) is turned on, the control module 70 waits for input of the action information (Step S 301 : No). When the action information has been input (Step S 301 : Yes), the control module 70 analyzes the content of the action information (Step S 302 ). When it is determined based on the analysis that the action information is light emission control information on the chip LEDs 30 (Step S 303 : Yes), the control module 70 performs light emission control.
- control module 70 determines the emission color and the emission timing of each chip LED 30 , and generates control signals for driving the chip LEDs 30 in that manner (Step S 304 ). Then, the control module 70 emits the signal light by driving the relevant chip LEDs 30 based on those control signals (Step S 305 ). The control module 70 waits for light emission control to finish (Step S 306 : No), and when the light emission control has finished (Step S 306 : Yes), ends the processing.
- Step S 303 when it is determined based on the analysis result of Step S 302 that the action information is not light emission control information on the chip LEDs 30 (Step S 303 : No), the control module 70 performs output control of the piezoelectric speaker 40 . Specifically, the control module 70 generates a control signal in accordance with the sound source data (Step S 307 ). Then, the control module 70 outputs a sound from the piezoelectric speaker 40 based on the control signal (Step S 308 ). The control module 70 waits for output control to finish (Step S 309 : No), and when the light emission control has finished (Step S 309 : Yes), ends the processing.
- the glasses type information terminal 1 autonomously generates the action information (second light emission control information), and performs light emission control of the chip LEDs 30 .
- the processing procedure of the control module 70 in this case is illustrated in FIG. 15 .
- the control module 70 waits for input from the environment sensor 50 (Step S 401 : No).
- the control module 70 determines whether or not the illuminance change is equal to or more than a reference range (Step S 402 ).
- the reference range corresponds to any one of the change IDs ( FIG. 6 ) in the association tables 713 .
- the control module 70 returns the processing to Step S 401 .
- the control module 70 identifies the change ID ( FIG. 6 ) corresponding to that reference range.
- the control module 70 changes the brightness of the relevant chip LEDs 30 to the set values (Step S 403 ).
- the signal light can be recognized more easily by increasing the brightness of the chip LEDs 30 when the surrounding area of the glasses frame 10 becomes brighter than a given reference range.
- the detection result of the control unit 50 may be transmitted to the smartphone, and the action information (third light emission control information) may be generated on the smartphone side.
- the processing of Step S 402 is performed by the smartphone.
- the control module 70 of the glasses type information terminal 1 performs the processing of Step S 403 based on the received action information.
- the signal light of the light emission mode determined in accordance with the execution situation of an APP loaded in the smartphone 5 is emitted from the chip LEDs 30 , and propagated to at least one of the edge surface of the glasses lens 20 and the inner portion of the glasses frame 10 .
- red signal light reaches, for example, the edge surface of the glasses lens 20 three times, and when there is a notification of a change in the price of a stock Y, signal light that slowly gleams blue reaches the edge surface of the glasses lens 20 , for example.
- the overall glasses lens 20 may appear to be gleaming. As a result, even when walking or during a task being focused on, or even when the eyes of the wearer are shut, the wearer can reliably recognize the signal light.
- the wearer may be allowed to relax by performing light emission control so that the light intensity emitted by the overall glasses lens 20 is easy on the eyes or is a relaxing emission color.
- an APP configured to change the emission color of the overall glasses frame 10 an APP configured to change the coloration of the overall glasses lens 20
- an APP capable of sending out information from the wearer to the surrounding area may be applied in uses other than alerting the wearer of a notification, for example, to the smartphone 5 .
- information can be sent out to the surrounding area in accordance with the personality or feelings of the wearer, or the current ambience.
- the glasses type information terminal 1 may also be employed in place of makeup to change the appearance of the skin color of the wearer or to cause the eyebrows of the wearer to look thicker. Further, the glasses type information terminal 1 may also be employed to search for or to recognize people in crowded or dark places and to rouse the wearer by using the color or a blinking pattern of the signal light.
- the sound of the output mode determined in accordance with the execution situation of an APP is output from the piezoelectric speaker 40 .
- an APP configured to alert the wearer of information that produces a sense of discomfort in the surrounding area like in the related-art device may be handled by only outputting a sound from the piezoelectric speaker 40 , and without performing light emission control of the chip LEDs 30 .
- implementing the light emission mode of the light-emitting source, such as the chip LEDs 30 , and the output mode of a sound by the piezoelectric speaker 40 in combination allows various information to be represented while using a simple configuration capable of reducing costs.
- the content corresponding to the association tables 713 is held both by the control module 70 of the glasses type information terminal 1 and by the smartphone 5 .
- those tables may be stored by only the smartphone 5 .
- the standards, for example, of the chip LEDs 30 and the piezoelectric speaker 40 of the glasses type information terminal 1 are input in advance in the smartphone 5 , and the smartphone 5 generates the action information for controlling the chip LEDs 30 and the piezoelectric speaker 40 .
- association tables 713 may be stored just by the control module 70 of the glasses type information terminal 1 .
- the content of those association tables 713 is utilized by the smartphone 5 , and only the pattern ID is transmitted to the glasses type information terminal 1 as information to be presented.
- the present invention is not limited to this example.
- the light-emitting surfaces of all the chip LEDs 30 may be arranged facing in a downward direction. Further, in the case that the light reaches the glasses lenses even without arranging the opening 111 b, it is not necessary to form the opening 111 b. From the perspective of increasing directivity, a reflective film may be arranged on a rear side of the light-emitting surfaces of the chip LEDs 30 .
- the environment sensor 50 is an illuminance sensor.
- an acceleration sensor or an angular velocity sensor is used as the environment sensor 50 , an even wider range of usages is possible.
- control can be performed for representing the display mode of the chip LEDs 30 or the output mode of the piezoelectric speaker 40 in accordance with the posture of the wearer.
- the glasses type information terminal 1 is configured to store the sound source data and to perform output control of the piezoelectric speaker 40 based on that sound source data.
- the present invention is not limited to this example.
- the present invention may also be implemented by utilizing the glasses type information terminal 1 as a wireless earpiece of the smartphone 5 .
- the control module 70 is configured to receive a wireless signal representing an output sound of the smartphone 5 from the smartphone 5 via the communication module 60 .
- the output sound is extracted from the received wireless signal, and the extracted output sound is output from the piezoelectric speaker 40 .
- 1 . . . glasses type information terminal 5 . . . smartphone, 10 . . . glasses frame, 20 a, 20 b . . . glasses lenses, 30 ( 30 a - 30 f ) . . . chip LED, 40 . . . piezoelectric speaker, 50 . . . environment sensor, 70 . . . control module, 80 . . . switch, 90 . . . battery
Abstract
Provided is a glasses type information terminal, which is not only configured to deliver information to a wearer without hindering everyday activities, but is also capable of easily delivering an intention or the like of the wearer to a surrounding area. Chip LEDs capable of selectively emitting a plurality of colors of light are arranged on a glasses frame. The chip LEDs are configured to radiate light toward an end portion of glasses lenses. A control module and a communication module configured to perform near field communication to and from a mobile terminal that generates personalized information on the wearer are accommodated in the glasses frame. The control module is configured to perform light emission control of the chip LEDs based on information from the mobile terminal.
Description
- This application is a continuation of U.S. application Ser. No. 15/120,190, accorded a filing date of Aug. 19, 2016, which is a national stage application of International Application No. PCT/JP2015/055188, filed on Feb. 24, 2015, which claims priority to JP 2014-032971, filed Feb. 24, 2014, and JP 2015-028069, filed on Feb. 16, 2015, the entire disclosures of which are hereby incorporated by reference.
- The present invention relates to a glasses type information terminal capable of delivering information to a wearer based on signal light and sound as well as sending out information to a surrounding area of the wearer, and an information processing device and components thereof configured to operate in cooperation with the glasses type information terminal.
- In recent years, there has been proposed a glasses type information terminal configured to represent information based on a sensation of wearing ordinary glasses. For example, in the eye mount video display device disclosed in
Patent Literature 1, a liquid crystal display panel is arranged at a portion corresponding to a glasses lens, and the liquid crystal display panel is configured to be connected to a computer device. Further, in the video display device disclosed inPatent Literature 2, light having a brightness that has been changed in accordance with an input video signal is converted into beam light. The beam light is two-dimensionally scanned, and the scanned beam light is guided to an eyeball of the wearer via an integrated mirror arranged at a site corresponding to a glasses lens. - In both the device disclosed in
Patent Literature 1 and the device disclosed inPatent Literature 2, a display panel for displaying an image or video (hereinafter referred to as “image”) is formed, or appears to the wearer as if it is formed, on a site corresponding to the glasses lens. Therefore, a processing module for image processing and an optical mechanism for displaying the image are required, which not only place a burden on the body of the wearer, but also appear weird to a person seeing the wearer. Normally, a person cannot directly view the image with one eye and the surrounding area of the person with another eye. Therefore, the wearer of a related-art glasses type information terminal such as that disclosed inPatent Literature - As a technology for solving such a problem, in the head-worn information notification device disclosed in
Patent Literature 3, a display unit is arranged at a position inside a field of view of a user and outside the field of view visible through the glasses lens when the user wears the glasses, and reception of information is notified to the user via light emitted by the display unit. - [PTL 1] JP 2003-289484 A; [PTL 2] JP 2000-111829 A; [PTL 3] JP 2011-229024 A
- A method of notifying information that produces a sense of discomfort in the surrounding area is limited in terms of its usable environment. Thus, the head-worn information notification device disclosed in
Patent Literature 3 is configured to notify reception of information only to the user, and to prevent the reception of information from being perceived in the surrounding area. Therefore, there is a disclosure that it is necessary for a light-emitting unit to be arranged in a region from about 68 degrees to about 100 degrees on the ear side with respect to a visual axis of the user. Further, there is also a disclosure that it is necessary for the light-emitting unit to be configured so as to have directivity, and for an irradiated region of exit light to be a region enclosed by the portions at both end surfaces of the head of the user (wearer) as viewed from an exit portion, namely, to be a region in which irradiation light is blocked by the head. - However, each wearer has a different field of view and range of view. Therefore, glasses frames in which the position of the light-emitting unit is fixedly determined cannot be mass produced, and hence glasses frames are so-called special order products. As a result, it is difficult to reduce manufacturing costs. In the case of weak light that is not perceived in the surrounding area, such light may also not be perceived by the wearer himself or herself. This is particularly the case when the attention of the wearer is focused on his or her range of view in front, such as during walking (traveling), or when the eyes of the user are shut. Further, because the light is emitted at a position away from the wearer, there is always an influence by the emitted light. As a result, it is difficult to build glasses frames for which emitted light is not perceived in the surrounding area. Rather than building such glasses frames, enabling information from the wearer to be sent out even to the surrounding area via emitted light is expected to lead to an increase in the demand and uses of this kind of glasses type information terminal.
- It is a main object of the present invention to provide a glasses type information terminal capable of not only delivering to the wearer information for the wearer without hindering everyday activities, but also of sending out information from the wearer even to the surrounding area.
- Another object of the present invention is to provide an information processing device suited to being in cooperation with the above-mentioned glasses type information terminal, and a computer program and a recording medium for implementing such an information processing device.
- According to one embodiment of the present invention, there is provided a glasses type information terminal, including: a glasses frame configured to hold a glasses lens; a light-emitting source of signal light; and a control module configured to perform, when triggered by input of information representing a light emission mode of the signal light, light emission control of the light-emitting source based on the information, the glasses type information terminal being configured such that a signal light of the light emission mode is propagated from the light-emitting source toward at least one of the glasses frame and an edge surface of the glasses lens.
- Further, according to one embodiment of the present invention, there is provided an information processing device, including: communication means for performing communication to and from the glasses type information terminal; monitoring means for monitoring an execution situation of a loaded application; setting means for setting a light emission mode of the light-emitting source in accordance with the monitored execution situation; and control means for generating the light emission control information based on content set by the setting means, and transmitting the generated light emission control information to the glasses type information terminal via the communication means.
- Further, according to one embodiment of the present invention, there are provided a computer program for causing a computer including a communication function to operate as the information processing device, and a recording medium having the computer program stored thereon.
- The glasses type information terminal according to the one embodiment of the present invention is configured to propagate signal light from a light-emitting source toward an edge surface of a glasses lens or a glasses frame. As a result, information may be delivered to the wearer via the signal light without impairing the range of view of the wearer. Further, information from the wearer can be sent out to the surrounding area by using light that has reached the glasses frame or an edge surface of the glasses lens.
- According to the information processing device of the present invention, the content of the representation of information by the glasses type information terminal is capable of being set at a position away from the glasses type information terminal.
-
FIG. 1A is a front view of a glasses type information terminal according to an embodiment of the present invention, andFIG. 1B is a side view of the glasses type information terminal. -
FIG. 2A is a top view of the glasses type information terminal, andFIG. 2B is a perspective view of the glasses type information terminal. -
FIG. 3 is an enlarged partial view of a rim on a right eye portion of a wearer. -
FIG. 4 is a function configuration diagram of a control module. -
FIG. 5 is an explanatory diagram of a content example of an association table. -
FIG. 6 is an explanatory diagram of a content example of the association table. -
FIG. 7 is an explanatory diagram of a content example of a table stored in a data storage unit. -
FIG. 8 is a function configuration diagram of an information processing device. -
FIG. 9 is a setting procedure explanatory diagram of an APP to be monitored. -
FIG. 10 is an explanatory diagram of a setting menu screen. -
FIG. 11 is an explanatory diagram of a selection screen of the APP to be set. -
FIG. 12 is an explanatory diagram of a setting content screen for an E-mail. -
FIG. 13 is a procedure explanatory diagram of generation and transmission of action information by the information processing device. -
FIG. 14 is an explanatory diagram of a control procedure by the glasses type information terminal based on the action information. -
FIG. 15 is an explanatory diagram of a control procedure by the glasses type information terminal based on a sensor result. - An embodiment of the present invention is now described with reference to the drawings. In this embodiment, an example is described of a case in which a user carrying a mobile terminal, which is an example of an information processing device, uses a glasses type information terminal by wearing the glasses type information terminal on his or her head. Such a user is referred to as a “wearer”. The mobile terminal is a computer, such as a smartphone, a tablet terminal, or a laptop computer. From the perspective of the glasses type information terminal, the mobile terminal is an external device. A plurality of types of applications (services implemented by execution of an application program; hereinafter referred to as “APP”) are loaded (installed) in the mobile terminal in advance. In the following description, for convenience, the mobile terminal is a smartphone.
- [Glasses Type Information Terminal]
- First, a configuration example of a glasses
type information terminal 1 is described.FIG. 1A is a front view of the glasses type information terminal according to this embodiment, andFIG. 1B is a side view of the glasses type information terminal.FIG. 2A is a top view of the glasses type information terminal, andFIG. 2B is a perspective view of the glasses type information terminal. - The glasses type
information terminal 1 includes aglasses frame 10. Theglasses frame 10 is built from a color-emitting member. Various types of electronic components are accommodated in theglasses frame 10. The color-emitting member is a member configured to emit a color in accordance with the color of input light. A translucent resin, such as acrylic, that emits a milky-white color, a specific achromatic color or chromatic color, or a mixed color thereof, may be used for the color-emitting member. Wearing the glasses typeinformation terminal 1 has the same meaning as wearing theglasses frame 10. - The
glasses frame 10 includes arim 11 configured to hold a part of an upper edge portion and a side end portion of each of a pair of left andright glasses lenses rim 11, a pair of grooves, referred to as rim lines, are dug into a edge surface that is on a lower side when theglasses frame 10 is worn and a side edge surface closer to the center. An upper edge surface of theglasses lenses glasses lenses rim 11. Theglasses lenses rim 11 by applying an adhesive to those edge surfaces. Temple portions (also referred to as arms or cranes) 13 a and 13 b are respectively attached to left andright end pieces rim 11 via a hinge. The tips of thetemple portions Nose pads rim 11. Thenose pads rim 11 by part referred to as a pad arm. - Typical glasses lenses used in everyday activities by the wearer may be used for the
glasses lenses information terminal 1 is completed by the wearer procuring glasses lenses for himself or herself, and mounting those glasses lenses in theglasses frame 10. - Various electronic components are accommodated in the
glasses frame 10 at sites indicated by the dashed lines inFIGS. 1A, 1B, 2A and 2B . One of the electronic components is color chip light-emitting diodes (LEDs) 30 a, 30 b, 30 c, 30 d, 30 e, and 30 f, which are each independently capable of light emission control. When it is not particularly necessary to distinguish among those color chip LEDs, the color chip LEDs are abbreviated as chip LEDs 30. Specifically, the chip LEDs 30 are each a light-emitting device capable of emitting color light in one or more colors. For example, multicolor light can be emitted by mounting on one chip LEDs in the three primary colors, namely, red, blue, and yellow, and selectively driving any one of those colors or two or more of those colors at a predetermined light intensity. As such chip LEDs 30, for example, “LL-S197BRGBC”, manufactured by the Chinese company Lucky Light Electronic Co., Ltd., may be used. - In this embodiment, the chip LEDs 30 are used as a light-emitting source configured to emit signal light in a predetermined direction in cooperation with an
opening 111 b, which is described later. The term “signal light” refers to light representing information. Regardless of whether the light is blinking light or is continuous light, as long as the light includes information, such light may be considered to be signal light. Three chip LEDs 30 are arranged for each of the left andright glasses lenses rim 11. As a result, multicolor light may be emitted in accordance with the information. - In this embodiment, in addition to the chip LEDs 30, a
piezoelectric speaker 40, anenvironment sensor 50, acommunication module 60, acontrol module 70, aswitch 80, and abattery 90 are used as electronic components. Those electronic components are also accommodated in predetermined sites of theglasses frame 10. - The
piezoelectric speaker 40 is arranged on an inner side of the ear piece of thetemple portion 13 b, namely, at a site directing to the ear of the wearer. InFIGS. 1A, 1B, 2A and 2B , an example is illustrated in which onepiezoelectric speaker 40 is used. However, thepiezoelectric speaker 40 may also be arranged on thetemple portion 13 a as well. Ultra-compact products 0.5 [mm] thin and about 1 [mm] square are currently being sold, and hence such a product may be used. - The
environment sensor 50, which is a sensor configured to detect a change in a surrounding environment of theglasses frame 10, is arranged near a center portion of therim 11. As theenvironment sensor 50, any one of, or a combination of, an acceleration sensor, an air pressure sensor, a temperature sensor, a humidity sensor, a distance sensor, and an illuminance sensor may be removably mounted. In this embodiment, the description is based on the assumption that an illuminance sensor is used as theenvironment sensor 50. - The
communication module 60 uses a multi-purpose module configured to use near field communication based on “Bluetooth”. Near field communication is a communication standard that uses a small amount of power and that has been determined in accordance with international standards. In this embodiment, the reason why near field communication is employed is in order to avoid interference with another information terminal. The reason why “Bluetooth” is employed is because with the reductions in module size, modules using “Bluetooth” are more suited to being accommodated in theglasses frame 10. However, near field communication other than “Bluetooth”, for example, infrared communication, may also be employed. In cases in which there is no risk of interference, a communication module configured to employ wireless communication other than near field communication or wired communication may also be used. - The
control module 70 is described later. Theswitch 80 is a switch for stopping and restarting operation of the chip LEDs 30 and thepiezoelectric speaker 40. Thebattery 90 is, for example, a lithium ion battery or a button battery. An adjustment button (not shown) configured to adjust the light intensity of the chip LEDs 30 or a volume level of thepiezoelectric speaker 40 is also arranged. - Each of the electronic components is mounted to the
glasses frame 10 via one or a plurality of film-like circuit boards on which a wiring pattern is formed. The circuit boards between therim 11 and the pair oftemple portions overall glasses frame 10. Each electronic component has a horizontal size and a vertical size of about 0.5 [mm] to about 5 [mm], or less. As a result, even when those electronic components are accommodated, compared with an ordinary glasses frame in which electronic components such as those of this embodiment are not mounted, aglasses frame 10 can be achieved that is compact, lightweight, and does not appear weird to the wearer or to a third party. - A structure of the light-emitting source is now described with reference to
FIG. 3 .FIG. 3 is an enlarged partial view of therim 11 on a right eye portion of the wearer. Amongchip LEDs chip LED 30 b in the center faces an edge surface of a peripheral edge of theglasses lens 20 a. The light-emitting surfaces of thechip LEDs chip LED 30 b face in the opposite direction to thechip LED 30 b. In therim 11, theopening 111 b configured to form the emitted light into a beam and to determine the emission direction of the light is formed in a portion for housing thecenter chip LED 30 b. Theopening 111 b is formed in a shape directing to an edge surface that, of the edge surface of theglasses lens 20 b, is slightly lower than the eye level of the wearer. In general, regardless of what type of glasses lens is held, the angle with respect to the glasses frame is almost constant. As a result, there is no problem even if, like in this embodiment, theopening 111 b is formed in advance in the manner described above. In other words, the signal light emitted from thechip LED 30 b is propagated toward the above-mentioned edge surface even when an arbitrary glasses lens selected by the wearer is held in theglasses frame 10. - A main role of the
chip LEDs glasses frame 10. Therefore, the light-emitting surfaces of thechip LEDs glasses frame 10. InFIG. 3 , an example is illustrated in which, when theglasses frame 10 is worn, thechip LEDs rim 11, when theglasses frame 10 is worn, thechip LEDs chip LEDs rim 11. During that process, therim 11 emits a color. That light is also propagated to thetemple portions overall glasses frame 10 can be changed from its original color. When a fluorescence agent is mixed in theglasses frame 10, there are advantages in that a light emission quantity is increased and synthesis of a desired color is easier. - The edge surface of the
glasses lens 20 a becomes a scattering surface during lens processing. As a result, even when a specific mechanism such as a reflection mirror is not arranged, the light that has reached the edge surface of theglasses lens 20 a arrives at the eye of the wearer via the light propagating through the edge surface and the surface of theglasses lens 20 a. It is easier for a person to look below eye level than above eye level. Therefore, even when the light intensity of the signal light is small, information can be delivered to the wearer at least via the edge surface lower than eye level. A display mode in which the signal light blinks is also possible. In this case, even when the wearer is focused on a task, or is walking or running, the signal light can be reliably delivered. In whichever case, because the signal light only travels toward the edge surface of theglasses lens 20 a, the range of view of the wearer is not impaired. -
FIG. 3 is an illustration of a structure of therim 11 of the right eye portion of the wearer. However, the left eye portion of therim 11 also has the same structure. The shape of theopening 111 b may be appropriately changed in accordance with the shape and structure of thechip LED 30 b, in particular, the light-emitting surface of thechip LED 30 b. In the following description, when it is not necessary to distinguish between theglasses lenses - Next, a function example to be implemented in the glasses type
information terminal 1 is described. Each function is implemented by thecontrol module 70 operating in a lead role. In this embodiment, thecontrol module 70 is built from a processor, a computer program, and firmware loaded with digital data. For this type of firmware, a small-scale complex programmable logic device (CPLD), a field-programmable gate array (FPGA), may be used. A function configuration example of thecontrol module 70 is illustrated inFIG. 4 . Thecontrol module 70 includes an input/output control unit 711, atimer 712, a plurality of association tables 713, adata storage unit 714, and amain control unit 715 configured to control operation of each unit in an integrated manner. - The input/
output control unit 711 is configured to control input and output of information to and from themain control unit 715 and the chip LEDs 30, thepiezoelectric speaker 40, theenvironment sensor 50, and thecommunication module 60. Thetimer 712 is configured to output a measurement result of the current time to themain control unit 715. Thetimer 712 is used to, for example, determine the time and to determine a start and an end of a time period. The association tables 713 are tables configured to show drive patterns of the chip LEDs 30 and thepiezoelectric speaker 40 by themain control unit 715. The drive patterns are set in accordance with various control information. The control information described in this embodiment is as follows. - (a) Light emission control information (received from a smartphone) representing a light emission mode of the light-emitting source determined in accordance with an execution situation of an APP loaded in the smartphone.
- (b) Light emission control information (second light emission control information) representing the light emission mode of the light-emitting source determined in accordance with a detection result of the
environment sensor 50. - (c) Light emission control information (third light emission control information: received from smartphone) representing the light emission mode of the light-emitting source determined in accordance with the detection result of the
environment sensor 50. - (d) Sound control information (received from smartphone) representing an output mode of a sound to be produced by the
piezoelectric speaker 40 by using sound source data. - In the following description, when it is not necessary to distinguish among the various pieces of control information, the various control information is collectively referred to as “action information”. The action information is unique to the wearer. The content of the action information may be freely set and changed as appropriate by the wearer or a concerned party via the smartphone, for example. The setting and changing methods are described in detail later.
- In this case, “emission mode of the light-emitting source” refers to, for example, an emission color (a combination in the case of mixed colors) achieved by controlling a drive timing of the chip LEDs 30, whether or not the light is blinking, or a blinking pattern (such as period, duration). Flashing is also one mode of a blinking pattern. Further, “output mode of a sound” refers to, for example, whether or not there is sound source data to be used in order to drive the
piezoelectric speaker 40, a sound source pattern (whether or not the sound is intermittent, or a combination of sound source data), and a message pattern (a combination of sound source data). The message pattern may include patterns of combinations of synthetic speech. Content examples of the association tables 713 of this embodiment are shown inFIG. 5 toFIG. 7 . - In the example shown in
FIG. 5 , for each record, a pattern identification (ID) is associated with the type (color) of light to be used, the blinking pattern, the sound source pattern, and the message pattern. Through identifying any one of the pattern IDs, at least one of the light emission mode and the output mode can be identified. Themain control unit 715 is configured to control the chip LEDs 30 and thepiezoelectric speaker 40 based on the content of the identified pattern ID. InFIG. 5 , “LED # 1” corresponds to thechip LED 30 a, “LED # 2” corresponds to thechip LED 30 b, “LED # 3” corresponds to thechip LED 30 c, “LED # 4” corresponds to thechip LED 30 d, “LED # 5” corresponds to thechip LED 30 e, and “LED # 6” corresponds to thechip LED 30 f. - The symbol “×” indicates that the relevant chip LED 30 is not driven. The symbols “L1”, “L2”, and “L3” each indicate a different emission color of the chip LEDs 30. “L1, L3” represents a mixed color. In “Blinking Pattern”, the symbol “∘” indicates the blinking pattern of the
LED # 1 toLED # 6, and the numeral “0” indicates that blinking is not performed, namely, the chip LEDs 30 are caused to emit bursts of light as a result of the chip LEDs 30 being driven for a given duration. The blinking patterns “1” to “4” each have a different blinking interval or speed. - For example, the pattern ID “A-001” of
FIG. 5 indicates that all of “LEDs # 1, #3, #4, and #6” are “L1”, namely, all of thechip LEDs piezoelectric speaker 40 also have a similar content. Associating the type (color) of light to be used, the blinking pattern, the sound source pattern, and the message pattern by a pattern ID for each record in this manner simplifies the control performed when the chip LEDs 30 and thepiezoelectric speaker 40 are combined (because only the pattern ID needs to be identified). The pattern IDs may be added to, changed, or deleted. - In
FIG. 6 , an example is shown of the light emission mode and the output mode controlled in accordance with the detection result of theenvironment sensor 50. The light emission mode and the output mode are associated with a change ID. The change ID represents, when the illuminance sensor is used as an example, a level of illuminance change of the surrounding area of the glasses typeinformation terminal 1. In the change ID, a reference range of each illuminance change is set. The change IDs are set so that when the illuminance change is in a given reference range, the change ID is “KA-001”, and when the illuminance change is more than the reference range, the change ID is “KA-002”, for example. As an example, when the illuminance change is a change by an amount corresponding to the change ID “KA-001”, among the chip LEDs 30, the light intensity of theLED # 1, theLED # 3, theLED # 4, and the LED #6 (chip LEDs piezoelectric speaker 40. When a sound or a message is to be output, the symbol “∘” is set. In such a case, as shown inFIG. 5 , any one of “1” to “5” is selected. - The change ID may be added to, changed, or deleted.
- In
FIG. 7 , an example of the control content for each APP is shown. The “APP-ID” represents the ID of each APP that is loaded in the smartphone and that is set so that the execution situation of the APP can be monitored. The “Pattern ID” represents the content shown as an example inFIG. 5 . The “Change ID” is, for example, KA-001 shown as an example inFIG. 6 . In the example shown inFIG. 7 , this means that for a given APP (APP-05), with the light emission mode and the output mode identified by the pattern ID “B-001” as a base, the light intensity is adjusted based on the pattern identified by the change ID “KB-001”. It is not always the case that the APP-ID (FIG. 7 ) includes a pattern ID (FIG. 5 ) and a change ID (FIG. 6 ), and the APP-ID may include only a pattern ID. In another case, another pattern (ID) may also be added to the APP-ID. - Returning to
FIG. 4 , the digital data required by themain control unit 715 to implement the light emission mode of the chip LEDs 30 and the output mode of thepiezoelectric speaker 40, and the setting content of each APP, are stored in thedata storage unit 714. The digital data is, for example, a control parameter for light emission control based on a specification of the chip LEDs 30, and a plurality of types of sound source data for determining the content of the sound to be output from thepiezoelectric speaker 40. The sound source data may also be synthetic speech for building message data. The digital data is obtained from the smartphone, for example, and stored. - One operation of the
main control unit 715 is performing light emission control of the chip LEDs 30 and output control of thepiezoelectric speaker 40 in accordance with the execution situation of an APP loaded in the smartphone or the detection result of theenvironment sensor 50. Those controls are performed based on the action information. In the case of monitoring the execution situation of an APP loaded in the smartphone, the action information is received from the smartphone that generated the action information via thecommunication module 60. Regarding the second light emission control information and warning information, such information is not received from the smartphone, but it is generated by themain control unit 715 itself. The content corresponding to the association tables 713 shown as examples inFIG. 5 toFIG. 7 is also included in the smartphone. Therefore, in this embodiment, the real action information received from the smartphone is the APP-ID shown inFIG. 7 . Regarding the action information (second light emission control information, for example) that has no relation to the execution situation of the smartphone, a fixed APP-ID is set for such action information in advance by the smartphone. - The
main control unit 715 is configured to identify the pattern ID (FIG. 5 ) and the change ID (FIG. 6 ) based on the acquired action information (APP-ID:FIG. 7 ). The chip LEDs 30 and thepiezoelectric speaker 40 are driven via the input/output control unit 711 by using, among the digital data stored in thedata storage unit 714, the control parameter and so on. - [Smartphone]
- Next, the configuration of the smartphone, which is an example of the mobile terminal (external device), is described. The smartphone is a known mobile computer including, for example, a communication function, such as data communication and telephone calls using a public telecommunications network, an information display function, such as a display, an information input function, such as a keyboard, sound source data, and a speaker. The information display function and the information input function may be implemented by a touch panel. The communication function includes, in addition to typical communication via a public telecommunications network, a function for performing one-to-one near field communication to and from the glasses type
information terminal 1. - In this embodiment, characteristic functions are implemented by loading in the smartphone a computer program for APP monitoring from a computer-readable recording medium in which the computer program is recorded, and executing that computer program.
FIG. 8 is a configuration diagram of the function blocks implemented in the smartphone. Asmartphone 5 is configured to function as acontrol unit 50, amonitoring unit 51, asetting unit 52, acommunication unit 53, and adata storage unit 54 that those function blocks refer to as appropriate. In this embodiment, thecommunication unit 53 is configured to perform, similar to the glasses typeinformation terminal 1, near field communication based on “Bluetooth”. Thedata storage unit 54 is configured to store, for example, information on the glasses typeinformation terminal 1, which is the other party in the near field communication, and tables including the same content as the association tables 713 (FIG. 5 toFIG. 7 ) included in the glasses typeinformation terminal 1. The content of the tables is synchronized at a point when near field communication to and from the glasses typeinformation terminal 1 has been enabled by thecommunication unit 53. - The
monitoring unit 51 is configured to monitor the execution situation of an APP loaded in the smartphone. The APP to be monitored is freely determined by the wearer, and the ID of that APP (APP-ID) is set in the tables in thedata storage unit 54. In this embodiment, an example is illustrated in which the execution situation of the APP is a call notification, a mail notification, a message exchange service notification, a notification of various information guidance, and relaxation. Each notification is detected as one execution situation of an APP already loaded in the smartphone, such as a mail APP, an internet communication APP, and not as an execution situation of thecommunication unit 53. - The setting
unit 52 is configured to set the light emission mode of the chip LEDs 30 and/or the output mode of thepiezoelectric speaker 40 to be determined in accordance with the execution situation of the APP monitored by themonitoring unit 51. Specifically, a setting screen is displayed on the touch panel, and setting content input by a touch operation or the like is transmitted to thecontrol unit 50. - The
control unit 50 is configured to create or update the content of the tables stored in thedata storage unit 54 based on the content set by the settingunit 52. The action information is generated based on the monitoring result of the execution situation of the APP by themonitoring unit 51. The generated action information is transmitted to the glasses typeinformation terminal 1 via thecommunication unit 53. Thecontrol unit 50 is configured to refer to the tables in thedata storage unit 54 when generating the action information. In this embodiment, by the time that the APP to be monitored is set, thecontrol unit 50 has grasped the APP-ID for that APP. Therefore, in this embodiment, the APP-ID (or with accompanying information) may be generated as the action information, and the generated APP-ID may be transmitted to the glasses typeinformation terminal 1. - Next, a cooperative operation example between the
smartphone 5 and the glasses typeinformation terminal 1 is described in detail. -
FIG. 9 is a procedure explanatory diagram when setting an APP whose execution situation is to be monitored. When a setting request from the wearer of the glasses typeinformation terminal 1 is input (Step S101: Yes), the settingunit 52 displays asetting menu screen 1001 illustrated inFIG. 10 on the touch panel (Step S102). On thesetting menu screen 1001, icons of the APPs already set as an APP whose execution situation is to be monitored, and a “setting”icon 1002 for enabling a new setting or already-set content to be changed, are displayed. - The APP icons displayed on the screen of
FIG. 10 correspond to “Timer”, “Tempo”, and “Relax”. The “Timer” icon represents an APP configured to output as the action information a time that the wearer is to pay attention to. The “Tempo” icon represents an APP configured to output as the action information a trigger for each fixed time interval to be used for a pace determination, for example. The “Relax” icon represents a so-called relaxation APP. The relaxation APP is configured to output action information for implementing a display mode that is easy on the eyes or that delivers a lot of relaxing emission colors to the eyes of the wearer. - When the “Setting”
icon 1002 is selected by the wearer via the screen illustrated inFIG. 10 , the touch panel screen switches to anAPP setting screen 1101 like that illustrated inFIG. 11 . APPs that have already been set are indicated as being “On”, and APPs that have not been set are indicated as being “Off”. When an “On” APP is selected, the setting content may be changed. When an “Off” APP is selected, the execution situation of the APP corresponding to that icon becomes a new monitoring target. The icons that are illustrated inFIG. 11 are the above-mentioned “Timer”, “Tempo”, and “Relax” icons. Examples of other APPs include the following. - “Call”: Call notification
- “Mail”: Mail notification
- “Social”: Message notification
- “Calendar”: Notification that a set date and time has arrived
- “Finance”: Notification of a movement in a stock price
- “Weather”: Notification of a change in the weather
- “SOS”: Search
- “Morse Code”: Morse communication
- “Disco”: Music notification
- On the
APP setting screen 1101 illustrated inFIG. 11 , when the “Mail”icon 1102 is selected, the additional note changes from “Off” to “On”, and the touch panel screen switches to a settingcontent screen 1201 for the mail notification illustrated as an example inFIG. 12 . On the settingcontent screen 1201, the following icons and buttons are displayed. - A
specification icon 1202 of the color that is to be emitted by the glasses typeinformation terminal 1 - An “ON/OFF”
button icon 1203 for specifying whether or not to temporarily stop a setting - A “Fade”
button icon 1204 for representing that the light intensity gradually changes - A “Beep”
button icon 1205 for outputting a beep sound - A “Brightness”
button 1206 for specifying the light intensity during light emission - A “Speed”
button 1207 for specifying a blinking speed - A “Repeat”
button 1208 for specifying the number of times for repeating light emission and sound - Returning to
FIG. 9 , when a desired input based on those indications is received via the setting unit 52 (Step S103: Yes), thecontrol unit 50 determines whether or not the received input is content that has already been transmitted to the glasses type information terminal 1 (Step S104). More specifically, thecontrol unit 50 determines whether or not the received input is a transmission (change transmission) for changing already-set content or for releasing an unset state based on a transmission history to the glasses typeinformation terminal 1. When an input is not received (Step S103: No), or when the received input is not a change transmission (Step S104: No), thecontrol unit 50 returns the processing to Step S103. When the received input is a change transmission (Step S104: YES), thecontrol unit 50 identifies and corrects the pattern ID corresponding to the input setting content, or newly generates a pattern ID, and as a result of that processing generates setting information associating the APP-ID to be monitored and the pattern ID (Step S105). Then, thecontrol unit 50 stores the generated setting information in the tables of the data storage unit 54 (Step S106). When there is another input (Step S107: Yes), thecontrol unit 50 returns the processing to Step S102. When there are no other inputs (Step S107: No), thecontrol unit 50 ends the setting processing. The stored setting information is transmitted to the glasses typeinformation terminal 1 when near field communication to and from the glasses typeinformation terminal 1 is enabled, and the transmitted setting information is synchronized with the association tables 713. - The
control unit 50 generates the action information and transmits the generated action information to the glasses typeinformation terminal 1 based on the monitoring result of themonitoring unit 51 and the stored setting information. A procedure explanatory diagram in such a case is illustrated inFIG. 13 . In this case, an example is illustrated of a case in which, in thesmartphone 5, a mail notification from outside or a notification based on Internet communication is monitored. InFIG. 13 , thecontrol unit 50 waits for a notification from outside by using the monitoring unit 51 (Step S201: No). When a notification is detected (Step S201: Yes), thecontrol unit 50 determines whether or not that notification is addressed to a set APP, namely, is a notification addressed to an APP set as a monitoring target (Step S202). When the notification is not addressed to a set APP (Step S202: No), thecontrol unit 50 returns the processing to Step S201. When the notification is addressed to a set APP (Step S202: Yes), thecontrol unit 50 reads the “APP-ID” of the APP to be monitored (Step S203). Then, thecontrol unit 50 generates action information based on, for example, the read “APP-ID”. (Step S204), and transmits the generated action information to the glasses type information terminal 1 (Step S205). After the action information has been transmitted, thecontrol unit 50 stores the transmission history in thedata storage unit 54, and ends the processing. - On the
APP setting screen 1101 ofFIG. 11 , when a predetermined event (including an instruction from the wearer) is detected during an execution situation of a non-notification APP, such as “Relax” and “Timer”, the processing is not limited to the processing described above. Specifically, when the APP is “Timer”, thecontrol unit 50 measures time with an internal clock, identifies the “APP-ID” corresponding to “Timer” when the current time arrives at the time set by the wearer, and then performs the processing of Step S204 onwards. When the APP is “Tempo”, after the instruction by the wearer, thecontrol unit 50 immediately identifies the “APP-ID” corresponding to “Tempo”, and then performs the processing of Step S204 onwards. The same processing as this is also performed when the APP is “Relax”. - The glasses type information terminal 1 (control module 70) performs light emission control of the chip LEDs 30 and/or output control of the
piezoelectric speaker 40 based on the procedure illustrated inFIG. 14 . Specifically, after the switch 80 (FIG. 2A ) is turned on, thecontrol module 70 waits for input of the action information (Step S301: No). When the action information has been input (Step S301: Yes), thecontrol module 70 analyzes the content of the action information (Step S302). When it is determined based on the analysis that the action information is light emission control information on the chip LEDs 30 (Step S303: Yes), thecontrol module 70 performs light emission control. Specifically, thecontrol module 70 determines the emission color and the emission timing of each chip LED 30, and generates control signals for driving the chip LEDs 30 in that manner (Step S304). Then, thecontrol module 70 emits the signal light by driving the relevant chip LEDs 30 based on those control signals (Step S305). Thecontrol module 70 waits for light emission control to finish (Step S306: No), and when the light emission control has finished (Step S306: Yes), ends the processing. - On the other hand, when it is determined based on the analysis result of Step S302 that the action information is not light emission control information on the chip LEDs 30 (Step S303: No), the
control module 70 performs output control of thepiezoelectric speaker 40. Specifically, thecontrol module 70 generates a control signal in accordance with the sound source data (Step S307). Then, thecontrol module 70 outputs a sound from thepiezoelectric speaker 40 based on the control signal (Step S308). Thecontrol module 70 waits for output control to finish (Step S309: No), and when the light emission control has finished (Step S309: Yes), ends the processing. - When the illuminance change measured by the
environment sensor 50 is a fixed value or more, the glasses type information terminal 1 (control module 70) autonomously generates the action information (second light emission control information), and performs light emission control of the chip LEDs 30. The processing procedure of thecontrol module 70 in this case is illustrated inFIG. 15 . - Specifically, the
control module 70 waits for input from the environment sensor 50 (Step S401: No). When there is input (Step S401: Yes), thecontrol module 70 determines whether or not the illuminance change is equal to or more than a reference range (Step S402). The reference range corresponds to any one of the change IDs (FIG. 6 ) in the association tables 713. When the illuminance change is less than a minimum reference range (Step S402: No), thecontrol module 70 returns the processing to Step S401. When the illuminance change is in a predetermined reference range, thecontrol module 70 identifies the change ID (FIG. 6 ) corresponding to that reference range. Then, based on the control pattern associated with the change ID, thecontrol module 70 changes the brightness of the relevant chip LEDs 30 to the set values (Step S403). As a result, for example, the signal light can be recognized more easily by increasing the brightness of the chip LEDs 30 when the surrounding area of theglasses frame 10 becomes brighter than a given reference range. - In the glasses type
information terminal 1, the detection result of thecontrol unit 50 may be transmitted to the smartphone, and the action information (third light emission control information) may be generated on the smartphone side. In this case, the processing of Step S402 is performed by the smartphone. Thecontrol module 70 of the glasses typeinformation terminal 1 performs the processing of Step S403 based on the received action information. - Thus, with the glasses type
information terminal 1 according to this embodiment, the signal light of the light emission mode determined in accordance with the execution situation of an APP loaded in thesmartphone 5 is emitted from the chip LEDs 30, and propagated to at least one of the edge surface of the glasses lens 20 and the inner portion of theglasses frame 10. For example, when there is a mail notification from a party X to thesmartphone 5, red signal light reaches, for example, the edge surface of the glasses lens 20 three times, and when there is a notification of a change in the price of a stock Y, signal light that slowly gleams blue reaches the edge surface of the glasses lens 20, for example. Because the signal light is scatted by the edge surface of the glasses lens 20, depending on the light emission mode, the overall glasses lens 20 may appear to be gleaming. As a result, even when walking or during a task being focused on, or even when the eyes of the wearer are shut, the wearer can reliably recognize the signal light. In the case of the relaxation APP, the wearer may be allowed to relax by performing light emission control so that the light intensity emitted by the overall glasses lens 20 is easy on the eyes or is a relaxing emission color. - Through loading in the
smartphone 5 an APP configured to change the emission color of theoverall glasses frame 10, an APP configured to change the coloration of the overall glasses lens 20, an APP capable of sending out information from the wearer to the surrounding area, for example, the glasses typeinformation terminal 1 according to this embodiment may be applied in uses other than alerting the wearer of a notification, for example, to thesmartphone 5. For example, through changing the coloration of theglasses frame 10 or the color of the light scattered by the edge surface of the glasses lens 20, information can be sent out to the surrounding area in accordance with the personality or feelings of the wearer, or the current ambience. Through utilizing the point that the signal light is also cast on the face of the wearer, the glasses typeinformation terminal 1 may also be employed in place of makeup to change the appearance of the skin color of the wearer or to cause the eyebrows of the wearer to look thicker. Further, the glasses typeinformation terminal 1 may also be employed to search for or to recognize people in crowded or dark places and to rouse the wearer by using the color or a blinking pattern of the signal light. - With the glasses type
information terminal 1 according to this embodiment, the sound of the output mode determined in accordance with the execution situation of an APP is output from thepiezoelectric speaker 40. As a result, an APP configured to alert the wearer of information that produces a sense of discomfort in the surrounding area like in the related-art device may be handled by only outputting a sound from thepiezoelectric speaker 40, and without performing light emission control of the chip LEDs 30. - Thus, according to this embodiment, implementing the light emission mode of the light-emitting source, such as the chip LEDs 30, and the output mode of a sound by the
piezoelectric speaker 40 in combination allows various information to be represented while using a simple configuration capable of reducing costs. - In the embodiment described above, an example is described in which three chip LEDs 30 are arranged corresponding to each of the pair of
glasses lenses information terminal 1. However, the number of chip LEDs 30 may be freely selected. - In the embodiment described above, an example is described in which the content corresponding to the association tables 713 is held both by the
control module 70 of the glasses typeinformation terminal 1 and by thesmartphone 5. However, those tables may be stored by only thesmartphone 5. In this case, the standards, for example, of the chip LEDs 30 and thepiezoelectric speaker 40 of the glasses typeinformation terminal 1 are input in advance in thesmartphone 5, and thesmartphone 5 generates the action information for controlling the chip LEDs 30 and thepiezoelectric speaker 40. - In another case, the association tables 713 may be stored just by the
control module 70 of the glasses typeinformation terminal 1. In this case, the content of those association tables 713 is utilized by thesmartphone 5, and only the pattern ID is transmitted to the glasses typeinformation terminal 1 as information to be presented. - In the embodiment described above, an example is described in which, for one glasses lens, the light-emitting surface of one
chip LED 30 b is directed toward a lower edge surface of theglasses lens 20 a, and the light-emitting surfaces of the other twochip LEDs opening 111 b, it is not necessary to form theopening 111 b. From the perspective of increasing directivity, a reflective film may be arranged on a rear side of the light-emitting surfaces of the chip LEDs 30. - In the embodiment described above, an example is described in which the
environment sensor 50 is an illuminance sensor. However, when an acceleration sensor or an angular velocity sensor is used as theenvironment sensor 50, an even wider range of usages is possible. For example, control can be performed for representing the display mode of the chip LEDs 30 or the output mode of thepiezoelectric speaker 40 in accordance with the posture of the wearer. - In the embodiment described above, an example is described in which the glasses type
information terminal 1 is configured to store the sound source data and to perform output control of thepiezoelectric speaker 40 based on that sound source data. However, the present invention is not limited to this example. The present invention may also be implemented by utilizing the glasses typeinformation terminal 1 as a wireless earpiece of thesmartphone 5. In this case, thecontrol module 70 is configured to receive a wireless signal representing an output sound of thesmartphone 5 from thesmartphone 5 via thecommunication module 60. The output sound is extracted from the received wireless signal, and the extracted output sound is output from thepiezoelectric speaker 40. - 1 . . . glasses type information terminal, 5 . . . smartphone, 10 . . . glasses frame, 20 a, 20 b . . . glasses lenses, 30(30 a-30 f) . . . chip LED, 40 . . . piezoelectric speaker, 50 . . . environment sensor, 70 . . . control module, 80 . . . switch, 90 . . . battery
Claims (18)
1. A glasses type information terminal, comprising:
a glasses frame capable of holding a glasses lens;
a light-emitting source for emitting signal light; and
a control module configured to control the light emitting source to produce a light emission mode of the signal light,
wherein the signal light from the light-emitting source propagates from the glasses frame, into the glasses lens, and toward an edge surface of the glasses lens.
2. The glasses type information terminal of claim 1 , wherein the signal light from the light-emitting source propagates from the light-emitting source, into the glasses lens, and toward the edge surface of the glasses lens without passing through the glasses frame.
3. The glasses type information terminal of claim 1 , wherein the signal light is scattered by the edge surface of the glasses lens to a surrounding area.
4. The glasses type information terminal of claim 1 , wherein
the light-emitting source is provided at a side portion of the glasses frame, and
the signal light from the light-emitting source propagates toward a side edge surface of the glasses lens.
5. The glasses type information terminal of claim 4 , wherein
the side portion of the glasses frame is an inner side portion of the glasses frame, proximate to a bridge of the glasses frame, and
the side edge surface of the glasses lens is an outer side edge surface of the glasses lens, spaced away from the bridge of the glasses frame.
6. The glasses type information terminal of claim 4 , wherein
the side portion of the glasses frame is an outer side portion of the glasses frame, spaced away from a bridge of the glasses frame, and
the side edge surface of the glasses lens is an outer side edge surface of the glasses lens, spaced away from the bridge of the glasses frame.
7. The glasses type information terminal of claim 4 , wherein
the side portion of the glasses frame is an outer side portion of the glasses frame, spaced away from a bridge of the glasses frame, and
the side edge surface of the glasses lens is an inner side edge surface of the glasses lens, proximate to the bridge of the glasses frame.
8. The glasses type information terminal according to claim 4 , wherein the signal light is configured to flash at least at the side edge surface, which is lower than an eyelevel of the wearer.
9. The glasses type information terminal according to claim 4 , further comprising
a communication module configured to perform wireless communication to and from an external device, which is configured to select any one of a plurality of applications including an application for sending out information other than information on a state notification of the glasses type information terminal, and to set the light emission mode in accordance with an execution situation of the selected application,
wherein the control module is configured to input, via the communication module, the light emission control information representing the light emission mode set by the external device.
10. The glasses type information terminal according to claim 4 ,
wherein the light-emitting source comprises a plurality of light-emitting devices each configured to be individually controlled and capable of emitting color light in one or more colors, and
wherein the control module is configured to cause the signal light to be emitted from the light-emitting source by controlling a drive timing of each of the plurality of light-emitting devices based on the light emission control information.
11. The glasses type information terminal according to claim 10 ,
wherein one or more of the plurality of light-emitting devices are configured to emit light toward an inner portion of the glasses frame,
wherein the glasses frame is built from a color-emitting member configured to emit a color in accordance with a color of input light, and
wherein the control module is configured to determine an emission color of the one or more of the plurality of light-emitting devices configured to emit light toward an inner portion of the glasses frame based on the light emission control information, and to enable a color of the glasses frame to be changed based on the determination.
12. The glasses type information terminal according to claim 4 , further comprising an environment sensor configured to detect a change in a surrounding environment of the glasses frame,
wherein the control module is configured to generate a second light emission control information, which represents a light emission mode and is different from the light emission control information, in accordance with a detection result of the environment sensor, and to perform light emission control of the light-emitting source based on the second light emission control information.
13. The glasses type information terminal according to claim 9 , further comprising an environment sensor configured to detect a change in a surrounding environment of the glasses frame,
wherein the control module is configured to transmit a detection result of the environment sensor to the external device via the communication module, and to receive and input the light emission control information determined in accordance with the detection result from the external device.
14. The glasses type information terminal according to claim 4 ,
wherein the glasses frame comprises a temple portion,
wherein, in the temple portion, a speaker configured to output a predetermined sound is accommodated in a site directing to an ear of the wearer, and
wherein the control module is configured to store a plurality of pieces of sound source data, and to implement, when triggered by input of sound control information representing an output mode of the predetermined sound to be produced by the speaker by using the plurality of pieces of sound source data, the output mode by performing output control of the speaker based on the sound control information.
15. The glasses type information terminal according to claim 9 ,
wherein the glasses frame comprises a temple portion,
wherein, in the temple portion, a speaker configured to output a predetermined sound is accommodated in a site directing to an ear of the wearer, and
wherein the control module is configured to receive from the external device a wireless signal representing an output sound of the external device, to extract the output sound from the received wireless signal, and to output the extracted output sound from the speaker.
16. An information processing device, comprising:
communication means for performing communication to and from the glasses type information terminal of claim 4 ;
setting means for selecting any one of a plurality of applications including an application for sending out information other than information on a state notification of the glasses type information terminal, and setting the light emission mode in accordance with an execution situation of the selected application;
monitoring means for monitoring the execution situation of the application; and
control means for generating light emission control information representing the light emission mode set by the setting means in accordance with the monitored execution situation, and transmitting the generated light emission control information to the glasses type information terminal via the communication means.
17. The information processing device according to claim 16 ,
wherein the glasses type information terminal comprises a temple portion,
wherein, in the temple portion, a speaker configured to output a predetermined sound is accommodated in a site directing to an ear of the wearer,
wherein the control module is configured to store a plurality of pieces of sound source data, and to implement, when triggered by input of sound control information representing an output mode of the predetermined sound to be produced by the speaker by using the plurality of pieces of sound source data, the output mode by performing output control of the speaker based on the sound control information,
wherein the setting means is configured to set an output mode of the speaker in accordance with the execution situation of the selected application, and
wherein the control means is configured to generate the sound control information in accordance with the monitored execution situation, and to transmit the generated sound control information to the glasses type information terminal via the communication means.
18. A non-transitory, computer readable recording medium containing a computer program for causing a computer comprising a communication function to operate as the information processing device of claim 16 .
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/964,278 US20180246348A1 (en) | 2014-02-24 | 2018-04-27 | Glasses type information terminal, information processing device, computer program and recording medium |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014032971 | 2014-02-24 | ||
JP2014-032971 | 2014-02-24 | ||
JP2015028069A JP5836517B2 (en) | 2014-02-24 | 2015-02-16 | Glasses-type information terminal, information processing apparatus, computer program, and recording medium |
JP2015-028069 | 2015-02-16 | ||
US15/120,190 US9977265B2 (en) | 2014-02-24 | 2015-02-24 | Glasses type information terminal, information processing device, computer program and recording medium |
PCT/JP2015/055188 WO2015125966A1 (en) | 2014-02-24 | 2015-02-24 | Glasses type information terminal, information processing device, computer program and recording medium |
US15/964,278 US20180246348A1 (en) | 2014-02-24 | 2018-04-27 | Glasses type information terminal, information processing device, computer program and recording medium |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/055188 Continuation WO2015125966A1 (en) | 2014-02-24 | 2015-02-24 | Glasses type information terminal, information processing device, computer program and recording medium |
US15/120,190 Continuation US9977265B2 (en) | 2014-02-24 | 2015-02-24 | Glasses type information terminal, information processing device, computer program and recording medium |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180246348A1 true US20180246348A1 (en) | 2018-08-30 |
Family
ID=53878462
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/120,190 Active US9977265B2 (en) | 2014-02-24 | 2015-02-24 | Glasses type information terminal, information processing device, computer program and recording medium |
US15/964,278 Abandoned US20180246348A1 (en) | 2014-02-24 | 2018-04-27 | Glasses type information terminal, information processing device, computer program and recording medium |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/120,190 Active US9977265B2 (en) | 2014-02-24 | 2015-02-24 | Glasses type information terminal, information processing device, computer program and recording medium |
Country Status (6)
Country | Link |
---|---|
US (2) | US9977265B2 (en) |
EP (1) | EP3112988A4 (en) |
JP (1) | JP5836517B2 (en) |
KR (1) | KR20160125475A (en) |
CN (1) | CN106062671B (en) |
WO (1) | WO2015125966A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200110289A1 (en) * | 2018-10-03 | 2020-04-09 | Carlos de la Fuente | Ambient light adjustable eyeglasses |
US20200201082A1 (en) * | 2017-02-07 | 2020-06-25 | Rancho El Toston, LLC | Hands-free spectrally-tunable smart loupe |
WO2023220294A1 (en) * | 2022-05-12 | 2023-11-16 | Meta Platforms Technologies, Llc | Head-worn wearable device providing indications of received and monitored sensor data, and methods and systems of use thereof |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5836517B2 (en) * | 2014-02-24 | 2015-12-24 | 株式会社ルネット | Glasses-type information terminal, information processing apparatus, computer program, and recording medium |
EP3196643A1 (en) * | 2016-01-22 | 2017-07-26 | Essilor International | A head mounted device comprising an environment sensing module |
KR101803775B1 (en) * | 2016-04-25 | 2017-12-01 | 울산과학기술원 | Glasses for night blindness |
KR101972667B1 (en) * | 2017-11-02 | 2019-04-25 | 연세대학교 산학협력단 | Head fixed type glasses for a surgical patient of skin incision |
CN108211132A (en) * | 2018-02-09 | 2018-06-29 | 深圳市慧智生命科技有限公司 | A kind of human boby biorhythm regulating device |
US10935815B1 (en) | 2018-03-06 | 2021-03-02 | Snap Inc. | Eyewear having custom lighting |
US11619834B2 (en) | 2018-04-25 | 2023-04-04 | William Allen | Illuminated lens frame |
CN109298546A (en) * | 2018-11-27 | 2019-02-01 | 刘光华 | Brilliant Eyes frame |
US11413424B2 (en) | 2019-05-20 | 2022-08-16 | Quantum Chromatics Corporation | System and a method for turnkey neurological solution |
CN110243387B (en) * | 2019-07-23 | 2021-03-09 | 联众智慧科技股份有限公司 | One-stop type hospitalizing guide system |
KR102229758B1 (en) * | 2020-09-24 | 2021-03-19 | 주식회사 플레임 | Glasses with motion input function |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6997552B1 (en) * | 2004-11-23 | 2006-02-14 | Ming-Chi Hung | Light-emitting eyeglasses structure |
US7175273B2 (en) * | 2005-02-09 | 2007-02-13 | Ching-Hui Lee | Eyeglasses having light emitting function |
US7792552B2 (en) * | 2003-04-15 | 2010-09-07 | Ipventure, Inc. | Eyeglasses for wireless communications |
US20130020128A1 (en) * | 2010-07-19 | 2013-01-24 | Antonio Calleri | System and method for the thermal conditioning of a fluid more particularly a drilling mud |
US9977265B2 (en) * | 2014-02-24 | 2018-05-22 | Lunettes Inc. | Glasses type information terminal, information processing device, computer program and recording medium |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02181722A (en) | 1989-01-06 | 1990-07-16 | Susumu Nemoto | Spectacle frame with light emitting function |
JP2000111829A (en) | 1998-10-08 | 2000-04-21 | Olympus Optical Co Ltd | Video display device |
JP2003289484A (en) | 2002-03-28 | 2003-10-10 | Sanyo Electric Co Ltd | Eye mount video display apparatus and operating apparatus |
US6857739B1 (en) * | 2004-06-08 | 2005-02-22 | Peter Watson | Illuminated eyewear and a method for illuminating eyewear |
JP2007052224A (en) * | 2005-08-18 | 2007-03-01 | Konica Minolta Photo Imaging Inc | Image display apparatus |
US20070200998A1 (en) * | 2006-02-24 | 2007-08-30 | Chemical Light, Inc. | Led illuminated novelty glasses |
US20100118139A1 (en) | 2008-07-19 | 2010-05-13 | Yuming Huang | Portable Device to Detect the Spin of Table Tennis Ball |
US8514097B2 (en) * | 2009-08-14 | 2013-08-20 | Michael William Boise | Glasses with sound activated lights |
JP5675155B2 (en) | 2010-04-21 | 2015-02-25 | オリンパス株式会社 | Head-mounted information notification device |
JP5879353B2 (en) * | 2010-10-07 | 2016-03-08 | 株式会社ソニー・コンピュータエンタテインメント | Head position and orientation tracking |
US8922644B2 (en) * | 2010-10-07 | 2014-12-30 | Sony Computer Entertainment Inc. | Tracking head position and orientation |
US20120203310A1 (en) * | 2011-02-04 | 2012-08-09 | Pugh Randall B | Spectacles for light therapy |
US8188880B1 (en) | 2011-03-14 | 2012-05-29 | Google Inc. | Methods and devices for augmenting a field of view |
-
2015
- 2015-02-16 JP JP2015028069A patent/JP5836517B2/en active Active
- 2015-02-24 KR KR1020167026272A patent/KR20160125475A/en unknown
- 2015-02-24 US US15/120,190 patent/US9977265B2/en active Active
- 2015-02-24 EP EP15752231.9A patent/EP3112988A4/en not_active Withdrawn
- 2015-02-24 CN CN201580010009.3A patent/CN106062671B/en not_active Expired - Fee Related
- 2015-02-24 WO PCT/JP2015/055188 patent/WO2015125966A1/en active Application Filing
-
2018
- 2018-04-27 US US15/964,278 patent/US20180246348A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7792552B2 (en) * | 2003-04-15 | 2010-09-07 | Ipventure, Inc. | Eyeglasses for wireless communications |
US6997552B1 (en) * | 2004-11-23 | 2006-02-14 | Ming-Chi Hung | Light-emitting eyeglasses structure |
US7175273B2 (en) * | 2005-02-09 | 2007-02-13 | Ching-Hui Lee | Eyeglasses having light emitting function |
US20130020128A1 (en) * | 2010-07-19 | 2013-01-24 | Antonio Calleri | System and method for the thermal conditioning of a fluid more particularly a drilling mud |
US9977265B2 (en) * | 2014-02-24 | 2018-05-22 | Lunettes Inc. | Glasses type information terminal, information processing device, computer program and recording medium |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200201082A1 (en) * | 2017-02-07 | 2020-06-25 | Rancho El Toston, LLC | Hands-free spectrally-tunable smart loupe |
US20200110289A1 (en) * | 2018-10-03 | 2020-04-09 | Carlos de la Fuente | Ambient light adjustable eyeglasses |
WO2023220294A1 (en) * | 2022-05-12 | 2023-11-16 | Meta Platforms Technologies, Llc | Head-worn wearable device providing indications of received and monitored sensor data, and methods and systems of use thereof |
Also Published As
Publication number | Publication date |
---|---|
US20170068120A1 (en) | 2017-03-09 |
EP3112988A1 (en) | 2017-01-04 |
KR20160125475A (en) | 2016-10-31 |
JP5836517B2 (en) | 2015-12-24 |
CN106062671A (en) | 2016-10-26 |
US9977265B2 (en) | 2018-05-22 |
EP3112988A4 (en) | 2017-10-25 |
WO2015125966A1 (en) | 2015-08-27 |
CN106062671B (en) | 2019-11-01 |
JP2015172932A (en) | 2015-10-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20180246348A1 (en) | Glasses type information terminal, information processing device, computer program and recording medium | |
US10725556B2 (en) | Wearable glasses and method of providing content using the same | |
JP7227321B2 (en) | Electronic device with sensor and display device | |
CN106471419B (en) | Management information is shown | |
AU2011204946C1 (en) | Automatic text scrolling on a head-mounted display | |
JP6479628B2 (en) | Glasses-type information terminal, information processing apparatus, computer program | |
US20140192092A1 (en) | Display device and control method thereof | |
US20150289227A1 (en) | Notification system including a notification accessory linkable to a communications device | |
CN103913841A (en) | Display device and control method thereof | |
JP2017049763A (en) | Electronic apparatus, support system, and support method | |
JP2015177404A (en) | Head-mounted display device and control method therefor | |
JP2017049449A (en) | Electronic apparatus and support method | |
CN208537830U (en) | A kind of wearable device | |
JP2017151576A (en) | Training device, training method, and program | |
AU2013200187B9 (en) | Automatic text scrolling on a head-mounted display | |
JP6932917B2 (en) | Head-mounted display, program, and head-mounted display control method | |
US9818319B2 (en) | Wearable device and control method thereof | |
KR20080029394A (en) | Eyeglass type alarm device for auditory difficulties | |
WO2017122508A1 (en) | Information display system and information display method | |
KR20190068308A (en) | Emitting type sound direction guide device | |
US20230224453A1 (en) | Wearable Virtual Retinal Display | |
JP2017129705A (en) | Spectacles with luminous function and spectacle system | |
WO2020019850A1 (en) | Wearable device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |