WO2014108675A1 - Appareil pouvant être monté sur la tête détectant un emmêlement de câble - Google Patents

Appareil pouvant être monté sur la tête détectant un emmêlement de câble Download PDF

Info

Publication number
WO2014108675A1
WO2014108675A1 PCT/GB2014/050031 GB2014050031W WO2014108675A1 WO 2014108675 A1 WO2014108675 A1 WO 2014108675A1 GB 2014050031 W GB2014050031 W GB 2014050031W WO 2014108675 A1 WO2014108675 A1 WO 2014108675A1
Authority
WO
WIPO (PCT)
Prior art keywords
head
user
mountable apparatus
cable
devices
Prior art date
Application number
PCT/GB2014/050031
Other languages
English (en)
Inventor
Simon Benson
Ian Bickerstaff
Sharwin Raghoebardayal
Original Assignee
Sony Computer Entertainment Europe Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Europe Limited filed Critical Sony Computer Entertainment Europe Limited
Publication of WO2014108675A1 publication Critical patent/WO2014108675A1/fr

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Definitions

  • This invention relates to head-mountable apparatus.
  • a head-mountable display is one example of a head-mountable apparatus.
  • Audio headphones comprising a frame supporting one or more audio transducers are another example of a head-mountable apparatus.
  • a head-mounted torch or light is a further example of a head-mountable apparatus. The following background discussions will relate mainly to HMDs, but the principles are also applicable to other types of head-mountable apparatus.
  • an image or video display device is provided which may be worn on the head or as part of a helmet. Either one eye or both eyes are provided with small electronic display devices.
  • Some HMDs allow a displayed image to be superimposed on a real-world view.
  • This type of HMD can be referred to as an optical see-through HMD and generally requires the display devices to be positioned somewhere other than directly in front of the user's eyes. Some way of deflecting the displayed image so that the user may see it is then required. This might be through the use of a partially reflective mirror placed in front of the user's eyes so as to allow the user to see through the mirror but also to see a reflection of the output of the display devices.
  • a waveguide arrangement employing total internal reflection is used to convey a displayed image from a display device disposed to the side of the user's head so that the user may see the displayed image but still see a view of the real world through the waveguide.
  • a virtual image of the display is created (using known techniques) so that the user sees the virtual image at an appropriate size and distance to allow relaxed viewing.
  • the virtual image may be arranged so as to be perceived by the user at a distance of (for example) 20 m from the user, having a perceived size of 5 m x 5m.
  • HMDs allow the user only to see the displayed images, which is to say that they obscure or at least substantially obscure the user's view of the real world environment surrounding the user.
  • This type of HMD can position the actual display devices in front of the user's eyes, in association with appropriate lenses or other optical components which place a virtual displayed image at a suitable distance for the user to focus in a relaxed manner - for example, at a similar virtual distance and perceived size as the optical see-through HMD described above.
  • This type of device might be used for viewing movies or similar recorded content, or for viewing so-called virtual reality content representing a virtual space surrounding the user. It is of course however possible to display a real-world view on this type of HMD, for example by using a forward-facing camera (such as a video camera) to generate images for display on the display devices.
  • a forward-facing camera such as a video camera
  • HMDs Although the original development of HMDs was perhaps driven by the military and professional applications of these devices, HMDs are becoming more popular for use by casual users in, for example, computer game or domestic computing applications.
  • This invention provides a head-mountable apparatus comprising:
  • a frame which is configured to be mounted on a user's head, the frame supporting one or more electrical and/or optical devices;
  • a detector for detecting head movements of a magnitude which, assuming a substantially stationary external device, may cause the cable to become at least partially wrapped around the user's body.
  • Embodiments of the invention provide a system to detect, and optionally to warn a user of a wired or cabled head- mountable apparatus such as a head-mountable display (HMD), about the possibility of the HMD cable becoming tangled or otherwise wrapped around the user's neck or other part of the body.
  • a head-mountable display such as a head-mountable display (HMD)
  • the HMD may have a motion detection and/or tracking arrangement such as one or more gyros or optical sensors so that the HMD (or a device that is driving the HMD) has awareness of the orientation or the HMD.
  • HMD head-mountable apparatus
  • a signal source or processor
  • a power supply
  • Figure 1 schematically illustrates an HMD worn by a user
  • Figure 2 is a schematic plan view of an HMD
  • Figure 3 schematically illustrates the formation of a virtual image by an HMD
  • Figure 4 schematically illustrates another type of display for use in an HMD
  • Figure 5 schematically illustrates a pair of stereoscopic images
  • Figure 6 schematically illustrates a user wearing an HMD connected to a Sony® PlayStation 3® games console
  • Figure 7 schematically illustrates a tangle detector using an accelerometer
  • Figure 8 schematically illustrates a tangle detector using a camera
  • Figure 9 schematically illustrates a cable having sensor portions
  • Figure 10 schematically illustrates a cable strain detector
  • Figure 11 schematically illustrates a tangle detector using a directional Bluetooth® antenna
  • Figure 12 is a schematic flowchart illustrating a tangle detection and warning process
  • Figure 13 schematically illustrates a warning display
  • Figure 14 is a schematic flowchart illustrating a tangle detection and warning process
  • Figure 15 schematically illustrates a displayed camera view.
  • a user 10 is wearing an HMD 20 (as an example of a generic head-mountable apparatus - other examples including audio headphones or a head-mountable light source) on the user's head 30.
  • the HMD comprises a frame 40, in this example formed of a rear strap and a top strap, and a display portion 50.
  • the HMD of Figure 1 completely (or at least substantially completely) obscures the user's view of the surrounding environment. All that the user can see is the pair of images displayed within the HMD.
  • the HMD has associated headphone audio transducers or earpieces 60 which fit into the user's left and right ears 70.
  • the earpieces 60 replay an audio signal provided from an external source, which may be the same as the video signal source which provides the video signal for display to the user's eyes. One or both ears may be provided with such transducers.
  • the external source may therefore provide audio and/or video signals to the HMD and may optionally act as a power supply to the HMD.
  • a front-facing camera 122 such as a video camera may capture images to the front of the HMD (that is to say, of the surroundings of the HMD), in use.
  • One or more such cameras may be provided.
  • a Bluetooth® antenna 124 may provide communication facilities or may simply be arranged as a directional antenna to allow a detection of the direction of a nearby Bluetooth transmitter.
  • a video signal is provided for display by the HMD.
  • This could be provided by an external video signal source 80 such as a video games machine or data processing apparatus (such as a personal computer), in which case the signals could be transmitted to the HMD by a wired or a wireless connection 82.
  • suitable wireless connections include Bluetooth® connections.
  • Audio signals for the earpieces 60 can be carried by the same connection.
  • any control signals passed from the HMD to the video (audio) signal source may be carried by the same connection.
  • a power supply 83 including one or more batteries and/or being connectable to a mains power outlet
  • the power supply 83 and the video signal source 80 may be separate units or may be embodied as the same physical unit. There may be separate cables for power and video (and indeed for audio) signal supply, or these may be combined for carriage on a single cable (for example, using separate conductors, as in a USB cable, or in a similar way to a "power over Ethernet" arrangement in which data is carried as a balanced signal and power as direct current, over the same collection of physical wires).
  • the video and/or audio signal may be carried by, for example, an optical fibre cable.
  • embodiments of the invention are applicable to an HMD having at least one electrical and/or optical cable linking the HMD to another device, such as a power supply and/or a video (and/or audio) signal source. So, embodiments of the invention can include, for example:
  • an HMD having a cabled connection to a power supply and to a video and/or audio signal source, embodied as a single physical cable or more than one physical cable;
  • an HMD having its own video and/or audio signal source (as part of the HMD arrangement) and a cabled connection to a power supply;
  • an HMD having a wireless connection to a video and/or audio signal source and a cabled connection to a power supply.
  • an HMD instead of an HMD, another type of head-mountable apparatus may be used, but the same considerations apply.
  • the physical position at which the cable 82 and/or 84 enters or joins the HMD is not particularly important from a technical point of view. Aesthetically, and to avoid the cable(s) brushing the user's face in operation, it would normally be the case that the cable(s) would enter or join the HMD at the side or back of the HMD (relative to the orientation of the user's head when worn in normal operation). Accordingly, the position of the cables 82, 84 relative to the HMD in Figure 1 should be treated merely as a schematic representation.
  • Figure 1 provides an example of a head-mountable display system comprising a frame to be mounted onto an observer's head, the frame defining one or two eye display positions which, in use, are positioned in front of a respective eye of the observer and a display element mounted with respect to each of the eye display positions, the display element providing a virtual image of a video display of a video signal from a video signal source to that eye of the observer.
  • Figure 1 shows just one example of an HMD.
  • Other formats are possible: for example an
  • HMD could use a frame more similar to that associated with conventional eyeglasses, namely a substantially horizontal leg extending back from the display portion to the top rear of the user's ear, possibly curling down behind the ear.
  • the user's view of the external environment may not in fact be entirely obscured; the displayed images could be arranged so as to be superposed (from the user's point of view) over the external environment. An example of such an arrangement will be described below with reference to Figure 4.
  • FIG. 1 A schematic plan view of how this is achieved is provided as Figure 2, which illustrates the positions 100 of the user's eyes and the relative position 110 of the user's nose.
  • the display portion 50 in schematic form, comprises an exterior shield 120 to mask ambient light from the user's eyes and an internal shield 130 which prevents one eye from seeing the display intended for the other eye.
  • the combination of the user's face, the exterior shield 120 and the interior shield 130 form two compartments 140, one for each eye.
  • a display element 150 and one or more optical elements 160 In each of the compartments there is provided a display element 150 and one or more optical elements 160. The way in which the display element and the optical element(s) cooperate to provide a display to the user will be described with reference to Figure 3.
  • the display element 150 generates a displayed image which is (in this example) refracted by the optical elements 160 (shown schematically as a convex lens but which could include compound lenses or other elements) so as to generate a virtual image 170 which appears to the user to be larger than and significantly further away than the real image generated by the display element 150.
  • the virtual image may have an apparent image size (image diagonal) of more than 1 m and may be disposed at a distance of more than 1 m from the user's eye (or from the frame of the HM D). In general terms, depending on the purpose of the HMD, it is desirable to have the virtual image disposed a significant distance from the user.
  • FIG. 4 An alternative arrangement is shown in Figure 4. This arrangement may be used where it is desired that the user's view of the external environment is not entirely obscured. However, it is also applicable to HMDs in which the user's external view is wholly obscured.
  • the display element 150 and optical elements 200 cooperate to provide an image which is projected onto a mirror 210, which deflects the image towards the user's eye position 220. The user perceives a virtual image to be located at a position 230 which is in front of the user and at a suitable distance from the user.
  • the mirror 210 can be a substantially 100% reflective mirror.
  • the arrangement of Figure 4 then has the advantage that the display element and optical elements can be located closer to the centre of gravity of the user's head and to the side of the user's eyes, which can produce a less bulky HMD for the user to wear.
  • the mirror 210 can be made partially reflective so that the user sees the external environment, through the mirror 210, with the virtual image superposed over the real external environment.
  • the lateral displacements in Figure 5 could in fact be the other way round, which is to say that the left eye image as drawn could in fact be the right eye image, and the right eye image as drawn could in fact be the left eye image.
  • some stereoscopic displays tend to shift objects to the right in the right eye image and to the left in the left eye image, so as to simulate the idea that the user is looking through a stereoscopic window onto the scene beyond.
  • some HMDs use the arrangement shown in Figure 5 because this gives the impression to the user that the user is viewing the scene through a pair of binoculars. The choice between these two arrangements is at the discretion of the system designer. In some situations, an HMD may be used simply to view movies and the like.
  • the user's viewpoint need to track movements with respect to a real or virtual space in which the user is located.
  • FIG. 6 schematically illustrates a user wearing an H M D connected to a Sony® PlayStation 3® games console 300.
  • the games console 300 is connected to a mains power supply 310 and (optionally) to a main display screen (not shown).
  • a cable acting as the cables 82, 84 discussed above (and so acting as both power supply and signal cables), links the HMD 20 to the games console 300 and is, for example, plugged into a USB socket 320 on the console 300.
  • a single physical cable is provided which fulfils the functions of the cables 82, 84.
  • a hand-held controller 330 which may be, for example, a Sony® Move® controller which communicates wirelessly with the games console 300 to control (or to contribute to the control of) game operations relating to a currently executed game program.
  • the video displays in the HMD 20 are arranged to display images generated by the games console 300, and the earpieces 60 in the HMD 20 are arranged to reproduce audio signals generated by the games console 300. Note that if a USB type cable is used, these signals will be in digital form when they reach the HMD 20, such that the HMD 20 comprises a digital to analogue converter (DAC) to convert at least the audio signals back into an analogue form for reproduction.
  • DAC digital to analogue converter
  • Images from the camera 122 mounted on the HMD 20 are passed back to the games console 300 via the cable 82, 84.
  • signals from those sensors may be at least partially processed at the HMD 20 and/or may be at least partially processed at the games console 300. The use and processing of such signals will be described further below.
  • the USB connection from the games console 300 also provides power to the HMD 20, according to the USB standard.
  • a risk can occur when a user is wearing an HMD of this type, particularly a so-called "full immersion" HM D which reduces or removes the opportunity of the user to sense his or her surroundings, by virtue of substantially obscuring the user's view of the surroundings and inhibiting the user from hearing the surroundings by reproducing an audio signal directly into the user's ears.
  • This risk is that the user may move, in the course of enjoying the game or other content which is being reproduced by the HMD, such that the cable 82, 84 may become entangled and/or at least partially wrapped around the user's body. The latter situation can be particularly hazardous if the cable were to wrap around the user's neck.
  • a detector is provided for detecting head movements of a magnitude which, assuming a substantially stationary external device, may cause the cable to become at least partially wrapped around the user's body.
  • cable tangle will be used as a generic expression to represent the cable tangling with itself and/or the cable at least partially wrapping around the user's body.
  • a “cable tangle” is indicative of a generic event relating to the cable which is undesirable for the user of a head-mountable apparatus connected to an external device by a cable.
  • Figure 7 schematically illustrates a cable tangle detector using an accelerometer and/or a gyroscope 400 to act as a motion detector to detect movement such as rotational motion of the HMD in use.
  • the accelerometer and/or gyroscope 400 may be mounted on the frame of the HMD 20 or may be mounted on the cable but at a position sufficiently close to the user's head (in operation) that the rotational motion of the user's head or a good approximation of that motion is detected by the accelerometer and/or gyroscope 400.
  • the processing of signals acquired by a sensor such as the accelerometer and/or gyroscope 400 may be carried out at least partially at the HMD and/or at least partially at the external device (in this case, the games console 300).
  • Carrying out the processing at the HMD has the advantage that a small amount of data transfer is required between the HM D and the external device, at least in respect of the detection process.
  • Carrying out the processing at the games console 300 has the advantage that the games console has a higher power processor and memory arrangement, as well as fewer restrictions on power consumption. For the purposes of the present description, it is (apart from the aspects discussed above) immaterial whether the processing is carried out at the HMD, at the external device or both.
  • the output of the accelerometer/gyroscope 400 is passed to an integrator 410. So, changes in motion or position detected by the accelerometer/gyroscope 400 are converted into absolute positions (relative to an arbitrary starting point) by the integrator 410.
  • the output of the integrator 410 is passed to a detector 420 which detects whether the rotational position of the HMD 20 (and therefore of the users head) has changed by at least a predetermined (threshold) angle (such as 240° or 360°, for example as measured with respect to a horizontal plane), and thereby that there has been a head movement of at least the predetermined angle.
  • a predetermined angle such as 240° or 360°, for example as measured with respect to a horizontal plane
  • Figure 7 is a schematic representation of the detection process. It may be that the detector 420 operates directly on the "change of position" data produced by the accelerometer/gyroscope 400, so that the integrator 410 is not in fact required.
  • Figure 8 schematically illustrates a tangle detector using a camera such as the front- facing camera 122 on the HMD 20.
  • a tracker 430 acting on the images captured by the front- facing camera 122, optically detects rotational movement of the HMD 20 by comparing images captured by the camera 122, thereby detecting the relative movement of the camera against the surroundings around the HMD.
  • a full (360°) turn can be detected by the tracker 430 acting as a comparator to generate a comparison of the image captured at the end of the rotation with the image captured at the beginning of the rotation, on the basis that there has been rotational movement relative to the surroundings in between these two images and thereby to compare captured images so as to detect motion of the head-mountable apparatus relative to the surroundings.
  • the HMD has rotated by a full 360°. If the image has moved by a multiple of the angular field of view of the camera (which may be known, as, for example, 55°) then the angular rotation of the camera relative to the surroundings may be detected and compared as above with a threshold rotation angle. The outcome, which may be indicative of a rotation of more than the threshold angle, is detected by a detector 440.
  • a similar but inverse arrangement could be provided by using a stationary camera, for example a camera associated with the games console 300 (not shown) to track a light source associated with the user.
  • a light source can be provided by the illuminated end of the motion controller 330 (and indeed, an accelerometer/gyroscope function can also be provided by the motion controller 330 although, as the motion controller 330 may be used in motion to control aspects of the gameplay, the motion of the controller 330 may not correspond well to the actual motion of the user's body).
  • using just a single light source can have a disadvantage that if the user turns his or her back on the fixed camera, the light source will not be visible to the camera.
  • embodiments of the invention provide multiple light sources (which may be infrared light sources and therefore the illumination can be invisible to the human eye) mounted on and spaced around the HMD, such as a light source 450 shown in Figure 1.
  • multiple light sources which may be infrared light sources and therefore the illumination can be invisible to the human eye
  • FIG. 9 schematically illustrates a cable 460 having sensor portions 470 surrounding a core region 480 in which the cable's conductors and/or optical fibres are housed.
  • An example of the sensor portions may be that they detect stress, for example by providing for a change in electrical resistance of the sensor portions (and so a change in current-carrying properties relating to a sensor current provided, for example, by the HMD all the games console 300) when they are compressed, so that an overlap of the cable 82, 84 with itself leads to compression of the outer sensor portions 470 which can in turn be detected as a potential problem situation relating to the cable.
  • Another example of sensor portions may be a proximity detector for sensing the proximity of an overlapping portion of the cable, for example formed by a set of conductors carrying a high-frequency test signal (such as a 100 kHz test signal), with those or other conductors in the outer sensor portions detecting induced currents from the test signal. The induced currents may change if one part of the cable overlies another part of the cable, thereby indicating an overlap, tangle or potential problem situation.
  • Figure 10 schematically illustrates a cable strain detector which indirectly detects a potential problem situation relating to the cable 82, 84 by detecting instances of the cable being placed under longitudinal strain.
  • the cable strain detector 500 shown in Figure 10 is schematically illustrated near to a USB plug 510 (and so at the games console end of the cable) but could in fact be positioned anywhere along the cable.
  • the strain detector 500 comprises a looped region of the cable 520, with parts of the loop being connected by a strain detector 530 such as a solid state electrical strain detector.
  • the detection of a longitudinal cable strain of at least a predetermined threshold amount by the strain detector can be used to detect a potential cable problem such as a tangle or a problem caused by excessive or inappropriate user movement.
  • Figure 1 1 schematically illustrates a tangle detector using a directional Bluetooth® or other radio frequency communication antenna such as the antenna 124 shown schematically in Figure 1.
  • the antenna 124 can be made directional in its response by known techniques. It can be used either to receive signals transmitted by a signal source such as the games console 300, or to transmit signals to a receiver which is assumed to be stationary such as a receiver associated with the games console 300, or both. In each case of radio frequency communication with an external device, an indication of direction is given by changes in the relative strength of the communicated radiofrequency signal.
  • the signal strength will be at a high level when the directional properties of the antenna 124 are aligned with the direction between the HMD and the other communicating device such as the games console 300, and will be at a lower level when the directional properties of the antenna 124 are not aligned with the direction between the HMD and the other communicating device.
  • many directional antennas have a symmetrical response (in other words, two peaks in response separated by 180°) this arrangement may, in itself, give a partially ambiguous result.
  • embodiments of the invention may combine a directional radiofrequency detection with other motion or angle detection techniques.
  • the signal strength from the directional antenna 124 (if it is used as a receiver) or from a fixed antenna at the games console 300 is passed to a motion tracker 540 which detects motion as described above, and from there to a detector 550 which detects whether the motion has exceeded a threshold likely to cause cable problems as discussed above.
  • Figure 12 is a schematic flowchart illustrating a tangle (or potential tangle) detection and warning process, a warning or alert being provided in the event of a detection of a potential cable tangle problem.
  • the video displays of the HMD provide an alert device to alert the user.
  • the earpieces and a suitable sound generator - not shown) could provide an audible alert device.
  • a vibrational element associated with the HMD could cause a vibration to be felt by the user in the case of a cable problem (and of course combinations of these alert techniques could be used).
  • vibrational elements on different sides of the HMD, they could also provide an indication to the user (without otherwise interrupting the user's enjoyment of the content being replayed or otherwise provided by the HM D) of which way to turn so as to alleviate the detected cable problem. For example, if the user needs to turn or rotate to the user's left to alleviate a cable problem, a transducer on the left side of the HMD could be caused to vibrate.
  • the amplitude, duration or repetition rate of the vibrational warning(s) could be used to indicate the severity of the potential cable problem, with a higher amplitude, a longer duration and/or a more frequent repetition being used to indicate a more severe potential problem.
  • the vibrational elements could be positioned at the user's ears.
  • a similar directional warning could be provided using sounds generated for reproduction in one or other of the earpieces.
  • the alert (which may be a visual and/or audible and/or vibrational alert) is arranged so as to indicate, to the user, which way to move the user's head in order to alleviate the instance (the cable tangle situation) which led to the alert.
  • the detection of which way to turn the head can be based upon the most recent rotational head movement (or in some embodiments, the most recently detected head rotation of at least a threshold net rotational angle, even if the movement paused or even partially reversed during its implementation), in that the indication of which way to turn is the opposite rotational direction to the most recently detected such head movement.
  • the user alert may be provided configured to alert the user to the detection of a head rotation of at least the predetermined magnitude, thereby warning the user that the cable may become at least partially wrapped around the user's body, and/or configured to alert the user to the detection of a longitudinal cable strain of at least the predetermined magnitude, thereby warning the user that the cable may become at least partially wrapped around the user's body.
  • a step 600 the system waits for a predetermined time T (such as 0.7 seconds) in case the user moves again so as to remove the potential problem. If the user does not move so as to remove the potential cable problem within the predetermined time, then at a step 620 a warning is displayed and/or sounded.
  • T such as 0.7 seconds
  • Figure 13 schematically illustrates a warning display which may be displayed on the video displays of the HMD so the user sees the warning display.
  • a textual warning 630 which may be in a coloured and/or flashing font, is superimposed over the images which are already being displayed on the video displays of the HMD, for a predetermined time (such as 10 seconds) or until the potential cable problem is at least alleviated by counteracting movements of the user.
  • an indication 640 may be provided to tell the user which way to move (rotate) in order to alleviate the potential cable problem.
  • FIG 14 is a schematic flowchart illustrating another tangle detection and warning process.
  • the various detection techniques discussed above are summarised by a generic detection step 700.
  • the video content currently being displayed by the video displays of the HMD may optionally be paused, and in its place a view from the forward-facing camera 122 is displayed at a step 710.
  • This has the effect of returning the user from the fully immersive environment of the HMD operation to a real-world view, allowing the user to make appropriate changes in the user's position and/or orientation so as to alleviate any cable-related problems.
  • Figure 15 schematically illustrates an example of such a displayed camera view.
  • Warning messages such as those schematically illustrated in Figure 13 may be superimposed over the view of the forward-facing camera. After a predetermined period, or when the cable problem has been detected to have been alleviated, the system can return to displaying the previous video content on the displays of the HMD 20, un-pausing the content if necessary.
  • a head-mountable apparatus comprising:
  • a frame which is configured to be mounted on a user's head, the frame supporting one or more electrical and/or optical devices;
  • a detector for detecting head movements of a magnitude which, assuming a substantially stationary external device, may cause the cable to become at least partially wrapped around the user's body.
  • a head-mountable apparatus in which the detector is operable to detect head movements which represent a head rotation of at least a predetermined angle.
  • a head-mountable apparatus in which the detector comprises a camera operable to capture images of the surroundings of the head-mountable apparatus, and a comparator to compare captured images so as to detect motion of the head-mountable apparatus relative to the surroundings.
  • a head-mountable apparatus in which the detector comprises a motion detector for detecting movement of the head-mountable apparatus.
  • a head-mountable apparatus in which the motion detector comprises an accelerometer and/or a gyroscope.
  • a head-mountable apparatus in which the detector comprises a directional radio frequency antenna for communicating, via radio frequencies, with a device external to the head-mountable apparatus.
  • a head-mountable apparatus in which the detector is operable to detect a strain, in the cable, of at least a threshold amount.
  • a head-mountable apparatus in which the detector is operable to detect head movements which cause the cable to overlap itself.
  • a head-mountable apparatus in which the cable comprises a sensor to detect the proximity of an overlapping portion of the cable. 10.
  • a head-mountable apparatus according to clause 10, in which the alert is an audible alert and/or a visual alert and/or a vibrational alert.
  • a head-mountable apparatus according to clause 1 1 , in which the alert is arranged so as to indicate, to the user, which way to move the user's head in order to alleviate the instance which led to the alert.
  • a head-mountable apparatus according to any one of the preceding clauses, in which the one or more electrical and/or optical devices comprise one or more video displays.
  • a head-mountable apparatus in which the one or more video displays are arranged with respect to the user's eyes, in use, so as to substantially obscure the user's view of the user's surroundings.
  • a head-mountable apparatus according to any one of the preceding clauses, in which the one or more electrical and/or optical devices comprise one or more audio transducers.
  • a head-mountable apparatus according to any one of the preceding clauses, in which the one or more electrical and/or optical devices comprise one or more video cameras.
  • a head-mountable apparatus according to any one of the preceding clauses, in which the cable comprises either or both of an electrical cable and an optical cable.
  • a head-mountable apparatus according to any one of the preceding clauses, in which the external device is a video and/or audio signal source.
  • a head-mountable apparatus according to any one of the preceding clauses, in which the external device is a power supply.
  • a system comprising a head-mountable apparatus according to any one of the preceding clauses, connected via the cable to the external device.
  • a method of operation of a head-mountable apparatus having a frame which is configured to be mounted on a user's head, the frame supporting one or more electrical and/or optical devices and a cable connecting the one or more electrical and/or optical devices to an external device separate to the head-mountable apparatus;
  • a method of operation of a head-mountable apparatus having a frame which is configured to be mounted on a user's head, the frame supporting one or more devices selected from the group consisting of electrical devices and optical devices and a cable connecting the one or more devices to an external device separate to the head-mountable apparatus; the method comprising:
  • a method of operation of a head-mountable apparatus having a frame which is configured to be mounted on a user's head, the frame supporting one or more devices selected from the group consisting of electrical devices and optical devices and a cable connecting the one or more devices to an external device separate to the head-mountable apparatus;
  • a head-mountable apparatus comprising:
  • a frame which is configured to be mounted on a user's head, the frame supporting one or more devices selected from the group consisting of electrical devices and optical devices; a cable connecting the one or more devices to an external device separate to the head- mountable apparatus; and
  • a detector configured to detect a head rotation relative to the external device of at least a predetermined magnitude
  • a user alert device configured to alert the user to the detection of a head rotation of at least the predetermined magnitude, thereby warning the user that the cable may become at least partially wrapped around the user's body.
  • a head-mountable apparatus comprising:
  • a frame which is configured to be mounted on a user's head, the frame supporting one or more devices selected from the group consisting of electrical devices and optical devices; a cable connecting the one or more devices to an external device separate to the head- mountable apparatus; and
  • a detector configured to detect a longitudinal cable strain of at least a predetermined magnitude
  • a user alert device configured to alert the user to the detection of a longitudinal cable strain of at least the predetermined magnitude, thereby warning the user that the cable may become at least partially wrapped around the user's body.
  • a head-mountable apparatus in which the detector is operable to detect head movements which represent a head rotation of at least the predetermined angle. 29.
  • the detector comprises a camera operable to capture images of the surroundings of the head-mountable apparatus, and a comparator to compare captured images so as to detect motion of the head-mountable apparatus relative to the surroundings.
  • a head-mountable apparatus according to clause 28, in which the detector comprises a motion detector for detecting movement of the head-mountable apparatus.
  • a head-mountable apparatus according to clause 30, in which the motion detector comprises an accelerometer and/or a gyroscope.
  • a head-mountable apparatus according to clause 28, in which the detector comprises a directional radio frequency antenna for communicating, via radio frequencies, with a device external to the head-mountable apparatus.
  • a head-mountable apparatus according to clause 26, in which the detector is operable to detect head movements which cause the cable to overlap itself.
  • a head-mountable apparatus in which the cable comprises a sensor to detect the proximity of an overlapping portion of the cable.
  • a head-mountable apparatus according to any one of clauses 26 to 34, in which the alert is an audible alert and/or a visual alert and/or a vibrational alert.
  • a head-mountable apparatus according to clause 35, in which the alert is arranged so as to indicate, to the user, which way to move the user's head in order to alleviate the instance which led to the alert.
  • a head-mountable apparatus according to any one of clauses 26 to 36, in which the one or more electrical and/or optical devices comprise one or more video displays.
  • a head-mountable apparatus in which the one or more video displays are arranged with respect to the user's eyes, in use, so as to substantially obscure the user's view of the user's surroundings.
  • a head-mountable apparatus according to any one of clauses 26 to 38, in which the one or more electrical and/or optical devices comprise one or more audio transducers.
  • a head-mountable apparatus according to any one of clauses 26 to 39, in which the one or more electrical and/or optical devices comprise one or more video cameras.
  • a head-mountable apparatus according to any one of clauses 26 to 40, in which the cable comprises either or both of an electrical cable and an optical cable.
  • the external device is a video and/or audio signal source.
  • a head-mountable apparatus according to any one of clauses 26 to 42, in which the external device is a power supply.
  • a system comprising a head-mountable apparatus according to any one of clauses 26 to 43, connected via the cable to the external device.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)

Abstract

L'invention porte sur un appareil pouvant être monté sur la tête (20), lequel appareil comprend un bâti qui est conçu pour être monté sur une tête d'un utilisateur, le bâti portant un ou plusieurs dispositifs électriques et/ou optiques (122) ; un câble (82), (84) connectant le ou les dispositifs électriques et/ou optiques à un dispositif externe (300) séparé de l'appareil pouvant être monté sur la tête (20) ; et un détecteur pour détecter des mouvements de tête d'une grandeur qui, en supposant un dispositif externe sensiblement stationnaire, peuvent provoquer l'enroulement au moins partiel du câble (82), (84) autour du corps de l'utilisateur.
PCT/GB2014/050031 2013-01-08 2014-01-07 Appareil pouvant être monté sur la tête détectant un emmêlement de câble WO2014108675A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB201300289A GB2509551A (en) 2013-01-08 2013-01-08 Detecting potential cable tangling or wrapping.
GB1300289.4 2013-01-08

Publications (1)

Publication Number Publication Date
WO2014108675A1 true WO2014108675A1 (fr) 2014-07-17

Family

ID=47748111

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2014/050031 WO2014108675A1 (fr) 2013-01-08 2014-01-07 Appareil pouvant être monté sur la tête détectant un emmêlement de câble

Country Status (2)

Country Link
GB (1) GB2509551A (fr)
WO (1) WO2014108675A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016102545A1 (fr) * 2014-12-22 2016-06-30 Klang Technologies Gmbh Jeu de câbles
CN108010394A (zh) * 2017-12-20 2018-05-08 杭州埃欧哲建设工程咨询有限公司 一种基于vr的虚拟教学方法、控制终端、虚拟教学系统
EP3372289A1 (fr) * 2017-03-07 2018-09-12 HTC Corporation Procédé approprié pour un visiocasque et un système de réalité virtuelle

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017102429A (ja) * 2015-11-19 2017-06-08 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ ウェアラブル端末および制御方法
US20190042843A1 (en) * 2018-04-05 2019-02-07 Intel Corporation Cable detection for ar/vr computing method and apparatus

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5562572A (en) * 1995-03-10 1996-10-08 Carmein; David E. E. Omni-directional treadmill
GB2301216A (en) * 1995-05-25 1996-11-27 Philips Electronics Uk Ltd Display headset
FR2778248A1 (fr) * 1998-04-30 1999-11-05 Pierre Emmanuel Bathie Procede et systeme de diffusion d'images de synthese d'un univers virtuel en relation avec le lieu ou evolue la personne recevant les images de synthese
US6064749A (en) * 1996-08-02 2000-05-16 Hirota; Gentaro Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
WO2007064456A2 (fr) * 2005-11-28 2007-06-07 The George Washington University Systèmes de harnais pour simulateur de réalité virtuelle
WO2009081177A2 (fr) * 2007-12-21 2009-07-02 Bae Systems Plc Appareil et procédé d'atterrissage d'un giravion

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5577981A (en) * 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
DE10245557B4 (de) * 2002-09-30 2014-10-09 Carl Zeiss Jena Gmbh Vorrichtung und Verfahren zur Anzeige eines virtuellen Bildes
US20120188148A1 (en) * 2011-01-24 2012-07-26 Microvision, Inc. Head Mounted Meta-Display System
CN103018903A (zh) * 2011-09-23 2013-04-03 奇想创造事业股份有限公司 具有显示方位锁定装置的头戴式显示器及其显示方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5562572A (en) * 1995-03-10 1996-10-08 Carmein; David E. E. Omni-directional treadmill
GB2301216A (en) * 1995-05-25 1996-11-27 Philips Electronics Uk Ltd Display headset
US6064749A (en) * 1996-08-02 2000-05-16 Hirota; Gentaro Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
FR2778248A1 (fr) * 1998-04-30 1999-11-05 Pierre Emmanuel Bathie Procede et systeme de diffusion d'images de synthese d'un univers virtuel en relation avec le lieu ou evolue la personne recevant les images de synthese
WO2007064456A2 (fr) * 2005-11-28 2007-06-07 The George Washington University Systèmes de harnais pour simulateur de réalité virtuelle
WO2009081177A2 (fr) * 2007-12-21 2009-07-02 Bae Systems Plc Appareil et procédé d'atterrissage d'un giravion

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Helmet-Mounted Displays: Sensation, Perception, and Cognition Issues. Ch. Guidelines for HMD Design", 31 December 2009, U.S. ARMY AEROMEDICAL RESEARCH LABORATORY, United States of America, ISBN: 978-0-61-528375-3, article J. E. MELZER ET AL: "Helmet-Mounted Displays: Sensation, Perception, and Cognition Issues. Ch. Guidelines for HMD Design", pages: 805 - 847, XP055109183 *
CIRIO G ET AL: "Walking in a Cube: Novel Metaphors for Safely Navigating Large Virtual Environments in Restricted Real Workspaces", IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, IEEE SERVICE CENTER, LOS ALAMITOS, CA, US, vol. 18, no. 4, 1 April 2012 (2012-04-01), pages 546 - 554, XP011490408, ISSN: 1077-2626, DOI: 10.1109/TVCG.2012.60 *
OKUMA T ET AL: "An augmented reality system using a real-time vision based registration", PATTERN RECOGNITION, 1998. PROCEEDINGS. FOURTEENTH INTERNATIONAL CONFE RENCE ON BRISBANE, QLD., AUSTRALIA 16-20 AUG. 1998, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, vol. 2, 16 August 1998 (1998-08-16), pages 1226 - 1229, XP010297670, ISBN: 978-0-8186-8512-5, DOI: 10.1109/ICPR.1998.711920 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016102545A1 (fr) * 2014-12-22 2016-06-30 Klang Technologies Gmbh Jeu de câbles
EP3372289A1 (fr) * 2017-03-07 2018-09-12 HTC Corporation Procédé approprié pour un visiocasque et un système de réalité virtuelle
US20180260022A1 (en) * 2017-03-07 2018-09-13 Htc Corporation Method suitable for a head mounted device and virtual reality system
CN108572721A (zh) * 2017-03-07 2018-09-25 宏达国际电子股份有限公司 适用于头戴式装置的预测方法及虚拟实境系统
CN108010394A (zh) * 2017-12-20 2018-05-08 杭州埃欧哲建设工程咨询有限公司 一种基于vr的虚拟教学方法、控制终端、虚拟教学系统
CN108010394B (zh) * 2017-12-20 2020-11-03 杭州埃欧哲建设工程咨询有限公司 一种基于vr的虚拟教学方法、控制终端、虚拟教学系统

Also Published As

Publication number Publication date
GB201300289D0 (en) 2013-02-20
GB2509551A (en) 2014-07-09

Similar Documents

Publication Publication Date Title
US10198866B2 (en) Head-mountable apparatus and systems
US9703100B2 (en) Change nature of display according to overall motion
US9423880B2 (en) Head-mountable apparatus and systems
US10078366B2 (en) Head-mountable apparatus and system
WO2017153768A1 (fr) Réalité virtuelle
JP7177054B2 (ja) ユーザ頭部回転ガイド付きヘッドマウントディスプレイ
US9372346B2 (en) Directional light beams for angle detection
WO2014108675A1 (fr) Appareil pouvant être monté sur la tête détectant un emmêlement de câble
US11045733B2 (en) Virtual reality
US20230061649A1 (en) Head-mountable display system and methods
GB2517008A (en) Head-mountable apparatus and systems
GB2534846A (en) Head-mountable apparatus and systems
GB2515353A (en) Head-mountable apparatus and systems
GB2571286A (en) Virtual reality
GB2558279A (en) Head mountable display system
WO2018115842A1 (fr) Affichage de réalité virtuelle par visiocasque
EP3559782B1 (fr) Traitement de données
WO2018115843A1 (fr) Visiocasque
WO2018096315A1 (fr) Réalité virtuelle
GB2515130A (en) Head-mountable apparatus and systems
GB2515131A (en) Head-mountable apparatus and systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14700106

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14700106

Country of ref document: EP

Kind code of ref document: A1