EP3281093A1 - Elektronisches armband zur anzeige interaktiver digitaler inhalte zur projektion auf eine zone eines arms - Google Patents
Elektronisches armband zur anzeige interaktiver digitaler inhalte zur projektion auf eine zone eines armsInfo
- Publication number
- EP3281093A1 EP3281093A1 EP16719037.0A EP16719037A EP3281093A1 EP 3281093 A1 EP3281093 A1 EP 3281093A1 EP 16719037 A EP16719037 A EP 16719037A EP 3281093 A1 EP3281093 A1 EP 3281093A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- bracelet
- detector
- interaction
- zone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1639—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being based on projection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/169—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3173—Constructional details thereof wherein the projection device is specially adapted for enhanced portability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
Definitions
- the field of the invention relates to electronic wristbands for displaying digital content on a portion of an arm. STATE OF THE ART
- the invention aims to overcome the aforementioned drawbacks.
- a transmitter of a light beam in a non-visible frequency band forming a light sheet to cover a first area of an arm or forearm;
- ⁇ A projector projecting an image on a second area, the first area overlapping substantially at the second area;
- One advantage is to distribute the weight of the bracelet to find a balance. Another advantage is to make the power supply removable without impacting the frame of the bracelet.
- the bracelet comprises:
- One advantage is to allow a comfortable display in a substantially rectangular format or at least giving the perception that the image is substantially perpendicular.
- One advantage is to compensate for surface effects related to the anatomy of the forearm as the lateral curvature of the forearm can deform the image. It is also possible to compensate for perspective effects.
- the deformation factors are transforming factors from a first 2D geometric form to a second 2D geometric form.
- the transmitter is a linear transmitter projecting a substantially plane light beam.
- the position of at least one interaction point is calculated from:
- a transformation of the acquired image and trace into an original image comprising an image of the trace from the transformation factors.
- the bracelet further comprises a second detector capturing colorimetric images of the second zone.
- the image stabilizer compares the longitudinal dimensions of the second area of the images acquired by the first detector with the dimensions of the images acquired by the second detector to generate correction factors to be applied to the transformation factors.
- the computer generates a control image and the projector regularly projects said reference image into the projected image stream, said control image being acquired by at least one detector of the bracelet in order to compare characteristic dimensions of the image. image acquired with a reference image for calculating image correction factors.
- the reference image is calculated during a calibration or first use operation, the reference image being obtained by applying transformation factors to a projected image to obtain a displayed image of which the dimensions are desired, that is to say having a substantially rectangular shape, the application of processing factors during this operation being performed from an interface of the bracelet.
- the second detector performs a second calculation of an interaction point by analyzing a trace intercepting the image, said trace being obtained by analyzing a change in the color of the pixels of the image. a portion of the acquired image.
- the computer comprises a shape recognition function for detecting the presence of the shape of a finger in the image and for determining an end point to deduce the interaction point.
- a calculator correlates the position of an interaction point obtained from an image acquired by the first detector and the position of an interaction point obtained from an image acquired by the second detector, the correlation of positions to generate a new position of an interaction point.
- the image projector is a color pico-projector.
- the image projector comprises a blue laser, a red laser and a green laser and a set of micro-mirrors oriented so as to produce at each projection point a point whose color is generated by a combination of the three lasers oriented by the mirrors.
- the image projector is an LCOS type projector.
- the image projector emits an image whose resolution is 1920x2080.
- the bracelet comprises an accelerometer and a gyroscope for activating functions generating a modification or a change of the image projected by the projector.
- the power source is a removable battery.
- a projection device comprising a bracelet of the invention and comprising a base comprising means for holding the bracelet, the bracelet calculator comprising a second projection mode comprises second image deformation factors for projecting images on a second projection plane, the second projection plane being coincident with the support plane of the base.
- the base comprises a transmitter of a substantially flat infrared beam and a detector disposed on the face opposite to the face of the support facing the image projection of the projector, said detector recording images comprising at least an interaction trace when the beam is intercepted by a body, the computer generating interaction instructions modifying the projected image according to a detected interaction zone.
- FIG. 1 a front view of an electronic bracelet comprising a projector of the invention
- FIG. 2 an arm of a user wearing a bracelet of the invention
- FIG. 3 a side sectional view of the bracelet of the invention and a projection mode of an image
- FIG. 4 is a representation of a grid used to detect an interaction point on a projected image
- FIG. 5 is a superposition of an original image and a matrix of boundary points for calculating an interaction zone
- FIG. 6 an electronic bracelet positioned on a base to provide a second display mode
- FIG. 1 shows an embodiment of a bracelet 1 of the invention.
- the bracelet includes a frame 3, a band 2 and a power source 4.
- Band 1 shows an embodiment of a bracelet 1 of the invention.
- the bracelet includes a frame 3, a band 2 and a power source 4.
- the band 2 forms the part of the bracelet for maintaining said bracelet around the wrist of a person. It may include means for adjusting the fastening position of the band to accommodate different circumferences of wrists. The means for adjusting the position of the bracelet 1 may also make it possible to fix two parts of the band around the wrist together.
- the band may be of flexible elastic material, fabric or rigid material such as a rigid plastic material, metal or foam or any other material for making a band.
- the band 2 may comprise a thin thickness of the size of a watch strap of a few millimeters or be thicker of the order of 1 or 2 cm.
- the lower part of the bracelet 1 is designated as a part opposite the part of the bracelet 1 comprising the frame 3 corresponding to the upper part of the bracelet 1.
- a power source 4 is positioned in the lower part of the bracelet 1 so as to make the frame 3 less bulky in volume and so as to balance by weight and / or aesthetically the bracelet 1 of the invention from either side.
- the bracelet 1 can find a better balance when held around a wrist.
- the supply connector (s) feeding the electronic components of the frame can (wind) be conveyed (s) along the band 2 for example inside the band 2 so as to to be masked from the outside.
- the power source 4 is arranged on the upper part of the bracelet 1.
- the frame 3 may include the power source 4.
- the power source may be included in another frame attached or juxtaposed to the frame 3 on the upper part.
- the power source is a rechargeable battery.
- the battery can then be removable and thus be removed from the bracelet 1 to be recharged.
- Another solution is to place the bracelet 1 on a base including a power supply for recharging the battery that remains in position in the bracelet.
- the power source is an exchangeable battery.
- the frame 3 comprises an infrared emitter 30.
- the emitter 30 then emits a light beam 31 forming a light sheet.
- the transmitter 30 is arranged in the lower part of the frame and can be a linear transmitter.
- the lower part of the frame 3 is defined as the part closest to the skin of the wrist or forearm or the hand of a person wearing the bracelet 1.
- the display can be made on the anterior or posterior side of the forearm.
- the projection of images can be performed on the inside or outside of the hand.
- One advantage is to achieve a substantially plane beam closer to the skin and substantially parallel to the surface of the wrist or forearm.
- FIG. 3 represents a sectional view in which the beam
- the frame 3 comprises a projector 20 for projecting an image along an axis intercepting the wrist or forearm of a person wearing the bracelet 1.
- FIG. 3 represents a sectional view of a portion of the projection cone 21 intercepting the forearm 101 to form an image 22.
- the projector is arranged in the frame at a height denoted H L ONG of the surface of the front-end. arm 101.
- the frame 3 comprises a first detector 10 for detecting in the infrared range the color changes related to the interactions of the beam emitted by the transmitter 30.
- the frame 3 comprises a second detector 11 for detecting the images emitted in the visible frequency domain in order to adjust in real time the size of the image and / or to calculate in real time the deformation factors at apply to the projected image.
- the frame 3 comprises calculation means, denoted M in FIG. 3, such as a computer that can be a microprocessor, a microcontroller or an electronic chip.
- the calculating means may comprise, according to the embodiment chosen, one or more computers performing the various functions of image processing. Among these functions are the generation of images and the calculation of deformation factors and / or image correction.
- the calculator makes it possible to calculate interaction point and servo position positions for generating new images based on the detected commands.
- the computer is therefore capable of generating the images to be projected according to the detected interactions, as well as any other functions necessary for carrying out the invention.
- the frame 3 comprises one or more memories, denoted M in FIG. 3, for storing temporary computed values or for storing interaction information such as interaction point positions or for store data to generate images or any other data necessary for carrying out the invention.
- the frame 3 comprises an accelerometer and a gyroscope for measuring movements of a wrist and / or the forearm of a person wearing the bracelet 1.
- the detected movements can be by comparing values of the accelerations with reference to known and recorded values which correspond to actions to carry out.
- the ignition of the bracelet can be performed by turning the wrist twice along the axis of the forearm.
- the acceleration values measured over a given period of time make it possible to determine which action must be taken according to the motion sequence detected.
- a wakeup action can be engaged to turn on the bracelet 1 when a threshold of acceleration in rotation around the forearm has been crossed.
- actions can be indicated according to acceleration values measured according to the three axes of a Cartesian reference system to generate specific actions such as: activate a detector or a projector, turn off a detector or a projector, generate an image or modify the generated image, activate a new image from a first image based on a browsing history.
- FIG. 2 represents a bracelet 1 of the invention positioned in a portion of the arm located between the forearm 101 and the hand 100. This junction zone is called the wrist 102. This zone is advantageously intended for the wearing of the bracelet 1 of the invention.
- the bracelet 1 is shown projecting an image 22 on the forearm 101 of a person.
- the infrared light beam 31 is also represented superimposed on the image displayed on the forearm 101.
- the display of the image 22 and the generation of the beam 31 can be made on the hand.
- the mode allows the bracelet 1 to be turned over and the display to be inverted in order to activate the projection direction of the image 22 towards the hand while benefiting from an image displayed in the reading direction.
- the bracelet is configured for display towards the direction of the hand.
- this display mode does not provide the entire projection surface of the forearm 101.
- the fingers and in particular the carpal bones limit the display area and cause a distortion of the displayed image.
- the movements of the hand 100 are often sharper and more sporadic than those of a forearm 101, therefore, the image stabilizer must be more responsive and must be configured to take into account these movements of the hand.
- the beam 31 is emitted preferentially in a non-visible frequency band so as not to alter the image 22 projected by the projector 20.
- the light beam is emitted by a linear emitter generating a substantially plane beam in a range. infrared frequency.
- the beam is emitted in a plane substantially parallel to the surface of the skin between 1 mm and 1 cm from the surface of the skin. A distance of between 1 mm and a few millimeters makes it possible to obtain good detection efficiency on the projection zone by limiting the errors of false detections.
- a power management module of the transmitted beam can be integrated into the frame.
- a control accessible by a user that can be either digital or by means of a discrete allows him to adjust the power of the beam. This command adjusts for example a night mode or a day mode. By default, the power is configured to provide good day and night detection.
- a detector 10 makes it possible to acquire, in a given frequency range, at least one trace 32 formed by the interception of the beam by a body.
- the body intercepting the beam is generally the finger of a user who is positioned on an area of the displayed image.
- An advantage of the bracelet 1 of the invention is to reproduce interactivity comparable to that of smartphones or tablets that include a touch screen but without the use and size of such a screen. Another body can be used such as a stylus. When the body is a finger, an advantage of the invention is that the interaction can be detected even with the use of a glove which does not allow a touch screen.
- the detector 10 When a body intercepts in at least one point the light beam 31, the detector 10 captures a light variation which can result in the presence of a white spot when the beam is an infrared beam.
- the detector 10 thus makes it possible to generate an image comprising a trace 32 having coordinates in the acquired image corresponding to the point of interaction that the user wishes to engage by an action of his finger. It is recalled that the user does not see the infrared beam 31 but only the projected image 22.
- the bracelet offers transparent control interactivity for the user.
- the interaction point therefore corresponds to an area of the image that it wishes to activate.
- the activation may correspond to the desire to navigate on another page by activating a link or may correspond to a choice among a list of choices or an option displayed and to be validated. Other examples of activations are possible according to the bracelet 1 of the invention.
- An advantage of the arrangement of the detector 10 which is positioned at a greater height than the beam transmitter 30 on the frame of the bracelet 1 vis-à-vis the surface of the wrist is to obtain a good image reflecting traces related to the interception of the beam by a body.
- Other systems exist evaluating the position in depth of an interaction such as a "radar" type operation, but these last solutions remain approximate and do not make it possible to discriminate many points on the zone of interaction. These devices generate many false detections because of the imprecision of the evaluation of the distance from the body to the detector.
- An advantage of the bracelet of the invention is to provide an arrangement of the detector providing a perspective of detection of the displayed image. This configuration improves the detection of an interaction point and the accuracy of determining the coordinates of the center of the interaction point.
- the determination of the interaction point can be performed in the referential linked to the projected image or in the reference frame of the image acquired and transformed. Both variants are substantially equivalent and offer comparable results. Either of these methods has its own advantages that can be chosen according to the intended design. For example, when the position calculations are performed in the frame of the image displayed on the forearm, the calculations related to the transformation matrices of the detected spot are simplified. On the other hand, when the position computations are carried out in the repository of the image acquired and transformed, a gain of precision can be obtained on the determination of the center of the detected spot and the determination of the activated zone of the image.
- the bracelet 1 of the invention therefore allows the analysis of at least one position of an interaction point of a user to determine which zone of the image will be activated.
- the image may include areas of interaction.
- a software cut of the image makes it possible to segment the image into different zones of interaction.
- the invention then makes it possible to compare the position of the point of interaction of the beam with reference points and to identify to which interaction zone of the image this point corresponds.
- the bracelet 1 of the invention makes it possible to transform the image acquired by the detector 10 into a known reference frame of an image not deformed.
- the image projected before the application of deformation factors or the image acquired after the application of deformation factors is called the original image.
- Different deformations can be applied to the acquired image to switch it to a format linked to the original image.
- the deformations applied to the image during the projection allow a user to view the image as if it were displayed while maintaining the proportions of an original image.
- the deformations applied during the acquisition of images make it possible to take into account the differences related to the fact that the detection plane is not parallel to the plane of the image and the effects of perspective.
- a first transformation may be applied to compensate for the lateral offset D L AT of the detector 10 with respect to the central axis of projection.
- a second transformation can be applied to compensate for the perspective effects of the image projected in depth and to apply a transformation aimed at restoring the image acquired in a 2D plane.
- the perspective effects can take into account the height between the detector 10 and the plane of the projected image 22 substantially parallel to the plane forming the forearm 101.
- the acquired image can then be transformed to compensate for this difference.
- the lateral perspective effects can be taken into account by the transformation factors as well as the edge effects including in particular the part of the image closest to the bracelet as well as the farthest part.
- a third transformation can be applied to compensate for the effects of surfaces related to the anatomy of the forearm or the hand that would be taken into account in projecting the projected image 22.
- the trace 32 detected in the acquired image can be transformed so as to obtain a trace 32 'in an undistorted image repository by the projection of the latter on the forearm.
- the undistorted image is named the original image as previously stated.
- the trace 32 'in the original image includes one or more pixels in the repository of the original image.
- a step of determining the center 33 of this trace 32 ', or a center of gravity, can be engaged to determine the most likely point of interaction of the image that a user wished to activate.
- the point thus calculated, called "interaction center” 33 may be a pixel of the image.
- the interaction center can be calculated on the acquired image not yet corrected by the transformation factors.
- the transform of the interaction center of the trace of the acquired image makes it possible to determine the position of the interaction center of the trace of the original image.
- the position of the interaction center 33 is compared with a matrix of points delimiting zones 55 or 55 'according to whether the acquired image or the original image obtained by the transformation of the image is considered. acquired image.
- Such zones 55 are shown in perspective in FIG. 4 and superimposed on the beam 31 and are represented in the original image in FIG. 5.
- Delimiting points 50 are defined in order to delimit the interaction zones 55 '.
- FIG. 5 represents the zones 55 'in a reference frame linked to the original image as well as the delimitation points 50.
- the image is delimited in zone 55' by a grid in the reference frame linked to the original image.
- the grid has identical rectangular surfaces. But any other grid is compatible with bracelet 1 of the invention.
- areas 55 'forming squares, diamonds or circles can be defined.
- the position of the interaction center 33 is thus compared with the position of the boundary points 50 or the boundaries of the zones 55 '.
- An algorithm for calculating the distances from the interaction center 33 to the closest delimitation points 50 makes it possible to estimate the zone 55 'which is activated by the user.
- the bracelet of the invention is configured to determine the proportion of the task in each zone.
- the area 55 'comprising the largest number of pixels of the trace 32' is determined as the active area.
- the display of the image comprises activatable zones whose activation is determined according to the calculation of the position of the interaction center 33 in the image.
- Figure 5 shows icons 201 of the original image.
- the computation of the trace 32 ', or of its center 33, in the reference frame of the original image can be reconciled:
- the use of the zones remains optional.
- the use of the zones makes it possible to make the detection of interaction points more robust by making a simple comparison with the corresponding area corresponding to the determined interaction point. The comparison makes it possible to arrive at an action that is related to the activation of said determined zone.
- Other actions combining different interaction points 33 can be detected according to the same principle by the bracelet 1 of the invention.
- two interaction points 33 can be detected.
- motion detection includes detecting a set of interaction points.
- Instant vectors can be deduced.
- the computer makes it possible, for example, to enlarge an image portion or the entire image according to the position of the determined interaction centers.
- Figure 3 shows the projector 20 projecting an image on the forearm 101.
- Projection makes it possible to distort an original image by applying deformation factors to the image.
- deformation factors take into account perspective effects.
- These perspective effects can take into account in particular the depth of field, that is to say the delimitation of the image to be displayed on the furthest part of the bracelet 1 and take into account the height of the projector vis-à- screw of the projection plane located on the skin of the forearm 101.
- the image transformation factors to compensate for the perspective effects take into account the lateral deformation of the image, i.e. the points of the image farthest from the main optical axis. .
- the deformations take into account the anatomy of the surface of the forearm or the hand of a user according to his morphology. For example, an average or standard morphology is applied to an image projected by the bracelet 1 and can be adjusted according to the different morphologies of users. Transformation factor correction factors can be applied to modify the transformations applied to the projected image.
- An objective of image transformation factors is to display an image on the forearm of a user that is close to an original image for the user. It is then necessary to compensate for certain natural deformations related to the projection mode of images and the projector itself.
- the calculator of the bracelet of the invention can make it possible to perform the image processing calculations, in particular the application of the deformation and / or correction factors.
- Another calculator can be used to generate the images.
- the same computer generates the images and transforms the images from the deformation and / or correction factors.
- the projector can have a laser projector type pico-laser color projector.
- the image projector comprises a blue laser, a red laser and a green laser and a set of micro-mirrors oriented so as to produce at each projection point a point whose color is generated by a combination of the three lasers oriented by the mirrors.
- the image projector may be for this purpose an LCOS type projector, designating in the English terminology "Liquid Crystal On Silicon” and meaning Liquid Crystal on Silicon.
- This technology mixes a light source with a light source.
- the light source can be generated by one or more laser (s) or one or more diode (s).
- a liquid crystal display can be directly mounted on an integrated component.
- a prism can also be used.
- the image projector emits an image whose resolution is 1920x2080.
- the bracelet 1 comprises a second detector 1 1 for acquiring color images.
- the second detector makes it possible to apply correction factors to the transformations to be applied to the projected image.
- an analysis of the contours of the projected image makes it possible to readjust the transformation factors to be applied to the projected image. For this, corrective factors are applied to the transformation factors to take into account the actual display detected on the forearm.
- the second detector 1 1 makes it possible to improve, in particular, the image stabilizer function.
- the contours of the displayed image 22 can be regularly compared to a control image having desired nominal dimensions whose characteristics are recorded in a memory M. This real-time comparison of the dimensions of the displayed image and that recorded makes it possible to generate data. corrective factors. The correction factors can therefore be generated according to the differences calculated by a calculator between two image dimensions.
- correction factors compensate for wrist, hand and forearm movements.
- correction factors can also compensate for an inclination of the frame when the bracelet has play around the wrist.
- the correction factors make it possible to offer a user an image stabilizer function.
- the dimensions of the images captured by the two detectors 10 and 11 can also be compared to ensure coherence of the image stabilization and the detection of interactive area of the image.
- the second detector 1 1 also makes it possible to perform a second detection calculation of an interaction center or an interaction zone.
- the positions obtained by the two detectors coupled to one or several calculators can be correlated to reduce the rate of false detections.
- An image calibration can be defined by means of the bracelet.
- the image calibration aims to project a reference image and to apply transformation factors according to the wishes of a user.
- the bracelet of the invention comprises an interface comprising buttons or contactors for applying changes in correction factors or image deformation.
- the calibration makes it possible to ensure that the image is displayed appropriately for a user, that is to say in a substantially rectangular format compensating the effects of perspectives.
- the calibration makes it possible to adapt the format of the image to a given morphology of a user.
- One advantage is to determine a display format and then make corrections to compensate for movements when using the bracelet.
- Another advantage is to allow the calibration phase at any time to compensate for drifts or changes in anatomy. It is also possible to customize the display according to users, the bracelet can then be preconfigured according to different calibrations and thus be used by different people.
- the bracelet 1 comprises a fabric that can be deployed on the forearm to form a screen.
- the fabric can be integrated in the strip 2 or in the frame 3 or in the compartment 4 which comprises the battery.
- the fabric can be held at its end by an elastic band or a second bracelet that attaches to the arm to stretch it.
- the bracelet 1 extends longitudinally for example by means of overlapping concentric rings.
- a locking and unlocking system makes it possible to go into an extended mode of the bracelet 1 and to lock it.
- the rings are then designed to hold for example thanks to diameters cooperating at the ends between two overlapping rings.
- the elongation device of the bracelet 1 is then similar to a deployment device of the "fishing rod" type.
- the rings may be portions of unclosed rings that cover only part of the forearm.
- One advantage is to form a screen superimposed on the skin of the forearm. This embodiment makes it possible in particular to overcome the surface topology of the forearm of a person, bristles and different thickness of the forearm. pairing
- the bracelet of the invention can be paired with equipment connected to a mobile or terrestrial network such as a smartphone, tablet or computer.
- a wireless link is advantageously used to pair the devices together.
- the wireless link can be established using a Bluetooth or Wifi protocol or any other protocol that allows such a link to be established.
- the bracelet of the invention comprises for this purpose a radio component or network for establishing such a connection.
- the computer present in the bracelet of the invention is configured to process the data received from the equipment and process the images to project them.
- the image projected by the bracelet of the invention is an image generated by the equipment and transmitted by the wireless link to the bracelet.
- the bracelet when an interaction on the image displayed by the bracelet is detected, the bracelet deals with the interaction independently of the equipment for example by offering an interactive menu and validating a choice of the user or by actuating a button for generating a second image.
- the bracelet is for example able to directly generate a request to a network equipment via access to a network independently of the equipment.
- the bracelet includes a memory in which are saved the data to display. Other interactions are possible according to alternative embodiments that can be combined with each other.
- the bracelet of the invention is configured to generate a request to the equipment in order to process the interaction detected on the displayed image.
- the bracelet is then used as an alternative display of equipment such as the Smartphone. If for example a button displayed on the forearm is activated, the query generated to the equipment can return an action or an image to the bracelet. The latter will then be able to project the result of the interaction.
- the bracelet comprises a network component for connecting to a network.
- the connection can be made, for example, by a wireless link such as a link Wifi or Bluetooth or any other protocol for establishing a wireless link.
- the bracelet can be configured to connect to an internet box via a Wi-Fi network or a 3G or 4G mobile network. The bracelet is then able to generate requests via the box through the network to interface with a server.
- the bracelet is a connected bracelet that can display for example a digital content from the Internet.
- a video of a video platform can be displayed on the forearm thanks to the reception of video frames and their processing by the calculator of the bracelet and the image projector.
- FIG. 6 represents another embodiment of the invention in which the bracelet 1 can be affixed and / or fixed on a support 5 forming a holding base.
- a second display mode may be engaged by a user.
- the image obtained can be larger, in particular by obtaining a larger interception surface between the cone 21 'and the display surface.
- the base can include its own power source to power the bracelet 1 or recharge the battery 4 of the bracelet 1.
- the base comprises an emitter 61 of an infrared beam and a detector 60 for acquiring an image 62 and detecting the interaction points of a finger in an interactivity zone .
- the interactivity zone is projected on the other side of the bracelet 1 with respect to image projection 22 as shown in FIG.
- the user can therefore use his finger as a mouse to animate a cursor displayed on the image or to activate an area of the image 22.
- the calculator K makes it possible to take into account the movements or actions carried out by an interacting finger on the interactivity zone 62 to generate actions on the image 22 to be displayed.
- the actions that the computer can engage there is in particular according to the invention: a modification of the image, a validation of a choice to generate a request from a server for example, the generation of a new image, activating a menu or button, etc.
- FIG. 7A to 7E show an example of image correction and calculation of correction factors applied to the projected image.
- FIG. 7A represents an image to be projected by the computer.
- the image can be encoded in a compression format such as jpeg format or any other format.
- the image shows a "13:37" time and a symbology representing circles.
- the image is shown undistorted in a rectangle with marks A, B, C, D, E, F, G, H.
- the calculator applies image transform factors to project a distorted image.
- This distorted image aims to compensate for the deformation related to the geometry of the optics so that a user observes an undistorted image displayed on his forearm.
- the computer performs a first rotation of the image by 90 ° counterclockwise.
- a trapezoidal deformation is then applied.
- the deformation factors applied correspond to a calibration during the first use. During this calibration, a reference image was recorded in a memory of the bracelet.
- FIG. 7B represents an image transformed by the calculator of the bracelet with the deformation factors recorded in a memory of the bracelet as a result of the calibration during the first use.
- Figures 7C and 7D schematically show the projection of the image of the bracelet projector on a wrist for cutting and in plan view.
- the transformations of the projected image make it possible to compensate:
- the acquired image is corrected according to the reference image in real time.
- a display driver can be installed to support the image comparison and application functions of corrected or unmatched transform factors.
- the deformations and the corrections of the deformations measured in real time make it possible to project an image compensating these deformations so that the user can observe images less dynamically deformed possible.
- the sample image is inserted into a continuous stream of images projected at a given frequency so that it is invisible to a user's eye.
- the refresh rate of the projected images is between 13 and 30 images per second, the emission of a control image in a window of one second is almost imperceptible to the observer.
- the sample image may be emitted at a known time in the stream of transmitted images, for example, it may be the last frame of a sequence of 24 frames per second emitted.
- Such an image can be emitted regularly at predefined times vis-à-vis the stream of transmitted images.
- the control image can be emitted at regular times, for example every 2s.
- the bracelet includes a clock for timestamping the generation of the control images to be transmitted and insert them into the projected image stream.
- FIG. 8 illustrates a second detection D2 performed shortly after the first detection D1.
- a finger 103 of a user enters the field of the colorimetric image 71 but does not intercept the infrared beam, that is to say the infrared beam superimposed on the image on a portion of the arm.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Geometry (AREA)
- Controls And Circuits For Display Device (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1553161A FR3034889B1 (fr) | 2015-04-10 | 2015-04-10 | Bracelet electronique pour l’affichage d’un contenu numerique interactif destine a etre projete sur une zone d’un bras |
PCT/EP2016/057848 WO2016162538A1 (fr) | 2015-04-10 | 2016-04-08 | Bracelet electronique pour l'affichage d'un contenu numerique interactif destine a etre projete sur une zone d'un bras |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3281093A1 true EP3281093A1 (de) | 2018-02-14 |
Family
ID=53541762
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16719037.0A Withdrawn EP3281093A1 (de) | 2015-04-10 | 2016-04-08 | Elektronisches armband zur anzeige interaktiver digitaler inhalte zur projektion auf eine zone eines arms |
Country Status (4)
Country | Link |
---|---|
US (1) | US20180113569A1 (de) |
EP (1) | EP3281093A1 (de) |
FR (1) | FR3034889B1 (de) |
WO (1) | WO2016162538A1 (de) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102629629B1 (ko) * | 2016-12-07 | 2024-01-29 | 플라트프로그 라보라토리즈 에이비 | 개선된 터치 장치 |
CN117311543A (zh) | 2017-09-01 | 2023-12-29 | 平蛙实验室股份公司 | 触摸感测设备 |
CN112889016A (zh) | 2018-10-20 | 2021-06-01 | 平蛙实验室股份公司 | 用于触摸敏感装置的框架及其工具 |
CN114730228A (zh) | 2019-11-25 | 2022-07-08 | 平蛙实验室股份公司 | 一种触摸感应设备 |
JP2023512682A (ja) | 2020-02-10 | 2023-03-28 | フラットフロッグ ラボラトリーズ アーベー | 改良型タッチ検知装置 |
CN112716117B (zh) * | 2020-12-28 | 2023-07-14 | 维沃移动通信有限公司 | 智能手环及其控制方法 |
DE102021114661A1 (de) | 2021-01-29 | 2022-08-04 | Sean Grant | Tragbare biometrische Vorrichtung |
US11847256B2 (en) * | 2022-03-04 | 2023-12-19 | Humane, Inc. | Presenting and aligning laser projected virtual interfaces |
DE102022108131B3 (de) | 2022-04-05 | 2023-10-05 | Audi Aktiengesellschaft | Tragbares Accessoire mit einer Anzeigeeinrichtung, Verfahren zum Betreiben eines tragbaren Accessoires, und Steuereinrichtung |
CN117218114B (zh) * | 2023-11-06 | 2024-01-30 | 山东滨州安惠绳网集团有限责任公司 | 一种基于图像数据处理的网状织物缺陷快速检测方法 |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1540641A2 (de) * | 2002-06-26 | 2005-06-15 | VKB Inc. | Integrierter mehrfunktions-bildsensor und anwendung auf die virtuelle schnittstellentechnologie |
US8195006B2 (en) * | 2004-08-30 | 2012-06-05 | Bauhaus-Universitaet Weimar | Method and device for representing a digital image on a surface which is non-trivial in terms of its geometry and photometry |
US9241143B2 (en) * | 2008-01-29 | 2016-01-19 | At&T Intellectual Property I, L.P. | Output correction for visual projection devices |
JP5256899B2 (ja) * | 2008-07-18 | 2013-08-07 | セイコーエプソン株式会社 | 画像補正装置、画像補正方法、プロジェクタおよびプロジェクションシステム |
US20100110264A1 (en) * | 2008-10-31 | 2010-05-06 | Lucent Technologies, Inc. | Image projection system |
US9569001B2 (en) * | 2009-02-03 | 2017-02-14 | Massachusetts Institute Of Technology | Wearable gestural interface |
US8727539B2 (en) * | 2010-10-28 | 2014-05-20 | Seiko Epson Corporation | Projector and method of controlling projector |
US9686388B2 (en) * | 2011-05-13 | 2017-06-20 | Rohm Co., Ltd. | Projector |
GB201205303D0 (en) * | 2012-03-26 | 2012-05-09 | Light Blue Optics Ltd | Touch sensing systems |
ITTO20120756A1 (it) * | 2012-08-31 | 2014-03-01 | St Microelectronics Srl | Dispositivo pico-proiettore stabilizzato e relativo metodo di stabilizzazione di immagine |
KR102065687B1 (ko) * | 2012-11-01 | 2020-02-11 | 아이캠, 엘엘씨 | 무선 손목 컴퓨팅과 3d 영상화, 매핑, 네트워킹 및 인터페이스를 위한 제어 장치 및 방법 |
KR101999958B1 (ko) * | 2013-05-22 | 2019-07-15 | 엘지전자 주식회사 | 이동 단말기 및 그것의 제어 방법 |
JP2015041052A (ja) * | 2013-08-23 | 2015-03-02 | ソニー株式会社 | リストバンド型情報処理装置および記憶媒体 |
JP6274839B2 (ja) * | 2013-12-04 | 2018-02-07 | キヤノン株式会社 | 画像処理装置、画像処理方法 |
US9369658B2 (en) * | 2014-01-20 | 2016-06-14 | Lenovo (Singapore) Pte. Ltd. | Image correction of surface projected image |
EP3126932A1 (de) * | 2014-04-01 | 2017-02-08 | Sony Corporation | Harmonisierung einer projizierten benutzerschnittstelle |
KR102029756B1 (ko) * | 2014-11-03 | 2019-10-08 | 삼성전자주식회사 | 웨어러블 디바이스 및 그 제어 방법 |
KR102347248B1 (ko) * | 2014-11-26 | 2022-01-04 | 삼성전자주식회사 | 터치 제스쳐 인식 방법 및 장치 |
-
2015
- 2015-04-10 FR FR1553161A patent/FR3034889B1/fr not_active Expired - Fee Related
-
2016
- 2016-04-08 WO PCT/EP2016/057848 patent/WO2016162538A1/fr active Application Filing
- 2016-04-08 EP EP16719037.0A patent/EP3281093A1/de not_active Withdrawn
- 2016-04-08 US US15/565,341 patent/US20180113569A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
WO2016162538A1 (fr) | 2016-10-13 |
US20180113569A1 (en) | 2018-04-26 |
FR3034889A1 (fr) | 2016-10-14 |
FR3034889B1 (fr) | 2017-04-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3281093A1 (de) | Elektronisches armband zur anzeige interaktiver digitaler inhalte zur projektion auf eine zone eines arms | |
FR3053509B1 (fr) | Procede d’occultation d’un objet dans une image ou une video et procede de realite augmentee associe | |
US9864430B2 (en) | Gaze tracking via eye gaze model | |
KR102313256B1 (ko) | 복수의 광원들과 센서들을 사용한 눈 시선 검출 | |
US11330200B2 (en) | Parallax correction using cameras of different modalities | |
EP2999393B1 (de) | Verfahren zur bestimmung von augenmessungen unter verwendung eines verbrauchersensors | |
US10339631B2 (en) | Image demosaicing for hybrid optical sensor arrays | |
ES2742416T3 (es) | Dispositivo y método de imagen corneal | |
US20170102768A1 (en) | Eye gaze tracking using binocular fixation constraints | |
US20180197275A1 (en) | Image demosaicing for hybrid optical sensor arrays | |
CN108352075A (zh) | 使用光流的眼睛跟踪 | |
EP3129849A1 (de) | Systeme und verfahren zur augenverfolgungskalibrierung | |
FR3011952A1 (fr) | Procede d'interaction par le regard et dispositif associe | |
US20110310238A1 (en) | Apparatus and method for inputting coordinates using eye tracking | |
US11451760B2 (en) | Systems and methods for correcting rolling shutter artifacts | |
US9449427B1 (en) | Intensity modeling for rendering realistic images | |
WO2016162539A1 (fr) | Dispositif electronique de projection interactif | |
US20210203910A1 (en) | Switchable fringe pattern illuminator | |
EP3401837A1 (de) | Vorrichtung zum abnehmen von fingerabdrücken | |
EP3145405B1 (de) | Verfahren zur bestimmung von mindestens einem verhaltensparameter | |
US11785199B2 (en) | SPAD array for intensity image capture and time of flight capture | |
WO2022263652A1 (fr) | Procédé de simulation de produits optiques | |
US20210400249A1 (en) | Systems and methods for temporal corrections for parallax reprojection | |
US20220156960A1 (en) | Information processing apparatus, information processing method, and program | |
FR3142589A1 (fr) | Instrumentation des applicateurs de maquillage pour améliorer et partager les techniques d’application |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20171108 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20191101 |