WO2025202048A1 - A wireless intraoral scanner - Google Patents
A wireless intraoral scannerInfo
- Publication number
- WO2025202048A1 WO2025202048A1 PCT/EP2025/057761 EP2025057761W WO2025202048A1 WO 2025202048 A1 WO2025202048 A1 WO 2025202048A1 EP 2025057761 W EP2025057761 W EP 2025057761W WO 2025202048 A1 WO2025202048 A1 WO 2025202048A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- scanner
- intraoral
- intraoral scanner
- scanning station
- establishing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00011—Operational features of endoscopes characterised by signal transmission
- A61B1/00016—Operational features of endoscopes characterised by signal transmission using wireless means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0088—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for oral or dental tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
- A61C9/00—Impression cups, i.e. impression trays; Impression methods
- A61C9/004—Means or methods for taking digitized impressions
- A61C9/0046—Data acquisition means or methods
- A61C9/0053—Optical means or methods, e.g. scanning the teeth by a laser or light beam
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
Definitions
- the disclosure relates to a wireless intraoral 3D scanner for generating a three-dimensional representation of a scanned object.
- 3D dental scanning technology is widely used in dentistry for creating a digital impression of teeth. This technology enables dentists to obtain a detailed and accurate representation of the teeth in a digital format, which can then be used for a variety of applications, including the design and fabrication of dental restorations, orthodontic appliances, and other dental prostheses.
- intraoral scanners To generate the digital impression the use of intraoral scanners has gained increasing popularity to the point where many clinics now own and use not just one, but multiple intraoral scanners shared amongst multiple scanning stations distributed. Further, in recent years, intraoral scanners have moved to interfacing with scanning stations through wireless operational connections rather than wired connections. This in turn, has promoted an increased mobility of the intraoral scanners within the clinic, as moving the scanner no longer involves the hassle of unplugging and re-plugging connection cables.
- An aspect of the present disclosure a method for establishing a wireless operational connection between an intraoral scanner and a scanning station.
- the method comprises detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection.
- the method comprises based on the detection of the user interaction indicative of an intention of establishing a wireless operational connection, broadcasting, by the intraoral scanner, a connection request.
- the method comprises receiving, by the scanning station, the connection request.
- the method comprises outputting, by the scanning station, an indication that the connection request has been received to the user.
- a further aspect of the present disclosure is an intraoral scanner.
- the intraoral scanner comprises a scanner interface configured for detecting a user interaction indicative of an intention to establishing a wireless operational connection.
- the present disclosure further relates to a data processing system, such as the scanner system disclosed herein, comprising one or more processors configured to perform the steps of the method disclosed herein.
- a data processing system such as the scanner system disclosed herein, comprising one or more processors configured to perform the steps of the method disclosed herein.
- the present disclosure further relates to a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method disclosed herein.
- the present disclosure further relates to a computer-readable data carrier having stored thereon said computer program product.
- the present disclosure further relates to a computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the steps of the method disclosed herein.
- wireless operational connection requires not just that the devices in wireless operational connection are connected by a network, e.g. a Wi-Fi network or the internet, but also that a functional communication channel is established over said network. Two devices may thus be connected to the same wireless network, while not being operationally connected to each other, unless a communication channel has been established between them.
- a network e.g. a Wi-Fi network or the internet
- FIG. 1 shows a top-view of an intraoral scanner of the invention
- FIG. 2 shows a perspective view of an intraoral scanner of the invention
- FIG. 5 is a schematic drawing of a scanning network of the invention
- FIG. 8 shows a graphical user interface outputted by a scanning station of the invention
- FIG. 9 shows a graphical user interface outputted by a scanning station of the invention.
- FIG. 10 is a schematic drawing of a intraoral scanner system
- FIG. 17 illustrates an intraoral scanner operating in a cloning connected to a scanning station
- FIG. 18 is a flowchart depicting the steps of a method of the invention.
- FIG. 19 is a flowchart depicting the steps of a method of the invention, and FIG. 20 illustrates different shaking directions of an intraoral scanner of the invention.
- the electronic hardware may include microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, and other suitable hardware configured to perform the various functionality described throughout this disclosure.
- Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
- the scanner employs a triangulation-based scanning principle.
- the scanner may comprise a projector unit and one or more camera units for determining points in 3D space based on triangulation.
- the scanner comprises a projector unit and two or more camera units, wherein the camera units are configured to image the scanned object from separate views, i.e. from different directions.
- the camera units may be configured to acquire a set of images, wherein a correspondence problem is solved within said set of images based on triangulation. The images within the set of images may be acquired by separate camera units of the scanner.
- the intraoral scanner may comprise one or more scan units, wherein each scan unit comprises a projector unit and one or more camera units.
- the scanner may comprise one scan unit comprising one projector unit and at least two camera units.
- the scanner may comprise one scan unit comprising one projector unit and four camera units.
- the scanner may comprise at least two scan units, wherein each scan unit comprises a projector unit and two or more camera units.
- the scanner may comprise at least two scan units, wherein each scan unit comprises a projector unit and four camera units.
- the scan units may in some embodiments be arranged in series to enable an extended or enlarged field of view (FOV) of the intraoral scanner.
- each scan unit may provide a FOV, such that two scan units provide a combined FOV of approximately double the FOV of a single scan unit.
- the intraoral scanner is capable of obtaining surface information by projecting a pattern and translating a focus plane along an optical axis of the intraoral scanner and capturing a plurality of 2D images at different focus plane positions such that each series of captured 2D images corresponding to each focus plane forms a stack of 2D images.
- the acquired 2D images are also referred to herein as raw 2D images, wherein raw in this context means that the images have not been subject to image processing.
- the focus plane position is preferably shifted along the optical axis of the scanner system, such that 2D images captured at a number of focus plane positions along the optical axis form said stack of 2D images (also referred to herein as a sub-scan) for a given view of the object, i.e.
- the result of stitching is the digital 3D representation of a surface larger than that which can be captured by a single sub-scan, i.e. which is larger than the field of view of the 3D intraoral scanner.
- Stitching also known as registration and fusion, works by identifying overlapping regions of 3D surface in various sub-scans and transforming sub-scans to a common coordinate system such that the overlapping regions match, finally yielding the digital 3D model.
- An Iterative Closest Point (ICP) algorithm may be used for this purpose.
- Another example of a intraoral scanner is a triangulation scanner, where a time varying pattern is projected onto the dental object and a sequence of images of the different pattern configurations are acquired by one or more cameras located at an angle relative to the projector unit.
- the process of obtaining surface information in real time of a dental object to be scanned requires the intraoral scanner to illuminate the surface and acquire high number of 2D images.
- a high-speed camera is used with a framerate of 300-20002D frames pr second dependent on the technology and 2D image resolution.
- the high amount of image data needed to be handled by the intraoral scanner to eighter directly forward the raw image data stream to an external processing device or performing some image processing before transmitting the data to an external device or display. This process requires that multiple electronic components inside the scanner is operating with a high workload thus requiring a high demand of current.
- the intraoral scanner comprises one or more light projectors configured to generate an illumination pattern to be projected on a three-dimensional dental object during a scanning session.
- the light projector(s) preferably comprises a light source, a mask having a spatial pattern, and one or more lenses such as collimation lenses or projection lenses.
- the light source may be configured to generate light of a single wavelength or a combination of wavelengths (mono- or polychromatic). The combination of wavelengths may be produced by using a light source configured to produce light (such as white light) comprising different wavelengths.
- the light projector(s) may comprise multiple light sources such as LEDs individually producing light of different wavelengths (such as red, green, and blue) that may be combined to form light comprising the different wavelengths.
- the light produced by the light source may be defined by a wavelength defining a specific color, or a range of different wavelengths defining a combination of colors such as white light.
- the intraoral scanner comprises a light source configured for exciting fluorescent material of the teeth to obtain fluorescence data from the dental object.
- a light source may be configured to produce a narrow range of wavelengths.
- the light from the light source is infrared (I R) light, which is capable of penetrating dental tissue.
- the light projector(s) may be DLP projectors using a micro mirror array for generating a time varying pattern, or a diffractive optical element (DOF), or back-lit mask projectors, wherein the light source is placed behind a mask having a spatial pattern, whereby the light projected on the surface of the dental object is patterned.
- the back-lit mask projector may comprise a collimation lens for collimating the light from the light source, said collimation lens being placed between the light source and the mask.
- the mask may have a checkerboard pattern, such that the generated illumination pattern is a checkerboard pattern. Alternatively, the mask may feature other patterns such as lines or dots, etc.
- Color texture of the dental object may be acquired by illuminating the object using different monochromatic colors such as individual red, green and blue colors or my illuminating the object using polychromatic light such as white light.
- a 2D image may be acquired during a flash of white light.
- the intraoral scanner preferably further comprises optical components for directing the light from the light source to the surface of the dental object.
- the specific arrangement of the optical components depends on whether the intraoral scanner is a focus scanning apparatus, a intraoral scanner using triangulation, or any other type of intraoral scanner.
- a focus scanning apparatus is further described in EP 2 442 720 B1 by the same applicant, which is incorporated herein in its entirety.
- the intraoral scanner may comprise an elongated housing comprising a distal end for being inserted into an oral cavity.
- the housing may be configured to accommodate a number of optical and/or electronic components of the scanner.
- the housing may constitute a rigid outer shell of the scanner.
- the housing may comprise an aperture located in a sidewall of the distal end of the housing.
- the aperture is preferably arranged such that it is located in an optical path of the light projected by the scanner.
- the housing of the scanner comprises two or more parts, such as a fixed part and a replaceable part, which is configured for being replaceably attached to the fixed part of the housing.
- the scanner may comprise a replaceable scanning tip configured for being mounted to the scanner or elongated housing. In that case, the scanning tip may comprise an aperture or window configured to align with a corresponding aperture or window of the elongated housing.
- the intraoral scanner comprises a window arranged at the aperture of the housing and/or of the scanning tip.
- the scanner may comprise a window arranged in the aperture of the housing, wherein the projector unit and window are arranged such that the pattern is projected through the window during use of the scanner.
- at least a region of the window is made of a transparent material, said region located in an optical path of the projected spatial pattern.
- the window may be made of a polymer, such as poly(methyl methacrylate) (PMMA), or a glass material, such as Sapphire glass.
- PMMA poly(methyl methacrylate)
- the window is preferably rigid and planar.
- the window is coated with an antireflective (AR) coating.
- the window may be located in an optical path of the scanner, i.e., located such that the projected pattern of light is projected through the window during use of the scanner.
- the intraoral scanner may comprise one or more projector units. Some or all of said projector unit(s) may be configured to project a predefined spatial pattern through the aperture and onto at least a part of the surface of a three-dimensional object.
- a projector unit may be understood herein as a device configured for projecting light onto a surface, such as the surface of a three-dimensional object.
- the projector unit is configured to project a pattern of light, such as the spatial pattern, onto the surface of a three- dimensional object, such as a dental object.
- the projector unit is configured to project a pattern of light such that the spatial pattern is, within a given tolerance, in focus at a predefined focus distance or range, when measured along a projector optical axis.
- the spatial pattern may be in an acceptable focus within a given focus range.
- the projector unit may be configured to project unpolarized light.
- the projector unit may be selected from the group of: Digital Light Processing (DLP) projectors using a plurality of digital micromirror devices (DMD) arranged in a matrix or array, or diffractive optical elements (DOE), or front-lit reflective mask projectors, or micro-LED projectors, or Liquid crystal on silicon (LCoS) projectors or back-lit mask projectors, wherein a light source is placed behind a mask having a spatial pattern.
- the pattern may be dynamic, i.e. such that the pattern changes over time, or the pattern may be static in time, i.e. such that the pattern remains the same over time.
- An advantage of projecting a static pattern is that it allows the capture of all the image data simultaneously, thus preventing warping due to movement between the scanner and the object.
- the projector unit may comprise one or more collimation lenses for collimating the light from the light source.
- the collimation lens(es) may be placed between the light source and a mask in a back-lit mask projector unit.
- some or all of the one or more collimation lenses are Fresnel lenses.
- the projector unit may further comprise one or more focus lenses configured for focusing the projected spatial pattern at a predefined focus range.
- the projector focus lenses may define a projector optical axis.
- the projector unit of the scanner comprises at least one light source and a pattern generating element for defining a pattern of light.
- the pattern generating element is preferably configured for generating a light pattern to be projected on a surface of an object.
- the pattern generating element may be a mask having a spatial pattern.
- the projector unit may comprise a mask configured to define a pattern of light.
- the mask may be placed between the light source of the projector unit and the one or more focus lenses, such that light transmitted through the mask is patterned into a spatial pattern.
- the mask may define a polygonal pattern comprising a plurality of polygons, such as a checkerboard pattern.
- the pattern generating element is based on diffraction and/or refraction to generate the light pattern, such as a pattern comprising an array of discrete unconnected dots.
- the projector unit is configured to generate a predefined static pattern, which may be projected onto a surface.
- the projector unit may be configured to generate a dynamic pattern, which changes in time, i.e., a time-varying pattern.
- the projector unit may be associated with its own projector plane, which is determined by the projector optics.
- the projector plane may be understood as the plane wherein the mask is contained.
- the projector plane comprises a plurality of pattern features of the projected pattern.
- the projector unit may comprise one or more light sources.
- the projector unit may be configured to project a spatial pattern of light defined by a plurality of projector rays when the light source(s) are on/active.
- the projector unit may be configured for sequentially turning the light source on and off at a predetermined frequency, wherein the light source is on for a predetermined time period.
- the light source(s) may be configured to generate light of a single wavelength, i.e. at narrow band centered at a wavelength, or a combination of wavelengths (mono- or polychromatic).
- the combination of wavelengths may be produced by a light source configured to produce light comprising different wavelengths, or a range of wavelengths (such as white light).
- the light source may be configured to generate unpolarized light, such as unpolarized white light.
- each projector unit comprises a light source for generating white light.
- white light enables the scanner to acquire data or information relating to the surface geometry and to the surface color simultaneously. Consequently, the same set of images can be used to provide both geometry of the object, e.g. in terms of 3D data / a 3D representation, and color of the object. Hence, there is no need for an alignment of data relating to the recorded surface geometry and data relating to the recorded surface color in order to generate a digital 3D representation of the object expressing both color and geometry of the object.
- the projector unit may comprise multiple light sources such as LEDs individually producing light of different wavelengths (such as red, green, and blue) that may be combined to form light comprising different wavelengths.
- the light produced by the light source(s) may be defined by a wavelength defining a specific color, or a range of different wavelengths defining a combination of colors such as white light.
- the light source is a diode, such as a white light diode, or a laser diode.
- the projector unit comprises a laser, such as a blue or green laser diode for generating blue or green light, respectively.
- a more efficient projector unit can be realized, which enables a faster exposure compared to utilizing e.g. a white light diode.
- the scanner comprises a light source configured for exciting fluorescent material to obtain fluorescence data from the dental object such as from teeth.
- the scanner comprises one or more infrared light sources, configured to generate wavelengths in the infrared range, such as between 700 nm and 1.5 pm.
- the scanner comprises one or more light sources selected from the group of: Infrared (IR) light source, near-infrared (NIR) light source, blue light source, violet light source, ultraviolet (UV) light source, and/or combinations thereof.
- IR Infrared
- NIR near-infrared
- UV ultraviolet
- the scanner comprises a first light source forming part of the projector unit, and one or more second light sources, e.g.
- Some of the light sources may be utilized for diagnostic purposes, such as for aiding in the detection of regions of caries or plaque.
- the spatial pattern may be generated using a pattern generating element, e.g. located in the projector unit.
- the pattern generating element may be a mask, such as a transparency or transmission mask, having a spatial pattern.
- the mask may be a chrome photomask.
- the pattern generating element is configured to utilize diffraction and/or refraction to generate a light pattern.
- the use of a pattern of light may lead to a correspondence problem, where a correspondence between points in the light pattern and points seen by the camera unit(s) viewing the pattern needs to be determined.
- the correspondence problem is solved jointly for groups of projector rays emanating from the projector unit.
- the spatial pattern may be a polygonal pattern comprising a plurality of polygons.
- the polygons may be selected from the group of: triangles, rectangles, squares, pentagons, hexagons, and/or combinations thereof. Other polygons can also be envisioned. In general, the polygons are composed of edges and corners.
- the polygons are repeated in the pattern in a predefined manner.
- the pattern may comprise a plurality of repeating units, wherein each repeating unit comprises a predefined number of polygons, wherein the repeating units are repeated throughout the pattern.
- the pattern may comprise a predefined arrangement comprising any one or more of: stripes, squares, dots, triangles, rectangles, and/or combinations thereof.
- the pattern is non-coded, such that no part of the pattern is unique.
- the generated pattern of light is a polygonal pattern, such as a checkerboard pattern comprising a plurality of checkers. Similar to a common checkerboard, the checkers in the pattern may have alternating dark and bright areas corresponding to areas of low light intensity (dark) and areas of high(er) light intensity (bright).
- the pattern of light is a checkerboard pattern comprising alternating squares of dark and bright light.
- the light pattern comprises a distribution of discrete unconnected spots of light.
- the spatial pattern preferably comprises a plurality of pattern features.
- the pattern features may be arranged in a regular grid. In some embodiments of the presently disclosed scanner, the total number of pattern features in the pattern is at least 1000, preferably at least 3000, more preferably at least 10000, even more preferably at least 15000.
- the acquired images of the object will similarly comprise a plurality of pattern features corresponding to the projected pattern features.
- a pattern feature may be understood as an individual well-defined location in the pattern or in the image. Examples of pattern features include corners, edges, vertices, points, transitions, dots, stripes, etc.
- the pattern features comprise the corners of checkers in a checkerboard pattern. In other embodiments, the pattern features comprise corners in a polygon pattern such as a triangular pattern.
- the intraoral scanner may comprise one or more camera units configured to acquire one or more two-dimensional images of the three-dimensional object. Preferably, at least a part of the spatial pattern is present in the images.
- a camera unit may be understood herein as a device for capturing an image of an object.
- Each camera unit may comprise an image sensor for generating an image based on incoming light e.g. received from an illuminated 3D object.
- the image sensor may be an electronic image sensor such as a charge-coupled device (CCD) or an activepixel sensor (CMOS sensor).
- the image sensor is a global shutter sensor configured to expose the entire image area (all pixels) simultaneously and generate an image in a single point in time.
- the image sensor is a rolling shutter sensor.
- the image sensor(s) may comprise an array of pixels, wherein each pixel is associated with a corresponding camera ray.
- the array of pixels may be a two-dimensional (2D) array.
- Each pixel may be covered by a micro lens.
- the image area, i.e. the 2D array of pixels is rectangular or quadratic.
- the image sensor is a CMOS sensor comprising an analog-to-digital converter (ADC) for each column of pixels, making conversion time significantly faster and allowing each camera unit to benefit from greater speed.
- ADC analog-to-digital converter
- Each image sensor may define an image plane, which is the plane that contains the object’s projected image.
- Each image obtained by the image sensor(s) may comprise a plurality of pattern features originating from a projected pattern comprising a plurality of such pattern features.
- one or more of the camera units comprise a light field camera.
- each camera unit defines a camera optical axis.
- the camera units may further comprise one or more focus lenses for focusing light.
- the image sensor is a monochrome image sensor, wherein each pixel is associated with a single color channel, e.g. is a grayscale color channel, wherein the value of each pixel represents only an amount of light.
- the image sensor is a color image sensor or an image sensor comprising a color filter array on the array of pixels.
- the color filter array may be a Bayer filter employing an arrangement of four color filters: Red (R), Green (G), Green (G), and Blue (B).
- the Bayer filter may also be referred to as an RGGB filter.
- color pixels may be combined to monochrome pixels of 2 x 2 color pixels for 3D depth reconstruction. In this case, the resolution of the 3D depth reconstruction is only half the resolution of the image sensor in each direction.
- the full native resolution is preferably utilized (with color filtered pixels).
- the projector optical axis and the camera optical axis, or axes are non-parallel.
- the projector optical axis and the camera optical axis of at least one camera unit may define a camera-projector angle of approximately 5 to 15 degrees, preferably approximately 5 to 10 degrees. All of the camera units may be angled similarly with respect to the projector unit, such that each camera optical axis defines approximately the same angle with the projector optical axis.
- the camera units are defocused at the opening of the probe of the scanner and/or at the surface of an optical window in said probe. In preferred embodiments of the scanner, the camera units and projector unit of a given scan unit are focused at the same distance.
- Each camera unit may comprise one or more focus lenses for focusing light onto the image sensor of the given camera unit.
- each camera unit comprises two or more lenses assembled in a camera lens stack.
- the purpose of the focus lenses may be to define or ensure a predetermined focus distance, or working distance, of the camera unit.
- the camera focus lenses may further define the camera optical axis.
- the scanner comprises two or more camera units configured for acquiring a set of images comprising at least one image from each camera unit, wherein each image includes at least a portion of the projected pattern.
- the images within the set of images are acquired simultaneously.
- the number of images in the set of images may preferably correspond to the number of camera units, wherein each camera unit contributes one image to the set of images.
- the 3D scanner system may comprise one or more processors configured to generate a 3D representation based on the set of images, e.g. by identifying pattern features in the set of images and determining points in 3D space based on triangulation. Some of the processors may be located on the scanner and/or some may be located on an external computer.
- the 3D representation may be generated continuously during a scanning session, and/or it may be generated in real-time.
- the 3D scanner system may further comprise a display for displaying the 3D representation. The rendering of the 3D representation and the display of said representation may further occur in realtime, or perceived real-time to the user.
- the 3D scanner system i.e. a system comprising one or more intraoral scanner(s) and one or more scanning station(s), may comprise one or more processors operationally connected to the intraoral scanner, wherein said processors are configured to generate a 3D representation of a scanned object.
- a 3D representation may be understood herein as a digital representation of a three- dimensional object’s external geometry and shape.
- the 3D representation may represent only a part of the object’s geometry and shape.
- the 3D representation may comprise a collection of points and/or polygons that collectively define the object’s surface.
- the 3D representation may be selected from the group of: a point cloud, a signed distance field, a triangulated point cloud, a collection of point clouds optionally with additional information such as uncertainty estimates or color(s), a collection of triangulated point clouds, a polygon mesh, a volumetric representation such as a voxel model, a parametrized surface, a surface elements model, or any other suitable three- dimensional representational model.
- each point may be defined by its three-dimensional coordinates (x, y, z) in a Cartesian coordinate system.
- the points may form part of a surface mesh, such as a polygon mesh.
- the 3D representation is a triangle mesh comprising a set of triangles connected by their common edges or vertices.
- the collection of points and/or the surface mesh may be used to create a visual representation of the object, which can be rendered on a computer screen.
- the method comprises detecting, by the scanning station, a user interaction indicative of approval of establishing the wireless operational connection.
- the detecting of the user interaction indicative of approval of establishing the wireless operational connection is done using the scanning station interface, preferably using one or more of a mouse, a keyboard, microphone, camera, or a touchscreen.
- the user interaction indicative of approval of establishing the wireless operational connection is a user interaction which the scanning station is configured to associate with an instruction to approve the connection request.
- the scanning station may be configured to, by a camera of the scanning station, observe the user performing the user interaction indicative of the intention of establishing a wireless operational connection and associate the observation with the approval.
- the method comprises establishing the wireless operational connection between an intraoral scanner and a scanning station, after which that scanner and scanning station becomes linked and a scanning session may be performed.
- the second method may comprise steps from the first method, e.g. also comprise detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection to initiate the detection of the distance or position.
- the method comprises capturing, by the intraoral scanner, multiple 2D images for the provision of image data.
- the method comprises detecting, by the intraoral scanner, movement of the intraoral scanner for the provision of movement data.
- the method comprises generating, by the scanning station, 3D representation data based on the image data.
- the method comprises generating, by the scanning station, output data based on the 3D representation data.
- the method comprises determining which of the multiple output devices is a selected output device based on the movement data.
- the method comprises.
- the method comprises outputting the output data to the selected output device.
- a data processing system such as the intraoral scanner system, comprising one or more processors configured to perform the steps of this method.
- a computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of this method.
- the multiple output devices may comprise one or more of the following: one or more display(s), one or more data storage devices, e.g. hard drive(s), local server(s) and remote server(s), one or more other scanning station(s), or one or more computer(s).
- the output interface may comprise one or more wired output ports comprising one or more of the following: one or more display port(s), e.g. HDMI, DisplayPort, DVI, and VGA port(s), one or more network port(s), e.g. ethernet port(s), or one or more data exchange port(s), e.g. USB and Thunderbolt port(s).
- the output interface may comprise a second wireless interface to connect the scanning station to a scanner network which at least some of the multiple output devices are connected to.
- selecting an output device may be performed by the user performing a swipe with their hand while holding the scanner, in a direction from the scanning station or the first display towards the desired output device.
- the scanner will detect this movement and generate movement data representing the detected movement, and transfer the movement data to the scanning station.
- the scanning station may then read the movement data and set an output device corresponding to the direction of the swipe as the selected output device.
- the multiple output devices may comprise a second display, wherein the scanning station is configured for changing between a first display mode, in which the first display is used as the main display, and a second display mode, in which the second display is used as the main display.
- Providing multiple displays for a scanning station may have multiple advantages, it may allow the user to switch from working on one side of the patient to the other side of the patient while still having a display at a natural viewing angle, or it may allow the user to share the result of the scanning with the patient or a colleague on a second, larger display.
- the scanning station may be configured for, when changing from the second display mode to the first display mode, putting the second display into a reduced power mode, such as an idle or off mode.
- the scanning station may be configured for, when changing from the first display mode to the second display mode, putting the second display from a reduced power mode, such as an idle or off mode, into an active mode.
- the first display will often be a display attached to the scanning station
- the second display may be a temporary display, i.e. a display used occasionally for shorter time periods.
- the scanner interface may further comprise one or more buttons configured for detecting a user interaction indicative of an intention of selecting an output device.
- the scanning station may then be configured for determining which of the multiple output devices is the selected output devices based on the detection of the user interaction indicative of selecting an output device. Combining the gesture-based selection of the output device with a requirement that the user also performs a user interaction indicative of an intention of selecting an output device may reduce the risk of detecting false positives, i.e. the user accidentally performing a movement associated with selection of an output device. It may thus be advantageous to only perform selection of an output device after the user has pushed a distinct button sequence or while they are holding down a button.
- the movement data may comprise data indicating one or more of the following: a movement direction, movement distance, movement speed, rotation direction, or rotation speed of the intraoral scanner.
- the determination of which of the multiple output devices is the selected output device based on the movement data may require the movement data indicating that the scanner has moved beyond an initiation distance threshold and/or faster than an initiation speed threshold.
- the initiation distance threshold may prevent the user from accidentally triggering a selection of an output device while operating the scanner, e.g. while scanning a patient.
- the initiation speed threshold may prevent the user from accidentally triggering a selection of an output device while moving the scanner about.
- the scanning station may be configured for determining whether the movement data fulfills an output device criterion for each of the multiple output devices and if the movement data fulfills one of the output device criteria setting the output device associated with the fulfilled criterion as the selected output device.
- the output device criterion for each output device may be a default setting or it may be a setting defined by the user.
- the scanning station may further be configured for translating the movement data into movement of a selection tool in a graphical user interface, such as a cursor shown on the first display.
- the output device criteria are boundary conditions on the first display, and wherein an output device criterion is fulfilled when the cursor is moved past the boundary condition associated with that output device criterion.
- the boundary conditions may be customized by the user so that a position in the GUI of a boundary associated with a particular output device may reflect the user’s preferences or the particular output device position relative to the first display, e.g. a boundary associated with a second display arranged to the right of the first display may be set on the right edge of the first display while a boundary associated with cloud storage may be set on the upper edge of the first display.
- Disclosed herein is also a method for cloning configuration settings of an intraoral scanner, i.e. a source scanner, to another intraoral scanner, i.e. a destination scanner.
- intraoral scanners are fairly advanced electronic devices, they will often have one or more configuration settings stored in the memory of the scanner.
- Configuring a new wireless scanner to use a new network can be a cumbersome and convoluted process.
- New network credentials may have to be transferred to the new scanner through either an already known network or some other wireless technology such as Bluetooth or NFC.
- scanners can have user settings that affect their behaviour. Duplicating these settings on multiple scanners will also take time. If multiple scanners need to be configured, the entire process must be repeated for each scanner and can be quite time-consuming.
- an intraoral scanner comprising an optical system having a projector unit and a camera unit, a memory configured for storing configuration settings, a processing unit configured for operating based on the configuration settings, a scanner interface configured for detecting user interactions, and a first wireless interface.
- the intraoral scanner being configured for operating in a cloning mode.
- the intraoral scanner In the cloning mode the intraoral scanner is in one of the following two sub-modes: a source scanner cloning mode or a destination scanner cloning mode.
- the intraoral scanner is configured for generating one or more configuration setting data package(s) based on the configuration settings, and transmitting the one or more configuration settings data package(s) via the first wireless interface to another intraoral scanner.
- the intraoral scanner is configured for receiving one or more configuration setting data package(s) via the first wireless interface from another intraoral scanner or from a scanning station, and updating the configuration settings based on the received one or more configuration setting data package(s).
- a computer program product comprising instructions which, when the program is executed by an intraoral scanner, cause the intraoral scanner to carry out the steps of this method.
- cloning configuration settings of an intraoral scanner may be initiated by a user interaction indicative of an intention of cloning detected by the scanner interface of one or both of the source scanner and the destination scanner, such as pressing specific buttons, possibly while powering on the devices.
- This may initiate a cloning mode of the scanners, wherein a private wireless connection between the two scanners, e.g., using Bluetooth, NFC, or other wireless protocols, using the first wireless interfaces of the scanners is established.
- the configuration settings would then be transferred from the source scanner to the destination scanner, and the destination scanner would then reboot.
- the source scanner and the destination scanner may support wireless technology where a scanner- to-scanner connection can be established.
- this connection should operate independently of the primary wireless connection used to connect to a scanning station or scanning network, so that the destination scanner can be cloned without the source scanner losing any pre-existing connection to a scanning station.
- the scanner-to-scanner connection may be a secure and encrypted wireless connection, since network credentials and other potential private information will be cloned. Authentication may also be used to prevent the cloning process from being triggered by unauthorized devices.
- the source scanner may generate configuration setting data packages comprising error detection data and/or error correction data.
- the error detection data e.g. a cyclic redundancy check, CRC
- CRC cyclic redundancy check
- the error correction data e.g. repetition copies of the configuration settings, allows the destination scanner to correct errors in the received configuration setting data packages, if such are detected.
- the intraoral scanner comprises a scanner interface having one or more buttons 118, e.g. two buttons in the shown embodiment.
- the scanner interface is configured for providing user control of one or more of the following: scanning operations, establishing a wireless operational connection, disconnecting a wireless operational connection, controlling a scanner station 200, i.e. providing input means for a scanner station 200, or switching between available scanner stations.
- the buttons can as an example comprise one or more of the following: a push button, a dial switch, touch interface, e.g., on a scanner display.
- Fig. 2 shows a perspective view of an intraoral scanner 100 as shown in Fig. 1.
- Fig. 3 shows a block diagram of an intraoral scanner 100 as shown in Fig. 1 and 2.
- the scanner 100 comprises an optical system 108 comprising a projector unit having one or more light source(s) configured for providing light for illuminating the object to be scanned and a camera unit having one or more image sensor(s) configured for capturing light coming off the object being scanned.
- the one or more light source(s) may comprise one or more of the following: an infrared, IR, light source, a near infrared, NIR, light source, a monochromatic visible light source, a polychromatic visible light source, a white light source, or an ultraviolet, UV, light source.
- the term visible refers to band of the electromagnetic spectrum that the human eye can perceive, typically about 380nm to 750nm.
- the scanner 100 comprises a processing unit 110 configured for executing control and input/output operations of the scanner 100.
- the processing unit 110 is operatively connected to the optical system whereby the processing unit 110 may control the optical system 108 during the scanning process and receive image data captured by the optical system 108.
- the processing unit 110 may comprise some or all of the one or more processors for generating the 3D representation.
- the processing unit 110 may be configured for performing preprocessing of the image data captured by the optical system and the 3D representation may be generated based on the pre-processed image data.
- the scanner 100 may comprise a memory 124 configured for storing one or more of the following: user settings, control and input/output operations of the scanner 100, one or more encryption key(s), or image data.
- the scanner 100 comprises a wireless interface, referred to herein as the first wireless interface, configured for providing a wireless link between the scanner 100 and a scanning station 200, a network and/or another intraoral scanner.
- the first wireless interface comprises a wireless communication unit 112, such as a radio, a transmitter, a transmitter-receiver pair, or a transceiver, coupled to one or more antennas 114.
- the one or more antennas 114 may comprise multiple antennas configured for operation in different frequency bands, e.g.
- antenna configured for operation in a frequency band centered at 2.45GHz and another antenna configured for operation in a frequency band centered at 5.8GHz, and/or polarizations, e.g., an antenna configured for operation at a first polarization and another antenna configured for operation at a second polarization substantially orthogonal to the first polarization.
- the wireless communication unit 112 is operatively connected to the processing unit 110, whereby the wireless communication unit 112 may receive the image data, the pre-processed image data, or data comprising the 3D representation from the processing unit 110 and transmit said data to a scanning station using the one or more antennas 114. Furthermore, the scanner may receive data via the first wireless interface, e.g. command data from a scanning station 200. Additionally, the wireless interface may transmit/receive further data as will be explained in greater detail below.
- the scanner 100 comprises an energy source 116, such as a rechargeable battery.
- the energy source 116 may be replacably mounted in the scanner 100 in an energy source slot 124 configured to receive and retain the energy source 116.
- the energy source 116 provides energy to the electrical components of the scanner 100, e.g., the first wireless interface, the processing unit 110, the optical system 108, the scanner interface, etc..
- the scanner interface may comprise one or more movement sensor(s) 120 configured to detect movement of the scanner 100.
- the one or more movement sensor(s) may comprise one or more of the following: an accelerometer, a gyroscope, or a magnetometer.
- the one or more movement sensor(s) may be configured for detecting linear movement and/or rotational movement of the scanner 100.
- the scanner interface may comprise a location determination unit 122 configured for enabling determination of a position of the scanner 100 either in relation to a scanning station 200 or an actual position, e.g. in terms of coordinates or a position within the clinic the scanner 100 is associated with.
- the location determination unit 122 may comprise a location detector, so that the scanner 100 can detect its location, and/or location emitter, so that the scanner 100 can emit a location signal whereby other devices, e.g. a scanning station 200, may detect the location of the scanner 100.
- Fig. 4 shows a scanning network 250 comprising multiple scanners 100, e.g. three as shown, and multiple scanning stations 200, e.g. three as shown.
- the scanning stations 200 may be connected to the scanning network 250 through wired connections and/or wireless connections.
- Some or all of the scanning stations 200 may be configured to be stationary, e.g. a desktop computer or a stationary display, and may therefore omit a wireless connection.
- Some or all of the scanning stations 200 may be configured to be movable, e.g. a laptop or tablet, in which case they will comprise a second wireless interface to connect to the scanning network 250.
- the scanning network 250 may be connected to one or more local server(s) 210 and/or to a cloud network 220.
- the one or more local server(s) 210 and/or the cloud network 220 may comprise some or all of the one or more processors which generates the 3D representation, whereby processes requiring larger amounts of computing power may be performed on the one or more local server(s) 210 and/or the cloud network 220.
- the one or more local server(s) 210 and/or the cloud network 220 may comprise data storage, whereby image data and other data requiring larger amounts of data storage space may be stored on the one or more local server(s) 210 and/or the cloud network 220. This may lessen the computing and storage requirements of the scanning station 200.
- Fig. 5 shows a scanning network 250 comprising a scanner 100 and two scanning stations 200, each scanning station 200 having a computer 202 and a display 204, which may be combined in one device, i.e. a laptop.
- the scanner 100 may only be operationally connected to one of the two scanning stations 200 at a time, so if the scanner 100 is switched between the scanning stations 200 or paired with the scanning network 250 for the first time the user has to perform actions to do so.
- Fig. 6 shows a flowchart of a method of the invention which simplifies such connection and pairing processes.
- a user interaction indicative of an intention of establishing a wireless operational connection i.e. the user wanting to operationally connect the scanner 100 to a scanning station 200, is detected 300. This is detected using the scanner interface which has a preset interaction associated with the user wanting to establish the wireless operational connection.
- the user interaction indicative of an intention of establishing a wireless operational connection may be a user interaction with the one or more button(s) 118, e.g. pushing a dedicated connection button or pushing a multi-purpose button in a unique pattern such as a double click or prolonged press.
- a connection request is broadcasted 302 by the scanner 100 using the first wireless interface. Subsequently, the scanning request is received 304 by the scanning stations 200.
- the connection request may be received directly by the second wireless interface of the scanning stations 200 or it may first be received by a wireless network node 230 which will then distribute the connection request to the scanning stations 200 in the scanning network 250.
- the scanning stations 200 Upon receiving 304 the connection request, the scanning stations 200 will output 306 an indication that the connection request has been received.
- the output may be performed visually using a display of the respective scanning station 200, in which case the indication will be presented in a Graphical User Interface, GUI, 400.
- the indication is presented alongside a visual representation of the scanner 100 which broadcasted the connection request.
- the visual representation of the scanner 100 may one or more of the following presented in the GUI 400: text identifying the scanner 100, a photo of the model of the scanner 100, or an animation of the scanner 100.
- the output may be performed audibly using a speaker of the respective scanning station 200, in which case the scanning station 200 will emit an acoustic signal comprising information that the connection request has been received, e.g. a speech signal.
- the scanning station 200 When outputting 306 the indication that the connection request has been received, the scanning station 200 will detect 308 for a user interaction indicative of approval of establishing the wireless operational connection. This may be done by presenting an option to accept the connection request in the GUI 400 and taking an input from the user, e.g. an input using a keyboard of the scanning station 200, or a user interaction with the GUI 400, e.g. pushing a virtual button to accept or pushing the visual representation of the scanner 100. If the user declines or omits to accept the connection request, the process of establishing the wireless operational connection may be terminated 314 without establishing the wireless operational connection.
- the process of associating that scanning station 200 and the scanner 100 that broadcasted the connection request proceeds. This may involve establishing 310 a secure connection comprising one or more of the following: a challenge request to verify the scanner, short-term key distribution, or long-term key distribution.
- the wireless operational connection is established 312 by opening a communication channel between the scanner 100 and the scanning station 200. This will allow the scanner 100 to transmit image data and/or preprocessed image data to the scanning station 200, whereby the user may have a substantially real-time view of the current field of view of the scanner 100 to help the user navigate and maneuver the scanner 100 inside the oral cavity of the patient. Also, the image data and/or preprocessed image data may be used to generate the 3D representation.
- Fig. 7 shows a process chart of the method described in connection with Fig. 6.
- the scanning station In response to receiving the connection request from a scanner 100, the scanning station optionally respond by issuing a challenge request to verify the scanner 100. After receiving the challenge request, the scanner may reply by transmitting a challenge response via the first wireless interface. If the challenge response is accepted by the scanning station 200, the scanning station may proceed to output the indication that the connection request has been received and await acceptance or dismissal from the user.
- the challenge request may comprise an action required to be performed on the scanner 100 and the required action may be outputted at the scanning station 200.
- the action required to be performed on the scanner 100 may be a push sequence of the one or more buttons 118 and/or moving the scanner 100 in a specific movement pattern, e.g. moving the scanner 100 in a counterclockwise circular motion, which is detected by the one or more movement sensor(s) 120.
- the required action may be outputted visually on a display of the scanning station 200 and/or audibly from a speaker of the scanning station 200. This makes it more difficult to establish an unauthorized connection to a scanning station 200 as one must be in proximity of the scanning station 200 to perceive the outputted solution to the challenge request in order to complete the action required to be performed on the scanner 100.
- the challenge request may comprise a request for a scanner certificate and the challenge request may be the scanner certificate.
- the challenge may thereby be at least partly completed upon verification, by the scanning station 200, of the scanner certificate.
- the scanner certificate may be stored in the memory 124 of the scanner 100 where it may have been put at a time of manufacture of the scanner 100.
- Verification of the scanner certificate may comprise validating the scanner certificate by comparing it to a comparison certificate obtained from a webserver, e.g. a webserver of the manufacturer of the scanner 100.
- the challenge request may comprise the scanner 100 and the scanning station 200 being within a certain distance of each other, i.e. below a connection proximity threshold, detected using the location determination unit 122 of the scanner 100.
- a proximity threshold as a limitation for establishing a wireless operational connection, it is made harder to establish an unauthorized connection to the scanning station 200, as scanner 100 must be in the vicinity of the scanning station 200 in order establish the wireless operational connection.
- the proximity threshold may be set by geofencing such that the scanner 100 must be within a geofence defining the clinic to which the scanner 100 is associated, whereby a wireless operational connection to the scanning station 200 may only be established if the scanner 100 is located in the clinic.
- An intraoral scanner system comprising:
- a scanner interface configured for detecting a user interaction indicative of an intention to establishing a wireless operational connection
- a scanning station comprising:
- the intraoral scanner system of items 10 or 11 wherein the user interaction indicative of an intention to establishing the wireless operational connection comprises a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection, and wherein the scanner interface comprises one or more movement sensor(s) configured for detecting the movement pattern.
- the movement pattern is a shake of the intraoral scanner.
- a data processing system such as an intraoral scanner system, comprising one or more processors configured to perform the steps of the method of any of items 1-9.
- a method for establishing a wireless operational connection between an intraoral scanner and a scanning station of multiple scanning stations comprising:
- the location determination unit comprises one or more location sensor(s) configured for transmitting a position signal and/or one or more location beacon(s) configured for detecting a location of the scanner.
- processor(s) configured for generating 3D representation data based on the image data
- an output interface configured for being connected to multiple output devices, the output interface being configured for providing output data based on the 3D representation data to a selected output device amongst the multiple output devices
- the scanning station is configured for determining which of the multiple output devices is the selected output device based on the movement data.
- the multiple output devices comprise a second display, wherein the scanning station is configured for changing between a first display mode, in which the first display is used as the main display, and a second display mode, in which the second display is used as the main display.
- the scanning station is configured for, when changing from the second display mode to the first display mode, putting the second display into a reduced power mode, such as an idle or off mode.
- the intraoral scanner system of items 38 or 39 wherein the scanning station is configured for, when changing from the first display mode to the second display mode, putting the second display from a reduced power mode, such as an idle or off mode, into an active mode.
- a reduced power mode such as an idle or off mode
- the intraoral scanner system of any of items 37-41 wherein the movement data comprises data indicating one or more of the following: a movement direction, movement distance, movement speed, rotation direction, and rotation speed of the intraoral scanner.
- a method for selecting an output device in an intraoral scanner system comprising an intraoral scanner, a scanning station, and multiple output devices, the method comprising:
- changing from the second display mode to the first display mode comprises putting the second display into a reduced power mode, such as an idle or off mode.
- determining which of the multiple output devices is a selected output device based on the movement data is further based on the detection of the user interaction indicative of selecting an output device.
- the movement data comprises data indicating one or more of the following: a movement direction, movement distance, movement speed, rotation direction, and rotation speed of the intraoral scanner.
- a data processing system such as an intraoral scanner system, comprising one or more processors configured to perform the steps of the method of any of items 46-54.
- a computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of the method of any of items 46-54.
- - a memory configured for storing configuration settings
- processing unit configured for operating based on the configuration settings
- a scanner interface configured for detecting user interactions
- the intraoral scanner is configured for operating in a cloning mode, in which the intraoral scanner is in one of the following two sub-modes:
- a source scanner cloning mode in which the intraoral scanner is configured for generating one or more configuration setting data package(s) based on the configuration settings, and transmitting the one or more configuration settings data package(s) via the first wireless interface to another intraoral scanner, and
- the intraoral scanner is configured for receiving one or more configuration setting data package(s) via the first wireless interface from another intraoral scanner or from a scanning station, and updating the configuration settings based on the received one or more configuration setting data package(s).
- the intraoral scanner of item 61 wherein the scanner interface comprises one or more movement sensor(s), and wherein the intraoral scanner is configured for entering the cloning mode in the source scanner cloning mode upon detecting a first movement pattern.
- the intraoral scanner of item 64 wherein the intraoral scanner is configured for entering the cloning mode in the destination scanner cloning mode upon detecting a second movement pattern.
- the intraoral scanner of any of items 57-68 wherein the intraoral scanner comprises a location determination unit configured for detecting a distance to the other intraoral scanner or scanning station, wherein the intraoral scanner is configured for only entering the cloning mode when the detected distance is below a cloning proximity threshold.
- a method for cloning configuration settings onto an intraoral scanner comprising: establishing a wireless operational connection between the intraoral scanner and another intraoral scanner or a scanning station; initiating a cloning mode of the intraoral scanner; - receiving one or more configuration setting data package(s) from the other intraoral scanner or from the scanning station; and
- a data processing system such as an intraoral scanner, comprising one or more processors configured to perform the steps of the method of any of items 70-79.
- a computer program product comprising instructions which, when the program is executed by an intraoral scanner, cause the intraoral scanner to carry out the steps of the method of any of items 70-79.
- 606 issuing a challenge request by the scanning station determined to be the closest to the intraoral scanner
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Theoretical Computer Science (AREA)
- Molecular Biology (AREA)
- General Business, Economics & Management (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Dentistry (AREA)
- Optics & Photonics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)
Abstract
Disclosed is a method for establishing a wireless operational connection between an intraoral scanner and a scanning station. The method comprises detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection. The method comprises based on the detection of the user interaction indicative of an intention of establishing a wireless operational connection, broadcasting, by the intraoral scanner, a connection request. The method comprises receiving, by the scanning station, the connection request. The method comprises outputting, by the scanning station, an indication that the connection request has been received to the user.
Description
A WIRELESS INTRAORAL SCANNER
Technical field
The disclosure relates to a wireless intraoral 3D scanner for generating a three-dimensional representation of a scanned object.
Background
3D dental scanning technology is widely used in dentistry for creating a digital impression of teeth. This technology enables dentists to obtain a detailed and accurate representation of the teeth in a digital format, which can then be used for a variety of applications, including the design and fabrication of dental restorations, orthodontic appliances, and other dental prostheses.
To generate the digital impression the use of intraoral scanners has gained increasing popularity to the point where many clinics now own and use not just one, but multiple intraoral scanners shared amongst multiple scanning stations distributed. Further, in recent years, intraoral scanners have moved to interfacing with scanning stations through wireless operational connections rather than wired connections. This in turn, has promoted an increased mobility of the intraoral scanners within the clinic, as moving the scanner no longer involves the hassle of unplugging and re-plugging connection cables.
Both the increase in the number of intraoral scanners used by each clinic and the increased mobility of each intraoral scanner within the clinic has prompted the issue of determining which particular scanner should be connected to which particular scanning station at a given moment. Thus, there is a need for providing an improved way of connecting an intraoral scanner to a scanning station.
Summary
An aspect of the present disclosure a method for establishing a wireless operational connection between an intraoral scanner and a scanning station. The method comprises detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection. The method comprises based on the detection of the user interaction indicative of an intention of establishing a wireless operational connection, broadcasting, by the intraoral scanner, a connection request. The method comprises receiving, by the scanning station, the connection request. The method comprises outputting, by the scanning station, an indication that the connection request has been received to the user.
A further aspect of the present disclosure is an intraoral scanner. The intraoral scanner comprises a scanner interface configured for detecting a user interaction indicative of an intention to establishing a wireless operational connection. The intraoral scanner comprises a processing unit configured for, upon detection of the user the user interaction indicative of an intention to establishing a wireless operational connection, entering a connection mode of the intraoral scanner. The intraoral scanner comprises a first wireless interface configured for, when in the intraoral scanner is in the connection mode, broadcasting a connection request.
A further aspect of the present disclosure is a 3D dental scanner system comprising an intraoral scanner and a scanning station. The intraoral scanner comprises a scanner interface configured for detecting a user interaction indicative of an intention to establishing a wireless operational connection. The intraoral scanner comprises a first wireless interface configured for, based on the detection of the user a user interaction indicative of an intention to establishing a wireless operational connection, broadcasting a connection request. The scanning station comprises a second wireless interface configured for receiving the connection request. The scanning station comprises a display configured for outputting a graphical interface comprising an indication that the connection request has been received.
The present disclosure further relates to a data processing system, such as the scanner system disclosed herein, comprising one or more processors configured to perform the steps of the method disclosed herein.
The present disclosure further relates to a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method disclosed herein. The present disclosure further relates to a computer-readable data carrier having stored thereon said computer program product.
The present disclosure further relates to a computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the steps of the method disclosed herein.
As used herein, the term wireless operational connection requires not just that the devices in wireless operational connection are connected by a network, e.g. a Wi-Fi network or the internet, but also that a functional communication channel is established over said network. Two devices may thus be connected to the same wireless network, while not being operationally connected to each other, unless a communication channel has been established between them.
Brief description of the drawings
The above and other features and advantages of the present invention will become readily apparent to those skilled in the art by the following detailed description of exemplary embodiments thereof with reference to the attached drawings, in which:
FIG. 1 shows a top-view of an intraoral scanner of the invention,
FIG. 2 shows a perspective view of an intraoral scanner of the invention,
FIG. 3 is a schematic drawing of an intraoral scanner of the invention,
FIG. 4 is a schematic drawing of a scanning network of the invention,
FIG. 5 is a schematic drawing of a scanning network of the invention,
FIG. 6 is a flowchart depicting the steps of a method of the invention,
FIG. 7 is a process flow diagram depicting a method of the invention,
FIG. 8 shows a graphical user interface outputted by a scanning station of the invention,
FIG. 9 shows a graphical user interface outputted by a scanning station of the invention,
FIG. 10 is a schematic drawing of a intraoral scanner system,
FIG. 11 illustrates a method for selecting an output device of an intraoral scanner system,
FIG. 12 shows a process flow diagram of a dental workflow,
FIG. 13 shows the selection of an output device using an intraoral scanner,
FIG. 14 is a schematic drawing of two intraoral scanners operating in a cloning mode,
FIG. 15 illustrates a method for selecting a direction of a cloning process,
FIG. 16 illustrates two intraoral scanners operating in a cloning connected to a scanning station,
FIG. 17 illustrates an intraoral scanner operating in a cloning connected to a scanning station,
FIG. 18 is a flowchart depicting the steps of a method of the invention,
FIG. 19 is a flowchart depicting the steps of a method of the invention, and
FIG. 20 illustrates different shaking directions of an intraoral scanner of the invention.
Detailed description
The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. Several aspects of the devices, systems, mediums, programs and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements”). Depending upon particular application, design constraints or other reasons, these elements may be implemented using electronic hardware, computer program, or any combination thereof.
The electronic hardware may include microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, and other suitable hardware configured to perform the various functionality described throughout this disclosure. Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
The scanner disclosed herein is an intraoral scanner for acquiring images within an intraoral cavity of a subject. The scanner may be a handheld scanner, i.e. a device configured for being held with a human hand. The scanner may employ any suitable scanning principle such as focus-based scanning, triangulation-based scanning, stereo vision, structure from motion, confocal scanning, or other scanning principles.
In some embodiments, the scanner employs a triangulation-based scanning principle. As an example, the scanner may comprise a projector unit and one or more camera units for determining points in 3D space based on triangulation. As another example, the scanner comprises a projector unit and two or more camera units, wherein the camera units are configured to image the scanned object from separate views, i.e. from different directions. In particular, the camera units may be configured to acquire a set of images, wherein a correspondence problem is solved within said set of images based on triangulation. The images within the set of images may be acquired by separate camera units of the scanner.
A triangulation-based intraoral scanner is further described in the following applications by the same applicant: WO 2023/117981 A1 “Systems and methods for generating a digital representation of a 3D object” filed on 19 December 2022, PCT/EP2023/058521 “Intraoral 3D scanning device for projecting a high-density light pattern” filed on 31 March 2023, and PCT/EP2023/058980 “Intraoral scanning device with extended field of view” filed on 5 April 2023, which are incorporated herein by reference in their entirety.
The intraoral scanner may comprise one or more scan units, wherein each scan unit comprises a projector unit and one or more camera units. As an example, the scanner may comprise one scan unit comprising one projector unit and at least two camera units. As another example, the scanner may comprise one scan unit comprising one projector unit and four camera units. In yet another example, the scanner may comprise at least two scan units, wherein each scan unit comprises a projector unit and two or more camera units. In yet another example, the scanner may comprise at least two scan units, wherein each scan unit comprises a projector unit and four camera units. The scan units may in some embodiments be arranged in series to enable an extended or enlarged field of view (FOV) of the intraoral scanner. Thus, each scan unit may provide a FOV, such that two scan units provide a combined FOV of approximately double the FOV of a single scan unit.
A scanning for providing intraoral scan data may be performed by a dental scanner system that may include an intraoral scanner such as the TRIOS series scanners from 3Shape A/S. The dental scanner system includes a wireless capability as provided by a wireless network unit. The intraoral scanner may employ a scanning principle such as triangulation-based scanning, confocal scanning, focus scanning, ultrasound scanning, x-ray scanning, stereo vision, structure from motion, optical coherent tomography OCT, or any other scanning principle. In an embodiment, the intraoral scanner is capable of obtaining surface information by projecting a pattern and translating a focus plane along an optical axis of the intraoral scanner and capturing a plurality of 2D images at different focus plane positions such that each series of captured 2D images corresponding to each focus plane forms a stack of 2D images. The acquired 2D images are also referred to herein as raw 2D images, wherein raw in this context means that the images have not been subject to image processing. The focus plane position is preferably shifted along the optical axis of the scanner system, such that 2D images captured at a number of focus plane positions along the optical axis form said stack of 2D images (also referred to herein as a sub-scan) for a given view of the object, i.e. for a given arrangement of the scanner system relative to the object. After moving the intraoral scanner relative to the object or imaging the object at a different view, a new stack of 2D images for that view may be captured. The focus plane position may be varied by means of at least one focus element, e.g., a moving focus lens.
The intraoral scanner is generally moved and angled relative to the dentition during a scanning session, such that at least some sets of sub-scans overlap at least partially, in order to enable reconstruction of the digital dental 3D model by stitching overlapping subscans together in real-time and display the progress of the virtual 3D model on a display as a feedback to the user. The result of stitching is the digital 3D representation of a surface larger than that which can be captured by a single sub-scan, i.e. which is larger than the field of view of the 3D intraoral scanner. Stitching, also known as registration and fusion, works by identifying overlapping regions of 3D surface in various sub-scans and transforming sub-scans to a common coordinate system such that the overlapping regions match, finally yielding the digital 3D model. An Iterative Closest Point (ICP) algorithm may be used for this purpose. Another example of a intraoral scanner is a triangulation scanner, where a time varying pattern is projected onto the dental object and a sequence of images of the different pattern configurations are acquired by one or more cameras located at an angle relative to the projector unit.
Generally, the process of obtaining surface information in real time of a dental object to be scanned requires the intraoral scanner to illuminate the surface and acquire high number of 2D images. Typically, a high-speed camera is used with a framerate of 300-20002D frames pr second dependent on the technology and 2D image resolution. The high amount of image data needed to be handled by the intraoral scanner to eighter directly forward the raw image data stream to an external processing device or performing some image processing before transmitting the data to an external device or display. This process requires that multiple electronic components inside the scanner is operating with a high workload thus requiring a high demand of current.
The intraoral scanner comprises one or more light projectors configured to generate an illumination pattern to be projected on a three-dimensional dental object during a scanning session. The light projector(s) preferably comprises a light source, a mask having a spatial pattern, and one or more lenses such as collimation lenses or projection lenses. The light source may be configured to generate light of a single wavelength or a combination of wavelengths (mono- or polychromatic). The combination of wavelengths may be produced by using a light source configured to produce light (such as white light) comprising different wavelengths. Alternatively, the light projector(s) may comprise multiple light sources such as LEDs individually producing light of different wavelengths (such as red, green, and blue) that may be combined to form light comprising the different wavelengths. Thus, the light produced by the light source may be defined by a wavelength defining a specific color, or a range of different wavelengths defining a combination of colors such as white light. In an embodiment, the intraoral scanner comprises a light source configured for exciting fluorescent material of the teeth to obtain fluorescence data from the dental object. Such a light source may be configured to produce a narrow range of wavelengths. In another embodiment, the light from the light source is infrared (I R) light, which is capable of penetrating dental tissue. The light
projector(s) may be DLP projectors using a micro mirror array for generating a time varying pattern, or a diffractive optical element (DOF), or back-lit mask projectors, wherein the light source is placed behind a mask having a spatial pattern, whereby the light projected on the surface of the dental object is patterned. The back-lit mask projector may comprise a collimation lens for collimating the light from the light source, said collimation lens being placed between the light source and the mask. The mask may have a checkerboard pattern, such that the generated illumination pattern is a checkerboard pattern. Alternatively, the mask may feature other patterns such as lines or dots, etc.
Color texture of the dental object may be acquired by illuminating the object using different monochromatic colors such as individual red, green and blue colors or my illuminating the object using polychromatic light such as white light. A 2D image may be acquired during a flash of white light.
The intraoral scanner preferably further comprises optical components for directing the light from the light source to the surface of the dental object. The specific arrangement of the optical components depends on whether the intraoral scanner is a focus scanning apparatus, a intraoral scanner using triangulation, or any other type of intraoral scanner. A focus scanning apparatus is further described in EP 2 442 720 B1 by the same applicant, which is incorporated herein in its entirety.
The intraoral scanner may comprise an elongated housing comprising a distal end for being inserted into an oral cavity. The housing may be configured to accommodate a number of optical and/or electronic components of the scanner. The housing may constitute a rigid outer shell of the scanner. The housing may comprise an aperture located in a sidewall of the distal end of the housing. The aperture is preferably arranged such that it is located in an optical path of the light projected by the scanner. In some embodiments, the housing of the scanner comprises two or more parts, such as a fixed part and a replaceable part, which is configured for being replaceably attached to the fixed part of the housing. As an example, the scanner may comprise a replaceable scanning tip configured for being mounted to the scanner or elongated housing. In that case, the scanning tip may comprise an aperture or window configured to align with a corresponding aperture or window of the elongated housing.
In some embodiments, the intraoral scanner comprises a window arranged at the aperture of the housing and/or of the scanning tip. Thus, the scanner may comprise a window arranged in the aperture of the housing, wherein the projector unit and window are arranged such that the pattern is projected through the window during use of the scanner. In preferred embodiments, at least a region of the window is made of a transparent material, said region located in an optical path of the projected spatial pattern. The window may be made of a polymer, such as poly(methyl methacrylate) (PMMA), or a glass material, such as Sapphire glass. The window is preferably rigid and planar. In some embodiments, the window is coated with an antireflective (AR) coating. The window may be located
in an optical path of the scanner, i.e., located such that the projected pattern of light is projected through the window during use of the scanner.
The intraoral scanner may comprise one or more projector units. Some or all of said projector unit(s) may be configured to project a predefined spatial pattern through the aperture and onto at least a part of the surface of a three-dimensional object.
A projector unit may be understood herein as a device configured for projecting light onto a surface, such as the surface of a three-dimensional object. In preferred embodiments, the projector unit is configured to project a pattern of light, such as the spatial pattern, onto the surface of a three- dimensional object, such as a dental object. Preferably, the projector unit is configured to project a pattern of light such that the spatial pattern is, within a given tolerance, in focus at a predefined focus distance or range, when measured along a projector optical axis. Thus, the spatial pattern may be in an acceptable focus within a given focus range. The projector unit may be configured to project unpolarized light.
The projector unit may be selected from the group of: Digital Light Processing (DLP) projectors using a plurality of digital micromirror devices (DMD) arranged in a matrix or array, or diffractive optical elements (DOE), or front-lit reflective mask projectors, or micro-LED projectors, or Liquid crystal on silicon (LCoS) projectors or back-lit mask projectors, wherein a light source is placed behind a mask having a spatial pattern. The pattern may be dynamic, i.e. such that the pattern changes over time, or the pattern may be static in time, i.e. such that the pattern remains the same over time. An advantage of projecting a static pattern is that it allows the capture of all the image data simultaneously, thus preventing warping due to movement between the scanner and the object.
The projector unit may comprise one or more collimation lenses for collimating the light from the light source. The collimation lens(es) may be placed between the light source and a mask in a back-lit mask projector unit. In some embodiments, some or all of the one or more collimation lenses are Fresnel lenses. The projector unit may further comprise one or more focus lenses configured for focusing the projected spatial pattern at a predefined focus range. The projector focus lenses may define a projector optical axis.
In preferred embodiments, the projector unit of the scanner comprises at least one light source and a pattern generating element for defining a pattern of light. The pattern generating element is preferably configured for generating a light pattern to be projected on a surface of an object. As an example, the pattern generating element may be a mask having a spatial pattern. Hence, the projector unit may comprise a mask configured to define a pattern of light. The mask may be placed between the light source of the projector unit and the one or more focus lenses, such that light transmitted through the mask is patterned into a spatial pattern. As an example, the mask may define
a polygonal pattern comprising a plurality of polygons, such as a checkerboard pattern. In other embodiments, the pattern generating element is based on diffraction and/or refraction to generate the light pattern, such as a pattern comprising an array of discrete unconnected dots.
Preferably, the projector unit is configured to generate a predefined static pattern, which may be projected onto a surface. Alternatively, the projector unit may be configured to generate a dynamic pattern, which changes in time, i.e., a time-varying pattern. The projector unit may be associated with its own projector plane, which is determined by the projector optics. As an example, if the projector unit is a back-lit mask projector, the projector plane may be understood as the plane wherein the mask is contained. The projector plane comprises a plurality of pattern features of the projected pattern.
The projector unit may comprise one or more light sources. The projector unit may be configured to project a spatial pattern of light defined by a plurality of projector rays when the light source(s) are on/active. The projector unit may be configured for sequentially turning the light source on and off at a predetermined frequency, wherein the light source is on for a predetermined time period. The light source(s) may be configured to generate light of a single wavelength, i.e. at narrow band centered at a wavelength, or a combination of wavelengths (mono- or polychromatic). The combination of wavelengths may be produced by a light source configured to produce light comprising different wavelengths, or a range of wavelengths (such as white light). The light source may be configured to generate unpolarized light, such as unpolarized white light.
In some embodiments, each projector unit comprises a light source for generating white light. An advantage hereof is that white light enables the scanner to acquire data or information relating to the surface geometry and to the surface color simultaneously. Consequently, the same set of images can be used to provide both geometry of the object, e.g. in terms of 3D data / a 3D representation, and color of the object. Hence, there is no need for an alignment of data relating to the recorded surface geometry and data relating to the recorded surface color in order to generate a digital 3D representation of the object expressing both color and geometry of the object. Alternatively, the projector unit may comprise multiple light sources such as LEDs individually producing light of different wavelengths (such as red, green, and blue) that may be combined to form light comprising different wavelengths. Thus, the light produced by the light source(s) may be defined by a wavelength defining a specific color, or a range of different wavelengths defining a combination of colors such as white light. In some embodiments, the light source is a diode, such as a white light diode, or a laser diode. In some embodiments, the projector unit comprises a laser, such as a blue or green laser diode for generating blue or green light, respectively. An advantage hereof is that a more efficient projector unit can be realized, which enables a faster exposure compared to utilizing e.g. a white light diode.
In some embodiments, the scanner comprises a light source configured for exciting fluorescent material to obtain fluorescence data from the dental object such as from teeth. Such a light source may be configured to produce a narrow range of wavelengths. In other embodiments, the scanner comprises one or more infrared light sources, configured to generate wavelengths in the infrared range, such as between 700 nm and 1.5 pm. In some embodiments, the scanner comprises one or more light sources selected from the group of: Infrared (IR) light source, near-infrared (NIR) light source, blue light source, violet light source, ultraviolet (UV) light source, and/or combinations thereof. In some embodiments, the scanner comprises a first light source forming part of the projector unit, and one or more second light sources, e.g. IR-LED(s) or NIR-LED(s) and/or blue or violet LED(s), located in a distal part of the scanner, such as in the tip of the scanner. Some of the light sources may be utilized for diagnostic purposes, such as for aiding in the detection of regions of caries or plaque.
The projector unit may be configured to project a spatial pattern of light defined by a plurality of projector rays when a light source of the projector unit is turned on. The spatial pattern may comprise a plurality of pattern features. In some embodiments, the pattern features are arranged in a two- dimensional (2D) grid. The terms ‘illumination pattern’, ‘pattern of light’, ‘spatial pattern’, and ‘projected pattern’ are used herein interchangeably.
The spatial pattern may be generated using a pattern generating element, e.g. located in the projector unit. The pattern generating element may be a mask, such as a transparency or transmission mask, having a spatial pattern. The mask may be a chrome photomask. In other embodiments, the pattern generating element is configured to utilize diffraction and/or refraction to generate a light pattern. The use of a pattern of light may lead to a correspondence problem, where a correspondence between points in the light pattern and points seen by the camera unit(s) viewing the pattern needs to be determined. In some embodiments, the correspondence problem is solved jointly for groups of projector rays emanating from the projector unit.
The spatial pattern may be a polygonal pattern comprising a plurality of polygons. The polygons may be selected from the group of: triangles, rectangles, squares, pentagons, hexagons, and/or combinations thereof. Other polygons can also be envisioned. In general, the polygons are composed of edges and corners. In preferred embodiments, the polygons are repeated in the pattern in a predefined manner. As an example, the pattern may comprise a plurality of repeating units, wherein each repeating unit comprises a predefined number of polygons, wherein the repeating units are repeated throughout the pattern. Alternatively, the pattern may comprise a predefined arrangement comprising any one or more of: stripes, squares, dots, triangles, rectangles, and/or combinations thereof. In some embodiments, the pattern is non-coded, such that no part of the pattern is unique.
In some embodiments, the generated pattern of light is a polygonal pattern, such as a checkerboard pattern comprising a plurality of checkers. Similar to a common checkerboard, the checkers in the pattern may have alternating dark and bright areas corresponding to areas of low light intensity (dark) and areas of high(er) light intensity (bright). In some embodiments the pattern of light is a checkerboard pattern comprising alternating squares of dark and bright light. In other embodiments, the light pattern comprises a distribution of discrete unconnected spots of light.
The spatial pattern preferably comprises a plurality of pattern features. The pattern features may be arranged in a regular grid. In some embodiments of the presently disclosed scanner, the total number of pattern features in the pattern is at least 1000, preferably at least 3000, more preferably at least 10000, even more preferably at least 15000. When projecting a pattern comprising such pattern features onto a surface of the 3D object, the acquired images of the object will similarly comprise a plurality of pattern features corresponding to the projected pattern features. A pattern feature may be understood as an individual well-defined location in the pattern or in the image. Examples of pattern features include corners, edges, vertices, points, transitions, dots, stripes, etc. In preferred embodiments, the pattern features comprise the corners of checkers in a checkerboard pattern. In other embodiments, the pattern features comprise corners in a polygon pattern such as a triangular pattern.
The intraoral scanner may comprise one or more camera units configured to acquire one or more two-dimensional images of the three-dimensional object. Preferably, at least a part of the spatial pattern is present in the images. A camera unit may be understood herein as a device for capturing an image of an object. Each camera unit may comprise an image sensor for generating an image based on incoming light e.g. received from an illuminated 3D object. As an example, the image sensor may be an electronic image sensor such as a charge-coupled device (CCD) or an activepixel sensor (CMOS sensor). In some embodiments, the image sensor is a global shutter sensor configured to expose the entire image area (all pixels) simultaneously and generate an image in a single point in time. In other embodiments, the image sensor is a rolling shutter sensor.
The image sensor(s) may comprise an array of pixels, wherein each pixel is associated with a corresponding camera ray. The array of pixels may be a two-dimensional (2D) array. Each pixel may be covered by a micro lens. In some embodiments, the image area, i.e. the 2D array of pixels, is rectangular or quadratic. In some embodiments, the image sensor is a CMOS sensor comprising an analog-to-digital converter (ADC) for each column of pixels, making conversion time significantly faster and allowing each camera unit to benefit from greater speed. Each image sensor may define an image plane, which is the plane that contains the object’s projected image. Each image obtained by the image sensor(s) may comprise a plurality of pattern features originating from a projected pattern comprising a plurality of such pattern features. In some embodiments, one or more of the
camera units comprise a light field camera. Preferably, each camera unit defines a camera optical axis. The camera units may further comprise one or more focus lenses for focusing light.
In some embodiments, the image sensor is a monochrome image sensor, wherein each pixel is associated with a single color channel, e.g. is a grayscale color channel, wherein the value of each pixel represents only an amount of light. In other embodiments, the image sensor is a color image sensor or an image sensor comprising a color filter array on the array of pixels. As an example, the color filter array may be a Bayer filter employing an arrangement of four color filters: Red (R), Green (G), Green (G), and Blue (B). The Bayer filter may also be referred to as an RGGB filter. When utilizing the image sensor data, color pixels may be combined to monochrome pixels of 2 x 2 color pixels for 3D depth reconstruction. In this case, the resolution of the 3D depth reconstruction is only half the resolution of the image sensor in each direction. When obtaining texture (color) images the full native resolution is preferably utilized (with color filtered pixels).
In accordance with some embodiments, the projector optical axis and the camera optical axis, or axes, are non-parallel. As an example, the projector optical axis and the camera optical axis of at least one camera unit may define a camera-projector angle of approximately 5 to 15 degrees, preferably approximately 5 to 10 degrees. All of the camera units may be angled similarly with respect to the projector unit, such that each camera optical axis defines approximately the same angle with the projector optical axis. In some embodiments, the camera units are defocused at the opening of the probe of the scanner and/or at the surface of an optical window in said probe. In preferred embodiments of the scanner, the camera units and projector unit of a given scan unit are focused at the same distance.
Each camera unit may comprise one or more focus lenses for focusing light onto the image sensor of the given camera unit. In some embodiments, each camera unit comprises two or more lenses assembled in a camera lens stack. The purpose of the focus lenses may be to define or ensure a predetermined focus distance, or working distance, of the camera unit. The camera focus lenses may further define the camera optical axis.
In some embodiments, the scanner comprises two or more camera units configured for acquiring a set of images comprising at least one image from each camera unit, wherein each image includes at least a portion of the projected pattern. In preferred embodiments, the images within the set of images are acquired simultaneously. Furthermore, the number of images in the set of images may preferably correspond to the number of camera units, wherein each camera unit contributes one image to the set of images. An advantage hereof, is that the light-budget is improved; thus, less power is consumed by the light source and the projector unit. Consequently, less heat is generated by said components, which is desired, since oftentimes it is difficult to remove heat from intraoral scanners.
The 3D scanner system may comprise one or more processors configured to generate a 3D representation based on the set of images, e.g. by identifying pattern features in the set of images and determining points in 3D space based on triangulation. Some of the processors may be located on the scanner and/or some may be located on an external computer. The 3D representation may be generated continuously during a scanning session, and/or it may be generated in real-time. The 3D scanner system may further comprise a display for displaying the 3D representation. The rendering of the 3D representation and the display of said representation may further occur in realtime, or perceived real-time to the user.
The 3D scanner system, i.e. a system comprising one or more intraoral scanner(s) and one or more scanning station(s), may comprise one or more processors operationally connected to the intraoral scanner, wherein said processors are configured to generate a 3D representation of a scanned object. A 3D representation may be understood herein as a digital representation of a three- dimensional object’s external geometry and shape. The 3D representation may represent only a part of the object’s geometry and shape. The 3D representation may comprise a collection of points and/or polygons that collectively define the object’s surface. As an example, the 3D representation may be selected from the group of: a point cloud, a signed distance field, a triangulated point cloud, a collection of point clouds optionally with additional information such as uncertainty estimates or color(s), a collection of triangulated point clouds, a polygon mesh, a volumetric representation such as a voxel model, a parametrized surface, a surface elements model, or any other suitable three- dimensional representational model. In the 3D representation, each point may be defined by its three-dimensional coordinates (x, y, z) in a Cartesian coordinate system. The points may form part of a surface mesh, such as a polygon mesh. In some embodiments, the 3D representation is a triangle mesh comprising a set of triangles connected by their common edges or vertices. The collection of points and/or the surface mesh may be used to create a visual representation of the object, which can be rendered on a computer screen.
The 3D representation may be generated from a plurality of 3D frames. A 3D frame may be understood herein as a 3D representation generated from a single field of view of an intraoral scanner. In other words, a 3D frame may in itself constitute a 3D representation of a part of the scanned object’s surface, and thus may fall within the examples of 3D representations given above. As an example, each 3D frame may constitute a point cloud having a plurality of points in three- dimensional space. During a scan, the scanner may acquire 3D frames at a given frame rate, such as between 20 to 35 frames per second. The 3D frames may be registered in a common reference system and stitched together to form a 3D representation, which is larger than what can be captured in a single field of view of the scanner. Registration of 3D frames may include registering a 3D frame to one or more previously captured 3D frames of the object. Registration of a 3D frame may be understood as determining the position and/or the orientation of the 3D frame relative to another
object and/or collection of objects (such as a collection of 3D frames). The registration may further include the actual positioning of the 3D frame relative to the collection of objects and/or collection of 3D frames. A collection of 3D frames stitched together may constitute the digital 3D representation described herein above. The 3D representation, e.g., of a given jaw or of a part of the dental arch, may be composed from a large number of 3D frames, such as between 100 and 2500 frames. Other amounts of 3D frames can be envisioned without departing from the scope of the disclosure.
The scanner interface is configured for providing the user control of scanner operation, and optionally one or more of establishing a wireless operational connection, disconnecting a wireless operational connection, changing scanning station, changing scanning station output, or scanner configuration cloning. The scanner interface may comprise one or more button(s), such as push buttons, a touch sensitive area, or virtual buttons on a touch display of the scanner, to provide the user with basic controls, such as on/off, start/end scan, etc.
The scanner interface may further comprise one or more movement sensor(s) configured for detecting movement of the scanner, thereby allowing the user, while holding the scanner, to use gestures as user interactions to issue control commands for the scanner, and optionally also the scanning station. The one or more movement sensor(s) may comprise one or more of an accelerometer, a gyroscope, and a magnetometer, whereby the one or more movement sensor(s) may be configured for detecting changes to one or more of acceleration, linear displacement, pitch, yaw, or roll of the scanner.
The scanner interface may further comprise a location determination unit having one or more location sensor(s) and/or location beacon(s) configured for detecting a location of the scanner. The one or more location sensor(s) may comprise one or more of a GPS unit, a Bluetooth proximity sensor, or an ultra-wideband, UWB, sensor. The one or more location beacon(s) may comprise one or both of a UWB tag or a Bluetooth proximity tag. The location determination unit may be provided by the first wireless interface, in which case the location of the scanner may be determined using one or more wireless network nodes.
The location of the scanner may be the location of the scanner relative to a scanning station given by a distance between the scanner and the scanning station and/or a direction from the scanning station in which the scanner is located. The location of the scanner may be the location of the scanner relative to the Earth, i.e. the coordinates of the current location of the scanner. The location may be a position within a clinic, e.g. a room which the scanner is located.
The scanning station disclosed herein comprises a computer and a display for providing the user with a substantially real time view of the 3D representation as it is being generated during a scan and/or a viewfinder showing at least part of a current field of view of the camera unit. This may help
the user navigate and/or maneuver the scanner around inside the patient’s oral cavity and provide the user with information about where the 3D representation is incomplete to guide them through the scanning process. The scanning station may comprise some or all of the one or more processors used to generate the 3D representation. The scanning station may at least partly be cloud based, whereby some or all of the one or more processors used to generate the 3D representation may be located remotely from the display.
The scanning station further comprises a scanning station interface for control of the scanning station, and for manipulating objects in the display, e.g., the 3D representation or a cursor in a graphical user interface, GUI. The scanning station interface may at least partly be provided by the scanner interface, whereby the scanner interface may be used to control some or all actions of the scanning station. This may be particularly advantageous when the scanner comprises one or more movement sensor(s) as this will allow the user to control the scanning station through gestures via the wireless operational connection, or via a wired connection if a scanner without wireless interface is used. In such cases the scanning station interface can be leveraged to use the scanner as a pointer for controlling the cursor in the GUI of the scanning station. This may be further improved by also using the scanner interface to select options or items in the GUI, e.g. by pressing a button of the one or more button(s), whereby the scanner may act as mouse for the scanning station.
The scanning station may be connected to a network, e.g. a Local Area Network, LAN, or the internet, through which the scanner may be connected. Alternatively or additionally, the scanner may comprise a scanning station wireless interface, referred to herein as the second wireless interface, whereby the scanner and scanning station may establish a wireless link directly between them.
In order for the scanner and the scanning station to exchange data, they must first be connected. This connection may be through a direct wireless link, i.e. between the first and second wireless interfaces, or it may be partially wireless, i.e. using a wireless network node of a network to which the scanning station is connected to provide a wireless link to the scanner. Secondly, a communications channel must be opened in order to make the connection operational. For first time sessions this may require pairing to create a trusted bond between the scanner and the scanning station.
Disclosed is a first method for establishing a wireless operational connection between an intraoral scanner and a scanning station. The method comprises detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection. The interaction indicative of an intention of establishing a wireless operational connection is a user interaction which the scanner is configured to associate with the intention of establishing a wireless operational connection. Said user interaction may be defined by default settings or user configured settings stored in the memory of the scanner. The detection will be performed by the scanner interface, for
example by using at least one of the following: the one or more button(s), the one or more movement sensor(s), or the location determination unit, depending on what kind of interaction the scanner is configured to associate with the user’s intention of establishing a wireless operational connection.
The user action which the scanner is configured to associate with the intention of establishing a wireless operational connection is an interaction by the user with the scanner interface. The user action which the scanner is configured to associate the intention of establishing a wireless operational connection may be pressing a button of the one or more buttons, such as a button of the one or more buttons dedicated to establishing a wireless operational connection or a multipurpose button of the one or more buttons a preset number of presses and/or for a preset duration, optionally in connection with powering on the scanner. If the scanner interface comprises other means for user interactions, such as a touch pad, a touch display, or a scroll wheel, the user action which the scanner is configured to associate the intention of establishing a wireless operational connection may be an interaction with one or more of these.
The user action which the scanner is configured to associate with the intention of establishing a wireless operational connection may be a gesture performed by the user while holding the scanner, detected by the one or more movement sensor(s). Said gesture may a shake of the scanner, e.g. moving the scanner in an up/down motion, moving the scanner in a side-to-side motion, and/or rotating the scanner in a clockwise/counterclockwise motion. Gesture based interactions may be advantageous as they are found to be intuitive for most users, thereby making the scanner easier to use. Using a gesture such a shake is advantageous as it is a type of movement not performed during a scanning procedure, thus making it unlikely that the user will accidentally perform it unintentionally.
The method comprises, based on the detection of the user interaction indicative of an intention of establishing a wireless operational connection, broadcasting, by the intraoral scanner, a connection request and receiving, by the scanning station, the connection request. Broadcasting the connection request is performed as a wireless signal by the first wireless interface. The connection request may be received by a wireless network node and subsequently distributed to one or more scanning stations on the scanning network. Alternatively, the connection request may be received by the scanning station directly. The connection request may be broadcasted as one or more connection request data packages comprising identification data identifying the scanner that broadcasted the connection request.
The method comprises outputting, by the scanning station, an indication that the connection request has been received to the user. The output may be audible in the form of an audio message presented to the user via a speaker of the scanning station. The output may be visual in the form of a visual indicator presented in the GUI on the display of the scanning station. The output may be presented in connection with a visual representation of the scanner which broadcasted the connection request,
thereby allowing the user to identify that scanner from a list of scanners or identify the visual representation of that scanner amongst multiple visual representations of scanners connected to the scanning network. The more scanners a clinic owns, the more advantageous this becomes as it allows the user to quickly identify the scanner, they are currently using by first performing the user interaction indicative of an intention of establishing a wireless operational connection, after which the visual representation of that scanner will by highlighted or isolated, thus allowing them to quickly select the correct scanner amongst the scanners available on the scanning network.
The method comprises detecting, by the scanning station, a user interaction indicative of approval of establishing the wireless operational connection. The detecting of the user interaction indicative of approval of establishing the wireless operational connection is done using the scanning station interface, preferably using one or more of a mouse, a keyboard, microphone, camera, or a touchscreen. The user interaction indicative of approval of establishing the wireless operational connection is a user interaction which the scanning station is configured to associate with an instruction to approve the connection request.
Said user interaction may be selecting the scanner which broadcasted the connection request in a list of available scanners or selecting the visual representation of the scanner which broadcasted the connection request, e.g. by moving a cursor in the GUI and selecting. The scanning station may be configured to associate other user interactions with the approval of establishing the wireless operational connection, such as voice commands detected by microphone, hand or eye gestures detected by camera and/or lidar. Alternatively, the scanning station may be configured to associate proximity of the scanner which broadcasted the connection request the scanning station as the approval of establishing the wireless operational connection, i.e. the user interaction indicative of approval of establishing the wireless operational connection is the user brining the scanner within a connection distance of the scanning station. Alternatively, where the user interaction indicative of the intention of establishing a wireless operational connection is a gesture with the scanner, e.g. a shake of the scanner, the scanning station may be configured to, by a camera of the scanning station, observe the user performing the user interaction indicative of the intention of establishing a wireless operational connection and associate the observation with the approval. Once the approval is detected, the method comprises establishing the wireless operational connection between an intraoral scanner and a scanning station, after which that scanner and scanning station becomes linked and a scanning session may be performed.
Disclosed is a second method for establishing a wireless operational connection between an intraoral scanner and a scanning station of multiple scanning stations. The intraoral scanner and the multiple scanning stations form a scanner system interconnected by a scanning network.
The method comprises detecting a distance between the intraoral scanner and at least some, preferably all, of the scanning stations. Detecting the distance may be done using the one or more location sensor(s) of the intraoral scanner or it may be done using one or more external location sensor(s) based on a signal from the one or more location beacon(s) of the scanner. The method comprises establishing the wireless operational connection between an intraoral scanner and the scanning station that is closest to the intraoral scanner amongst the scanning stations.
Alternatively, the method comprises detecting a position of the intraoral scanner and determining which scanning station is associated with that location. The method then comprises establishing the wireless operational connection between the intraoral scanner and the scanning station associated with the detected location. For a scanner system comprising multiple scanning stations distributed over an area, e.g. over several rooms within a clinic, each scanning station may be associated with a particular area, e.g. a room within the clinic.
In such setups where proximity and/or location can be determined, approval steps may be omitted, optionally provided that a trusted bond is established between the scanner and the scanning station, as the location of the scanner relative to the scanning stations may be sufficient both for determining to which scanning station the scanner should establish the wireless operational connection and for security as it would not be possible for someone located outside the clinic to establish the wireless operational connection. If further security is desired, the method may still comprise detecting, by the scanning station, a user interaction indicative of approval of establishing the wireless operational connection, wherein the user interaction may be one of the options disclosed above or a pop-up box presented in the GUI of the scanning station closest to the scanner.
The second method may comprise steps from the first method, e.g. also comprise detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection to initiate the detection of the distance or position.
Disclosed is a third method for establishing a wireless operational connection between an intraoral scanner of multiple intraoral scanners and a scanning station. The method comprises detecting, by the scanning station, a user interaction indicative of an intention of establishing a wireless operational connection. The user interaction indicative of an intention of establishing the wireless operational connection may be pressing a virtual quick connect button in a GUI of the scanning station or a voice command, e.g. the user saying connect scanner in a language which the scanning station is configured to recognize.
The method comprises detecting, by one of the intraoral scanners, a second user interaction indicative of an intention of establishing a wireless operational connection. The method comprises establishing the wireless operational connection between the scanning station and the intraoral
scanner that detected the second user interaction indicative of an intention of establishing the wireless operational connection. The second user interaction indicative of an intention of establishing a wireless operational connection may be a button press or a gesture, e.g. a shake of the scanner, detected by the scanner interface of one of the intraoral scanners.
Scanning a patient’s oral cavity is only the first step in a dental workflow. The user may want to move on to a subsequent step such as inspecting the 3D representation resulting from the scanning, presenting it to the patient, storing it in the patient’s journal, or sending it elsewhere for diagnostics, either of which may involve moving the data away from the scanning station. Given the requirements for hygiene when scanning a patient, it may be cumbersome for the user to change the output destination of the scanning station, as touching other things than the scanner will require the user to change their operation gloves and possibly also re-sterilize their hands, particularly so if the user has to use a mouse, keyboard or touch screen, which can all accumulate pathogens. Minimizing user interactions with such objects is therefore highly desirable. According to the invention, this may be achieved by using the scanner, at least partly, as the scanning station interface, i.e. while the scanner is operationally connected to the scanning station using the scanner interface as input means for the scanning station.
Disclosed is an intraoral scanner system comprising an intraoral scanner and a scanning station operationally connected to the intraoral scanner. The intraoral scanner comprises an optical system having a projector unit and a camera unit, the optical system being configured for capturing multiple 2D images for the provision of image data. The intraoral scanner comprises a scanner interface having one or more movement sensor(s) configured for detecting movement of the intraoral scanner for the provision of movement data. The scanning station comprises one or more processor(s) configured for generating 3D representation data based on the image data. The scanning station comprises an output interface configured for being connected to multiple output devices, the output interface being configured for providing output data based on the 3D representation data to a selected output device amongst the multiple output devices. The scanning station comprises a first display, the first display being one of the multiple output devices. The scanning station is configured for determining which of the multiple output devices is the selected output device based on the movement data.
Further disclosed is a method for selecting an output device in an intraoral scanner system comprising an intraoral scanner, a scanning station, and multiple output devices. The method comprises capturing, by the intraoral scanner, multiple 2D images for the provision of image data. The method comprises detecting, by the intraoral scanner, movement of the intraoral scanner for the provision of movement data. The method comprises generating, by the scanning station, 3D representation data based on the image data. The method comprises generating, by the scanning station, output data based on the 3D representation data. The method comprises determining which
of the multiple output devices is a selected output device based on the movement data. The method comprises. The method comprises outputting the output data to the selected output device.
Further disclosed is a data processing system, such as the intraoral scanner system, comprising one or more processors configured to perform the steps of this method.
Further disclosed is a computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of this method.
The multiple output devices may comprise one or more of the following: one or more display(s), one or more data storage devices, e.g. hard drive(s), local server(s) and remote server(s), one or more other scanning station(s), or one or more computer(s). The output interface may comprise one or more wired output ports comprising one or more of the following: one or more display port(s), e.g. HDMI, DisplayPort, DVI, and VGA port(s), one or more network port(s), e.g. ethernet port(s), or one or more data exchange port(s), e.g. USB and Thunderbolt port(s). The output interface may comprise a second wireless interface to connect the scanning station to a scanner network which at least some of the multiple output devices are connected to.
The 3D representation data comprise the 3D representation of the scanned object, i.e. at least part of the patient’s oral cavity, stitched together from the image data. Where the user will want to output the 3D representation data may depend on what the next step of the dental workflow is. It is an advantage of the invention that the user may select an output device for the 3D representation data solely through interaction with the intraoral scanner, as this will allow the user to resume scanning or other dental procedures on the patient without compromising the sterility of the user’s hands. By determining the output based on the movement data, the user may select an output device through hand gestures while holding the intraoral scanner, which will detect the user’s movement by the movement sensor(s) and generate movement data representing the user’s movement.
Hence, selecting an output device may be performed by the user performing a swipe with their hand while holding the scanner, in a direction from the scanning station or the first display towards the desired output device. The scanner will detect this movement and generate movement data representing the detected movement, and transfer the movement data to the scanning station. The scanning station may then read the movement data and set an output device corresponding to the direction of the swipe as the selected output device.
The multiple output devices may comprise a second display, wherein the scanning station is configured for changing between a first display mode, in which the first display is used as the main display, and a second display mode, in which the second display is used as the main display. Providing multiple displays for a scanning station may have multiple advantages, it may allow the
user to switch from working on one side of the patient to the other side of the patient while still having a display at a natural viewing angle, or it may allow the user to share the result of the scanning with the patient or a colleague on a second, larger display.
The scanning station may be configured for, when changing from the second display mode to the first display mode, putting the second display into a reduced power mode, such as an idle or off mode. The scanning station may be configured for, when changing from the first display mode to the second display mode, putting the second display from a reduced power mode, such as an idle or off mode, into an active mode. While the first display will often be a display attached to the scanning station, the second display may be a temporary display, i.e. a display used occasionally for shorter time periods. It may therefore be advantageous to provide a scanning station which is configured for waking the second display from an idle mode when the movement data indicates that the user wants to use the second display as the selected output device, and/or provide a scanning station which is configured for putting the second display in an idle mode when the movement data indicates that the user wants to use another device than the second display as the selected output device.
The scanner interface may further comprise one or more buttons configured for detecting a user interaction indicative of an intention of selecting an output device. The scanning station may then be configured for determining which of the multiple output devices is the selected output devices based on the detection of the user interaction indicative of selecting an output device. Combining the gesture-based selection of the output device with a requirement that the user also performs a user interaction indicative of an intention of selecting an output device may reduce the risk of detecting false positives, i.e. the user accidentally performing a movement associated with selection of an output device. It may thus be advantageous to only perform selection of an output device after the user has pushed a distinct button sequence or while they are holding down a button.
The movement data may comprise data indicating one or more of the following: a movement direction, movement distance, movement speed, rotation direction, or rotation speed of the intraoral scanner. The determination of which of the multiple output devices is the selected output device based on the movement data, may require the movement data indicating that the scanner has moved beyond an initiation distance threshold and/or faster than an initiation speed threshold. The initiation distance threshold may prevent the user from accidentally triggering a selection of an output device while operating the scanner, e.g. while scanning a patient. The initiation speed threshold may prevent the user from accidentally triggering a selection of an output device while moving the scanner about.
The scanning station may be configured for determining whether the movement data fulfills an output device criterion for each of the multiple output devices and if the movement data fulfills one of the output device criteria setting the output device associated with the fulfilled criterion as the selected output device. The output device criterion for each output device may be a default setting or it may
be a setting defined by the user. By providing a scanner system which allows the user to set at least some of the output device criterion the user may customize which gestures should be associated with which output devices, thereby providing a scanner system that is more intuitive for the user.
The scanning station may further be configured for translating the movement data into movement of a selection tool in a graphical user interface, such as a cursor shown on the first display. The output device criteria are boundary conditions on the first display, and wherein an output device criterion is fulfilled when the cursor is moved past the boundary condition associated with that output device criterion. Firstly, providing an intraoral scanner which may act as a pointer allows the user to manoeuvre and selecting options in the GUI presented on the first display, whereby the scanner may replace other interface options, e.g. the mouse. Secondly, by linking the selection of the output device to movement of the cursor, the user may be provided with visual feedback when performing a gesture to select and output device.
The boundary conditions may be customized by the user so that a position in the GUI of a boundary associated with a particular output device may reflect the user’s preferences or the particular output device position relative to the first display, e.g. a boundary associated with a second display arranged to the right of the first display may be set on the right edge of the first display while a boundary associated with cloud storage may be set on the upper edge of the first display.
Disclosed herein is also a method for cloning configuration settings of an intraoral scanner, i.e. a source scanner, to another intraoral scanner, i.e. a destination scanner. As intraoral scanners are fairly advanced electronic devices, they will often have one or more configuration settings stored in the memory of the scanner. Configuring a new wireless scanner to use a new network can be a cumbersome and convoluted process. New network credentials may have to be transferred to the new scanner through either an already known network or some other wireless technology such as Bluetooth or NFC. In addition to network credentials, scanners can have user settings that affect their behaviour. Duplicating these settings on multiple scanners will also take time. If multiple scanners need to be configured, the entire process must be repeated for each scanner and can be quite time-consuming.
Disclosed is an intraoral scanner comprising an optical system having a projector unit and a camera unit, a memory configured for storing configuration settings, a processing unit configured for operating based on the configuration settings, a scanner interface configured for detecting user interactions, and a first wireless interface. The intraoral scanner being configured for operating in a cloning mode. In the cloning mode the intraoral scanner is in one of the following two sub-modes: a source scanner cloning mode or a destination scanner cloning mode. In the source scanner cloning mode, the intraoral scanner is configured for generating one or more configuration setting data package(s) based on the configuration settings, and transmitting the one or more configuration
settings data package(s) via the first wireless interface to another intraoral scanner. In the destination scanner cloning mode, the intraoral scanner is configured for receiving one or more configuration setting data package(s) via the first wireless interface from another intraoral scanner or from a scanning station, and updating the configuration settings based on the received one or more configuration setting data package(s).
Disclosed is a method for cloning configuration settings onto an intraoral scanner. The method comprises establishing a wireless operational connection between the intraoral scanner and another intraoral scanner or a scanning station. The method comprises initiating a cloning mode of the intraoral scanner. The method comprises receiving one or more configuration setting data package(s) from the other intraoral scanner or from the scanning station. The method comprises updating configuration settings of the intraoral scanner based on the received one or more configuration setting data package(s).
Further disclosed is a data processing system, such as an intraoral scanner, comprising one or more processors configured to perform the steps of this method.
Further disclosed is a computer program product comprising instructions which, when the program is executed by an intraoral scanner, cause the intraoral scanner to carry out the steps of this method.
An advantage of these is that the user may clone the configuration settings of an already customized scanner, i.e. a source scanner, onto a new scanner, i.e. the destination scanner, whereby the user not only saves the time it would otherwise require to customize the new scanner but also ensures that the configuration settings of the new scanner becomes the same as the source scanner, so that operation of the new scanner will be the same.
According to the invention, cloning configuration settings of an intraoral scanner may be initiated by a user interaction indicative of an intention of cloning detected by the scanner interface of one or both of the source scanner and the destination scanner, such as pressing specific buttons, possibly while powering on the devices. This may initiate a cloning mode of the scanners, wherein a private wireless connection between the two scanners, e.g., using Bluetooth, NFC, or other wireless protocols, using the first wireless interfaces of the scanners is established. The configuration settings would then be transferred from the source scanner to the destination scanner, and the destination scanner would then reboot.
The user interaction indicative of an intention of cloning may comprise the user pressing one or more buttons in a first button pressing pattern, possibly in combination with the scanner being powered on. The simplest user interaction indicative of an intention of cloning would comprise a press of a single button on the destination scanner, possibly while powering on the destination scanner,
possibly a prolonged press. In this scenario, a scanner is ready to be cloned at any time as the cloning process is triggered by the destination scanner. The user interaction indicative of an intention of cloning may comprise arranging the source scanner and the destination scanner within a distance, i.e. below a cloning proximity threshold, of each other, which may be detected using the location determination units of the respective scanners. The user interaction indicative of an intention of cloning may comprise a user gesture while holding one or both of the source and destination scanners, e.g. a shake of one or both scanners, detected by the one or more movement sensor(s) of the respective scanners.
The user interaction indicative of an intention of cloning may be accompanied by a user interaction indicating the direction of cloning, i.e. indicating which scanner should be the source scanner and which should be the destination scanner. The user interaction indicating the direction of cloning may comprise a second button pressing pattern on a first scanner, whereby the first scanner enters a cloning mode as a source scanner, and/or a third button pressing pattern on a second scanner, whereby the second scanner enters a cloning mode as a destination scanner. Additionally or alternatively, the user interaction indicating the direction of cloning may comprise a user gesture while holding one or both of the source and destination scanners, e.g. a swipe of the destination scanner towards the source scanner, detected by the one or more movement sensor(s) of the source scanner scanners.
The source scanner and the destination scanner may support wireless technology where a scanner- to-scanner connection can be established. Preferably, this connection should operate independently of the primary wireless connection used to connect to a scanning station or scanning network, so that the destination scanner can be cloned without the source scanner losing any pre-existing connection to a scanning station. In addition, the scanner-to-scanner connection may be a secure and encrypted wireless connection, since network credentials and other potential private information will be cloned. Authentication may also be used to prevent the cloning process from being triggered by unauthorized devices.
To further ensure a secure scanner-to-scanner connection, the method for cloning configuration settings of an intraoral scanner may comprise broadcasting a cloning request by one or both of the source and destination scanners; receiving, by a scanning station, the cloning request; detecting, by the scanning station, a user approval of the cloning request. Using the scanning station for approval of the cloning request adds an extra layer of security against both unauthorized and accidental initiation of a cloning process. An additional or alternative security measure against unauthorized initiation may be to use the aforementioned cloning proximity threshold, i.e. the method for cloning configuration settings of an intraoral scanner may comprise a proximity between the source and
destination scanners, and if the source and destination scanners are further from each other than the cloning proximity threshold abort the cloning process.
To prevent the user from accidentally triggering cloning, i.e. accidentally performing the user interaction indicative of an intention if the clone, which could result in accidentally overwriting a scanner configuration that was meant to be different, the method for cloning configuration settings of an intraoral scanner may comprise outputting, by the source scanner and/or destination scanner, a cloning notification. The cloning notification may comprise one or more of the following: a haptic notification, an audible notification, or a visual notification. This may be proceeded by detecting, by the source scanner and/or destination scanner, a user approval of initiating the cloning process. Preferably, the cloning notification is output by at least the destination scanner. Preferably, the user approval of initiating the cloning process is detected by the destination scanner. As the destination scanner is the scanner that will be overwritten, it is advantageous that it alerts the user before initiating cloning by outputting the cloning notification and holds the cloning process until user approval is detected, thereby reducing the risk of accidentally triggering cloning.
As having an additional wireless connection for the scanner-to-scanner connection active may consume a lot of energy from the energy source, e.g. the battery, the source and/or destination scanner may be configured for, upon detecting the user interaction indicative of an intention of cloning establishing the scanner-to-scanner connection, and, upon completion of transferring the configuration settings from the source scanner to the destination scanner, suspending the scanner- to-scanner connection. This will minimize the time the scanner-to-scanner connection must be active, whereby energy consumption is reduced.
When transferring the configuration settings wirelessly, the source scanner may generate configuration setting data packages comprising error detection data and/or error correction data. The error detection data, e.g. a cyclic redundancy check, CRC, is an error-detecting code enabling the destination scanner to detect possible accidental changes in the configuration setting data packages that may happen during the wireless transfer. The error correction data, e.g. repetition copies of the configuration settings, allows the destination scanner to correct errors in the received configuration setting data packages, if such are detected.
The method described above may be extended to cloning configuration setting from a scanning station to a destination scanner. In the extended case, where the configuration settings are cloned from a scanning station, an application running on the scanning station may take the role of the source scanner, i.e. as the clone source instead of a scanner.
Detailed description of figures
Fig. 1 illustrates an intraoral scanner, also referred to as a scanner, 100 for acquiring a set of images of the scanned object, e.g. within the oral cavity of a person. The scanner 100 comprises a housing having a distal end 104 for being inserted into the oral cavity of a patient, and a proximal end 106 opposite the distal end 104. The scanner 100 comprises a tip 102, which during scanning is at least partly inserted into the patient’s oral cavity. The tip 102 comprises an aperture through which the scanner 100 is configured for emitting light to illuminate an object to be scanned, and through which light coming off, e.g. through reflection or fluorescence, can enter the scanner 100 for capture to obtain image data. The intraoral scanner comprises a scanner interface having one or more buttons 118, e.g. two buttons in the shown embodiment. The scanner interface is configured for providing user control of one or more of the following: scanning operations, establishing a wireless operational connection, disconnecting a wireless operational connection, controlling a scanner station 200, i.e. providing input means for a scanner station 200, or switching between available scanner stations. The buttons can as an example comprise one or more of the following: a push button, a dial switch, touch interface, e.g., on a scanner display. Fig. 2 shows a perspective view of an intraoral scanner 100 as shown in Fig. 1.
Fig. 3 shows a block diagram of an intraoral scanner 100 as shown in Fig. 1 and 2. The scanner 100 comprises an optical system 108 comprising a projector unit having one or more light source(s) configured for providing light for illuminating the object to be scanned and a camera unit having one or more image sensor(s) configured for capturing light coming off the object being scanned. The one or more light source(s) may comprise one or more of the following: an infrared, IR, light source, a near infrared, NIR, light source, a monochromatic visible light source, a polychromatic visible light source, a white light source, or an ultraviolet, UV, light source. Herein, the term visible refers to band of the electromagnetic spectrum that the human eye can perceive, typically about 380nm to 750nm.
The scanner 100 comprises a processing unit 110 configured for executing control and input/output operations of the scanner 100. The processing unit 110 is operatively connected to the optical system whereby the processing unit 110 may control the optical system 108 during the scanning process and receive image data captured by the optical system 108. The processing unit 110 may comprise some or all of the one or more processors for generating the 3D representation. The processing unit 110 may be configured for performing preprocessing of the image data captured by the optical system and the 3D representation may be generated based on the pre-processed image data. The scanner 100 may comprise a memory 124 configured for storing one or more of the following: user settings, control and input/output operations of the scanner 100, one or more encryption key(s), or image data.
The scanner 100 comprises a wireless interface, referred to herein as the first wireless interface, configured for providing a wireless link between the scanner 100 and a scanning station 200, a network and/or another intraoral scanner. The first wireless interface comprises a wireless communication unit 112, such as a radio, a transmitter, a transmitter-receiver pair, or a transceiver, coupled to one or more antennas 114. The one or more antennas 114 may comprise multiple antennas configured for operation in different frequency bands, e.g. and antenna configured for operation in a frequency band centered at 2.45GHz and another antenna configured for operation in a frequency band centered at 5.8GHz, and/or polarizations, e.g., an antenna configured for operation at a first polarization and another antenna configured for operation at a second polarization substantially orthogonal to the first polarization.
The wireless communication unit 112 is operatively connected to the processing unit 110, whereby the wireless communication unit 112 may receive the image data, the pre-processed image data, or data comprising the 3D representation from the processing unit 110 and transmit said data to a scanning station using the one or more antennas 114. Furthermore, the scanner may receive data via the first wireless interface, e.g. command data from a scanning station 200. Additionally, the wireless interface may transmit/receive further data as will be explained in greater detail below.
The scanner 100 comprises an energy source 116, such as a rechargeable battery. The energy source 116 may be replacably mounted in the scanner 100 in an energy source slot 124 configured to receive and retain the energy source 116. During operation of the scanner 100, the energy source 116 provides energy to the electrical components of the scanner 100, e.g., the first wireless interface, the processing unit 110, the optical system 108, the scanner interface, etc..
The scanner interface may comprise one or more movement sensor(s) 120 configured to detect movement of the scanner 100. The one or more movement sensor(s) may comprise one or more of the following: an accelerometer, a gyroscope, or a magnetometer. The one or more movement sensor(s) may be configured for detecting linear movement and/or rotational movement of the scanner 100. The scanner interface may comprise a location determination unit 122 configured for enabling determination of a position of the scanner 100 either in relation to a scanning station 200 or an actual position, e.g. in terms of coordinates or a position within the clinic the scanner 100 is associated with. The location determination unit 122 may comprise a location detector, so that the scanner 100 can detect its location, and/or location emitter, so that the scanner 100 can emit a location signal whereby other devices, e.g. a scanning station 200, may detect the location of the scanner 100.
Fig. 4 shows a scanning network 250 comprising multiple scanners 100, e.g. three as shown, and multiple scanning stations 200, e.g. three as shown. The scanning stations 200 may be connected to the scanning network 250 through wired connections and/or wireless connections. Some or all of
the scanning stations 200 may be configured to be stationary, e.g. a desktop computer or a stationary display, and may therefore omit a wireless connection. Some or all of the scanning stations 200 may be configured to be movable, e.g. a laptop or tablet, in which case they will comprise a second wireless interface to connect to the scanning network 250.
The scanning network 250 may be connected to one or more local server(s) 210 and/or to a cloud network 220. The one or more local server(s) 210 and/or the cloud network 220 may comprise some or all of the one or more processors which generates the 3D representation, whereby processes requiring larger amounts of computing power may be performed on the one or more local server(s) 210 and/or the cloud network 220. The one or more local server(s) 210 and/or the cloud network 220 may comprise data storage, whereby image data and other data requiring larger amounts of data storage space may be stored on the one or more local server(s) 210 and/or the cloud network 220. This may lessen the computing and storage requirements of the scanning station 200.
The provide a wireless link to the scanners 100, the scanning network 250 comprises one or more wireless network node(s), e.g. a Wi-Fi router, which act as relays between the scanners 100 and the scanning stations 200. Through the scanning network 250 an at least partially wireless connection is provided between the scanners 100 and the scanning stations 200, thereby allowing a wireless operational connection to be established between a scanner 100 and a scanning station 200 for a scanning session of a patient as will be described in greater detail below.
Fig. 5 shows a scanning network 250 comprising a scanner 100 and two scanning stations 200, each scanning station 200 having a computer 202 and a display 204, which may be combined in one device, i.e. a laptop. The scanner 100 may only be operationally connected to one of the two scanning stations 200 at a time, so if the scanner 100 is switched between the scanning stations 200 or paired with the scanning network 250 for the first time the user has to perform actions to do so.
Fig. 6 shows a flowchart of a method of the invention which simplifies such connection and pairing processes. A user interaction indicative of an intention of establishing a wireless operational connection, i.e. the user wanting to operationally connect the scanner 100 to a scanning station 200, is detected 300. This is detected using the scanner interface which has a preset interaction associated with the user wanting to establish the wireless operational connection. The user interaction indicative of an intention of establishing a wireless operational connection may be a user interaction with the one or more button(s) 118, e.g. pushing a dedicated connection button or pushing a multi-purpose button in a unique pattern such as a double click or prolonged press. The user interaction indicative of an intention of establishing a wireless operational connection may be a gesture performed by the user while holding the scanner 100, whereby the gesture may be detected using the one or more movement sensor(s) 120. In such embodiments, the scanner 200 will have a preset movement pattern associated with the intention of establishing a wireless operational
connection. The movement pattern may be the user shaking the scanner 100, e.g. by linearly shaking the scanner 100 and/or by rotationally shaking the scanner 100.
Upon detecting 300 the user interaction indicative of the intention of establishing a wireless operational connection, a connection request is broadcasted 302 by the scanner 100 using the first wireless interface. Subsequently, the scanning request is received 304 by the scanning stations 200. The connection request may be received directly by the second wireless interface of the scanning stations 200 or it may first be received by a wireless network node 230 which will then distribute the connection request to the scanning stations 200 in the scanning network 250.
Upon receiving 304 the connection request, the scanning stations 200 will output 306 an indication that the connection request has been received. The output may be performed visually using a display of the respective scanning station 200, in which case the indication will be presented in a Graphical User Interface, GUI, 400. Preferably, the indication is presented alongside a visual representation of the scanner 100 which broadcasted the connection request. The visual representation of the scanner 100 may one or more of the following presented in the GUI 400: text identifying the scanner 100, a photo of the model of the scanner 100, or an animation of the scanner 100. Additionally or alternatively, the output may be performed audibly using a speaker of the respective scanning station 200, in which case the scanning station 200 will emit an acoustic signal comprising information that the connection request has been received, e.g. a speech signal.
When outputting 306 the indication that the connection request has been received, the scanning station 200 will detect 308 for a user interaction indicative of approval of establishing the wireless operational connection. This may be done by presenting an option to accept the connection request in the GUI 400 and taking an input from the user, e.g. an input using a keyboard of the scanning station 200, or a user interaction with the GUI 400, e.g. pushing a virtual button to accept or pushing the visual representation of the scanner 100. If the user declines or omits to accept the connection request, the process of establishing the wireless operational connection may be terminated 314 without establishing the wireless operational connection.
If the user interaction indicative of approval of establishing the wireless operational connection is detected by a scanning station 200, the process of associating that scanning station 200 and the scanner 100 that broadcasted the connection request proceeds. This may involve establishing 310 a secure connection comprising one or more of the following: a challenge request to verify the scanner, short-term key distribution, or long-term key distribution. Finally, the wireless operational connection is established 312 by opening a communication channel between the scanner 100 and the scanning station 200. This will allow the scanner 100 to transmit image data and/or preprocessed image data to the scanning station 200, whereby the user may have a substantially real-time view of the current field of view of the scanner 100 to help the user navigate and maneuver the scanner 100
inside the oral cavity of the patient. Also, the image data and/or preprocessed image data may be used to generate the 3D representation.
Fig. 7 shows a process chart of the method described in connection with Fig. 6. In response to receiving the connection request from a scanner 100, the scanning station optionally respond by issuing a challenge request to verify the scanner 100. After receiving the challenge request, the scanner may reply by transmitting a challenge response via the first wireless interface. If the challenge response is accepted by the scanning station 200, the scanning station may proceed to output the indication that the connection request has been received and await acceptance or dismissal from the user.
The challenge request may comprise an action required to be performed on the scanner 100 and the required action may be outputted at the scanning station 200. The action required to be performed on the scanner 100 may be a push sequence of the one or more buttons 118 and/or moving the scanner 100 in a specific movement pattern, e.g. moving the scanner 100 in a counterclockwise circular motion, which is detected by the one or more movement sensor(s) 120. The required action may be outputted visually on a display of the scanning station 200 and/or audibly from a speaker of the scanning station 200. This makes it more difficult to establish an unauthorized connection to a scanning station 200 as one must be in proximity of the scanning station 200 to perceive the outputted solution to the challenge request in order to complete the action required to be performed on the scanner 100.
The challenge request may comprise a request for a scanner certificate and the challenge request may be the scanner certificate. The challenge may thereby be at least partly completed upon verification, by the scanning station 200, of the scanner certificate. The scanner certificate may be stored in the memory 124 of the scanner 100 where it may have been put at a time of manufacture of the scanner 100. Verification of the scanner certificate may comprise validating the scanner certificate by comparing it to a comparison certificate obtained from a webserver, e.g. a webserver of the manufacturer of the scanner 100.
The challenge request may comprise the scanner 100 and the scanning station 200 being within a certain distance of each other, i.e. below a connection proximity threshold, detected using the location determination unit 122 of the scanner 100. By using a proximity threshold as a limitation for establishing a wireless operational connection, it is made harder to establish an unauthorized connection to the scanning station 200, as scanner 100 must be in the vicinity of the scanning station 200 in order establish the wireless operational connection. The proximity threshold may be set by geofencing such that the scanner 100 must be within a geofence defining the clinic to which the scanner 100 is associated, whereby a wireless operational connection to the scanning station 200 may only be established if the scanner 100 is located in the clinic.
If the challenge request is successfully completed and the connection request accepted the scanner 100 and the scanning station 200 may proceed to exchange keys to encrypt communication between the two. Key distribution may comprise distribution of short-term keys for use in a current session and/or long-term keys for use in the current and future sessions.
Fig. 8 shows an example of a GUI 400 of the invention presented on a display 204 at a scanning station 200. The GUI 400 comprises a visual representation 402 of a scanner 100, wherein the visual representation 402 comprises a photo of the model of the scanner 100 and text identifying the scanner 100 and current connection status. Upon receiving a connection request from the scanner 100, the GUI 400 will output an indication 404 that the connection request has been received linked to the visual representation of the scanner 100 so that the user can easily identify the scanner from other scanners available on the network. In the shown embodiment, the indication 404 that the connection request has been received is outputted in the form of a changing boundary box around the visual representation 402, thereby making the user aware that a connection request has been received from the scanner 100. The indication 404 that the connection request has been received may be represented by the boundary box doing one or more of the following: fading in and out, flashing, changing color, or shaking. The indication 404 that the connection request has been received may comprise a pop-up box in the GUI with a virtual approve button.
Additionally or alternatively, the indication 404 that the connection request has been received may comprise changes to the visual representation 402 of a scanner 100, such as movement, enlargement, and/or fading in and out of the visual representation 402. Movement of the visual representation may be a preset animation or it may be linked to movement detected by the one or more movement sensor(s) so that the visual representation 402 moves in a manner corresponding to movement of the scanner, whereby the user may in full confidence identify the visual representation linked to the scanner they are holding as movement of that visual representation will correspond to how they are moving the scanner.
The user may then proceed to approve the connection request through the user interaction indicative of approval of establishing the wireless operational connection. The user interaction indicative of approval of establishing the wireless operational connection may be an interaction with the GUI 400, such as pressing an accept connection button in the GUI 400 or simply by pressing the visual representation 402 of the scanner 100 using a mouse cursor or a touchscreen, after which an operational connection between that scanning station 200 and that scanner 100 is established.
The GUI 400 may further comprise one or more other visual representations 406 associated with other scanners connected to the scanning network 250. The other visual representations 406 may like the visual representation 402 of a scanner 100 comprise a photo of the model of the respective other scanners and text identifying them and their current connection status. The more scanners a
clinic uses, the more advantageous the disclosed method becomes, as the GUI 400 becomes increasingly cluttered with an increasing number of scanners. The disclosed invention thus facilitates associating a particular scanner 100 with a scanning station by allowing the user through simple interactions with that scanner 100 to quickly identify it on the display of their current scanning station 200 and establish the operational connection between the two.
Fig. 9 shows another example of a GUI 400 of the invention wherein the GUI 400 further comprises second visual representation 408 used if the scanner 100 broadcasting the connection request has not been paired with the scanning station 200 and/or scanning network 250. The second visual representation 408 may be realized like the visual representation 402 of Fig. 8.
When connecting a scanner 100 to a scanner network 250 or a scanning station 200 for the first time, further steps may be required to pair the scanner 100 so that communication between the scanner network 250 or the scanning station 200 is encrypted and secure. This may comprise a challenge request issued by the scanning station 200 to the scanner 100, to which the scanner must respond with a challenge response. The challenge request may require the user to perform a user interaction on the scanner 100, e.g. a button and/or gesture pattern, which the scanner 100 detects by the scanner interface and use to generate a challenge response. The required user interaction may be presented in the GUI 400, which will allow a user to see the answer, while someone without visual access to the scanning station 200 would not be able to complete the challenge request.
Fig. 10 shows a scanner system comprising an intraoral scanner 100, a scanning station 200, and a wireless network node 230. The scanning station 200 comprises a computer 202 operatively connected to a first display 204a on which the scanning station 200 may output the GUI 400 and other visual information. The scanner system also comprises a second display 204b, which in the shown figure is connected directly to the scanning station 200, but which may alternatively be connected to the scanning station 200 via a scanner network. The first display 204a and/or the second display 204b may be operatively connected to the computer 202 by a wired connection, e.g. by an HDMI or DisplayPort cable, or by a wireless connection. If either of the first display 204a and/or the second display 204b a connected through a wireless connection the respective display must comprise a display wireless interface, referred to herein as a third wireless interface 206. The third wireless interface 206 is configured for connecting its display to the computer 202, either through a direct wireless connection or through a scanning network 250. The first display 204a may be a permanent display of the scanning station 200, e.g. if the scanning station 200 is provided by a laptop, while the second display 204b may be a display connected to the scanning network 250.
During scan sessions the scanning station 200 may also output the partial 3D representation of the ongoing scan session as the scan progresses to guide the user through the scanning process, e.g. to indicate which part of a jaw or the oral cavity of the patient that has yet to be scanned, and provide
the user with options for controlling the scan process, e.g. through menus in which the user may select various scan options. To do this, it is advantageous that the first display is a smaller display such as a laptop display or a display mounted on a portable stand or an adjustable arm mounted near a dental chair, so that the user may have the first display close without obstructing a dental procedure, and so that they may move it during a procedure unlike a fixed wall mounted display.
After a scan session, the scanning station 200 may further output the finalized 3D representation for the user to inspect or to help the user engage in dialogue with the patient, e.g. to explain the patient’s dental health status and possible treatments if such are needed. The user could wish to do this on a larger display so as to get a more detailed view of the 3D representation or to better present it to the patient. The second display 204b could therefore be a larger display better suited for this purpose, such as a large wall mounted display.
While the scan of the patient might be complete, the user may have to continue to work on the patient with other dental procedures. Touching objects such as a remote control, keyboard, touchscreen, or mouse to select an output for the scanning station 200 would therefore be a great inconvenience to the user, as they would have to re-sterilize before resuming work on the patient’s mouth, so as to avoid risking infection for the patient. It may therefore be advantageous to provide the user with a scanner 100 capable of selecting the output device as will be explained in detail below.
Fig. 11 shows a scanner system like the one described above in Fig. 10. In the shown embodiment, the scanning station 200 is provided by a laptop comprising the first display 204a. A second display 204b is provided by a monitor which is wirelessly connected to the scanning network 250 through the third wireless interface 206 of the second display 204b.
To select which of the first display 204a or the second display 204b should be used as the output device for the scanning station 200, the scanner 100 comprises a scanner interface having one or more movement sensor(s) 120 configured for detecting movement of the intraoral scanner 100 for the provision of movement data. The movement data is transferred to the scanning station 200, preferably through a wireless connection, although a wired connection may suffice for this application. The scanning station 200 is configured for determining which of the first display 204a or the second display, and possibly other available output devices, the scanning station 200 should output data to based on the movement data.
As shown in Fig. 10, this may be when the movement data indicates that the user has pointed the scanner 100 towards the first display 204a and performed a swipe in a direction towards the second display 204b, which the scanning station 200 may be configured to translate into a user command to change the output device from the first display 204a to the second display 204b. This gesture based output device selection may be accompanied by other user interactions, such as holding one
of the one or more button(s) pressed while performing the movement, so that the user is less likely to accidentally switch output device.
While the figure uses a swipe to exemplify the gesture needed to generate movement data for selecting the output device, the scanner system could be configured to associate other gestures with an intention of switching output device by the user. The scanning station 200 may determine which output device should be selected by comparing the movement data to an output criterion of each available output device. The output criteria may be stored as data in a memory of the scanning station 200. The output criteria may be default settings so that the movement the user has to perform while holding the scanner 100 to select a particular output device is preset, or the output criteria may be user defined settings so that the user can customize the movement the user has to perform while holding the scanner 100 to select a particular output device.
Changing between the first display 204a and the second display 204b may comprise putting the former output display in a sleep mode and/or activating the new output display from a sleep mode. Changing between the first display 204a and the second display 204b may comprise establishing an operational wireless connection between the scanning station 200 and the new output display. Changing between the first display 204a and the second display 204b may comprise suspending an operational wireless connection between the scanning station 200 and the former output display. Suspending the operational wireless connection between the scanning station 200 and the former output display may be delayed so that the operational wireless connection is maintained for a period of time after switching display mode, in case the user wishes to resume work on the former output display.
While a first display 204a and a second display 204b have been used to exemplify possible output devices of the scanning station 200, other or additional output devices could also be used. The intraoral scanner system may comprise a local server 210 for storing data for all scanning stations on the scanner network 250 or a connection to cloud storage 220, either of which could be output devices selected by the user performing gestures associated with the selection of them as the output device.
Fig. 12 shows a process flow diagram of a dental workflow 500. The dental workflow 500 starts by the user scanning 502 at least part of the patient’s oral cavity using an intraoral scanner 100 to create 3D representation data comprising a 3D representation of the scanned parts of the patient’s oral cavity. To guide the user through the scanning 502 they will likely want to output the partial 3D representation on the first display 204a to visually determine the progress and which parts of the patient’s oral cavity are yet to be scanned.
Subsequently, the user may want to examine 504 the resulting 3D representation or present 504 it to the patient on a bigger screen. For this purpose, the user may select the second display 204b as the output device by using gestures holding the scanner 100 that will produce movement data associated with a selection of the second display 204b by the scanning station 200. The user may further select a server 210 as the output device for storing 506 the 3D representation data on the patient’s journal, and/or forward the 3D representation data to a colleague for further diagnostics 508 by selecting the colleague’s computer as the output device, both of which may be done by performing the appropriate gestures while holding the scanner 100. After these, the user may then resume 510 working on the patient to perform other dental procedures, which would require the user to change their gloves and re-sterilize if they had been using unsterile equipment to select the output devices for the previous steps.
Fig. 13 shows an example of the first display 204a displaying a graphical user interface, GUI, 400. The GUI 400 comprises a movable selection tool 410, e.g. a cursor, for manoeuvring and selecting options in the GUI 400. The scanning station 200 may be configured for translating the movement data provided by the scanner 100 into movement of the selection tool 410, and similarly translate button presses on the scanner 100 into a selection of an option associated with the selection tool’s 410 current position, thereby allowing the scanner 100 to function as a pointer.
In the shown embodiment, at least some, or all, of the output criteria are linked to the GUI 400 and realized as invisible boundary conditions 412, 414 arranged at the edges of the GUI 400. The GUI 400 comprises a first boundary condition 412, which may as an example be the output criterion of the second display 204b, and the scanning station 200 may be configured to determine that the output criterion of the second display 204b is fulfilled when the user, via movement of the scanner 100, cause the scanner 100 to generate movement data that cause the selection tool 410 to move to or past the first boundary condition 412. The first boundary condition 412 is arranged at the right edge of the GUI 400, so the user would have to make a rightwards movement with the scanner 100, optionally while holding a button pressed, to move the selection tool 410 to or past the first boundary condition 412, at which point the scanning station would determine that the output criterion of the device associated, e.g. the second display 204b, with the first boundary condition 412 would be fulfilled and select that device as the output destination.
Similarly, the GUI 400 comprises a second boundary condition 414, which may as an example be the output criterion of cloud storage 220, and the scanning station 200 may be configured to determine that the output criterion of cloud storage 220 is fulfilled when the user, via movement of the scanner 100, cause the scanner 100 to generate movement data that cause the selection tool 410 to move to or past the second boundary condition 414. The second boundary condition 414 is arranged at the upper edge of the GUI 400, so the user would have to make an upwards movement
with the scanner 100, optionally while holding a button pressed, to move the selection tool 410 to or past the second boundary condition 414, at which point the scanning station 200 would determine that the output criterion of the cloud storage 220 would be fulfilled and select it the output destination.
By leveraging the one or more movement sensor(s) 120 of the scanner 100 as control means for the scanning station 200, the user may control the scanning station 200 and select output device, without risking contaminating their hands, they may therefore continue with the scanning session uninterrupted by a need to re-sterilize their hands. This not only saves time for the user, and thereby also reduces cost for the patient, it also reduces the risk that a forgetful user would touch a contamination source and resume scanning without sterilizing, which could lead to infection for the patient.
The method and system described above for selecting output devices based on gesture control detected by an intraoral scanner 100, may be expanded by replacing or supplementing the detection of movement by the one or more movement sensor(s) 120 of the scanner 100 with other gesture detection means. Hence, the movement data may additionally or alternatively be provided by other means for detecting gestures of a user, such as a camera device tracking the user’s eye movement and/or a LIDAR device tracking hand gestures of the user, whereby the user is provided with the option of selecting an output device among several available output devices while in a dental workflow 500.
Fig. 14 shows a set of intraoral scanners comprising a first scanner 100a and a second scanner 100b. The first and second scanners 100a, 100b each comprise a memory 124 in which configuration settings may be stored. The configuration settings may comprise one or more of the following: stored network credentials for a scanning network 250, user settings modifying operations of the scanner 100 from a default setting of the scanner 100, a scanner certificate, long-term keys for encrypted communication with paired devices. For a clinic having a scanner 100 and acquiring another one, it may be time-consuming to set up the new scanner with configuration settings matching their original scanner. This may be mitigated by providing a scanner 100 configured for operating in a cloning mode, where configuration settings of another scanner are cloned onto the scanner 100.
In the shown embodiment, the first scanner 100a is a configured scanner customized by a user. The second scanner 100b on the other hand is a new scanner with default settings, which the user might want to customize like the first scanner 100a. The first and second scanner 100a, 100b are configured for operating in a cloning mode, in which a wireless scanner-to-scanner connection 150 is established allowing data to be exchanged between the first and second scanner 100a, 100b. When entering the cloning mode, each scanner 100a, 100b will have to enter a sub-mode of either a source scanner cloning mode or a destination scanner cloning mode to define the direction of the
cloning process. The first scanner 100a, referred to as the source scanner 100a, will thus enter the source scanner cloning sub-mode, while the second scanner 100b, referred to as the destination scanner 100b, will enter the destination scanner cloning sub-mode.
In the cloning mode, the source scanner 100a will generate configuration setting data packages based on the source scanner’s 100a configuration settings. The source scanner 100a is configured for transmitting the configuration setting data packages to the destination scanner 100b via the scanner-to-scanner connection 150. Upon receiving the configuration setting data packages, the destination scanner 100b will store new configuration settings based on the configuration setting data packages in its memory 124 and reboot if needed, whereby destination scanner 100b will be customized identically to the source scanner 100a.
The scanner-to-scanner connection 150 may be independent of a primary wireless connection used to connect to the scanning station 200 and scanner network 250, so that the source scanner 100a can be cloned without losing any pre-existing connections. In addition, the scanner-to-scanner connection 150 should be secure and encrypted, since network credentials and other potential private information will be cloned.
To enter the cloning mode, the one or more buttons 118 may be used by providing a scanner 100 that is configured to associate a first button pressing pattern with a user command to enter the cloning mode, possibly in combination with the scanner 100 being powered on. The first button pressing pattern may be followed by a second button pressing pattern to identify the source scanner 100a or a third button pressing pattern to identify the destination scanner 100b, so the direction of cloning is obvious. The simplest first button pressing pattern would be to only use a single button press, optionally while powering on, on the destination scanner 100b, while being near to an already powered on source scanner 100a. In this scenario, all scanners are ready to be cloned from at any time as the cloning is triggered by the destination scanner 100b.
To reduce the risk of the user unintentionally triggering the cloning process and accidentally overwriting a scanner 100 the first button pressing pattern may be more complex than a simple button push, e.g. require a combination and/or prolonged hold of one or more buttons 118. Entering the cloning mode may also cause one or both scanners 100a, 100b to output a cloning notification, such as a haptic, audible, and/or visual notification, after which the scanners 100a, 100b wait for a preset duration to allow the user to abort or require a further user interaction to confirm that the scanners 100a, 100b should enter the cloning mode.
To reduce battery consumption of the scanner-to-scanner connection 150, it might only be active for the duration required of cloning process. Establishing the scanner-to-scanner connection 150 may therefore be initiated by entering the cloning mode, and the scanner-to-scanner connection 150 may
be suspended when the destination scanner 100b determines it has received the configuration setting data packages.
Fig. 15 illustrates how the one or more movement sensor(s) 120 may be used to define the direction of the cloning process. Upon entering the cloning mode, the user may perform a user interaction indicating the direction while holding one of the scanners 100a, 100b. In the shown embodiment, the user holds the source scanner 100a and performs a swiping movement towards the destination scanner 100b, which the one or more movement sensor(s) 120, optionally supported by the location determination unit 122, whereby the scanners 100a, 100b may determine which is the source scanner 100a and which is the destination scanner 100b based on the movement data generated by the detection of this movement.
Fig. 16 illustrates a cloning setup where the source scanner 100a has an active wireless operational connection to a scanning station 200 in addition to the scanner-to-scanner connection 150. To prevent any actor with access to a scanner 100, or a device imitating a scanner, from initiating a cloning without authorization, entering the cloning mode may require the source scanner 100a receiving a cloning approval from the scanning station 200 to add an extra layer of protection. When detecting the first button pressing pattern on one or both of the source scanner 100a or the destination scanner 100b, the source scanner 100a may transmit a cloning request to the scanning station 200 which then outputs a notification and option to approve cloning in the GUI 400. If the user approves cloning, the scanning station 200 will transmit the cloning approval to the source scanner 100a so that the scanning process may proceed.
Fig. 17 Illustrates a cloning process where the configuration settings the user wants cloned onto the destination scanner 100b are stored in a scanning station 200. In this extended case, where the configuration settings are cloned from a scanning station 200, an application running on the scanning station 200 acts as the clone source instead of a source scanner 100a. The scanning station 200 should support the requisite wireless technology. Prior to initiating the clone, the application is started and configured for cloning. Then the cloning trigger pattern is used on the destination scanner to initiate a configuration clone from the application.
Fig. 18 shows a flow chart for proximity assisted establishment of the wireless operational connection between an intraoral scanner 100 and a scanning station 200 amongst multiple scanning stations. The method may be initiated automatically, or optionally comprise detecting 600 a user interaction indicative of an intention of establishing a wireless operational connection by the intraoral scanner. As previously disclosed, this may comprise detecting, by one or more movement sensors of the intraoral scanner, a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection.
Once the method is initiated, the method comprises detecting 602 a distance between the intraoral scanner 100 and at least some, preferably all, of the scanning stations, followed by determining 604 a scanning station 200 of the multiple scanning stations that is closest to the intraoral scanner 100 amongst the scanning stations. Before establishing the wireless operational connection, the method optionally comprises issuing 606 a challenge request by the scanning station determined to be the closest to the intraoral scanner 100, and responding 608 to the challenge request by the intraoral scanner 100. The method may optionally further comprise distributing 610 short- and/or long-term keys between the intraoral scanner 100 and the scanning station determined to be the closest to the intraoral scanner 100. Finally, the method comprises establishing 612 the wireless operational connection between the intraoral scanner 100 and the scanning station 200 determined to be closest to the intraoral scanner 100.
Fig. 19 shows a flow chart for location assisted establishment of the wireless operational connection between an intraoral scanner 100 and a scanning station 200 amongst multiple scanning stations. The method may be initiated automatically, or optionally comprise detecting 700 a user interaction indicative of an intention of establishing a wireless operational connection by the intraoral scanner. As previously disclosed, this may comprise detecting, by one or more movement sensors of the intraoral scanner, a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection.
Once the method is initiated, the method comprises detecting 702 a location of the intraoral scanner 100, followed by determining 704 a scanning station 200 of the multiple scanning stations that is associated with the detected location. Before establishing the wireless operational connection, the method optionally comprises issuing 706 a challenge request by the scanning station determined to be the closest to the intraoral scanner 100, and responding 708 to the challenge request by the intraoral scanner 100. The method may optionally further comprise distributing 710 short- and/or long-term keys between the intraoral scanner 100 and the scanning station determined to be the closest to the intraoral scanner 100. Finally, establishing 712 the wireless operational connection between the intraoral scanner and the scanning station determined to be associated with the detected location.
Fig. 20 illustrates examples of shaking directions the one or more movement sensor(s) 120 is/are configured for detecting. The gesture of shaking the scanner as a user interaction may be used for all of the methods and systems disclosed above. The one or more movement sensor(s) 120 may be configured for detecting linear shaking, i.e. movement in a longitudinal direction 802 of the scanner 100 and/or in a width or height direction 800 of the scanner 100, and/or detecting rotational shaking 804, i.e. rotation about a pivoting point of the scanner 100.
The use of the terms "first", "second", "third" and "fourth", "primary", "secondary", "tertiary" etc. does not imply any particular order, but are included to identify individual elements. Moreover, the use of the terms "first", "second", "third" and "fourth", "primary", "secondary", "tertiary" etc. does not denote any order or importance, but rather the terms "first", "second", "third" and "fourth", "primary", "secondary", "tertiary" etc. are used to distinguish one element from another. Note that the words "first", "second", "third" and "fourth", "primary", "secondary", "tertiary" etc. are used here and elsewhere for labelling purposes only and are not intended to denote any specific spatial or temporal ordering. Furthermore, the labelling of a first element does not imply the presence of a second element and vice versa.
It is to be noted that the word "comprising" does not necessarily exclude the presence of other elements or steps than those listed. It is to be noted that the words "a" or "an" preceding an element do not exclude the presence of a plurality of such elements.
It should further be noted that any reference signs do not limit the scope of the claims, that the exemplary embodiments may be implemented at least in part by means of both hardware and software, and that several "means", "units" or "devices" may be represented by the same item of hardware.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.
Although embodiments and features have been shown and described, it will be understood that they are not intended to limit the claimed invention, and it will be made obvious to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the claimed invention. The specification and drawings are, accordingly to be regarded in an illustrative rather than restrictive sense. The claimed invention is intended to cover all alternatives, modifications, and equivalents.
Further details
Embodiments of the invention are disclosed in the following list of enumerated items:
1. A method for establishing a wireless operational connection between an intraoral scanner and a scanning station, the method comprising:
- detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection;
- based on the detection of the user interaction indicative of an intention of establishing a wireless operational connection, broadcasting, by the intraoral scanner, a connection request;
- receiving, by the scanning station, the connection request; and
- outputting, by the scanning station, an indication that the connection request has been received.
2. The method of item 1 further comprising:
- detecting, by the scanning station, a user interaction indicative of approval of establishing the wireless operational connection; and
- establishing the wireless operational connection between an intraoral scanner and a scanning station.
3. The method of any of the previous items, wherein detecting the user interaction indicative of an intention to establishing the wireless operational connection comprises:
• detecting, by one or more movement sensors of the intraoral scanner, a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection.
4. The method of item 3 wherein the movement pattern is a shake of the intraoral scanner.
5. The method of any of the previous items when dependent on item 2, wherein establishing the wireless operational connection between an intraoral scanner and a scanning station comprises:
• by the scanning station, issuing a challenge request to the intraoral scanner;
• by the intraoral scanner, obtaining a challenge response to the challenge request;
• transmitting the challenge response from the intraoral scanner to the scanning station.
6. The method of any of the previous items when dependent on item 2, wherein establishing the wireless operational connection between the intraoral scanner and the scanning station comprises:
• distributing short-term keys and/or long-term keys between the intraoral scanner and the scanning station.
7. The method of any of the previous items, wherein outputting an indication that the connection request has been received comprises displaying, on a display of the scanning station, a graphical user interface, GUI, comprising a visual representation of the intraoral scanner.
8. The method of item 7, wherein the GUI comprises a visual representation of one or more other available intraoral scanners, and wherein the indication that the connection request has been received comprises emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners.
9. The method of item 8, wherein emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners comprises one or more of enlarging, shaking, framing, or flashing the visual representation of the intraoral scanner.
10. An intraoral scanner system comprising:
- an intraoral scanner comprising:
• a scanner interface configured for detecting a user interaction indicative of an intention to establishing a wireless operational connection, and
• a first wireless interface configured for, based on the detection of the user a user interaction indicative of an intention to establishing a wireless operational connection, broadcasting a connection request,
- a scanning station comprising:
• a second wireless interface configured for receiving the connection request, and
• a display configured for outputting a graphical user interface, GUI, comprising an indication that the connection request has been received.
11. The intraoral scanner system of item 10, wherein the scanning station further comprises:
• a scanning station interface configured for detecting a user interaction indicative of approval of establishing the wireless operational connection, wherein intraoral scanner system is configured for establishing the wireless operational connection between an intraoral scanner and a scanning station, upon detecting the user interaction indicative of approval of establishing the wireless operational connection.
12. The intraoral scanner system of items 10 or 11 , wherein the user interaction indicative of an intention to establishing the wireless operational connection comprises a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection, and wherein the scanner interface comprises one or more movement sensor(s) configured for detecting the movement pattern.
13. The intraoral scanner system of item 12, wherein the movement pattern is a shake of the intraoral scanner.
14. The intraoral scanner system of any of items 10-13 when dependent on item 12, wherein the scanning station is configured for obtaining a challenge request and transmitting the challenge request to the intraoral scanner; and wherein the intraoral scanner is configured for obtaining a challenge response to the challenge request and transmitting the challenge response to the scanning station.
15. The intraoral scanner system of any of items 10-14 when dependent on item 2, wherein the intraoral scanner and/or the scanning station are configured for obtaining one or more short-term key(s) and/or long-term key(s) and distributing the one or more short-term key(s) and/or long-term key(s) between the intraoral scanner and the scanning station.
16. The intraoral scanner system of any of items 10-15, wherein the GUI comprises a visual representation of the intraoral scanner.
17. The intraoral scanner system of item 16, wherein the GUI comprises a visual representation of one or more other available intraoral scanners, and wherein the indication that the connection request has been received comprises emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners.
18. The intraoral scanner system of item 17, wherein emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners comprises one or more of enlarging, shaking, framing, or flashing the visual representation of the intraoral scanner.
19. A data processing system, such as an intraoral scanner system, comprising one or more processors configured to perform the steps of the method of any of items 1-9.
20. A computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of the method of any of items 1-9.
21 . A method for establishing a wireless operational connection between an intraoral scanner and a scanning station of multiple scanning stations, the method comprising:
- detecting a distance between the intraoral scanner and at least some, preferably all, of the scanning stations;
- determining a scanning station of the multiple scanning stations that closest to the intraoral scanner amongst the scanning stations; and
establishing the wireless operational connection between the intraoral scanner and the scanning station that is closest to the intraoral scanner.
22. A method for establishing a wireless operational connection between an intraoral scanner and a scanning station of multiple scanning stations, the method comprising:
- detecting a location of the intraoral scanner;
- determining a scanning station of the multiple scanning stations that is associated with the detected location;
- establishing the wireless operational connection between the intraoral scanner and the scanning station determined to be associated with the detected location.
23. The method of items 21 or 22, wherein the method is initiated by detecting, by the intraoral scanner, a user interaction indicative of an intention to establishing the wireless operational connection.
24. The method of item 23, wherein detecting the user interaction indicative of an intention to establishing the wireless operational connection comprises:
• detecting, by one or more movement sensors of the intraoral scanner, a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection.
25. The method of item 24, wherein the movement pattern is a shake of the intraoral scanner.
26. The method of any of items 21-25, wherein establishing the wireless operational connection between an intraoral scanner and a scanning station comprises:
• by the scanning station, issuing a challenge request to the intraoral scanner;
• by the intraoral scanner, obtaining a challenge response to the challenge request;
• transmitting the challenge response from the intraoral scanner to the scanning station.
27. The method of any of items 21-26, wherein establishing the wireless operational connection between the intraoral scanner and the scanning station comprises:
• distributing short-term keys and/or long-term keys between the intraoral scanner and the scanning station.
28. An intraoral scanner system comprising:
- an intraoral scanner comprising a first wireless interface;
- multiple scanning stations, each comprising a second wireless interface; and
a location determination system configured for detecting a distance between the intraoral scanner and at least some of the multiple scanning stations and/or a location of the intraoral scanner, wherein the intraoral scanner system is configured for establishing a wireless operational connection between the intraoral scanner and the scanning station of the multiple scanning stations that is closest to the intraoral scanner, or wherein the intraoral scanner system is configured for establishing a wireless operational connection between the intraoral scanner and a scanning station associated with the detected location.
29. The intraoral scanner system of item 28, wherein the intraoral scanner further comprises a scanner interface configured for detecting a user interaction indicative of an intention to establishing the wireless operational, and wherein the intraoral scanner system is configured for initiating the detection of the distance or location, and establishing a wireless operational connection between the intraoral scanner and a scanning, upon detecting the user interaction indicative of an intention to establishing the wireless operational.
30. The intraoral scanner system of item 29, wherein the user interaction indicative of an intention to establishing the wireless operational connection comprises a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection, and wherein the scanner interface comprises one or more movement sensor(s) configured for detecting the movement pattern.
31 . The intraoral scanner system of item 30, wherein the movement pattern is a shake of the intraoral scanner.
32. The intraoral scanner system of any of items 28-31 , wherein the multiple scanning stations are configured for obtaining a challenge request and transmitting the challenge request to the intraoral scanner; and wherein the intraoral scanner is configured for obtaining a challenge response to the challenge request and transmitting the challenge response to the scanning station of the multiple scanning stations that is closest to the intraoral scanner or to the scanning station associated with the detected location.
33. The intraoral scanner system of any of items 28-32, wherein the intraoral scanner and/or the scanning stations are configured for obtaining one or more short-term key(s) and/or long-term key(s) and distributing the one or more short-term key(s) and/or long-term key(s) between the intraoral
scanner and the scanning station of the multiple scanning stations that is closest to the intraoral scanner or to the scanning station associated with the detected location.
34. The intraoral scanner system of any of items 28-33, wherein intraoral scanner comprises a location determination unit which provides at least part of the location determination system.
35. The intraoral scanner system of item 34, wherein the location determination unit comprises one or more location sensor(s) configured for transmitting a position signal and/or one or more location beacon(s) configured for detecting a location of the scanner.
36. A data processing system, such as an intraoral scanner system, comprising one or more processors configured to perform the steps of the method of any of items 21-27.
36. A computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of the method of any of items 21-27.
37. An intraoral scanner system comprising:
- an intraoral scanner comprising
• an optical system having a projector unit and a camera unit, the optical system being configured for capturing multiple 2D images for the provision of image data, and
• a scanner interface having one or more movement sensor(s) configured for detecting movement of the intraoral scanner for the provision of movement data; and
- scanning station operationally connected to the intraoral scanner, the scanning station comprising
• one or more processor(s) configured for generating 3D representation data based on the image data,
• an output interface configured for being connected to multiple output devices, the output interface being configured for providing output data based on the 3D representation data to a selected output device amongst the multiple output devices, and
• a first display, the first display being one of the multiple output devices, wherein the scanning station is configured for determining which of the multiple output devices is the selected output device based on the movement data.
38. The intraoral scanner system of item 37, wherein the multiple output devices comprise a second display, wherein the scanning station is configured for changing between a first display mode, in which the first display is used as the main display, and a second display mode, in which the second display is used as the main display.
39. The intraoral scanner system of item 38, wherein the scanning station is configured for, when changing from the second display mode to the first display mode, putting the second display into a reduced power mode, such as an idle or off mode.
40. The intraoral scanner system of items 38 or 39, wherein the scanning station is configured for, when changing from the first display mode to the second display mode, putting the second display from a reduced power mode, such as an idle or off mode, into an active mode.
41. The intraoral scanner system of any of items 37-40, wherein the scanner interface further comprises one or more buttons configured for detecting a user interaction indicative of selecting an output device, wherein the scanning station is configured for determining which of the multiple output devices is the selected output devices based on the detection of the user interaction indicative of selecting an output device.
42. The intraoral scanner system of any of items 37-41 , wherein the movement data comprises data indicating one or more of the following: a movement direction, movement distance, movement speed, rotation direction, and rotation speed of the intraoral scanner.
43. The intraoral scanner system of any of items 37-42, wherein the scanning station is configured for determining whether the movement data fulfills an output device criterion for each of the multiple output devices and if the movement data fulfills one of the output device criteria setting the output device associated with the fulfilled criterion as the selected output device.
44. The intraoral scanner system of any of items 37-43, wherein the scanning station is further configured for translating the movement data into movement of a cursor shown on the first display.
45. The intraoral scanner system of items 43 and 44, wherein the output device criteria are boundary conditions on the first display, and wherein an output device criterion is fulfilled when the cursor is moved past the boundary condition associated with that output device criterion.
46. A method for selecting an output device in an intraoral scanner system comprising an intraoral scanner, a scanning station, and multiple output devices, the method comprising:
- capturing, by the intraoral scanner, multiple 2D images for the provision of image data;
- detecting, by the intraoral scanner, movement of the intraoral scanner for the provision of movement data;
- generating, by the scanning station, 3D representation data based on the image data;
- generating, by the scanning station, output data based on the 3D representation data
- determining which of the multiple output devices is a selected output device based on the movement data; and
outputting the output data to the selected output device.
47. The method of item 46, wherein the multiple output devices comprise a first display and a second display, wherein the method further comprises:
- changing between a first display mode, in which the first display is used as the main display for the scanning station, and a second display mode, in which the second display is used as the main display for the scanning station, based on the movement data.
48. The method of item 47, wherein changing from the second display mode to the first display mode comprises putting the second display into a reduced power mode, such as an idle or off mode.
49. The method of items 47 or 48, wherein changing from the first display mode to the second display mode comprise putting the second display from a reduced power mode, such as an idle or off mode, into an active mode.
50. The method of any of items 46-49, wherein the method further comprises:
- detecting, by one or more button(s) of the intraoral scanner, a user interaction indicative of selecting an output device, wherein determining which of the multiple output devices is a selected output device based on the movement data is further based on the detection of the user interaction indicative of selecting an output device.
51 . The method of any of items 46-50, wherein the movement data comprises data indicating one or more of the following: a movement direction, movement distance, movement speed, rotation direction, and rotation speed of the intraoral scanner.
52. The method of any of items 46-51 , wherein determining which of the multiple output devices is a selected output device based on the movement data comprise:
• determining whether the movement data fulfills an output device criterion for each of the multiple output devices, and
• if the movement data fulfills one of the output device criteria, setting the output device associated with the fulfilled criterion as the selected output device.
53. The method of any of items 46-52, wherein the method further comprises:
- displaying a graphical user interface comprising a cursor; and
- translating the movement data into movement of the cursor.
54. The method of items 52 and 53, wherein the output device criteria are boundary conditions in the graphical user interface, and wherein an output device criterion is fulfilled when the cursor is moved past the boundary condition associated with that output device criterion.
55. A data processing system, such as an intraoral scanner system, comprising one or more processors configured to perform the steps of the method of any of items 46-54.
56. A computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of the method of any of items 46-54.
57. An intraoral scanner comprising:
- an optical system having a projector unit and a camera unit;
- a memory configured for storing configuration settings;
- a processing unit configured for operating based on the configuration settings;
- a scanner interface configured for detecting user interactions;
- a first wireless interface, wherein the intraoral scanner is configured for operating in a cloning mode, in which the intraoral scanner is in one of the following two sub-modes:
• a source scanner cloning mode, in which the intraoral scanner is configured for generating one or more configuration setting data package(s) based on the configuration settings, and transmitting the one or more configuration settings data package(s) via the first wireless interface to another intraoral scanner, and
• a destination scanner cloning mode, in which the intraoral scanner is configured for receiving one or more configuration setting data package(s) via the first wireless interface from another intraoral scanner or from a scanning station, and updating the configuration settings based on the received one or more configuration setting data package(s).
58. The intraoral scanner of item 57, wherein the first wireless interface is configured for providing a direct wireless connection to the other intraoral scanner or scanning station.
59. The intraoral scanner of items 57 or 58, wherein the first wireless interface is configured for providing an encrypted wireless connection to the other intraoral scanner or scanning station.
60. The intraoral scanner of any of items 57-59, wherein the first wireless interface is configured for exchanging encryption keys with the other intraoral scanner or scanning station.
61. The intraoral scanner of any of items 57-60, wherein the scanner interface comprises one or more button(s), wherein the intraoral scanner is configured for entering the cloning mode upon detecting a first button pressing pattern.
62. The intraoral scanner of item 61 , wherein the intraoral scanner is configured for entering the cloning mode in the source scanner cloning mode upon detecting a second button pressing pattern.
63. The intraoral scanner of items 61 or 62, wherein the intraoral scanner is configured for entering the cloning mode in the destination scanner cloning mode upon detecting a third button pressing pattern.
64. The intraoral scanner of item 61 , wherein the scanner interface comprises one or more movement sensor(s), and wherein the intraoral scanner is configured for entering the cloning mode in the source scanner cloning mode upon detecting a first movement pattern.
65. The intraoral scanner of item 64, wherein the intraoral scanner is configured for entering the cloning mode in the destination scanner cloning mode upon detecting a second movement pattern.
66. The intraoral scanner of any of items 57-65, wherein the intraoral scanner is configured for awaiting a cloning approval from the scanning station before entering the source scanner cloning mode.
67. The intraoral scanner of any of items 57-66, wherein the intraoral scanner is configured for transmitting a cloning request to the other intraoral scanner or the scanning station when entering the destination scanner cloning mode.
68. The intraoral scanner of any of items 57-67, wherein the intraoral scanner is configured for outputting a cloning notification when entering the destination scanner cloning mode.
69. The intraoral scanner of any of items 57-68, wherein the intraoral scanner is configured for, when entering the destination scanner cloning mode, waiting for a fixed period or for a user interaction indicative of an intention of updating the intraoral scanner before updating the configuration settings.
69. The intraoral scanner of any of items 57-68, wherein the intraoral scanner comprises a location determination unit configured for detecting a distance to the other intraoral scanner or scanning station, wherein the intraoral scanner is configured for only entering the cloning mode when the detected distance is below a cloning proximity threshold.
70. A method for cloning configuration settings onto an intraoral scanner, the method comprising: establishing a wireless operational connection between the intraoral scanner and another intraoral scanner or a scanning station; initiating a cloning mode of the intraoral scanner;
- receiving one or more configuration setting data package(s) from the other intraoral scanner or from the scanning station; and
- updating configuration settings of the intraoral scanner based on the received one or more configuration setting data package(s).
71. The method of item 70, wherein the wireless operational connection is a direct wireless connection to the other intraoral scanner or scanning station.
72. The method of items 70 or 71 , wherein the wireless operational connection is an encrypted wireless connection to the other intraoral scanner or scanning station.
73. The method of items 71 or 72, wherein the method further comprises:
- exchanging encryption keys with the other intraoral scanner or scanning station.
74. The method of any of items 70-73, wherein the method further comprises:
- detecting a first button pressing pattern by a scanner interface comprising one or more button(s) of the intraoral scanner; wherein initiating the cloning mode of the intraoral scanner is based on the detection of the first button press pattern.
75. The method of any of items 70-74, wherein initiating the cloning mode of the intraoral scanner comprises:
• transmitting a cloning request to the other intraoral scanner or the scanning station.
76. The method of any of items 70-75, wherein initiating the cloning mode of the intraoral scanner comprises:
• outputting a cloning notification.
77. The method of any of items 70-76, wherein the method further comprises: waiting for a fixed period or for a user interaction indicative of an intention of updating the intraoral scanner before updating the configuration settings of the intraoral scanner.
78. The method of any of items 70-76, wherein the method further comprises:
- detecting a distance to the other intraoral scanner or scanning station by a scanner interface comprising a location determination unit of the intraoral scanner; wherein initiating the cloning mode of the intraoral scanner is based on the detected distance.
79. The method of item 78, wherein initiating the cloning mode requires that the detected distance is below a cloning proximity threshold.
80. A data processing system, such as an intraoral scanner, comprising one or more processors configured to perform the steps of the method of any of items 70-79.
81. A computer program product comprising instructions which, when the program is executed by an intraoral scanner, cause the intraoral scanner to carry out the steps of the method of any of items 70-79.
List of references
100 intraoral scanner
100a source intraoral scanner
100b destination intraoral scanner
102 scanner tip
104 distal end
106 proximal end
108 optical system
110 processing unit
112 communication unit
114 one or more antenna(s)
116 energy source
118 one or more buttons
120 one or more movement sensor(s)
122 location determination unit
150 scanner-to-scanner connection
200 scanning station
202 computer of scanning station
204 display of scanning station
204a first display of scanning station
204b second display of scanning station
210 one or more local server(s)
220 cloud network
230 wireless network node
250 scanning network
300 detecting a user interaction indicative of an intention of establishing a wireless operational connection
302 broadcasting a connection request
304 receiving the connection request
306 outputting an indication that the connection request has been received
308 detecting a user interaction indicative of approval of establishing the wireless operational connection
310 establishing a secure connection
312 establishing the wireless operational connection
314 terminated without establishing the wireless operational connection
400 Graphical User Interface, GUI
402 visual representation associated with the scanner
404 indication that a connection request has been received
406 one or more other visual representations associated with other scanners
408 second visual representation
500 dental workflow
502 scanning
504 first analysis/consultation with patient
506 storing 3D representation data
508 diagnostics
510 resume work on the patient
600 detecting a user interaction indicative of an intention of establishing a wireless operational connection by the intraoral scanner
602 detecting a distance between the intraoral scanner and the scanning stations
604 determining a scanning station that is closest to the intraoral scanner
606 issuing a challenge request by the scanning station determined to be the closest to the intraoral scanner
608 responding to the challenge request by the intraoral scanner
610 distributing short- and/or long-term keys
612 establishing the wireless operational connection between the intraoral scanner and the scanning station determined to be closest to the intraoral scanner
700 detecting a user interaction indicative of an intention of establishing a wireless operational connection by the intraoral scanner
702 detecting a location of the intraoral scanner
704 determining a scanning station that is associated with the detected location
706 issuing a challenge request by the scanning station determined to be the closest to the intraoral scanner
708 responding to the challenge request by the intraoral scanner
710 distributing short- and/or long-term keys
712 establishing the wireless operational connection between the intraoral scanner and the scanning station determined to be associated with the detected location
800 linear shaking in a width direction of the scanner
802 linear shaking in a longitudinal direction of the scanner
804 rotational shaking about a pivot point of the scanner
Claims
1 . A method for establishing a wireless operational connection between an intraoral scanner and a scanning station, the method comprising:
- detecting, by the intraoral scanner, a user interaction indicative of an intention of establishing a wireless operational connection;
- based on the detection of the user interaction indicative of an intention of establishing a wireless operational connection, broadcasting, by the intraoral scanner, a connection request;
- receiving, by the scanning station, the connection request; and
- outputting, by the scanning station, an indication that the connection request has been received to the user.
2. The method of claim 1 further comprising:
- detecting, by the scanning station, a user interaction indicative of approval of establishing the wireless operational connection; and
- establishing the wireless operational connection between an intraoral scanner and a scanning station.
3. The method of claim 2, wherein establishing the wireless operational connection between an intraoral scanner and a scanning station comprises:
• by the scanning station, issuing a challenge request to the intraoral scanner;
• by the intraoral scanner, obtaining a challenge response to the challenge request;
• transmitting the challenge response from the intraoral scanner to the scanning station.
4. The method of any of the previous claims, wherein detecting the user interaction indicative of an intention to establishing the wireless operational connection comprises:
• detecting, by one or more movement sensors of the intraoral scanner, a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection.
5. The method of claim 4, wherein the movement pattern is a shake of the intraoral scanner.
6. The method of any of the previous claims, wherein outputting an indication that the connection request has been received comprises displaying a graphical interface comprising a visual representation of the intraoral scanner.
7. The method of claim 6, wherein the graphical interface comprises a visual representation of one or more other available intraoral scanners, and wherein the indication that the connection request has been received comprises emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners.
8. The method of claim 7, wherein emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners comprises one or more of enlarging, shaking, framing, or flashing the visual representation of the intraoral scanner.
9. A computer program product comprising instructions which, when the program is executed by an intraoral scanner system, cause the intraoral scanner system to carry out the steps of the method of any of claims 1-8.
10. An intraoral scanner system comprising:
- an intraoral scanner comprising:
• a scanner interface configured for detecting a user interaction indicative of an intention to establishing a wireless operational connection, and
• a first wireless interface configured for, based on the detection of the user a user interaction indicative of an intention to establishing a wireless operational connection, broadcasting a connection request,
- a scanning station comprising:
• a second wireless interface configured for receiving the connection request, and
• a display configured for outputting a graphical interface, GUI, comprising an indication that the connection request has been received.
11. The intraoral scanner system of claim 10, wherein the scanning station further comprises:
• a scanning station interface configured for detecting a user interaction indicative of approval of establishing the wireless operational connection, wherein intraoral scanner system is configured for establishing the wireless operational connection between an intraoral scanner and a scanning station, upon detecting the user interaction indicative of approval of establishing the wireless operational connection.
12. The intraoral scanner system of claims 10 or 11 , wherein the user interaction indicative of an intention to establishing the wireless operational connection comprises a movement pattern of the intraoral scanner associated with the intention to establishing a wireless operational connection, and wherein the scanner interface comprises one or more movement sensor(s) configured for detecting the movement pattern.
13. The intraoral scanner system of claim 12, wherein the movement pattern is a shake of the intraoral scanner.
14. The intraoral scanner system of any of claims 10-13, wherein the GUI comprises a visual representation of the intraoral scanner.
15. The intraoral scanner system of claim 14, wherein the GUI comprises a visual representation of one or more other available intraoral scanners, and wherein the indication that the connection request has been received comprises emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners.
16. The intraoral scanner system of claim 15, wherein emphasizing the visual representation of the intraoral scanner over the visual representation of one or more other available intraoral scanners comprises one or more of enlarging, shaking, framing, or flashing the visual representation of the intraoral scanner.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DKPA202470087 | 2024-03-25 | ||
| DKPA202470087 | 2024-03-25 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025202048A1 true WO2025202048A1 (en) | 2025-10-02 |
Family
ID=95151626
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2025/057761 Pending WO2025202048A1 (en) | 2024-03-25 | 2025-03-21 | A wireless intraoral scanner |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2025202048A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2442720B1 (en) | 2009-06-17 | 2016-08-24 | 3Shape A/S | Focus scanning apparatus |
| US20220233078A1 (en) * | 2021-01-26 | 2022-07-28 | Align Technology, Inc. | Distributed intraoral scanning system |
| WO2023117981A1 (en) | 2021-12-22 | 2023-06-29 | 3Shape A/S | Systems and methods for generating a digital representation of a 3d object |
| US20230329846A1 (en) * | 2020-08-17 | 2023-10-19 | 3Shape A/S | System and method for scanning a dental object |
-
2025
- 2025-03-21 WO PCT/EP2025/057761 patent/WO2025202048A1/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2442720B1 (en) | 2009-06-17 | 2016-08-24 | 3Shape A/S | Focus scanning apparatus |
| US20230329846A1 (en) * | 2020-08-17 | 2023-10-19 | 3Shape A/S | System and method for scanning a dental object |
| US20220233078A1 (en) * | 2021-01-26 | 2022-07-28 | Align Technology, Inc. | Distributed intraoral scanning system |
| WO2023117981A1 (en) | 2021-12-22 | 2023-06-29 | 3Shape A/S | Systems and methods for generating a digital representation of a 3d object |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12171640B2 (en) | Device pairing for distributed intraoral scanning system | |
| KR101977181B1 (en) | Dental intraoral scanner system | |
| JP6663718B2 (en) | Intraoral scanning device with illumination frame incorporated into image frame | |
| CN107427345A (en) | Intraoral scanner with touch-sensitive input | |
| US12611096B2 (en) | Minimalistic intraoral scanning system | |
| US20250120794A1 (en) | Intraoral scanning with remote processing and local viewing | |
| US12599286B2 (en) | Power sources for wireless intraoral scanners | |
| US20170230636A1 (en) | Scanning an object in three dimensions using color dashed line pattern | |
| US12539028B2 (en) | Oral image processing device for processing oral image according to tip coupled to oral scanner and oral image processing method | |
| CN105468210B (en) | Position detection device, projector, and position detection method | |
| CN108446011A (en) | A kind of medical householder method and equipment based on augmented reality | |
| US20260108142A1 (en) | Intraoral scanning system and method for using remote resources | |
| US20250025035A1 (en) | Intraoral scanning system component pairing | |
| WO2022164827A1 (en) | Distributed intraoral scanning system | |
| WO2025202048A1 (en) | A wireless intraoral scanner | |
| WO2025019365A1 (en) | Intraoral scanning system component pairing | |
| KR102705055B1 (en) | A data processing apparatus, a data processing method | |
| CN116887785A (en) | Data processing device and data processing method | |
| JP2015159460A (en) | Projection system, projection apparatus, photographing apparatus, guide frame generation method and program | |
| JP6439398B2 (en) | Projector and projector control method | |
| EP4591783A1 (en) | Scanner, data processing device and data processing method | |
| US20240129447A1 (en) | Data processing device and data processing method | |
| US20240398517A1 (en) | Image processing apparatus and image processing method using same | |
| KR102953378B1 (en) | Medical data wireless transmitter for wirelessly transmitting medical data by selecting the desired receiver | |
| KR20240040634A (en) | A scanner, a data processing apparatus, and a data processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 25714299 Country of ref document: EP Kind code of ref document: A1 |