KR102575920B1 - Dental cad apparatus and control method thereof - Google Patents

Abstract

The dental CAD device according to the present invention is equipped with an input unit that receives scan data of teeth and a pre-trained artificial neural network, and uses the artificial neural network to provide information related to the margin-line of the input scan data. It is characterized by including a control unit for extracting.

Description

Dental CAD device and control method using the same {DENTAL CAD APPARATUS AND CONTROL METHOD THEREOF}

The present invention relates to a dental CAD device and its control method using an artificial neural network.

In dental care, prosthetics are most frequently used to replace missing or damaged teeth. Prosthetic treatment using these prosthetics can restore jaw and tooth function when teeth and surrounding tissues are lost due to cavities, gum disease, external shock, etc.

Currently, in order to manufacture a prosthesis, the patient's oral data is first obtained. Specifically, the dental office sends a model of the patient's mouth to a dental laboratory for processing and scanning, or the dental office scans the patient's teeth using an oral scanner.

When scan data of the target tooth (working tooth) is acquired through the scanning process, the technician uses a CAD program to manually mark the margin-line of the target tooth on the scan data. Setting the margin line is an essential process for the prosthesis to be fully bonded to the target tooth.

In other words, in prosthetic treatment, it is essential for a technician to directly mark the margin line every time a prosthesis is manufactured, so there is a problem that a significant amount of time is spent in terms of cost and time. In addition, there is a problem that the accuracy of the margin line may decrease depending on the technician's ability.

As a solution to this problem, the present invention seeks to provide a dental CAD device equipped with dental CAD software that can actively generate a margin line using recently emerging deep learning technology, and a method for controlling the same.

Meanwhile, artificial intelligence technologies such as deep learning are being applied to process image information. Image identification technology, one of the processing technologies related to image information, is developed for the purpose of detecting what the image is.

In particular, in order to detect a plurality of objects included in an arbitrary image, technology for detecting the corners of an image is being developed.

Considering the process by which a technician detects a margin line, an artificial neural network that has learned tooth scan data with already marked margin lines can set a more accurate margin line than an existing technician using the image recognition technology described above.

J.P. 2012-24496 A US 2021-0059796 A1 KR 10-2019-0074962 A KR 10-2255592 B KR 10-2138921 B

The technical object of the present invention is to provide a dental CAD device and a control method thereof that can detect margin lines of dental scan data using an artificial neural network.
Another technical object of the present invention is a dental CAD device equipped with a pre-trained artificial neural network and including a control unit that extracts information related to the margin line of the input scan data using the artificial neural network. , the artificial neural network performs learning using scan data of teeth and learning data including margin information corresponding to the scan data of the teeth, and provides a dental CAD device including the obtained artificial intelligence model and its control method. It is provided.
Another technical problem of the present invention is that the scan data of the teeth consists of three-dimensional coordinate information, and the control unit generates normal information based on the three-dimensional coordinate information in order to apply the scan data of the teeth to an artificial neural network. To provide a dental CAD device and its control method.
Another technical problem of the present invention is the dental CAD device and its control, wherein the control unit uses an artificial neural network to divide the input scan data of the teeth into upper scan data and lower scan data based on the margin line. It provides a method.

The dental CAD device according to the present invention is equipped with an input unit that receives scan data of teeth and a pre-trained artificial neural network, and uses the artificial neural network to provide information related to the margin-line of the input scan data. It is characterized by including a control unit for extracting.

According to the present invention, the margin lines of teeth required for prosthetic treatment can be automatically created, resulting in cost and time savings.
The present invention is a dental CAD device that is equipped with a pre-trained artificial neural network and includes a control unit that extracts information related to the margin line of the input scan data using the artificial neural network, wherein the artificial neural network Provides a dental CAD device including an artificial intelligence model obtained by performing learning using scan data of teeth and learning data including margin information corresponding to the scan data of the teeth, and a method of controlling the same.
The present invention is a dental CAD device in which the scan data of the teeth consists of three-dimensional coordinate information, and the control unit generates normal information based on the three-dimensional coordinate information in order to apply the scan data of the teeth to an artificial neural network. Provides his control method.
The present invention provides a dental CAD device and a control method thereof, wherein the control unit uses an artificial neural network to divide the input scan data of the teeth into upper scan data and lower scan data based on a margin line. .

Figure 1 is a conceptual diagram showing the components of a dental CAD device, which is the subject of the control method proposed in the present invention.
Figure 2 is a conceptual diagram showing an embodiment of the artificial neural network proposed in the present invention.
Figure 3 is a conceptual diagram showing the process of dividing new tooth scan data.
Figure 4 is a conceptual diagram showing a learning method.
Figure 5 is a conceptual diagram showing a margin line setting method using an artificial neural network.
Figure 6 is a conceptual diagram showing the prosthetic CAD process according to the present invention.

Hereinafter, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the drawings and examples disclosed below. In addition, in order to clearly explain the present invention in the drawings, parts not related to the present invention are omitted, and identical or similar symbols in the drawings indicate identical or similar components.

The purpose and effect of the present invention can be naturally understood or become clearer through the following description, and if it is judged that it may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. Therefore, the purpose of the present invention can be understood only by the following description. and the effect is not limited.

Figure 6 shows the prosthetic CAD process according to the present invention.

As shown in Figure 6, according to the dental CAD software proposed in the present invention, a pre-trained artificial intelligence engine creates a margin for the input tooth scan data without the technician having to directly mark the margin line of the target tooth. -Lines can be extracted.

That is, when the dental CAD device runs the dental CAD software, the dental CAD device 100, that is, the control unit 180, collects customer (patient) information, operation information related to the target tooth, and scan data of the tooth. After receiving the input, the margin-line corresponding to the scan data of the corresponding tooth can be automatically extracted without any additional work by the technician.

This margin-line automatic extraction function is performed by a pre-trained artificial intelligence engine, and the method of training this artificial intelligence engine will be described in more detail below.

In Figure 1, the components of the dental CAD device 100 are explained.

The dental CAD device 100 described in this specification may be defined as a variety of devices that perform data communication, data processing, and predetermined operations, such as a mobile terminal. That is, the dental CAD device 100 is a device that executes dental CAD software defined in the present invention, and the mobile terminal is only an example for convenience of explanation, and embodiments of the present invention are not limited thereto.

As an example, if the dental CAD device 100 is a mobile terminal, the dental CAD device 100 may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), or a PMP. (portable multimedia player), navigation, slate PC, tablet PC, ultrabook, wearable device (e.g., smartwatch), glass-type terminal (smart) glass), HMD (head mounted display), etc. may be included.

However, those skilled in the art will easily understand that, except for the case where the configuration according to the embodiment described in this specification is applicable only to mobile terminals, it can also be applied to fixed terminals such as digital TVs, desktop computers, digital signage, etc. will be.

The dental CAD device 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit ( 190), etc. may be included.

More specifically, among the components, the wireless communication unit 110 is used between the dental CAD device 100 and the wireless communication system, between the dental CAD device 100 and another dental CAD device 100, or between the dental CAD device 100. ) and may include one or more modules that enable wireless communication between the server and an external server. Additionally, the wireless communication unit 110 may include one or more modules that connect the dental CAD device 100 to one or more networks.

This wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example. , touch keys, push keys (mechanical keys, etc.). Voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information within the collection device, information on the surrounding environment surrounding the collection device, and user information. For example, the sensing unit 140 includes a proximity sensor (141), an illumination sensor (142), a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, IR sensor (infrared sensor), fingerprint scan sensor, ultrasonic sensor , optical sensors (e.g., cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (e.g., barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a heat detection sensor, a gas detection sensor, etc.) and a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.).

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a haptip module 153, and an optical output unit 154. can do. The display unit 151 can implement a touch screen by forming a layered structure or being integrated with the touch sensor. This touch screen functions as a user input unit 123 that provides an input interface between the dental CAD device 100 and the user, and can simultaneously provide an output interface between the dental CAD device 100 and the user.

The interface unit 160 serves as a passageway for various types of external devices connected to the dental CAD device 100. This interface unit 160 connects devices equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In the dental CAD device 100, in response to an external device being connected to the interface unit 160, appropriate control related to the connected external device can be performed.

Additionally, the memory 170 stores data supporting various functions of the dental CAD device 100. The memory 170 may store a number of application programs (application programs or applications) running on the dental CAD device 100, data for operating the dental CAD device 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. In addition, at least some of these applications may be present on the dental CAD device 100 from the time of shipment for the basic functions of the dental CAD device 100 (e.g., call incoming and outgoing functions, message receiving and sending functions). there is. Meanwhile, the application program may be stored in the memory 170, installed on the dental CAD device 100, and driven by the control unit 180 to perform the operation (or function) of the dental CAD device.

In addition to operations related to the application program, the control unit 180 typically controls the overall operation of the dental CAD device 100. The control unit 180 can provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components discussed above, or by running an application program stored in the memory 170.

Additionally, the control unit 180 may control at least some of the components examined with FIG. 1 in order to run an application program stored in the memory 170. Furthermore, the control unit 180 may operate at least two of the components included in the dental CAD device 100 in combination with each other in order to drive the application program.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 and supplies power to each component included in the dental CAD device 100. This power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

Below, before looking at various embodiments implemented through the dental CAD device 100 discussed above, the components listed above will be looked at in more detail with reference to FIG. 1.

First, looking at the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives broadcast signals and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channels may include satellite channels and terrestrial channels. Two or more broadcast reception modules may be provided in the dental CAD device 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 uses technical standards or communication methods for mobile communication (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced, etc.), wireless signals are transmitted and received with at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to (Long Term Evolution-Advanced), etc.).

The wireless signal may include various types of data based on voice call signals, video call signals, or text/multimedia message transmission and reception.

The wireless Internet module 113 refers to a module for wireless Internet access and may be built into or external to the dental CAD device 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network based on wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), and WiMAX (Worldwide). Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above.

From the perspective that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is achieved through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, including Bluetooth®, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Short-distance communication can be supported using at least one of NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. This short-range communication module 114 is used between the dental CAD device 100 and a wireless communication system, between the dental CAD device 100 and another dental CAD device 100, or between the dental CAD device 100 through wireless area networks. Wireless communication between the CAD device 100 and a network where another terminal (or external server) is located can be supported. The short-range wireless communication networks may be wireless personal area networks.

Here, the other terminal is a wearable device (or capable of interoperating with) data with the dental CAD device 100 according to the present invention, for example, a smartwatch, smart glass. ), it can be a HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the dental CAD device 100 in the vicinity of the dental CAD device 100. Furthermore, if the detected wearable device is a device certified to communicate with the dental CAD device 100 according to the present invention, the control unit 180 transfers at least a portion of the data processed by the dental CAD device 100 to the short-range communication It can be transmitted to a wearable device through the module 114. Accordingly, the user of the wearable device can use the data processed by the dental CAD device 100 through the wearable device. For example, according to this, when a call is received by the dental CAD device 100, the user makes a phone call through a wearable device, or when a message is received by the dental CAD device 100, the user makes the phone call through the wearable device. It is possible to check received messages.

The location information module 115 is a module for acquiring the location (or current location) of a mobile terminal, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from the user. To input image information, the dental CAD device 100 One or multiple cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by an image sensor in video call mode or shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. Meanwhile, a plurality of cameras 121 provided in the dental CAD device 100 may be arranged to form a matrix structure. Through the cameras 121 forming the matrix structure, the dental CAD device 100 can be viewed at various angles or angles. A plurality of image information having a focus may be input. Additionally, the plurality of cameras 121 may be arranged in a stereo structure to acquire left and right images for implementing a three-dimensional image.

The microphone 122 processes external acoustic signals into electrical voice data. The processed voice data can be utilized in various ways depending on the function (or application program being executed) being performed in the dental CAD device 100. Meanwhile, various noise removal algorithms may be implemented in the microphone 122 to remove noise generated in the process of receiving an external acoustic signal.

The user input unit 123 is for receiving information from the user. When information is input through the user input unit 123, the control unit 180 can control the operation of the dental CAD device 100 to correspond to the input information. there is. This user input unit 123 may be a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the dental CAD device 100, a dome switch, a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, soft key, or visual key displayed on the touch screen through software processing, or a part other than the touch screen. It can be done with a touch key placed in . Meanwhile, the virtual key or visual key can be displayed on the touch screen in various forms, for example, graphic, text, icon, video or these. It can be made up of a combination of .

Meanwhile, the sensing unit 140 senses at least one of information within the collection device, information on the surrounding environment surrounding the collection device, and user information, and generates a sensing signal corresponding thereto. Based on these sensing signals, the control unit 180 may control the driving or operation of the dental CAD device 100, or perform data processing, functions, or operations related to an application program installed on the dental CAD device 100. Representative sensors among the various sensors that may be included in the sensing unit 140 will be looked at in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing nearby without mechanical contact using the power of an electromagnetic field or infrared rays. This proximity sensor 141 may be placed in the inner area of the collection device surrounded by the touch screen as seen above or near the touch screen.

Examples of the proximity sensor 141 include a transmissive photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high-frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of a conductive object by changing the electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself can be classified as a proximity sensor.

Meanwhile, for convenience of explanation, the act of approaching an object on the touch screen without touching it so that the object is recognized as being located on the touch screen is called "proximity touch," and the touch The act of actually touching an object on the screen is called “contact touch.” The position at which an object is close-touched on the touch screen means the position at which the object corresponds perpendicularly to the touch screen when the object is close-touched. The proximity sensor 141 can detect proximity touch and proximity touch patterns (e.g., proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). there is. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and proximity touch pattern detected through the proximity sensor 141, as described above, and further provides visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the control unit 180 can control the dental CAD device 100 so that different operations or data (or information) are processed depending on whether the touch to the same point on the touch screen is a proximity touch or a contact touch. there is.

The touch sensor detects a touch (or touch input) applied to the touch screen (or display unit 151) using at least one of several touch methods such as resistive method, capacitive method, infrared method, ultrasonic method, and magnetic field method. sense

As an example, a touch sensor may be configured to convert changes in pressure applied to a specific part of the touch screen or capacitance occurring in a specific part into an electrical input signal. The touch sensor may be configured to detect the position, area, pressure at the time of touch, capacitance at the time of the touch, etc., at which the touch object that touches the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or stylus pen, or a pointer.

In this way, when there is a touch input to the touch sensor, the corresponding signal(s) are sent to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the control unit 180. As a result, the control unit 180 can determine which area of the display unit 151 has been touched. Here, the touch controller may be a separate component from the control unit 180 or may be the control unit 180 itself.

Meanwhile, the control unit 180 may perform different controls or perform the same control depending on the type of touch object that touches the touch screen (or touch keys provided other than the touch screen). Whether to perform different controls or the same controls depending on the type of touch object may be determined depending on the current operating state of the dental CAD device 100 or the application program being executed.

Meanwhile, the touch sensor and proximity sensor discussed above are used independently or in combination to provide short (or tap) touch, long touch, multi touch, and drag touch on the touch screen. ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. Touch can be sensed.

An ultrasonic sensor can recognize the location information of a sensing object using ultrasonic waves. Meanwhile, the control unit 180 is capable of calculating the location of the wave source through information sensed from an optical sensor and a plurality of ultrasonic sensors. The location of the wave generator can be calculated using the property that light is much faster than ultrasonic waves, that is, the time for light to reach the optical sensor is much faster than the time for ultrasonic waves to reach the ultrasonic sensor. More specifically, the location of the wave source can be calculated using the time difference between the arrival time of the ultrasonic waves using light as a reference signal.

Meanwhile, looking at the configuration of the input unit 120, the camera 121 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor can be combined with each other to detect the touch of the sensing object for a 3D stereoscopic image. A photo sensor can be laminated on the display element, and this photo sensor is configured to scan the movement of a detection object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TR (transistors) in rows/columns and scans the contents placed on the photo sensor using electrical signals that change depending on the amount of light applied to the photo diode. In other words, the photo sensor calculates the coordinates of the sensing object according to the amount of change in light, and through this, location information of the sensing object can be obtained.

The display unit 151 displays (outputs) information processed by the dental CAD device 100. For example, the display unit 151 can display execution screen information of an application running on the dental CAD device 100, or UI (User Interface) and GUI (Graphic User Interface) information according to this execution screen information. there is.

Additionally, the display unit 151 may be configured as a three-dimensional display unit that displays a three-dimensional image.

A three-dimensional display method such as a stereoscopic method (glasses method), an autostereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the three-dimensional display unit.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, etc. The sound output unit 152 also outputs sound signals related to functions performed by the dental CAD device 100 (eg, call signal reception sound, message reception sound, etc.). This sound output unit 152 may include a receiver, speaker, buzzer, etc.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of a tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 can be controlled by the user's selection or settings of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 153 responds to stimulation such as pin arrays moving perpendicular to the contact skin surface, blowing force or suction force of air through a nozzle or inlet, grazing the skin surface, contact with electrodes, and electrostatic force. A variety of tactile effects can be generated, including effects by reproducing hot and cold sensations using elements that can absorb heat or heat.

The haptic module 153 can not only deliver a tactile effect through direct contact, but can also be implemented so that the user can feel the tactile effect through muscle senses such as fingers or arms. Two or more haptic modules 153 may be provided depending on the configuration of the dental CAD device 100.

The optical output unit 154 uses light from the light source of the dental CAD device 100 to output a signal to notify that an event has occurred. Examples of events that occur in the dental CAD device 100 may include receiving a message, receiving a call signal, missed call, alarm, schedule notification, receiving email, receiving information through an application, etc.

The signal output by the optical output unit 154 is realized as the collection device emits light of a single color or multiple colors to the front or back. The signal output may be terminated when the collection device detects the user's confirmation of the event.

The interface unit 160 serves as a passageway for all external devices connected to the dental CAD device 100. The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the dental CAD device 100, or transmits data inside the dental CAD device 100 to an external device. For example, wired/wireless headset port, external charger port, wired/wireless data port, memory card port, port for connecting a device equipped with an identification module. A port, an audio input/output (I/O) port, a video input/output (I/O) port, an earphone port, etc. may be included in the interface unit 160.

Meanwhile, the identification module is a chip that stores various information for authenticating the right to use the dental CAD device 100, and includes a user identification module (UIM), a subscriber identity module (SIM), and a general-purpose user. It may include an authentication module (universal subscriber identity module (USIM)), etc. A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in a smart card format. Therefore, the identification device can be connected to the terminal 100 through the interface unit 160.

In addition, the interface unit 160 serves as a path through which power from the cradle is supplied to the dental CAD device 100 when the dental CAD device 100 is connected to an external cradle, or is supplied from the cradle by the user. It can be a passage through which various input command signals are transmitted to the dental CAD device 100. Various command signals or the power input from the cradle may be operated as signals for recognizing that the dental CAD device 100 is correctly mounted on the cradle.

The memory 170 can store programs for operating the control unit 180, and can also temporarily store input/output data (eg, phone book, messages, still images, videos, etc.). The memory 170 may store data on various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 170 is a flash memory type, hard disk type, solid state disk type, SDD type (Silicon Disk Drive type), and multimedia card micro type. ), card-type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), EEPROM (electrically erasable programmable read) -only memory), PROM (programmable read-only memory), magnetic memory, magnetic disk, and optical disk may include at least one type of storage medium. The dental CAD device 100 may be operated in connection with web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as discussed above, the control unit 180 controls operations related to application programs and generally controls the overall operation of the dental CAD device 100. For example, if the state of the collection device satisfies a set condition, the control unit 180 may execute or release a lock state that restricts the user's input of control commands to applications.

In addition, the control unit 180 performs control and processing related to voice calls, data communications, video calls, etc., or performs pattern recognition processing to recognize handwriting input or drawing input made on the touch screen as text and images, respectively. You can. Furthermore, the control unit 180 may control any one or a combination of the above-described components in order to implement various embodiments described below on the dental CAD device 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 and supplies power necessary for the operation of each component. The power supply unit 190 includes a battery, and the battery can be a built-in battery that can be recharged, and can be detachably coupled to the terminal body for charging, etc.

Additionally, the power supply unit 190 may be provided with a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery wirelessly without using the connection port. In this case, the power supply unit 190 uses one or more of the inductive coupling method based on magnetic induction phenomenon or the magnetic resonance coupling method based on electromagnetic resonance phenomenon from an external wireless power transmitter. Power can be transmitted.

Meanwhile, various embodiments below may be implemented in a recording medium readable by a computer or similar device, for example, using software, hardware, or a combination thereof.

The location information module 115 provided in the collection device is used to detect, calculate, or identify the location of the collection device, and representative examples may include a Global Position System (GPS) module and a Wireless Fidelity (WiFi) module. If necessary, the location information module 115 may replace or additionally perform any of the functions of other modules of the wireless communication unit 110 to obtain data regarding the location of the collection device.

The GPS module 115 calculates distance information and accurate time information from three or more satellites and then applies trigonometry to the calculated information to accurately calculate three-dimensional current location information according to latitude, longitude, and altitude. can do. Currently, a method of calculating location and time information using three satellites and correcting errors in the calculated location and time information using another satellite is widely used. Additionally, the GPS module 115 can calculate speed information by continuously calculating the current location in real time. However, it is difficult to accurately measure the location of the collection device using a GPS module in shaded areas of satellite signals, such as indoors. Accordingly, WPS (WiFi Positioning System) can be used to compensate for GPS-based positioning.

The WiFi Positioning System (WPS) uses a WiFi module provided in the dental CAD device 100 and a wireless AP (Wireless Access Point) that transmits or receives wireless signals with the WiFi module, to detect the dental CAD device ( 100), it is a technology for tracking the location of a device and refers to a location determination technology based on WLAN (Wireless Local Area Network) using WiFi.

The Wi-Fi location tracking system may include a Wi-Fi location determination server, a dental CAD device 100, a wireless AP connected to the dental CAD device 100, and a database storing arbitrary wireless AP information.

The dental CAD device 100 connected to the wireless AP may transmit a location information request message to the Wi-Fi location determination server.

The Wi-Fi location determination server extracts information on the wireless AP connected to the dental CAD device 100 based on the location information request message (or signal) of the dental CAD device 100. Information on the wireless AP connected to the dental CAD device 100 may be transmitted to the Wi-Fi location determination server through the dental CAD device 100, or may be transmitted from the wireless AP to the Wi-Fi location determination server.

Based on the location information request message of the dental CAD device 100, the extracted wireless AP information includes MAC Address, Service Set IDentification (SSID), Received Signal Strength Indicator (RSSI), Reference Signal Received Power (RSRP), and RSRQ. It may be at least one of (Reference Signal Received Quality), Channel Information, Privacy, Network Type, Signal Strength, and Noise Strength.

As described above, the Wi-Fi location determination server can receive information on the wireless AP connected to the dental CAD device 100 and extract wireless AP information corresponding to the wireless AP to which the collection device is connected from a pre-built database. At this time, information on any wireless APs stored in the database includes MAC Address, SSID, channel information, Privacy, Network Type, latitude and longitude coordinates of the wireless AP, name of the building where the wireless AP is located, number of floors, and detailed indoor location information (GPS coordinates). available), and may be information such as the AP owner’s address and phone number. At this time, in order to remove mobile APs or wireless APs provided using illegal MAC addresses from the positioning process, the Wi-Fi location determination server may extract only a certain number of wireless AP information in order of high RSSI.

Thereafter, the Wi-Fi location determination server may extract (or analyze) the location information of the dental CAD device 100 using at least one wireless AP information extracted from the database. By comparing the included information with the received wireless AP information, location information of the dental CAD device 100 is extracted (or analyzed).

As a method for extracting (or analyzing) the location information of the dental CAD device 100, the Cell-ID method, the fingerprint method, the triangulation method, and the landmark method can be used.

The Cell-ID method is a method of determining the location of the wireless AP with the strongest signal strength among the surrounding wireless AP information collected by the collection device as the location of the collection device. It has the advantage of being simple to implement, requiring no additional costs, and being able to obtain location information quickly, but has the disadvantage of lowering the positioning accuracy if the installation density of wireless APs is low.

The fingerprint method is a method of collecting signal strength information by selecting a reference location in the service area and estimating the location through signal strength information transmitted from a collection device based on the collected information. In order to use the fingerprint method, it is necessary to create a database of radio wave characteristics in advance.

The triangulation method is a method of calculating the location of a collection device based on the coordinates of at least three wireless APs and the distance between the collection devices. To measure the distance between a collection device and a wireless AP, the signal strength is converted into distance information, or the time when the wireless signal is transmitted (Time of Arrival, ToA), or the time difference between the signal transmission (Time Difference of Arrival, TDoA) , the angle at which the signal is transmitted (Angle of Arrival, AoA), etc. can be used.

The landmark method is a method of measuring the location of a collection device using a landmark transmitter whose location is known.

In addition to the methods listed, various algorithms can be used as a method to extract (or analyze) the location information of the collection device.

The location information of the dental CAD device 100 extracted in this way is transmitted to the dental CAD device 100 through the Wi-Fi location determination server, so that the dental CAD device 100 can obtain the location information.

The dental CAD device 100 can obtain location information by connecting to at least one wireless AP. At this time, the number of wireless APs required to obtain location information of the dental CAD device 100 may vary depending on the wireless communication environment in which the dental CAD device 100 is located.

As previously seen in Figure 1, the collection device according to the present invention includes Bluetooth (Bluetooth??), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, and NFC ( Near field communication (Near Field Communication) and Wireless USB (Wireless Universal Serial Bus) may be applied.

Among these, the NFC module provided in the collection device supports non-contact, short-range wireless communication between devices at a distance of about 10 cm. The NFC module can operate in any of card mode, reader mode, and P2P mode. In order for the NFC module to operate in card mode, the dental CAD device 100 may further include a security module that stores card information. Here, the security module may be a physical medium such as a Universal Integrated Circuit Card (UICC) (e.g., Subscriber Identification Module (SIM) or Universal SIM (USIM)), Secure micro SD, and a sticker, or it may be a logical medium embedded in the collection device ( For example, it may be an embedded SE (Secure element). Data exchange based on SWP (Single Wire Protocol) can occur between the NFC module and the security module.

When the NFC module is operated in card mode, the collection device can transmit the stored card information to the outside like a traditional IC card. Specifically, by bringing the collection device that stores the card information of payment cards such as credit cards or bus cards close to the fare payment machine, mobile short-distance payments can be processed, and the collection device that stores the card information of the access card can be used to authorize access. Upon approaching the flag, the access approval process can begin. Cards such as credit cards, transportation cards, and access cards are mounted on the security module in the form of an applet, and the security module can store card information for the mounted cards. Here, the card information of the payment card may be at least one of the card number, balance, and usage history, and the card information of the access card may be at least one of the user's name, number (e.g., user's student number or employee number), and access history. It could be one.

When the NFC module is operated in reader mode, the collection device can read data from an external tag. At this time, the data that the collection device receives from the tag may be coded in the NFC Data Exchange Format defined by the NFC Forum. In addition, the NFC Forum defines four record types. Specifically, the NFC Forum defines four Record Type Definitions (RTDs): Smart Poster, Text, Uniform Resource Identifier (URI), and General Control. If the data received from the tag is a smart poster type, the control unit can run a browser (eg, an Internet browser), and if the data received from the tag is a text type, the control unit can run a text viewer. If the data received from the tag is a URI type, the control unit can run a browser or make a phone call, and if the data received from the tag is a general control type, the control unit can execute an appropriate operation according to the control contents.

When the NFC module is operated in P2P (Peer-to-Peer) mode, the collection device can perform P2P communication with other collection devices. At this time, LLCP (Logical Link Control Protocol) may be applied to P2P communication. For P2P communication, a connection can be created between a collection device and another collection device. At this time, the created connection can be divided into a connectionless mode, which terminates after exchanging one packet, and a connection-oriented mode, which continuously exchanges packets. Through P2P communication, data such as electronic business cards, contact information, digital photos, URLs, and setup parameters for Bluetooth and Wi-Fi connections can be exchanged. However, since the available distance of NFC communication is short, P2P mode can be effectively used to exchange small data.

Hereinafter, embodiments related to the control method that can be implemented in the dental CAD device configured as described above will be discussed with reference to the attached drawings. It is obvious to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

The purpose of the dental CAD device 100 according to the present invention is to set the margin line required for prosthetic treatment on the patient's dental scan data using a pre-trained artificial neural network.

Referring to FIG. 2, an artificial neural network that performs learning using a patient's dental scan data and data with margin lines previously marked by a dental technician is shown.

As shown in Figure 2, the artificial neural network according to the present invention uses training data (i.e., training data and verification data in Figure 4) including scan data of teeth and margin line data corresponding to the scan data. You can use it to perform self-study.

At this time, the margin line data may include information related to the margin line manually marked by the technician in relation to the corresponding scan data.
To elaborate, learning data is made up of a pair of scan data of teeth and margin line data (i.e., margin line data created by a technician) corresponding to the scan data, and some of the plurality of learning data made up in this way are learning data. is used, and the rest is used as verification data.

Specifically, scan data may consist of point cloud data in 3D space and normal vector information for each point.

Using the learning data configured as above, the artificial neural network can perform learning by setting the objective function to improve the extraction accuracy of the margin line. As a result, it is possible to build a deep learning model that extracts the margin line using only newly input scan data, that is, tooth scan data that does not contain any information related to the margin line.

In order to perform such learning, existing scan data and margin line data are converted into Nx6 (N: number of points, 6: position of point and normal vector) point cloud data including normal line information.

For example, point cloud data may be composed of an x-axis coordinate, a y-axis coordinate, a z-axis coordinate, an xy normal vector, a yz normal vector, and a zx normal vector.

Additionally, based on margin line data, scan data can be labeled into upper scan data and lower scan data. For example, data at one point above the margin line may be labeled as being above the margin line (Up), and data at another point below the margin line may be labeled as being below the margin line (Down).

When the labeling process is performed, the learning data that is finally input to the artificial neural network may consist of Nx7 point cloud data.

When new scan data is input, the artificial neural network that has learned using the pre-processed learning data can convert the new scan data into Nx6 point cloud data like the learning data.

Additionally, new scan data converted by a pre-learned model may be classified into upper scan data or lower scan data.

From the results divided into upper scan data and lower scan data in this way, information related to the margin line can be finally extracted by applying edge detection technology.

Referring to FIG. 3, a process in which scan data is divided into upper scan data and lower scan data based on a margin line is shown.

As described above, the control unit 180 of the dental CAD device 100 according to the present invention is equipped with an artificial neural network previously learned by learning data including margin line data, so new tooth scan data 301 is input. When available, it can be divided into upper scan data 302 and lower scan data 303 using a pre-trained artificial intelligence model.

Figure 4 is a flowchart showing the above-described learning method in more detail.

As shown in FIG. 4, the control unit 180 of the dental CAD device 100 can convert learning data (i.e., learning data and verification data) with margin lines already displayed into Nx6 point cloud data (S110, S115) ). In addition, the control unit 180 may perform labeling using learning data converted based on the margin line. The learning data (i.e., training data and verification data) are input into the artificial neural network (S120, S125). The training data among the training data trains an artificial neural network (deep neural network) (S130), and as a result, the artificial neural network generates an artificial intelligence model (deep learning model) that generates a margin line (S150). Verification data is applied to the artificial intelligence model (deep learning model) created after learning, and learning accuracy is calculated (S160).
Determining whether the calculated learning accuracy is above a certain level (preset level) (S170), and if the calculated accuracy is below a certain level, repeating the learning process to train an artificial neural network (deep neural network) (S130) Returns to , and if the calculated learning accuracy is above a certain level, learning is terminated (S180), and the generated artificial intelligence model (deep learning model) is recorded in the memory 170.

At this time, the control unit 180 may set the objective function to improve the margin line extraction accuracy of the artificial neural network and control the artificial neural network to learn the labeled learning data.

Meanwhile, the control unit 180 can determine the accuracy of the learned artificial neural network using verification data that matches the learning data. The control unit 180 may control the artificial neural network to repeatedly perform learning until the determined accuracy reaches a certain level or higher.

Figure 5 is a flowchart showing in more detail a method of extracting a margin line (i.e., a method of driving a dental CAD device) using a trained artificial neural network.

As shown in FIG. 5, the input unit 110 of the dental CAD device 100 can receive new tooth scan data.

In addition, the control unit 180 is equipped with a pre-trained artificial neural network, that is, an artificial intelligence model (deep learning model) that generates a margin line, and uses the artificial intelligence model to create a margin line (Margin- Information related to (i.e., upper scan data 302 and lower scan data 303 based on the margin line) can be extracted.

Specifically, the control unit 180 converts the input new tooth scan data into point cloud data including a normal vector (S210). Afterwards, the control unit 180 inputs the converted new tooth scan data into an artificial neural network, that is, the artificial intelligence model (deep learning model), and information related to the margin line corresponding to the new tooth scan data (upper scan data and Extract the lower scan data (S250).

The artificial neural network mounted on the control unit 180 performs learning using training data with margin lines previously marked.

In one embodiment, scan data may consist of 3D coordinate information.

Additionally, the control unit 180 may generate normal information based on the 3D coordinate information in order to apply scan data to an artificial neural network.

In addition, the control unit 180 can use an artificial neural network to divide the input scan data into upper scan data and lower scan data.

Thereafter, the control unit 180 may extract margin line information corresponding to the scan data using the upper scan data and the lower scan data.

In one embodiment, the control unit 180 may extract information related to the margin line by detecting a corner (i.e., border) of the upper scan data and a corner (i.e., border) of the lower scan data.

Preferably, the control unit 180 may generate the margin line by sequentially connecting a plurality of coordinates corresponding to the corners of the upper scan data or the corners of the lower scan data.

For example, the control unit 180 may generate a margin line by sequentially connecting a plurality of coordinates corresponding to the corners based on the direction angle with respect to the center point of the scan data.

Meanwhile, the control unit 180 may perform sampling on a plurality of coordinates corresponding to corners and generate a margin line based on the sampling results.

Claims (14)

An input unit that receives scan data of teeth;
A control unit equipped with a pre-trained artificial neural network and extracting information related to a margin line of the input scan data using the artificial neural network; and
In the dental CAD device, comprising: an output unit that outputs the input scan data of the teeth and information related to the margin line,
The artificial neural network includes an artificial intelligence model obtained by performing learning using scan data of teeth and learning data including margin information corresponding to the scan data of the teeth,
The scan data of the teeth consists of three-dimensional coordinate information,
The control unit generates normal information based on the three-dimensional coordinate information in order to apply the scan data of the tooth to the artificial neural network,
The control unit is a dental CAD device characterized in that, using the artificial neural network, the input scan data of the teeth is divided into upper scan data and lower scan data based on a margin line. According to paragraph 1,
In order to perform learning of the artificial neural network, the control unit converts the scan data and margin line data of the teeth into Nx6 (N: number of points) point cloud data including normal line information,
A dental CAD device characterized in that the point group data consists of an x-axis coordinate, a y-axis coordinate, a z-axis coordinate, an xy normal vector, a yz normal vector, and a zx normal vector. delete According to paragraph 1,
The control unit,
A dental CAD device, characterized in that it extracts margin line information corresponding to the input scan data of the teeth using the upper scan data and the lower scan data.
According to paragraph 4,
The control unit,
Dental CAD device, characterized in that the margin line information is extracted by detecting corners of the upper scan data and corners of the lower scan data.
According to clause 5,
The control unit,
Dental CAD device, characterized in that the margin line is created by sequentially connecting a plurality of coordinates corresponding to the corners of the upper scan data or the corners of the lower scan data.
According to clause 6,
The control unit,
Dental CAD device, characterized in that the margin line is created by sequentially connecting the plurality of coordinates based on the direction angle with respect to the center point of the scan data.
An input step in which a control unit equipped with a pre-trained artificial neural network receives scan data of teeth from an input unit;
A margin-line-related information extraction step in which the control unit extracts information related to a margin-line of the input scan data using the artificial neural network; and
In the method of driving a dental CAD device, including an output step in which the control unit outputs the input scan data and information related to the margin line,
The artificial neural network includes an artificial intelligence model obtained by performing learning using scan data of teeth and learning data including margin information corresponding to the scan data of the teeth,
The scan data of the teeth entered in the input stage consists of 3D coordinate information,
In the margin line-related information extraction step, the control unit,
In order to apply scan data of teeth to an artificial neural network, it includes generating normal information based on the 3D coordinate information,
In the margin line-related information extraction step, the control unit,
A method of driving a dental CAD device, characterized in that, using the artificial intelligence model, the scan data of the input teeth is divided into upper scan data and lower scan data based on the margin line. According to clause 8,
In order for the control unit to learn the artificial neural network, the tooth scan data and margin line data are converted into Nx6 (N: number of points) point cloud data including normal line information,
A method of driving a dental CAD device, wherein the point group data consists of an x-axis coordinate, a y-axis coordinate, a z-axis coordinate, an xy normal vector, a yz normal vector, and a zx normal vector. delete According to clause 8,
In the margin line-related information extraction step, the control unit,
A method of driving a dental CAD device, characterized by extracting margin line information corresponding to scan data of input teeth using upper scan data and lower scan data.
According to clause 11,
In the margin line-related information extraction step, the control unit,
A method of driving a dental CAD device, characterized in that the margin line information is extracted by detecting the corners of the upper scan data and the corners of the lower scan data.
According to clause 12,
In the margin line-related information extraction step, the control unit,
A method of driving a dental CAD device, characterized in that the margin line is generated by sequentially connecting a plurality of coordinates corresponding to the corners of the upper scan data or the corners of the lower scan data.
According to clause 13,
In the margin line-related information extraction step, the control unit,
A method of driving a dental CAD device, characterized in that the margin line is generated by sequentially connecting a plurality of coordinates based on the direction angle with respect to the center point of the scan data.