KR20220074317A - Electronic device and Method for controlling electronic device using LiDAR sensor - Google Patents

Abstract

According to the present invention, a method for controlling an electronic device including one or more lidar sensors includes: acquiring data on a user's movement through the one or more lidar sensors; separately acquiring one or more data for distance, angle, position, direction, coordinate, spatial information or mapping data for a specific body part, object, or movement of each of them, and based on the acquired one or more data, the It may include controlling the operation of the electronic device.

Description

Electronic device and method for controlling electronic device using LiDAR sensor

The present invention relates to electronic device control, and more particularly, to an electronic device that can be controlled according to a user's movement by using a lidar sensor, and a control method thereof.

Various sensor technologies are being researched and developed according to the advancement of ICT technology. In particular, radar or LiDAR technology is being introduced in the conventional aviation field or the recent autonomous driving technology field.

However, the technology has been studied and utilized only limitedly to detect a distant object, recognize a driving line or an obstacle on a road, and measure the distance.

On the other hand, a motion sensor has been used to detect a user's movement in a conventional mobile device, etc., but there is a limit to the motion sensor alone, and meaningful data on the user's movement can be obtained only by combining data sensed by other sensors.

Accordingly, in the prior art, various sensors were required to accurately detect a user's movement, and a lot of time and resources were consumed in analyzing the sensed data, and the processing process was also complicated.

Accordingly, a specific method for solving the above problems is required.

Domestic Registered Patent Publication No. 10-2059244 (published on June 28, 2019)

In order to solve the above conventional problems, an object of the present invention is to detect a user's movement using a lidar sensor technology.

Another object of the present invention is to provide a method of detecting a user's movement through a lidar sensor included in an electronic device, and controlling the electronic device according to a detection result.

Another task of the present invention is to utilize the lidar sensor technology and the user's motion detection technology to control the operation of various electronic devices in daily life.

The technical problems to be achieved in the present invention are not limited to the above technical problems, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description.

The method for controlling an electronic device using one or more lidar sensors according to an embodiment of the present invention for solving the above-described problems includes acquiring data on a user's movement through the one or more lidar sensors, the acquired Based on the data on the user's movement, at least one or more data is individually obtained for the user, the user's specific body parts, objects, and the distance, angle, location, direction, coordinates or spatial information, and mapping data for each of these movements and controlling the operation of the electronic device based on the acquired one or more data.

According to the method for controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, data on the user, a specific body part of the user, an object, or their respective movements, or the user, a specific body part of the user , the method may further include storing operation control data of the electronic device according to the movement of the object or each of them.

According to the method of controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, the acquired data is a polar coordinate data type, a Cartesian coordinate data type, or a distance, angle, position, direction, It may include a data type representing one or more of coordinates, spatial information, and mapping data.

According to the method for controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, the movement amount, movement speed, and movement direction of the user's body part may be calculated based on the acquired data.

According to the method for controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, in the calculated movement amount, the movement amount in the x-axis, y-axis, and z-axis to a specific direction, or in a straight or curved form If some or all of the movement amount for the movement is equal to or greater than the threshold, only the movement amount of the axis having a greater change in the movement amount may be used as valid data.

According to the method for controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, in the calculated movement amount, the movement amount in the x-axis, y-axis, z-axis to a specific direction, or in a straight line or curved form When some or all of the movement amount for the movement is equal to or greater than the threshold, some or all of the change in each movement amount may be used as valid data.

According to the method for controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, in the calculated movement amount, the movement amount in the x-axis, y-axis, z-axis to a specific direction, or in a straight line or curved form If some or all of the movement amount for the movement is equal to or greater than the threshold, only the movement amount of the axis that is changed later on the time axis may be used as valid data regardless of the movement amount.

According to the method for controlling an electronic device using at least one lidar sensor according to an embodiment of the present invention, the at least one lidar sensor includes a rotary lidar sensor, a fixed lidar sensor, a super lidar sensor, and a 2D lidar. sensor, 3D lidar sensor, device type lidar sensor, MEMS lidar sensor, flash lidar sensor, OPA lidar sensor, FMCW lidar sensor, camera lidar, lidar scanner, multilayer scanner or linear measurement sensor It may include various types of lidar.

The electronic faucet according to an embodiment of the present invention includes a memory, one or more lidar sensors, and a processor, wherein the processor acquires data on a user's movement through the one or more lidar sensors, and Recognizes the user's hand part based on the user's movement data, and the distance, angle, position, direction, coordinates, spatial information or mapping data for the recognized user's hand movement through the one or more lidar sensors It is possible to separately acquire one or more data for , and control the operation of the electronic faucet based on the acquired one or more data.

A neck care device according to an embodiment of the present invention includes a memory, one or more lidar sensors and a processor, wherein the processor acquires data about a user's movement through the one or more lidar sensors, and Recognizes the user's chin or face to neck, waist, or spine based on data about a user's movement, and recognizes the recognized user's chin or face to neck, waist or spine through the one or more lidar sensors. One or more data for distance, angle, position, direction, coordinate, spatial information or mapping data with respect to movement may be separately obtained, and health guide data may be provided to the user based on the obtained one or more data.

According to the present invention as described above, the effects described below can be obtained. However, the effect obtainable through the present invention is not limited thereto.

First, there is an effect of detecting the user's movement using the lidar sensor technology.

Second, there is an effect of providing a method for detecting a user's movement through a lidar sensor included in the electronic device and controlling the electronic device according to the detection result.

Third, there is an effect that the lidar sensor technology and the user's motion detection technology can be used to control the operation of various electronic devices in daily life.

1 is a block diagram of an electronic device controlled by using a lidar technology according to an embodiment of the present invention.
2 is a diagram illustrating an electronic device control system using lidar technology according to an embodiment of the present invention.
3 is a block diagram of a processor, which is a component of an electronic device (or computing device) controlled by using a lidar technology according to an embodiment of the present invention.
4 is a flowchart illustrating a method for controlling an electronic device using a lidar technology according to an embodiment of the present invention.
5 is a perspective view of an electronic faucet to which lidar technology is applied according to an embodiment of the present invention.
6 is a diagram illustrating a motion for controlling the electronic faucet of FIG. 5 .
FIG. 7 is a view for explaining the control of the electronic faucet according to the motion of FIG. 6 .
8 is a perspective view of a neck care device to which lidar technology is applied according to an embodiment of the present invention.
FIG. 9 is a diagram illustrating a motion for providing guide data of the neck care device of FIG. 8 .
FIG. 10 is a diagram illustrating the provision of guide data of the neck care device according to the motion of FIG. 9 .

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION The detailed description set forth below in conjunction with the appended drawings is intended to describe exemplary embodiments of the present invention and is not intended to represent the only embodiments in which the present invention may be practiced.

Only the present embodiments are provided so that the disclosure of the present invention is complete, and to fully inform those of ordinary skill in the art to which the present invention belongs, the scope of the invention, and the present invention is to be defined by the scope of the claims. only

In some cases, in order to avoid obscuring the concept of the present invention, well-known structures and devices may be omitted or shown in block diagram form focusing on core functions of each structure and device. In addition, the same reference numerals are used to describe the same components throughout the present specification.

Throughout the specification, when a part is said to "comprising or including" a certain component, it does not exclude other components unless otherwise stated, meaning that other components may be further included. do.

In addition, the term “unit” described in the specification means a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. Furthermore, "a or an", "one", and like related terms in the context of describing the present invention are used in both the singular and the plural unless otherwise indicated herein or otherwise clearly contradicted by the context. It can be used in the meaning of including.

In addition, specific terms used in the embodiments of the present invention are provided to help the understanding of the present invention, and unless otherwise defined, all terms used herein, including technical or scientific terms, are used in the present invention. It has the same meaning as commonly understood by those of ordinary skill in the art to which it belongs. The use of these specific terms may be changed to other forms without departing from the technical spirit of the present invention.

Hereinafter, in the present specification, the electronic device is controlled using LiDAR (Light Detection And Ranging) technology. The lidar emits a laser and a pulse (or laser) and receives the light reflected from the target object. It is a device that accurately draws the surroundings by measuring the distance to the object, and is used for analyzing the distance to the target object, as well as the moving speed, direction, temperature, ambient air substance analysis and concentration measurement.

Lidar can detect non-metallic rocks, clouds, raindrops, and aerosols using ultraviolet, visible, and near-infrared rays, so it is also used for weather observation. It is also used as a peripheral awareness device. It is also used to find out the chemical composition of a gas mixed in the air by using the phenomenon that the wavelengths of light that are smoothly scattered for each molecule are different.

Recently, lidar has emerged as a core technology of a sensor that acquires information necessary to implement a three-dimensional image. If the topography is surveyed by analyzing the spatial location of the reflection point by measuring the return time by firing laser pulses on the ground while flying with the lidar mounted on the aircraft, the reflection and return time varies depending on the structure, so the optical image is obtained from this. It is possible to obtain a 3D model that is difficult to obtain with The ground lidar also combines this with the location coordinates obtained from GPS to obtain precise data.

Lidar usually consists of a laser, a scanner, a receiver, and a positioning system. The laser has a different wavelength depending on the purpose, but generally uses light of a wavelength of 600-1000 nm, but is not limited thereto, and may use light of a longer wavelength to reduce damage to the human eye. The receiver, which is one component of the lidar, is a part that detects the returning light, and the sensitivity of the receiver to the light is a major factor influencing the performance of the lidar. Essentially, the receiver detects photons and amplifies them. The positioning system is a part that confirms the position coordinates and direction where the receiver is placed in order to implement a 3D image.

For basic information on the lidar technology, refer to known content in addition to the above, and a separate description thereof will be omitted. On the other hand, although described in the present specification by naming lidar, the present invention is not limited to the expression, and all expressions referring to lidar (LiDAR) are considered to be included.

Hereinafter, the "electronic device" described in this specification senses a user's motion or motion by utilizing the lidar technology according to the present invention, and the function, operation, etc. of the electronic device is controlled in response to the user's motion or motion. It can include all possible types of devices. For better understanding of the present invention and convenience of explanation, an electronic faucet is used as an electronic device to which the present invention is applied in FIGS. 5 to 7, which will be described later, and a neck care (electronic faucet) to which the present invention is applied in FIGS. Neck-care device is shown. However, this is an embodiment of the present invention, and the present invention is not applied only to such a device.

In addition, in the present invention, a specific body part that senses a user's movement using lidar technology, for example, a person's hand or chin, is taken as a reference, but is not necessarily limited thereto. In other words, a body part of a person does not necessarily need to be specified and used in order to sense the user's movement, and furthermore, a separate device may be used.

1 is a configuration block diagram of an electronic device 10 controlled by using a lidar technology according to an embodiment of the present invention.

2 is a diagram illustrating an electronic device control system 100 using lidar technology according to an embodiment of the present invention.

Referring to FIG. 1 , an electronic device 10 may include a memory 11 , a sensor module 12 , and a processor 13 . However, this shows only essential components for explaining control using lidar technology according to an embodiment of the present invention, and the present invention is not limited to such a configuration, and one or more other components are further added. may include

The memory 11 may store various data of the electronic device 10 . In particular, the memory 11 may store data for controlling the electronic device 10 through the lidar technology. The memory 11 may store data on a motion related to the control of the electronic device 10 among various motions of the user, and the memory 11 may store in advance a data set for controlling the electronic device 10 . The memory 11 may map and store a data set for controlling the electronic device 10 and motion data related to the control of the electronic device 10 .

The sensor module 12 may include a lidar sensor. According to an embodiment, the lidar sensor is a sensor capable of measuring distance, angle, position, direction, coordinates, spatial information, mapping data, etc., and includes a rotary lidar sensor, a fixed lidar sensor, a super lidar sensor, and a MEMS lidar. sensor, flash lidar sensor, OPA lidar sensor, FMCW lidar sensor, lidar scanner, device lidar sensor, 2D (dimensional) lidar sensor or 3D lidar sensor, camera lidar sensor, etc. In addition, the lidar sensor is not a rotary lidar sensor, 2D lidar sensor, or 3D lidar sensor, but a device or system implemented to perform the function of a lidar sensor that has been developed or will be developed in the future (eg, , a camera-type lidar that measures distance, angle, position, direction, coordinates, spatial information, etc. in a mapping method using image(s) taken using one or more camera lenses, cameras and radars, ultrasonic sensors, etc. It can be interpreted as a concept that includes all implemented pseudo LiDAR, multi-layer scanner, linear measurement sensor, high-resolution radar, imaging radar, etc.). According to an embodiment, the sensor module 12 may be detachable from the electronic device 10 .

According to an embodiment, the electronic device 10 may include a plurality of lidar sensors.

The processor 13 converts or generates an interface signal related to control of the electronic device 10 based on the user's movement data sensed through the sensor module 12, and through the converted or generated interface signal, the electronic device 10 can control

1 shows an embodiment in which a lidar sensor 12 is mounted on one surface of an electronic device 10 and a processor 13 is also included as a component of the electronic device 10 . In contrast, FIG. 2 illustrates the electronic device control system 100 as an independent component in which the processor is not a component of the electronic devices 10 and 20 .

Referring to FIG. 2 , the electronic device control system 100 according to the present invention may include a plurality of electronic devices 10 and 20 and a computing device 30 to which lidar technology is applied. As described above, the functions of the processor 13 of FIG. 1 may be performed by the computing device 30 of FIG. 2 .

On the other hand, the computing device 30 of FIG. 2 may be a fixed terminal such as a PC or a TV or a mobile terminal such as a smart phone or a tablet PC. , may be in the form of a board or board in a state in which functional operation is possible, such as a bread board. According to an embodiment, the computing device 30 of FIG. 2 may be a dedicated device for controlling the electronic devices 10 and 20 . According to an embodiment, the computing device 30 of FIG. 2 may be a server located remotely. In this case, the computing device 30 may receive user movement data sensed through the lidar sensor from at least one or more remotely located electronic devices, and transmit control data corresponding thereto to the corresponding electronic device.

The electronic devices 10 and 20 constituting the electronic device control system shown in FIG. 2 may perform data communication with the computing device 30 through a wired/wireless communication protocol. To this end, the electronic devices 10 and 20 of FIG. 2 may include various communication interfaces for communication protocols such as Bluetooth and Wi-Fi.

When a plurality of electronic devices constituting the electronic device control system shown in FIG. 2 are located within a predefined range, when a lidar sensor of a specific electronic device operates or the lidar sensor is defective or reliable due to an error, etc. In the absence of this, lidar sensors of other electronic devices may operate together or instead.

The computing device 30 of FIG. 2 may store and use data stored in the memory 11 of FIG. 1 in a separate database DB.

The processor 13 of FIG. 1 to the computing device 30 of FIG. 2 may control the electronic device by using the user's movement data sensed based on the lidar technology as a motion control interface signal of the electronic device. To this end, a process of converting the sensed motion data of the user into a motion control signal of the electronic device or generating a motion control signal of the electronic device by using the motion data of the user may be included. The user's movement data may be directly used as a motion control interface signal as it is. In addition, the processor 13 to the computing device 30 may minimize misrecognition or misoperation control by learning by referring to the user's feedback after the control, including the artificial intelligence module.

Although not shown, the electronic device may input or output audio data including a microphone or a speaker, which may be used together or as feedback data in the electronic device control process according to the user's movement using the above-described lidar technology. can

Meanwhile, the electronic device in FIGS. 1 and 2 may transmit data related to the use of the electronic device to the registered terminal so that the transmitted data can be checked through the display of the terminal. To this end, the terminal may download and install an application related to data, such as use of an electronic device, and may include a related application program interface (API) or embedded software.

FIG. 3 is a block diagram of a processor that is a component of the processor 13 of FIG. 1 or the computing device 30 of FIG. 2 .

4 is a flowchart illustrating a method for controlling an electronic device using a lidar technology according to an embodiment of the present invention.

For convenience of description, the configuration block diagram shown in FIG. 3 will be described as the processor 13 of FIG. 1 .

The processor 13 may include a communication unit 301 , a data extraction unit (or data recognition unit) 302 , a data conversion unit 303 , a data analysis unit 304 , and a control unit 305 .

A description of each component constituting the electronic device 10 and the processor 13 will be described with reference to FIG. 4 .

A method of controlling an electronic device using a lidar sensor will be described with reference to FIG. 4 , as follows.

The sensor module 12 may acquire first data on the user's movement through at least one lidar sensor (S101). Here, the user's movement means that the user moves his/her body parts (hands, fingers, feet, toes, knees, neck, shoulders, head, chest, etc.) It can mean moving at an angle and in a variety of positions.

The data extraction unit 302 may recognize a predefined body part of the user based on the acquired first data (S102). Here, recognizing the predefined user's body part may include specifically recognizing one or more specific body parts of the user that are related to motion control of the electronic device, that is, preset to be used for motion control of the electronic device. In this case, it may also be possible for the data extraction unit 302 to recognize the user's body part(s) that are not related to the operation control of the electronic device.

The data extraction unit 302 and the sensor module 12 are configured to move (eg, distance, angle, location, direction, spatial information, mapping data, polar coordinates, 3 dimensional coordinates, etc.) may be obtained (S103).

The data conversion unit 304 may convert the obtained second data into third data (S104).

The controller 305 may control the electronic device based on the converted third data (S105).

However, according to an embodiment of the present invention, the data extraction unit 302, the data conversion unit 304 and/or the control unit 305 may be formed integrally, and furthermore, the first data obtained as above The acquired first data may be directly used for controlling the electronic device without a process of converting it into second data and/or third data.

To this end, in the process of acquiring the first data, the first data may be set to be acquired as the type (or shape) of the second data or the type (or shape) of the third data. In addition, the acquired second data may be directly used to control the electronic device, and in this case, the second data may be acquired as a type (or form) of the third data in the process of acquiring the second data. may be set.

Referring back to FIG. 3 , the memory 11 may store body part data of the user set in relation to electronic device control and motion control data according to the movement of the body part.

According to an embodiment, the first data and the second data may be polar coordinate data, and the third data may be rectangular coordinate data, but is not limited thereto, and the distance, angle, location, direction, coordinates, spatial information, and mapping of the object to be recognized is not limited thereto. It may include various data types representing one or more of the data.

According to an embodiment, the movement direction, movement amount, and/or movement speed of the user's body part may be calculated based on at least one of the first to third data (particularly, the third data).

According to the embodiment, in the calculated movement amount, if some or all of the movement amount in the x-axis, y-axis, and z-axis or in a specific direction or movement in a straight line or curved form is greater than or equal to a threshold value, the change in the movement amount is greater Only the movement amount of the axis can be used as valid data.

According to an embodiment, in the calculated movement amount, if some or all of the movement amount in the x-axis, y-axis, and z-axis or in a specific direction or movement in a straight line or a curved shape is greater than or equal to a threshold value, the change in each movement amount Some or all of them may be used as valid data.

According to an embodiment, in the calculated movement amount, if some or all of the movement amount in a specific direction from the x-axis, y-axis, z-axis, or movement in a linear or curved form is greater than or equal to a threshold value, regardless of the movement amount, the time axis Only the movement amount of the axis that is changed later in the phase can be used as valid data.

In the above, the use of valid data has been described based on the movement amount, but in addition, it is possible to set the use standard for valid data based on the movement direction or movement speed.

According to an embodiment, the at least one lidar sensor may include a rotation lidar sensor.

Hereinafter, an electronic device to which the electronic device control method using the lidar technology according to the present invention is applied is taken as an example and will be described in detail. As described above, FIGS. 5 to 7 show an electronic faucet to which the present invention is applied, and FIGS. 8 to 10 show a neck care device to which the present invention is applied.

5 is a perspective view of the electronic faucet 10 to which the lidar technology is applied according to an embodiment of the present invention.

FIG. 6 is a diagram illustrating a user's movement for controlling the electronic faucet 10 of FIG. 5 .

7 is a view for explaining the control of the electronic faucet 10 according to the motion of FIG. 6 .

First, with reference to FIGS. 5 to 7 , the electronic faucet control according to the user's movement based on the lidar technology in the electronic faucet to which the present invention is applied will be described as follows.

As shown in FIG. 5 , the electronic faucet 10 includes a shower head unit 510 and a shower body 520 that supports the shower head unit 510 and into which a water pipe for supplying water is inserted. may include

The showerhead 510 may include a waterfall, and may include one or more lidar sensors.

In FIG. 5 , a plurality of lidar sensors, for example, a first lidar sensor 511 and a second lidar sensor 512 are mounted on the showerhead 510 .

According to an embodiment, at least one of the plurality of lidar sensors may be a rotating lidar sensor. In FIG. 5 , for convenience, the second lidar sensor 512 may be a rotating lidar sensor.

Also, according to an embodiment, the lidar sensor may be mounted on the shower body 520 instead of the shower head 510 .

According to an embodiment, when the electronic faucet 10 includes a plurality of lidar sensors, some may be mounted on the shower head unit 510 and the rest may be mounted on the shower body 520 . That is, the mounting position of the lidar sensor(s) may not be limited.

The shower body 520 may be equipped with a handy shower on one side, and may include a display 521 and a microcontroller 522 .

The display 521 is an LCD display, a touch screen display, or the like, and may output various data such as electronic faucet 10 usage data, electronic faucet 10 operation control data, and data related to the electronic faucet 10 .

According to an embodiment, the display 521 may be formed at the user's eye level, and the height may be adjusted in the direction of gravity according to the user.

Depending on the embodiment, the microcontroller 522 may be Java-based. The microcontroller 522 may be formed at the bottom of the shower body 520 .

At least one of the shower head unit 510 and the shower body 520, although not shown, may be further equipped with a microphone or speaker.

In FIG. 6 , a user motion suitable for operation control of the electronic faucet 10 among user motion sensed through a lidar sensor and a user motion not suitable for operation control of the electronic faucet 10 are shown.

6 (a) is an example of a user motion suitable for controlling the operation of the electronic faucet 10 among the user's motion sensed through the lidar sensor, and the user's body part and its motion are sensed. That is, when a motion of a user extending a hand (including a finger) and/or a clenching motion of a fist is predefined to control the operation of the electronic faucet 10, the lidar sensor moves the sensed user's hand to the electronic faucet. It can be determined as a suitable recognition target for the operation control of (10), and the sensed movement of the user's hand (opening or clenching a fist, etc.) is considered as a suitable user's motion for controlling the operation of the electronic faucet 10 can

On the other hand, (b) of FIG. 6 is an example of a recognition target or user motion that is not suitable for operation control of the electronic faucet 10, and the user's body part or user not related to the previously stored operation control of the electronic faucet 10 It is a sensed image of an object, not a body part. That is, when the motion of the user extending his or her hand (including a finger) and/or clenching a fist is preset for controlling the operation of the electronic faucet 10, the lidar sensor detects other body parts except for the user's hand. When (head, etc.) or other objects (shampoo bottle, shower, etc.) are sensed, they may not be determined as recognition targets for operation control of the electronic faucet 10, and furthermore, even if their movements are sensed, the electronic faucet 10 ) can be considered as an unsuitable motion for motion control. In addition, although not shown in FIG. 6 , the lidar sensor may determine the sensed user's hand as a suitable recognition target for operation control of the electronic faucet 10, but the sensed user's hand movement is the preset In the case of not a motion such as spreading a hand or clenching a fist (eg, interlocking fingers), this may be considered as a user's motion that is inappropriate for controlling the operation of the electronic faucet 10 .

Accordingly, in FIGS. 6A and 6B , the user's body part and its motion, for example, the hand and its motion, are sensed by the lidar sensor, and the electronic power receiver is based on the sensed hand and its motion data. (10) shows suitable and non-conforming motion data in the case of controlling the motion. However, the present invention is not necessarily limited to the illustrated examples. The contents related to this motion (body part or its movement) are preset in the electronic faucet 10 or can be arbitrarily set by the user.

In FIG. 7 , when it is determined that a suitable user's body part is sensed in FIG. 6 , a detailed description will be given of how to control the electronic faucet 10 according to the degree of its movement.

In FIG. 7( a ), it is an embodiment in which the temperature of water emitted from the electronic faucet 10 is adjusted as the user's hand moves horizontally from side to side. For example, based on the initially sensed position of the user's hand, moving to the left may lower the water temperature, and moving it in the opposite direction may increase the water temperature. To this end, the above body parts and/or their movements and corresponding controls may be preset.

In relation to this, the processor 13 recognizes the first movement of the user's hand movement sensed through the lidar sensor, and finally determines the user's hand movement direction, distance, angle, coordinates, motion, etc. therefrom, You can determine the degree of temperature control.

According to an embodiment, when a suitable user's motion sensed through the lidar sensor is detected, the processor 13 continues to move the user's hand from then on, that is, information about one or more of the moving direction, distance, angle, coordinates, and motion. The water temperature can be adjusted according to the movement of the user's hand in real time by sensing the In this case, if there is no more movement of the user's hand or there is an inappropriate additional motion of the user (eg, washing the head or washing the body with hands after moving the hand left and right), the processor 13 is You can stop regulating the water temperature.

According to an embodiment, the processor 13 detects an appropriate user motion sensed through the lidar sensor, but if the user's hand moves alternately left and right, the movement direction, distance, The water temperature of the electronic faucet 10 may be adjusted with reference to one or more information among angle, coordinate, and operation. At this time, the processor 13 does not stop after the user's motion sensed through the lidar sensor moves from the reference position by a predetermined direction and distance, and does not stop. You can pause for a moment and wait for the user's hand to stop moving. This is also the same in the case of water pressure control of FIG. 7 (b), which will be described later.

Referring to FIG. 7B , in the same manner as in FIG. 7A , the water pressure of the electronic faucet 10 can be adjusted according to the vertical movement distance of the user's hand.

7(a) and 7(b) illustrate examples of water temperature control according to the left and right movement of the user's hand and water pressure control according to the vertical movement, respectively.

According to an embodiment, if the user's hand moves left and right and then continuously moves up and down, the water temperature is adjusted according to the distance moved from the reference position to the left and right until the left and right movement stops, and the time when the left and right movement stops It is also possible to adjust the water pressure according to the distance moved up and down until the point where the up-down movement stops again with the reference position.

According to the embodiment, if the user's hand moves left and right and then moves up and down continuously, the reference position is applied the same as the first appropriate motion detection time, and the water temperature is adjusted according to the distance moved left and right until the left and right movement stops , it is also possible to calculate the diagonal distance from the reference position to the stopping distance of the vertical movement, and adjust the water pressure based thereon.

According to an embodiment, if the user's hand moves left and right and then continuously moves up and down, the user's intention is determined to be an up and down motion, and the distance moved up and down from the point at which the left and right motion stops, that is, the point where the up and down motion starts, is calculated. So you can adjust the water pressure. Conversely, in the case of continuously moving left and right after moving up and down, only water temperature control may be performed without water pressure control.

According to an embodiment, when the user's hand moves left and right and then continuously moves up and down, the distance moved from the reference position to the left and right from the reference position to the time when the left and right movement stops is calculated, and the time when the left and right movement stops is again the reference position After calculating the distance moved up and down until the point where the up-down movement stops, the water temperature and water pressure can be adjusted simultaneously with the average value of the two calculated distances.

8 is a perspective view of the neck care device 20 to which the lidar technology is applied according to an embodiment of the present invention.

9 is a diagram illustrating a motion for providing guide data of the neck care device 20 of FIG. 8 .

FIG. 10 is a diagram illustrating the provision of guide data of the neck care device 20 according to the motion of FIG. 9 .

First, with reference to FIGS. 8 to 10 , in the neck care device 20 to which the present invention is applied, the provision of neck care guide data according to a user's movement based on the lidar technology will be described as follows.

As shown in FIG. 8 , the neck care device 20 is a fixed device installed in a predetermined space, and provides feedback and health guide data by detecting the user's motion through a lidar sensor to protect it from a neck disk or the like. It can be used for posture correction.

The neck care device 20 includes a head unit 810 equipped with at least one lidar sensor, a module supporting the head unit 810 and measuring carbon dioxide concentration, which is a factor for user fatigue or drowsiness. It may include a built-in body 820 .

At least one lidar sensor mounted on the head unit 810 may be a rotating lidar sensor.

According to an embodiment, the lidar sensor may be mounted on the body 820 instead of the head 810 .

According to an embodiment, when the neck care device 20 includes a plurality of lidar sensors, some may be mounted on the head unit 810 and the rest may be mounted on the body 820 . That is, the mounting position of the lidar sensor(s) may not be limited.

Although not shown, the head unit 810 is not fixed to the body 820, but is adjustable in height, so that accurate sensing through the lidar sensor is possible by adjusting the height of the head unit 810 according to the use. can

The head unit 810 or body 820 may include a display (not shown) and a microcontroller (not shown).

The display is an LCD display, a touch screen display, etc., and outputs various data, such as data using the neck care device 20 , guide data generated according to user motion in the neck care device 20 , and data related to the neck care device 20 . can do.

According to an embodiment, the display may be formed at the user's eye level.

According to an embodiment, the microcontroller may be Java-based. The microcontroller may be formed at the bottom of the body.

At least one of the head part 810 and the body 820, although not shown, a microphone or a speaker may be further mounted.

In FIG. 9 , a user motion suitable for operation control of the neck care device 20 and a user motion not suitable for operation control of the neck care device 20 among the user motion sensed through the lidar sensor are shown.

9 (a) is an example of a user motion suitable for providing a guide through the neck care device 20 among the user's motion sensed by the lidar sensor, and the user's body part, that is, the side of the face, the jaw line, and its movement A sensed appearance for That is, if the user's chin or facial part (eg, the jaw line and side of the face, etc.), neck, waist, or spine and their movements are preset as a motion for providing a guide through the neck care device 20, The IDA sensor may determine the sensed user's chin or face to neck, waist or spine as a suitable recognition target for providing a guide through the neck care device 20, and the sensed user's chin or face to neck , the movement of the waist or the spine may be considered as a motion of the user suitable for providing a guide through the neck care device 20 .

On the other hand, FIGS. 9 (b) and 9 (c) are examples of recognition objects or user motions that are not suitable for providing a guide through the neck care device 20, and control the operation of the neck care device 20 set in advance. The user's body part (hand) not related to the user's body part, or an object (book) other than the user's body part is sensed. That is, if the user's chin or facial part (eg, the jaw line and side of the face, etc.), neck, waist, or spine and their movements are preset as a motion for providing a guide through the neck care device 20, In the case where the user's chin, face, neck, waist, or other body parts (hands, etc.) or other objects (books, etc.) are sensed, the sensor is the recognition target of providing a guide through the neck care device 20. may not be determined, and further, even if their movements are sensed, they may be considered as inappropriate motions in providing a guide through the neck care device 20 . In addition, although not shown in FIG. 7 , the lidar sensor may determine the sensed user's chin or face, neck, waist or spine as a suitable recognition target for providing a guide through the neck care device 20, but the sensing If the movement of the user's chin or face, neck, waist, or spine is not the preset movement, it may be considered as an inappropriate user's motion in providing a guide through the neck care device 20 .

Accordingly, FIGS. 9A to 9C show the user's body parts and their movements, for example, the chin and its movements are sensed by the lidar sensor, and the neck care device ( 20) shows suitable and inappropriate motion data for providing health guide data. However, the present invention is not necessarily limited to the illustrated examples. Content related to such a motion (a body part or its movement) is preset in the neck care device 20 or can be arbitrarily set by a user.

In FIG. 10, the user's jaw line or the side contour of the face (from the chin to the forehead) is sensed, and when a virtual line is drawn from the starting point of the chin to the ending point of the forehead through the lidar sensor, the virtual direction of gravity is It is possible to determine whether the posture is normal based on the difference in angle from the reference line.

In Figure 10 (a), as one of the normal postures, if the angle between the virtual line from the user's chin to the forehead and the virtual reference line in the direction of gravity is determined to be less than or equal to a predetermined threshold, it can be determined as a normal posture. .

On the other hand, in (b) of FIG. 10, it is determined that the angle between the virtual line from the user's chin to the forehead and the virtual reference line in the direction of gravity exceeds a predetermined threshold in an abnormal posture, for example, turtle neck posture. If you do, it is judged as an abnormal posture. Accordingly, the neck care device 20 may generate and provide health guide data for correcting the user's abnormal posture in the case of FIG. 10B .

According to an embodiment, the health guide data may be directly provided to the user in various forms through a display, a speaker, a vibrator, and the like in the neck care device 20 .

According to an embodiment, the health guide data may be provided from the neck care device 20 to a terminal connected through a wired/wireless communication protocol or a registered terminal. In relation to the present invention, the terminal may comprehensively check the health management data transmitted through the execution of the aforementioned health management application in real time or by collecting it.

According to an embodiment, health guide data may be processed and managed in units set such as time, day, month, year, and the like.

According to an embodiment, when a suitable user's motion sensed through the lidar sensor is detected, the processor 13 continuously calculates the movement of the user's chin or face, that is, the moving direction (angle) and/or distance to pose in real time. Guide data for calibration can be provided.

According to an embodiment, the processor 13 detects a suitable user motion sensed through the lidar sensor, but when the motion continues, the user's movement does not calculate the direction and distance according to the movement of the user's chin or face in real time. Wait until it stops. After that, when the user's movement stops, only the moving direction and distance at that point in time is calculated based on reference data for generating health guide data (eg, (a) of FIG. 10), and based on whether the posture is normal or abnormal After cognition determination, health guide data may be generated and provided.

The electronic devices 10 and 20 may process data sensed by the lidar sensor related to the present invention in a Java-based microcontroller and perform processing such as extraction, comparative analysis, and generation of necessary related data. First, the recognized shape is analyzed so that it can be recognized only by the user, and then data recognized from the lidar sensor can be converted through a coordinate conversion algorithm. Next, it is possible to generate health guide data to check the degree of curvature of the user's waist or neck through an algorithmized system by analyzing various motions, and feed back the generated health guide data to the user through a display.

According to an embodiment, in the case of the neck care device 20, although not shown, health guide data including a lighting device may be provided to the user through a lighting device capable of irradiating various colors.

The microcontroller of the electronic devices 10 and 20 may process the data sensed by the lidar sensor according to the present invention as follows. First, it is possible to use an object identification algorithm that recognizes only a specific body part of the user, that is, the hand or the neck.

Next, data on the recognized body part distance, angle, coordinates, motion, etc. are converted into data types representing one or more of polar coordinate data, Cartesian coordinate data, or distance, angle, position, direction, coordinates, spatial information, and mapping data, respectively. They can be converted individually. An algorithm that sets a reference value for the user's movement and allows only motion that meets the reference value as a motion control signal or health guide data target motion may be used.

Finally, based on such data, operation control of the electronic device 10 may be performed or the neck care device 20 may provide health guide data to the user. The above-described algorithm may be written as a code using API and mounted on the electronic devices 10 and 20 .

On the other hand, in relation to the present invention, in order to prevent malfunction of the infrared laser of the lidar, it may have a design as shown in FIG. 5 that can reduce the error of the refraction phenomenon in water or fog conditions. In addition, an infrared wavelength laser (eg, 1,550 nm) may be used for higher accuracy through the lidar, but is not limited thereto.

Meanwhile, the above-described method can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable medium. In addition, the structure of data used in the above-described method may be recorded in a computer-readable medium through various means. A computer readable medium storing executable computer code for performing various methods of the present invention may be a magnetic storage medium (eg, ROM, floppy disk, hard disk, etc.), an optically readable medium (eg, CD-ROM, DVD). storage media, such as).

Those of ordinary skill in the art related to the embodiments of the present invention will understand that it can be implemented in a modified form within a range that does not depart from the essential characteristics of the description. Therefore, the disclosed methods are to be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated in the claims rather than the detailed description of the invention, and all differences within the scope equivalent thereto should be construed as being included in the scope of the present invention.

The present invention is applicable to all electronic devices to which lidar technology is applied, including lidar sensors.

Claims (10)

A method for controlling an electronic device including one or more lidar sensors, the method comprising:
acquiring data on the user's movement through the one or more lidar sensors;
At least one or more data on distance, angle, position, direction, coordinates, spatial information, or mapping data for a user, a specific body part, object, or each of these movements, based on the acquired data on the user's movement individually acquiring; and
Controlling the operation of the electronic device based on the one or more acquired data; and a method for controlling an electronic device. According to claim 1,
Storing the user, the user's specific body parts and objects, and data on their respective movements or the user, the user's specific body parts and objects, and operation control data of the electronic device according to their respective movements; further comprising A method of controlling an electronic device. According to claim 1,
The acquired data includes a data type representing at least one of a polar coordinate data type, a Cartesian coordinate data type, or a distance, angle, location, direction, coordinate, spatial information, and mapping data of an object to be recognized, an electronic device control method . 4. The method of claim 3,
An electronic device control method of calculating a movement amount, a movement speed, and a movement direction of the user's body part based on the acquired data. 5. The method of claim 4,
In the calculated movement amount, if some or all of the movement amount in the x-axis, y-axis, z-axis, or a movement in a straight or curved shape is greater than or equal to a threshold value, only the movement amount with a larger change in movement amount is valid data A method of controlling an electronic device using as 5. The method of claim 4,
In the calculated movement amount, if some or all of the movement amount in the x-axis, y-axis, and z-axis or in a specific direction or movement in a linear or curved form is greater than or equal to a threshold, some or all of the change in each movement amount is effective A method of controlling an electronic device using data. 5. The method of claim 4,
In the calculated movement amount, if some or all of the movement amount in the x-axis, y-axis, z-axis, or movement in a straight or curved form is greater than or equal to the threshold value, the movement amount of the axis changed late on the time axis regardless of the movement amount An electronic device control method using only valid data. According to claim 1,
The at least one lidar sensor,
Rotary lidar sensor, fixed lidar sensor, super lidar sensor, 2D lidar sensor, 3D lidar sensor, device lidar sensor, MEMS lidar sensor, flash lidar sensor, OPA lidar sensor, FMCW lidar sensor , a camera-type lidar, lidar scanner, multi-layer scanner or a linear measurement sensor. In the electronic faucet,
Memory;
one or more lidar sensors; and
including a processor;
The processor is
Obtaining data on the user's movement through the one or more LiDAR sensors, recognizing the user's hand part based on the obtained data on the user's movement, and the recognized user through the one or more LiDAR sensors Obtaining one or more data individually for distance, angle, position, direction, coordinates, spatial information or mapping data with respect to the movement of the hand, and controlling the operation of the electronic faucet based on the acquired one or more data, electronic faucet. In the neck care device,
Memory;
one or more lidar sensors; and
including a processor;
The processor is
Acquire data on the user's movement through the one or more LiDAR sensors, recognize the user's chin or face, neck, waist, or spine based on the acquired data on the user's movement, and One or more data is individually acquired for the distance, angle, position, direction, coordinates, spatial information or mapping data with respect to the movement of the recognized user's chin, face, neck, waist, or spine through the IDA sensor, A neck care device that provides health guide data to the user based on the acquired one or more data.

Images