KR20220146031A - Electronic device for detecting black ice and controlling method thereof - Google Patents

Abstract

Disclosed are an electronic device and a method for controlling the electronic device. In particular, the electronic device according to the present invention is provided to detect black ice on the road surface, and comprises: a light which radiates a short-wave infrared light; a first camera detecting the short-wave infrared light; a memory; and a processor which controls the light to radiate the short-wave infrared light, detects the short-wave infrared light reflected from the road surface by means of the first camera to acquire an image with respect to the road surface, identifies a first area which displays that the radiated short-wave infrared light is absorbed by the road surface in the acquired image, and, when the first area is identified, determines that water or ice exists on the area of the road surface corresponding to the first area of the image. Therefore, black ice can be precisely detected.

Description

ELECTRONIC DEVICE FOR DETECTING BLACK ICE AND CONTROLLING METHOD THEREOF

The present disclosure relates to an electronic device and a control method of the electronic device, and more particularly, to an electronic device capable of detecting black ice and a control method of the electronic device.

Black ice has been pointed out as one of the main causes of road traffic accidents in winter from the past to the present. Black ice can form on the road surface in cases such as a sudden drop in temperature, and since the coefficient of friction is only 0.05, it makes the braking distance of a vehicle more than double that of a dry road surface, resulting in various types of traffic accidents may cause

In particular, due to the recent development of autonomous driving technology, the need for a technology capable of accurately detecting black ice on a road surface while driving a vehicle and preventing a traffic accident caused by black ice is further emphasized.

As a prior art for detecting black ice, a technique for predicting black ice present in a vehicle-cooled driving path using a temperature sensor and a GPS sensor, a technique for removing black ice using piezoelectric power generation, and a technique for removing reflected light and Although there exist a technique for detecting black ice using a difference in brightness of transmitted light, there is a continuing demand for a technique capable of detecting black ice more accurately compared to the prior art.

The present disclosure has been made in accordance with the above-described needs, and an object of the present disclosure is to provide an electronic device capable of accurately detecting black ice on a road surface using a shortwave infrared camera and a control method of the electronic device.

Another object of the present disclosure is to provide an electronic device capable of more accurately detecting black ice on a road surface by using a short-wave infrared camera and a long-wave infrared camera together, and a method for controlling the electronic device.

According to an embodiment of the present disclosure for achieving the object as described above, an electronic device controls the illumination to emit short wave infrared light, a first camera for sensing the short wave infrared light, a memory, and the short wave infrared light. and, through the first camera, detects the short-wave infrared reflected by the road surface to obtain an image of the road surface, indicating that the emitted short-wave infrared radiation is absorbed by the road surface in the acquired image and a processor for identifying a first region, and determining, when the first region is identified, that water or ice is present on a region of the road surface corresponding to the first region of the image.

Here, a second camera for detecting infrared rays having a longer wavelength than the short-wave infrared rays; further comprising, wherein the processor obtains information on the surface temperature of the road surface through the second camera, and based on the information on the surface temperature, the surface temperature of the first region is less than or equal to a preset threshold temperature. A second area may be identified, and when the second area is identified, it may be determined that ice is present on the area of the road surface corresponding to the second area of the image.

Here, the critical temperature may be 0 degrees Celsius.

Meanwhile, the short-wave infrared rays may be infrared rays having a wavelength of 1400 nm or more and less than 1800 nm, and the infrared rays having a longer wavelength than the short-wave infrared rays may be infrared rays having a wavelength of 3000 nm or more and less than 15000 nm.

Here, the short-wave infrared rays may be infrared rays having a wavelength of 1400 nm or more and less than 1500 nm, and the infrared rays having a longer wavelength than the short-wave infrared rays may be infrared rays having a wavelength of 8000 nm or more and less than 15000 nm.

Meanwhile, the electronic device further includes an output unit, and the processor obtains information for driving of the vehicle based on the information on the first area or the information on the second area, and through the output unit, It can provide information for driving.

According to an embodiment of the present disclosure for achieving the object as described above, a control method of an electronic device including an illumination emitting shortwave infrared and a first camera sensing the shortwave infrared may be configured to emit the shortwave infrared. controlling lighting, detecting the short-wave infrared light reflected by the road surface through the first camera to obtain an image of the road surface; identifying a first region indicating that it has been absorbed by do.

Here, the electronic device further includes a second camera for detecting infrared rays having a longer wavelength than the short-wave infrared rays, and the control method of the electronic device includes obtaining information on the surface temperature of the road surface through the second camera Step, based on the information on the surface temperature, identifying a second region of the first region having a surface temperature equal to or less than a preset threshold temperature, and when the second region is identified, corresponding to the second region of the image The method may further include determining that ice is present on the area of the road surface.

Here, the critical temperature is 0 degrees Celsius, the short-wave infrared rays may be infrared rays having a wavelength of 1400 nm or more and less than 1500 nm, and the infrared rays having a longer wavelength than the short-wave infrared rays may be infrared rays having a wavelength of 8000 nm or more and less than 15000 nm.

According to an embodiment of the present disclosure for achieving the object as described above, in a non-transitory computer-readable recording medium including a program for executing a control method of an electronic device, the electronic device is a light emitting shortwave infrared and a first camera detecting the short-wave infrared, wherein the controlling method of the electronic device includes controlling the illumination to emit the short-wave infrared, the short-wave infrared reflected by the road surface through the first camera acquiring an image of the road surface by detecting and determining that water or ice is present on an area of the road surface that corresponds to the first area of the image.

1 is a block diagram schematically illustrating a configuration of an electronic device according to an embodiment of the present disclosure;
2 is a graph showing the absorption rate of short-wave infrared by water or ice;
3 is a view showing an image of a road surface when water or ice is present on the road surface;
4 is a view showing an image of a road surface when there is no water or ice on the road surface;
5 is a block diagram illustrating in detail the configuration of an electronic device according to an embodiment of the present disclosure;
6 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;
7 is a flowchart illustrating a control method of an electronic device according to another embodiment of the present disclosure.

Since the present embodiments can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for like components.

In describing the present disclosure, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted.

In addition, the following examples may be modified in various other forms, and the scope of the technical spirit of the present disclosure is not limited to the following examples. Rather, these embodiments are provided to more fully and complete the present disclosure, and to fully convey the technical spirit of the present disclosure to those skilled in the art.

The terms used in the present disclosure are used only to describe specific embodiments, and are not intended to limit the scope of rights. The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

In this disclosure, expressions such as “A or B,” “at least one of A and/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, "A or B," "at least one of A and B," or "at least one of A or B" means (1) includes at least one A, (2) includes at least one B; Or (3) it may refer to all cases including both at least one A and at least one B.

As used in the present disclosure, expressions such as “first,” “second,” “first,” or “second,” may modify various elements, regardless of order and/or importance, and refer to one element. It is used only to distinguish it from other components, and does not limit the components.

A component (eg, a first component) is "coupled with/to (operatively or communicatively)" to another component (eg, a second component) When referring to "connected to", it should be understood that the certain element may be directly connected to the other element or may be connected through another element (eg, a third element).

On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), the component and the It may be understood that other components (eg, a third component) do not exist between other components.

The expression "configured to (or configured to)" as used in this disclosure depends on the context, for example, "suitable for," "having the capacity to" ," "designed to," "adapted to," "made to," or "capable of." The term “configured (or configured to)” may not necessarily mean only “specifically designed to” in hardware.

Instead, in some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase “a processor configured (or configured to perform) A, B, and C” refers to a dedicated processor (eg, an embedded processor) for performing the operations, or by executing one or more software programs stored in a memory device. , may mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

In an embodiment, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and implemented by at least one processor, except for 'modules' or 'units' that need to be implemented with specific hardware.

Meanwhile, various elements and regions in the drawings are schematically drawn. Accordingly, the technical spirit of the present invention is not limited by the relative size or spacing drawn in the accompanying drawings.

Hereinafter, embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them.

1 is a block diagram schematically showing the configuration of an electronic device 100 according to an embodiment of the present disclosure, FIG. 2 is a graph showing the absorption rate of short-wave infrared rays by water or ice, and FIG. 3 is a water surface on a road surface. Alternatively, it is a diagram illustrating an image of a road surface when ice is present, and FIG. 4 is a diagram illustrating an image of a road surface when water or ice is not present on the road surface.

Hereinafter, an embodiment of the present disclosure will be described in detail with reference to FIGS. 1 to 4 together.

First, the electronic device 100 according to the present disclosure acquires an image of a road surface through a camera included in the electronic device 100 and detects black ice on the road surface based on the acquired image. device that can Black ice refers to dark, thin ice formed on the road surface, and can occur when drizzle or drizzle falls on a road surface below 0 degrees Celsius, or when the surface temperature of an already wet road falls below the freezing point.

In particular, the electronic device 100 may be mounted on a vehicle to acquire an image of a road surface while the vehicle travels on the road, and may detect black ice on the road surface in real time. As an example, the electronic device 100 according to the present disclosure may be implemented as a device such as a smart phone or a black box, but there is no particular limitation on the type of the electronic device 100 according to the present disclosure.

Referring to FIG. 1 , an electronic device 100 according to an embodiment of the present disclosure may include a lighting 110 , a first camera 120 , a memory 130 , and a processor 140 .

The lighting 110 may emit short-wave infrared rays. Specifically, the lighting 110 may radiate short-wave infrared rays toward the road surface under the control of the processor 140 . Here, the short-wave infrared refers to infrared rays having a wavelength of 1400 nm or more and less than 3000 nm. In particular, the illumination 110 according to the present disclosure may be implemented to emit infrared rays having a wavelength of 1400 nm or more and less than 1500 nm.

In the description of the present disclosure, it will be described on the premise that the lighting 110 and the first camera 120 are separated from each other, but this is only for clearly distinguishing and explaining the operation of each of the components according to the present disclosure, Of course, the lighting 110 may be implemented in a form combined with the first camera 120 according to the present disclosure. For example, when the illumination 110 is implemented in a form combined with the first camera 120 , the first camera 120 includes a light emitting unit including the illumination 110 and a light receiving unit including a lens and an image sensor. may include

The first camera 120 may detect short wave infrared rays. Specifically, when short-wave infrared rays are emitted by the lighting 110 , the first camera 120 may detect short-wave infrared rays reflected by the road surface. That is, the first camera 120 according to the present disclosure may be implemented as a so-called short-wave infrared camera or a SWIR (Short Wavelength InfraRed) camera. The wavelength range of the short-wave infrared that can be detected by the first camera 120 and the wavelength range of the short-wave infrared that are emitted by the illumination 110 may be different, but the wavelength range of the short-wave infrared that can be detected by the first camera 120 is Preferably, the wavelength range includes the wavelength range of shortwave infrared radiation emitted by the illumination 110 .

At least one instruction related to the electronic device 100 may be stored in the memory 130 . In addition, an operating system (O/S) for driving the electronic device 100 may be stored in the memory 130 . In addition, various software programs or applications for operating the electronic device 100 according to various embodiments of the present disclosure may be stored in the memory 130 . In addition, the memory 130 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

Specifically, various software modules for operating the electronic device 100 may be stored in the memory 130 according to various embodiments of the present disclosure, and the processor 140 executes various software modules stored in the memory 130 . Thus, the operation of the electronic device 100 may be controlled. That is, the memory 130 is accessed by the processor 140 , and reading/writing/modification/deletion/update of data by the processor 140 may be performed.

Meanwhile, in the present disclosure, the term "memory 130" refers to the memory 130, a ROM (not shown) in the processor 140, a RAM (not shown), or a memory card (not shown) mounted in the electronic device 100 (eg, For example, micro SD card, memory stick) may be used in the sense of including.

In particular, in various embodiments according to the present disclosure, the memory 130 includes information on the direction and wavelength range of the short-wave infrared light emitted by the illumination 110 , and information on the image acquired through the first camera 120 . , information on the surface temperature of the road surface obtained through the second camera 150 , information on the first and second regions identified according to the present disclosure, and information for driving the vehicle, etc. may be stored. In addition, various information necessary within the scope for achieving the object of the present disclosure may be stored in the memory 130, and the information stored in the memory 130 may be updated as it is received from an external device or input by a user. .

The processor 140 controls the overall operation of the electronic device 100 . Specifically, the processor 140 is connected to the configuration of the electronic device 100 including the lighting 110 , the first camera 120 and the memory 130 , and at least one stored in the memory 130 as described above. By executing the instruction of , it is possible to control overall operation of the electronic device 100 .

The processor 140 may be implemented in various ways. For example, the processor 140 may include an Application Specific Integrated Circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), or a digital signal processor (Digital Signal). Processor, DSP). Meanwhile, in the present disclosure, the term processor 140 may be used to include a central processing unit (CPU), a graphic processing unit (GPU), a main processing unit (MPU), and the like.

In particular, in various embodiments according to the present disclosure, the processor 140 may control the illumination 110 to emit short-wave infrared rays. According to an embodiment, the processor 140 controls the driving unit (not shown) coupled to the lighting 110 so that the short-wave infrared rays can be radiated toward the road surface, and the angle at which the lighting 110 emits the short-wave infrared rays is determined. can be adjusted

After the shortwave infrared is emitted, the processor 140 may acquire an image of the road surface by detecting the shortwave infrared reflected by the road surface through the first camera 120 . Specifically, when shortwave infrared rays reflected by the road surface are detected through the first camera 120 , the processor 140 converts the sensed shortwave infrared rays into an electrical signal to obtain an image of the road surface.

According to an embodiment, the processor 140 may acquire an image of the road surface through the first camera 120 while the electronic device 100 is mounted on the vehicle and the vehicle travels on the road. Hereinafter, in describing the present disclosure, the term 'image' may be used in the same meaning as 'image on a road surface'.

Meanwhile, the processor 140 may convert an image of a road surface into a top-view image, and perform a process of identifying a first region and a second region from the converted top-view image, which will be described later. Here, the process of converting the image of the road surface into a top view image may be performed using an inverse perspective mapping (IPM) technique. In the image of the road surface, the lanes show a form that converges toward the vanishing point in the center of the image. This is due to the perspective effect proportional to the angle of view of the lens included in the first camera 120 , and since the actual road exists on a 3D plane, it is preferable to remove the perspective effect for accurate lane detection. Accordingly, the processor 140 performs IPM for mapping the 3D plane to the 2D plane using conditions such as the position, coordinates, and optical features of the first camera 120, You can convert an image of a road surface into a top view image. In acquiring the top view image according to the present disclosure, various techniques may be applied in addition to the IPM technique.

When an image of the road surface is acquired, the processor 140 may identify a first region indicating that short-wave infrared rays are absorbed by the road surface in the acquired image. When the first area is identified as a result of the identification, the processor 140 may determine that water or ice is present on the area of the road surface corresponding to the first area of the image. On the other hand, if the first area is not identified, the processor 140 may determine that there is no water or ice on the road surface. In the description of the present disclosure, it is assumed that a first area, which is one area, is identified for convenience of description, but it goes without saying that a plurality of physically separated areas may be identified as a result of identification.

Specifically, referring to FIG. 2 showing the absorption coefficient according to the wavelength range, it can be confirmed that the infrared rays having a wavelength of 1400 nm to 1500 nm among short-wave infrared rays have a very high absorption rate by water or ice. Accordingly, when water or ice is present on the road surface, short-wave infrared rays do not appear in an area corresponding to the area in which water or ice exists in the image of the road surface.

For example, when short-wave infrared rays in the form of a line are irradiated to the center of a road surface, if there is no water or ice in the center of the road surface, the image of the road surface is A region 310 corresponding to the reflected short-wave infrared light may appear. On the other hand, when short-wave infrared rays in the form of a line are irradiated to the center of the road surface, if water or ice exists in the center of the road surface, the image of the road surface is different from the example of FIG. 3 , as in the example of FIG. The short-wave infrared reflected by the surface includes an invisible region 410 . And, in the case of FIG. 4 , it may be estimated that water or ice is present on one region 420 including the region 410 where shortwave infrared rays reflected by the road surface are not visible.

According to the above-described embodiment, the electronic device 100 may identify an area in which water or ice exists on the road surface based on the short-wave infrared reflected by the road surface after irradiating the short-wave infrared rays to the road surface, , thus making it possible to detect an area where black ice is likely to exist. In particular, since short-wave infrared rays hardly exist in natural light, when the illumination 110 emitting short-wave infrared rays and a short-wave infrared camera are used as in the present disclosure, black ice on the road surface is accurately detected without the influence of noise from an external light source. be able to do

5 is a block diagram illustrating in detail the configuration of the electronic device 100 according to an embodiment of the present disclosure.

As shown in FIG. 5 , the electronic device 100 according to an embodiment of the present disclosure includes a lighting 110 , a first camera 120 , a memory 130 , and a processor 140 as well as a second camera ( 150 ), an input unit 160 , and an output unit 170 may be further included. However, the configurations shown in FIG. 5 are merely exemplary, and in implementing the present disclosure, a new configuration may be added or some configurations may be omitted in addition to the configuration shown in FIG. 5 .

The second camera 150 may detect infrared rays having a longer wavelength than the first camera 120 . Specifically, the second camera 150 may detect infrared rays having a wavelength of 3000 nm or more and less than 15000 nm, and more specifically, may detect infrared rays having a wavelength of 8000 nm or more and less than 15000 nm. That is, the second camera 150 according to the present disclosure may be referred to as a thermal imaging camera capable of detecting Long Wavelength InfraRed (LWIR). However, infrared light that can be detected by the second camera 150 according to the present disclosure is not limited to long-wave infrared, and mid-wavelength infrared (LWIR, Mid-Wavelength InfraRed) may be sensed in addition to long-wave infrared.

The processor 140 may acquire information about the surface temperature of the road surface through the second camera 150 . Specifically, the processor 140 detects long-wave infrared rays emitted from the object through the second camera 150, and uses the fact that the higher the temperature of the object emits shorter wavelength infrared rays, information can be obtained. As an example, the information on the surface temperature of the object may be expressed as a color close to red as the surface temperature is high, and as a thermal image expressed in a color close to purple as the surface temperature is low.

When information on the surface temperature of the road surface is obtained, the processor 140 may identify a second area in which the surface temperature is equal to or less than a preset threshold temperature among the first areas based on the information on the surface temperature of the road surface. Here, the critical temperature may be 0 degrees Celsius, and thus, a region having a surface temperature below the critical temperature may be estimated as a region in which ice exists. According to an embodiment, the critical temperature may be set to various temperatures, such as 2 degrees Celsius, in consideration of errors that may occur when measuring the surface temperature.

If the second area is identified as a result of the identification, the processor 140 may determine that ice is present on the area of the road surface corresponding to the second area of the image. On the other hand, if the second area is not identified, the processor 140 may determine that only water exists on the road surface area corresponding to the first area of the image and no ice exists.

According to the above-described embodiment, the electronic device 100 may not only identify an area where water or ice exists on the road surface as described above with reference to FIGS. It is possible to identify an area in which ice is present from among the existing areas, and accordingly, the accuracy of black ice detection may be improved.

The input unit 160 includes a circuit, and the processor 140 may receive a user command for controlling the operation of the electronic device 100 through the input unit 160 . Specifically, the input unit 160 may be configured such as a microphone and a remote control signal receiver. In addition, the input unit 160 may further include cameras other than the first camera 120 and the second camera 150 according to the present disclosure. Also, the input unit 160 may be implemented as a touch screen and included in the display.

In particular, according to various embodiments of the present disclosure, the input unit 160 may receive various types of user commands, such as a user command for acquiring an image of a road surface, a user command for requesting black ice detection, and the like. .

The output unit 170 includes a circuit, and the processor 140 may output various functions that the electronic device 100 can perform through the output unit 170 . In addition, the output unit 170 may include at least one of a display, a speaker, and an indicator.

The display may output image data under the control of the processor 140 . Specifically, the display may output an image pre-stored in the memory 130 under the control of the processor 140 . In particular, the display according to an embodiment of the present disclosure may display a user interface stored in the memory 130 . The speaker may output audio data under the control of the processor 140 , and the indicator may be lit under the control of the processor 140 .

In particular, according to various embodiments of the present disclosure, the processor 140 may acquire information for autonomous driving of the vehicle based on the information on the first area or the information on the second area.

Here, 'information for driving a vehicle' is a general term for information that can be helpful for driving on a road, and may include information for autonomous driving of a vehicle. As an example, the information for driving the vehicle may be generated by using not only the information on the first area or the information on the second area, but also information on the driving route of the vehicle and information on the weather.

Meanwhile, in the above description, the process in which the electronic device 100 acquires an image of a road surface according to the present disclosure and detects black ice on the road surface based on the acquired image has been described above, but this is the main implementation according to the present disclosure This is only to clarify the example. That is, various embodiments according to the present disclosure may be similarly applied to a process of detecting a region in which water or ice exists on a surface of an object other than a road surface.

6 is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure, and FIG. 7 is a flowchart illustrating a control method of the electronic device 100 according to another embodiment of the present disclosure.

Referring to FIG. 6 , the electronic device 100 may control lighting included in the electronic device 100 to emit short-wave infrared rays ( S610 ).

After the shortwave infrared is emitted, the electronic device 100 may acquire an image of the road surface by detecting the shortwave infrared reflected by the road surface through the first camera ( S620 ). Specifically, when the shortwave infrared reflected by the road surface is detected through the first camera, the electronic device 100 may obtain an image of the road surface by converting the sensed shortwave infrared light into an electrical signal.

When the image of the road surface is acquired, the electronic device 100 may identify a first region indicating that shortwave infrared rays are absorbed by the road surface in the acquired image ( S630 ). When the first area is identified as a result of the identification (S630-Y), the electronic device 100 may determine that water or ice is present on the area of the road surface corresponding to the first area of the image (S640). On the other hand, if the first area is not identified (S630-N), the electronic device 100 may determine that there is no water or ice on the road surface (S650).

Meanwhile, FIG. 7 illustrates a control that may be performed by the electronic device 100 when it is determined that water or ice is present on the area of the road surface corresponding to the first area of the image in the embodiment of FIG. 6 ( S640 ). It is a drawing for explaining the method.

Referring to FIG. 7 , when it is determined that water or ice is present on the area of the road surface corresponding to the first area of the image ( S640 ), the electronic device 100 determines the surface temperature of the road surface through the second camera. information can be obtained (S710).

When information on the surface temperature of the road surface is obtained, the electronic device 100 may identify a second area in which the surface temperature of the first area is equal to or less than a preset threshold temperature, based on the information on the surface temperature of the road surface. (S720).

If the second area is identified as a result of the identification (S720-Y), the electronic device 100 may determine that ice is present on the area of the road surface corresponding to the second area of the image (S730). On the other hand, if the second region is not identified, the electronic device 100 may determine that there is only water and no ice on the region of the road surface corresponding to the first region of the image (S740).

Meanwhile, the control method of the electronic device 100 according to the above-described embodiment may be implemented as a program and provided to the electronic device 100 . In particular, a program including a control method of the electronic device 100 may be stored and provided in a non-transitory computer readable medium.

Specifically, in a non-transitory computer-readable recording medium including a program for executing a control method of the electronic device 100, the electronic device 100 includes an illumination emitting short-wave infrared and a first camera for detecting the short-wave infrared. Including, the control method of the electronic device 100 includes the steps of controlling the lighting to emit shortwave infrared rays, detecting the shortwave infrared rays reflected by the road surface through the first camera to obtain an image of the road surface; identifying a first area indicating that the shortwave infrared radiation emitted from the acquired image has been absorbed by the road surface, and when the first area is identified, water or ice is present on the area of the road surface corresponding to the first area of the image It may include the step of determining that

In the above, the control method of the electronic device 100 and the computer-readable recording medium including the program for executing the control method of the electronic device 100 have been briefly described, but this is only for omitting redundant description, and Of course, various embodiments of the device 100 may be applied to a computer-readable recording medium including a control method of the electronic device 100 and a program for executing the control method of the electronic device 100 .

The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' is a tangible device and only means that it does not contain a signal (eg, electromagnetic wave). It does not distinguish the case where it is stored as For example, the 'non-transitory storage medium' may include a buffer in which data is temporarily stored.

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product (eg, a downloadable app) is stored at least in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server. It may be temporarily stored or temporarily created.

As described above, each of the components (eg, a module or a program) according to various embodiments of the present disclosure may be composed of a singular or a plurality of entities, and some of the above-described corresponding sub-components are omitted. Alternatively, other sub-components may be further included in various embodiments. Alternatively or additionally, some components (eg, a module or a program) may be integrated into a single entity to perform the same or similar functions performed by each corresponding component prior to integration.

According to various embodiments, operations performed by a module, program, or other component may be sequentially, parallel, repetitively or heuristically executed, or at least some operations may be executed in a different order, omitted, or other operations may be added. can

Meanwhile, the term “unit” or “module” used in the present disclosure includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. can A “unit” or “module” may be an integrally constituted part or a minimum unit or a part thereof that performs one or more functions. For example, the module may be configured as an application-specific integrated circuit (ASIC).

Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium readable by a machine (eg, a computer). The device calls the stored instructions from the storage medium. and an electronic device (eg, the electronic device 100) according to the disclosed embodiments as a device capable of operating according to the called command.

When the instruction is executed by the processor 140 , the processor 140 may perform a function corresponding to the instruction by using other components directly or under the control of the processor 140 . Instructions may include code generated or executed by a compiler or interpreter.

In the above, preferred embodiments of the present disclosure have been illustrated and described, but the present disclosure is not limited to the specific embodiments described above, and it is common in the technical field to which the disclosure pertains without departing from the gist of the present disclosure as claimed in the claims. Various modifications may be made by those having the knowledge of

100: electronic device 110: lighting
120: first camera 130: memory
140: processor 150: second camera
160: input unit 170: output unit

Claims (10)

In an electronic device,
Lights that emit shortwave infrared;
a first camera for detecting the short-wave infrared;
Memory; and
controlling the illumination to emit the short-wave infrared;
Through the first camera, by detecting the short-wave infrared reflected by the road surface to obtain an image of the road surface,
identifying a first region in the acquired image indicating that the emitted short-wave infrared light has been absorbed by the road surface;
a processor for determining that water or ice is present on a region of the road surface corresponding to the first region of the image when the first region is identified; An electronic device comprising a.
The method of claim 1,
a second camera for detecting infrared rays having a longer wavelength than the short-wave infrared rays; further comprising,
The processor is
Obtaining information about the surface temperature of the road surface through the second camera,
Based on the information on the surface temperature, a second region having a surface temperature equal to or less than a preset critical temperature among the first regions is identified,
When the second area is identified, the electronic device determines that ice is present on the area of the road surface corresponding to the second area of the image.
3. The method of claim 2,
The threshold temperature is 0 degrees Celsius.
The method of claim 1,
The short-wave infrared is infrared having a wavelength of 1400 nm or more and less than 1800 nm,
The infrared ray having a longer wavelength than the short-wave infrared ray is an infrared ray having a wavelength of 3000 nm or more and less than 15000 nm.
5. The method of claim 4,
The short-wave infrared is infrared having a wavelength of 1400 nm or more and less than 1500 nm,
The infrared ray having a longer wavelength than the short-wave infrared ray is an infrared ray having a wavelength of 8000 nm or more and less than 15000 nm.
3. The method of claim 2,
output unit; further comprising,
The processor is
Obtaining information for driving a vehicle based on the information on the first area or the information on the second area,
An electronic device that provides information for driving of the vehicle through the output unit.
A method of controlling an electronic device comprising: an illumination emitting short-wave infrared light; and a first camera detecting the short-wave infrared light;
controlling the illumination to emit the shortwave infrared;
acquiring an image of the road surface by detecting the short-wave infrared light reflected by the road surface through the first camera;
identifying a first region in the acquired image indicating that the emitted short-wave infrared light has been absorbed by the road surface; and
determining that water or ice is present on an area of the road surface corresponding to the first area of the image when the first area is identified; A control method of an electronic device comprising a.
8. The method of claim 7,
The electronic device is
a second camera for detecting infrared rays having a longer wavelength than the short-wave infrared rays; further comprising,
The control method of the electronic device,
obtaining information on the surface temperature of the road surface through the second camera;
identifying a second region having a surface temperature equal to or less than a preset critical temperature among the first regions based on the information on the surface temperature; and
determining that ice is present on an area of the road surface corresponding to the second area of the image when the second area is identified; Control method of an electronic device further comprising a.
9. The method of claim 8,
The critical temperature is 0 degrees Celsius,
The short-wave infrared is infrared having a wavelength of 1400 nm or more and less than 1500 nm,
The infrared ray having a longer wavelength than the short-wave infrared ray is infrared ray having a wavelength of 8000 nm or more and less than 15000 nm.
A non-transitory computer-readable recording medium comprising a program for executing a control method of an electronic device,
The electronic device is
Illumination emitting short-wave infrared light and a first camera for detecting the short-wave infrared,
The control method of the electronic device,
controlling the illumination to emit the shortwave infrared;
acquiring an image of the road surface by detecting the short-wave infrared light reflected by the road surface through the first camera;
identifying a first region in the acquired image indicating that the emitted short-wave infrared light has been absorbed by the road surface; and
determining that water or ice is present on an area of the road surface corresponding to the first area of the image when the first area is identified; A computer-readable recording medium comprising a.

Images