KR102485492B1 - Electronic device for detecting black ice and controlling method thereof - Google Patents

Abstract

An electronic device and a control method of the electronic device are disclosed. Specifically, an electronic device according to the present disclosure is for detecting black ice on a road surface, and includes lighting emitting short-wave infrared rays, a first camera for detecting short-wave infrared rays, a memory, and lighting to emit short-wave infrared rays. and acquires an image of the road surface by detecting short-wave infrared light reflected by the road surface through a first camera, and identifying a first region indicating that the short-wave infrared light emitted from the acquired image is absorbed by the road surface. and a processor for determining that water or ice is present on a region of the road surface corresponding to the first region of the image, if the first region is identified.

Description

Electronic device for detecting black ice and control method of electronic device

The present disclosure relates to an electronic device and a control method of the electronic device, and more particularly, to an electronic device capable of detecting black ice and a control method of the electronic device.

Black ice has been pointed out as one of the main causes of road traffic accidents in winter from the past to the present. Black ice can form on the road surface when the temperature drops rapidly, and because the coefficient of friction is only 0.05, it increases the braking distance of the vehicle more than twice as long as that of a dry road surface, resulting in various types of traffic accidents. can lead to

In particular, due to the recent development of autonomous driving technology, the need for a technology capable of preventing traffic accidents caused by black ice by accurately detecting black ice on a road surface while driving a vehicle is being emphasized.

As a conventional technology for detecting black ice, a technology for predicting black ice present in a driving path of a vehicle using a temperature sensor and a GPS sensor, a technology for removing black ice using piezoelectric power generation, and a technology for removing black ice using reflected light and There are techniques for detecting black ice using a difference in brightness of transmitted light, but there is a continuing demand for a technique capable of more accurately detecting black ice than the prior art.

An object of the present disclosure is to provide an electronic device capable of accurately detecting black ice on a road surface using a shortwave infrared camera and a method for controlling the electronic device.

Another object of the present disclosure is to provide an electronic device and a control method of the electronic device capable of more accurately detecting black ice on a road surface by using a short-wave infrared camera and a long-wave infrared camera together.

According to an embodiment of the present disclosure for achieving the above object, an electronic device includes a light emitting short-wave infrared rays, a first camera sensing the short-wave infrared rays, a memory, and controlling the light to emit the short-wave infrared rays. and acquiring an image of the road surface by detecting the shortwave infrared rays reflected by the road surface through the first camera, and indicating that the radiated shortwave infrared rays are absorbed by the road surface in the obtained image. and a processor that identifies a first area and, if the first area is identified, determines that water or ice is present on an area of the road surface corresponding to the first area in the image.

Here, a second camera for detecting infrared rays having a longer wavelength than the short-wave infrared rays; The processor further includes, wherein the processor obtains information on the surface temperature of the road surface through the second camera, and based on the information on the surface temperature, the surface temperature of the first region is less than or equal to a preset threshold temperature. A second area may be identified, and if the second area is identified, it may be determined that ice exists on an area of the road surface corresponding to the second area of the image.

Here, the critical temperature may be 0 degrees Celsius.

Meanwhile, the short-wave infrared rays may be infrared rays having a wavelength of 1400 nm or more and less than 1800 nm, and the infrared rays having a longer wavelength than the short-wave infrared rays may be infrared rays having a wavelength of 3000 nm or more and less than 15000 nm.

Here, the short-wave infrared rays may be infrared rays having a wavelength of 1400 nm or more and less than 1500 nm, and the infrared rays having a longer wavelength than the short-wave infrared rays may be infrared rays having a wavelength of 8000 nm or more and less than 15000 nm.

Meanwhile, the electronic device further includes an output unit, and the processor obtains information for driving of the vehicle based on the information on the first area or the information on the second area, and the information about the vehicle through the output unit. Information for driving can be provided.

According to an embodiment of the present disclosure for achieving the above object, a control method of an electronic device including a light emitting short-wave infrared rays and a first camera detecting the short-wave infrared rays is configured to emit the short-wave infrared rays. Controlling illumination, acquiring an image of the road surface by detecting the short-wave infrared rays reflected by the road surface through the first camera, and detecting the short-wave infrared light reflected by the road surface through the first camera; identifying a first area indicating that it has been absorbed by the image; and if the first area is identified, determining that water or ice is present on an area of the road surface corresponding to the first area in the image. do.

Here, the electronic device further includes a second camera for detecting infrared rays having a longer wavelength than the short-wave infrared rays, and the control method of the electronic device includes obtaining information about the surface temperature of the road surface through the second camera. Step, based on the information about the surface temperature, identifying a second region of the first region having a surface temperature equal to or less than a preset threshold temperature, and if the second region is identified, corresponding to the second region of the image The method may further include determining that ice exists on the region of the road surface.

Here, the critical temperature is 0 degrees Celsius, the short-wave infrared rays may be infrared rays having a wavelength of 1400 nm or more and less than 1500 nm, and the infrared rays having a longer wavelength than the short-wave infrared rays may be infrared rays having a wavelength of 8000 nm or more and less than 15000 nm.

According to an embodiment of the present disclosure for achieving the above object, in a non-transitory computer-readable recording medium including a program for executing a control method of an electronic device, the electronic device is a light that emits short-wave infrared rays. and a first camera that detects the short-wave infrared rays, wherein the control method of the electronic device includes controlling the illumination to emit the short-wave infrared rays, the short-wave infrared rays reflected by a road surface through the first camera. acquiring an image of the road surface by detecting , identifying a first area indicating that the radiated shortwave infrared ray is absorbed by the road surface in the acquired image, and when the first area is identified, the and determining that water or ice is present on an area of the road surface corresponding to the first area of the image.

1 is a block diagram briefly showing the configuration of an electronic device according to an embodiment of the present disclosure;
2 is a graph showing the absorption rate of short-wave infrared rays by water or ice;
3 is a view showing an image of a road surface when water or ice exists on the road surface;
4 is a view showing an image of a road surface when water or ice does not exist on the road surface;
5 is a block diagram showing the configuration of an electronic device according to an embodiment of the present disclosure in detail;
6 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure, and
7 is a flowchart illustrating a control method of an electronic device according to another embodiment of the present disclosure.

Since the present embodiments can apply various transformations and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to the specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for like elements.

In describing the present disclosure, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

In addition, the following embodiments may be modified in many different forms, and the scope of the technical idea of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the spirit of the disclosure to those skilled in the art.

Terms used in this disclosure are only used to describe specific embodiments, and are not intended to limit the scope of rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present disclosure, expressions such as “has,” “can have,” “includes,” or “can include” indicate the presence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

In this disclosure, expressions such as “A or B,” “at least one of A and/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, “A or B,” “at least one of A and B,” or “at least one of A or B” (1) includes at least one A, (2) includes at least one B, Or (3) may refer to all cases including at least one A and at least one B.

Expressions such as "first," "second," "first," or "second," used in the present disclosure may modify various elements regardless of order and/or importance, and may refer to one element as It is used only to distinguish it from other components and does not limit the corresponding components.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or connected through another component (eg, a third component).

On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), the element and the above It may be understood that other components (eg, a third component) do not exist between the other components.

The expression “configured to (or configured to)” as used in this disclosure means, depending on the situation, for example, “suitable for,” “having the capacity to.” ," "designed to," "adapted to," "made to," or "capable of." The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware.

Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase "a processor configured (or configured) to perform A, B, and C" may include a dedicated processor (eg, embedded processor) to perform the operation, or by executing one or more software programs stored in a memory device. , may mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

In an embodiment, a 'module' or 'unit' performs at least one function or operation, and may be implemented with hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and implemented by at least one processor, except for 'modules' or 'units' that need to be implemented with specific hardware.

Meanwhile, various elements and regions in the drawings are schematically drawn. Therefore, the technical spirit of the present invention is not limited by the relative size or spacing drawn in the accompanying drawings.

Hereinafter, with reference to the accompanying drawings, an embodiment according to the present disclosure will be described in detail so that those skilled in the art can easily implement it.

1 is a block diagram briefly illustrating the configuration of an electronic device 100 according to an embodiment of the present disclosure, FIG. 2 is a graph showing absorption of short-wave infrared rays by water or ice, and FIG. 3 is water on a road surface. Alternatively, it is a diagram showing an image of a road surface when ice is present, and FIG. 4 is a diagram showing an image of a road surface when water or ice is not present on the road surface.

Hereinafter, an embodiment of the present disclosure will be described in detail with reference to FIGS. 1 to 4 .

First, the electronic device 100 according to the present disclosure acquires an image of a road surface through a camera included in the electronic device 100 and detects black ice on the road surface based on the acquired image. refers to a device capable of Black ice is a dark, thin sheet of ice formed on a road surface, and can occur when drizzle or drizzle falls on a road surface that is less than 0 degrees Celsius, or when the surface temperature of an already wet road drops below the freezing point.

In particular, the electronic device 100 may be mounted on a vehicle to acquire an image of a road surface while the vehicle drives, and detect black ice on the road surface in real time. As an example, the electronic device 100 according to the present disclosure may be implemented as a device such as a smart phone or a black box, but the type of the electronic device 100 according to the present disclosure is not particularly limited.

Referring to FIG. 1 , an electronic device 100 according to an embodiment of the present disclosure may include a light 110, a first camera 120, a memory 130, and a processor 140.

Illumination 110 may emit short-wave infrared light. Specifically, the lighting 110 may emit short-wave infrared rays toward the road surface under the control of the processor 140 . Here, short-wave infrared refers to infrared rays having a wavelength of 1400 nm or more and less than 3000 nm. In particular, the lighting 110 according to the present disclosure may be implemented to emit infrared rays having a wavelength of 1400 nm or more and less than 1500 nm.

In describing the present disclosure, it will be described on the premise that the lighting 110 and the first camera 120 are separated from each other, but this is only for clearly distinguishing and explaining the operation of each of the components according to the present disclosure, Of course, the lighting 110 may be implemented in a form combined with the first camera 120 according to the present disclosure. For example, when the lighting 110 is implemented in a form coupled with the first camera 120, the first camera 120 includes a light emitting unit including the lighting 110 and a light receiving unit including a lens and an image sensor. can include

The first camera 120 may detect short-wave infrared light. Specifically, when short-wave infrared rays are emitted by the lighting 110 , the first camera 120 may detect short-wave infrared rays reflected by the road surface. That is, the first camera 120 according to the present disclosure may be implemented as a so-called short wave infrared camera or a SWIR (Short Wavelength InfraRed) camera. Although the wavelength range of shortwave infrared rays that can be detected by the first camera 120 and the wavelength range of shortwave infrared rays emitted by the lighting 110 may be different, the wavelength range of shortwave infrared rays that can be detected by the first camera 120 It is preferred that the wavelength range includes the wavelength range of short wave infrared rays emitted by illumination 110 .

At least one instruction related to the electronic device 100 may be stored in the memory 130 . Also, an operating system (O/S) for driving the electronic device 100 may be stored in the memory 130 . Also, various software programs or applications for operating the electronic device 100 may be stored in the memory 130 according to various embodiments of the present disclosure. Also, the memory 130 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

Specifically, various software modules for operating the electronic device 100 may be stored in the memory 130 according to various embodiments of the present disclosure, and the processor 140 executes various software modules stored in the memory 130. Thus, the operation of the electronic device 100 may be controlled. That is, the memory 130 is accessed by the processor 140, and data can be read/written/modified/deleted/updated by the processor 140.

Meanwhile, in the present disclosure, the term memory 130 refers to the memory 130, a ROM (not shown) in the processor 140, a RAM (not shown), or a memory card (not shown) mounted in the electronic device 100 (eg For example, micro SD card, memory stick) may be used as a meaning including.

In particular, in various embodiments according to the present disclosure, the memory 130 includes information about the direction and wavelength range of the short-wave infrared ray emitted by the lighting 110 and information about the image acquired through the first camera 120. , information about the surface temperature of the road surface acquired through the second camera 150, information about the first area and second area identified according to the present disclosure, information for driving the vehicle, and the like may be stored. In addition, various information required within the scope of achieving the object of the present disclosure may be stored in the memory 130, and the information stored in the memory 130 may be updated as received from an external device or input by a user. .

The processor 140 controls overall operations of the electronic device 100 . Specifically, the processor 140 is connected to the configuration of the electronic device 100 including the lighting 110, the first camera 120 and the memory 130, and at least one of the components stored in the memory 130 as described above. By executing the instructions of, it is possible to control the overall operation of the electronic device 100 .

Processor 140 can be implemented in a variety of ways. For example, the processor 140 may include an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), a digital signal processor Processor, DSP) may be implemented as at least one. Meanwhile, in the present disclosure, the term processor 140 may be used to include a Central Processing Unit (CPU), a Graphic Processing Unit (GPU), and a Main Processing Unit (MPU).

In particular, in various embodiments according to the present disclosure, the processor 140 may control the lighting 110 to emit short-wave infrared rays. According to one embodiment, the processor 140 controls a driving unit (not shown) coupled to the lighting 110 to set an angle at which the lighting 110 emits short-wave infrared rays so that the short-wave infrared rays are radiated toward the road surface. can be adjusted

After the shortwave infrared rays are emitted, the processor 140 may obtain an image of the road surface by detecting the shortwave infrared rays reflected by the road surface through the first camera 120 . Specifically, when shortwave infrared rays reflected by the road surface are detected through the first camera 120, the processor 140 may obtain an image of the road surface by converting the detected shortwave infrared rays into electrical signals.

According to an embodiment, the processor 140 may obtain an image of the road surface through the first camera 120 while the electronic device 100 is mounted on the vehicle and the vehicle drives on the road. Hereinafter, in describing the present disclosure, the term 'image' may be used in the same meaning as 'image of a road surface'.

Meanwhile, the processor 140 may convert an image of the road surface into a top-view image, and may perform a process of identifying a first area and a second area from the converted top-view image as will be described later. Here, the process of converting the road surface image into a top-view image may be performed using an inverse perspective mapping (IPM) technique. In the image of the road surface, the lanes show a shape converging toward the vanishing point in the center of the image. This is due to the perspective effect proportional to the angle of view of the lens included in the first camera 120. Since the actual road exists on a 3D plane, it is desirable to remove the perspective effect for accurate lane detection. Accordingly, the processor 140 performs IPM for mapping a 3D plane to a 2D plane using conditions such as the position, coordination, and optics of the first camera 120, An image of a road surface can be converted into a top view image. In obtaining a top-view image according to the present disclosure, various techniques other than the IPM technique may be applied.

When an image of the road surface is acquired, the processor 140 may identify a first region indicating that shortwave infrared rays are absorbed by the road surface in the acquired image. If the first area is identified as a result of the identification, the processor 140 may determine that water or ice exists on the area of the road surface corresponding to the first area of the image. On the other hand, if the first area is not identified, the processor 140 may determine that there is no water or ice on the road surface. In the description of the present disclosure, for convenience of description, a case in which one area, the first area, is identified will be described, but as a result of the identification, a plurality of physically separated areas may be identified as a matter of course.

Specifically, referring to FIG. 2 showing the absorption coefficient according to the wavelength range, it can be confirmed that the absorption rate by water or ice of short-wave infrared rays having a wavelength of 1400 nm to 1500 nm is very high. Therefore, when water or ice exists on the road surface, short-wave infrared rays do not appear in an area corresponding to the area where water or ice exists in the image of the road surface.

For example, when short-wave infrared rays in the form of a line are irradiated to the central portion of the road surface, and no water or ice exists in the central portion of the road surface, the image of the road surface is formed by the road surface as shown in the example of FIG. 3 . An area 310 corresponding to the reflected short-wave infrared light may appear. On the other hand, when short-wave infrared rays in the form of a line are irradiated to the central portion of the road surface, and water or ice exists in the central portion of the road surface, the image of the road surface is displayed as in the example of FIG. 4 , unlike the example of FIG. 3 . Short wave infrared rays reflected by the surface include an invisible region 410 . In addition, in the case of FIG. 4 , it can be estimated that water or ice is present on an area 420 including an area 410 in which short-wave infrared rays reflected by the road surface are not visible.

According to the above-described embodiments, the electronic device 100 can identify an area where water or ice exists on the road surface based on the short-wave infrared rays reflected by the road surface after radiating short-wave infrared rays to the road surface. Accordingly, it is possible to detect an area where black ice is highly likely to exist. In particular, since there is almost no short-wave infrared light in natural light, black ice on the road surface is accurately detected without being affected by noise of an external light source when using the lighting 110 emitting short-wave infrared light and a short-wave infrared camera as in the present disclosure. You can do it.

delete

5 is a block diagram showing the configuration of the electronic device 100 according to an embodiment of the present disclosure in detail.

As shown in FIG. 5 , the electronic device 100 according to an embodiment of the present disclosure includes not only a lighting 110, a first camera 120, a memory 130 and a processor 140, but also a second camera ( 150), an input unit 160 and an output unit 170 may be further included. However, the configurations shown in FIG. 5 are merely exemplary, and in the implementation of the present disclosure, new configurations may be added or some configurations may be omitted in addition to the configurations shown in FIG. 5 , of course.

The second camera 150 may detect infrared rays having a longer wavelength than the first camera 120 . Specifically, the second camera 150 may detect infrared rays having a wavelength of 3000 nm or more and less than 15000 nm, and more specifically, may detect infrared rays having a wavelength of 8000 nm or more and less than 15000 nm. That is, the second camera 150 according to the present disclosure may be referred to as a thermal imaging camera capable of detecting Long Wavelength InfraRed (LWIR). However, infrared rays that can be detected by the second camera 150 according to the present disclosure are not limited to long-wave infrared rays, and may also detect mid-wavelength infrared (LWIR) in addition to long-wave infrared rays.

The processor 140 may obtain information about the surface temperature of the road surface through the second camera 150 . Specifically, the processor 140 detects long-wave infrared rays emitted from the object through the second camera 150, and uses the fact that the higher the temperature of the object emits infrared rays with shorter wavelengths, information can be obtained. As an example, information on the surface temperature of an object may be represented by a thermal image in which a color closer to red as the surface temperature increases and a color closer to purple as the surface temperature decreases.

When information on the surface temperature of the road surface is obtained, the processor 140 may identify a second area having a surface temperature of a predetermined threshold temperature or less among the first area, based on the information on the surface temperature of the road surface. Here, the critical temperature may be 0 degrees Celsius, and therefore, a region having a surface temperature less than or equal to the critical temperature may be estimated as a region in which ice exists. According to an embodiment, the critical temperature may be set to various temperatures, such as 2 degrees Celsius, in consideration of an error that may occur when measuring the surface temperature.

If the second area is identified as a result of the identification, the processor 140 may determine that ice exists on the area of the road surface corresponding to the second area of the image. On the other hand, if the second area is not identified, the processor 140 may determine that only water exists on the area of the road surface corresponding to the first area of the image, but no ice exists.

According to the above-described embodiments, the electronic device 100 can not only identify the area where water or ice exists on the road surface, as described above with reference to FIGS. 1 to 4 , but also the water or ice An area in which ice is present may be identified among the areas in which ice is present, and thus the accuracy of detecting black ice may be improved.

The input unit 160 includes a circuit, and the processor 140 may receive a user command for controlling the operation of the electronic device 100 through the input unit 160 . Specifically, the input unit 160 may include a microphone and a remote control signal receiving unit. In addition, the input unit 160 may further include cameras other than the first camera 120 and the second camera 150 according to the present disclosure. Also, the input unit 160 may be implemented as a touch screen included in a display.

In particular, in various embodiments according to the present disclosure, the input unit 160 may receive various types of user commands, such as a user command for obtaining an image of a road surface and a user command for requesting detection of black ice. .

The output unit 170 includes a circuit, and the processor 140 may output various functions that the electronic device 100 can perform through the output unit 170 . Also, the output unit 170 may include at least one of a display, a speaker, and an indicator.

The display may output image data under the control of the processor 140 . Specifically, the display may output an image pre-stored in the memory 130 under the control of the processor 140 . In particular, the display according to an embodiment of the present disclosure may display a user interface stored in the memory 130 . The speaker may output audio data under the control of the processor 140, and the indicator may be turned on under the control of the processor 140.

In particular, in various embodiments according to the present disclosure, the processor 140 may obtain information for autonomous driving of the vehicle based on information on the first area or information on the second area.

Here, 'information for driving of a vehicle' is a general term for information that can be helpful for driving on a road, and may include information for autonomous driving of a vehicle. As an example, information for vehicle driving may be generated by using not only information on the first area or information on the second area, but also information on a driving route of the vehicle and information on weather.

Meanwhile, in the foregoing, the process of obtaining an image of the road surface by the electronic device 100 according to the present disclosure and detecting black ice on the road surface based on the obtained image has been described above, but this is the main implementation according to the present disclosure. The example is only for clarification. That is, various embodiments of the present disclosure may be similarly applied to a process of detecting an area where water or ice is present on a surface of an object other than a road surface.

6 is a flowchart illustrating a method of controlling the electronic device 100 according to an embodiment of the present disclosure, and FIG. 7 is a flowchart illustrating a method of controlling the electronic device 100 according to another embodiment of the present disclosure.

Referring to FIG. 6 , the electronic device 100 may control lighting included in the electronic device 100 to emit short-wave infrared rays (S610).

After the shortwave infrared rays are emitted, the electronic device 100 may obtain an image of the road surface by detecting the shortwave infrared rays reflected by the road surface through the first camera (S620). Specifically, when short-wave infrared rays reflected by the road surface are detected through the first camera, the electronic device 100 may obtain an image of the road surface by converting the detected short-wave infrared rays into electrical signals.

When an image of the road surface is obtained, the electronic device 100 may identify a first area indicating that shortwave infrared rays are absorbed by the road surface in the acquired image (S630). As a result of the identification, if the first area is identified (S630-Y), the electronic device 100 may determine that water or ice is present on the area of the road surface corresponding to the first area of the image (S640). On the other hand, if the first area is not identified (S630-N), the electronic device 100 may determine that no water or ice exists on the road surface (S650).

Meanwhile, FIG. 7 shows a control that may be performed by the electronic device 100 when it is determined that water or ice is present on the area of the road surface corresponding to the first area of the image in the embodiment of FIG. 6 (S640). It is a drawing for explaining the method.

Referring to FIG. 7 , when it is determined that water or ice exists on the region of the road surface corresponding to the first region of the image (S640), the electronic device 100 measures the surface temperature of the road surface through the second camera. It is possible to obtain information about (S710).

When information on the surface temperature of the road surface is obtained, the electronic device 100 may identify a second area having a surface temperature of a predetermined threshold temperature or less among the first area based on the information on the surface temperature of the road surface. (S720).

As a result of the identification, if the second area is identified (S720-Y), the electronic device 100 may determine that ice exists on the area of the road surface corresponding to the second area of the image (S730). On the other hand, if the second area is not identified, the electronic device 100 may determine that only water exists on the area of the road surface corresponding to the first area of the image, but no ice exists (S740).

Meanwhile, the control method of the electronic device 100 according to the above-described embodiment may be implemented as a program and provided to the electronic device 100 . In particular, a program including a control method of the electronic device 100 may be stored and provided in a non-transitory computer readable medium.

Specifically, in a non-transitory computer-readable recording medium containing a program that executes a control method of the electronic device 100, the electronic device 100 includes lighting that emits short-wave infrared rays and a first camera that detects short-wave infrared rays. The control method of the electronic device 100 includes controlling lighting to emit short-wave infrared rays, acquiring an image of the road surface by detecting short-wave infrared rays reflected by the road surface through a first camera, Identifying a first area indicating that shortwave infrared rays emitted from the acquired image are absorbed by the road surface, and if the first area is identified, water or ice is present on the area of the road surface corresponding to the first area of the image. It may include the step of deciding to do.

In the above, the control method of the electronic device 100 and the computer readable recording medium including the program for executing the control method of the electronic device 100 have been briefly described, but this is only for omitting redundant description, and Various embodiments of the device 100 can also be applied to a computer readable recording medium including a control method of the electronic device 100 and a program executing the control method of the electronic device 100 .

The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary storage medium' only means that it is a tangible device and does not contain signals (e.g., electromagnetic waves), and this term refers to the case where data is stored semi-permanently in the storage medium and temporary It does not discriminate if it is saved as . For example, a 'non-temporary storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or between two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smartphones. In the case of online distribution, at least a part of a computer program product (eg, a downloadable app) is stored on a device-readable storage medium such as a memory of a manufacturer's server, an application store server, or a relay server. It can be temporarily stored or created temporarily.

Each of the components (eg, modules or programs) according to various embodiments of the present disclosure as described above may be composed of a single object or a plurality of entities, and some of the sub-components described above are omitted. or other sub-elements may be further included in various embodiments. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration.

According to various embodiments, operations performed by modules, programs, or other components may be executed sequentially, in parallel, repetitively, or heuristically, or at least some operations may be executed in a different order, may be omitted, or other operations may be added. can

On the other hand, the term "unit" or "module" used in the present disclosure includes units composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits, for example. can A “unit” or “module” may be an integrated component or a minimum unit or part thereof that performs one or more functions. For example, the module may be composed of an application-specific integrated circuit (ASIC).

Various embodiments of the present disclosure may be implemented as software including commands stored in a storage medium readable by a machine (eg, a computer). The device calls the stored commands from the storage medium. And, as a device capable of operating according to the called command, it may include an electronic device (eg, the electronic device 100) according to the disclosed embodiments.

When the command is executed by the processor 140, the processor 140 may directly or use other components under the control of the processor 140 to perform a function corresponding to the command. An instruction may include code generated or executed by a compiler or interpreter.

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the art to which the disclosure belongs without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

100: electronic device 110: lighting
120: first camera 130: memory
140: processor 150: second camera
160: input unit 170: output unit

Claims (10)

In electronic devices,
Illumination that emits short-wave infrared rays and infrared rays of a longer wavelength than the short-wave infrared rays;
a first camera that senses the short-wave infrared light;
a second camera for detecting the long-wavelength infrared rays;
Memory; and
Control the illumination to emit the short-wavelength infrared rays and the long-wavelength infrared rays;
Obtaining an image of the road surface by detecting the short-wave infrared reflected by the road surface through the first camera;
Identifying a first region indicating that the radiated shortwave infrared rays are absorbed by the road surface in the acquired image;
When the first area is identified, information on the surface temperature of the road surface is obtained through the second camera;
Based on the information on the surface temperature, identifying a second region having a surface temperature less than or equal to a preset threshold temperature among the first region;
If the second area is identified, ice exists on the area of the road surface corresponding to the second area of the image. If the second area is not identified, ice exists on the area of the road surface corresponding to the first area of the image. a processor that determines that water is present on the area;
An electronic device comprising a.
delete According to claim 1,
The electronic device wherein the critical temperature is 0 degrees Celsius.
According to claim 1,
The short-wave infrared rays are infrared rays having a wavelength of 1400 nm or more and less than 1800 nm,
The infrared rays having a longer wavelength than the short-wave infrared rays are infrared rays having a wavelength of 3000 nm or more and less than 15000 nm.
According to claim 4,
The short-wave infrared rays are infrared rays having a wavelength of 1400 nm or more and less than 1500 nm,
The infrared rays having a longer wavelength than the short-wave infrared rays are infrared rays having a wavelength of 8000 nm or more and less than 15000 nm.
According to claim 1,
output unit; Including more,
the processor,
Obtaining information for vehicle driving based on the information on the first area or the information on the second area;
An electronic device that provides information for driving of the vehicle through the output unit.
A method for controlling an electronic device including a light emitting short-wave infrared rays and infrared rays having a longer wavelength than the short-wave infrared rays, a first camera detecting the short-wave infrared rays, and a second camera detecting the long-wavelength infrared rays,
controlling the illumination to emit the short-wavelength infrared rays and the long-wavelength infrared rays;
obtaining an image of the road surface by detecting the short-wave infrared rays reflected by the road surface through the first camera;
identifying a first region indicating that the radiated shortwave infrared rays are absorbed by the road surface in the acquired image;
acquiring information about the surface temperature of the road surface through the second camera when the first area is identified;
identifying a second region having a surface temperature equal to or less than a predetermined threshold temperature among the first regions based on the surface temperature information; and
If the second area is identified, ice exists on the area of the road surface corresponding to the second area of the image. If the second area is not identified, ice exists on the area of the road surface corresponding to the first area of the image. determining that water is present on the region;
Control method of an electronic device comprising a.
delete According to claim 7,
The critical temperature is 0 degrees Celsius,
The short-wave infrared rays are infrared rays having a wavelength of 1400 nm or more and less than 1500 nm,
The infrared having a longer wavelength than the short-wave infrared is infrared having a wavelength of 8000 nm or more and less than 15000 nm.
A computer-readable recording medium recording a program for executing the method of claim 7 on a computer.

Images