KR102330949B1 - Smart LED display board and image output method using the same - Google Patents

Abstract

According to an embodiment of the present invention, a smart LED display board comprises: a control monitoring unit receiving a display image to be displayed on the display board consisting of a plurality of LED modules from a database where the display image is stored, designating the received display image in a region of the LED modules to output the display image, receiving an external environment monitoring image acquired from an image sensor, and controlling a color tone including brightness of the display board according to an external environment factor corresponding to a weather condition or surrounding place background included in the external environment monitoring image to output the display image; and a display unit which activates the LED modules with the region designated to output the display image and in which the display image, which is adjusted to the color tone including brightness set according to the external environment factor, is output.

Description

Smart LED display board and image output method using the same {Smart LED display board and image output method using the same}

The present invention relates to a smart LED electric sign board and an image output method using the same, and more particularly, to an electric sign board and an image output method using the same.

Although an LED device is a low-power device, it is composed of a considerable amount of LED modules to express images or images.

For example, in the case of a double-sided billboard consisting of 32 horizontal modules and 18 vertical modules, the number of modules is 1,152 and the total power consumption per module is 50W, which is 57.6Kwh.

That is, in order to drive the electric signboard of the above example, it is necessary to separately receive power from KEPCO in three phases and install a meter, and since a lot of power consumption occurs, efforts to reduce power consumption are required.

On the other hand, in order to reduce power consumption, conventionally, a light sensor (CDS) was attached to the upper part of the outdoor electric sign board and the overall brightness of the electric sign board was adjusted according to the amount of light, but it has a problem that the light sensor is vulnerable to durability or dust.

Specifically, the method of setting and adjusting the brightness for each time zone based on the day in software is widely used in the electronic display control unit, but there is a problem that it is a uniform brightness adjustment method without considering summer/winter/weather.

In addition, in the case of a specific text phrase on the video image displayed on the electric signboard, for example, in the case of a promotional text, partially color the white (white) background to make the text stand out, and there are many cases where the promotional text to be delivered is written. In this case, there is a problem in that power consumption is rapidly increased because there are too many unnecessary whites.

In addition, the electronic sign board is equipped with a plurality of LED modules to display images or text phrases. If some modules are defective, only a part of the text or image is displayed, so it is difficult to check the displayed image properly until maintenance is performed. there was.

Therefore, in order to solve the above problem, it is possible to optimize and finely adjust the color tone, including the brightness of the image, according to external environmental factors such as weather conditions and surrounding places, and check the bad module sector and place the text in the area except for the bad module. There is a need for research on an electric signboard capable of displaying lights and an image output method using the same.

Korean Patent Registration No. 10-1510802 (Registered on Apr. 3, 2015)

An object of the present invention is to provide a smart LED signboard capable of reducing power consumption by performing color tone control including the brightness of the electric sign LED in consideration of external environmental factors according to the weather environment state and the background of surrounding places, and an image output method using the same. will be.

Another object of the present invention is to have an image sensor for monitoring the electric signboard and the surrounding environment, and check a defective module of the electric signboard with the image sensor to control the display image to be displayed in the area except for the defective module area. And An object of the present invention is to provide an image output method using the same.

Smart LED billboard according to an embodiment of the present invention is provided from a database in which a display image to be displayed on an electric signboard composed of a plurality of LED modules is stored, and the received display image is designated and outputted in the area of the LED module, but from the image sensor a control monitoring unit receiving the acquired external environment monitoring image and controlling the color tone including the brightness of the electric signboard according to the weather conditions included in the external environment monitoring image or external environmental factors corresponding to the background of the surrounding place to control the display image to be output; and a display unit for outputting the display image by activating a region-designated LED module, and adjusting the color tone including the brightness set according to the external environmental factor to output the display image.

In the above, the control monitoring unit is characterized in that the output control of the display image by applying a color change value that can increase visibility according to the weather conditions recognized from the external environment monitoring image differently.

In the above, the control and monitoring unit is characterized in that the output control of the display image by applying a color change value that can increase visibility according to the location by determining the surrounding location recognized from the external environment monitoring image differently.

In the above, the control monitoring unit is provided with the external environment monitoring image obtained from the image sensor, the control unit for adjusting the color tone set according to the external environmental factors to output control the display image; and the image sensor which acquires an external environment monitoring image and an electronic signboard monitoring image for checking a defective module from the surroundings and provides it to the control unit.

In the above, the controller performs HSV region conversion from RGB pixels in the external environment monitoring image, distinguishes whether the corresponding image is a dark image or a bright image according to a dark reference value set based on the converted V value, and a dark image By creating a tone curve to be applied to the image and a tone curve to be applied to a bright image, and performing optimal tone mapping in the display image according to the darkness of the external environment monitoring image using the generated tone curve mixture, It is characterized in that the color tone is adjusted to output a display image.

In the above, the control unit receives the electronic sign monitoring image obtained from the image sensor, checks a defective module among the LED modules, and controls to output a display image in an area excluding the defective module, and the display unit displays the display image An LED block in which a plurality of LEDs are provided in a matrix form, an LED Dot Matrix block having a plurality of modules; Receives a bad module control signal corresponding to the bad module determination result of determining whether it is a bad module from the control unit, transmits power and display image signals normally in case of a normal module according to the bad module control signal, and in case of a bad module a bad module control unit controlling to block the power of the corresponding module block and the display image signal; a section board that receives the display image signal and performs a function of displaying an image in a designated area (LED Dot Matrix) of the LED Dot Matrix block; It further includes an SMPS for electronically supplying power to the bad module control unit.

The defective module control unit identifies a defective module area according to the defective module control signal, and then designates a module area to be rearranged when outputting an image according to a video, an image, and a text phrase of the displayed image, but determines whether the text mode of the displayed image can be changed. In the case of a display video containing text phrases in the form of overlay subtitles, if the background video or image is unnecessary or impossible to relocate, delete the background video or image and display the text phrase on a black background, but display the text in the relocated module area. In the case of a promotional video or image that cannot be changed in text mode, it is checked whether it can be displayed in an area excluding the defective module area, and the corresponding image is output to the corresponding module area or not output if impossible.

In an image output method using a smart LED signboard having a plurality of LED modules according to an embodiment of the present invention, the signboard is set for each time zone or place by an internal control unit, and a display image to be output is provided from a database and loaded step; checking, by the control unit, whether a defective area among the LED module areas of the electric sign board; calculating, by the controller, a color tone change value of a display image in consideration of weather conditions or external environmental factors corresponding to a background of a surrounding place; When the control unit determines that there is no abnormality in the LED module block, transmitting the corresponding display image to the display unit; The display unit includes outputting a display image whose color tone is adjusted according to the calculated color change value.

In the above, the control unit acquires an external environment monitoring image periodically photographed for the external environment from an image sensor in order to consider external environmental factors; The control unit determines a weather condition or a state of a surrounding place in the external environment monitoring image determining a corresponding wake-up state or a state of a surrounding place by calculating an RGB pixel change value of an acquired video image to determine whether the image is detected and comparing it with a set reference value; When the weather condition is determined as a specific weather condition or the surrounding place is determined as a specific location according to the determination result, the controller calculates a color change value suitable for the corresponding weather condition or the surrounding place and applies it to the display image; The method further includes outputting a display image by performing color tone adjustment including optimal brightness according to the color change value.

In the above, acquiring an electric sign monitoring image of the front of the electric sign using an image sensor, the control unit checking whether there is a defective module area of the electric sign using the electric sign monitoring image; designating, by the controller, an area of an electric sign module to be rearranged when outputting an image according to a moving picture, an image, or a text phrase of the displayed image after identifying the defective module area; checking, by the controller, whether the text mode of the displayed image can be changed, and checking whether an image that cannot be changed in text mode can be displayed in a module area excluding the defective module area; When the control unit determines that it is a display image including text phrases, if the background video or image is unnecessary or cannot be rearranged, the control unit deletes the background video or image and displays the text phrase on a black background, but in the relocated module area controlling to display; The controller further includes the step of adjusting the font size of the text phrase to be output if necessary when the text phrase is displayed by rearranging it in the module area to be displayed.

In the above, when determining that the display image includes text phrases, the control unit deletes the background video or image when the background video or image is unnecessary or cannot be rearranged in the case of the display image including the text phrase in the form of an overlay subtitle, The method further includes displaying a text phrase corresponding to the subtitle data on a black background, but controlling to display it in the rearranged module area.

The present invention provides a color tone including optimized brightness suitable for the surrounding environment by determining the weather conditions of the surrounding external environmental factors and adjusting and outputting the color tone including the brightness reflecting the color tone change value of the displayed image according to the weather condition. Thus, it has the effect of preventing glare and glare.

When an optimized color tone is provided, the sharpness is improved by including a color change, and as a result, visibility is improved and visual transmission power is increased.

In addition, in order to perform optimal tone mapping, a neural network learning algorithm is used to reflect the tone mapping result to the learning model, to determine whether the color tone according to tone mapping meets the set reference value, and to reset the reference value through repeated learning to reset the external environment It has the advantage of being optimized by patterning and classifying for each weather condition so that the color tone can be precisely adjusted according to factors.

In addition, the bad module can be monitored and utilized for maintenance, and the display image is displayed by controlling it to be rearranged in an area excluding the bad module before maintenance, thereby coping with an emergency situation.

1 is a block diagram showing the configuration of an electric sign board according to an embodiment of the present invention.
2 is a block diagram showing a detailed configuration of an electric sign display unit according to an embodiment of the present invention.
3 is a flowchart illustrating a process of outputting a display image whose color tone is adjusted according to an external environment of the method for outputting an image on an electric signboard according to an embodiment of the present invention.
4 is a flowchart illustrating a process of calculating a color change value according to an external environment in a method for outputting an image on an electric signboard according to an embodiment of the present invention.
5 is a flowchart illustrating a process of checking a defective area on an electric signboard in the method for outputting an image on the electric signboard according to an embodiment of the present invention.
6 is a view showing a front and side installation state of an electric sign board according to an embodiment of the present invention.
7 is a diagram illustrating an example of a learning area of an external environment monitoring image to determine a current weather state when a color tone change value according to an external environment is calculated.
8 is a diagram exemplarily illustrating a process for applying tone mapping of a display image.
FIG. 9 is a diagram for explaining a dark frame detection process for distinguishing a dark image from a bright image in FIG. 8 .
FIG. 10 is a diagram for explaining a process of generating an appropriate brightness value alpha by combining tone curves of a dark image and a bright image in FIG. 8 .
11 is a view for explaining an example of text display when a defective area of an electric sign is detected.
12 is a view for explaining a module block for identifying a location of a defective area of an electric sign board.
13 to 16 are diagrams illustrating examples of symptoms of a defective module by type.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the spirit of the present invention is not limited to the embodiments presented, and those skilled in the art who understand the spirit of the present invention may add, change, delete, etc. other components within the scope of the same spirit, through addition, change, deletion, etc. Other embodiments included within the scope of the invention may be easily proposed, but this will also be included within the scope of the invention. In addition, components having the same function within the scope of the same idea shown in the drawings of each embodiment will be described using the same reference numerals.

1 is a block diagram showing the configuration of an electric sign board according to an embodiment of the present invention.

As shown in FIG. 1 , the smart LED billboard 1 of the present invention may include a control monitoring unit 100 , a display unit controller 200 , a display unit 300 , and a database 500 .

The control monitoring unit 100 receives a display image to be displayed on the electronic sign board 1 having a plurality of LED modules from a database, controls the display image output, and in particular, according to external environmental factors such as weather conditions and background of surrounding places. By controlling the color tone including the brightness of the electric sign 1, the area of the LED module is designated for the display image and output is controlled.

In addition, the control monitoring unit 100 can monitor the electronic sign board 1 to check a defective module, and monitor and control the display image to be output for an area other than the defective module area. As described above, it further includes a control unit 110 and an image sensor 120 .

The control unit 110 receives the external environment monitoring image from the image sensor 120 and adjusts the color tone including the brightness set according to external environmental factors such as weather conditions and background of surrounding places to output and control the displayed image, and furthermore, the image sensor Controls to output a display image to an area excluding the defective module by checking a defective module among the LED modules by receiving the electronic signboard monitoring image obtained from 120 .

In addition, the image sensor 120 obtains an external environment monitoring image and an electric sign monitoring image for checking a defective module from the surroundings and provides it to the control unit 110 .

The image sensor 120 is an image capturing means, for example, provided in the form of a single camera, and may be a 360-degree rotating camera capable of taking pictures in all directions to check both the electric sign 1 and the external environment. Referring to FIG. 6 , the electric sign board It is installed in the front where the display unit 300 of (1) is located, so that an image of the electric sign 1 and the external environment can be acquired.

The display unit controller 200 may perform a role of receiving the display image to be output controlled from the control unit 110 and controlling the area of the LED module to be displayed on the display unit 300 to be specified and output, such a separate display unit controller ( The configuration and function of 200 may be included in the control and monitoring unit 100 or the control unit 110 if necessary according to design, or may be included in the display unit 300 to be described later.

The display unit 300 activates the region-designated LED module from the display unit controller 200 to output a display image, and at this time, the display image may be output by adjusting the color tone including the brightness set by the controller 110 . In this case, the hue change value including the adjusted brightness may include a hue change value using the HSV value from the RGB pixels, and a tone curve (tone change value) calculation algorithm for adjusting the HSV will be described later in detail.

Referring to FIGS. 6 and 11 , the front surface of the display unit 300 includes a partition plate 400 having a predetermined partition for checking a defective module area of the electric sign 1 .

That is, the control unit 110 may determine in which area the defective module is located by referring to the division at a predetermined interval divided according to the number of modules in the electronic sign monitoring image obtained from the image sensor 120 .

For example, referring to FIG. 11 , the electric sign 1 is divided into X-axis (column) and Y-axis (short) by installing a grid-shaped partition plate 400 to determine the position of each module, and each column and The stage includes a predetermined number of modules, and each module further includes a plurality of pixels representing pixels. Using the partitioned module as described above, it is possible to know which column and which column the defective module belongs. In FIG. 11 , the defective module blocks from the 8th column and 12th column module to the 8th column and 15th column module are shown.

In the database 500 , a display image to be output controlled by the controller 110 may be stored, and in particular, a reference value for providing a color tone of an output image according to an optimal tone mapping result and accumulated data for a learning execution result may be stored. In addition, the display image may be separately set for each time zone and place, and may be stored together with setting information so that the display image is output differently according to each time zone or place.

The database 500 may find a corresponding display image in response to a request from the controller 110 for the stored display image and provide it to the controller 110, and index information for this may be included in the display image and stored.

In addition, the database 500 may store and manage external environment monitoring images obtained from the image sensor 120 , various statistical information, events, log data, and the like.

In addition, the database 500 may be installed and managed in the field, but may be managed to be stored online in a remote location that can communicate through a network depending on the design environment.

In addition, although not shown in the signboard 1, a power supply unit to supply power to a plurality of LED modules, a power controller, a sub-controller, an A/V mixer for combining images when there are multiple display images, a fan for heat dissipation, etc. are more may be included.

2 is a block diagram showing a detailed configuration of the display unit of the electric sign 1 according to an embodiment of the present invention.

As shown in FIG. 2 , the display unit includes at least one LED Dot Matrix block 310 , a bad module control unit 320 , a section board 330 , and an SMPS 340 , and the display unit controller shown in FIG. 1 . (200) may be configured therein.

The LED Dot Matrix block 310 is an LED block in which a plurality of LEDs on which a display image is displayed are provided in a matrix form, and a plurality of modules may be provided in the form of RGB or the like to implement various colors.

The bad module control unit 320 receives a bad module control signal corresponding to the result of determining whether the module is a bad module from the controller 110, and in case of a normal module according to the bad module control signal, power and a display image signal. It transmits normally, and in case of a defective module, it controls to cut off the power and display video signal of the corresponding module block.

In addition, the defective module control unit 320 may control driving power and display image signals of a plurality of LED Dot Matrix (LDM) blocks connected to the individual section boards 330 .

The section board 330 receives a display image signal from the display controller 200 and performs a function of displaying an image in an area (LED Dot Matrix) designated by the controller 110 , and the section board 330 is an electric sign 1 ) may be added or decreased according to the total pixel size.

SMPS (340) is a switched-mode power supply (Switched-Mode Power Supply), includes a switching regulator to efficiently supply power, it can electronically supply power to the defective module control unit 320, the form of which is DC power can be in the form

3 is a flowchart illustrating a process of outputting a display image whose color tone is adjusted according to an external environment in the method for outputting an image on an electric signboard according to an embodiment of the present invention.

First, the display image to be output and displayed on the electric sign board 1 is stored in advance in the database 500 at the site or stored and managed in the server database 500 located in a remote place where communication is possible through a network. Basically, the displayed image is the electric sign 1 ) can be a custom-made image to be displayed within the size.

In addition, the display image here may be a moving image, at least one image, or a text image to be output and displayed at various places for the purpose of advertising promotion, guidance, instruction, or the like, or an image in which at least one or more of these images are combined.

In addition, the display image may be a display image based on public data (real-time disaster text, weather, environmental data, etc.) provided in connection with a public institution server.

At this time, in order to receive public data in real time even in case of emergency (rescue, disaster, etc.) can

That is, the electric sign 1 receives the display image set by the administrator for each time and place in the control unit 110 from the database 500 and loads it, and details such as the brightness of the display image according to the color tone including the set brightness. It is possible to control the output by adjusting the output environment value (S100).

In addition, before the output of the display image to be output at this time, it is checked whether all the module blocks of the electric sign board 1 are normal (S102).

In this case, whether the module block is defective may be determined using the electronic signboard monitoring image captured by the image sensor 120 .

In addition, the color tone change value of the display image is calculated in consideration of external environmental factors (weather conditions and background of surrounding places) identified from the external environment monitoring image (S104).

The control unit 110 may transmit a command to the display unit 300 to output a corresponding display image when the module block is not abnormal as a result of checking through the electronic signage monitoring image and the color tone change value is calculated in step S104 (S106).

The display unit 300 outputs a display image whose color tone including brightness is adjusted according to the calculated color tone change value (S108).

Through this, the effect of reducing the power consumption by lowering the output of the display image can be expected.

4 is a flowchart illustrating a process of calculating a color change value according to an external environment in a method for outputting an image on an electric signboard according to an embodiment of the present invention.

The control unit 110 acquires an external environment monitoring image periodically taken with respect to the external environment (weather state and surrounding place background) from the image sensor 120 in order to consider external environmental factors (S200).

In this case, it is preferable that the controller 110 determines the weather condition of the external environment based on the most recent external environment monitoring image when the database 500 of the display image is loaded.

Here, the weather state of the external environment may be, for example, daytime, nighttime, cloudy, rain, snow, sunrise, sunset, or the like.

The control unit 110 may calculate an RGB pixel change value of an acquired video image to determine a wake-up state or a state of a surrounding place in the external environment monitoring image and compare it with a set reference value to determine it (S202).

At this time, in the acquired image for objective and consistent comparison and determination, a specific area corresponding to the area of interest is detected by an object recognition algorithm such as CNN or RNN, and pixel change values are calculated only for the specific area and used for comparison determination. have.

For example, a specific area to be used for comparison and discrimination is an area that has a constant change depending on weather conditions and is not sensitive to changes in ambient tone or brightness. It may be a white background part (apartment, part B of FIG. 7 ) in which it is easy to check a change in a hue value.

In addition, when determining what kind of weather conditions are according to external environmental factors, it is possible to determine what kind of environmental conditions are by analyzing each frame and time unit of the image.

For example, when fog is classified by weather conditions, the change in fog can be detected by averaging the change in fog intensity per row of the image frame based on the center line of the image.

In addition, in order to distinguish between night and rain, a histogram distribution map obtained by analyzing an image in an image can be used. The image histogram enables analysis of image characteristics such as contrast, brightness, and color distribution of the image.

In addition, for a specific example, in high humidity weather conditions (rain, snow, fog, cloudy, etc.), the color change value is applied to improve visibility by lowering the illuminance or luminance, and in the case of strong sunlight, the module Since it is often difficult to check the text phrase printed on have.

As another example, if the corresponding place is an urban area by the identification of surrounding places recognized in the external environment monitoring image (for example, when a large number of buildings are recognized, it is determined as downtown), the color change value can be applied to have a gray color as a whole in the display image. Also, if necessary, to increase visibility and reduce power consumption, the power can be cut off in units of LDM blocks and applied to have a black background. In addition, when the corresponding place is a mountainous area (distinguished as a mountainous area when a plurality of mountain objects are recognized), a color change value may be applied to have a color contrasting with green to increase visibility.

In addition, the above-described hue change values are basically applied to text phrases displayed on the module, and the text phrase and the background color of the text phrase may be displayed differently. For example, the background color may be preferentially changed to a color with high visibility, and a color contrasting with the background color may be applied for text phrases. to be able to increase

When the weather condition corresponding to the weather condition is determined, the controller 110 calculates a color change value suitable for the weather condition and applies it to the display image.

For example, a night state corresponding to a dark weather condition and a day state corresponding to a bright weather condition are distinguished, and a color tone change value (tone curve) corresponding to the corresponding state is calculated ( S204 ).

8 and 9 , as a pre-step for calculating the tone curve, HSV (Hue, Saturation, Value) region conversion is performed from RGB pixels in the external environment monitoring image, and the converted V (Value, brightness) value is performed. Dark frame detection is performed to distinguish whether the corresponding image is a dark image or a bright image using That is, when detecting a dark frame, a dark reference value, which is a standard of whether it is dark or bright, is set based on the V value, and discrimination can be made using the dark reference value.

_dark)와 밝은 영상에 적용할 전달 함수(transfer function) 형태의 톤 커브(

_bright)를 생성하되, 색조 또는 계조(gradation) 변화에 영향을 주는 적어도 하나의 파라미터(parameter)를 적용하여 생성한다.Also, referring to FIG. 10, the tone curve (

_dark ) and a tone curve in the form of a transfer function to be applied to bright images (

_bright ), but by applying at least one parameter influencing a change in hue or gradation.

In addition, by performing optimal tone mapping in the display image according to the darkness of the external environment monitoring image in the display image using the mixing of the generated tone curve, the optimal brightness (Alpha value) is adjusted and the display image to be able to output (S206).

Furthermore, in order to perform optimal tone mapping, the neural network learning algorithm is used to reflect the tone mapping result in the learning model, to determine whether the color tone including brightness according to tone mapping meets the set reference value, and to reset the reference value through repeated learning. It can be optimized by patterning, classifying, and categorizing for each weather condition so that color tones including brightness can be precisely adjusted according to external environmental factors.

Such a learning algorithm may include at least any one or more of learning algorithms such as CNN, RNN, and SVM. In particular, SVM is one of the supervised learning machine learning methods mainly used for classification, regression, and outliers detection. For example, two groups of datasets are distinguished. Among the various methods to do this, it can be said that the best way to increase the classification accuracy is to be able to accurately distinguish the midpoint at the maximum distance of each group.

In addition, by applying the color tone including the optimal brightness according to the weather conditions of the external environmental factors as a result by adjusting the color tone including the brightness described above, a dark image is displayed in a dark environment, and the brightness is increased in a bright environment to tone mapping Visibility can be improved by improving sharpness by improving the contrast by

In addition, when performing tone mapping with a tone curve applied, it can be applied to be less sensitive to image conversion through a certain time or a certain frame delay in order to respond to changes in the image frame. It is also possible to additionally apply Boundary Masking, which adjusts the contrast by adding a gray level to the boundary.

5 is a flowchart illustrating a process of checking a defective area on an electric signboard in the method for outputting an image on the electric signboard according to an embodiment of the present invention.

The image sensor 120 is used to obtain an electric sign monitoring image of the front of the electric sign 1, and the control unit 110 can check whether there is a defective module area of the electric sign 1 using the electric sign monitoring image (S300). ).

Specifically, for example, when a defective module is checked, an infrared camera is used to acquire an electronic sign monitoring image, or an infrared sensor is used to obtain a temperature change value of the module, and among a plurality of LED modules, a defective pixel is detected by using the difference in the image temperature. By detecting, it can be done.

After confirming the defective module area, the defective module control unit 320 may designate a module area to be rearranged when outputting an image according to a moving picture, an image, and a text phrase of the displayed image ( S302 ).

The defective module control unit 320 checks whether the text mode of the displayed image can be changed, and in the case of a promotional video or image in which the text mode cannot be changed, it checks whether it can be displayed in an area other than the defective module area, and outputs it to the corresponding module area or if it is not possible It may not be output (S304).

In addition, in the case of a display image containing text phrases in the form of subtitles, as shown in FIG. 11, if the background video or image is unnecessary or cannot be rearranged, the background video or image is deleted and the text phrase is displayed on a black background, but It can be controlled to display in the rearranged module area (S306, S308, S310).

That is, the display image including the text phrase may be a display image in which the subtitle data is overlaid on a part of the screen, and since it is data separate from the image, it is loaded separately and controlled so that the text phrase corresponding to the subtitle data is displayed it can be done

Also, when the text phrase is displayed by rearranging it in the module area to be displayed, the font size of the text phrase to be output can be adjusted if necessary, such as when the corresponding area is small (S308).

Furthermore, the defective module control unit 320 accurately checks the ratio of the area to be displayed so that the text phrases are rearranged in the moving picture. Referring to FIGS. 6 and 12 , the defective module area is based on the coordinate values divided by the section board 330 . , determine the outputable coordinate area using the corresponding coordinate value, and numerically readjust the proportion or font size of the display image to be rearranged.

In particular, even if the corresponding defective module area corresponds to only a part of a specific text, since only a partial area cannot be displayed, it is preferable to move or readjust the text text including the surrounding area on a line-by-line basis. 12 as an example, even if it is determined as a defective module area for some areas of the phrase 'required', it is preferable to move the entire phrase 'required' line by line, and if it is an expression that does not require the phrase, You can also control to delete text and display only the remaining text. It is preferable that the method of changing the text display according to the specific defective module area is set in advance for each display image so that it can be controlled according to the situation by an algorithm.

In addition, the control unit 110 may generate log data for the determination result of the above-described defective module area, and the log data is transmitted to an administrator terminal or a server (not shown) to be utilized as monitoring data for maintenance and operation. can

13 to 16 show examples of symptoms of a defective module for each type.

Failure of the LED Dot Matrix block 310 may be caused by various causes, such as damage or deterioration due to overheating of parts such as LED elements and driver ICs, abnormal operation due to poor contact due to manufacturing or other reasons, For example, damage to major components due to rain or condensation.

In addition, failure symptoms may be the examples shown in FIGS. 13 to 16, and damage to the LED element: abnormal operation of a specific pixel out of control, damage to driver IC: pixel corresponding to a specific bit or all bits of the LED driver IC Abnormal operation, mainly a specific color for each specific block, abnormal data in the column after the module, damage to major ICs such as FET: abnormal operation in line units, or ghosting (color bleeding).

In the present invention, in case of such a failure symptom, a phrase avoidance (change) algorithm for each failure step can be designed and applied according to the failure type. Specifically, for example, the following phrase avoidance (change) algorithm is applied based on 16 * 16 pixels can

1. When a certain number of pixels (10 pixels or less) blink abnormally: Do not avoid (change).

2. Avoid the relevant area in case of continuous block defects of more than 4 pixels even if it is a small pixel defect

3. When multiple (10 pixels or more) pixel error occurs -> If only the relevant module is affected, only the relevant module is avoided (changed) -> If there is an effect on subsequent columns, it is separated by line and avoided (changed)

In the present invention, a network refers to a connection structure in which information can be exchanged between each node such as a terminal (eg, an electronic signboard as a communication device) or a server, and a local area network (LAN), a wide area network (WAN : Wide Area Network), Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, wired and wireless television communication network, etc.

Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, ultrasound Communication, Visible Light Communication (VLC), LiFi, etc. are included, but are not limited thereto.

1: electric sign
100: control monitoring unit
110: control unit
120: image sensor
200: display controller
300: display
310 : LED Dot Matrix Block
320: bad module control unit
330: section board
340: SMPS
400: partition plate
500 : database

Claims (11)

A display image to be displayed on an electric sign board composed of a plurality of LED modules is provided from a stored database, and the received display image is designated and outputted in the area of the LED module, but an external environment monitoring image obtained from an image sensor is provided and an external environment monitoring image a control monitoring unit for controlling the display image to be output by controlling the color tone including the brightness of the electric sign according to the external environmental factors corresponding to the weather conditions or the background of the surrounding places;
and a display unit for outputting the display image by activating the region-designated LED module, and outputting the display image by adjusting the color tone including the brightness set according to the external environmental factors,
The control monitoring unit
Output-controlling the display image by applying a color change value differently so as to increase visibility depending on the place by determining the surrounding place recognized from the external environment monitoring image,
The control monitoring unit
a control unit receiving the external environment monitoring image obtained from the image sensor, adjusting the color tone set according to the external environment factor, and outputting a display image;
Further comprising the image sensor to obtain the external environment monitoring image and the electronic sign monitoring image for checking the defective module from the surroundings and provide it to the control unit,
The control unit is
HSV region conversion is performed from RGB pixels in the external environment monitoring image, and the image is classified as a dark image or a bright image according to the dark reference value set based on the converted V value,
Optimum brightness by creating a tone curve to be applied to a dark image and a tone curve to be applied to a bright image, and performing optimal tone mapping in the display image according to the darkness of the external environment monitoring image using the generated tone curve mixture. The display image is output by adjusting the color tone including
In order to perform optimal tone mapping, a neural network learning algorithm is used to reflect the tone mapping result in a learning model including at least one of CNN, RNN, and SVM learning algorithms, and the color tone including brightness according to tone mapping is set. It can be patterned, classified, and optimized for each weather condition so that it can be determined whether it meets the
The control unit is
Controls to output a display image in an area excluding the defective module by checking a defective module among the LED modules by receiving the electronic sign board monitoring image obtained from the image sensor,
the display unit
an LED block in which a plurality of LEDs on which the display image is displayed are provided in a matrix form, and an LED Dot Matrix block having a plurality of modules;
Receives a bad module control signal corresponding to the bad module determination result of determining whether it is a bad module from the control unit, transmits power and display image signals normally in case of a normal module according to the bad module control signal, and in case of a bad module It further includes; a bad module control unit for controlling to block the power and display image signal of the module block;
The defective module control unit
After checking the defective module area according to the defective module control signal, designate the module area to be rearranged when outputting the video according to the video, image, and text phrase of the displayed image,
Check whether the text mode of the displayed image can be changed, and in the case of a display image containing text phrases in the form of overlay subtitles, if the background video or image is unnecessary or impossible to rearrange, delete the background video or image and put it on a black background control to display the text phrase but in the relocated module area,
In the case of a video or image that cannot be changed in text mode, it is checked whether it can be displayed in an area except for the defective module area, and the corresponding image is output to the corresponding module area, or if it is impossible, the smart LED signage is controlled not to be output. According to claim 1,
The control monitoring unit
Smart LED billboard, characterized in that the output control of the display image by applying a color change value differently to increase visibility according to the weather conditions recognized from the external environment monitoring image. delete delete delete According to claim 1,
The control unit is
Controls to output a display image in an area excluding the defective module by checking a defective module among the LED modules by receiving the electronic sign board monitoring image obtained from the image sensor,
the display unit
an LED block in which a plurality of LEDs on which the display image is displayed are provided in a matrix form, and an LED Dot Matrix block having a plurality of modules;
Receives a bad module control signal corresponding to the bad module determination result of determining whether it is a bad module from the control unit, transmits power and display image signals normally in case of a normal module according to the bad module control signal, and in case of a bad module a bad module control unit controlling to block the power of the corresponding module block and the display image signal;
a section board receiving the display image signal and performing a function of displaying an image in a designated area (LED Dot Matrix) of the LED Dot Matrix block;
SMPS that electronically supplies power to the defective module control unit
Smart LED billboard further comprising. delete In the image output method using a smart LED signboard having a plurality of LED modules,
Loading the electronic display board by receiving a display image to be output by the internal control unit for each time zone or by location provided from a database;
checking, by the control unit, whether a defective area among the LED module areas of the electric sign board;
calculating, by the controller, a color tone change value of a display image in consideration of weather conditions or external environmental factors corresponding to a background of a surrounding place;
When the control unit determines that there is no abnormality in the LED module block, transmitting the corresponding display image to the display unit;
outputting, by the display unit, a display image whose color tone is adjusted according to the calculated color change value;
obtaining, by the controller, an external environment monitoring image periodically photographed for an external environment from an image sensor in order to consider external environmental factors;
determining, by the controller, a corresponding wake-up state or a surrounding place state by calculating an RGB pixel change value of an acquired video image to determine a wake-up state or a state of a surrounding place in the external environment monitoring image, and comparing it with a set reference value;
When the wake-up state is determined as a specific wake-up state or the surrounding place is determined as a specific place according to the determination result, the control unit calculates a color change value suitable for the corresponding weather state or the surrounding place and applies it to the display image;
outputting a display image by adjusting a color tone including optimal brightness according to the color change value;
acquiring an electric sign monitoring image of the front of the electric sign using an image sensor, and the control unit checking whether there is a defective module area of the electric sign using the electric sign monitoring image;
designating, by the controller, an area of an electric sign module to be rearranged when outputting an image according to a moving picture, an image, or a text phrase of the displayed image after identifying the defective module area;
checking, by the controller, whether the text mode of the displayed image can be changed, and checking whether an image that cannot be changed in text mode can be displayed in a module area excluding the defective module area;
When the control unit determines that it is a display image including text phrases, if the background video or image is unnecessary or cannot be rearranged, the control unit deletes the background video or image and displays the text phrase on a black background, but in the relocated module area controlling to display;
adjusting, by the controller, the font size of the text phrase to be output if necessary when the text phrase is displayed by rearranging it in the module area to be displayed;
When determining that the display image includes text phrases, the control unit deletes the background video or image when the background video or image is unnecessary or cannot be rearranged in the case of a display image including the text phrase in the form of an overlay subtitle, and deletes the background video or image on a black background. Displaying a text phrase corresponding to the subtitle data, including controlling to display it in the relocated module area,
The control unit is
HSV region conversion is performed from RGB pixels in the external environment monitoring image, and the image is classified as a dark image or a bright image according to the dark reference value set based on the converted V value,
Optimum brightness by creating a tone curve to be applied to a dark image and a tone curve to be applied to a bright image, and performing optimal tone mapping in the display image according to the darkness of the external environment monitoring image using the generated tone curve mixture. The display image is output by adjusting the color tone including
In order to perform optimal tone mapping, a neural network learning algorithm is used to reflect the tone mapping result in a learning model including at least one of CNN, RNN, and SVM learning algorithms, and the color tone including brightness according to tone mapping is set. An image output method, characterized in that it can be optimized by patterning, classifying, and categorizing for each weather condition so that the color tone including brightness can be precisely adjusted according to external environmental factors by judging whether it conforms to the conditions and resetting the reference value through repeated learning.
delete delete delete

Images