KR20190108474A - Display control device - Google Patents

Abstract

According to the present invention, a display control device comprises: a memory for storing a plurality of contents; a sensing unit for acquiring sensing information about an object of interest when the object of interest enters within an object detection area; and a control unit for controlling a display device to output content when the object of interest approaches within an object recognition area closer than the object detection area, and to terminate the output of the content when the object of interest is outside of the object recognition area, the control unit determining the type of the object of interest that enters within the object detection area based on the sensing information, calculating an estimated remaining time for the object of interest to stay in the object recognition area, generating a content playlist based on the type of the object of interest, and adjusting a play time of the content play list based on the estimated remaining time.

Description

Display control device

The present invention is a display control device, and more particularly, a display control device capable of providing content suitable for an object of interest.

The display device is a device for outputting an image. The display apparatus outputs an image through a display panel or projects an image to the outside using visible light.

On the other hand, as a commercial display device, the tendency to arrange a display device outside is increasing.

On the other hand, conventional commercial display apparatuses, for example, conventional digital signage and electronic signs, repeatedly display the same contents or simply reproduce characters or images regardless of the presence or absence of a viewer.

According to this, conventional digital signage and billboards are widely used in roads, gas stations, churches, temples, government offices, hospitals, museums, hotels, banks, terminals, airports, train stations, department stores, shops, convenience stores, stadiums, etc. You cannot set the star or purpose feature as a function.

According to this, since the same content for the unspecified number is provided, there is a problem in that the effect of providing the content is lowered because the viewer does not watch the content with interest.

In addition, since the same content must be repeatedly provided, unnecessary power consumption is consumed.

On the other hand, since a digital signage or signboard manager must turn on and off the display device, a very cumbersome situation occurs in which the manager must continuously manage power.

In addition, since there is no feedback on advertisement effects such as images and information displayed on a conventional digital signage or an electronic sign, there is a problem that it is difficult to establish accurate information or statistics on the advertisement provision effect.

An object of the present invention is to provide a display control device that can provide content suitable for the interest.

Another object of the present invention is to provide a display control apparatus capable of providing content only when an object of interest is within a viewable distance.

Still another object of the present invention is to provide a display control apparatus capable of detecting and recognizing an object around a display device and providing suitable content corresponding to the recognized object.

Still another object of the present invention is to provide a display control apparatus capable of detecting and recognizing an object around a display device, providing suitable content corresponding to the recognized object, and feeding back the content providing effect to an installer or a provider of the display device. In providing.

Another object of the present invention is to provide a display control device capable of reducing power consumption and maintenance cost of a display device.

Still another object of the present invention is to display a module capable of modularizing statistical information providing functions for object recognition, type determination, viewing judgment, etc., providing a module as an optional function of a product, or using a product as a marketing information. In providing a control device.

A display control apparatus according to an embodiment of the present invention for achieving the above object includes a memory for storing a plurality of contents; A sensing unit configured to acquire sensing information about the target of interest when the target of interest enters within a target detection area; And controlling the display device to output content when the object of interest approaches the object recognition area closer to the object detection area and to terminate the output of the content when the object of interest leaves the object recognition area, based on the sensing information. Determine a type of the target of interest that has entered the target detection area, calculate an expected remaining time for the target of interest to stay in the target recognition area, generate a content playlist based on the type of the target of interest, and generate the expected residual It may include a control unit for adjusting the playback time of the content playback list based on the time.

The control unit may calculate and update the estimated remaining time in the target recognition area of the target of interest based on the sensing information in real time, and reproduce all contents included in the content play list within the estimated remaining time. If it is determined that there is no content, the content playback speed may be varied or the number of contents to be played back may be reduced.

The controller may be further configured to weight the plurality of contents based on the sensing information, calculate a fitness of the plurality of contents based on the weighting result, and generate the content reproduction list in the order of the calculated high suitability. Can be generated.

The controller may generate the content reproduction list by weighting the plurality of contents based on the operation state information of the interest object, and whether the motion of the interest object related to the content being played in the object recognition region is detected. In accordance with the present invention, it may be determined whether the content being played achieves the purpose.

The controller may update the content play list by changing a weight given to the content play list and recalculating the fitness based on whether the content being played achieves the purpose.

The controller may determine that the detection target has a high degree of concentration in the specific section when the relevant motion of the object of interest is detected in the specific section of the content being played, and the specific section of the content being played is repeatedly played. Can be.

If it is detected that the object of interest is a pedestrian and the pedestrian gazes at the display device, the controller extends the playing time of the content being played based on the estimated remaining time or sets the content being played as the interest content. Can be set.

The controller may update the content play list by recalculating the suitability of the plurality of pieces of content based on the movement or operation of another object of interest detected while playing the content play list for the object of interest.

According to an embodiment of the present invention, a display control apparatus may include a sensing unit for sensing an object of interest, an interface unit for receiving data from an external device, and a control unit for outputting content corresponding to the object of interest detected by the sensing unit. And a controller, wherein the controller comprises a content playback list using a distance to the object of interest, a moving speed of the object of interest, an estimated time of arrival of the object of interest, an estimated remaining time within the object recognition region of the object of interest, and a direction of the object of interest. By calculating the time to play the content, it is possible to provide content suitable for the object of interest. Therefore, content viewing rate according to content provision can be increased.

Meanwhile, the sensing unit controls information about a distance to the object of interest, a moving speed of the object of interest, an estimated time of arrival of the object of interest, a remaining time of the child within the object recognition region of the object of interest, and a direction of the object of interest to the controller, every predetermined time. The information of interest can be updated in real time.

On the other hand, the controller may determine the order of the displayed contents on the basis of the time to play the calculated content play list, thereby providing content suitable for the object of interest. Therefore, content viewing rate according to content provision can be increased.

Meanwhile, the controller may add related content for the interest of interest, control to repeatedly play the same content, or control the variable playback speed according to the goodness of fit, thereby providing content suitable for the interest of interest. Will be. Therefore, content viewing rate according to content provision can be increased.

On the other hand, by controlling the output of the content when the external object or the object of interest approaches within the target recognition area, and to terminate the output of the content when it is outside the target recognition area, power consumption and maintenance cost can be reduced. Will be.

Meanwhile, the recognized external object is controlled by varying the output content according to the size or type of the external object or the object of interest, or controlling the playback time, display size, display brightness, display position, or amount of the output content to vary. It is possible to provide content suitable for.

On the other hand, it is recognized by varying the output content, or controlling the playback time, display size, display brightness, display position or the amount of the content is changed according to the access speed or the approach distance of the external object or the object of interest. It is possible to provide content suitable for an external target.

Meanwhile, when the first external object approaches the target recognition area, the first external object is controlled to output the first content. When the second external object approaches the target recognition area, the second external object is controlled to output the second content. When the external object approaches within the object recognition area, the third object may be controlled to output the third content, thereby providing content suitable for the recognized external object.

Meanwhile, by controlling the sound signal corresponding to the content to be added to the output signal output from the sensing unit, the sound signal corresponding to the content can be provided to the external object, and thus the content recognition rate can be increased.

Meanwhile, when the first external object approaches the target recognition area more than a predetermined number of times during the first period, the first external object is controlled to output different content from the first content, so that the first external object includes the display control device and the same. According to the number of times of access to the display device, it is possible to provide the corresponding content. Therefore, content can be provided by learning.

Meanwhile, by sensing and recognizing an object around the display apparatus and displaying appropriate content corresponding to the recognized object, content suitable for the object can be provided.

On the other hand, the display device may provide the appropriate content corresponding to the recognized object and provide the content providing effect to the installer or provider of the display device, thereby feeding back the content providing effect.

On the other hand, the display device, by providing a modular information providing function for the object recognition, type determination, viewing judgment, etc., it is possible to utilize a variety of information such as marketing information.

1 is a conceptual diagram of a display system according to an embodiment of the present invention.
FIG. 2 is an example of an internal block diagram of the display device of FIG. 1.
FIG. 3 is an example of an internal block diagram of the display control device of FIG. 2.
4 is another example of an internal block diagram of the display apparatus of FIG. 1.
FIG. 5 is an example of an internal block diagram of the display control device of FIG. 4.
6A-6B illustrate various examples of internal block diagrams of the control unit of FIG. 3 or FIG. 5.
7A to 7B are views illustrating an appearance of the display apparatus of FIG. 1.
8 is an example of a flowchart illustrating a method of operating a display control apparatus according to an embodiment of the present invention.
9A to 17 are views referred to for describing the operating method of FIG. 7.
18 to 23 are examples of flowcharts illustrating a method of operating a display control apparatus according to various embodiments of the present disclosure.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffixes "module" and "unit" for components used in the following description are merely given in consideration of ease of preparation of the present specification, and do not impart any particular meaning or role by themselves. Therefore, the "module" and "unit" may be used interchangeably.

1 is a conceptual diagram of a display system according to an embodiment of the present invention.

Referring to FIG. 1, the display system 10 may include a display apparatus 100 capable of displaying various contents and a server 300 receiving data from the display apparatus 100 and providing contents to the display apparatus 100. ), And a mobile terminal 600 that exchanges data with the server 300.

The display apparatus 100 may be installed in an external public place.

For example, the display apparatus 100 may be installed in public facilities such as a terminal, a train station, and an airport to provide information such as advertisements, news, and announcements. It is also possible to be placed around show windows in stores, such as gas stations, department stores, shopping malls, large marts, for advertisements of particular goods.

On the other hand, when the display apparatus 100 is fixedly installed on a road, a gas station, or the like, it detects and recognizes a passing vehicle as an object, and displays information such as traffic guidance, maps, instructions, etc., or displays gas station information. Can be.

On the other hand, when the display apparatus 100 is fixedly installed in a road, a public office, a store, a church, a temple, or the like, the display apparatus 100 may detect and recognize a person passing by, i. Can be.

On the other hand, the display device 100 is fixedly installed in hospitals, banks, stadiums, hotels, trains, train stations, buses, bus stops, airports, department stores, outlets, and the like, and displays various kinds of guide information and advertisement information. can do.

The display apparatus 100 may be disposed outside the mobile vehicle, and may detect and recognize a surrounding vehicle or a pedestrian, and display various guide information and advertisement information corresponding to the target vehicle.

Meanwhile, the display apparatus 100 may be disposed inside the mobile vehicle, and may detect and recognize a passenger riding in the vehicle, and display various guide information and advertisement information corresponding to the target. have.

The display device 100 may include a display 180 disposed inside the casing.

On the other hand, the external objects VC1 to VC3 and PD1 to PD2 can watch the video displayed on the display apparatus 100 as shown in the figure.

The display apparatus 100 according to an embodiment of the present invention recognizes the external targets VC1 to VC3, PD1 to PD2, and displays various contents corresponding to the recognized targets VC1 to VC3, PD1 to PD2. Can be. Accordingly, content suitable for the recognized targets VC1 to VC3 and PD1 to PD2 can be provided.

In particular, when the provided content is advertisement information, advertisement image, etc., it is possible to provide an advertisement suitable for the recognized targets VC1 ˜ VC3, PD1 ˜ PD2, which may help increase the profits of the installer of the display apparatus 100. It becomes possible.

To this end, the display apparatus 100 preferably includes a sensing unit 195 for recognizing the type, size, and the like of the external object.

The display apparatus 100 according to an exemplary embodiment of the present invention may include a vehicle recognition sensor 195a of FIG. 3, a pedestrian recognition sensor 195b of FIG. 3, and the like for recognizing various vehicles.

The display apparatus 100 may receive and store various contents from an external server 300 in advance, and provide corresponding contents according to the type, size, etc. of the recognized external object.

As another example, the display apparatus 100 transmits information on the type and size of the recognized external object to the server 300 or sends a specific content transmission request to the server 300 according to the type and size of the recognized external object. Can transmit

Accordingly, the server 300 may provide corresponding content to the display apparatus 100 in a stream form in real time.

The display apparatus 100 may transmit the recognized object information, the number of times passed, and the like to the server 300 when the recognized object passes over the predetermined number of times.

Accordingly, the server 300 transmits separate content to the recognized object by using the received object information, the number of times that have passed, and the like, and the display apparatus 100 that has received the received object has a predetermined number of times. As described above, separate content may be provided.

Meanwhile, in the mobile terminal 600 of a specific user, content desired by the user may be transmitted to the server 300, and the user equipped with the mobile terminal 600 or the vehicle in which the user boards the display apparatus 100 may be used. ), The user may provide the desired content.

Meanwhile, the mobile terminal 600 may be a mobile terminal, such as a wearable device such as a mobile phone, a smart phone, a tablet PC, or a smart watch.

The server 300 may be a server provided by the manufacturer of the display apparatus 100 or a server operated by a provider for providing content to the display apparatus 100.

The sensing unit 195 disposed on the display apparatus 100 may include a vehicle recognition sensor 195a such as a rider and a radar, a pedestrian recognition sensor 195b such as a camera, and the like.

In particular, the pedestrian recognition sensor 195b may include a stereo camera. The display apparatus 100 may signal-process the received stereo image based on computer vision to recognize and identify an external object, especially the pedestrians PD1 and PD2.

Alternatively, the display apparatus 100 may recognize and confirm an external object, in particular, the vehicles VC1 to VC3, and the like, based on a sensing signal from the vehicle recognition sensor 195a such as a rider or a radar.

On the other hand, the internal structure and operation of the display device 100 will be described with reference to FIG.

FIG. 2 is an example of an internal block diagram of the display device of FIG. 1.

Referring to the drawing, the display apparatus 100 may include a display control apparatus IPA, a display 180, an input apparatus 185, and the like.

For example, when the display apparatus 100 is installed at a gas station near a road, the display 180 may provide, for example, text for fuel (petrol, kerosene) price information for each fuel.

As another example, when the display apparatus 100 is installed at a gas station near a road, the display device 100 may provide fuel-specific price information (eg, gasoline or kerosene) through the display 180 as an image. In this case, the display 180 may include a liquid crystal panel, an organic light emitting panel, an LED panel, an electrophoretic panel, and the like.

The display control device IPA may provide the processed signal to the display 180 for content display.

To this end, the display control device IPA may include a control board CB including a control unit and a timing controller board TB including a timing controller (not shown).

The timing controller (not shown) is a panel of the display 180 based on the video signal DVI from the control board CB or the video signal DVI from a separate control PC CPC. The data driving signal and the gate driving signal for driving may be output.

The timing controller (not shown) may further receive a control signal, a vertical synchronization signal Vsync, and the like from the control board CB in addition to the image signal DVI.

In addition to the image signal DVI, the timing controller 232 may provide a data driving signal and a gate driving signal for driving the panel of the display 180 based on a control signal, a vertical synchronization signal Vsync, or the like. You can print

In this case, the data driving signal may be an RGB subpixel driving data driving signal when the panel includes an RGB subpixel, and when the panel includes an RGBW subpixel, the data driving signal may be an RGBW subpixel driving data driving signal.

On the other hand, the control PC (CPC) may provide various contents displayed on the display apparatus 100.

For example, when the external object is recognized by the display device 100, the control PC CPC receives information about the recognized external object, and transmits content corresponding to the recognized external object to the display device 100. Can provide.

When the external object is recognized by the display apparatus 100, the control PC may store information on the recognized external object and perform history management.

For example, the control PC (CPC) may provide separate content when the recognized object passes by more than a predetermined number of times.

The input device 185 may transmit an input signal for controlling the display control device IPA to the display control device IPA.

For example, the input device 185 may be provided with a plurality of buttons such as a power button.

As another example, the input device 185 may transmit an input signal for controlling the display control device IPA to the display control device IPA and display information for monitoring the display control device IPA. To this end, the input device 185 may include a touch-based display panel that can input and display.

FIG. 3 is an example of an internal block diagram of the display control device of FIG. 2. In particular, an internal block diagram in the control board CB of FIG. 2 is illustrated.

Referring to the drawings, the control board CB in the display control device IPA includes the interface unit 130, the memory 140, the image processing unit 160, the control unit 170, the display 180, and the power supply unit 190. ), The sensing unit 195 and the like.

The interface unit 130 may transmit / receive data with an external device (not shown). For example, data may be transmitted and received with the connected external device.

To this end, the interface unit 130 may include various connection terminals.

For example, the interface unit 130 may include an HDMI terminal, an RGB terminal, a component terminal, a USB terminal 133, a micro SD terminal, an IR receiving terminal 134, a DVI receiving terminal 131, and an image to the display 180. DVI transmission terminal 131b and the like for signal transmission may be included.

Meanwhile, the interface unit 130 may provide an interface for connecting the display control apparatus (IPA) to a wired / wireless network including an internet network. For example, the interface unit 130 performs USB communication, wired communication (RS-232C, etc.), or wireless communication (WiFi, Bluetooth, WiDi, mobile communication, etc.) to perform an Internet or content provider or a network. The network operator can transmit and receive content or data.

For example, the interface unit 130 may include a LAN terminal 132 for wired data communication.

The memory 140 may store a program for processing and controlling each signal in the controller 170, or may store a signal-processed video, audio, or data signal.

In addition, the memory 140 may perform a function for temporarily storing an image, audio, or data signal input to the interface unit 130.

The memory 140 may include a RAM, a ROM, an HDD, an SSD, or the like.

The image processor 160 may perform image processing of an image signal received through the controller 170 or the interface 130.

To this end, the image processor 160 may include an image encoder, an image decoder, a scaler, a frame rate converter, and the like.

An image decoder (not shown) decodes the demultiplexed video signal, and a scaler (scaling) performs scaling to output the resolution of the decoded video signal on the display 180.

An image decoder (not shown) may include decoders of various standards.

The controller 170 may perform an overall control operation of the display control apparatus IPA. Specifically, the operation of each unit in the display control device IPA can be controlled.

The controller 170 may be implemented as a system on chip (SoC), MCU, CPU, or Micom.

The controller 170 may control to output an image stored in the memory 140 or an image received from an external device through the interface unit 130.

The power supply unit 190 may receive an external power source or an internal power source under the control of the controller 170 to supply power for operation of each component.

The power supply unit 190 supplies the corresponding power throughout the display control device IPA. In particular, power may be supplied to the controller 170, which may be implemented in the form of a system on chip (SOC), the display 180 for displaying an image, and the like.

Specifically, the power supply unit 190 may include a converter for converting an AC power source to a DC power source, and a dc / dc converter for converting a level of the DC source power.

The sensing unit 195 may include a vehicle recognition sensor 195a, a pedestrian recognition sensor 195b, an illuminance sensor 195c, a solar sensor 195d, a heat sensor (not shown), a heat tracking sensor (not shown), GPS sensors, IOT sensors (eg, humidity sensors, temperature sensors, dust sensors, ultraviolet sensors, earthquake sensors, etc.) may be provided.

The vehicle recognition sensor 195a is a sensor for recognizing a vehicle approaching the display apparatus 100 or the vicinity of the display control apparatus IPA, and may include a radar or a rider.

The radar may transmit the radar signal or the radar beam to the outside using the antenna, and receive the signal or beam reflected from the vehicle.

The pedestrian recognition sensor 195b may include a camera. Here, the camera may be a visible light based camera or an infrared based camera.

The controller 170 or the vehicle recognition sensor 195a may calculate phase information on the distance of the vehicle or the speed of the vehicle, based on the difference between the transmitted signal and the received signal.

The rider may transmit the rider signal to the outside using the antenna and receive the signal reflected from the vehicle.

The controller 170 or the vehicle recognition sensor 195a may calculate phase information on the distance of the vehicle or the speed of the vehicle, based on the difference between the transmitted signal and the received signal.

The illuminance sensor 195c may sense the illuminance around the display apparatus 100 or the display control apparatus IPA.

The solar sensor 195d may sense sunlight around the display apparatus 100 or the display control apparatus IPA.

The controller 170 or the vehicle recognition sensor 195a may calculate the photoelectric efficiency of sunlight based on the sensing information from the solar sensor 195d.

On the other hand, according to an embodiment of the present invention, the sensing unit 195 may operate for detecting the presence of the object, type, number, recognition, and tracking the object.

For example, when the object is detected in the predetermined object detection area ZN1, the sensing unit 195 recognizes the presence or absence of the object, and the object is detected in the predetermined object recognition area ZN2. If it is recognized, information of the recognized object may be extracted and transmitted to the controller 170. The controller 170 may recognize the recognized object in comparison with the information previously stored in the memory 140.

In addition, the controller 170 may change the previously stored information in the memory 140 through learning after comparing the detected target information with previously stored information.

The controller 170 may classify the information extracted by the sensing unit 195 with respect to the recognized object as the object of interest based on a result of comparing the stored information with previously stored information.

If you're interested, you can subdivide that kind.You can be a car or a person, and a car can be a bus, a truck, a car, a motorcycle, a bike, a taxi, and so on. , Middle age, old age, and old age can be classified.

Meanwhile, the sensing unit 195 may count each individual number of objects of interest recognized in the object recognition region ZN2, but may not count any more when it is outside the object recognition region ZN2.

The object detection area (ZN1 of FIG. 9B) refers to a predetermined area longer than the distance that the sensing unit 195 recognizes the object, and the object recognition area (ZN2 of FIG. 9B) indicates the object to be detected by the sensing unit 195. It may mean a preset area.

Although the object detection area ZN1 and the object recognition area ZN2 may be the same, the object detection area ZN2 is typically set with a sensing distance farther away, and the presence or absence of the object is detected within the detection distance. When the target is of interest, it can recognize whether the object is of interest, and if it is of interest, it can be further subdivided to recognize and track.

In addition, the predetermined predetermined object detection area ZN1 may be equal to or longer than the predetermined predetermined object recognition area ZN2, and the content reproduction area may be reproduced in the object recognition area ZN2. It may be equal to or shorter than the object recognition area ZN2.

The object detection area ZN1 and the object recognition area ZN2 are located on the front side of the display apparatus 100 that can be viewed by the target of interest, and when the target of interest is outside the target recognition zone ZN2, The content playback on the display apparatus 100 ends, and the sensing unit 195 may not detect an object farther than the object detection area ZN1.

The sensing unit 195 may use various sensors such as a camera, a radar, a rider, an infrared ray, a thermal sensor, and a heat tracer. The camera may use a single camera or two stereo cameras. Radar can also be used alone or in combination with other sensors such as cameras.

In addition, the sensing unit 195 may use a sensor such as a GPS capable of sensing the current location, and may recognize the current location and transmit related information to the control unit 170.

In addition, the sensing unit 195 may be controlled by the controller 170 to be turned on even when the display apparatus 100 is in the standby mode. In this case, the display apparatus 100 may be in the standby mode. ), And when the sensing unit 195 appears in the target detection area ZN1, the display unit 100 may turn on the power-up / wake-up signal to enter the operating mode. It may transmit to the control unit 170.

In this case, the control unit 170 may receive a power-up / wake-up signal from the sensing unit 195 even during a standby mode, and in some cases, the control unit 170 may execute the function of the control unit 170. It may be provided as a separate device outside the SoC or MCU.

The controller 170 receives the power-up / ake-up signal, and then the memory 140, the interface unit 130, the power supply unit 190, the image processor 160, the display 180, and the like. Each device may be controlled to apply power and enter an operating mode.

Meanwhile, in the present invention, the display apparatus 100 for selectively displaying the customized content to the target of interest does not always operate in the execution mode, but when the target is displayed in the standby mode when there is no target. In this case, the device enters an operating mode as needed, thereby reducing power consumption of the display apparatus 100 displaying content.

To this end, the sensing unit 195 of the display apparatus 100, if the target does not appear for a predetermined time in the predetermined target detection area ZN1, the control unit 170 in the standby mode (Stand By Mode) Signal), and the controller 170 controls the memory 140, the communication unit, and the interface unit (100) of the display device 100 to enter the standby mode from the operating mode. 130, the power supply unit 190, the image processor 160, and the display 180 may be controlled.

At this time, a function capable of receiving a power-up / ake-up signal from the sensing unit 195 is in an operating mode. The function may be inside an SoC or MCU, or may be separately It can also be present as a device.

In addition, when the sensing unit 195 does not have an object in the predetermined target sensing area ZN1, the sensing unit 195 may transmit a signal indicating that there is no object to be detected to the controller 170.

If the control unit 170 continues to receive a signal that there is no object from the sensing unit 195 for a predetermined time, the control unit 170 displays the display device 100 in the standby mode (Operating Mode). The memory 140, the communication unit, the interface unit 130, the power supply unit 190, the image processor 160, the display 180, and the like of the display apparatus 100 may be controlled to enter the Stand By Mode.

 Meanwhile, the sensing unit 195 transmits information of objects to the control unit 170 at predetermined time intervals, and the information may include at least one of existence, recognition, and numbers, and stands by mode. In one case, an interval of a predetermined time of transmission may be longer than that of an operating mode.

On the other hand, the sensing unit 195 may perform movement of the object and recognition of motion.

For example, when the type of the object of interest in the predefined object recognition area ZN2 is recognized by the controller 170, the sensing unit 195 may be located in the predefined object recognition area ZN2. Regarding the movement of the object of interest, the distance to the object of interest based on the display apparatus 100 equipped with the sensor, when the object of interest is a vehicle, the distance between the object of interest and the preceding vehicle, the moving speed of the object of interest, the object of interest The estimated time to reach the display apparatus 100, the estimated remaining time of the object of interest in the object recognition area ZN2, the direction of the object of interest, and the like may be recognized and transmitted to the controller 170 at predetermined times.

In more detail, when the controller 170 receives the type of the object of interest in the predetermined object recognition area ZN2, the sensing unit 195 recognizes and tracks the movement of the object of interest from the controller 170. The control unit 170 receives a command for transmitting the predetermined information every predetermined time, and based on this command, the sensing unit 195 recognizes and tracks the movement of the object of interest and transmits the recognized information to the control unit 170. Can be sent every hour.

 In addition, the sensing unit 195 may recognize a specific operation related to viewing content of the display apparatus 100 of interest in the predetermined object recognition area ZN2.

In the case of a vehicle, information about an operation in which a change in movement caused by vehicle control occurs is transmitted to the controller 170 at predetermined time intervals, for example, an acceleration change such as a speed down or a lane change in the target recognition region ZN2. In response to the movement direction, the change, and the movement of the movement of the object of interest, the controller 170 recognizes an operation in which the movement of the object of interest occurs.

In addition, in the object recognition area ZN2, a person may recognize an operation about fixing the direction of the face or the direction of the face, or fixing the direction of the line of sight or the line of sight, and transmit the same to the controller 170 at a predetermined time.

Meanwhile, the controller 170 may calculate and select content corresponding to the type and movement of the object.

The controller 170 receives information about the existence of the object sensed by the sensing unit 195 and the type, number, movement, and operation of the object of interest recognized from the sensing unit 195, and receives the received information on the object of interest. Based on the content list pre-stored in the memory 140, the fitness of the contents can be calculated.

The controller 170 filters the most suitable contents for the target of interest by using calculated fitness information about the type, number, movement, etc. of the target of interest, and determines the selected content based on the order of relevance again, and thus has a high degree of fitness. The content play list may be generated so that they can be displayed on the display apparatus 100.

In this case, the method of determining the selected content may include calculating using a weight based on the fitness according to the object of interest and the information received from the sensing unit 195.

If the object of interest recognized by the sensing unit 195 is a vehicle, and the speed of the object of interest received by the controller 170 is higher than a predetermined reference speed, the controller 170 adjusts the content suitability suitable for the object of interest. Judgment is based on the type, distance, distance, number, speed, estimated time of arrival, estimated remaining time and direction in the target recognition zone (ZN2). Accordingly, when determining the respective content, the controller 170 may determine that the content that is most suitable for the current interest is content related to speed reduction. Then, the controller 170 may filter or select contents related to speed reduction.

 When the object of interest is a vehicle, when the controller 170 receives the changed information of the operation of the object of interest from the sensing unit 195, the controller 170 may display the content displayed on the display apparatus 100 by the object of interest. If it is determined that the user is watching, and the content being played is related to the content being played, the purpose of the content has been achieved. Therefore, the information of interest, the play list, the sensing information of the sensing unit 195, and the effect of playing the content are stored. Can be.

On the other hand, the controller 170 may update the content playlist by changing the weight of the playlist content and determining the fitness again.

If the operation of the object of interest received by the controller 170 is not related to the content currently being played on the display apparatus 100, the fitness of previously stored contents may be calculated.

In addition, the control unit 170 may determine the content reproduction method for the object of interest again, the related content for the object of interest may be added or may be controlled to repeatedly play the same content according to the determination of the fitness, and the playback speed is normal. You can also control various things, such as playing faster or slower than speed.

For example, when a vehicle stopped for a signal waiting or a vehicle moving in a slow motion is of interest, information about the type of vehicle is received from the sensing unit 195 in the same manner, but information about movement or operation is changed. The content suitability determination may be executed again, and the content playback method may be controlled again to match the movement or operation of the object of interest.

On the other hand, the sensing unit 195 may sense the operation of the object of interest and transmit it to the control unit 170, and the control unit 170 may determine whether the reproduction purpose has been achieved.

In addition, if the controller 170 receives the same movement information even if a plurality of interests are of the same type or different types, the controller 170 may be interested based on information on the type, number, movement, etc. of the interests. The most suitable content is determined to select or filter the most suitable content. The content list to be played is determined in order of high suitability.

On the other hand, the controller 170 receives information from the sensing unit 195 about an operation in which an acceleration such as speed up or down, a change thereof, a direction and a change, and a change in movement of the object of interest is received and is currently being reproduced. The controller 170 determines that the action of the object of interest has changed when the movement or motion information of the object of interest changes with respect to the content being played. ) Can be stored.

On the other hand, the controller 170 determines that the object of content reproduction has been achieved, stores it in the memory 140, changes the weight to reflect the achievement of the content reproduction purpose in the fitness determination, and performs the fitness judgment again to reproduce the content. You can control the list to be updated.

The controller 170 may generate a content list suitable for the object of interest.

For example, the controller 170 may generate a content playback list that is most suitable to be displayed to the target of interest, and may calculate the playback order, the total playback length, and the like based on the movement information of the target of interest.

In particular, the controller 170 may include a distance from the display apparatus 100 to an object of interest, a speed of the object of interest, an estimated time of arrival of the object of interest to the display device 100, an estimated remaining time in the object recognition area ZN2, Using the information such as the direction of interest, the time (playback start, playback length, playback speed, playback end, etc.) for playing the content playlist can be calculated.

Meanwhile, the controller 170 may determine the order of the contents to be displayed by selecting contents most suitable for display to the target of interest from the contents reproduction list generated based on the calculated reproduction time.

 In addition, the controller 170 generates a content play list by using the above method to the other interested objects determined by the controller 170, and the content play in which the contents included in the generated content play list are displayed to the previous interest object is generated. When finished, you can control playback to begin.

Accordingly, the controller 170 may control to configure a content list for other interests while controlling to play one current content playlist.

 In addition, the controller 170 may operate the object of interest in the predetermined predetermined object recognition area ZN2 recognized by the sensing unit 195 even while controlling the current display apparatus 100 to play the content for the object of interest. It may be determined whether the display apparatus 100 is related to the content being played.

In particular, if the object of interest is a speeding vehicle, and the control unit 170 controls the playback of the content for the speeding vehicle, and the movement or motion information of the vehicle of interest received by the sensing unit 195 is determined to decrease in speed, the control unit The 170 may store both the object of interest, a content list played for the object of interest, and related information.

Therefore, when reproducing the contents of the content play list, the controller 170 may compare the purpose of the content with the motion information of the object of interest received from the sensing unit 195 and determine whether the operation corresponds to the purpose of the content. For example, in the case of a vehicle, there may be a deceleration, acceleration, inter-vehicle distance, lane change, direction indication, and the like.

The controller 170 may play the selected content.

For example, the controller 170 controls to play the content which is to be displayed first among the contents that are not yet started playing in the content playlist, and transmits the content stored in the memory 140 to the image processor 160. The image processor 160 may reproduce the corresponding content to be displayed on the display 180.

That is, the controller 170 instructs the image processor 160 to play the content, and the image processor 160 processes the content and transmits the content to the display 180 to be displayed on the screen of the display 180.

 On the other hand, the control unit 170, after determining the reproduction end condition of the play list, and controls, if the object of interest is determined to have passed the predetermined object detection area (ZN1) or the predetermined object recognition area (ZN2) or the contents of the play list. If all of the contents are determined to be played, the content list generated for the target of interest and the related information may be stored in the memory 140 and the reproduction of the contents included in the generated content list may be terminated.

The controller 170 may control content playback.

For example, the controller 170 may determine a content reproduction condition for the object of interest based on information or a signal received from the outside, and control content reproduction based on the determined condition. In detail, the controller 170 may determine whether the playback condition of the display apparatus 100 is an emergency condition or a default condition based on information or a signal received from the outside, and control the playback to meet the condition.

The emergency condition may include a case in which the control unit 170 receives disaster information such as a traffic accident, a fire, an earthquake, or the like from the sensing unit 195 or the communication unit.

When the controller 170 receives the above information, the controller 170 may control the emergency content previously stored in the memory 140 or the external device to be reproduced.

The default condition may include a case where a command signal is received from the manager of the display apparatus 100.

The controller 170 may control the content specified in the memory 140 or the external device to be played back.

 In addition, if a change or movement of another object of interest occurs while playing the contents of the content playlist for the object of interest, the controller 170 may cause a change in the content suitability calculation result suitable for the type and movement of the object of interest. Accordingly, the content playlist may be updated.

In this case, the controller 170 may change the content play list itself to be played back or control specific content included in the content play list to be deleted and other content is added.

In addition, the playback command from the controller 170 may be changed according to the changed movement or operation of the object of interest, and the playback command may be controlled including fast play, repeat play, continuous play, slow play, stop, and the like.

In addition, if a target does not appear in the predetermined target detection area ZN1 for a predetermined time, the controller 170 checks the previously stored information by the administrator of the display apparatus 100, and the administrator checks the previously stored information. If the specified basic content is included, it is selected to play it. If the checked pre-stored information does not have the basic content designated by the administrator, the controller 170 arbitrarily selects the content or receives the ambient condition signal received from the sensing unit 195. Based on the selected content can be controlled to be played on the display 180.

At this time, the ambient conditions may include weather, night and day. Accordingly, the controller 170 receives the signal of the object from the sensing unit 195 and the ambient condition signal received by the sensing unit 195 or the basic content or arbitrary content until the object is recognized as the object of interest based on the signal. Control to play the selected content on the basis of.

In addition, if a target does not appear in the predetermined target detection area ZN1 for a predetermined time, the sensing unit 195 transmits a standby mode signal to the controller 170, and the controller ( The 170 may control the display apparatus 100 to enter the standby mode by receiving the corresponding signal.

Meanwhile, the controller 170 may control the transmission and display of information to the input device 185 or the surrounding mobile device that can be monitored.

For example, the controller 170 may control the display apparatus 100 to be turned off or on by receiving an administrator's command through the input apparatus 185, and may turn the display apparatus 100 into a standby mode. By mode) may be entered into the operating mode (Operating Mode) or from the operating mode (Operating Mode) to enter the standby mode (Stand By Mode).

Meanwhile, the administrator may search for a list of information stored in the display apparatus 100 through the input device 185 and control the display to be displayed on the input device 185.

In detail, the controller 170 transmits and displays information on execution of the display apparatus 100, information on an object of interest, and content or content playlist information for a preset period such as time / date / week / month to a monitor. By controlling the display apparatus 100, the display apparatus 100 manager may view information about the object of interest and the content being played back and information about the object of interest and the reproduced content for a predetermined period of time without looking at the screen of the display apparatus 100. It can be controlled for easy viewing on a monitor.

Herein, the manager of the display apparatus 100 may mean a person who manages or includes a robot or a vision function, and includes a computer.

On the other hand, the display device 100 administrator, the effect of the content to be reproduced on the display device 100, information about the number of times or frequency of playback, information about the object passing in front of the display device 100, information on power consumption reduction, etc. can confirm.

That is, the controller 170 may reproduce the content being played on the display 180 on the monitor, and display information stored in the memory 140 in addition to the content on the monitor.

In this case, the information about the execution of the display apparatus 100 transmitted from the controller 170 to the input device 185, the information about the object of interest, and the content or the content playlist information may be transmitted while the content is displayed on the display 180. Alternatively, a time when no content is played may be separately set and transmitted.

Meanwhile, information about execution of the display apparatus 100 transmitted to the input device 185, information about an object of interest, and content or content playlist information may be compressed and transmitted.

Meanwhile, the controller 170 may transmit information transmitted to the input device 185 to a preset device so that the administrator of the display apparatus 100 may receive and confirm the information at a long distance.

The controller 170 may control the display apparatus 100.

For example, the controller 170 decreases or displays the brightness of the image of the content being played when information about the presence of the object or information about movement or a specific operation is not received from the sensing unit 195 for a predetermined time. The display device 100 may be controlled to reduce the brightness of the screen of the screen 180 or to convert the predetermined content into a predetermined content, to turn off the light source of the screen or the screen itself, or to enter the standby mode. .

If the controller 170 does not receive information about the presence of the target or information about movement or a specific operation from the sensing unit 195 for a predetermined time, the controller 170 may play the preset specific content. You can play the preset content, refresh rate top-level content, the preset logo image, or the specified text.

In particular, the display apparatus 100 is in a standby mode, and when the controller 170 receives a power-up / wake-up signal from the sensing unit 195, the controller 170 stores the memory 140. ), The communication unit, the interface unit 130, the power supply unit 190, the image processing unit 160, the display 180, and the like may apply power to each device to enter the operating mode. Upon entering the execution mode, the controller 170 may calculate power consumption and transmit power consumption information to the monitor or mobile device to be displayed on the monitor or mobile device.

Upon entering the execution mode, the controller 170 may calculate power consumption and transmit power consumption information to the monitor or mobile device to be displayed on the monitor or mobile device.

On the other hand, when the information about the presence of the target or information about the movement or a specific operation is received from the sensing unit 195 again, the controller 170 increases or decreases the brightness of the lowered image to the normal state of the display 180. A display device that increases the brightness of the screen, stops playback of certain preset content, plays content for a recognized object, turns the light source of the screen off or the screen itself back on, or is in Stand By Mode. Each device may be controlled to enter 100 in an operating mode.

In particular, the control unit 170 receives the power-up / ake-up signal, and then the memory 140, the communication unit, the interface unit 130, the power supply unit 190, the image processing unit 160, and the display 180. Each device can be controlled to apply power to the back panel and enter the operating mode.

Although the controller 170 is in a stand-by mode, a device that receives a power-up / wake-up signal from the sensor is running. In a special case, only the device is external to the SoC or MCU of the controller 170. It can also be provided separately.

On the other hand, the controller 170 controls to transmit the excellent content reproduction information to the monitor or the mobile device with the target, the content having the effect of the content playback, such as the target of interest to perform a specific operation after playing the content for the interest On the contrary, after playing the content for the object of interest, the object of interest may not be moved or operated so that the inferior content reproduction information together with the object may be transmitted to the monitor or the mobile device. The display control device (IPA) manager may look at the notification information and find an effect, a direction, a frequency, and a remedy for the content or method of playing the content.

The controller 170 may perform data processing of the display apparatus 100.

For example, the controller 170 controls to store information about a target, information about a content, and information about determination or control of the controller 170 in the memory 140. You can control to save separately.

The controller 170 may control the memory 140 to transmit the information about the main object and the reproduced content to the input device 185 or the mobile device for each preset period, day / week / month according to the setting of the administrator. .

On the other hand, the sensing unit 195 in the display control device IPA recognizes the presence or absence of the object when the object appears within a predetermined sensing distance defined outside the splay control device IPA, and defines the predetermined object recognition area. It is possible to recognize the type and movement of the object within ZN2 and the specific operation.

On the other hand, the control unit 170 in the display control device (IPA) according to an embodiment of the present invention, from the sensing unit 195 receives information about the presence, type, number, movement, or specific operation of the target The content suitability for the type, movement, or specific operation of the object may be calculated and the content may be filtered or selected.

On the other hand, the control unit 170 in the display control device (IPA) according to an embodiment of the present invention, to generate a play list with the filtered or selected content and to control the playback of the content, so that the content is displayed on the display 180, the video signal And the display apparatus 100.

On the other hand, the control unit 170 in the display control device (IPA) according to an embodiment of the present invention, to control the playback of the content and the generation of the play list with the filtered or selected content, and to display the content on the display 180 The signal and the display apparatus 100 may be controlled and the memory 140 may be controlled to store information about the target, content reproduction information, or situation information in the memory 140.

On the other hand, when the display device 100 according to the embodiment of the present invention is a display device fixedly installed outdoors, the control unit 170 of the display control device IPA according to the embodiment of the present invention is filtered or selected. It is possible to control a video signal and the display apparatus 100 to generate a playlist from the contents, control the reproduction of the contents, and display the contents on the display 180.

Meanwhile, when the display apparatus 100 according to the exemplary embodiment of the present invention is a display apparatus installed outside of a moving object such as an outdoor vehicle, the controller 170 of the display control apparatus IPA according to the exemplary embodiment of the present invention. The control unit may generate the play list with the filtered or selected contents, control the reproduction of the contents, and control the image signal and the display apparatus 100 to display the contents on the display 180.

Meanwhile, when the display apparatus 100 according to the exemplary embodiment of the present invention is a display apparatus installed inside a moving object such as an outdoor vehicle, the controller 170 of the display control apparatus IPA according to the exemplary embodiment of the present invention. The control unit may generate the play list with the filtered or selected contents, control the reproduction of the contents, and control the image signal and the display apparatus 100 to display the contents on the display 180.

On the other hand, the controller 170 of the display control device (IPA) according to an embodiment of the present invention, to generate a play list with the filtered or selected content and to control the playback of the content, the image to display the content on the display 180 The signal and the display apparatus 100 may be controlled, and the information and content information about the target may be transmitted and displayed to the input apparatus 185.

That is, the controller 170 may display information about the object of interest and the content being played by the person who manages the display apparatus 100 and information about the object of interest and the reproduced content for a predetermined period of time. You can control it so that you can easily see it on the monitor without looking at the screen.

Meanwhile, the controller 170 of the display control apparatus (IPA) according to an embodiment of the present invention may control the display apparatus 100 by checking whether the content is playable based on information on a current time.

That is, the control unit 170 receives information about time through the sensing unit, the interface unit 130, or a communication unit (not shown), and stores the time information of the content obtained from the data stored in the memory 140 and the current time. It is possible to compare the related information, check whether the content can be played back at the current time, and control playback of the content at the time of the playable time.

If the content enters a time when the content cannot be played while the content is being played, the controller 170 may end the current content playback. In addition, the controller 170 may control the display apparatus 100 by checking whether the next content is content that can be played based on time information.

As an example of a time limit that is a time during which the corresponding content cannot be played, it may be a time for going to work or going to school. Or day time, or leave / dismissal time or night.

The time limit for not being able to play the corresponding content may vary depending on the type or property of the content. For example, in the case of advertisement content targeting adults, the corresponding content may not be displayed during the day.

This time limit may be determined by the laws of the government or local government.

On the other hand, the input device 185, in particular, the monitor may be attached to the housing of the display device 100, or may be provided outside the display device 100, depending on the system configuration.

Meanwhile, the controller 170 of the display control device IPA according to the embodiment of the present invention may control the display of the mobile device.

For example, the controller 170 of the display control device (IPA) may generate a play list based on the filtered or selected contents, control the reproduction of the contents, and display the image signal and the display apparatus such that the contents are displayed on the display 180. And control information to be transmitted and displayed on the mobile device and the content information to the mobile device so that the person who manages the display device 100 is currently interested in and information about the content being played and a predetermined period of time. Information about the object of interest and the reproduced content may be controlled so that the mobile device of the remote device can easily check the information on the object of interest and the reproduced content. In particular, the controller 170 may control to display information about the content displayed by the app of the mobile device, a main interest object, an effect object, a power consumption reduction, and the like.

Meanwhile, the controller 170 of the display control apparatus IPA according to the exemplary embodiment of the present invention may control the server 300 to transmit predetermined data.

For example, the controller 170 of the display control device (IPA) may generate a play list based on the filtered or selected contents, control the reproduction of the contents, and display the image signal and the display apparatus such that the contents are displayed on the display 180. 100 may be controlled to store information on the object, content reproduction information, or situation information in the memory 140, and may transmit the stored information to the server 300.

4 is another example of an internal block diagram of the display apparatus of FIG. 1.

Referring to the drawings, the display apparatus 100 of FIG. 4 may include a display control apparatus (IPA), a display 180, an input apparatus 185, and the like.

 The display apparatus 100 of FIG. 4 is similar to the display apparatus 100 of FIG. 2, but in the display control apparatus IPA, the control PC CPCb is replaced in place of the control board CB, and the control PC CPCb ), There is a difference in that the sensing unit 195 is provided.

FIG. 5 is an example of an internal block diagram of the display control device of FIG. 4. In particular, it is an example of an internal blow diagram of a control PC (CPC).

Referring to the drawings, the control PC CPCb of FIG. 5 is similar to the control board CB of FIG. 3, except that the sensing unit 195 is separately provided.

6A-6B illustrate various examples of internal block diagrams of the control unit of FIG. 3 or FIG. 5.

First, referring to FIG. 6A, the controller 170 may perform an object distance calculation unit 431, an object detection unit 434, and an object confirmation unit to perform vehicle recognition based on a sensing signal from the vehicle recognition sensor 195a. 436, the target tracking unit 440, and the application unit 450 may be provided.

First, the target distance calculator 431 may receive a transmitted radar signal or a rider signal and a received signal, and perform distance detection and speed detection on the target based on a difference between the transmitted signal and the received signal. .

For example, the target distance calculator 431 may calculate the distance or speed based on the phase difference between the transmission signal and the reception signal.

Next, the target detector 434 may receive the transmitted radar signal or the rider signal and the received signal, and perform distance detection and speed detection on the target based on the difference between the transmitted signal and the received signal.

For example, the target detector 434 may detect the size of the target or the like according to the size of the enlarged area when a part of the received half-band signals increases.

Next, the object verification unit 436 classifies and verifies the detected and separated objects based on the objects detected by the object detection unit 434.

The object tracking unit 440 performs tracking on the identified object. For example, the motion or motion vector of the identified object may be calculated, and the movement of the corresponding object may be tracked based on the calculated motion or motion vector. Accordingly, it is possible to track the confirmed movement of the vehicle.

The application unit 450 may provide various applications for the tracked object. For example, it can be controlled to provide content for the tracked object.

Next, referring to FIG. 6B, the controller 170 may perform an image preprocessing unit 410, a disparity calculating unit 420, and a segmentation unit to perform pedestrian recognition based on a sensing signal from the pedestrian recognition sensor 195b. 432, an object detecting unit 434, an object identifying unit 36, an object tracking unit 440, and an application unit 450 may be provided.

The description of the object detector 434, the object confirmation unit 36, the object tracking unit 440, and the application unit 450 will be omitted with reference to the description of FIG. 6A.

The image preprocessor 410 may receive an image from the camera 195b and perform preprocessing.

In detail, the image preprocessing unit 410 may include noise reduction, rectification, calibration, color enhancement, and color space conversion for the received image. CSC), interpolation, camera gain control, and the like. Accordingly, a clearer image may be obtained than the image photographed by the camera.

The disparity calculator 420 receives an image signal-processed by the image preprocessor 410, and performs stereo matching on a plurality of images or stereo images sequentially received for a predetermined time. A disparity map according to stereo matching is obtained. That is, disparity information about the periphery of the display apparatus 100 may be obtained.

In this case, the stereo matching may be performed in units of pixels or in units of predetermined blocks of the images. On the other hand, the disparity map may refer to a map that numerically represents the disparity information (binocular parallax information) of the image, that is, the left and right images.

The segmentation unit 432 may perform segmentation and clustering in the image based on the disparity information from the disparity calculator 420.

In detail, the segmentation unit 432 may separate a background and a foreground from at least one of the images based on the disparity information.

Next, the object detector 434 may detect the object based on the image segment from the segmentation unit 432.

That is, the object detector 434 may detect an object with respect to at least one of the images based on the disparity information information.

In detail, the object detector 434 may detect an object with respect to at least one of the images. For example, an object can be detected from the foreground separated by image segments.

7A to 7B are views illustrating an appearance of the display apparatus of FIG. 1.

Referring to the drawings, FIG. 7A illustrates a front surface of the display apparatus 100 and FIG. 7B illustrates a rear surface of the display apparatus 100.

The display apparatus 100 may include a sensing unit 195 disposed in the front case CAS and a display 180 under the sensing unit 195.

Meanwhile, the rear surface of the display apparatus 100 may be covered with a rear case BCAS.

8 is an example of a flowchart illustrating a method of operating a display control apparatus according to an exemplary embodiment of the present invention, and FIGS. 9A to 17 are views referred to for describing the operating method of FIG. 7.

Referring to the drawing, the display control apparatus IPA determines whether an external object is within a sensing distance (S810), and if applicable, recognizes the external object (S815).

For example, the vehicle recognition sensor 195a in the sensing unit 195 may output a radar signal or a rider signal and receive a reflection signal reflected on an object.

The vehicle recognition sensor 195a or the controller 170 determines that the external object is outside the sensing distance when the level of the reflected signal is less than the first reference value, and detects the external object when the level of the reflected signal is greater than or equal to the first reference value. You can judge that you are within range.

As another example, the pedestrian recognition sensor 195b in the sensing unit 195 may acquire an image.

When the size of the object corresponding to the pedestrian is less than the first predetermined value, the controller 170 determines that the external object is outside the sensing distance, and the size of the object corresponding to the pedestrian is the first small. In the case of an abnormality, it may be determined that the external object is within a sensing distance.

Next, the display control apparatus IPA determines whether the external object is within the viewable area (S820), and if applicable, outputs content corresponding to the recognized external object (S825).

For example, when the vehicle recognition sensor 195a or the control unit 170 has a level of the reflected signal received by the vehicle recognition sensor 195a is greater than or equal to the first reference value and less than the second reference value, the external object may be outside the viewable area. If the level of the reflected signal is greater than or equal to the second reference value, it may be determined that the external object is within the viewable area.

As another example, the controller 170 may analyze the image acquired by the pedestrian recognition sensor 195b and, when the size of the object corresponding to the pedestrian is greater than or equal to the first predetermined value and less than the second reference value, the external object can be viewed. If it is determined that the object is outside, and the size of the object corresponding to the pedestrian is greater than or equal to the second predetermined value, it may be determined that the external object is within the viewable area.

Meanwhile, when the vehicle recognized based on the vehicle recognition sensor 195a or the like is the first vehicle VC1, the controller 170 may provide first content for the first vehicle VC1.

For example, when the display control device IPA is installed at the gas station, the controller 170 may provide gasoline price information for the first vehicle VC1.

Alternatively, when the display control device IPA is installed on a building wall or a roof, the controller 170 may provide a first product advertisement image for the first vehicle VC1.

Alternatively, when the display control device IPA is installed in a public office, the controller 170 may provide first administrative information for the first vehicle VC1.

Meanwhile, when the vehicle recognized based on the vehicle recognition sensor 195a or the like is the second vehicle VC2, the controller 170 may provide second content for the second vehicle VC2.

For example, when the display control device IPA is installed at the gas station, the controller 170 may provide kerosene price information for the second vehicle VC2.

Alternatively, when the display control device IPA is installed on a building wall or a roof, the controller 170 may provide a second product advertisement image for the second vehicle VC1.

Alternatively, when the display control device IPA is installed in a public office, the controller 170 may provide second administrative information for the second vehicle VC2.

Meanwhile, when the pedestrian recognized based on the pedestrian recognition sensor 195b is the first pedestrian PED1, the controller 170 may provide content for the first pedestrian PED1.

For example, when the display control device IPA is installed in a mobile phone store, the controller 170 may provide first mobile phone price information for the first pedestrian PED1.

Alternatively, when the display control device IPA is installed on a building wall or a roof, the controller 170 may provide a second product advertisement image for the first pedestrian PED1.

Alternatively, when the display control device IPA is installed in the church, the controller 170 may provide first information for the first pedestrian PED1.

Meanwhile, when the pedestrian recognized based on the pedestrian recognition sensor 195b or the like is the second pedestrian PED2, the controller 170 may provide second content for the second pedestrian PED2.

For example, when the display control device IPA is installed in a mobile phone store, the controller 170 may provide kerosene price information for the second pedestrian PED2.

Alternatively, when the display control device IPA is installed on the building wall or the roof, the controller 170 may provide a second advertisement image for the second pedestrian PED2.

Alternatively, when the display control device IPA is installed in the church, the controller 170 may provide second information for the second pedestrian PED2.

As described above, by providing various contents according to the recognized external object, the content concentration, the viewer rating, etc. of the external object can be remarkably improved.

Next, the display control apparatus IPA determines whether the external object has left the viewable area (S830), and if so, ends the output of the content corresponding to the recognized external object (S835).

For example, when the display control device IPA is installed at a gas station, the controller 170 provides gasoline price information for the first vehicle VC1, and then the first vehicle VC1 is outside the viewable area. In case of passing the gas station, or the gasoline price information can be terminated. As a result, unnecessary power consumption can be reduced.

As another example, when the display control apparatus IPA is installed in a mobile phone store, the controller 170 provides first mobile phone price information for the first pedestrian PED1, and the first pedestrian PED1 is able to view the viewing area. If out of, or passed by the mobile phone store, the first mobile phone price information can be terminated. As a result, unnecessary power consumption can be reduced.

Meanwhile, the controller 170 may control the output content to vary according to the size or type of the external object, or control the output time, display size, display brightness, display position, or amount of content to be changed. .

Meanwhile, the controller 170 may control the output content to vary according to the approach speed or the approach distance of the external object, or to control the playback time, the display size, the display brightness, the display position, or the amount of the output content to vary. Can be.

Meanwhile, the controller 170 controls to output the first content when the first external object approaches the target recognition area, and outputs the second content when the second external object approaches the target recognition area. The third object may be controlled to output third content when the plurality of external objects approach within the object recognition area.

Meanwhile, when the external object approaches the target recognition area, the controller 170 controls the content corresponding to the external object to be displayed on the display, and corresponds to the output signal output from the sensing unit 195. The sound signal may be added and controlled to be output.

Meanwhile, when the first external object approaches the target recognition area, the controller 170 controls to output the first content, and the first external object approaches the target recognition area more than a predetermined number of times during the first period. In this case, it may be controlled to output content different from the first content.

Meanwhile, the object recognition area may vary according to the recognized approach speed of the external object or the type of the external object.

FIG. 9A is a diagram illustrating that an output signal RES, such as a laser signal or a rider signal, is output from the sensing unit 195 of the display apparatus 100 to reach the first vehicle VC1, which is an external object.

The output signal RES is reflected by the first vehicle VC1, and the sensing unit 195 may receive the reflected signal.

Accordingly, the sensing unit 195 or the control unit 170 may calculate a distance, a position, a speed, and the like of the first vehicle VC1.

In particular, the controller 170 calculates the distance, speed, and magnitude of the external object based on the difference between the output signal and the reflected signal, and based on the calculated distance, speed, and magnitude, the external object, that is, the first The vehicle VC1 can be recognized.

FIG. 9B illustrates that an object detection area, an object recognition area, and the like are divided based on the display apparatus 100 according to the driving of the first vehicle VC1.

Based on the output signal output from the sensing unit 195 and the reflection signal, the range in which the external object can be detected is limited. To this end, as shown in the figure, it may be divided into a target detection area ZN1 and a target recognition area ZN2.

For example, when the first vehicle VC1 is outside the target sensing area ZN1, the level of the reflected signal reflected from the first vehicle VC1 by the output signal output from the display apparatus 100 may be the first. It may be below the reference value.

On the other hand, when the first vehicle VC1 enters the L1 position and enters the target sensing region ZN1 as shown in FIG. 9B, the first vehicle VC1 is output by the output signal output from the display apparatus 100. The level of the reflected signal reflected from may be greater than or equal to the first reference value. Accordingly, the sensing unit 195 or the control unit 170 may perform recognition of the first vehicle VC1.

Next, when the first vehicle VC1 enters the L2 position and enters the target recognition region ZN2 as illustrated in FIG. 9C, the controller 170 may display the first content for the first vehicle VC1. Can provide. Accordingly, the display 180 may display first content for the first vehicle VC1.

FIG. 9C illustrates that gasoline price information 910 and event information 915 are displayed on the display 180 for the first vehicle VC1.

The controller 170 may provide a plurality of contents when the external object is within the object recognition area ZN2. In particular, different contents may be provided according to the distance of the external object. This will be described with reference to FIG. 9D.

FIG. 9D illustrates that only the gasoline price information 910 for the first vehicle VC1 is displayed on the display 180 when the first vehicle VC1 approaches the display apparatus 100 more than in FIG. 9C. Illustrate that.

Even within the object recognition area ZN2, the viewable area of the display 100 may be different. As shown in FIG. 9C, when the entire area of the display 100 is viewable, content may be displayed in the entire area of the display 100, and as shown in FIG. 9D, when a partial area of the display 100 is viewable. In some regions of the display 100, content may be displayed. Accordingly, content viewership is improved and unnecessary content can be prevented.

Next, when the first vehicle VC1 enters the L3 position and leaves the target recognition region ZN2 as shown in FIG. 9E, the controller 170 cannot view the first content, and thus, the first content VC1 may not be able to view the first content. Offer can be terminated. Accordingly, the display 180 may enter a standby mode.

Meanwhile, the controller 170 may control the output content to vary according to the approach speed or the approach distance of the external object, or to control the playback time, the display size, the display brightness, the display position, or the amount of the output content to vary. Can be. This will be described with reference to FIG. 9F.

9F illustrates a case where the target recognition area ZN2 is entered at a faster second speed V2, unlike the first speed V1 of FIG. 9C.

When entering the object recognition area ZN2 at a faster second speed V2, the amount of viewable data may be smaller. Accordingly, the controller 170 may control the amount of displayed content to be smaller than that of FIG. 9C as shown in FIG. 9F.

That is, FIG. 9F illustrates that only the gasoline price information 910 for the first vehicle VC1 is displayed on the display 180.

10A to 10D illustrate that the second vehicle VC2 approaches the display apparatus 100.

First, when the second vehicle VC2 enters the L1 position and enters the target sensing region ZN1 as shown in FIG. 10A, the second vehicle VC2 is output by the output signal output from the display apparatus 100. The level of the reflected signal reflected from may be greater than or equal to the first reference value. Accordingly, the sensing unit 195 or the control unit 170 may perform recognition of the second vehicle VC2.

Next, when the second vehicle VC2 enters the L2 position and enters the target recognition region ZN2 as illustrated in FIG. 10B, the controller 170 may display the second content for the second vehicle VC2. Can provide. Accordingly, the display 180 may display second content for the second vehicle VC2.

FIG. 10B illustrates that kerosene price information 1010 and event information 1015 are displayed on the display 180 for the second vehicle VC2.

The controller 170 may provide a plurality of contents when the external object is within the object recognition area ZN2. In particular, different contents may be provided according to the distance of the external object. This will be described with reference to FIG. 10B.

FIG. 10C illustrates that only the kerosene price information 1010 for the second vehicle VC2 is displayed on the display 180 when the second vehicle VC2 approaches the display apparatus 100 more than FIG. 10B. Illustrate that.

Even within the object recognition area ZN2, the viewable area of the display 100 may be different. 10B, when the entire area of the display 100 is viewable, content may be displayed on the entire area of the display 100, and as shown in FIG. 10C, when a partial area of the display 100 is viewable. In some regions of the display 100, content may be displayed. Accordingly, content viewership is improved and unnecessary content can be prevented.

Next, when the second vehicle VC2 enters the L3 position and leaves the target recognition region ZN2 as shown in FIG. 10D, the controller 170 cannot view the second content, and thus, the second content VC2 may not be viewed. Offer can be terminated. Accordingly, the display 180 may enter a standby mode.

11A to 11D illustrate a plurality of vehicles VC1 and VC2 approaching the display apparatus 100.

FIG. 11A illustrates a case where the plurality of vehicles VC1 and VC2 are within the object sensing area ZN1, and in particular, only the first vehicle VC1 enters the object recognition area ZN2.

Accordingly, the controller 170 may provide first content for the first vehicle VC1 among the plurality of vehicles VC1 and VC2. Accordingly, the display 180 may display first content for the first vehicle VC1.

FIG. 11A illustrates that the gasoline price information 910 for the first vehicle VC1 is displayed on the display 180.

Next, FIG. 11B illustrates a case where both the first vehicle VC1 and the second vehicle VC2 enter the object recognition region ZN2.

Accordingly, the controller 170 may simultaneously provide the first content and the second content for the plurality of vehicles VC1 and VC2. Accordingly, the display 180 may display the first content and the second content for the plurality of vehicles VC1 and VC2.

FIG. 11B illustrates that the gasoline price information 910 for the first vehicle VC1 and the kerosene price information 1010 for the second vehicle VC2 are displayed on the display 180.

Meanwhile, unlike FIG. 11B, when both the first vehicle VC1 and the second vehicle VC2 enter the object recognition region ZN2, in particular, the second vehicle VC2 newly sets the object recognition region ZN2. In case of entering, since the first content has already been provided, it is also possible to provide only the second content among the first content and the second content.

Accordingly, FIG. 11C illustrates that only the kerosene price information 1010 for the second vehicle VC2 is displayed on the display 180.

Next, when the plurality of vehicles VC1 and VC2 enter the L3 position and move out of the target recognition region ZN2 as shown in FIG. 11D, the controller 170 cannot view the contents, so that the contents are not provided. You can exit. Accordingly, the display 180 may enter a standby mode.

In the standby mode, the controller 170 may control the luminance LUMb of the display 180 to be lowered as illustrated in FIG. 11D.

Meanwhile, when the external object approaches the target recognition area, the controller 170 controls the content corresponding to the external object to be displayed on the display, and corresponds to the output signal output from the sensing unit 195. The sound signal may be added and controlled to be output. According to this, since the content can be confirmed by hearing as well as by time, the content recognition rate can be significantly increased. This will be described with reference to FIG. 12.

12 illustrates a case where the first vehicle VC1 enters the target recognition area ZN2.

Accordingly, the controller 170 may provide first content for the first vehicle VC1.

That is, the controller 170 controls the first content for the first vehicle VC1 to be displayed on the display 180 and corresponds to the content in the output signal RES output from the sensing unit 195. The sound signal Sou may be added and controlled to be output.

In particular, the drawing illustrates that the sound signal Sou is added to the carrier signal Car in the output signal RES and output.

Accordingly, the display 180 displays the gasoline price information 910 and the event information 915 for the first vehicle VC1, and the first vehicle VC1 through the speaker of the first vehicle VC1. Gasoline price information 1210 and event information 1215 may be output as sound.

Meanwhile, the carrier signal Car may correspond to a broadcast signal such as a radio frequency or a bidirectional communication signal such as a mobile communication frequency, a Bluetooth frequency, or a Wi-Fi frequency as an RF signal.

When the carrier signal Car corresponds to the broadcast signal and the radio of the first vehicle VC1 is turned on, the gasoline price information 1210 and the event information 1215 for the first vehicle VC1 are transmitted through the speaker. Sound can be output.

Meanwhile, the carrier signal Car corresponds to the bidirectional communication signal, and when the Bluetooth of the first vehicle VC1 is turned on, the first vehicle VC1 approaches the pairable area within the object recognition area ZN2. In this case, based on the pairing signal from the display apparatus 100 and the pairing response signal of the first vehicle VC1, a bidirectional communication connection is established, and according to the sound signal Sou added to the carrier signal Car, the speaker Through, the gasoline price information 1210 and the event information 1215 for the first vehicle VC1 may be output as sound.

Meanwhile, the sound signal Sou corresponding to the content of FIG. 12 is added and output, and is applicable to a pedestrian wearing a wireless headset in addition to the vehicle. That is, by communicating with a wireless headset or a mobile terminal worn by a pedestrian instead of a vehicle, advertisement information, event information, and the like for the pedestrian may be output as sound through the wireless headset.

Meanwhile, when the first external object approaches the target recognition area, the controller 170 controls to output the first content, and the first external object approaches the target recognition area more than a predetermined number of times during the first period. In this case, it may be controlled to output content different from the first content. This will be described with reference to FIGS. 13A to 13B.

First, FIG. 13A illustrates gasoline price information 910 and event information 915 for the first vehicle VC1 when the first vehicle VC1 enters the target recognition region ZN2 at a Ta point of time. Illustrates that is displayed on the display 180.

The display apparatus 100 may transmit the first vehicle VC1 recognition information to the server 300 or the like.

In addition, the server 300 or the display apparatus 100 may determine whether the first vehicle VC1 approaches the target recognition area more than a predetermined number of times during the first period.

Next, FIG. 13B illustrates a case where the first vehicle VC1 enters the target recognition region ZN2 at the time Tb.

The server 300 or the display apparatus 100 may include, for example, history information 1310 including the number of times that the first vehicle VC1 approaches a predetermined number of times or more within the target recognition area during the first period, or the like, and the number of times that the vehicle has passed, etc. Phosphorus, special discount gasoline information 1315, and the like can be provided.

Accordingly, the controller 180 can control the display 180 to display the history information 1310 including the number of times passed, the special discounted gasoline information 1315, and the like, which are separate contents at the time point Tb. have.

9A to 13B illustrate content provided mainly as text information. However, the present invention is not limited thereto, and various contents such as still images and videos may be provided. This will be described with reference to FIGS. 14A to 14F.

FIG. 14A illustrates that when the first vehicle VC1 enters the target recognition area ZN2, the first content 1410 for the first vehicle VC1 is displayed on the display 180.

14B illustrates that the second content 1415 is displayed on the display 180 after the first content 1410 when the first vehicle VC1 passes a predetermined time within the object recognition area ZN2. do.

14C illustrates the first vehicle VC1 when the first vehicle VC1 enters the object recognition region ZN2 at a second speed v2 greater than the first speed v1 of FIG. 14A. For example, the first content 1410 is displayed on the display 180.

14D illustrates that the first content 1410 is continuously displayed on the display 180 unlike FIG. 14B when the first vehicle VC1 passes a predetermined time within the object recognition area ZN2. do.

That is, the control unit 170, the faster the access speed of the external object, the shorter the playback time of the output content, the larger the display size of the content, the larger the display brightness, or move the display position upwards To reduce the amount of content.

FIG. 14E illustrates that the third content 1430 for the second vehicle VC2 is displayed on the display 180 when the second vehicle VC2 enters the target recognition area ZN2.

14F illustrates that the third content 1430 is continuously displayed on the display 180 when the second vehicle VC2 has elapsed for a predetermined time within the object recognition area ZN2. Unlike FIG. 14B, the providing time of the provided content may vary according to the recognized object.

On the other hand, the controller 170 analyzes the image acquired by the pedestrian recognition sensor 195b and, when the size of the object corresponding to the pedestrian is greater than or equal to the first predetermined value and less than the second reference value, the external object may be outside the viewable area. If the size of the object corresponding to the pedestrian is greater than or equal to the second predetermined value, it may be determined that the external object is within the viewable area. Regarding the content provided to the pedestrian, the following description will be given with reference to FIG.

FIG. 15A illustrates that an object sensing region, an object recognition region, and the like are divided based on the display apparatus 100 according to the first pedestrian PED1.

Based on the image acquired by the sensing unit 195, a range in which an external object can be detected is limited. To this end, as shown in the figure, it may be divided into a target detection area ZN1 and a target recognition area ZN2.

For example, when the first pedestrian PED1 is outside the target detection area ZN1, the size of the pedestrian object in the image acquired by the pedestrian recognition sensor 195b may be less than the first predetermined value.

On the other hand, when the first pedestrian PED1 enters within the L1 position and enters the target detection area ZN1 as shown in FIG. 15A, the size of the pedestrian object in the image acquired by the pedestrian recognition sensor 195b is the first. It may be more than a predetermined value. Accordingly, the controller 170 may recognize the first pedestrian PED1.

Next, when the first pedestrian PED1 enters within the L2 position and enters the target recognition area ZN2 as shown in FIG. 15B, the controller 170 may provide content for the first pedestrian PED1. Can be. Accordingly, the display 180 may display content for the first pedestrian PED1.

FIG. 15B illustrates that when the first pedestrian PED1 enters the target recognition area ZN2, the first content 1510 for the first pedestrian PED1 is displayed on the display 180.

Next, when the first pedestrian PED1 enters within the L3 position and leaves the target recognition area ZN2 as shown in FIG. 15C, the controller 170 cannot view the first content, and thus, the first content of the first content cannot be viewed. Offer can be terminated. Accordingly, the display 180 may enter a standby mode.

Meanwhile, when the second pedestrian PED2 enters within the L1 position and enters the target detection area ZN1 as shown in FIG. 16A, the size of the pedestrian object in the image acquired by the pedestrian recognition sensor 195b is the first. It may be more than a predetermined value. Accordingly, the controller 170 may recognize the second pedestrian PED2.

Next, when the second pedestrian PED2 enters within the L2 position and enters the target recognition area ZN2 as shown in FIG. 16B, the controller 170 may provide content for the second pedestrian PED2. Can be. Accordingly, the display 180 may display content for the second pedestrian PED2.

FIG. 16B illustrates that when the second pedestrian PED2 enters the target recognition area ZN2, the second content 1520 for the second pedestrian PED2 is displayed on the display 180.

Next, when the second pedestrian PED2 enters within the L3 position and leaves the target recognition area ZN2 as shown in FIG. 16C, the controller 170 cannot view the second content, and thus, the second content of the second content cannot be viewed. Offer can be terminated. Accordingly, the display 180 may enter a standby mode.

Meanwhile, when the plurality of pedestrians PEDS are within the target recognition area ZN2, the controller 170 may provide content for the plurality of pedestrians PEDS.

FIG. 17 illustrates that when the plurality of pedestrians PEDS enter the target recognition area ZN2, the third content 1530 for the plurality of pedestrians PEDS is displayed on the display 180. Accordingly, it is possible to provide customized content for a plurality of pedestrians (PEDS).

Meanwhile, the controller 170 determines whether the pedestrian is watching the display apparatus 100 based on the acquired image, and extends the playing time of the provided content according to whether the pedestrian is watching the display device 100, or is provided. The content may be changed to the content of interest. Accordingly, the content providing effect can be maximized.

Meanwhile, the controller 170 may calculate the gender, age group, number of people, etc. of the pedestrian, and may change the provided content based on the calculated.

Meanwhile, the information obtained from the controller 170 or the calculated information may be provided to the control PC (CPC) or the server 300 and managed by date and time.

On the other hand, the control unit 170 calculates a time when a target such as a pedestrian or a vehicle enters the target recognition area ZN2 and leaves the target recognition area ZN2, that is, the time of staying in the target recognition area ZN2. According to the calculated time, the provided content may be changed, or the reproduction time, display size, display brightness, display position, or amount of content of the output content may be changed.

On the other hand, the controller 170 may calculate the speed, acceleration, or progress direction of the target, such as a pedestrian or a vehicle, and vary the provided content or change the output content according to the speed or the progress direction of the target. The playback time, the display size, the display brightness, the display position, or the amount of content can be controlled to vary.

Meanwhile, the controller 170 may classify the type of vehicle into a passenger car, a bus, a truck, a taxi, or the like, or may classify the vehicle into a gasoline vehicle, a diesel vehicle, a hybrid vehicle, an electric vehicle, a motorcycle, and the like.

Meanwhile, when recognizing a plurality of vehicles or pedestrians, the controller 170 may first recognize vehicles or pedestrians stored in the DB, and may provide content based on the first recognized vehicles or pedestrians.

The controller 170 may control the luminance of the displayed content to vary according to the illuminance detected by the illuminance sensor 195. For example, the controller 170 may control the luminance of the content to increase as the illumination intensity increases.

On the other hand, if a valid sensing signal is not received from the sensing unit 195 for a predetermined time, the controller 170 enters a standby mode and controls the luminance of the display 180 to be lowered, and the sensing unit 195 When the valid sensing signal is received, the standby mode may be terminated to increase the luminance of the display 180.

In particular, when the standby mode ends, the controller 170 may first play a specific advertisement, a logo, and the like, and thereafter, when the recognized object enters the viewable area, the controller 170 may control to provide content according to the recognized object. have.

Alternatively, if a valid sensing signal is not received from the sensing unit 195 for a predetermined time, the controller 170 may enter a standby mode and may repeatedly display a specific advertisement, a logo, or the like. At this time, it is preferable that the display luminance of the specific advertisement, the logo, etc. is lower than in the normal mode.

When the sensing unit 195 receives a valid sensing signal, the sensing unit 195 ends the standby mode, increases the brightness of a specific advertisement, a logo, and the like, and then recognizes the recognized object when the recognized object enters the viewable area. It can be controlled to provide content according to

On the other hand, the controller 170, when providing the content according to the object to be recognized, it is possible to provide a plurality of content, in this case, it can be controlled to play the content in the order of high suitability for the recognized object.

On the other hand, if the object to be recognized is variable and reaches within the viewable area, the controller 170 may stop the reproduction of the first content and control to reproduce the second content for the new object. In this case, the controller 170 may control to perform a natural screen switching.

Next, the controller 170 may vary the playback speed of the content according to the movement speed of the object to be recognized. That is, it can be controlled so that the replay speed is faster or slower.

Meanwhile, the controller 170 may repeatedly provide a specific section when the object to be recognized has a high concentration on a specific section of the reproduced content, and adaptively provide the repeated section.

In order to change the reproduction section of such content, the content is preferably databaseized.

For example, information about a title to be reproduced, a title, a target, a purpose, a reproduction length, a reproduction date, a reproduction time, a repetition number, a reproduction number, a ranking, and the like may be added or separately managed.

In addition, information about an installation place of the display apparatus 100, a recognized object, an action, a movement, a type of object, a total number of objects, and the like may be added or separately managed.

Such database-informed information may be managed by the memory 140 or the control PC (CPC) or the server 300 inside the display apparatus 100.

18 to 23 are examples of flowcharts illustrating a method of operating a display control apparatus according to various embodiments of the present disclosure.

First, referring to FIG. 18, the sensing unit 195 in the display control apparatus IPA according to an embodiment of the present invention determines whether there is an object (S5), and if there is an object, the display control device ( The control unit 170 in the IPA performs an execution mode (S82).

In addition, the sensing unit 195 in the display control device IPA performs object detection and recognition (S10). This will be described with reference to FIG. 19.

On the other hand, the control unit 170 in the display control device IPA determines the content reproduction condition (S70). This will be described with reference to FIG. 21.

Next, the controller 170 in the display control device IPA controls to display the appropriate content based on the object recognized by the sensing unit 195 (S30). This will be described with reference to FIG. 20.

On the other hand, in the fifth step S5, when there is no object, the sensing unit 195 or the control unit 170 in the display control device IPA determines whether a predetermined time has elapsed (S7), and the predetermined time has elapsed. In one case, it may be controlled to enter the standby mode (S82). The contents related to the standby mode will be described with reference to FIG. 23.

On the other hand, the display control apparatus (IPA) can largely perform the detection and recognition of the object, the determination of the object, and control of the object. Recognition of the object will be described with reference to FIG. 19, and determination and control of the object will be described with reference to FIGS. 20 to 23.

19 is a flow chart referenced for sensing and recognizing an object.

First, in a fifth step S5 of FIG. 18, the sensing unit 195 in the display control apparatus IPA may detect whether an object of interest exists in operation S11.

For example, the sensing unit 195 in the display control device IPA may detect that an object appears in the object detection area ZN1.

Next, the sensing unit 195 in the display control apparatus IPA may recognize the type of the object of interest (S12).

For example, recognition and learning may be performed in comparison with information stored in a basic manner to recognize an object such as a vehicle or a person.

On the other hand, the sensing unit 195 in the display control device (IPA) can compare and update the information previously stored in the memo 140 and the like to recognize the type of the object, and if the object is not of interest, the detection and recognition of the object Can be excluded.

For example, when the object of interest is a type of vehicle, the vehicle may be classified into a bus, a truck, a passenger car, a motorcycle, a bicycle, a taxi, and the like.

As another example, when the object of interest is a kind of person, the person may be classified into a gender, a height, a man and woman, a child, a young man, a middle age, an elderly person, an old age, and the like.

Meanwhile, the sensing unit 195 in the display control device IPA may track an object in the object recognition area ZN2.

The object recognition area ZN2 may be a tracking distance of a defined sensor.

On the other hand, the sensing unit 195 in the display control device IPA counts the number of objects in the object recognition region ZN2, and may exclude the object from the object of recognition if it is outside the object recognition region ZN2.

Next, the sensing unit 195 in the display control apparatus IPA may recognize the movement of the object of interest (S21).

For example, the sensing unit 195 in the display control device IPA may recognize a movement, an operation, or a moving distance of the object of interest or a distance from the object to the display device 100. Such information may be used by the controller 170 to determine a start time of playing content.

On the other hand, according to the speed of the object, the movement, operation, or moving distance of the object of interest or the distance from the object to the display device 100 changes in real time, and thus, for example, the sensing unit 195 in the display control device IPA. ) May calculate, in real time, the movement, operation, or movement distance of the object of interest or the distance from the object to the display apparatus 100.

For example, the sensing unit 195 in the display control device IPA may calculate the speed at the start or the stop speed of the object at which the object stops when the object starts. On the other hand, when the object stops at a traffic light, the related content may be played.

On the other hand, the sensing unit 195 in the display control device IPA can calculate the time taken for the object to reach the display device 100, and the time-to-arrival. Based on this, the controller 170 may determine a start time, a play length, a play speed, and the like, of the playback.

Meanwhile, the time it takes for the object to reach the display apparatus 100 may be used as an estimated remaining time of the object of interest in the object recognition area ZN2 and may be changed in real time according to the speed of the object.

Next, the sensing unit 195 in the display control apparatus IPA may recognize the operation of the object of interest (S22).

The sensing unit 195 in the display control device IPA may detect the acceleration of the object, in particular, whether the speed increases or decreases. The information may be used by the controller 170 to determine the effect of the content being played.

For example, if it is determined that there is a change in the operation of the target, the controller 170 may be used to determine a change in the reproduction method later (S61).

In addition, the information may be used by the controller 170 to generate a command such as repeat play, continuous play, slow play, fast play, stop, and follow play.

On the other hand, the sensing unit 195 in the display control device IPA may sense a target, such as drowsy driving, right, left, straight, backward, and the like. Such information may be used by the controller 170 to determine a change in motion of the target, to enter the display apparatus 100, to change lanes, to release sleepiness, or to control a command to change the playback command. Can be used to generate

On the other hand, when the movement information of the same object changes with respect to the content during the content reproduction after the control unit 170 in the display control device IPA receives the information on the movement, the control unit 170 changes the operation of the object. In response to the determination, the display apparatus 100 may be controlled again based on the corresponding information and may be controlled to store the corresponding information in the memory 140.

20 is a diagram referred to for describing control of an object.

Referring to the drawing, the controller 170 in the display control apparatus IPA may determine the corresponding content based on the type of the object from the sensing unit 195 and the recognition information.

The control unit 170 in the display control device IPA may determine whether the target performs a specific operation (S41).

For example, the controller 170 in the display control device IPA may determine whether the target is currently playing content and performing a specific operation.

When performing a specific operation, the controller 170 in the display control device IPA may check the content currently being played (S42).

In addition, the controller 170 of the display control apparatus IPA may compare the specific operation of the recognized object with the object, the purpose, and the like of the content being played (S43) to determine whether or not it is related. If not relevant, the 31 st step S31 may be performed immediately.

If relevant, the control unit 170 in the display control apparatus IPA may perform the reproduction purpose achievement process (S44).

For example, the controller 170 in the display control apparatus IPA may control to store all the information in the memory 140 when deceleration, inter-vehicle distance, lane change, direction change, and the like occur.

Next, the controller 170 in the display control apparatus IPA may change the weight (S45), calculate the content suitability (S46), and update the playlist to control to reflect the achievement of the content reproduction purpose (S47). In addition, after updating the playlist, a thirty-second step S32 may be performed.

Next, the controller 170 in the display control apparatus IPA may perform a calculation for searching for content suitable for the type of object (S31).

For example, the controller 170 in the display control device IPA may calculate the relevance based on the pre-stored type information of the object. For example, when the target is a car, a bus or a passenger car, or when the target is a person, a calculation may be performed to find content according to whether the target is an adult woman.

The control unit 170 in the display control apparatus IPA may select the most relevant content among the retained contents (S32).

For example, the controller 170 in the display control apparatus IPA may score objects and movements and select the most objects and movements and high content.

Specifically, when the target is a bus and enters at a speed of 120 km, the first content is selected, and when the target is a woman in her 20s and 30s and walks facing each other, the second content is selected and five buses enter. In this case, the third content may be selected, and when seven women and two men walk, the fourth content may be selected.

On the other hand, the control unit 170 in the display control device (IPA), when selecting the content by using the movement information and motion information of the target, because the features may be different for each place, object, operation, for the relevance calculation and content selection You can also use learning or AI algorithms.

For example, when the control PC (CPC) transmits data to the server 300, the control PC (CPC) may receive it from the server 300 to drive a learning or AI algorithm, and transmit the result to the control PC (CPC). Accordingly, the control PC (CPC) may receive the result, select the content, and transmit and control the content to the display 180.

In this case, the server 300 may accumulate data transmitted from other control PCs (CPCs), and then use the data after big data of the corresponding area and place after statisticalization.

Meanwhile, depending on the system, the learning or artificial intelligence algorithm may be operated in the display device 100 or the control PC (CPC).

Meanwhile, the server 300 may store all data, content selection results, and statistical data transmitted by the control PC (CPC), and transmit the data to the mobile device of the user if necessary.

Conversely, it is also possible to run the AI algorithm on the control PC (CPC) and send the result to the server 300.

Next, the controller 170 in the display control apparatus IPA filters the contents related to the type of the object based on the type, movement, calculation, and filtering of the object when the fitness score is obtained as a result of the calculation (S31). In operation S33, content suitable for the target may be determined.

For example, the control unit 170 in the display control device IPA may determine the content to be played in order of the goodness of fit score.

Next, the controller 170 in the display control apparatus IPA may generate a content list suitable for the target (S51).

On the other hand, the control unit 170 in the display control device (IPA) may share the content list being played.

Next, the controller 170 in the display control apparatus IPA may calculate a content list playing time for the target (S52).

For example, when the object of interest moves, the entire reproduction time of the content reproduction list may be calculated using the movement information.

Meanwhile, when N contents cannot be played for a given time according to the calculated time to arrival, the N-1 contents may be played or the N contents playback speed may be changed.

Next, the controller 170 in the display control apparatus IPA may control to transmit the selected content from the memory 140 to the image processor 160 (S61) and control to play the selected content (S62).

 The image processor 160 may include a decoder, a scaler, an encoder, an FRC, and the like, and the image processor 160 may reproduce the content to be displayed on the display 180.

That is, the controller 170 may generate a command for the image processor 160 to play the content, and the image processor 160 may play the content and transmit the content to the display 180.

On the other hand, when the target operation is a specific operation, the control unit 170 in the display control apparatus (IPA) may play the updated content playback list corresponding to the target operation or generate a changed playback command to play the corresponding content. have.

For example, the content may be controlled to be repeated playback, continuous playback, slow playback, fast playback, stop, or subsequent playback.

On the other hand, the control unit 170 in the display control device (IPA), since the portion of the effect of the advertisement is generated can be controlled to store information about the object, the content, the operation of the object and the like to the memory (140).

On the other hand, the control unit 170 in the display control device (IPA), when the content playback list of the target is updated, the content is transmitted from the memory 140 to the image processing unit 160, it is to be reproduced to be displayed on the display 180 Can be.

On the other hand, the control unit 170 in the display control device IPA can reproduce the original playlist and the playback command when the target operation is the normal operation.

Next, the controller 170 in the display control device IPA determines whether the object is out of the object detection area ZN1 of the display apparatus 100 or whether the contents of the playlist are all played (S63). If applicable, it may be controlled to store the content list and related information (S64).

Then, the control unit 170 in the display control device IPA can end the content playback on the target (S65).

FIG. 21 is performed when the movement of the object is an emergency in the twenty-first step S21.

Referring to the drawing, the controller 170 in the display control device IPA may determine whether the object is a default situation, an emergency situation, or a general situation at the time of recognizing the movement of the object in the twenty-first step S21.

For example, in an emergency situation (S71a), the control unit 170 in the display control device IPA receives emergency information from the sensing unit 195 or an external communication device, and the emergency content corresponding to the emergency situation is reproduced. It may be controlled to (S72).

For example, an emergency situation may include a disaster situation such as a traffic accident situation, an earthquake or a fire when an emergency vehicle such as a 119 or a police car is dispatched.

As another example, in the case of the default situation (S71b), the control unit 170 in the display control device IPA controls the default content corresponding to the default situation to be played until the default playback command is received and the content for the next target is played. It may be (S73).

Here, the default content may be content selected by the advertiser, or content having the highest suitability for a given period (day / week / month).

As another example, in the normal situation (S71c), the control unit 170 in the display control device (IPA) can select the general or next content playback list (S31).

22 is performed when there is no subject.

Referring to the drawing, the controller 170 in the display control apparatus IPA may determine whether an object exists in the object detection area ZN1, and if so, determine whether a predetermined time has elapsed. (S79).

That is, the controller 170 in the display control device IPA may determine whether an object exists in the object detection area ZN1 for a predetermined time.

If the object does not exist in the object detection area ZN1 for a predetermined time, the controller 170 of the display control device IPA may control to check the preset basic content information (S74b).

At this time, the control unit 170 in the display control device (IPA), if there is a basic content (S74c), selects the corresponding basic content (S74d), if there is no basic content, other content, especially the highest suitability The content can be selected (S74e).

23 is a diagram referred to for describing the standby mode.

Referring to the drawing, the controller 170 in the display control apparatus IPA may control an image when entering the standby mode (S2310).

For example, the controller 170 in the display control apparatus IPA may lower the brightness of the image when the object or the operation signal of the object is not detected for a predetermined time.

Next, the controller 170 in the display control apparatus IPA may determine whether there is a user setting when a predetermined time elapses after the brightness of the image is lowered (S2315).

When there is a user setting, the controller 170 in the display control device IPA may control the display of the content according to the user setting (S2325). For example, specific content may be played back according to a user setting.

On the other hand, if there is no user setting, the controller 170 in the display control device IPA may control the brightness of the screen (S2330).

The control unit 170 in the display control device IPA may reproduce the highest frequency of reproduction, reproduce a designated logo image, or reproduce a specified phrase before controlling the brightness of the screen.

In addition, the controller 170 in the display control apparatus IPA may lower the brightness of the screen (for example, a panel of the display).

On the other hand, the control unit 170 in the display control device (IPA), after a predetermined time elapses after the screen control (S2335), may control to turn off the screen (S2340).

On the other hand, the control unit 170 in the display control device (IPA), if a predetermined time elapses after the screen off (S2345), may control to maintain the standby mode (S2350).

As a result, each component unit in the display control apparatus IPA enters the standby mode. In particular, all units except the interrupt receiving unit of the sensing unit 195 and the control unit 170 (SoC) may be switched to the standby mode.

On the other hand, the control unit 170 in the display control device (IPA), if the target or the operation signal of the target is detected again, restores the brightness of the image to normal, to restore the brightness of the screen to normal, or to a target other than the specific content Can play the content or control the screen to be turned on.

For example, when the controller 170 receives a signal for an object from a sensor in the sensing unit 195, the controller 170 may generate a wake-up signal.

Accordingly, it is possible to apply a wake-up signal and supply power to all blocks in the display control apparatus IPA in the stand-by mode.

On the other hand, the control unit 170 in the display control device (IPA), when the sensor signal is detected in the standby mode may transmit a wake-up signal to the LAN to control the control PC (CPC) to boot.

On the other hand, the control unit 170 in the display control device (IPA) can calculate the content viewing information of the target based on the signal sensed for the target.

For example, when an advertisement is played, the controller 170 in the display control apparatus IPA transmits the content viewing information or the content information about the advertisement to the input device 185 or the mobile device 600, and the advertisement effect information. Can be controlled to transmit.

More specifically, the control unit 170 in the display control device (IPA), if it is determined that the target focuses on the advertisement, the content information having an excellent advertising effect, the content input device 185 or the mobile device 600 Can be sent.

Alternatively, when it is determined that the object does not focus on an advertisement, the controller 170 in the display control device (IPA) may transmit content information having a low advertisement effect to the input device 185 or the mobile device 600. have.

On the other hand, the memory 140 may store information about the content and the context information.

In addition, the memory 140 may store information about a target, a content reproduction list, situation information, and the like.

In this case, the memory 140 may store data in a table. For example, you can save by date or by destination.

On the other hand, when there is an operation related to the content being played (S34), the memory 140 may store information on the object, the content, the operation of the object, etc. since the effect of the advertisement is generated.

On the other hand, the control unit 170 in the display control device (IPA) can provide simple information to the input device 185 that can be displayed.

For example, the controller 170 in the display control device IPA may transmit the main object and the reproduced content information to the input device 185 for each day / week / month.

Meanwhile, the input device 185 may not be provided in the display device 100 according to the system.

Meanwhile, the server 300 or the mobile terminal 600 may provide a statistical service.

To this end, information stored in the memory 140 of the controller 170 or the control PC may be transmitted to the server server 300 or the mobile terminal 600.

The server 300 or the mobile terminal 600 may perform statistical calculation on the object and the content in the server 300.

For example, the server 300 or the mobile terminal 600 may be classified into contents having an advertising effect, contents having no advertising effect, contents requiring an advertisement modification, contents requiring an advertisement method change, contents recommendation, and the like. have.

Meanwhile, the server 300 may transmit the playback information or notification information of the display apparatus 100 to the mobile terminal 600, and the mobile terminal 600 may display the received playback information or notification information.

Meanwhile, the content to be played on the display apparatus 100 may be transmitted from the mobile terminal 600 to the server 300.

Accordingly, the content is stored in the server 300 according to the user's account, the content is transmitted from the server 300 to the display device 100, and the received content is stored in the memory 140 of the display device 100. Can be. Accordingly, the content desired by the user can be displayed on the display apparatus 100 under the control of the display control apparatus IPA.

On the other hand, the data field of the content stored in the memory 140, the server 300, the control PC (CPC), etc., is set to facilitate the calculation to select and play the content in the control unit 170, etc. It is preferable.

Accordingly, the data field of the content may be divided into an input prohibition field B, a hidden field H that is not visible to the customer, and the like.

For example, the data field of the content for content DB may include each of the following items. That is, the data field of the contents for the content DB includes title, object, purpose, weight, playable time information, playable region information, play recommendation region information, play count (B), goodness of fit (B), and specific operation. (B) etc. can be provided.

As another example, the data field of the content for management DB may include each of the following items. That is, the data field of the content for the management DB includes the business name (H), the location (H), the recognition target (H), the content list (H), the playback content (H), the operation (H), and the achievement / effect (H). ), Decision making and the like.

Meanwhile, the contents of FIGS. 18 to 23 may be applied to the fixed display device, but may also be applied to the mobile display device. In addition, in the case of a mobile display device, modifications to the contents of FIGS. 1 to 17 may be applied.

Meanwhile, the mobile display device may be mounted inside or outside the vehicle.

The display apparatus 100 may be disposed outside the mobile vehicle, and may detect and recognize a surrounding vehicle or a pedestrian, and display various guide information and advertisement information corresponding to the target vehicle.

On the other hand, when the mobile display device is disposed outside the vehicle, the controller 170 in the display control apparatus IPA according to the embodiment of the present invention may determine whether the playable area or the playable area is present when the content is played. have.

When the content is played, the controller 170 may stop playing the content when the content is not playable, and control the content to be played when the user enters the playable area out of the area.

In detail, the controller 170 may control the display apparatus 100 by checking whether the content is playable based on the information about the position of the mobile display apparatus.

That is, the controller 170 receives the information about the position through the sensing unit 195, the interface unit 130, or a communication unit (not shown), and obtains the position information and the current position of the content obtained from the data stored in the memory 140. It is possible to compare the information about the content, check whether the content can be played back at the current location, and play back the content when the content is playable.

If the content enters the area where the content cannot be played while the content is being played, the controller 170 ends the current content playback and checks whether the content can be played based on the position information of the display device for the next content. You can control the device.

As another example, the controller 170 may control the display apparatus 100 by checking the recommended advertisement region of the content based on the information about the position of the mobile display apparatus.

 That is, the controller 170 receives the information about the position through the sensing unit 195, the interface unit 130, or a communication unit (not shown), and obtains the position information and the current position of the content obtained from the data stored in the memory 140. After comparing the information related to the information, and confirming whether the content can be played at the current position, if the recommended advertisement suitable for playing at the current position, it controls to perform the reproduction of the content in preference to other contents.

If the content enters the area where the content cannot be played while the content is being played, the controller 170 ends the current content playback and checks whether the content can be played based on the position information of the display device for the next content. You can control the device.

Meanwhile, the content reproduction restriction region or the content reproduction recommendation (possible) region may be determined according to the type or attribute of the content.

For example, in order to protect children, the neighborhood of the school may be exemplified as a content reproduction restriction area.

As another example, when the content is sensational or entertainment or gambling or game advertisement, a residential price or the like may be exemplified as a content reproduction restriction area.

On the other hand, the content playback recommendation (possibly) area may be exemplified as a prosthetic area when the content is about garlic.

Such a content reproduction restriction region or a content reproduction recommendation (possible) region may be determined by government / local government regulations.

On the other hand, in the case of a mobile display device, it may be possible to charge advertising costs for the area-based advertising.

For example, when the mobile display device moves in a neighborhood where a store is located, an advertisement may be charged in proportion to the content playback time or the content viewing time.

As another example, when the advertiser selects a specific area that the advertiser wants to advertise and the display device advertises in the area, it may be charged.

On the other hand, billing may be set according to various criteria, for example, when displaying an advertisement, when watching an advertisement, when an advertisement and a consumer interacting, moving to an advertising area, The billing may be based on a visit to an advertisement store, a purchase of an advertisement product, or an online purchase (a determination method is a problem).

The charging information may be calculated by the controller 170 and the calculated charging information may be transmitted to the server 300 or the like. Accordingly, compensation for the content advertisement is possible.

The display control device and the display device having the same according to the embodiment of the present invention are not limited to the configuration and method of the embodiments described as described above, but the embodiments may be implemented in various ways so that various modifications can be made. All or part of the examples may be optionally combined.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims (8)

A memory for storing a plurality of contents;
A sensing unit configured to acquire sensing information about the target of interest when the target of interest enters within a target detection area; And
The display apparatus controls the display device to output content when the object of interest approaches within the object recognition area closer to the object detection area and to terminate the output of the content when the object of interest leaves the object recognition area, based on the sensing information. Determine a type of the target of interest that enters within a target detection area, calculate an estimated remaining time for the target of interest to stay in the target recognition area, generate a content playlist based on the type of the target of interest, and generate the expected remaining time And a controller configured to adjust a play time of the content play list based on the content play list. The method of claim 1, wherein the control unit,
Calculating and updating the estimated remaining time in the target recognition region of the target of interest based on the sensing information in real time,
And if it is determined that the entire contents included in the content reproduction list cannot be reproduced within the expected remaining time, the content reproduction speed is changed or the number of contents to be reproduced is reduced. The method of claim 2, wherein the control unit,
Weighting the plurality of contents based on the sensing information, calculating a suitability of the plurality of contents based on the weighting result, and generating the contents reproduction list in the order of the calculated high suitability. A display control device. The method of claim 3, wherein the control unit,
The content reproduction list is generated by weighting the plurality of contents based on the operation state information of the target of interest.
And determining whether the content of the content being played is achieved according to whether a motion of the object of interest related to the content being played is detected in the object recognition area. The method of claim 4, wherein the control unit,
And updating the content reproduction list by changing a weight given to the content reproduction list and recalculating the suitability based on whether the content being reproduced has been achieved. The method of claim 4, wherein the control unit,
When the motion of the object of interest is detected in a specific section of the content being played, it is determined that the detection object has a high concentration in the specific section, and the specific section of the content being played is repeatedly played. Display control device. The method of claim 4, wherein the control unit,
If the object of interest is a pedestrian and the pedestrian is watching the display device, the playing time of the content being set based on the estimated remaining time is extended or the content being played is set as the content of interest. A display control device. The method of claim 2, wherein the control unit,
A display control device, wherein the content playlist is updated by redefining the suitability of the plurality of contents based on movement or operation of another target of interest detected while playing the content playlist for the target of interest; .

Images