KR20190043718A - Method for allocating spatial power using visual information and apparatus for the same - Google Patents

Abstract

According to an embodiment of the present invention, a spatial power allocation method in a base station is a spatial power allocation method performed in a first communication node using visual information. The method comprises the steps of: collecting visual information of an area where a second communication node requesting spatial power allocation is located; analyzing the visual information to recognize a person, a communication device, and an object in the area where the second communication node is located; analyzing influence of communication performance of the person, the communication device, and the object in a propagation environment to predict a role of the person, the communication device, and the object; and performing the spatial power allocation to the area where the second communication node is located according to a predicted role of the person, the communication device, and the object.

Description

TECHNICAL FIELD [0001] The present invention relates to a spatial power allocation method and apparatus using visual information,

The present invention relates to a power allocation method and apparatus, and more particularly, to a method and apparatus for spatially allocating power using visual information collected by a video apparatus or a sensor.

A training sequence based scheme, a Direction of Arrival (DoA) based scheme, and a reference signal based scheme have been proposed as conventional spatial power allocation schemes using antenna arrays. Such spatial power allocation schemes are based on utilizing time or frequency resources. Therefore, in order to increase the gain through the spatial power allocation scheme, more time or frequency resources must be used, which is difficult to apply in communication environments such as high-speed wireless transmission and multi-user. In order to achieve optimum performance through the spatial power allocation function, it is necessary to optimize the utilization of time or frequency resources or to prevent waste of existing resources by using information of other domains.

SUMMARY OF THE INVENTION [0008] In order to solve the above problems, A method and apparatus for spatially allocating power using visual information collected from a video device or a sensor without using time, frequency resources, reference signals, or feedback channels.

According to another aspect of the present invention, there is provided a method for allocating spatial power to a first communication node using visual information, the method comprising the steps of: The method of claim 1, further comprising the steps of: collecting visual information; analyzing the visual information to recognize a person, a communication device, and an object in an area where the terminal is located; and analyzing the influence of the communication performance of the person, And estimating a role of the person, a communication device, and an object, and performing spatial power allocation to an area where the second communication node is located according to a predicted role of the person, the communication device, and the object .

A method for allocating spatial power in a first communication node according to an embodiment of the present invention is a method for allocating spatial power in a first communication node in a step of analyzing a person, a communication device, and an object using a hypothesis generated through machine learning, Predict role.

The method for allocating spatial power in a first communication node according to an embodiment of the present invention is a method for allocating spatial power to a first communication node in a case where the role of the person, .

A method for allocating space power in a first communication node according to an embodiment of the present invention is a method for allocating space power to a first communication node when a role of the person, Spatial power allocation is performed.

The method of allocating spatial power in a first communication node according to an embodiment of the present invention is a method of allocating spatial power at a level lower than an average power level in the case of a communication obstacle in which the role of the person, .

The method of allocating spatial power in a first communication node according to an embodiment of the present invention collects visual information according to a physical phenomenon in a propagation environment of an area where the second communication node is located in the step of collecting the visual information . Then, the spatial power allocation is performed at a level higher than the average power level in the region where the change in the physical phenomenon exceeds the reference value.

The method of allocating spatial power in a first communication node according to an embodiment of the present invention is characterized in that in the step of analyzing the visual information, a direction, a distance, a position, an interval , Vertical, horizontal, and depth information.

The method for allocating spatial power in a first communication node according to an embodiment of the present invention is characterized in that in the step of collecting the visual information, a plurality of visual information collecting apparatuses are sequentially operated, Arrange the information in chronological order to reduce the time interval between visual information.

The method of allocating spatial power in a first communication node according to an embodiment of the present invention may further include a step of performing spatial power allocation to an area where the second communication node is located, And expanding an area in which spatial power allocation is performed for the second communication node based on visual information around the area.

A method for allocating space power at a first communication node according to an embodiment of the present invention includes the steps of: the communication node transmitting a spatial power allocation request to a second communication node capable of spatial power allocation; Speed and direction information to the second communication node; and receiving from the second communication node a spatial power allocation based on the coordinate, velocity, and direction information of the first communication node.

The method for allocating space power in a first communication node according to an embodiment of the present invention includes the steps of transmitting the power allocation request to the second communication node, Power allocation level information.

The method of allocating spatial power in a first communication node according to an embodiment of the present invention includes the steps of the first communication node transmitting and receiving signals with the second communication node using allocated spatial power, Monitoring the performance of signal transmission and reception with the second communication node; and re-requesting the spatial power allocation if the signal transmission / reception performance is less than a preset reference value.

A method for allocating a spatial power in a first communication node according to an embodiment of the present invention includes the steps of: when the first communication node moves out of an area subjected to spatial power allocation, 2 < / RTI > communication node.

A method for allocating spatial power in a first communication node according to an embodiment of the present invention includes the steps of retransmitting coordinate, velocity and direction information of the first communication node to the second communication node, From the second communication node, a spatial power allocation based on the coordinate, velocity, and direction information of the first communication node.

A method for allocating spatial power at a first communication node according to an embodiment of the present invention includes receiving a spatial power allocation update request from the second communication node after receiving the spatial power allocation from the second communication node Speed and direction information of the first communication node to the second communication node; and transmitting a spatial power allocation based on the coordinate, speed, and direction information of the first communication node retransmitted to the second communication node, Lt; / RTI >

A communication node for performing spatial power allocation according to an exemplary embodiment of the present invention includes a first communication node that performs spatial power allocation using visual information and includes a visual information collecting unit A communication device and an object based on the visual information, a propagation environment of an area where the second communication node is located, a person, a communication device, and an object, and predicts the role of the person, And a communication device that performs spatial power allocation to an area where the second communication node is located according to the predicted role of the person, the communication device, and the object.

In a first communication node that performs spatial power allocation according to an embodiment of the present invention, the visual information collection device may be applied to one or more image devices or one or more sensor-based information collection devices.

A first communication node that performs spatial power allocation according to an exemplary embodiment of the present invention sequentially operates a plurality of video devices or a plurality of sensor-based information collecting devices, arranges visual information in a time sequence, The interval can be reduced.

In a first communication node that performs spatial power allocation according to an embodiment of the present invention, the visual information processing apparatus predicts the roles of the person, the communication device, and the object using hypotheses generated through machine learning.

In a first communication node that performs spatial power allocation according to an embodiment of the present invention, the communication device includes an analog domain based pattern reshapable antenna or a switching based antenna arrangement.

According to the present invention, power can be spatially allocated to a communication device or an antenna using visual information collected from a video device or a sensor without using a time, a frequency resource, a reference signal, or a feedback channel.

According to the present invention, communication efficiency can be increased through a spatial power allocation scheme based on visual information.

According to the present invention, high-level spatial power allocation can be performed in a place where a disaster occurs due to a natural phenomenon, using visual information collected from a video device or a sensor.

According to the present invention, it is possible to perform spatial power allocation based on the signal quality information existing in the existing communication standard or system and the visual information collected from the visual information collecting apparatus, without using a separate time or frequency resource or generating a feedback channel. can do.

According to the present invention, it is possible to improve the gain of spatial power allocation by arranging a plurality of visual information collecting apparatuses and recognizing and analyzing the propagation environment on the basis of more visual information.

According to the present invention, by including the machine learning function for analyzing visual information and propagation environment, it is possible to self-learn the result of the spatial allocation method for various spatial information, communication apparatus, communication method or scenario in the radio wave environment, An optimum spatial allocation scheme can be derived.

1 is a conceptual diagram showing a first embodiment of a communication system.
2 is a block diagram showing a first embodiment of a communication node constituting a communication system.
3 is a diagram illustrating a spatial power allocation apparatus according to an embodiment of the present invention.
4 is a diagram showing an example of recognizing an object, an object, and a physical phenomenon based on a one-dimensional basis.
FIG. 5 is a diagram showing an example of recognizing an object, an object, and a physical phenomenon based on a two-dimensional basis.
6 is a diagram illustrating an example of recognizing an object, an object, and a physical phenomenon based on a three-dimensional basis.
7 is a flowchart showing a machine learning method of the visual information processing apparatus.
8 is a diagram showing the visual information processing apparatus shown in Fig.
9 is a diagram showing an interface between a visual information processing apparatus and a communication apparatus.
10 is a diagram showing an example in which a visual information collecting device and a visual information processing device are configured for each communication device.
11 is a diagram showing a spatial coordinate system arranging unit.
12 is a diagram for explaining the operation of the visual information collecting device, the visual information processing device, and the communication device.
Fig. 13 is a diagram showing that one visual visual information collecting and processing device is connected to two communication devices. Fig.
14 is a diagram showing an interface between one visual visual information collecting and processing device and two communication devices.
15 is a diagram showing a spatial coordinate system arrangement unit arranged in each of the two communication apparatuses shown in FIG.
16 is a diagram showing three visual information collecting and processing devices and two communication devices connected to each other.
17 is a diagram showing various embodiments in which a visual information collecting and processing device and a communication device are connected.
18 is a diagram showing an example of recognizing the propagation environment or the propagation environment.
19 is a diagram showing an example of a distributed antenna disposed in a spatial power allocation apparatus.
20 is a diagram showing a method of collecting visual information in the visual information collecting apparatus.
21 is a diagram showing a spatial power allocation method.
22 is a diagram showing an example in which visual information collection is applied to an office environment.
23 is a diagram showing the result of spatial power allocation to the office environment of FIG. 22. FIG.
24 is a diagram showing an example in which visual information collection is applied to the hallway environment.
FIG. 25 is a diagram showing the result of spatial power allocation in the hallway environment of FIG. 24. FIG.
26 is a diagram showing an example in which visual information collection is applied to a road environment.
Fig. 27 is a diagram showing a result of spatial power allocation to the road environment in Fig. 26; Fig.
Fig. 28 is a diagram showing an example in which visual information collection and spatial power allocation are applied to a venue; Fig.
29 is a diagram showing an example in which visual information collection and spatial power allocation are applied to a field of play.
30 is a diagram showing an example in which visual information collection and spatial power allocation are applied to houses.
31 is a diagram showing an example of predicting the position of a moving object.
32 is a diagram showing an example of collecting visual information by applying a plurality of visual information collecting apparatuses.
33 is a diagram showing a method for improving the speed of visual information collection by applying a plurality of visual information collecting apparatuses.
34 is a diagram illustrating a method of allocating power to a communication device or antenna for which spatial power allocation is desired.
Fig. 35 is a diagram showing an example of the element space constituting the propagation environment of Fig. 34. Fig.
36 is a diagram of a first embodiment of an initial entry of a spatial power allocation operation.
37 is a diagram of a second embodiment of an initial entry of a spatial power allocation operation.
38 is a diagram of a third embodiment of an initial entry of a spatial power allocation operation.
39 is a diagram illustrating a spatial power allocation method according to the first embodiment of the present invention.
40 is a diagram illustrating a spatial power allocation method according to a second embodiment of the present invention.
41 is a diagram illustrating a spatial power allocation method according to a third embodiment of the present invention.
42 is a diagram illustrating a spatial power allocation method according to a fourth embodiment of the present invention.
43 is a diagram showing a first embodiment for handling a failure of spatial power allocation.
Figure 44 is a diagram illustrating a second embodiment for handling the failure of spatial power allocation.
45 is a diagram showing a third embodiment for handling the failure of spatial power allocation.
46 is a diagram showing a fourth embodiment for handling the failure of spatial power allocation.
47 is a diagram showing an extension of a space in which visual information can be acquired by adding a visual information collecting device.
48 is a diagram showing an example of a method of expanding a space in which visual information can be acquired by adding a visual information collecting device.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the relevant art and are to be interpreted in an ideal or overly formal sense unless explicitly defined in the present application Do not.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In order to facilitate the understanding of the present invention, the same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

1 is a conceptual diagram showing a first embodiment of a communication system.

1, a communication system 100 includes a plurality of communication nodes 110-1, 110-2, 110-3, 120-1, 120-2, 130-1, 130-2, 130-3, 130-4, 130-5, and 130-6. Here, the communication system 100 may be referred to as a " communication network ". Each of the plurality of communication nodes may support at least one communication protocol. For example, each of the plurality of communication nodes may be a wireless communication device based on a communication protocol based on a code division multiple access (CDMA) communication protocol, a communication protocol based on a wideband CDMA (WCDMA), a communication protocol based on a time division multiple access (TDMA) based communication protocol, an orthogonal frequency division multiplexing (OFDM) based communication protocol, an OFDMA (orthogonal frequency division multiple access) based communication protocol, a single carrier-FDMA based communication protocol, a non-orthogonal multiple access-based communication protocol, and a space division multiple access (SDMA) -based communication protocol. Each of the plurality of communication nodes may have the following structure.

2 is a block diagram showing a first embodiment of a communication node constituting a communication system.

Referring to FIG. 2, the communication node 200 may include at least one processor 210, a memory 220, and a transceiver 230 connected to the network to perform communication. The communication node 200 may further include an input interface device 240, an output interface device 250, a storage device 260, and the like. Each component included in the communication node 200 may be connected by a bus 270 and communicate with each other.

The processor 210 may execute a program command stored in at least one of the memory 220 and the storage device 260. The processor 210 may refer to a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods in accordance with embodiments of the present invention are performed. Each of the memory 220 and the storage device 260 may be constituted of at least one of a volatile storage medium and a nonvolatile storage medium. For example, the memory 220 may comprise at least one of read-only memory (ROM) and random access memory (RAM).

Referring again to FIG. 1, the communication system 100 includes a plurality of base stations 110-1, 110-2, 110-3, 120-1, 120-2, a plurality of user equipments ) 130-1, 130-2, 130-3, 130-4, 130-5, and 130-6. Each of the first base station 110-1, the second base station 110-2 and the third base station 110-3 may form a macro cell. Each of the fourth base station 120-1 and the fifth base station 120-2 may form a small cell. The fourth base station 120-1, the third terminal 130-3 and the fourth terminal 130-4 may belong to the coverage of the first base station 110-1. The second terminal 130-2, the fourth terminal 130-4 and the fifth terminal 130-5 may belong to the coverage of the second base station 110-2. The fifth base station 120-2, the fourth terminal 130-4, the fifth terminal 130-5 and the sixth terminal 130-6 may belong to the coverage of the third base station 110-3 . The first terminal 130-1 may belong to the coverage of the fourth base station 120-1. The sixth terminal 130-6 may belong to the coverage of the fifth base station 120-2.

Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1 and 120-2 includes a Node B, an evolved Node B, a base transceiver station (BTS) A radio base station, a radio transceiver, an access point, an access node, a roadside unit (RSU), a radio remote head (RRH), a transmission point (TP) , A transmission and reception point (TRP), a relay node, and the like. Each of the plurality of terminals 130-1, 130-2, 130-3, 130-4, 130-5, and 130-6 includes a terminal, an access terminal, a mobile terminal, May be referred to as a station, a subscriber station, a mobile station, a portable subscriber station, a node, a device, and the like.

A plurality of communication nodes 110-1, 110-2, 110-3, 120-1, 120-2, 130-1, 130-2, 130-3, 130-4, 130-5, Each may support cellular communication (e.g., long term evolution (LTE), LTE-A (advanced), etc. defined in 3GPP standards). Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1, and 120-2 may operate in different frequency bands, or may operate in the same frequency band. Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1 and 120-2 may be connected to each other via an ideal backhaul or a non-ideal backhaul, Or non-idle backhaul. Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1, and 120-2 may be connected to a core network (not shown) through an idle backhaul or a non-idle backhaul. Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1, and 120-2 transmits a signal received from the core network to the corresponding terminals 130-1, 130-2, 130-3, 130 130-2, 130-3, 130-4, 130-5, and 130-6, and transmits the signals received from the terminals 130-1, 130-2, 130-3, 130-4, Lt; / RTI >

Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1, and 120-2 can support downlink transmission based on OFDMA, and uplink ) Transmission. Also, each of the plurality of base stations 110-1, 110-2, 110-3, 120-1, and 120-2 may perform multiple input multiple output (MIMO) transmission (for example, MIMO, MIMO, MIMO, Coordinated Multipoint (CoMP), Carrier Aggregation, Unlicensed Band, Device to Device (D2D) ) Communication (or proximity services (ProSe)). Each of the plurality of terminals 130-1, 130-2, 130-3, 130-4, 130-5, and 130-6 includes base stations 110-1, 110-2, 110-3, and 120-1 , 120-2, and operations supported by the base stations 110-1, 110-2, 110-3, 120-1, and 120-2.

For example, the second base station 110-2 can transmit a signal to the fourth terminal 130-4 based on the SU-MIMO scheme, and the fourth terminal 130-4 can transmit a signal based on the SU-MIMO scheme And may receive a signal from the second base station 110-2. Alternatively, the second base station 110-2 may transmit a signal to the fourth terminal 130-4 and the fifth terminal 130-5 based on the MU-MIMO scheme, the fourth terminal 130-4, And the fifth terminal 130-5 may receive signals from the second base station 110-2 by the MU-MIMO scheme. Each of the first base station 110-1, the second base station 110-2 and the third base station 110-3 can transmit a signal to the fourth terminal 130-4 based on the CoMP scheme, The terminal 130-4 can receive signals from the first base station 110-1, the second base station 110-2, and the third base station 110-3 by the CoMP method. Each of the plurality of base stations 110-1, 110-2, 110-3, 120-1, and 120-2 includes terminals 130-1, 130-2, 130-3, 130-4, 130-5, and 130-6) and a carrier aggregation scheme. Each of the first base station 110-1, the second base station 110-2 and the third base station 110-3 coordinates D2D communication between the fourth terminal 130-4 and the fifth terminal 130-5, the fourth terminal 130-4 and the fifth terminal 130-5 may be coordinated by the coordination of the second base station 110-2 and the third base station 110-3, Can be performed.

3 is a diagram illustrating a spatial power allocation apparatus according to an embodiment of the present invention.

Referring to FIG. 3, a spatial power allocation apparatus 1000 according to an embodiment of the present invention may include a visual information collection apparatus 1100, a visual information processing apparatus 1200, and a communication apparatus 1300. The visual information processing apparatus 1200 includes a spatial coordinate sorting unit 1210, an information storage unit 1220, a machine learning unit 1230, an information analysis unit 1240, and a control unit 1250. The communication device 1300 may include a communication unit 1310, an antenna control module 1320, and an antenna unit 1330. The communication unit 1310 includes the communication unit 1310, the antenna control module 1320 and the antenna unit 1330. The communication unit 1310 includes the communication unit 1310, the antenna control module 1320, and the antenna unit 1330, Each may be arranged in a separate configuration.

The propagation environment can include objects, objects, physical phenomena (light, fire, smoke, water) that are shaped, colored or colored. In the present invention, a multi-dimensional-based propagation environment is shown as a rectangle to help understand the propagation environment.

The visual information collection device 1100 may include a video device (e.g., a camera) or a sensor based information collection device (e.g., an ultrasonic sensor, an infrared sensor, a radar, a rider). This visual information collection device 1100 collects visual information where the communication device (e.g., terminal or antenna) requesting spatial power allocation is located. Here, the visual information includes image information photographed through the image device and visual sensing information collected through the sensor-based information collecting device.

By way of example, the visual information collection device 1100 collects visual information according to the amount of objects, objects, physical phenomena (light, fire, smoke, water) and physical phenomena in the propagation environment.

Here, the visual information collecting apparatus 1100 may be composed of one imaging apparatus or one sensor-based information collecting apparatus. In this case, the visual information collecting apparatus 1100 can collect visual information of the entire radio wave environment using one image sensor or one sensor-based information collecting apparatus.

As another example, the visual information collection device 1100 may be composed of a plurality of image devices or a plurality of sensor-based information collection devices. In this case, the visual information collection device 1100 can classify the propagation environment for each of a plurality of image devices, and collect visual information using each image device. Meanwhile, the visual information collecting device 1100 may classify the propagation environment for each of the plurality of sensor-based information collecting devices, and collect the visual information using the respective sensor-based information collecting devices.

As another example, the visual information collection device 1100 may be comprised of one or more imaging devices and one or more sensor-based information collection devices. In this case, the visual information collection device 1100 may divide the propagation environment into one or more image devices and one or more sensor-based information collection devices, and use the respective image devices and the respective sensor-based information collection devices to acquire visual information Can be collected.

In addition, the visual information collection device 1100 includes a visual range control function such as enlarging, reducing, and changing a point of view. In addition, the visual information collection device 1100 includes an information collection mode control function such as heat, light, temperature, electromagnetic waves, and the like.

The visual information collecting apparatus 1100 transmits the collected visual information periodically or non-periodically to the visual information processing apparatus 1200.

The visual information processing apparatus 1200 may include a spatial coordinate system sorting unit 1210, an information storage unit 1220, a machine learning unit 1230, an information analysis unit 1240, and a control unit 1250.

The information storage unit 1220 stores the visual information periodically or aperiodically received from the visual information collection apparatus 1100 and transmits the visual information to the information analysis unit 1240. Here, the information storage unit 1220 may include an information database for information storage or machine learning for analyzing visual information, an information updating function, and an interface function with an external device.

4 is a diagram showing an example of recognizing an object, an object, and a physical phenomenon based on a one-dimensional basis. FIG. 5 is a diagram showing an example of recognizing an object, an object, and a physical phenomenon based on a two-dimensional basis. 6 is a diagram illustrating an example of recognizing an object, an object, and a physical phenomenon based on a three-dimensional basis.

4 to 5, the information analyzing unit 1240 may include a function of recognizing the radio wave environment and a function of analyzing the radio wave environment.

The information analyzing unit 1240 can recognize the propagation environment based on the received visual information. That is, the information analyzing unit 1240 can recognize an object, an object, a physical phenomenon, and the like based on the received visual information.

Here, when analyzing the propagation environment, the information analyzing unit 1240 can recognize symmetry and asymmetry of objects, objects, and physical phenomena in one dimension, as shown in FIG.

In analyzing the propagation environment, the information analyzer 1240 can recognize symmetry, asymmetry, and geometric arrangement of objects, objects, and physical phenomena in two dimensions as shown in FIG.

In analyzing the propagation environment, the information analyzing unit 1240 can recognize that symmetry, asymmetry, symmetry and asymmetry of objects, objects, and physical phenomena are combined in three dimensions as shown in FIG.

Specifically, the information analyzing unit 1240 can recognize objects, objects, and physical phenomena based on the visual information received from the visual information collecting apparatus 1100 through shapes, materials, or colors.

The information analyzing unit 1240 can recognize objects, objects, and physical phenomena based on visual information received from the visual information collecting apparatus 1100 through recognition of visual changes such as shape, color, light source, and movement.

The information analyzing unit 1240 can recognize changes in physical phenomena (light, fire, smoke, water) and physical phenomena based on the visual information received from the visual information collecting apparatus 1100. Here, the recognition of physical phenomena is for recognizing light, fire, smoke and water caused by a fire or a natural disaster. It recognizes the occurrence and amount of light, fire, smoke and water, The spatial power allocation can be increased and smooth communication can be provided to the terminal located there. By way of example, the information analysis unit 1240 may recognize a disaster based on changes in the amount of light, fire, smoke, and water. The communication device 1300 may then perform spatial power allocation to a level greater than the average power level for the area where the disaster occurred.

However, the present invention is not limited to this, and a second communication node (e.g., a base station or a terminal) that desires spatial power allocation to a visual information collecting apparatus 1100 (first communication node) capable of allocating spatial power can use a light source To request spatial power allocation. In this case, the first communication node may perform positioning, power level selection, and spatial power allocation of the second communication node requesting spatial power allocation through light source recognition and analysis.

The information analyzer 1240 can acquire spatial information such as directions, distances, positions, intervals, vertical, horizontal, depth, and the like on the basis of the visual information received from the visual information collecting apparatus 1100 have.

Here, the visual information received from the visual information collection device 1100 includes the visual information collected through the imaging device and / or the visual sensing information collected through the sensor-based information collection device.

3, the communication unit 1310 is a device capable of communication (transmission / reception), and can be applied to a transmission mode, a base station, a terminal, a cellular / WLAN / WPAN, .

The antenna portion 1330 may include a single antenna or a multiple antenna arrangement and may include an analog domain based reconfigurable antenna or a switching based antenna selection.

The antenna control unit 1320 may include hardware (e.g., control circuitry) and software for controlling the antenna in an analog domain or switching basis. Hereinafter, an analog domain-based antenna control scheme and a switching-based antenna control scheme will be described.

When the communication device 1300 includes the antenna control unit 1320, the antenna unit 1330 can perform spatial power allocation in the following four ways.

1) A method in which the antenna control unit 1320 receives a control signal from the visual information processing apparatus 1200 and allocates power based on the analog domain based on the received control signal.

2) The communication unit 1310 receives control information from the visual information processing apparatus 1200, object information (first information) in the propagation environment, role information (second information) of the object obtained through system and communication standard- Related timing information (including third information and synchronization-related signals), and allocates power based on the digital domain based on the received control signal and the first to third information.

3) The communication unit 1310 receives the control signal from the visual information processing apparatus 1200, the object information (first information) in the propagation environment, the role information (second information) of the object obtained through the system and communication standard- Related timing information (including third information and synchronization-related signals), and allocates power based on the analog domain based on the received control signal and the first to third information.

4) The communication unit 1310 receives the control signal from the visual information processing apparatus 1200, the object information (first information) in the propagation environment, the role information (second information) of the object obtained through the system and communication standard- Related timing information (including third information and a synchronization-related signal), and allocates power in a hybrid (analog + digital) form based on the received control signal and the first to third information.

On the other hand, when the antenna control unit 1320 is not included in the communication apparatus 1300, the antenna unit 1330 can perform spatial power allocation in the following manner.

5) The communication unit 1310 receives the control signal from the visual information processing apparatus 1200, the object information (first information) in the propagation environment, the role information (second information) of the object obtained through the system and communication standard- Related timing information (including third information and synchronization-related signals), and allocates power based on the digital domain based on the received control signal and the first to third information.

7 is a flowchart showing a machine learning method of the visual information processing apparatus. 8 is a diagram showing the visual information processing apparatus shown in Fig.

7 and 8, the machine learning unit 1230 of the visual information processing apparatus 1200 performs learning to generate a hypothesis used for recognition and analysis of a radio wave environment, 1240). Then, the information analysis unit 1240 can predict recognition and role based on the generated hypothesis.

The role of objects, objects, and physical phenomena can be defined to distinguish between what roles, objects, and physical phenomena in a radio environment affect communication performance.

According to the analysis of the propagation environment performed by the information analysis unit 1240, spatial power allocation according to the predicted role of objects, objects, and physical phenomena is performed by recognizing objects, objects, and physical phenomena. For example, various roles can be defined, such as an object (communication instruction) that directly helps communication, an object that obstructs communication (communication obstacle), and an indirect assistance object (communication aid). Here, the spatial power allocation may be performed for each role of the predicted object, and the spatial power allocation may be performed in the communication device 1300. [ However, the present invention is not limited to this, and spatial power allocation may be performed for each role of the predicted object in the visual information processing apparatus 1200. [

The information analysis function performed by the information analysis unit 1240 can be designed or configured based on machine learning, and FIG. 7 shows a flowchart of the machine learning and information analysis.

As shown in FIG. 7, the information analyzer 1240 predicts output data corresponding to the input data, based on hypotheses learned through the data trained in the machine learning unit 1230.

More specifically, the machine learning unit 1230 When the training data is input (S10), the role of objects, objects, and physical phenomena can be learned through the learning algorithm (S20). The machine learning unit 1230 provides the information analysis unit 1240 with learning results (hypotheses) about the roles of objects, objects, and physical phenomena.

The information analysis unit 1240 then substitutes the input data from the information storage unit 1220, that is, the visual information from the visual information collection apparatus 1100 and the information from the communication apparatus 1300, into the learning result (hypothesis) (S30).

Then, the information analysis unit 1240 generates a role determination or a prediction result (hypothesis) of an object, an object, and a physical phenomenon, and outputs it as output data (S40).

Here, the machine learning unit 1230 can perform learning by recognizing an empty space such as air as a specific object. Since the roles of the same objects, objects, and physical phenomena may vary with time, the machine learning unit 1230 can define and update the roles of objects, objects, and physical phenomena. The machine learning unit 1230 can learn the roles of objects, objects, and physical phenomena by reflecting systems and communication standards such as the operating frequency, bandwidth, antenna specifications and performance of the communication device 1300, communication network, and the like.

Specifically, the machine learning unit 1230 can perform role definition and role definition update for objects, objects, and physical phenomena according to a system, a communication standard, a communication environment, a communication state, and the like.

In addition, the machine learning unit 1230 can set the learning objective for various communication performance enhancements such as improvement of signal quality, increase of power efficiency, adjustment of communication area, reduction of shaded area, and expansion of coverage.

In addition, the machine learning unit 1230 can learn the roles of objects, objects, physical phenomena, etc. existing in the propagation environment.

In addition, the machine learning unit 1230 may generate a role determination or a prediction result (hypothesis) of an object, an object, a physical phenomenon, etc. through role learning and provide the determination result to the information analysis unit 1240. The machine learning unit 1230 may use the supervised learning method, the unsupervised learning method, the semi-supervised learning method, or the reinforcement learning method, , The role determination of the object, the physical phenomenon, or the prediction result (hypothesis).

Specifically, as shown in FIG. 8, the visual information processing apparatus 1200 can perform machine learning by applying four embodiments, and can predict the recognition and role of objects, objects, and physical phenomena.

Embodiment 1 The visual information processing apparatus 1200 uses visual information of an actual propagation environment received from the visual information collecting apparatus 1100 and information received from the communication apparatus 1300 using only hypotheses obtained through learning of training data The object, the object, the physical phenomenon, etc. can be predicted and the role can be predicted. At this time, the visual information processing apparatus 1200 can receive the signal quality and the communication status information from the communication apparatus 1300. [ The visual information processing apparatus 1200 can receive information from the visual information collecting apparatus 1100 through the external interface of the visual information processing apparatus 1200 as well as the signal quality and communication status information from the communication apparatus 1300. [

Embodiment 2 The visual information processing apparatus 1200 includes the first embodiment and also receives visual information of the actual propagation environment received from the visual information collecting apparatus 1100 and information received from the communication apparatus 1300 You can use it as data to update the learning algorithm or hypothesis.

Embodiment 3) The visual information processing apparatus 1200 uses visual data of the actual propagation environment received from the visual data collecting apparatus 1100 and information received from the communication apparatus 1300 using the training data without learning the training data Generate learned hypotheses. Then, the visual information processing apparatus 1200 can predict the recognition and the role of the object, the object, and the physical phenomenon based on the hypothesis.

Embodiment 4) Based on hypotheses obtained through learning of training data, recognition and role of objects, objects, and physical phenomena can be predicted using only information received from the communication device 1300 without visual information.

8, two pieces of data TD1 and TD2 are transmitted from the information storage unit 1220 to the machine learning unit 1230 as training data. The training data to be applied to the machine learning may be composed of the first data TD1 and the second data TD2. The first data TD1 includes information such as visual information, system and communication standard, signal quality, communication status information, and space information of the communication device. The second data (TD2) includes recognition and role (an accurate value rather than a predicted value, a value to be obtained through such a process ultimately, not a simple learning result) of an object, a thing, a physical phenomenon in the propagation environment .

Here, the machine learning unit 1230 uses training data for both the first data (TD1) and the second data (TD2) when applying the map learning method. In addition, the machine learning unit 1230 uses the first data (TD1) as training data when applying the non-background learning method. In addition, the machine learning unit 1230 can perform a rough learning method that performs both a map learning method and a non-map learning method. In addition, the machine learning unit 1230 may perform an enhancement learning method for performing an evaluation according to a learning result and applying a weight to the evaluation result.

The recognition result and the role prediction value (prediction data) generated by the information analysis unit 1240 based on the hypothesis generated by the machine learning unit 1230 are input to other devices, external device delivery, database construction, analysis of the propagation environment And may be stored in the information storage unit 1220 for the user.

The signal S1 transmitted from the information storage unit 1220 to the controller 1250 includes a control signal for changing the operation mode of the visual information collecting apparatus 110 such as visual range control and information collection mode control.

The spatial coordinate system arranging unit 1210 can convert the spatial coordinates of the visual information and the spatial coordinates of the communication unit 1310 or perform the alignment. In addition, the spatial coordinate system arranging unit 1210 may convert the spatial coordinates of the visual information and the spatial coordinates of the antenna disposed in the antenna unit 1330 or perform the alignment. The spatial coordinate system arrangement unit 1210 may be disposed in the visual information processing apparatus 1200 or in the communication apparatus 1300. [

9 is a diagram showing an interface between a visual information processing apparatus and a communication apparatus.

Referring to FIG. 9, the visual information processing apparatus 1200 transmits recognition information related to objects, objects, physical phenomena, and the like in the propagation environment to the communication apparatus 1300. Also, the visual information processing apparatus 1200 transmits role information of objects, objects, and physical phenomena in the propagation environment to the communication apparatus 1300. In addition, the visual information processing apparatus 1200 transmits a first signal (control signal) to the communication apparatus 1300 for allocating spatial power of the antenna according to the role of objects, objects, physical phenomena, etc. in the propagation environment. In addition, the visual information processing apparatus 1200 transmits a timing signal for spatial power allocation of the antenna to the communication apparatus 1300.

The recognition information transmitted from the visual information processing device 1200 to the communication device 1300 includes not only information on recognition of an object, an object, a physical phenomenon, etc., but also information such as an angle, a position, a distance, Related information. In addition, the domain of the spatial information may have a global or local form depending on the complexity and the device configuration. The recognition information input to the communication apparatus 1300 includes the visual information obtained from the visual information collection apparatus 1100 or the recognition information generated through the information analysis function of the visual information processing apparatus 1200. [

Role information of objects, objects, and physical phenomena is generated as a result of predicting the roles of objects, objects, and physical phenomena in the propagation environment obtained by using the machine learning of the information analysis function of the visual information processing apparatus 1200. Role information of objects, objects, and physical phenomena generated in the visual information processing apparatus 1200 is transmitted to the communication device 1300.

Here, the role of the object, the object, and the physical phenomenon predicted according to the propagation environment or the communication state may change with time, and the role of the object, the object, and the physical phenomenon may be updated by the machine learning.

The visual information processing apparatus 1200 transmits analog domain-based antenna control related information to the antenna control module 1320. At this time, the visual information processing apparatus 1200 transmits the first signal and the second signal to the antenna control module 1320.

The first signal transmitted from the visual information processing apparatus 1200 to the antenna control module 1320 is a control signal for the spatial power allocation of the antenna. Specifically, the first signal is a control signal for spatial power allocation based on the role of objects, objects, and physical phenomena in the actual propagation environment generated through information analysis of the visual information processing apparatus 1200.

The second signal transmitted from the visual information processing apparatus 1200 to the antenna control module 1320 is a timing signal of the first signal (control signal). The antenna control module 1320 can control one or a plurality of antennas disposed in the antenna unit 1330 synchronously or asynchronously based on the timing signals.

The communication device 1300 transmits information such as spatial information, status information, an entire propagation environment, or a specific radio wave environment monitoring request to the visual information processing device 1200. The spatial information of the communication device 1300 may include spatial information such as an angle, a position, a distance, an interval, a movement, a moving direction, a speed, etc. of the communication device, and may further include surrounding visual information.

The status information of the communication device 1300 includes all status, control, and request information used for communication except for the signal quality information (error rate, SNR, SINR, EVM, RSSI, etc.) . As an example of signal quality information, channel quality (CQI), precoder matrix indicator (PMI) and rank indicator (RI) may be applied in case of LTE standard.

The propagation environment monitoring request of the communication device 1300 may include control of the visual information collection device 1100, visual information collection, information analysis process, or an update request related thereto.

The communication device 1300 can perform spatial power allocation in the following three ways.

1) The communication device 1300 may perform analog domain-based spatial power allocation using the antenna control module 1320.

2) The communication device 1300 may perform digital domain-based spatial power allocation based on information received from the visual information processing device 1200.

3) The communication device 1300 may perform spatial power allocation in a hybrid (analog + digital) manner based on the information received from the antenna control module 1320 and the visual information processing device 1200.

Among the three types of spatial power allocation schemes described above, 1) an analog domain-based spatial power allocation scheme means that spatial power allocation is performed through antenna control based on an analog domain. When a separate external interface is arranged in the antenna control module 1320, the visual information processing device 1200 can transmit the visual information analysis result to the antenna control module 1320 without going through the communication part 1310. [ The antenna control module 1320 may perform spatial power allocation of the antenna based on the received visual information analysis result.

Of the three spatial power allocation schemes described above, 2) a digital domain-based spatial power allocation scheme means performing spatial power allocation through digital domain-based signal processing. The spatial power allocation can be performed in the digital adaptive beamforming scheme considering the result of visual information analysis through the configuration of the present invention.

By way of example, communication device 1300 may perform spatial power allocation based on information received from visual information processing device 1200. [ However, the present invention is not limited to this, and the communication apparatus 1300 may integrate information received from the visual information processing apparatus 1200 and information previously held by the communication apparatus 1300, and perform spatial power allocation based on the integrated information You may.

Among the three types of spatial power allocation schemes described above, 3) hybrid spatial power allocation scheme is a combination of the 1) analog domain-based spatial power allocation scheme and 2) digital domain-based spatial power allocation scheme described above. The communication device 1300 may perform spatial power allocation in a hybrid manner.

Objects of spatial power allocation performed in the communication device 1300 are objects, objects, and physical phenomena that are recognized and analyzed by the visual information processing apparatus 1200. At this time, it is possible to perform spatial power allocation differently according to the roles of objects, objects, and physical phenomena based on roles of objects, objects, and physical phenomena.

Here, even one object, an object, or a phenomenon can be recognized as a plurality of detailed objects according to purposes, and the communication apparatus 1300 can perform spatial power allocation differentially for several detailed objects. In addition, the communication device 1300 can perform spatial power allocation differently depending on cases where different objects, objects, and physical phenomena have the same role. In addition, the communication device 1300 may perform spatial power allocation differentially taking into account not only the role of objects, objects, and physical phenomena, but also spatial information such as angle, position, distance, interval, motion, . In addition, when the communication device 1300 has various roles in one object, object, and physical phenomenon, the communication device 1300 can perform spatial power allocation differently according to each role.

10 is a diagram showing an example in which a visual information collecting device and a visual information processing device are configured for each communication device.

Referring to FIG. 10, a visual information collecting apparatus 1100 and a visual information processing apparatus 1200 may be configured for each communication apparatus 1300. However, the present invention is not limited to this, and one visual information collecting apparatus 1100 and one visual information processing apparatus 1200 may be shared by a plurality of communication apparatuses. In addition, a plurality of visual information collecting apparatuses 1100 and a plurality of visual information processing apparatuses 1200 may share one communication apparatus 1200.

In FIG. 10, it is assumed that the propagation environment can be represented by a two-dimensional rectangle, and it is assumed that only three objects exist in the propagation environment. The visual information collection device 1100 collects visual information of the propagation environment and transmits the collected visual information to the visual information processing device 1200. The visual information processing device 1200 recognizes objects, objects, and physical phenomena in the propagation environment based on machine learning. The visual information processing apparatus 1200 defines various roles of objects, objects, and physical phenomena according to systems, communication standards, and the like. The visual information processing device 1200 can also predict three roles of objects in the propagation environment as one of the predetermined roles based on machine learning results, additional visual information, and information received from the communication device 1300.

The communication device 1300 can perform spatial power allocation for each role via the antenna based on the predicted result of the visual information processing device 1200. [

For example, if the communication device 1300 defines a communication instruction, a communication obstacle, and a communication aid as a role of an object, an object, and a physical phenomenon and assumes a power allocation level of three levels, For example, a first level) can be allocated. Then, the communication apparatus 1300 allocates power corresponding to an intermediate level (for example, second level) in the case of the communication aid and allocates power corresponding to the lowest level (for example, the third level in the case of the communication obstacle) can do.

Here, the spatial power allocation level of the communication device 1300 according to the roles of objects, objects, and physical phenomena through the machine learning of the visual information processing apparatus 1200 and the roles of objects, objects, and physical phenomena can be varied Design or configuration is possible. In designing or setting the power allocation level of the communication device 1300, beamforming or nulling may be reflected.

11 is a diagram showing a spatial coordinate system arranging unit.

11, when the spatial coordinates do not match between the visual information collection device 1100 and the antennas of the communication device 1300, the spatial coordinate system arrangement part 1210 and the communication device The spatial coordinate system can be aligned using at least one of the spatial coordinate system arrangements 1340 arranged in the spatial coordinate system 1300. [

The spatial coordinate system arranging unit 1210 arranged in the visual information processing apparatus 1200 arranges the spatial coordinates collected by the visual information collecting apparatus 1100 so as to coincide with the spatial coordinates of the antenna of the communication apparatus 1300 . That is, the spatial coordinate system arranging unit 1210 can arrange the spatial coordinates of the objects of the visual information collecting apparatus 1100 according to the antenna spatial coordinates of the communication apparatus 1300. Conversely, the spatial coordinate system arranging unit 1210 may align the antenna spatial coordinates of the communication device 1300 with the spatial coordinates of the respective objects of the visual information collecting apparatus 1100.

 The spatial coordinate system arranging unit 1340 arranged in the communication apparatus 1300 may also align the spatial coordinates collected by the visual information collecting apparatus 1100 so as to coincide with the spatial coordinates of the antenna of the communication apparatus 1300. Conversely, the spatial coordinate system arrangement unit 1340 may align the spatial coordinates of the antennas of the communication device 1300 with the spatial coordinates of the objects of the visual information collection device 1100.

12 is a diagram for explaining the operation of the visual information collecting device, the visual information processing device, and the communication device.

Referring to FIG. 12, a visual information collecting apparatus 1100 and a visual information processing apparatus 1200 are configured for each communication apparatus 1300 to perform spatial power allocation in a time sequence. It is assumed that the propagation environment can be represented by a two-dimensional rectangle. Role definitions for objects, objects, and physical phenomena are defined as communication indicators (circular shapes), communication aids (triangular shapes), communication obstacles Type. It is assumed that there are three levels of power allocation according to the roles of objects, objects, and physical phenomena, such as blue, middle (green), and bottom (red). As shown in FIGS. 4 to 6, it is assumed that recognition results based on a grid structure are derived to help urbanization, although recognition results of objects, objects, and physical phenomena may vary due to visual information acquired over time. 12, one domain can be classified into one recognition object, and the number and type of roles can be changed according to time, but they are shown based on a section that does not change. In addition, spatial power allocation according to role prediction obtained through machine learning is shown to be performed immediately. Here, not only visual information but also various information received by the communication device 1300 can be used for recognition and role prediction through machine learning.

The visual information collecting device 1100 collects visual information of the propagation environment periodically or aperiodically, and transmits the collected visual information to the visual information processing device 1200. The visual information processing apparatus 1200 performs machine learning based on the received visual information, and recognizes objects, objects, and physical phenomena through machine learning. The total number recognized in FIG. 12 is 20 in the first section, 19 in the second section, 18 in the third section, and 18 in the fourth section. The visual information processing apparatus 1200 performs a machine learning based on a predefined role definition of an object, an object, and a physical phenomenon recognized in the first to fourth sections, Can predict the role of objects, objects, and physical phenomena. The communication device 1300 can perform predetermined spatial power allocation for each object, object, and physical phenomenon according to the predicted results in the first to fourth sections. Here, the communication device 1300 can perform power allocation according to the roles of objects, objects, and physical phenomena in three phases such as blue, middle, and red. That is, the communication apparatus 1300 performs spatial power allocation for the communication instruction (circular figure) in the upper part (blue), performs spatial power allocation for medium (green) for the communication aid (triangular figure) Spatial power allocation can be performed under (red) for obstacles (cross-shaped).

Figure 13 is a diagram showing that one initiating information gathering and processing device is connected to two communication devices. 14 shows an interface between three initiating information collecting and processing devices and two communication devices. 15 is a diagram showing a spatial coordinate system arrangement unit arranged in each of the two communication apparatuses shown in FIG.

Referring to FIGS. 13 to 15, the visual information collecting apparatus 1100 and the visual information processing apparatus 1200 shown in FIG. 10 are integrated into one visual information collecting and processing apparatus 1600. FIG. One visual information collecting and processing apparatus 1600 can be shared by two communication apparatuses 1700 and 1800. At this time, the propagation environment can be composed of the whole propagation environment or the unit propagation environment. One visual information collection and processing apparatus 1600 may include a spatial coordinate system arrangement unit 1610. The first communication device 1700 may include a first communication unit 1710, a first antenna control module 1720, a first antenna unit 1730, and a first spatial coordinate system arrangement unit 1740. The second communication device 1800 may include a second communication unit 1810, a second antenna control module 1820, a second antenna unit 1830, and a second spatial coordinate system arrangement unit 1840.

13, it is assumed that there are three objects in the unit propagation environment. Objects, objects, and physical phenomena recognized by the visual information collecting and processing device 1600 may have the same role in the first communication device 1700 and the second communication device 1800. However, the present invention is not limited to this, and objects, objects, and physical phenomena recognized by the visual information collecting and processing apparatus 1600 may have different roles in the first communication apparatus 1700 and the second communication apparatus 188. Accordingly, the visual information gathering and processing apparatus 1600 may include two machine learning units (not shown) for predicting the roles of objects, objects, and physical phenomena. That is, the first machine learning unit disposed in the visual information collecting and processing apparatus 1600 may correspond to the first communication apparatus 1700, and the second machine learning unit may correspond to the second communication apparatus 1800. [

15, the first spatial coordinate system arranging unit 1740 arranges the first spatial coordinates collected by the visual information collecting and processing apparatus 1600 so as to match the spatial coordinates of the antenna of the first communication apparatus 1700 . That is, the first spatial coordinate system arranging unit 1740 can arrange the spatial coordinates of each object of the visual information collecting and processing apparatus 1600 according to the antenna spatial coordinates of the first communication apparatus 1700.

In addition, the second spatial coordinate system arrangement unit 1840 may align the second spatial coordinates collected by the visual information collection and processing apparatus 1600 with the spatial coordinates of the antenna of the second communication apparatus 1800. [ That is, the second spatial coordinate system arranging unit 1840 can align the spatial coordinates of each object of the visual information collecting and processing apparatus 1600 with the antenna spatial coordinates of the second communication apparatus 1800.

16 is a diagram showing three visual information collecting and processing devices and two communication devices connected to each other.

Referring to FIG. 16, there is shown an example in which three visual information collecting and processing devices 1601, 1602, and 1603 and two communication devices 1700 and 1880 are configured. By configuring one or more visual information gathering and processing devices, e.g., three visual information gathering and processing devices (1601, 1602, 1603) in the entire propagation environment or unit propagation environment, the gain of the analysis area and spatial power allocation Can be improved. The first communication device 1700 and the second communication device 1800 receive visual information from the first and second visual information gathering and processing apparatuses 1602 and 1603 as well as the first visual information gathering and processing apparatus 1601 To perform spatial power allocation.

17 is a diagram showing various embodiments in which a visual information collecting and processing device and a communication device are connected.

17, various configurations of the spatial power allocation apparatus according to the embodiment of the present invention are shown. The spatial power allocating apparatus can be configured such that one visual information collecting and processing apparatus and one communication apparatus correspond to each other. In addition, a spatial power allocation apparatus can be configured such that a plurality of visual information collecting and processing apparatuses and a plurality of communication apparatuses correspond one by one. In addition, a spatial power allocation apparatus can be configured such that a plurality of visual information collecting and processing apparatuses and one communication apparatus are associated with each other. In addition, a spatial power allocation apparatus can be configured such that one visual information collecting and processing apparatus and a plurality of communication apparatuses correspond to each other. In addition, a spatial power allocation apparatus can be configured such that a plurality of visual information collecting and processing apparatuses and a plurality of communication apparatuses share each other.

18 is a diagram showing an example of recognizing the propagation environment or the propagation environment.

As shown in FIG. 18, a region can be defined in one or more dimensions and various forms such as symmetry, asymmetry, geometry, and the like. The visual information processing apparatus 1200 can analyze the propagation environment based on the defined set of regions, and determine or predict the role of each region. The visual information processing apparatus 1200 transmits the prediction result for each area to the communication apparatus 1300 and the communication apparatus 1300 can perform spatial power allocation based on the prediction result for each received area.

19 is a diagram showing an example of a distributed antenna disposed in a spatial power allocation apparatus.

Referring to FIG. 19, a spatial power allocation apparatus 1000 can be configured with M visual information collecting apparatuses 1101 to 110M, one or more visual information processing apparatuses 1200, and one communication apparatus 1300. A Distributed Antenna System (DAS) composed of N antenna sub-arrays may be applied as the antenna unit 1330 of the communication device 1300. [ In Fig. 20, functions and devices related to a distributed antenna system such as an optical device, a router, a central processing unit and the like are not shown.

The distributed antenna system is composed of one or more antenna sub-arrays, and the shape of each antenna sub-array is not limited. For example, the N antenna sub may all be composed of the same antenna, and the N antenna sub may be all different. Also, some of the N antenna subs may be the same, and the remainder may be different from each other.

The combination of the M visual information collecting apparatuses 1101 to 110M and the N antenna sub-arrays may exist in various ways. Hereinafter, the combination of the representative M visual information collecting apparatuses 1101 to 110M and the N antenna sub- I will explain.

One or more visual information processing devices 1200 or antenna control module 1320 may be needed for one or more visual information collection devices 1100 or distributed antenna systems. In FIG. 19, only one visual information processing apparatus 1200 and one antenna control module 1320 are shown.

In FIG. 19, signals transmitted and received between the visual information processing apparatus 1200 and the communication apparatus 1300 are indicated by bold lines. Signals transmitted from the communication unit 1310 in the communication device 1300 to the antenna control module 1320 are indicated by bold lines. In addition, the spatial power allocation can be independently performed for each antenna sub, and signals transmitted to the antenna sub-arrays in the communication unit 1310 and the antenna control module 1320 are represented by different lines to represent the spatial power allocation.

The spatial power allocation of the communication device 1300 can be performed for one or more of the visual information collecting devices 1101 to 110M, the visual information processing device 1200, and the antenna sub-array under the following conditions.

First, the propagation environment of each antenna sub-array can be recognized and analyzed through one or more visual information collecting devices 1101 to 110M.

Second, each visual information collection device 1100 - 110M can recognize and analyze the propagation environment of one or more antenna sub-arrays.

Third, there may be one or more antenna sub-arrays that do not perform propagation environment recognition and analysis among the entire antenna sub-arrays.

The spatial coordinate system alignment functions of the visual information processing device 1200 and the communication device 1300 are the same as those of the spatial coordinate system arrangements 1210, 1740, and 1840 described with reference to FIGS. 11 and 15, .

Even if a distributed antenna system is applied to the spatial power allocation apparatus 1000, the types of signals transmitted and received between the internal configurations of the visual information processing apparatus 1200 may be the same as those applied to a single antenna. Also, even though the distributed antenna system is applied to the spatial power allocation apparatus 1000, the types of signals transmitted and received between the at least one visual information collecting apparatus 1100 to 110M and the visual information processing apparatus 1200 are the same as those in the case of applying a single antenna . Even when the distributed antenna system is applied to the spatial power allocation apparatus 1000, the types of signals transmitted and received between the visual information processing apparatus 1200 and the communication apparatus 1300 may be the same as those in the case of applying a single antenna. Here, since the spatial power allocation may be different for each antenna sub-array, signals transmitted to each antenna sub-array of the antenna unit 1330 in the communication unit 1310 may be different for each antenna sub.

The role definition of objects, objects, and physical phenomena performed in the visual information processing device 1200 and the level of spatial power allocation performed in the communication device 1300 can be predicted or updated as a result of machine learning. By way of example, although any object is assigned a power level, the power level may change over time depending on the propagation environment, system, or communication specification. Therefore, the power allocation level for the power allocation object can be periodically updated through the information analysis function of the visual information processing apparatus 1200. [

The communication device 1300 can perform spatial power allocation in three steps as low, medium, and high. The communication device 1300 can perform a high level spatial power allocation for an object (communication indication) directly contributing to communication. In addition, the communication device 1300 can perform medium level spatial power allocation for objects (communication aids) that indirectly help in communication. In addition, the communication device 1300 can perform low-level spatial power allocation for an object (communication obstacle) that interferes with communication.

Here, a low level of spatial power allocation means allocating power lower than an existing power allocation or average power level. Further, the medium level spatial power allocation means maintaining the existing power allocation or average power level. As another example, a medium level spatial power allocation may mean allocating power that is greater than an existing power allocation or average power level. Also, a high level of spatial power allocation implies allocating power that is greater than an existing power allocation or average power level.

20 is a diagram showing a method of collecting visual information in the visual information collecting apparatus.

Referring to FIG. 20, various examples of collecting visual information about the propagation environment through the spatial power allocation apparatus 1000 according to the embodiment of the present invention are shown. A total of 12 still images were acquired through the visual information collecting device 1100, and it was assumed that there was no visual change during the time interval between each still image. Of the 12 still images, at the time t = k7, both of them are taking the communication device out of the body and using it. At the time t = k8, the communication device used by the person on the right is put into the body and using it. , It is possible to obtain visual information on a situation in which the left person stops using the communication device. The visual information generated in the visual information collecting apparatus 1100 may be transmitted to the visual information processing apparatus 1200 so that recognition of an object, a physical phenomenon, and role prediction in the propagation environment can be performed.

21 is a diagram showing a spatial power allocation method.

Referring to FIG. 21, spatial power allocation in the communication device 1300 based on the visual information in FIG. 20 and the recognition and role prediction of objects, objects, and physical phenomena in the propagation environment transmitted to the visual information processing apparatus 1200 Examples are shown.

As shown in FIG. 21, spatial power allocation can be performed based on visual information without using frequency resources as in the prior art. In particular, visual information can be used to observe and analyze natural disasters such as forest fires and floods. Based on this, it is possible to increase the spatial coverage of the natural disasters, . This will enable disaster communication services to be provided in the event of a disaster.

22 is a diagram showing an example in which visual information collection is applied to an office environment.

22, an example in which the spatial power allocation apparatus 1000 according to the embodiment of the present invention is applied to an office environment has been described.

In the environment in which the spatial power allocation apparatus 1000 is disposed in the center of the ceiling of the office (see left side in FIG. 22), the recognition operation for the propagation environment is performed to determine whether or not the communication apparatus is used through human behavior pattern recognition, And recognition of whether or not to move (see the right side of FIG. 22). A plurality of objects, objects, and physical phenomena can be recognized through the machine learning of the visual information processing apparatus 1200, and persons and communication apparatuses can be recognized appropriately for the internal environment of the office.

23 is a diagram showing the result of spatial power allocation to the office environment of FIG. 22. FIG.

23, in the environment where the spatial power allocation apparatus 1000 is disposed in the center of an office ceiling, visual information of the inside of the office is collected, and the collected visual information is analyzed to capture and track the movement of objects, can do. FIG. 23 shows an example of performing spatial power allocation by capturing and tracking human movements within an office.

24 is a diagram showing an example in which visual information collection is applied to the hallway environment. FIG. 25 is a diagram showing the result of spatial power allocation in the hallway environment of FIG. 24. FIG.

Referring to FIGS. 24 and 25, it is assumed that a space power allocation apparatus 1000 according to an embodiment of the present invention is placed at the end of a corridor inside a building, where two people walk while using a communication apparatus 24). It is possible to predict the use of the communication device by analyzing the behavior pattern of a person through the machine learning function of the visual information processing apparatus 1200 and exposing the communication apparatus to the outside of the person's body. It is also possible to analyze the behavior pattern of a person through the machine learning function of the visual information processing apparatus 1200 to predict that the communication apparatus will be used even if the communication apparatus is not exposed outside the human body (see the right side of FIG. 24).

The visual information processing apparatus 1200 can recognize and predict a role for a plurality of objects, objects, and physical phenomena according to a prediction result, and can transmit the information to the communication device 1300. [ The communication device 1300 can perform a high-level spatial power allocation to the point where the person using the communication device is located based on the information received at the visual information processing device 1200. [

26 is a diagram showing an example in which visual information collection is applied to a road environment. Fig. 27 is a diagram showing a result of spatial power allocation to the road environment in Fig. 26; Fig.

Referring to FIGS. 26 and 27, in an environment in which the spatial power allocation apparatus 1000 according to the embodiment of the present invention is disposed at the center of an intersection, people and communication apparatuses located around the intersection can be recognized and analyzed. It is possible to analyze the behavior pattern of a person through the machine learning function of the visual information processing apparatus 1200 to predict the movement of each person and the use of the communication apparatus. That is, the visual information processing apparatus 1200 can distinguish between a person who uses the communication device and a person who does not use the communication device among a plurality of recognized persons. The visual information processing apparatus 1200 can predict the role of a plurality of objects, objects, and physical phenomena according to a prediction result, and can transmit the information to the communication device 1300. [ The communication device 1300 can perform a high-level spatial power allocation to the point where the person using the communication device is located based on the information received at the visual information processing device 1200. [

Fig. 28 is a diagram showing an example in which visual information collection and spatial power allocation are applied to a venue; Fig. 29 is a diagram showing an example in which visual information collection and spatial power allocation are applied to a field of play. 30 is a diagram showing an example in which visual information collection and spatial power allocation are applied to houses.

28 to 30, there is shown an example in which a spatial power allocation apparatus 1000 according to an embodiment of the present invention is arranged in a performance site, a playground, and a house to perform spatial power allocation.

When the spatial power allocation apparatus 1000 according to the embodiment of the present invention is applied to a theater, the use of the communication apparatuses (spectators) and people (spectators) who desire to use the communication apparatus through the machine learning function of the visual information processing apparatus 1200 You can distinguish people who are unwanted, or who have low requirements (performers). The communication device 1300 performs a high-level spatial power allocation where the people (spectators) who desire to use the communication device are located, and places it at a place where people (performers) who do not want to use the communication device, A low level spatial power allocation can be performed.

In addition, when the spatial power allocation apparatus 1000 according to the embodiment of the present invention is applied to a field of playground, it is possible to prevent the people (spectators) who want to use the communication apparatus through the machine learning function of the visual information processing apparatus 1200, You can distinguish between people who do not want to use them or people who have low requirements (players and referees). The communication device 1300 performs a high level spatial power allocation where the people (spectators) who desire to use the communication device are located, and the people (players and judges) who do not want to use the communication device or who have low requirements A low-level spatial power allocation can be performed for the location where it is located.

In addition, when the spatial power allocation apparatus 1000 according to the embodiment of the present invention is applied to a house, the location and behavior pattern of the communication apparatus and the person can be analyzed through the machine learning function of the visual information processing apparatus 1200 . The communication device 1300 can perform high-level spatial power allocation for a communication device and a place where a person is located, and can obtain a coverage expansion effect by performing spatial power allocation using a result of a movement pattern of a person.

31 is a diagram showing an example of predicting the position of a moving object.

Referring to FIG. 31, in the conventional power allocation scheme, when an object moves fast, the coordinates of an object are separately received, or the position of a moving object is detected based on feedback information, so that the procedure is complicated and frequency resources must be used have. The spatial power allocation apparatus 1000 according to the embodiment of the present invention can detect the position of an object that receives coordinates of an object separately or moves without feedback information. An example of detecting the position of a moving object in an environment where the spatial power allocating apparatus 1000 is disposed around will be described as an example.

The visual information collecting device 1100 collects visual information and interpolates the visual information through the visual information processing device 1200 to detect the position of a moving object and the position where the moving object is to be moved. Particularly, since the moving direction of the vehicle is determined on the road, it is possible to improve the accuracy of the position of the object and the position to be moved.

32 is a diagram showing an example of collecting visual information by applying a plurality of visual information collecting apparatuses. 33 is a diagram showing a method for improving the speed of visual information collection by applying a plurality of visual information collecting apparatuses.

Referring to Figures 32 and 33, there is a possibility of turning left or right when the vehicle passes through an intersection, and this possibility can be achieved by precisely predicting the future position of the vehicle by finely adjusting the interval between visual information have.

For example, a camera disposed at an intersection may be used as the plurality of visual information collecting apparatuses 1100A. However, when collecting visual information with a plurality of cameras rather than collecting visual information with a single camera, . Assuming that the camera generates images at 30 frames per second (30 Hz), when visual information is generated by 10 cameras, if the visual information of the 10 cameras is collected in time order, the image of 300 frames per second . In other words, when visual information is generated with 10 cameras than when one camera generates visual information, the interval of visual information can be reduced to 10 times.

In this way, by applying the plurality of visual information collecting apparatuses 1100A to reduce the intervals of visual information, the visual information processing apparatus 1200 can precisely determine the left or right turn when the vehicle passes the intersection based on such visual information Can be predicted. That is, the visual information processing apparatus 1200 can precisely predict the future position of the vehicle. Thereafter, the communication device 1300 can perform spatial power allocation based on the prediction result of the future position of the vehicle.

34 is a diagram illustrating a method of allocating power to a communication device or antenna for which spatial power allocation is desired. Fig. 35 is a diagram showing an example of the element space constituting the propagation environment of Fig. 34. Fig.

Referring to FIGS. 34 and 35, the element space constituting the propagation environment shown in FIG. 34 is specifically shown in FIG. 35, and the spatial power allocation apparatus 1000 can be disposed at a certain height from the ground . The spatial power allocation apparatus 1000 has analyzed the position of a communication device or an antenna capable of allocating spatial power and performed spatial power allocation for each communication apparatus or antenna. However, without being limited thereto, the spatial power allocation apparatus 1000 may perform spatial power allocation within the propagation environment for each of the communication devices or antennas 2000 desiring spatial power allocation.

36 to 38, various embodiments of an initial entry of a spatial power allocation operation to a communication apparatus or antenna 2000 in which the spatial power allocation apparatus 1000 desires spatial power allocation will be described.

36 is a diagram of a first embodiment of an initial entry of a spatial power allocation operation.

Referring to FIG. 36, an initial entry of a spatial power allocation operation may be performed by transmitting a spatial power allocation request message to a spatial power allocation apparatus 1000 in a communication apparatus or antenna 2000 desiring spatial power allocation (S101) . Here, the spatial power allocation request message may include power allocation level information that the communication apparatus or the antenna 2000 desires to receive. That is, the communication apparatus or antenna 2000 desiring to allocate the spatial power transmits a spatial power allocation request message including the level information that it desires to be allocated to the power allocation apparatus 1000 so that the initial entry of the spatial power allocation operation .

37 is a diagram of a second embodiment of an initial entry of a spatial power allocation operation.

Referring to FIG. 37, in order to determine whether a communication apparatus or an antenna 2000 that desires spatial power allocation exists, the spatial power allocation apparatus 1000 transmits a spatial power allocation request request message Device or the antenna 2000 (S111).

Then, when the communication apparatus or antenna 2000 desires spatial power allocation, a spatial power allocation request message is transmitted to the spatial power allocation apparatus 1000 in response to the received spatial power allocation request message, (S112). ≪ / RTI > Here, the spatial power allocation request message may include power allocation level information that the communication apparatus or the antenna 2000 desires to receive. That is, the communication apparatus or antenna 2000 desiring to allocate the spatial power transmits a spatial power allocation request message including the level information that it desires to be allocated to the power allocation apparatus 1000 so that the initial entry of the spatial power allocation operation .

38 is a diagram of a third embodiment of an initial entry of a spatial power allocation operation.

Referring to FIG. 38, the spatial power allocation apparatus 1000 may transmit a spatial power allocation start message indicating the start of spatial power allocation to the communication apparatus or the antenna 2000 (S121). An initial entry of the spatial power allocation operation may be performed after the spatial power allocation start message is generated in the spatial power allocation apparatus 1000. [

Various embodiments of a spatial power allocation method according to an embodiment of the present invention will be described with reference to FIGS. 39 to 42. FIG.

39 is a diagram illustrating a spatial power allocation method according to the first embodiment of the present invention.

Referring to FIG. 39, after an initial entry of the spatial power allocation, a communication device or antenna 2000 (hereinafter, referred to as 'terminal 2000') desiring spatial power allocation is located in the Global Positioning System ) Information to the spatial power allocation apparatus 1000 (hereinafter referred to as 'base station 1000') (S201). Here, the GPS information may include information on coordinates, speed, and direction of the location where the terminal 2000 is located.

Next, the base station 1000 may select or change a spatial classification scheme (e.g., polar or hexagon) in the propagation environment (S202).

Then, the base station 1000 can predict a specific space area in the propagation environment of the terminal 2000 based on the GPS information received from the terminal 2000 (S203).

The base station 1000 may then perform spatial power allocation for the terminal 2000 for the predicted spatial region. As another example, the visual information collecting device 1100 generates visual information of the place where the terminal 2000 is located, and based on the predicted space area and surrounding visual information of the terminal 2000, (S204). ≪ / RTI > Here, the base station 1000 can perform spatial power allocation using visual information only when the terminal 2000 is recognized in the visual information.

Then, the base station 1000 transmits a successful response of the spatial power allocation and information of the predicted space region to the terminal 2000 (S205).

Then, the base station 1000 and the terminal 2000 can continuously observe the communication performance according to the spatial power allocation (S206).

40 is a diagram illustrating a spatial power allocation method according to a second embodiment of the present invention.

Referring to FIG. 40, after the initial entry of the spatial power allocation, the base station 1000 can transmit the GPS information and the spatial classification scheme in the radio environment where the base station 1000 is located to the terminal 2000 (S211). Here, the GPS information may include information on coordinates, speed, and direction of the base station 1000.

Then, the terminal 2000 can predict a specific space area in the propagation environment where the terminal 2000 is located based on the GPS information received from the base station (S212).

Subsequently, the terminal 2000 transmits the predicted spatial region information to the base station 1000 (S213).

The base station 1000 may then perform spatial power allocation for the terminal 2000 for the predicted spatial region based on the information of the received spatial region. As another example, the base station 1000 generates visual information where the terminal 2000 is located through the visual information collection device 1100. [ Then, the base station 1000 can perform spatial power allocation for the terminal 2000 based on the predicted spatial area information and the visual information of the location where the terminal 2000 is located (S214). Here, the base station 1000 can perform spatial power allocation using visual information only when the terminal 2000 is recognized in the visual information.

Then, the base station 1000 transmits a successful response of the spatial power allocation and information of the predicted space region to the terminal 2000 (S215).

Then, the base station 1000 and the terminal 2000 can continuously observe the communication performance according to the spatial power allocation (S216).

41 is a diagram illustrating a spatial power allocation method according to a third embodiment of the present invention.

41, there is a case where the spatial classification scheme in the previous propagation environment is inadequate due to the high mobility of the terminal 2000, or the terminal 2000 moves out of the predicted spatial region and the previous spatial power allocation is inappropriate (S231). In this case, the base station 1000 can perform the spatial power allocation again to the terminal 2000. [

First, the terminal 2000 desiring spatial power allocation may transmit a spatial power allocation update request and GPS information of its location to the base station 1000 (S232).

Then, the base station 1000 may select or change a spatial classification scheme (e.g., polar or hexagon) in the propagation environment (S233).

Then, the base station 1000 can predict a specific space area in the propagation environment of the terminal 2000 based on the GPS information received from the terminal 2000 (S234).

The base station 1000 may then perform spatial power allocation for the terminal 2000 for the predicted spatial region. As another example, the visual information collecting device 1100 generates visual information of the place where the terminal 2000 is located, and based on the predicted space area and surrounding visual information of the terminal 2000, (S235). ≪ / RTI > Here, the base station 1000 can perform spatial power allocation using visual information only when the terminal 2000 is recognized in the visual information.

Then, the base station 1000 transmits a successful response of the spatial power allocation and information of the predicted space region to the terminal 2000 (S236).

Then, the base station 1000 and the terminal 2000 can continuously observe the communication performance according to the spatial power allocation (S237).

42 is a diagram illustrating a spatial power allocation method according to a fourth embodiment of the present invention.

Referring to FIG. 42, since the existing space division scheme is updated due to high mobility of the communication node (for example, the base station 1000 or the terminal 2000) or the previous spatial power allocation is inappropriate due to the visual information collection device reconfiguration (S241). In this case, the base station 1000 can perform the spatial power allocation again to the terminal 2000. [

Then, the base station 1000 can transmit the spatial power allocation update request, the GPS information where it is located, and the space classification method in the propagation environment to the terminal 2000 (S242).

Then, the terminal 2000 can predict a specific space area in the propagation environment where the terminal 2000 is located based on the GPS information received from the base station (S243).

Subsequently, the terminal 2000 transmits the predicted spatial region information to the base station 1000 (S244).

The base station 1000 may then perform spatial power allocation for the terminal 2000 for the predicted spatial region based on the information of the received spatial region. As another example, the base station 1000 generates visual information where the terminal 2000 is located through the visual information collection device 1100. [ The base station 1000 may perform spatial power allocation for the terminal 2000 based on the predicted spatial domain information and the visual information of the location where the terminal 2000 is located (S245). Here, the base station 1000 can perform spatial power allocation using visual information only when the terminal 2000 is recognized in the visual information.

Then, the base station 1000 transmits a successful response of the spatial power allocation and information of the predicted space region to the terminal 2000 (S246).

Then, the base station 1000 and the terminal 2000 can continuously observe the communication performance according to the spatial power allocation (S247).

Hereinafter, various embodiments of a method of failing to allocate space power in the case where spatial power allocation fails will be described with reference to FIGS.

43 is a diagram showing a first embodiment for handling a failure of spatial power allocation.

The terminal 2000 can transmit GPS information to the base station 1000 (S301). Here, the GPS information includes information on the position of the terminal 2000

 Information about the coordinates, the speed and the direction of the point of interest can be included.

Next, the base station 1000 may select or change a spatial classification scheme (e.g., polar or hexagon) in the propagation environment (S302).

Then, the base station 1000 can perform prediction of a specific spatial region within the propagation environment of the terminal 2000 based on the GPS information received from the terminal 2000. [ Here, if the location of the terminal 2000 is out of the spatial area supporting the spatial power allocation, the base station 1000 can not predict a specific space area based on the GPS information of the terminal 2000. [ That is, the base station 1000 may fail to predict a specific spatial area (S303).

Then, the base station 1000 may transmit a spatial power allocation failure response to the terminal 2000 (S304). At this time, the terminal 2000 receiving the spatial power allocation failure response from the base station 1000 can retry the spatial power allocation by performing the procedure shown in FIG. 39 or 41 with the base station 1000.

Figure 44 is a diagram illustrating a second embodiment for handling the failure of spatial power allocation.

Referring to FIG. 44, the base station 1000 may transmit the GPS information and the spatial classification scheme in the propagation environment of the base station 1000 to the terminal 2000 (S311). Here, the GPS information may include information on coordinates, speed, and direction of the base station 1000.

The terminal 2000 can then perform prediction of a specific spatial region within the propagation environment of the base station 1000 based on the GPS information received at the base station 1000. [ Here, when the terminal 2000 is located outside the space area where the base station 1000 supports the spatial power allocation, the terminal 2000 can not predict a specific space area based on the GPS information of the base station 1000. That is, prediction of a specific spatial region in the terminal 2000 may fail (S312).

Subsequently, the terminal 2000 transmits a spatial power allocation failure response to the base station 1000. As another example, the terminal 2000 may transmit a re-request of the GPS information and the space division scheme of the base station 1000 to the base station 1000 (S313). At this time, the base station 1000 receiving the spatial power allocation failure response from the terminal 2000 can retry the spatial power allocation by performing the procedure shown in FIG. 40 or FIG. 42 with the terminal 2000. FIG. Also, when the terminal 2000 receives the GPS information of the base station 1000 and the re-request of the space division method, the spatial power allocation can be retried by performing the procedure of FIG. 40 or FIG.

45 is a diagram showing a third embodiment for handling the failure of spatial power allocation.

45, when the spatial power allocation is normally performed from the base station 1000 to the terminal 2000, the base station 1000 may transmit the spatial power allocation success response and the predicted spatial domain information to the terminal 2000 S321).

Then, the base station 1000 and the terminal 2000 continuously monitor communication performance to determine whether the communication performance falls below a predetermined reference value (S322).

When the terminal 2000 disappears from the visual information of the location where the terminal 2000 is located, the base station 1000 can recognize that the terminal 2000 fails to recognize the terminal 2000 based on the visual information, (S323). For example, if a person who owns the terminal 2000 goes inside the building while walking on the road, the terminal 2000 disappears from the visual information generated by the camera on the road where the terminal 2000 is located. In this case, since the base station 1000 can not continuously allocate the spatial power to the terminal 2000, the base station 1000 can treat the allocation of the spatial power as failed.

Subsequently, the base station 1000 may transmit a spatial power allocation failure response to the terminal 2000. At this time, the terminal 2000 receiving the power allocation failure response from the base station 1000 may retry the spatial power allocation by performing the procedure of FIG. 39 or 31 with the base station 1000.

46 is a diagram showing a fourth embodiment for handling the failure of spatial power allocation.

46, when the spatial power allocation is normally performed from the base station 1000 to the terminal 2000, the base station 1000 may transmit the spatial power allocation success response and the predicted spatial domain information to the terminal 2000 S331).

Then, the base station 1000 and the terminal 2000 continuously observe the communication performance (S332).

If the base station 1000 can not find the terminal 2000 in the visual information or if the terminal 2000 is out of the space area in which the base station 1000 supports spatial power allocation, (S333). In this case, the communication performance between the base station and the base station can be reduced to a preset reference value.

Then, if the communication performance between the base station 1000 and the terminal 2000 drops to a preset reference value, the terminal 2000 can not receive the spatial power allocation. In this case, the terminal 2000 may transmit a spatial power allocation failure response to the base station 1000. As another example, the terminal 2000 may transmit its GPS information and the space division method re-request to the base station 1000 (S334). At this time, the base station 1000 receiving the power allocation failure response from the terminal 2000 can retry the spatial power allocation by performing the procedure of FIG. 40 or FIG.

47 is a diagram showing an extension of a space in which visual information can be acquired by adding a visual information collecting device. 48 and 48 are diagrams showing an example of a method of expanding a space in which visual information can be acquired by adding a visual information collecting device. The procedures in Figs. 47 and 48 are similar to Figs. 16 and 19, When the spatial power allocating apparatus 1000 is driven, including the spatial power allocating unit 1100, a spatial power allocation is performed by extending a space where visual information can be obtained.

47 and 48, a plurality of visual information collecting apparatuses 1100C to 1100F are additionally arranged around the first communication node (for example, the base station 1000), and a plurality of additional visual information It is possible to expand the space where visual information can be obtained through the collecting apparatuses 1100C to 1100F. In this case, it is possible to smoothly allocate the spatial power even if the second communication node (for example, the terminal 2000) which desires spatial power allocation moves.

Specifically, the terminal 2000 desiring spatial power allocation may transmit a spatial power allocation request message to the base station 1000 (S401). The spatial power allocation request message may include power allocation level information that the terminal 2000 desires to receive. That is, the terminal 2000 desiring to allocate the spatial power transmits a spatial power allocation request message including the level information to be allocated to the base station 1000, thereby allowing the initial entry of the spatial power allocation operation to be performed.

Subsequently, the terminal 2000 can transmit its GPS information to the base station 1000 (S402). Here, the GPS information may include information on coordinates, speed, and direction of the location where the terminal 2000 is located.

Then, the base station 1000 may select or change a space division method (polar or hexagon) in the radio wave environment (S403).

Then, the base station 1000 can perform prediction of a specific spatial region in the propagation environment based on the GPS information of the terminal 2000 (S404).

Then, the base station 1000 can recognize the terminal 2000 from the visual information of the location where the terminal 2000 is located, based on the GPS information of the terminal 2000. At this time, if the terminal 2000 moves quickly or moves outdoors, the recognition of the terminal 2000 fails in the visual information (405).

The base station 1000 transmits the visual information collecting device D corresponding to the predicted space area among the visual information collecting devices 1100A located in the predicted space area based on the GPS information of the terminal 2000 2000) (S406).

Then, the visual information collecting device D where the terminal 2000 is located can transmit the visual information of the terminal 2000 to the base station 1000 (S407).

Then, the base station 1000 may convert or align the spatial coordinates of the visual information received from the visual information collecting device D into the spatial coordinates of the base station 1000 (S408).

Then, the base station 1000 may perform spatial power allocation for the terminal 2000 for the aligned spatial coordinates (S409).

Then, the base station 1000 may transmit the spatial power allocation success response and the predicted spatial domain information to the terminal 2000 (S410).

Subsequently, the terminal 2000 and the base station 1000 can continuously observe the communication performance (S411).

Next, the base station 1000 may request additional visual information from the visual information collecting devices C and F disposed around the terminal 2000 (S412).

Next, the visual information collecting devices C and F disposed in the vicinity of the terminal 2000 can transmit the visual information to the base station 1000 (S413).

As described above, the base station 1000 can expand the space in which the spatial power allocation is performed to the terminal 2000 by receiving the visual information from the surrounding visual information collecting devices as well as the visual information collecting device where the terminal 2000 is located . That is, even if the terminal 2000 moves quickly or changes the traveling direction at a specific point, it is possible to continuously track the position of the terminal 2000 through the added visual information, thereby expanding the area of the spatial power allocation.

The methods according to the present invention can be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer readable medium may be those specially designed and constructed for the present invention or may be available to those skilled in the computer software.

Examples of computer readable media include hardware devices that are specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate with at least one software module to perform the operations of the present invention, and vice versa.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

1000: Spatial power allocation device 1100: Visual information collection device
1200: Visual Information Processing Apparatus 1210: Space Coordinate Arranging Unit
1220: Information storage unit 1230: Machine learning unit
1240: Information analysis unit 1250:
1300: Communication device 1310: Communication part
1320: Antenna control module 1330: Antenna part

Claims (1)

A method of spatial power allocation performed at a first communication node using visual information,
Collecting visual information of an area where the second communication node requesting the spatial power allocation is located;
Analyzing the visual information to recognize a person, a communication device, and an object in an area where the second communication node is located;
Analyzing the influence of the communication performance of the person, the communication device, and the object in the propagation environment to predict the role of the person, the communication device, and the object; And
Performing spatial power allocation on an area where the second communication node is located according to a predicted role of the person, the communication device, and the object;
Spatial power allocation method.

Images