KR102438712B1 - Server and control method for generating 3d spatial modeling data - Google Patents

Abstract

The present invention relates to a server for generating 3D spatial modeling data and a method for controlling the same. The control method performed by the server for generating 3D spatial modeling data based on the image taken at at least one point according to the present invention is to analyze the image taken for a preset time through a camera provided in the store to analyze the customer by location calculating the density of ; determining a shooting point for generating 3D spatial modeling data based on the density of customers in the store calculated in the above step; controlling a driving imaging device to perform imaging for 3D spatial modeling data at each of the determined imaging points; and generating 3D spatial modeling data based on the photographed image.

Description

3D spatial modeling data generation server and its control method {SERVER AND CONTROL METHOD FOR GENERATING 3D SPATIAL MODELING DATA}

The present invention relates to a server for generating 3D spatial modeling data and a method for controlling the same, and more particularly, to a server for generating data required to provide 360 3D content and a method for controlling the same.

Recently, with the development of communication technology and electronic communication technology, 3D contents are provided.

In particular, due to the spread of VR (Virtual Reality) devices, 3D content, especially 360-degree 3D content, is trying to be used in various fields. Attempts are being made to make it possible to check the products on the shelves in the store even when not in the store.

In order to provide a VR-based 3D virtual store service, shooting data for providing such 3D virtual content is required. In the past, a method has been used in which a person directly finds a necessary location and takes a picture.

However, it is not only a very cumbersome task for people to go around a large store and take a photo manually, but it is a method that incurs a lot of money when shooting frequently.

Also, in the past, 360 3D content images shot at regular intervals without special standards were provided to customers, which is inefficient in content management.

That is, each product may have different preferences for each customer. If the shooting is uniformly performed while shooting a 360-degree image of the shelf on which the product is placed, the amount of image content for the product with low preference and the product with high preference Since the amount of video content is the same, inefficiency occurs in content management and content provision.

Registered Patent No. 10-1803820

The present invention has been devised to solve the above-mentioned problems of the prior art, and an object of the present invention is to provide a server for generating 3D spatial modeling data in order to provide in more detail about products preferred by customers, and a method for controlling the same.

In order to achieve the above object, the server for generating 3D spatial modeling data based on the image taken at at least one point according to the present invention analyzes the image taken for a preset time through a camera provided in the store and locates the location a customer density calculation unit for calculating the density of each customer; a photographing point determination unit for determining a photographing point for generating 3D spatial modeling data based on the customer's intra-store density calculated by the customer density calculation unit; a 3D imaging controller for controlling the driving imaging device to perform imaging for 3D spatial modeling data at each of the imaging points determined by the imaging point determining unit; and a spatial data generator for generating 3D spatial modeling data based on the image captured by the driving photographing device.

Here, the 3D photographing control unit turns on at least one of the lights in the store from the off state at a preset time point, then controls the driving photographing device so that the photographing is performed, and when the photographing is finished, turns on the lamp in the store It can be turned off in the original on state.

Here, the step of acquiring customer shopping behavior data of customers through online or offline shopping further includes a shopping status collecting unit, wherein the shooting point determining unit calculates the customer shopping behavior data and the customer density obtained from the shopping status collecting unit The photographing point may be determined by applying a preset weight to the density of customers in the store calculated by the department.

Here, when there is a request for 3D store VR content from the user terminal, the apparatus may further include a 3D content providing unit that provides 3D store VR content based on the 3D spatial modeling data generated by the spatial data generating unit.

Here, the photographing point determining unit determines the photographing point group for generating 3D spatial modeling data for each customer group in consideration of both the product arrangement information for each shelf in the store and the customer's in-store density calculated by the customer density calculation unit, The 3D photographing control unit causes the 3D spatial modeling data to be photographed for each photographing point group determined by the point determining unit, and the spatial data generating unit 3D space for each customer group based on the group image photographed by the driving photographing device You can create modeling data.

Here, the 3D content providing unit identifies the customer by analyzing the 3D store VR content request of the user terminal, obtains a customer group corresponding to the identified customer from a pre-stored database or an external server, and obtains the obtained customer group 3D store VR content based on 3D spatial modeling data for each customer group corresponding to may be provided to the user terminal.

Here, the customer density calculation unit analyzes the captured image to calculate the density and the direction of concentration of customers by location, and the photographing point determining unit is provided with the density and direction of the customer in the store calculated by the customer density calculation unit. Based on the facility information in the store, a shooting point and a shooting focus or exposure value for generating 3D spatial modeling data are determined, and the 3D shooting control unit controls the driving imaging device to determine the shooting point for each shooting point determined by the shooting point determining unit. Shooting for 3D spatial modeling data can be made with a shooting focus or exposure value.

Here, the product preference determination unit further comprises a product preference determination unit for determining a preference for each product by comparing the density of customers calculated by the customer density calculation unit with the location of the products on the shelf in the store, wherein the shooting point determination unit is configured to re-arrange the products on the shelf in the store. Based on the product preference determined by the product preference determination unit and product relocation information on the shelf, it is possible to automatically re-determine a shooting point for generating 3D spatial modeling data.

In addition, in order to achieve the above object, the control method performed by the server for generating 3D spatial modeling data based on the image taken at at least one point according to the present invention is performed for a preset time through a camera provided in the store. analyzing the captured image to calculate a density of customers for each location; determining a shooting point for generating 3D spatial modeling data based on the density of customers in the store calculated in the above step; controlling the driving photographing apparatus to perform photographing for 3D spatial modeling data at each of the photographing points determined in the above step; It may include generating 3D spatial modeling data based on the image captured in the above step.

Here, the step may include turning on at least one of the lights in the store from the off state at a preset time; controlling the driving photographing device to perform photographing; When the photographing of the step is finished, the method may include turning off the light in the store from the original on state.

Here, the method further comprises the step of acquiring customer shopping behavior data of customers made by online or offline shopping, wherein in the step, the customer shopping behavior data acquired in the step and the store density of the customers calculated in the step are set in advance. The photographing point may be determined by applying a weight.

Here, when there is a request for 3D store VR content from the user terminal, the method may further include providing 3D store VR content based on the 3D spatial modeling data generated in step (d).

Here, in the above step, a photographing point group for generating 3D spatial modeling data for each customer group is determined in consideration of both the product arrangement information for each shelf in the store and the density of customers calculated in the above step, and each photographing point group is determined. It is possible to make a photographing for the 3D space modeling data, and to generate 3D space modeling data for each customer group based on the photographed image for each group.

Here, in the step, the customer is identified by analyzing the 3D store VR content request of the user terminal, and a customer group corresponding to the identified customer is obtained from a pre-stored database or an external server, and corresponding to the obtained customer group 3D store VR content based on 3D spatial modeling data for each customer group to be used may be provided to the user terminal.

Here, by analyzing the photographed image, the density and the direction of density of customers by location are calculated, and in the step, 3D space modeling data is based on the calculated density and direction of the customer in the store and information on the facilities in the store. A shooting point for generation and a shooting focus or exposure value are determined, and in the above step, the driving shooting device is controlled so that shooting for 3D spatial modeling data is performed with the determined shooting focus or exposure value at each of the determined shooting points. have.

Here, determining the preference for each product by comparing the calculated density of customers by location with the location of the products on the shelf in the store; The method may further include automatically re-determining a shooting point for generating 3D spatial modeling data based on the product preference determined in the above step and the shelf product rearrangement information when relocating products on the shelf in the store.

As described above, according to the present invention, there is an effect of reducing costs in continuous operation by automatically using the driving photographing device rather than manually acquiring photographing data for 360-degree 3D virtual content by a person.

In particular, in selecting shooting points, rather than selecting at uniform intervals, select shooting points with short intervals in areas that are relatively crowded with customers, and select shooting points with long intervals in areas that are not relatively crowded by customers. , it can maximize efficiency in content management and operation.

1 is a schematic configuration diagram of an entire system including a 3D spatial modeling data generation server according to an embodiment of the present invention;
Figure 2 is a functional block diagram of the 3D spatial modeling data generation server of Figure 1,
3 is a view showing the density of customers,
4 is a view showing the shooting point compared to the conventional method based on the customer's density,
5 to 7 are control flowcharts of a 3D spatial modeling data generating server according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, each embodiment according to the present invention is merely an example for helping understanding of the present invention, and the present invention is not limited to these embodiments. In particular, the present invention may be composed of a combination of at least any one of individual components, individual functions, or individual steps included in each embodiment.

In particular, for convenience, some of the claims include an alphabet such as '(a)', but the alphabet does not define the order of each step.

In addition, each signal referred to in each embodiment according to the present invention may mean one signal transmitted by one connection, etc., but may also mean a series of signal groups transmitted for the purpose of performing a specific function to be described later. . That is, in each embodiment, a plurality of signals transmitted at a predetermined time interval or transmitted after receiving a response signal from a counterpart device may be expressed as one signal name for convenience.

A schematic configuration of the entire system including the 3D spatial modeling data generation server 100 according to an embodiment of the present invention is shown in FIG. 1 .

As shown in the figure, the entire system may be configured to include a closed-circuit television (CCTV) camera, a driving imaging device 102 , and a 3D space modeling data generation server 100 .

Here, the CCTV camera 200 is to continuously or periodically photograph the inside of the store, and is to check the degree of concentration of customers in the store as will be described later.

The CCTV camera 200 may be a security camera provided to prevent theft, etc. in the store. Since the operation or configuration of the CCTV camera 200 itself corresponds to a known technology, a more detailed description will be omitted.

The driving photographing device 102 is a device that takes pictures while moving by itself, moves along a passage (traveling path) between the shelves and the shelves in which the products in the store are displayed, and can perform a predetermined photographing according to an external control. Since the driving photographing device 102 itself corresponds to a known technology, a more detailed description thereof will be omitted.

In this embodiment, a camera capable of performing 360-degree photographing may be installed in the driving photographing device 102 to generate 3D virtual content. A description is omitted.

The 3D spatial modeling data generation server 100 analyzes the captured image received from the above-described CCTV chimera and eventually performs a function of generating 3D spatial modeling data corresponding to 3D virtual content. It can perform a function of providing 3D virtual content that allows a user to visually see a product or the like.

An example of a specific functional block of the 3D spatial modeling data generation server 100 is shown in FIG. 2 .

As shown in the figure, the 3D spatial modeling data generation server 100 according to an embodiment of the present invention includes a customer density calculation unit 110 , a photographing point determination unit 120 , a 3D photographing control unit 130 , and spatial data. It may be configured to include a generating unit 140 , a shopping status collecting unit 150 , a 3D content providing unit 160 , a product preference determining unit 170 , and a storage unit 180 .

Here, the storage unit 180 contains applications, setting values, basic data, etc. required for the operation of the 3D spatial modeling data generation server 100 , and is newly created during the operation of the 3D spatial modeling data generation server 100 . Alternatively, a function of storing data received from the outside or a photographed image may be additionally performed.

Hereinafter, even if there is no particular mention, data necessary for the operation of the 3D spatial modeling data generation server 100 or a photographed image may be extracted from the storage unit 180 .

The customer density calculation unit 110 performs a function of calculating the density of customers by location by analyzing the images taken for a preset time through a camera provided in the store (ie, the CCTV camera 200 described above).

For example, the customer density calculation unit 110 may calculate the customer density in consideration of the time the customers in the store move between the stands or stay in front of a specific stand.

Since the technique of checking the motion of people in a fixed image and analyzing the motion itself corresponds to a known technique, a more detailed description will be omitted.

Here, the density of customers is, of course, the density according to the location in the store, and the determination of the coordinates in the store itself corresponds to a well-known technology such as using a map, so a more detailed description will be omitted.

As such, an example of the customer density calculated by the customer density calculator 110 by analyzing the image captured by the CCTV chimera is shown in FIG. 3 .

In FIG. 3, as an example, the density of customers determined based on the photographed image is expressed in color.

That is, as the colors change to green, yellow, and red in FIG. 3 , it means that the density of customers is higher.

The method of expressing the density of customers is not limited thereto, and of course, it may be expressed in various ways.

In addition, the customer density calculator 110 may analyze the captured image to calculate not only the density of customers for each location but also the direction of density.

For example, if the map in a store is divided into aisles between shelves and shelves, customers can calculate the direction of concentration based on which of the left and right stands on the aisle more densely.

The shopping status collecting unit 150 performs a function of acquiring customer shopping behavior data of customers made by online or offline shopping.

For example, when customers who have visited the store of FIG. 1 purchase a product, it is possible to manage the purchase history of the product and also receive information about online shopping from the external server 300 to obtain the customer's shopping behavior data. .

For example, the shopping status collection unit 150 may acquire information on products that are popular with customers in recent years.

The product preference determination unit 170 compares the density of customers for each location in the store calculated by the customer density calculation unit 110 with the location of the products on the shelf in the store to determine the preference for each product.

That is, since the product arrangement information may be stored in advance in the storage unit 180 , the product preference determination unit 170 may determine that a product in a place where many customers stay is a popular product.

The photographing point determining unit 120 performs a function of determining a photographing point for generating 3D spatial modeling data based on the customer's in-store density calculated by the customer density calculating unit 110 .

For example, the photographing point determiner 120 may set the photographing points densely in an area within a store where the customer density is high, and may set the photographing points sparsely in an area within the store where the customer density is not high.

An example of the state determined by the photographing point determiner 120 is illustrated in FIG. 4(b) .

For reference, FIG. 4(a) corresponds to the prior art as an example in which shooting points are determined at uniform intervals, and the difference can be clearly seen when compared with FIG. 4(b).

In addition, when the customer shopping behavior data is obtained from the shopping status collecting unit 150, the shooting point determining unit 120 is based on the acquired customer shopping behavior data and the customer's in-store density calculated by the customer density calculation unit 110. A shooting point may be determined by applying a set weight.

For example, there may be a slight difference between customers' preference for a specific product in a store and customers' preference for a specific product online. The final shooting point can be determined by applying 40% to the purchase amount.

In order to perform this process, of course, it is necessary to first determine the in-store product preferred by customers through the information on the customer's in-store density and in-store product arrangement, which is performed by the product preference determining unit 170 described above. may be done

In addition, the shooting point determination unit 120 combines the customer's preference for a product preferred by customers through the determination of the density of customers in the store and the online customer's product preference, and finally, in the store where the customer's preferred product is provided. This allows more shooting points to be set near the stand.

In addition, the photographing point determination unit 120 considers both the product arrangement information for each shelf in the store and the customer's in-store density calculated by the customer density calculation unit 110, and the photographing point group for generating 3D spatial modeling data for each customer group can be decided

For example, the photographing point determination unit 120 extracts product arrangement information for each shelf in the store from the storage unit 180, classifies them into fresh food and industrial products, and then sets photographing points for fresh food in consideration of customer density. The first shooting point group may be determined, and shooting points for industrial products may be determined as the second shooting point group.

In addition, as described above, when the density and the direction of customer density are calculated by the customer density calculating unit 110 , the shooting point determining unit 120 determines the density of customers in the store calculated by the customer density calculating unit 110 . and a shooting point for generating 3D spatial modeling data, as well as a shooting focus or exposure value, may be determined based on the direction of concentration and information on facilities in the store.

For example, when backlight due to ceiling lighting is generated from the direction of a shelf where customers gather a lot, the photographing point determiner 120 may determine an appropriate exposure at the corresponding photographing point, or the driving photographing device 102 moves. It is also possible to determine an appropriate shooting focus based on the distance from the passage to the stand.

On the other hand, the shooting point determining unit 120 is a shooting point for generating 3D spatial modeling data based on the product preference determined by the product preference determining unit 170 and the shelf product relocation information, when the product on the shelf is rearranged in the store. It can also be re-determined automatically.

For example, the location of a shelf in a large store or the type of product provided on the shelf may be changed at any time, in this case, the shooting point determination unit 120 detects a product relocation event (administrator input, etc.) when the product preference determination unit ( 170), it is possible to automatically re-determine the shooting point without additionally checking the density of customers through the aforementioned CCTV footage based on the product preference and product relocation information on the shelf.

In other words, if it is primarily determined as a shooting point, when product relocation occurs, the degree of density of customers in the store can be predicted without additional CCTV chimera shooting, and the shooting point can be automatically re-determined based on this.

Of course, this is meaningful until new CCTV chimera shooting data is accumulated. This is preferable.

The 3D imaging control unit 130 controls the driving imaging device 102 to perform a function of shooting for 3D spatial modeling data at each imaging point determined by the imaging point determining unit 120 .

If the shooting point determining unit 120 determines a shooting point group for generating 3D spatial modeling data for each customer group, the 3D shooting control unit 130 performs shooting for 3D spatial modeling data for each shooting point group determined by the point determining unit. can make it happen.

In addition, as described above, when the shooting point determining unit 120 determines not only the shooting point but also the shooting focus or exposure value at each shooting point, the 3D shooting control unit 130 controls the driving imaging device 102 to take each shot. At each point, shooting for 3D spatial modeling data may be performed with the determined shooting focus or exposure value.

Accordingly, as described above, the driving photographing apparatus 102 may perform a photographing operation at the photographing point determined by the photographing point determiner 120 while moving around the store by autonomous driving, for example.

In this case, the 3D imaging control unit 130 may also control the predetermined light 101 provided in the store.

That is, in order for the driving photographing device 102 to take a picture, it is better to do it at night when there are no customers. After turning on at least one of the lights 101 in the store from the off state at the time to be controlled (for example, 2 am), the driving photographing device 102 is controlled so that the photographing is performed, and the photographing at all photographing points is performed. In case of termination, the light 101 in the store may be switched from the original on state to the off state. Accordingly, the captured image may have an appropriate brightness.

The spatial data generating unit 140 performs a function of generating 3D spatial modeling data based on the image captured by the driving photographing apparatus 102 . Here, the 3D space modeling data may be data necessary to configure the 360-degree virtual content as described above. Since the form of the data for configuring the 360-degree virtual content itself corresponds to a known technology, a more detailed description will be omitted. .

In particular, when the 3D shooting control unit 130 controls the shooting for the 3D spatial modeling data for each shooting point group, the spatial data generating unit 140 receives the customer based on the group-specific images captured by the driving imaging device 102 . It is also possible to generate 3D spatial modeling data for each group.

On the other hand, the 3D content providing unit 160 provides a function of providing 3D store VR content based on the 3D spatial modeling data generated by the spatial data generating unit 140 when there is a 3D store VR content request from the user terminal 400 . carry out

For example, after the 3D content providing unit 160 renders each 3D spatial modeling data to generate 3D store VR content, if there is a request from a customer who has visited the store or a customer who has not visited the store, the 3D store VR content is will be able to provide

Here, the 3D store VR content is content that allows you to check the beach status of products through 360-degree virtual reality, even if you do not go around the store yourself.

In particular, the 3D content providing unit 160 analyzes the 3D store VR content request signal of the user terminal 400 to identify the corresponding customer, and store the customer group corresponding to the identified customer in a pre-stored database or external server 300 . 3D store VR content based on 3D spatial modeling data for each customer group corresponding to the obtained customer group may be provided to the user terminal 400 .

For example, it is possible to check whether each customer is a group with a well-being vegan tendency, a group with an outdoor activity tendency, or a group with a tendency to stay at home most of the time through the customer's purchase history. When the user logs in, the 3D content providing unit 160 identifies the customer based on the login information, checks the customer's group from a pre-stored database, etc., and provides 3D store VR content suitable for the customer of the group. it can be done

This is based on the assumption that 3D spatial modeling data for each customer group is generated as described above.

Hereinafter, a control flow of the 3D spatial modeling data generation server 100 according to an embodiment of the present invention will be described with reference to FIGS. 5 to 7 .

First, it will be described with reference to FIG. 5 as follows.

First, when shooting is usually performed by the CCTV chimera (step S1), the 3D spatial modeling data generation server 100 analyzes the image captured by the CCTV chimera to calculate the density of customers in the store (step S3).

Next, the 3D spatial modeling data generation server 100 determines a shooting point based on the calculated customer density (step S5).

After the shooting point is determined, the 3D spatial modeling data generation server 100 controls the driving imaging device 102 to be photographed at each shooting point while moving in the store (step S7).

The 3D spatial modeling data generation server 100 generates 3D spatial modeling data by using the image captured by such driving shooting (step S)9, and renders the 3D store VR contents rendered with this data at the request of the customer. If provided (step S11).

FIG. 6 shows a process of determining a photographing point by additionally reflecting the customer's shopping behavior data in FIG. 5 (step S32). Since the rest of the process is the same as that of FIG. 5, a redundant description will be omitted.

7 illustrates a process of providing different 3D store VR contents to customers for each customer group in FIG. 5 .

That is, the 3D spatial modeling data generation server 100 obtains product arrangement information for each shelf in the store (step S52), and then determines a photographing point group for each customer group (ie, different photographing points for each group).

Next, since it is the same as that of FIG. 5 except that a plurality of processing processes are performed for each group, a redundant description will be omitted.

Meanwhile, it goes without saying that the process of performing each of the above-described embodiments may be performed by a program or application stored in a predetermined recording medium (eg, computer-readable). Here, the recording medium includes an electronic recording medium such as a random access memory (RAM), a magnetic recording medium such as a hard disk, and an optical recording medium such as a compact disk (CD).

In this case, the program stored in the recording medium may be executed on hardware such as a computer or a smart phone to perform each of the above-described embodiments. In particular, at least one of the functional blocks of the 3D spatial modeling data generation server 100 according to the present invention described above may be implemented by such a program or application.

In addition, the present invention is not limited to the specific embodiments described above, but can be practiced with various modifications and modifications within the scope without departing from the gist of the present invention. It will be apparent that such modifications and variations are included in the present invention provided they fall within the scope of the appended claims.

100: 3D spatial modeling data generation server
200: CCTV camera 300: external server
101: light 102: driving photographing device
400: user terminal 110: customer density calculator
120: shooting point determining unit 130: 3D shooting control unit
140: spatial data generation unit 150: shopping status collection unit
160: 3D content providing unit 170: product preference determination unit
180: storage

Claims (18)

In the control method performed by a server that generates 3D spatial modeling data based on an image taken at at least one point,
(a) calculating the density of customers by location by analyzing the images taken for a preset time through a camera provided in the store;
(b) determining a photographing point for generating 3D spatial modeling data based on the customer's in-store density calculated in step (a);
(c) controlling the driving photographing apparatus to perform photographing for 3D spatial modeling data at each of the photographing points determined in step (b);
(d) generating 3D spatial modeling data based on the image captured in step (c). According to claim 1,
Step (c) is,
(c1) turning on at least one of the lights in the store from the off state at a preset time;
(c2) controlling the driving photographing device to perform photographing;
(c3) When the photographing of step (c2) is finished, the control method of the 3D spatial modeling data generating server, characterized in that it comprises the step of turning off the light in the store from the original on state. According to claim 1,
(e) further comprising the step of acquiring customer shopping behavior data of customers made by online or offline shopping,
In the step (b), the photographing point is determined by applying a preset weight to the customer shopping behavior data obtained in the step (e) and the density within the store of the customer calculated in the step (a) Control method of spatial modeling data generation server. The method of claim 1,
After step (d),
(f) when there is a request for 3D store VR content from the user terminal, 3D space modeling data generation, characterized in that it further comprises the step of providing 3D store VR content based on the 3D space modeling data generated in step (d) How to control the server. 5. The method of claim 4,
In the step (b), the photographing point group for generating 3D spatial modeling data for each customer group is determined in consideration of both the product arrangement information for each shelf in the store and the customer's in-store density calculated in the step (a),
In step (c), shooting for 3D spatial modeling data is made for each shooting point group determined in step (b),
In the step (d), the 3D spatial modeling data generation server control method, characterized in that generating 3D spatial modeling data for each customer group based on the group-specific image captured in the step (c). 6. The method of claim 5,
In the step (f), the customer is identified by analyzing the 3D store VR content request of the user terminal, the customer group corresponding to the identified customer is obtained from a pre-stored database or an external server, and the obtained customer group is A control method of a 3D spatial modeling data generating server, characterized in that providing 3D store VR contents based on 3D spatial modeling data for each corresponding customer group to the user terminal. According to claim 1,
In the step (a), by analyzing the captured image, the density and the direction of density of customers by location are calculated,
In the step (b), the shooting point and the shooting focus or exposure value for generating 3D spatial modeling data are determined based on the customer's in-store density and the density direction calculated in the (a) step and the facility information in the store. do,
3D spatial modeling data, characterized in that in the step (c), the driving imaging device is controlled so that the shooting for the 3D spatial modeling data is performed with the shooting focus or exposure value determined at each shooting point determined in the step (b). How to control the creation server. According to claim 1,
(g) determining the preference for each product by comparing the density of customers by location calculated in step (a) with the location of the products on the shelf in the store;
(h) automatically re-determining the shooting point for 3D spatial modeling data generation based on the product-specific preference and shelf-product relocation information determined in step (g) when rearranging products on the shelf in the store. 3D spatial modeling data generation server control method, characterized in that. A computer-readable recording medium in which a program for executing the method of any one of claims 1 to 7 is recorded. An application program stored in a computer-readable recording medium in combination with hardware to execute the method of any one of claims 1 to 7. In the server for generating 3D spatial modeling data based on the image taken at at least one point,
a customer density calculation unit that analyzes images taken for a preset time through a camera provided in the store and calculates the density of customers by location;
a photographing point determination unit for determining a photographing point for generating 3D spatial modeling data based on the customer's intra-store density calculated by the customer density calculation unit;
a 3D imaging control unit that controls the driving imaging device to perform imaging for 3D spatial modeling data at each imaging point determined by the imaging point determining unit;
and a spatial data generating unit generating 3D spatial modeling data based on the image captured by the driving photographing device. 12. The method of claim 11,
The 3D photographing control unit turns on at least one of the lights in the store from the off state at a preset time point, then controls the driving photographing device so that the photographing is performed, and when the photographing is finished, the lighting in the store is restored to its original state. 3D spatial modeling data generation server, characterized in that it is turned off in an on state. 12. The method of claim 11,
The step of acquiring customer shopping behavior data of customers made by online or offline shopping further comprises a shopping status collecting unit,
3D space, characterized in that the photographing point determining unit determines the photographing point by applying a preset weight to the customer shopping behavior data obtained by the shopping status collecting unit and the density of customers in the store calculated by the customer density calculating unit. Modeling data generation server. 12. The method of claim 11,
3D spatial modeling data generating server, characterized in that when there is a request for 3D store VR content from the user terminal, the 3D space modeling data generation server further comprising a 3D content providing unit for providing 3D store VR contents based on the 3D spatial modeling data generated by the spatial data generating unit . 15. The method of claim 14,
The photographing point determining unit determines the photographing point group for generating 3D spatial modeling data for each customer group in consideration of both the product arrangement information for each shelf in the store and the customer's in-store density calculated by the customer density calculation unit,
The 3D photographing control unit allows photographing for 3D spatial modeling data to be performed for each photographing point group determined by the point determining unit,
3D spatial modeling data generating server, characterized in that the spatial data generating unit generates 3D spatial modeling data for each customer group based on the group-specific image captured by the driving photographing device. 16. The method of claim 15,
The 3D content providing unit identifies the customer by analyzing the 3D store VR content request of the user terminal, obtains a customer group corresponding to the identified customer from a pre-stored database or an external server, and corresponds to the acquired customer group 3D space modeling data generating server, characterized in that it provides 3D store VR contents based on 3D spatial modeling data for each customer group to be provided to the user terminal. 12. The method of claim 11,
The customer density calculator calculates the density and the direction of customer density by location by analyzing the captured image,
The shooting point determining unit determines the shooting point and shooting focus or exposure value for 3D spatial modeling data generation based on the customer's in-store density and density direction calculated by the customer density calculating unit and the facility information in the store, ,
The 3D photographing control unit controls the driving photographing device so that photographing for 3D spatial modeling data is performed at each photographing point determined by the photographing point determination unit with the determined photographing focus or exposure value. server. 12. The method of claim 11,
Further comprising a product preference determination unit for determining the preference for each product by comparing the density of customers calculated by the customer density calculation unit and the product location in the store,
The photographing point determining unit automatically re-determines the photographing point for 3D spatial modeling data generation based on the product preference determined by the product preference determination unit and the shelf product relocation information when relocating the products on the shelf in the store. 3D spatial modeling data generation server.

Images