KR20180001550A - Personalized shopping mall system using virtual camera - Google Patents

Abstract

The present invention relates to a personalized shopping mall system using a virtual camera, wherein a virtual camera for each user having different region of interest (ROI) from an image of an offline store captured by a physical camera is provided and the captured image is included in a shopping mall page and streamed online, so that a user can feel like shopping in a real offline store. The personalized shopping mall system using a virtual camera comprises: a physical fixing camera; an image processing device including an image receiving part and a virtual camera managing part; and the virtual camera including an ROI selecting part, an ROI playing part and an image processing part.

Description

[0001] Personalized shopping mall system using virtual camera [0002]

The present invention relates to an online shopping mall, and more particularly to a personalized shopping mall system using a virtual camera.

Korean Patent Laid-Open No. 10-2011-0072846 (June 29, 2011), a technique of cropping only a part of a video image output from a camera, a part of a target image such as a human face or a license plate, .

Korean Patent Laid-Open No. 10-2013-0039652 (Feb. 04, 2013) searches for two or more subnets storing contents, and if the retrieved subnets are two or more, In the process of delivering contents to a user from a content server by selecting a node included in a subnet and a subnet that provide a service and delivering the content to a user, an optimal server node is selected in the network to increase traffic efficiency, And a load balancing technique capable of providing streaming services.

The present inventor created a virtual camera for each user having different ROIs from an image of an offline store photographed by one physical camera using the image cropping technique described above and included the shopping mall page for streaming Technology.

Further, the present inventor has developed an image processing apparatus and an image processing method in which, from an offline store screen constituted by sequentially connecting images of an offline store photographed by a plurality of physical cameras using the image cropping technique described above, We created a camera and included it in a shopping mall page to study streaming technology.

In addition, the present inventors have found that 3D objects from an offline store screen including 3D objects detected using stereoscopic differences of 2D images of offline stores photographed by a plurality of physical cameras, (ROI) in which the user is located in the shopping mall page, and then a streaming technique is carried out.

In addition, the inventor of the present invention created a virtual camera for each user having different ROIs from an image of an offline store photographed by a physical camera, and included the virtual camera in a shopping mall page, We have studied the technique of distributing and transmitting the streaming loads of the ROI images played by the user-specific virtual cameras.

Korean Patent Publication No. 10-2011-0072846 (June 29, 2011), Korean Patent Publication No. 10-2013-0039652 (Feb.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances and provides a virtual camera for generating a virtual camera for each user having a different ROI from an image of an offline store photographed by a single physical camera, And a personalized shopping mall system using the same.

In addition, the present invention creates a virtual camera for each user having different ROIs from an offline store screen formed by sequentially connecting images of an offline store photographed by a plurality of physical cameras, The present invention provides a personalized shopping mall system using a virtual camera.

The present invention also relates to a method and apparatus for displaying 3D objects from an offline store screen including 3D objects detected using stereoscopic differences of 2D images of offline stores photographed by a plurality of physical cameras, The present invention provides a personalized shopping mall system using a virtual camera that creates a plurality of different virtual cameras for each user having a region of interest (ROI) located therein and streams the virtual cameras in a shopping mall page.

According to another aspect of the present invention, a virtual camera for each user having different ROIs from an image of an offline store, which is photographed by a physical camera, is generated and included in a shopping mall page, The present invention provides a personalized shopping mall load balancing system using a virtual camera that distributes and transmits a streaming load of ROIs reproduced by user-specific virtual cameras.

According to one aspect of the present invention, there is provided a personalized shopping mall system using a virtual camera, comprising: a plurality of physical cameras for photographing an image of an offline store in real time; And an offline store screen which is formed by sequentially connecting the images of the offline stores received by the image receiving unit and constituting an integrated offline store screen, An image processing apparatus including a virtual camera management unit for generating a plurality of user-specific virtual cameras having different ROIs from the screen; An interest area selection unit for selecting an area of interest of an image of an offline store photographed by the physical camera; an interest area playback unit for playing back the image of the ROI selected by the ROI selection unit; A virtual camera including a video pan for pan / tilt or zoom in / zoom out an image of a region of interest reproduced by the region of interest playback unit; .

According to a further aspect of the present invention, there is provided a video camera system comprising: a connection management unit for processing connection and disconnection of a user terminal by the virtual camera management unit; A virtual camera generation unit for generating a virtual camera to be provided to the user terminal connected by the connection management unit; A shopping mall page generator configured to configure a shopping mall page included in the virtual camera area by the virtual camera generated by the virtual camera generating unit; A shopping mall page providing unit for providing the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated by the shopping mall page generating unit; A control granting unit for granting a control right to the virtual camera included in the shopping mall page provided by the shopping mall page providing unit to the corresponding user terminal; .

According to a further aspect of the present invention, the control right of the virtual camera is a virtual camera screen pan / tilt and a zoom in / zoom out right.

According to a further aspect of the present invention, a shopping mall page generated by the shopping mall page generating unit includes an interested goods area in which an interested merchandise image uploaded by the manager terminal is registered.

According to a further aspect of the present invention, the shopping mall page generated by the shopping mall page generating unit includes a video chat area for processing a video chat between the manager terminal and the user terminal.

According to a further aspect of the present invention, the shopping mall page generated by the shopping mall page generating unit includes a store information area for providing offline store information.

According to a further aspect of the present invention, the virtual camera may further include a region of interest (ROI) reproduced by the region of interest reproducer according to a Pan / Tilt or Zoom In / Zoom Out operation signal A simulation pan tilt zoom processor for outputting to the image processor a virtual camera control command instructing to pan / tilt or zoom in / out in software within a range of a virtual camera area; And further comprising:

According to a further aspect of the present invention, when the virtual camera moves out of the virtual camera range of the image of the region of interest reproduced by the region of interest reproducer, the virtual camera instructs to physically pan / tilt or zoom in / out An optical pan tilt zoom processor for outputting a physical camera driving command to a physical camera; And further comprising:

According to a further aspect of the present invention, there is provided a virtual camera, comprising: a setting information storage unit for storing virtual camera setting information; A virtual camera setting unit for receiving virtual camera setting information from a user and storing the virtual camera setting information in the setting information storage unit; And further comprising:

According to a further aspect of the present invention, the virtual camera setting unit sets at least one of an initial ROI, an ROI, a resolution, a quality, a compression format, and a virtual camera area pattern as virtual camera setting information.

According to a further aspect of the present invention, the image processing unit comprises: a memory for storing a store image taken by a physical camera; An interest region extracting unit for extracting, from a burial image stored in the memory, an image of a region of interest selected by the region of interest selecting unit, the region of interest set in the camera setting information; An image scaler for converting the ROI extracted by the ROI extractor into a resolution set in the camera setting information; A codec for compressing the region of interest image converted by the image scaler into a compressed format set in the camera setting information; .

According to a further aspect of the present invention, there is provided a method for controlling an image processing apparatus, comprising: a frame rate conversion unit for converting a frame rate of an ROI according to a quality set in camera setting information; And further comprising:

According to a further aspect of the present invention, the image processing unit extracts a background object and a foreground object from the image of the ROI, and the image of the ROI including only the background object from which the foreground object is removed, And reproduced through the area reproduction unit.

According to a further aspect of the present invention, the image processing unit recognizes a person from an image of a region of interest and performs a masking process on the recognized face of the person.

According to a further aspect of the present invention, ROIs selected by the ROI selection unit may be overlapped with each other.

According to a further aspect of the present invention, the image processing apparatus converts the ROI images reproduced by the plurality of user-specific virtual cameras into packet image signals originated from different ports having the same network address, A multiplexer for converting the stream into a single packet video stream; An image transmission unit for transmitting a single packet image stream multiplexed by the multiplexing unit to user terminals through a single physical layer; And further comprising:

According to a further aspect of the present invention, the virtual camera management unit includes a control right collection unit for collecting control rights to the virtual camera assigned to the user terminal that has been disconnected by the connection management unit; And further comprising:

According to a further aspect of the present invention, the plurality of physical cameras are installed in a line.

According to a further aspect of the present invention, the plurality of physical cameras are radially installed.

According to a further aspect of the present invention, the virtual camera management unit is connected such that some of the images of the off-line store are overlapped.

The present invention creates a virtual camera for each user having different ROIs from an image of an offline store photographed by a single physical camera, and stores the generated virtual camera in a shopping mall page for streaming, The effect can be given.

In addition, the present invention creates a virtual camera for each user having different ROIs from an offline store screen formed by sequentially connecting images of an offline store photographed by a plurality of physical cameras, So that it is possible to give the user the same feeling as shopping in the actual offline store.

The present invention also relates to a method and apparatus for displaying 3D objects from an offline store screen including 3D objects detected using stereoscopic differences of 2D images of offline stores photographed by a plurality of physical cameras, A plurality of different virtual cameras for each user having ROIs are generated and included in a shopping mall page, thereby providing a user with a feeling of shopping in an actual offline store.

According to another aspect of the present invention, a virtual camera for each user having different ROIs from an image of an offline store, which is photographed by a physical camera, is generated and included in a shopping mall page, The streaming load of the region-of-interest images reproduced by the user-specific virtual cameras is dispersed and transmitted, thereby providing a shopping mall page that can give the user the feeling of shopping in the actual offline store at a high speed.

1 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a first embodiment of the present invention.
2 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a second embodiment of the present invention.
3 is a view showing an example of a physical camera installation mode and a store screen of a personalized shopping mall system using the virtual camera shown in FIG.
4 is a view showing another example of the physical camera installation mode and the store screen of the personalized shopping mall system using the virtual camera shown in FIG.
5 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a third embodiment of the present invention.
6 is a view showing an example of a physical camera installation mode of the personalized shopping mall system using the virtual camera shown in FIG.
7 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a fourth embodiment of the present invention.
8 is a block diagram showing the configuration of an embodiment of a virtual camera management unit of an image processing apparatus of a personalized shopping mall system using a virtual camera according to the present invention.
9 is a view showing an example of a shopping mall page generated by the image processing apparatus of the personalized shopping mall system using the virtual camera according to the present invention.
10 is a block diagram showing the configuration of an embodiment of a virtual camera of a personalized shopping mall system using a virtual camera according to the present invention.
11 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in Fig.
12 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in Fig.
13 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in Fig.
FIG. 14 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in FIG. 7;
FIG. 15 is a flowchart illustrating an example of a ROI extraction process by the virtual camera shown in FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The terms used throughout the specification of the present invention have been defined in consideration of the functions of the embodiments of the present invention and can be sufficiently modified according to the intentions and customs of the user or operator. It should be based on the contents of.

1 is a schematic diagram of a personalized shopping mall system using a virtual camera according to the present invention. As shown in FIG. 1, a personalized shopping mall system using a virtual camera according to this embodiment includes a single physical camera 100 and an image processing apparatus 200.

2 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a second embodiment of the present invention. As shown in FIG. 2, the personalized shopping mall system using the virtual camera according to this embodiment includes a plurality of physical cameras 100 and an image processing apparatus 200.

3 is a view showing an example of a physical camera installation mode and a store screen of a personalized shopping mall system using the virtual camera shown in FIG. As shown in FIG. 3, the plurality of physical cameras 100 may be installed in a row.

4 is a view showing another example of the physical camera installation mode and the store screen of the personalized shopping mall system using the virtual camera shown in FIG. But may be radially arranged as shown in Fig.

5 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a third embodiment of the present invention. As shown in FIG. 5, the personalized shopping mall system using the virtual camera according to this embodiment includes a plurality of physical cameras 100 disposed adjacent to each other, and an image processing apparatus 200.

6 is a view showing an example of a physical camera installation mode of the personalized shopping mall system using the virtual camera shown in FIG. As shown in Fig. 6, a plurality of adjacent physical cameras 100 may be installed on all four sides.

7 is a block diagram showing the configuration of a personalized shopping mall system using a virtual camera according to a fourth embodiment of the present invention. 7, the personalized shopping mall system using the virtual camera according to this embodiment includes a physical camera 100, an image processing apparatus 200, a local server 300, a streaming dedicated server 400 ).

The camera 100 is installed in an off-line store and photographs an image of the off-line store in real time. For example, the camera 100 may be a general high resolution camera, a panoramic camera, a fisheye lens camera, or the like.

The image processing apparatus 200 generates a plurality of virtual cameras for each user having ROIs different from the images of the offline stores photographed by the physical camera 100, A plurality of shopping mall pages for each user are formed and provided to each user terminal.

In this case, a virtual camera for each user having different ROIs refers to a software module that crops and reproduces an image of a personalized ROI that is different for each user from an image of an offline store.

The local server 300 transmits interest region images reproduced by the user-specific virtual cameras included in the virtual camera region of the shopping mall pages provided to the user terminal to the user terminals by the image processing apparatus 200 Stream.

If the streaming load of the local server 300 exceeds the threshold value, the streaming dedicated server 400 transmits a streaming service request to the streaming server 400, The streaming load of the region images is dispersed and transmitted.

8 is a block diagram showing the configuration of an embodiment of a virtual camera management unit of an image processing apparatus of a personalized shopping mall system using a virtual camera according to the present invention. The image processing apparatus 200 includes an image receiving unit 210 and a virtual camera managing unit 220.

(Embodiment 1)

The image receiving unit 210 receives an image of an offline store photographed by the physical camera 100.

The virtual camera management unit 220 generates a plurality of virtual cameras for each user having different ROIs from the images of the offline stores received by the image receiving unit 210. [

The virtual camera management unit 220 includes a connection management unit 221, a virtual camera generation unit 222, a shopping mall page generation unit 223, a shopping mall page provision unit 224, .

The connection management unit 221 processes connection and disconnection of a user terminal. For example, the connection management unit 221 may be configured to retrieve a user ID and a password input from a user terminal requesting connection to the image processing apparatus 200 from a member registration DB (not shown) to process the user terminal connection .

On the other hand, the connection management unit 221 may be configured to process connection release of the user terminal in response to a connection release request from the user terminal connected to the image processing apparatus 200. [ At this time, the user terminal may be a portable terminal such as a PC or a smart phone.

The virtual camera creation unit 222 creates a virtual camera to be provided to the user terminal connected by the connection management unit 221. [ For example, the virtual camera generating unit 222 may be configured to generate a plurality of user-specific virtual cameras having different ROIs from the images of the received offline stores.

In this case, the virtual camera is a software module for cropping and reproducing an image of a specific ROI that the user is interested in from the image of the offline store, and will be described in detail later.

The shopping page generating unit 223 forms a shopping mall page included in the virtual camera area by the virtual camera generated by the virtual camera generating unit 222. [ At this time, the shopping mall page is provided with an interested merchandise area in which an interested merchandise image to be uploaded by an administrator terminal (not shown) is registered, a video chat area in which a video chat between the manager terminal and the user terminal is processed, A store information area, and the like.

The shopping mall page providing unit 224 provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated by the shopping mall page generating unit 223. [

When the shopping mall page is provided to the user terminal, the virtual camera included in the virtual camera area of the shopping mall page real-time streams the ROI image of the actual offline store.

The user feels the same as visiting the actual offline store and shopping while viewing the ROI image of the offline store which is streamed live by the virtual camera on-line.

The control right assignment unit 225 gives control rights to the virtual camera included in the shopping mall page provided by the shopping mall page providing unit 224 to the corresponding user terminal.

At this time, the control right for the virtual camera may be a virtual camera screen pan / tilt and a zoom in / zoom out right. On the other hand, the virtual camera screen pan / tilt and zoom in / zoom out are not performed by the physical operation control, but by the software, such as the up / down / left / right movement on the screen, to be.

For example, a virtual camera screen pan / tilt event is generated when a finger is touched in the up / down / left / right direction on the touch screen of the user terminal to which control is given, Area can be streamed and reproduced by the virtual camera.

For example, when two fingers are opened or closed through a touch screen of a user terminal to which control is given, a virtual camera screen zoom in / zoom out event may be generated to enlarge or reduce a region of interest image have.

Since each user independently controls the virtual camera included in the shopping mall page provided to his / her user terminal and receives an image of an area of interest, the personalized interest area image for each user is transmitted to each user terminal .

By implementing such a configuration, a virtual camera for each user having different ROIs from an image of an offline store that is photographed by a physical camera is generated and is included in a shopping mall page and streamed, thereby providing a user with the feeling of shopping in a real- .

(Second Embodiment)

The image receiving unit 210 receives images of off-line stores that are photographed by the plurality of physical cameras 100, respectively.

The virtual camera management unit 220 sequentially connects the images of the offline stores received by the image reception unit 210 to form an integrated offline store screen and displays a plurality of offline store images having different ROIs Create a virtual camera for each user.

At this time, the virtual camera management unit 220 may be configured to configure the offline store screen by connecting some of the images of the offline store to overlap each other. It is possible to prevent a missing area when a part of the images of the offline stores are connected so as to overlap.

The virtual camera management unit 220 includes a connection management unit 221, a virtual camera generation unit 222, a shopping mall page generation unit 223, a shopping mall page provision unit 224, .

The connection management unit 221 processes connection and disconnection of a user terminal. For example, the connection management unit 221 may be configured to retrieve a user ID and a password input from a user terminal requesting connection to the image processing apparatus 200 from a member registration DB (not shown) to process the user terminal connection .

On the other hand, the connection management unit 221 may be configured to process connection release of the user terminal in response to a connection release request from the user terminal connected to the image processing apparatus 200. [ At this time, the user terminal may be a portable terminal such as a PC or a smart phone.

The virtual camera creation unit 222 creates a virtual camera to be provided to the user terminal connected by the connection management unit 221. [ For example, the virtual camera generating unit 222 may sequentially connect the images of the received offline store to configure an integrated offline store screen, and a plurality of user-specific virtual cameras having different ROIs from the configured offline store screen Lt; / RTI >

In this case, the virtual camera is a software module for cropping and reproducing an image of a specific ROI that the user is interested in from the image of the offline store, and will be described in detail later.

The shopping page generating unit 223 forms a shopping mall page included in the virtual camera area by the virtual camera generated by the virtual camera generating unit 222. [ At this time, the shopping mall page is provided with an interested merchandise area in which an interested merchandise image to be uploaded by an administrator terminal (not shown) is registered, a video chat area in which a video chat between the manager terminal and the user terminal is processed, A store information area, and the like.

The shopping mall page providing unit 224 provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated by the shopping mall page generating unit 223. [

When the shopping mall page is provided to the user terminal, the virtual camera included in the virtual camera area of the shopping mall page real-time streams the ROI image of the actual offline store.

The user feels the same as visiting the actual offline store and shopping while viewing the ROI image of the offline store which is streamed live by the virtual camera on-line.

The control right assignment unit 225 gives control rights to the virtual camera included in the shopping mall page provided by the shopping mall page providing unit 224 to the corresponding user terminal.

At this time, the control right for the virtual camera may be a virtual camera screen pan / tilt and a zoom in / zoom out right. On the other hand, the virtual camera screen pan / tilt and zoom in / zoom out are not performed by the physical operation control, but by the software, such as the up / down / left / right movement on the screen, to be.

For example, a virtual camera screen pan / tilt event is generated when a finger is touched in the up / down / left / right direction on the touch screen of the user terminal to which control is given, Area can be streamed and reproduced by the virtual camera.

For example, when two fingers are opened or closed through a touch screen of a user terminal to which control is given, a virtual camera screen zoom in / zoom out event may be generated to enlarge or reduce a region of interest image have.

Since each user independently controls the virtual camera included in the shopping mall page provided to his / her user terminal and receives an image of an area of interest, the personalized interest area image for each user is transmitted to each user terminal .

By implementing such a configuration, a virtual camera for each user having different ROIs from an image of an offline store that is photographed by a physical camera is generated and is included in a shopping mall page and streamed, thereby providing a user with the feeling of shopping in a real- .

(Example 3)

The image receiving unit 210 receives the 2D images of the offline stores photographed by the plurality of physical cameras 100 arranged adjacent to each other.

The virtual camera management unit 220 detects 3D objects using the stereo difference of the 2D images of the offline stores received by the image reception unit 210, constructs an offline store screen including the detected 3D objects, And creates a plurality of different user-specific virtual cameras having an area of interest (ROI) in which 3D objects are located from the screen.

At this time, the offline store screen constituted by the virtual camera management unit 220 is captured in real time by a plurality of physical cameras 100 installed on any one of a plurality of physical cameras 100 installed in all directions, Which is the screen of the offline store.

Stereo Vision (Stereo Vision), which detects 3D objects using stereoscopic visual difference, is a process in which the human visual system receives different images due to the difference in position of the left and right eyes, and the brain receives the stereoscopic images A 3D image processing technique using the principle of generating a three-dimensional sensation in the conventional technique, which is already known and practiced before this application, so that a detailed description thereof will be omitted.

The virtual camera management unit 220 includes a connection management unit 221, a virtual camera generation unit 222, a shopping mall page generation unit 223, a shopping mall page provision unit 224, .

The connection management unit 221 processes connection and disconnection of a user terminal. For example, the connection management unit 221 may be configured to search for a user ID and a password input from a user terminal requesting connection to the image processing apparatus 200 from a member registration DB (not shown) and process the user terminal connection .

On the other hand, the connection management unit 221 may be configured to process connection release of the user terminal in response to a connection release request from the user terminal connected to the image processing apparatus 200. [ At this time, the user terminal may be a portable terminal such as a PC or a smart phone.

The virtual camera creation unit 222 creates a virtual camera to be provided to the user terminal connected by the connection management unit 221. [ For example, the virtual camera generating unit 222 detects 3D objects using the stereo visual difference of the 2D images of the received offline store, constructs an offline store screen including the detected 3D objects, and displays the 3D objects from the configured offline store screen May be implemented to create a plurality of different user-specific virtual cameras with regions of interest (ROI).

In this case, the virtual camera is a software module for cropping and reproducing an image of a personalized ROI in which interested 3D objects are located for each user from an offline store screen, and will be described later in detail.

The shopping page generating unit 223 forms a shopping mall page included in the virtual camera area by the virtual camera generated by the virtual camera generating unit 222. [ At this time, the shopping mall page is provided with an interested merchandise area in which an interested merchandise image to be uploaded by an administrator terminal (not shown) is registered, a video chat area in which a video chat between the manager terminal and the user terminal is processed, A store information area, and the like.

The shopping mall page providing unit 224 provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated by the shopping mall page generating unit 223. [

When the shopping mall page is provided to the user terminal, the virtual camera included in the virtual camera area of the shopping mall page real-time streams the ROI image of the actual offline store. At this time, the 3D object detected by the stereo visual difference is rendered and displayed in the virtual camera area.

The user feels the same as visiting the actual offline store while shopping for the 3D object located on the interest area image of the offline store which is streamed live by the virtual camera on-line.

The control right assignment unit 225 gives control rights to the virtual camera included in the shopping mall page provided by the shopping mall page providing unit 224 to the corresponding user terminal.

In this case, the control right for the virtual camera may be a rotation or Zoom In / Zoom Out or a Pan / Tilt right of a 3D object rendered and displayed. Rotation or Zoom In / Zoom Out or Pan / Tilt of a 3D object rendered on a virtual camera screen is not a physical operation control but a software-based screen rotation , Screen enlargement / reduction, and screen movement processing.

For example, a 3D object rotation event is generated when a finger is touched in the up / down / left / right direction on the touch screen of the user terminal to which control is given, and the 3D object rendered and displayed on the virtual camera screen is rotated in the corresponding direction .

For example, when two fingers are opened or closed through the touch screen of the user terminal having the control right, a Zoom In / Zoom Out event of the 3D object is generated and the 3D object rendered and displayed on the virtual camera screen is enlarged Or reduced.

Each user independently controls the virtual camera included in the shopping mall page provided to his / her user terminal, and receives the image of the area including the 3D object of interest. Therefore, Video is reproduced for each user terminal.

The 3D objects from the offline store screen including the 3D objects detected by using the stereoscopic difference of the 2D images of the off-line stores, which are respectively disposed by the plurality of physical cameras, A plurality of different virtual cameras for each user having ROIs are generated and included in a shopping mall page to stream the content to the user so that they feel like shopping in a real offline store.

At this time, rotation of each of the 3D objects displayed through the virtual camera and zoom in / zoom out (Zoom Out) or pan / tilt control can be performed for each user, It is possible to overcome the limitation that only one person can control the image at the time of video streaming using a single camera.

(Example 4)

The image receiving unit 210 receives an image of an offline store photographed by the physical camera 100.

The virtual camera management unit 220 generates a plurality of virtual cameras for each user having different ROIs from the images of the offline stores received by the image receiving unit 210. [

The virtual camera management unit 220 includes a connection management unit 221, a virtual camera generation unit 222, a shopping mall page generation unit 223, a shopping mall page provision unit 224, .

The connection management unit 221 processes connection and disconnection of a user terminal. For example, the connection management unit 221 may be configured to retrieve a user ID and a password input from a user terminal requesting connection to the image processing apparatus 200 from a member registration DB (not shown) to process the user terminal connection .

On the other hand, the connection management unit 221 may be configured to process connection release of the user terminal in response to a connection release request from the user terminal connected to the image processing apparatus 200. [ At this time, the user terminal may be a portable terminal such as a PC or a smart phone.

The virtual camera creation unit 222 creates a virtual camera to be provided to the user terminal connected by the connection management unit 221. [ For example, the virtual camera generating unit 222 may be configured to generate a plurality of user-specific virtual cameras having different ROIs from the images of the received offline stores.

In this case, the virtual camera is a software module for cropping and reproducing an image of a specific ROI that the user is interested in from the image of the offline store, and will be described in detail later.

The shopping page generating unit 223 forms a shopping mall page included in the virtual camera area by the virtual camera generated by the virtual camera generating unit 222. [ At this time, the shopping mall page is provided with an interested merchandise area in which an interested merchandise image to be uploaded by an administrator terminal (not shown) is registered, a video chat area in which a video chat between the manager terminal and the user terminal is processed, A store information area, and the like.

The shopping mall page providing unit 224 provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated by the shopping mall page generating unit 223. [

When the shopping mall page is provided to the user terminal, the virtual camera included in the virtual camera area of the shopping mall page real-time streams the ROI image of the actual offline store.

The user feels the same as visiting the actual offline store and shopping while viewing the ROI image of the offline store which is streamed live by the virtual camera on-line.

The control right assignment unit 225 gives control rights to the virtual camera included in the shopping mall page provided by the shopping mall page providing unit 224 to the corresponding user terminal.

At this time, the control right for the virtual camera may be a virtual camera screen pan / tilt and a zoom in / zoom out right. On the other hand, the virtual camera screen pan / tilt and zoom in / zoom out are not performed by the physical operation control, but by the software, such as the up / down / left / right movement on the screen, to be.

For example, a virtual camera screen pan / tilt event is generated when a finger is touched in the up / down / left / right direction on the touch screen of the user terminal to which control is given, Area can be streamed and reproduced by the virtual camera.

For example, when two fingers are opened or closed through a touch screen of a user terminal to which control is given, a virtual camera screen zoom in / zoom out event may be generated to enlarge or reduce a region of interest image have.

Since each user independently controls the virtual camera included in the shopping mall page provided to his / her user terminal and receives an image of an area of interest, the personalized interest area image for each user is transmitted to each user terminal .

The local server 300 may stream the ROIs reproduced by the user-specific virtual cameras included in the virtual camera region of the shopping mall pages provided by the user to the user terminal by the image processing apparatus 200, do.

On the other hand, when the streaming load of the local server 300 exceeds the threshold value, the streaming dedicated server 400 reproduces by the user-specific virtual cameras included in the virtual camera area of the shopping mall pages for each user on behalf of the local server The streaming load of the region of interest is dispersed and transmitted.

That is, when the shopping mall page is provided to the user terminal by the image processing apparatus 200, the interest area image of the actual offline store is stored in the local server 300 or the streaming dedicated server 400).

At this time, depending on the streaming load of the local server 300, the local server 300 directly streams the ROIs reproduced by the virtual cameras, or indirectly transmits the ROIs to the virtual cameras through the streaming- And streaming the ROI images reproduced by the ROI.

Meanwhile, the personalized shopping mall load balancing system using the virtual camera according to this embodiment may further include a shopping mall management server 500. [ The shopping mall management server 500 monitors the streaming load of the local server 300 to determine whether or not the streaming load of the local server exceeds the threshold value. If it is determined that the streaming load of the local server exceeds the threshold value, Retrieves it from the local server 300, and transfers it to the streaming dedicated server 400.

For example, determining whether the streaming load of the local server exceeds the threshold can include determining the number of sessions per second (SPS) that can be handled, the number of packets per second (PPS) that can be handled, The transaction per second (TPS), and the like.

Meanwhile, when the streaming control right of the shopping mall management server 500 is transferred to the streaming dedicated server 400 and the streaming load of the local server 300 falls below a threshold value, the shopping mall management server 500 transmits the streaming control right from the streaming dedicated server 400 And returns it to the local server 300.

As a result, the user feels like visiting the actual offline store and shopping while viewing the ROI image of the offline store which is streamed in real time by the virtual camera, online.

In addition, a shopping mall page can be provided at a high speed by distributing and transmitting a streaming load of ROIs reproduced by user-specific virtual cameras included in a virtual camera area of shopping mall pages for each user.

A shopping mall page generated by the above-described first to fourth embodiments will be described with reference to FIG. 9 is a view showing an example of a shopping mall page generated by the image processing apparatus of the personalized shopping mall system using the virtual camera according to the present invention. The shopping mall page 600 includes a virtual camera area 610, an interested goods area 620, a video chat area 630, and a store information area 640.

According to a further aspect of the present invention, the image processing apparatus 200 may further include a multiplexing unit 230 and an image transmission unit 240.

The multiplexer 230 converts the ROIs reproduced by the plurality of user-specific virtual cameras into packet image signals originated from different ports having the same network address, and multiplexes them into a single packet video stream Conversion.

The image transmission unit 240 transmits a single packet image stream multiplexed by the multiplexer 230 to user terminals through a single physical layer.

For example, the interest area image signals output by the plurality of user-specific virtual cameras may be packet signals having respective network addresses. In this case, the multiplexer 230 converts the network addresses of the interest area image signals output by the plurality of user-specific virtual cameras into the same network address by using the network address translation (NAT) function, Number can be assigned and multiplexed.

For example, interest area image signals output by a plurality of user-specific virtual cameras may be video stream data. In this case, the multiplexer 230 may multiplex the video signals of the interest region video signals output by the plurality of user-specific virtual cameras into packets having the same network address and different port numbers.

For example, an address of a region of interest image signal outputted by one virtual camera is allocated to '160, 245, 200, 1: 8091', and an address of a region of interest image signal outputted by another virtual camera is allocated to 160,245,200,1: 8092 '. These multiplexed video packets having the same IP address can be output through the image transmission unit 240 which is a single physical layer (PHY).

According to a further aspect of the present invention, the virtual camera management unit 220 may further include a control right recovery unit 226. [ The control right collection unit 226 recovers control rights for the virtual camera assigned to the user terminal that has been disconnected by the connection management unit 221. [

That is, in this embodiment, when the user terminal that is given the control right to the virtual camera is disconnected by the control right assignment unit 225, the control right of the virtual camera is given to the user terminal through the control right collection unit 226 And the like.

According to the above-described embodiment, the present invention creates a virtual camera for each user having different ROIs from an image of an offline store photographed by a physical camera, and stores the generated virtual camera in a shopping mall page for streaming, I can feel the same.

At this time, since the pan / tilt control for the virtual camera can be performed for each user, individual ROIs for each user can be overlapped with each other, and the fan (s) at the time of video streaming using a single camera Pan / Tilt control can be overcome.

10 is a block diagram showing the configuration of an embodiment of a virtual camera of a personalized shopping mall system using a virtual camera according to the present invention. 10, the virtual camera 700 included in the virtual camera region of the shopping mall page includes a region of interest selector 710, a region of interest regenerator 720, and an image processor 730.

In the case of Embodiments 1, 2 and 4, the ROI selector 710 selects ROIs from images of the offline stores photographed by the physical camera 100. For example, an area displaying a popular item of an offline store may be stored as an initial interest area position, and the interest area selection unit 710 may select an area corresponding to the initial interest area position as a region of interest.

In the case of the third embodiment, the ROI selection unit 710 selects an ROI area as a ROI in the offline store screen. For example, when the ROI 710 selects a 3D object, which is detected by using a stereo visual difference of the 2D images of the off-line store, which are respectively photographed by the plurality of physical cameras 100 arranged adjacent to each other, As a region of interest.

In the case of Embodiments 1, 2 and 4, the ROI reproducing unit 720 reproduces images of ROIs selected by the ROI selecting unit 710. Accordingly, the user enjoys online shopping while feeling the same shopping experience as visiting the actual offline store while watching the ROI image of the offline store that is streamed live by the virtual camera on-line.

In the case of the third embodiment, the ROI reproducing unit 720 renders 3D objects of the ROI selected by the ROI selecting unit 710. Accordingly, the user enjoys on-line shopping with the same feeling of visiting the actual offline store and shopping while viewing the 3D object of the interest area displayed in real time by the virtual camera on-line.

In the case of Embodiments 1, 2 and 4, the image processing unit 730 may generate an image of a region of interest reproduced by the region of interest reproducing unit 720, ) / Tilt (Tilt) or zoom in (Zoom Out) processing.

In the case of the third embodiment, the image processing unit 730 may rotate or zoom in / out the 3D object rendered and displayed by the ROI 720 according to the operation of the user terminal (Zoom Out) or pan (Pan) / Tilt (Tilt) processing.

Meanwhile, when there are a plurality of 3D objects overlapping within the area of interest of the ROI 720, only the selected 3D objects may be displayed. That is, when another 3D object overlapping with the 3D object of interest is displayed as a foreground or background object, the interested region reproducer 720 selects only the 3D object of interest that is desired to be rendered, The desired 3D object of interest may be selected by the region of interest selector 710.

In the case of the first, second, and fourth embodiments, the region of interest image selected by the region of interest selector 710 and reproduced by the region of interest reproducing unit 720 is a region of interest And is changed by a virtual camera screen pan / tilt and zoom in / zoom out operation of the terminal.

The image processing unit 730 can pan / tilt an image of a region of interest according to operations of a camera screen pan / tilt and a zoom in / zoom out operation of the user terminal. Or Zoom In / Zoom Out.

In the case of the third embodiment, the ROI selected by the ROI selecting unit 710 and reproduced by the ROI reproducing unit 720 includes a 3D object rotation of the user terminal, Or Zoom In / Zoom Out or Pan / Tilt operation of the camera screen.

The image processing unit 730 may include an image of a region of interest in accordance with a 3D object rotation of a user terminal or a Zoom In / Zoom Out / Pan / Tilt operation of the camera screen Pan / Tilt or Zoom In / Zoom Out images of a 3D object in an area of interest or a region of interest.

According to an additional aspect of the present invention, the virtual camera 700 may further include a simulated pan / tilt zoom processor 740. The simulated pan / tilt zoom processor 740 performs a pan / tilt zoom operation on a region of interest (ROI) reproduced by the ROI reproducing unit 720 according to a Pan / Tilt or Zoom In / And outputs a virtual camera control command to the image processing unit 730 to instruct the camera to pan / tilt or zoom in / out in a virtual camera region within the range of the image.

When the user performs a Pan / Tilt or Zoom In / Zoom Out operation through the user terminal, the simulated pan / tilt zoom processor 740 sets the pan / And outputs the virtual camera control command to the image processing unit 730. The image processing unit 730 outputs the virtual camera control command to the image processing unit 730, The image of interest is panned / tilted in software or zoomed in / out to change the region of interest.

According to an additional aspect of the present invention, the virtual camera 700 may further include an optical pan / tilt zoom processor 750. The optical panning and tilting processor 750 physically pans / tilts the physical camera 100 when the image of the region of interest reproduced by the region of interest reproducing unit 720 is out of the virtual camera range, And outputs the physical camera driving command to the physical camera 100.

There is a limit in software-based pan / tilt or zoom in / out control of the virtual camera by the simulated pan / tilt zoom processor 740. [ If the image of the region of interest is out of the virtual camera range, it is not possible to control the software such that the camera can be panned / tilted or zoomed in / out. Instead, the physical camera 100 is directly Pan / tilt or zoom in / out control.

When the image of the region of interest is out of the virtual camera range by a pan / tilt operation or a zoom in / zoom out operation through the user terminal, the optical panning / zooming processor 750 The physical camera 100 outputs a physical camera driving instruction to physically pan / tilt or zoom in / zoom out the physical camera 100 to the physical camera 100, and the physical camera 100 moves to a position outside the virtual camera area Physically pan / tilt or zoom in / out to change the region of interest.

According to a further aspect of the present invention, the virtual camera 700 may further include a setting information storage unit 760 and a virtual camera setting unit 770.

The setting information storage unit 760 stores virtual camera setting information. For example, the virtual camera configuration information may include at least one of an initial ROI, a ROI, a resolution, a quality, a compression format, and a virtual camera area pattern.

The virtual camera setting unit 770 receives the virtual camera setting information from the user and stores the virtual camera setting information in the setting information storage unit 760. For example, the virtual camera setting unit 770 may set at least one of an initial region of interest, a region of interest, a resolution, a quality, a compression format, and a virtual camera region pattern as virtual camera setting information.

According to a further aspect of the present invention, the image processor 730 may include a memory 731, a region of interest extractor 732, an image scaler 733, and a codec 734.

The memory 731 stores a store image photographed by a physical camera. For example, the memory 731 may be a semiconductor memory for buffering a store video signal photographed by a physical camera and storing the buffered video signal for each frame. At this time, the size of the store image stored in the memory 731 may be equal to or smaller than the size of the store image taken by the physical camera.

The ROI extracting unit 732 extracts an image of the ROI selected by the ROI selecting unit 710 from the store image stored in the memory 731 as the ROI size set in the camera setting information.

For example, the ROI extractor 732 may extract the ROI image of the region of interest from the store image frames buffered and stored in the memory 731. In this case, the region of interest must be smaller than the size of the store image buffered and stored in the memory 731.

The image scaler 733 converts the ROI extracted by the ROI extractor 732 into the resolution set in the camera setting information. For example, if the resolution set in the camera setting information is '640 * 480', the image scaler 733 can convert the region of interest image to a resolution of '640 * 480'.

The codec 734 compresses the region of interest image converted by the image scaler 733 into a compressed format set in the camera setting information. For example, the codec 734 may compress and output the region of interest image in a specific format such as MPEG-2.

According to an additional aspect of the present invention, the image processing unit 730 may further include a frame rate conversion unit 735. The frame rate conversion unit 735 converts the frame rate of the ROI according to the quality set in the camera setting information. At this time, the quality set in the camera setting information can be set in stages such as high quality / medium quality / low quality, and the frame rate conversion unit 735 sets the frame rate to a relatively high quality .

According to a further aspect of the present invention, the image processing unit 730 extracts a background object and a foreground object from an image of a region of interest using a video analytic technique, An image of the ROI including only the background object may be reproduced through the ROI reproducing unit 720. [

For example, when there is a menu for 'playing back only background image', a menu for 'playing only background image' is provided, and if the user selects a menu for 'playing back background image only', the image processing unit 730 displays the image of interest region As shown in FIG.

This embodiment is an embodiment in which a person who is a foreground object is removed and reproduced so that only a product as a background object is displayed because a product is hidden because a product is hidden when a person passes or remains between the displayed 'merchandise' of the store and the camera.

According to an additional aspect of the present invention, the image processing unit 730 may recognize a person from an image of a region of interest and mask the face of the recognized person.

For example, the image processing unit 730 may recognize a person among a plurality of objects existing in an area of interest, and mask the face of the recognized person.

This embodiment provides a store image in which customers' shopping faces in an offline store are mass-mapped to online users, thereby making it impossible to identify customers who shop in the offline store, thereby protecting personal information.

The shopping mall page providing operation of the personalized shopping mall system using the virtual camera according to the present invention as described above will be described with reference to FIGS. 11 to 14. FIG.

11 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in Fig.

First, in step 810, when a user terminal is connected, the image processing apparatus generates a virtual camera to be provided to the user terminal.

In step 820, the image processing apparatus configures a shopping mall page included in the virtual camera area by the virtual camera generated in step 810.

In step 830, the image processing apparatus provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated in step 820.

In step 840, the image processing apparatus gives the user terminal control of the virtual camera included in the shopping mall page provided by the step 830.

Then, in step 850, the ROI image of the offline store that is photographed by the physical camera installed in the offline store is reproduced by the virtual camera included in the virtual camera area of the shopping mall page provided to the user terminal.

Then, in step 860, a pan / tilt of the region of interest image is generated according to the user's operation on the region of interest image reproduced by the virtual camera included in the virtual camera region of the user terminal, ) Or a zoom in / zoom out operation is performed.

According to the present invention, a virtual camera for each user having different ROIs is generated from an image of an offline store photographed by a physical camera, and the virtual camera is streamed by including the virtual camera in a shopping mall page, I can feel the same.

12 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in Fig.

First, when a user terminal is connected in step 910, the image processing apparatus generates a virtual camera to be provided to the user terminal.

In step 920, the image processing apparatus configures a shopping mall page included in the virtual camera area by the virtual camera generated in step 910.

In step 930, the image processing apparatus provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated in step 920.

In step 940, the image processing apparatus gives the user terminal control of the virtual camera included in the shopping mall page provided by the step 930.

Then, in step 950, among the offline store images in which the images of the in-store shops photographed in real time are sequentially connected by the plurality of physical cameras installed in the off-line store, the virtual camera area of the shopping mall page, As shown in Fig.

Then, in step 960, a pan / tilt of the region of interest image is generated according to the user's operation on the region of interest image reproduced by the virtual camera included in the virtual camera region of the user terminal, ) Or a zoom in / zoom out operation is performed.

According to the present invention, a virtual camera for each user having different ROIs is generated from an offline store screen formed by sequentially connecting images of an offline store photographed by a plurality of physical cameras, Streaming to the user can give the user the same feeling of shopping in a real offline store.

13 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in Fig.

First, in step 1010, when a user terminal is connected, the image processing apparatus generates a virtual camera to be provided to the user terminal.

In step 1020, the image processing apparatus configures a shopping mall page included in the virtual camera area by the virtual camera generated in step 1010. [

At this time, the virtual camera area of the shopping mall page may include a selected specific 3D object among the 3D objects detected using the stereo visual difference of the 2D images of the off-line stores, which are respectively shot by the plurality of physical cameras disposed adjacent to each other.

In step 1030, the image processing apparatus provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated in step 1020. At this time, the 3D object is rendered and displayed through the virtual camera included in the shopping mall page.

In step 1040, the image processing apparatus gives the user terminal control rights to the 3D object displayed and rendered through the virtual camera included in the shopping mall page provided in step 1030.

Then, in step 1050, the image processing apparatus performs control on the 3D object rendered and displayed through the virtual camera according to the user operation from the user terminal that is given the control right for the 3D object.

In this case, the control for the 3D object may be a rotation or zoom in / zoom out (Zoom Out) or a pan / tilt (Tilt) control for the 3D object rendered by the virtual camera. have.

According to the present invention, there is provided an offline store screen including 3D objects detected using a stereo visual difference of 2D images of offline stores photographed by a plurality of physical cameras, A plurality of different virtual cameras for each user having the region in which the 3D objects are located as ROIs are created and streamed by including them in the shopping mall page to give the user the feeling of shopping in a real offline store.

FIG. 14 is a flowchart illustrating an example of a shopping mall page providing operation of the personalized shopping mall system using the virtual camera shown in FIG. 7;

First, when a user terminal is connected in step 1110, the image processing apparatus generates a virtual camera to be provided to the user terminal.

In step 1120, the image processing apparatus configures a shopping mall page included in the virtual camera area by the virtual camera generated in step 1110.

Then, in step 1130, the image processing apparatus provides the shopping mall page included in the virtual camera area to the user terminal by the virtual camera generated in step 1120.

In step 1140, the image processing apparatus gives the corresponding user terminal control rights to the virtual camera included in the shopping mall page provided by the step 1130. [

Then, the ROI image of the offline store image photographed in real time by the physical camera installed in the offline store is reproduced by the virtual camera included in the virtual camera area of the shopping mall page provided to the user terminal.

At this time, according to the streaming load of the local server in step 1150, the local server directly streams the ROIs reproduced by the virtual cameras or indirectly reproduces the ROIs reproduced by the virtual cameras through the streaming- Stream.

Then, in step 1160, a pan / tilt of the region of interest image is generated according to the user's operation on the region of interest image reproduced by the virtual camera included in the virtual camera region of the user terminal, ) Or a zoom in / zoom out operation is performed.

According to the present invention, the present invention provides a virtual camera for each user having different ROIs from an image of an offline store photographed by a physical camera, and provides the generated virtual camera to a shopping mall page, It is possible to provide a shopping mall page at a high speed that can give the user the feeling of shopping in the actual offline store by distributing and transmitting the streaming load of the interest area images reproduced by the user-specific virtual cameras included in the area.

Referring to FIG. 15, the operation of extracting a region of interest in a virtual camera of a personalized shopping mall system using a virtual camera according to the present invention will be described. FIG. 15 is a flowchart illustrating an example of a ROI extraction process by the virtual camera shown in FIG.

First, in step 1210, the virtual camera receives and stores the virtual camera setting information from the user. For example, the virtual camera setting information may include at least one of an initial ROI, an ROI, a resolution, a quality, a compression format, and a virtual camera area pattern.

Next, in step 1220, the virtual camera determines an initial RO region location set in the virtual camera setting information as a region of interest, and extracts a portion corresponding to the region of interest in the store image received from the physical camera as ROI size region .

Then, if there is a pan / tilt operation or a zoom in / zoom out operation from the user in step 1230, the image of the region of interest in which the virtual camera is reproduced is converted into software Pan / tilt or zoom in / out.

If the image of the region of interest reproduced by the user from Pan / Tilt or Zoom In / Zoom Out operation is out of the virtual camera region range (physical camera photographing range) In step 1240, a physical camera drive command to the physical camera to instruct the virtual camera to physically pan / tilt or zoom in / out on the physical camera.

As described above, according to the present invention, a virtual camera for each user having different ROIs from an image of an offline store photographed by a single physical camera is generated and is included in a shopping mall page to be streamed, You can feel like shopping in.

In addition, the present invention creates a virtual camera for each user having different ROIs from an offline store screen formed by sequentially connecting images of an offline store photographed by a plurality of physical cameras, So that the user can feel like shopping in a real offline store.

The present invention also relates to a method and apparatus for displaying 3D objects from an offline store screen including 3D objects detected using stereoscopic differences of 2D images of offline stores photographed by a plurality of physical cameras, A plurality of different virtual cameras for each user having ROIs are generated and included in the shopping mall page to stream the content to the user so that they feel like shopping in a real offline store.

According to another aspect of the present invention, a virtual camera for each user having different ROIs from an image of an offline store, which is photographed by a physical camera, is generated and included in a shopping mall page, The streaming load of the region of interest images reproduced by the user-specific virtual cameras is dispersed and transmitted so that a shopping mall page that gives the user the feeling of shopping in the actual offline store can be provided at a high speed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. .

INDUSTRIAL APPLICABILITY The present invention can be industrially used in the technical field related to on-line shopping mall and its application technology field.

100: camera
200: image processing device
210:
220: Virtual camera management unit
221:
222: Virtual camera creation section
223: Shopping Mall Page Generation Unit
224: shopping mall page offerings
225: Whether or not control is granted
226:
230: multiplexer
240:
300: Local server
400: Streaming dedicated server
500: shopping mall management server
600: Shopping Mall Page
610: Virtual camera area
620: Interested goods area
630: Video chat area
640: store information area
700: Virtual camera
710:
720:
730:
731: Memory
732: ROI extracting unit
733: Image Scaler
734: Codec
735: frame rate conversion unit
740: a simulated pan tilt zoom processor
750: Optical pan tilt zoom processor
760: Setting information storage unit
770: Virtual camera setting unit

Claims (1)

A plurality of physical fixed cameras for photographing images of an offline store in real time;
And an offline store screen which is connected by sequentially connecting the images of the off-line store received by the image receiving unit and forms an integrated offline store screen, An image processing apparatus including a virtual camera management unit for generating a plurality of user-specific virtual cameras having different ROIs from a store screen;
An interest area selector for selecting an area of interest of an image of an offline store photographed by the physical fixed camera; an interest area regenerator for regenerating an image of the region of interest selected by the interest area selector; A pan / tilt or a zoom in / zoom out process of an image of a region of interest reproduced by the ROI reproducing unit, and a foreground A virtual camera including an image processing unit for preventing a background object from being obscured by a foreground object by including only a background object by removing an object;
Personalized shopping mall system using embedded virtual camera.

Images