KR101514313B1 - Virtual photographing service system and method - Google Patents

Abstract

A virtual photographing service method according to the present invention comprises the steps of a main terminal executing a service app according to an operation of a user and sending an invitation message to a terminal of the persons to be photographed through the executed service app, The method comprising the steps of: when each of the terminals receiving the invitation message completes the connection, the main terminal instructs the position of each photographing target according to the user's instruction The main terminal transmits the photographed image to the server and the server extracts an image of each photographed subject according to a predetermined object segmentation technique from the transferred image. Inserting each extracted image at a designated position on a final image to complete and store the image; The image comprises the step of transmitting toward the terminal of each shooting subject.
The present invention realizes a virtual photographing service system that photographs by allowing users at a remote location to participate in an online virtual space. The present invention implements a service app for a virtual photography service, so that members (or friends, family members, etc.) who can not attend a trip or a meeting are put in, a geese dad who is separated from his family is put in a family photograph, It is expected that it will be easier and more convenient to provide functions such as recording video clips of celebrities (for example, entertainers or sports stars), providing online photo services for fans in online fan clubs.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual photography service system and method,

The present invention relates to a virtual photographing service, and more particularly, to a virtual photographing service system and method in which users at remote locations participate on-line.

In recent years, smartphones that have been rapidly spread over the years have become part of our daily lives by combining mobile communication and the functions of personal computers (operating system implementation, application running, and Internet access functions).

In addition, smartphone applications (hereinafter referred to as "apps") have been developed in such a wide variety of ways that they can not be counted, and they are evolving so that they provide many convenience with useful ideas in real life .

The spread of smartphones and the development of smartphone applications are continuing to expand, but the number of applications for virtual photography, which are shot online and engaged by users online, are still insufficient.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a virtual photographing service system in which a user of a remote location photographs an image by taking an existing stored image or a virtual image in the background.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the present invention will be realized and attained by the structure particularly pointed out in the claims, as well as the following description and the annexed drawings.

The present invention realizes a virtual photographing service system that photographs by allowing users at a remote location to participate in an online virtual space.

The present invention implements a service app for a virtual photography service, so that members (or friends, family members, etc.) who can not attend a trip or a meeting are put in, a geese dad who is separated from his family is put in a family photograph, It is expected that it will be easier and more convenient to provide functions such as recording video clips of celebrities (for example, entertainers or sports stars), providing online photo services for fans in online fan clubs.

1 is a block diagram of a virtual photographing service system according to the present invention;
2 is a flowchart illustrating an operation of a virtual photographing service system according to the present invention.
FIG. 3A is a diagram illustrating a virtual photography service setting screen according to the present invention; FIG.
FIG. 3B illustrates another setting screen of the virtual shooting service according to the present invention; FIG.
4 is an exemplary view of a terminal screen constructed in accordance with the present invention;
5A is an exemplary view showing a screen configuration of the main terminal 100;
5B is an exemplary view showing a screen configuration of the sub terminal 200a.
5C is an exemplary view showing a screen configuration of the sub terminal 200b.
5D is an exemplary view showing a screen configuration of the sub terminal 200c.
6 illustrates sub-terminals and terminal users according to the present invention.

According to another aspect of the present invention,

The method comprising the steps of: a main terminal executing a service application according to an operation of a user; sending an invitation message to a terminal of the persons to be photographed through the executed service application; And connecting to the main terminal; and when the terminals having received the invitation message are all connected, the main terminal designates a position of each photographing subject according to a user's instruction and performs photographing, The server transmits the captured image to the server side, and the server extracts images of the subjects to be photographed from the delivered images according to a predetermined object segmentation technique. The server extracts the extracted images from the final image A step of inserting the completed image into the designated position on the terminal It comprises the step of transmitting.

Preferably, each of the terminals, which have received the invitation message, connect to the main terminal by accepting the invitation and connecting to the main terminal. The method includes the steps of driving the camera module, And transferring the stored image of the album to participate in the photographing.

Preferably, the virtual photographing service method further comprises the steps of: setting, by the main terminal, a background image type for virtual photographing when all the terminals receiving the invitation message complete connection; And displaying the image of the person to be photographed in the area of the designated position, respectively, according to the input of the user.

In order to achieve the above object, a virtual photographing service system according to the present invention comprises:

When a terminal sends an invitation message to a terminal of a person to be photographed through a predetermined service application and all the terminals that have received the invitation message complete the connection, At least one sub-terminal for driving a camera module to transmit a real-time image to a main terminal and participating in shooting of the main terminal when an invitation message is received from the main terminal, And a server for extracting an image of each photographing subject according to a predetermined object segmentation technique from the received image and inserting each extracted image at a designated position on the final image to complete an image.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The embodiment of the present invention realizes a virtual photographing service system in which a remote user participates in a virtual space having a predetermined background image on-line and photographs using a smart device having a photographing function and a communication function .

1 is a block diagram of a virtual photographing service system according to the present invention.

1, the virtual photographing service system according to the present invention includes a main terminal 100, sub terminals 200a, 200b, and 200c, and a server 300. As shown in FIG.

When the service application is executed, the main terminal 100 drives the camera module and selects a background image type (e.g., real-time image (e.g., still image or video), album And the like).

Then, an invitation message is sent to the sub terminals 200a, 200b, and 200c, that is, the terminals 200A, 200B, and 200C of the to-be-photographed persons through the service application, When the user accesses the service, the user designates the position of each person to be photographed and performs shooting. Thereafter, when the photographing is completed, the photographed image is transmitted to the server 300 side.

When the photographed image is received from the main terminal 100, the server 300 extracts an image of each photographed subject in the received image according to the object extraction technique. In this case, the object extraction technique refers to a technique of detecting an object to be extracted separately from the background image along the outline of the object. Object extraction techniques include object segmentation techniques.

The server 300 inserts (superimposes) each of the extracted images at a designated position of a photograph to complete a final image. Then, the final image is stored in the memory and transmitted to the main terminal 100 and the terminals 200A, 200B, and 200C of the photographing target.

Upon receipt of the invitation message from the main terminal 100, the sub terminals 200a, 200b and 200c execute the service application and accept the invitation according to the user's instructions, ). Then, the camera module is driven to participate in shooting by transmitting a real-time image (e.g., still image or moving image) or a stored image of the album to the main terminal 100 according to a user's selection.

The sub terminals 200a, 200b and 200c display the photographed images of the main terminal 100 on their respective terminal screens in real time in cooperation with the main terminal 100 during photographing, 200c allow users of the mobile terminal 200a to take pose corresponding to their own individuality.

The sub terminals 200a, 200b and 200c may also set a type of chat (for example, a character chat or a voice chat) in advance according to the user's selection, 200c to communicate and communicate with each other.

The main terminal 100 and the sub terminals 200a, 200b and 200c may be a notebook computer, a desktop computer or a mobile communication terminal (for example, a mobile phone, a PDA, a smart phone, or a tablet PC) have.

The main terminal 100 and the sub terminals 200a, 200b and 200c include a camera module, a wireless communication unit, an A / V (Audio / Video) input unit, a user input unit, a sensing unit, an output unit, A feeder, and the like. Not all of the above elements are necessary, and may have more or fewer components.

The main terminal 100 and the sub terminals 200a, 200b, and 200c may have a device or an application for performing a virtual photographing service or may store them in a memory. The virtual photographing service application according to the present invention can be provided by an application purchasing place such as an Android market or an application store and the user can download the service app in advance and install install. The service app according to the present invention may be implemented in a controller (not shown) during manufacture of a terminal, in which case the service app is regarded as a control unit.

2 is a flowchart illustrating an operation of the virtual photographing service system according to the present invention.

2, when a user executes a virtual photographing service application (hereinafter referred to as a 'service app') stored in the terminal 100 (S110), the main terminal 100 ) Drives the camera module and displays a background image type (e.g., a real-time image (e.g., a still image or a moving image), an image of an album Stored image, etc.) and the size of the shot image (e.g., face, half body, whole body, etc.). 3A is an example in which the size of the photographed image is set to 'face'. The setting procedure (for example, the background image type, the size of the photographed image, etc.) may be processed in the following step S150 according to the needs of the user.

Then, the number of people to be photographed (persons to be photographed) is inputted, and the persons to be photographed (for example, friend, family, member, company colleague, etc.) are selected from the phone book provided by the service application (or OS (Operating System) of the terminal). FIG. 3A illustrates a virtual photography service setting screen according to the present invention, in which the number of photographed persons (persons to be photographed) is 4, and the size of the photographed image is set to 'face'. When the size of the photographed image is set to 'face', only the face of the person to be photographed is extracted and inserted into the previously photographed image (for example, a stored image of the album).

When the to-be-photographed persons are selected, the main terminal 100 sends an invitation message to the terminals 200A, 200B, and 200C of the selected to-be-photographed persons through the service application. (S120)

When the invitation message is transmitted to each of the terminals 200A, 200B, and 200C, the user of each of the terminals 200A, 200B, and 200C receiving the invitation message executes the service application and responds to the invitation And connects to a virtual photographing service (e.g., main terminal 100). (S130 to S140)

Then, the camera module provided in each terminal is driven to selectively transmit a live image (e.g., a still image or a moving image) of the user or a stored image of the album to the main terminal 100 To participate in the photographing. FIG. 3B illustrates another setting screen of the virtual shooting service according to the present invention.

As shown in FIG. 3B, the sub terminals 200a, 200b and 200c in real time interlock with the main terminal 100 during the photographing, display the photographed images of the main terminal 100 on their respective terminal screens as they are So that terminal users can view their own images.

The sub terminals 200a, 200b, and 200c may also set a chat type (e.g., a text chat, a voice chat, and the like) to enable communication (communication)

When the terminal 200A, 200B or 200C having received the invitation message completes the service connection (or the main terminal 100), the main terminal 100 sets the position of each photographing target And performs shooting. (S150) The position of the subject to be photographed is specified according to the user's selection through the setting screen D10 of Fig. 3A.

When the photographing is completed, the main terminal 100 transmits the photographed image to the server side 300. (S160) When delivering the photographed image to the server side 300, the main terminal 100 conveys the information (hereinafter, referred to as " front-rear relationship setting information " In the case of FIG. 3A, since the images of the subjects 100, 200A, 200B, and 200C are set to 'face' and the faces of the persons to be imaged do not overlap each other, , If the size of the photographed image is set to 'half-duplex' and the subjects 100, 200A, 200B, and 200C overlap each other as shown in FIG. 5, the fore-to- Must be transmitted to the server 300 side.

Then, when the photographed image is transmitted to the server 300, the server 300 extracts an image of each person to be photographed according to the object extraction technique. (S170)

In this case, the object extraction technique refers to a technique of detecting an object to be extracted separately from the background image along the outline of the object. Object extraction techniques include object segmentation techniques.

The server 300 inserts (superimposes) each of the extracted images at a designated position of a photograph to complete a final image. (S180) The server 300 refers to the fore / aft relation setting information, and inserts the extracted images into a designated position of the photograph.

Then, the final image is stored in the memory and transmitted to the main terminal 100 and the terminals 200A, 200B, and 200C of the photographing target. (S190)

FIG. 4 is an exemplary view of a terminal screen constructed in accordance with the present invention. FIG. 4 illustrates a screen configuration displayed on the screens of the main terminal 100 and the sub terminals 200A, 200B, and 200C during photographing.

In step S150, when the position of each subject is designated, the main terminal 100 displays the image of the subject to be photographed in the area of the designated position, as shown in FIG.

The user of the main terminal 100 sets a chat type (e.g., character, voice, etc.) as a voice and displays the chat type with the users of the sub terminals 200a, 200b and 200c Communicate and communicate.

The sub terminals 200a, 200b and 200c display the photographed images of the main terminal 100 on the respective terminal screens in real time while realizing the shooting with the main terminal 100 in real time. As shown in FIG. 6, users of the terminals 200a, 200b, and 200c can view their own images displayed on the terminal screen and can take appropriate pauses. 6 is a diagram illustrating a sub terminal 200b and a terminal user posing in accordance with the present invention.

5A is a diagram illustrating a screen configuration of the main terminal 100, FIG. 5B is an exemplary view illustrating a screen configuration of the sub terminal 200a, and FIG. 5C FIG. 5D is an exemplary view showing a screen configuration of the sub terminal 200c. FIG.

5A to 5D, in the virtual photographing service according to the present example, the size (e.g., face, half body, whole body, etc.) of the photographed image is set to " 200A, 200B, and 200C when the subjects overlap each other.

5A, the main terminal 100 displays an image of the user of the terminal 100 in the person A area. The main terminal 100 allows the user of the terminal 100 to check his or her own image participating in the photographing by displaying the person A area with priority regardless of the ranking value of the front-rear relation setting information.

In the case of the main terminal 100, the user can activate a desired person area (e.g., a person A area, a person B area, a person C area, and a person D area) as a screen touch. For example, when the user of the terminal 100 wants to check the pose or attire of the user of the sub terminal 200a, the user of the sub terminal 200a is checked by touching the person B area (user of the sub terminal 200a) .

Then, the sub terminal 200a displays the image of the user of the terminal 200a in the person B area, as shown in FIG. 5B. The sub terminal 200a displays the person B area at the front of the screen so that the user of the terminal 200a can check his or her own image participating in the photographing.

Then, the sub terminal 200b displays the user's image in the person C area, as shown in Fig. 5C. Then, as shown in FIG. 5D, the sub terminal 200c displays the user's image in the person D area.

The operation of the present invention described herein can be implemented in a computer-readable recording medium using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, May be implemented by a control unit (or a service application (App) itself).

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in a memory (not shown) and can be executed by a control unit (or a service application (App)).

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. May be constructed by selectively or in combination. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

INDUSTRIAL APPLICABILITY As described above, the present invention implements a virtual photographing service system that allows photographers to take photographs by allowing users at remote locations to participate in an online virtual space.

The present invention implements a service app for a virtual photography service, so that members (or friends, family members, etc.) who can not attend a trip or a meeting are put in, a geese dad who is separated from his family is put in a family photograph, It is expected that it will be easier and more convenient to provide functions such as recording video clips of celebrities (for example, entertainers or sports stars), providing online photo services for fans in online fan clubs.

100: Main terminal 200a, 200b, 200c: Sub terminal
300: server

Claims (8)

The main terminal 100 executing a service application according to a user's operation;
Sending an invitation message to the terminals 200A, 200B, and 200C of the to-be-photographed persons through the executed service application;
A step in which each of the terminals 200A, 200B, and 200C receiving the invitation message executes the service application and accesses the main terminal 100;
When the terminals having received the invitation message complete the connection, the main terminal 100 performs a photographing operation in accordance with a user's instruction;
The main terminal 100 delivers the photographed image to the server side, and the server 300 extracts an image of each person to be photographed according to a predetermined object segmentation technique in the transferred image;
Inserting each extracted image into a designated position on a final image to complete and store the image;
And transmitting the completed image to the terminal 200A, 200B, or 200C of each photographing target,
The process of each terminal that has received the invitation message accesses the main terminal 100
Accepting the invitation and connecting to the main terminal 100;
The method comprising the steps of driving the camera module and transmitting the user's moving image in real time or transmitting the stored image of the album according to the user's selection,
Setting a background image type for virtual photographing by the main terminal (100) when all the terminals receiving the invitation message complete the connection;
Designating a position of a to-be-photographed person on the set background image according to an input of a user;
Further comprising the step of displaying an image of the person to be photographed in an area of each designated location. delete delete 2. The apparatus according to claim 1, wherein the terminals (200A, 200B, 200C)
And displays the screen of the main terminal (100) as it is on the screen of the main terminal (100) in cooperation with the main terminal (100) in real time. The method as claimed in claim 1, wherein each of the terminals, having received the invitation message, accesses the main terminal (100)
And setting a text chat or voice chat with the main terminal (100) according to a user's selection. When an invitation message is sent to the terminals 200A, 200B, and 200C of the to-be-photographed persons through a predetermined service application and the terminals receiving the invitation message complete the connection, the positions of the respective to-be-photographed persons are designated according to the instruction of the user A main terminal 100 for performing photographing;
When the invitation message is received from the main terminal 100, the camera module is driven to transmit a real time image to the main terminal 100 and at least one sub terminal 200a, 200b, 200c )Wow;
When an image photographed from the main terminal 100 is received, an image of each person to be photographed is extracted from the received image according to a predetermined object segmentation technique, and each extracted image is displayed at a designated position on the final image And a server (300) for inserting and completing an image,
The main terminal 100
When all of the terminals receiving the invitation message complete the connection, an image type of the background for virtual photography is set,
Designates the position of the object to be photographed on the set background image according to the input of the user,
And displays the image of the person to be photographed in an area of each designated position. delete 7. The method of claim 6, wherein the at least one sub-terminal (200a, 200b, 200c)
And displays the screen of the main terminal (100) on its own screen in real time in cooperation with the main terminal (100).

Images