WO2015037761A1

WO2015037761A1 - Method for providing multi-angle image service and system using same

Info

Publication number: WO2015037761A1
Application number: PCT/KR2013/008292
Authority: WO
Inventors: 이동채; 유수근
Original assignee: 주식회사 모브릭
Priority date: 2013-09-13
Filing date: 2013-09-13
Publication date: 2015-03-19
Also published as: KR101542416B1; KR20150030889A

Abstract

The present invention relates to a method for providing a multi-angle image service, using a system for providing the multi-angle image service, and, more particularly, to a method for providing a multi-angle image service and a system for executing the method. The method for providing the multi-angle image service comprises the steps of: shooting images by a plurality of image shooting apparatuses, which shoot images from different angles at different locations, respectively; transmitting the shot images to a server by the plurality of image shooting apparatuses; receiving the shot images by the server; generating a multi-angle image on the basis of the received images by the server; transmitting the generated multi-angle image to a user terminal by the server; receiving the multi-angle image by the user terminal; executing an application for reproducing the received multi-angle image by the user terminal; and displaying the received multi-angle image through the executed application.

Description

Method and system for providing multi-angle video service

The present invention relates to a digital broadcasting service providing method and a digital broadcasting service providing system, and more particularly, to a method and system for providing a multi-angle video service for capturing a multi-angle video in a real-time event and providing the captured video to a user. will be.

Recently, with the spread of high-speed communication networks and convergence of broadcasting and communication technologies, IPTV, which allows a user to selectively receive desired contents through a high-speed communication network, has become a major field of the broadcasting communication industry.

In addition to sports broadcasts, viewers often want to focus on the players they want when broadcasting programs that involve multiple people, such as game broadcasts, but existing television broadcast services provide the broadcast screen of the broadcaster's choice through a single channel. do.

In order to improve such a point, a multi-angle broadcasting service has recently been implemented in which a plurality of cameras are arranged in a stadium and the like, and images recorded by cameras having different angles are transmitted through different channels. By changing the channel, the user can watch the video captured from the desired angle.

However, the existing multi-angle service has a problem that it is difficult to build the environment that provides the multi-angle video to the user. Therefore, there is a problem in that a large cost is consumed in constructing a system for providing a multi-angle image.

In addition, even if a multi-angle image is provided by constructing an expensive system, there is a problem that synchronization is not performed or buffering occurs when a user selects a specific angle.

SUMMARY OF THE INVENTION In order to solve the problems of the related art, an object of the present invention is to provide a smooth multi-angle service to a user by taking a different image from each of a plurality of terminals and using the captured images.

In accordance with another aspect of the present invention, a method of providing a multi-angle video service includes: capturing an image from a plurality of photographing apparatuses photographing images of different angles at different positions, respectively; Transmitting images to a server, receiving the captured images at the server, generating a multi-angle image based on the received images, and the server using the generated multi-angle image. Transmitting to the terminal, receiving the multi-angle image at the user terminal, executing a process for the user terminal to play the received multi-angle image, and receiving the received multi through the executed application. And displaying an angle image.

In addition, the multi-angle video service providing system according to another embodiment of the present invention, a plurality of photographing equipment for recording images of different angles at different positions, respectively, and transmits the captured image to the server, the photographed Receiving the images, generating a multi-angle image based on the received images, transmitting the generated multi-angle image to a user terminal, and receiving the multi-angle image from the server, and receiving the received And a user terminal for displaying the received multi-angle image by executing an application for playing a multi-angle image.

Through the method and system for providing a multi-angle video service according to an exemplary embodiment of the present invention, there is an effect of allowing a user to easily view a multi-angle video while allowing a user to conveniently view the multi-angle video.

Accordingly, the multi-angle video can be stably provided to the user. Accordingly, the interest and convenience of the user can be improved, and the use of the multi-angle video service can be promoted.

1 is a diagram illustrating a multi-angle video service providing system according to an exemplary embodiment of the present invention.

2 is a flowchart illustrating steps of a multi-angle image providing method according to an exemplary embodiment of the present invention.

3 is a flowchart illustrating steps of a multi-angle image providing method according to another exemplary embodiment of the present invention.

4 is a diagram illustrating a configuration of photographing equipment according to an embodiment of the present invention.

5 is a diagram illustrating a configuration of a server according to an exemplary embodiment of the present invention.

6 is a diagram illustrating a configuration of a user terminal according to an exemplary embodiment of the present invention.

7 is a diagram illustrating a communication process between a multi-angle video providing terminal and a server according to an exemplary embodiment of the present invention.

8 is a diagram illustrating a communication process between a multi-angle video providing terminal and a server according to another embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. Furthermore, the suffixes "unit" and "device" for components used in the following description are merely given in consideration of ease of preparation of the present specification, and the "unit" and "device" may be used interchangeably with each other. It can be designed in hardware or software.

Furthermore, although an embodiment of the present invention will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, the present invention is not limited or restricted by the embodiments.

According to an embodiment, the plurality of photographing equipments 100 may be connected to the server 200 to perform an operation for providing a multi-angle screen. In other words, when a plurality of photographing apparatuses photographs images at different locations and transmits the photographed images to the server, the server transmits a multi-angle screen including the plurality of images to the user terminal 300 of the subscriber. The multi-angle screen providing service may be performed.

That is, for example, in the case of providing a football game through a multi-angle video service, a plurality of shooting equipment 100 is attached to each helmet of football players, and from the plurality of attached shooting equipment 100 Each image is received by the server 200 to generate a multi-angle screen, and the generated image is displayed through the user terminal 300, so that the user can watch a game from each viewpoint of the player.

In addition, according to an embodiment, the photographing equipment 100 may be various devices that can be photographed while moving, such as an action cam, a smartphone equipped with a camera, a digital camera, and the like. .

In addition, according to an embodiment, the user terminals 300 may be various devices capable of displaying a screen and transmitting / receiving data, such as a smartphone, a tablet PC, a laptop PC, and the like.

The configuration of the photographing equipment 100, the server 200, and the user terminal shown in this figure, and a method for providing a multi-angle video service using the multi-angle video service providing system including the same will be described in detail below.

According to an embodiment, the multi-angle video service providing method using the multi-angle video service providing system may be performed through the steps as shown in the figure.

First, images are respectively taken by a plurality of photographing apparatuses that capture images of different angles at different positions, respectively (S101).

According to an embodiment of the present disclosure, the plurality of photographing apparatuses may photograph the image including information for determining an angle of the photographed image including location information of the plurality of photographing apparatuses.

Next, the plurality of photographing equipment transmits the captured images to the server (S102).

According to an embodiment, a mobile communication network may be used as the transmission means. That is, a 3G communication network or an LTE communication network may be used, and for this, photographing equipment may be subscribed to a mobile communication network. According to another embodiment, when the Wi-Fi communication is possible, the captured images may be transmitted to the server through Wi-Fi communication. That is, not limited to the communication means, various types of communication formats capable of transmitting and receiving data between the server and the photographing equipment can be used. The diversity of the use of the communication format also applies to the communication between the server 200 and the user terminal 300.

Next, the server receives the captured images (S103), and the server generates a multi-angle image based on the received images (S104).

According to an embodiment, in generating the multi-angle image, various image formats such as AVI, MKV, and MOV may be used. In addition, a multi-angle image may be generated by being encrypted so as not to take data from a device other than the subscriber.

Next, the server transmits the generated multi-angle image to the user terminal (S105). According to an exemplary embodiment, subscriber information of the multi-angle video service may be stored in the server, and the multi-angle video may be transmitted to one or more user terminals 300 based on the stored subscription information.

Next, the user terminal receives the multi-angle image (S106), and executes a process for playing the received multi-angle image (S107).

Next, the received multi-angle image is displayed through the executed application (S108).

To this end, in order to provide a multi-angle video service, a user terminal, for example, an application for a smart terminal called an interactive player, a computer program, or a computer software is pre-driven to provide a multi-angle video service. Perform

That is, the multi-angle video service may be provided to the user through the interactive player through the above steps.

Also, in addition to those shown in this figure, steps for synchronizing a multi-angle image may be performed. Hereinafter, the steps for maintaining synchronization in the multi-angle video service will be described.

First, a plurality of photographing apparatuses for capturing images of different angles transmit respective terminal information to a server. That is, according to an embodiment, a plurality of photographing apparatuses may be used to acquire the photographing screens of the angles from each other, and to generate a multi-angle screen through the plurality of photographing apparatuses, the information of the plurality of photographing apparatuses. Can be sent to the server.

Next, the server determines whether the plurality of imaging equipment is a terminal included in a preset shooting group based on the received imaging equipment information. According to an embodiment of the present disclosure, upon receiving the photographing equipment information, the server may determine whether the photographing equipment is the photographing equipment included in the preset photographing group. The shooting group may be, for example, a 'team A' group, and in this case, all shooting equipment attached to the helmets of the players of the team A may be included in the shooting group.

According to an embodiment of the present disclosure, in determining whether the plurality of photographing equipments are photographing equipments included in a preset photographing group, information on photographing equipment is pre-registered with the same group name (eg, A group) in the server. In this case, the photographing equipment may be determined to be photographing equipment included in a preset photographing group. That is, for example, the server may store a group information table, and the table may include and store information items of photographing target equipment.

In addition, when there is a difference between the information on the received photographing equipment and the photographing equipment information previously stored in the server, the server may update the previously recorded photographing equipment information. That is, the server can always keep the shooting equipment information up to date.

On the other hand, according to an embodiment, when the information about the imaging equipment is not registered in the server with the same group name, the imaging equipment may be determined as the imaging equipment not included in the preset imaging group. In this case, for a terminal determined not to be included in the photographing group, a new new group can be created based on the photographing equipment information of the photographing equipment, and the photographing equipment can be selected as a master terminal. That is, a new photographing group may be formed around photographing equipment not included in the photographing group. The server may generate a group table for the generated group, and store information on a synchronization period among the information on the master photographing equipment in the group table. Therefore, a new group is created, and information about the new group can be stored and utilized in the server.

According to an embodiment, when a group information request signal is transmitted to another server from another photographing apparatus not included in the photographing group, the server may transmit information about the created group to the photographing apparatus that has transmitted the request signal. have. That is, the photographing apparatus without the preset photographing group may request group information from the server, and transmit the subscription request signal to the server with reference to this. In addition, when the subscription request signal is received, a request for permission to join a photographing group of another photographing device from a master photographing device. In response, the master photographing device may transmit a subscription permission signal or a subscription not allowed signal to the server after determining whether to subscribe based on a preset criterion.

On the other hand, each photographing equipment can function as a new master terminal by forming a new photographing group by itself, and for this purpose, it transmits a request signal for forming a new group to a server and transmits information about the new group to another terminal You may be encouraged to join. In addition, the terminal to belong to the group may request information on the groups formed so far to the server, it may be a slave terminal by selecting the group to join.

According to an embodiment, the master photographing device, when the subscription request signal is transmitted, displays the relevant menu on the display unit, and receives a subscription permission signal or a subscription disallowed signal by receiving a signal for subscription permission from a user through a user interface unit. Can be generated and transmitted.

In addition, according to another embodiment, one of the plurality of recording equipment, one of the recording equipment is the Master Mode (Master Mode) is On (On), the other recording equipment is the Master Mode (Master Mode) is Off (Off) When the subscription request signal is transmitted, the subscription permission signal is automatically generated and transmitted.

The server may include a photographing device that has transmitted the subscription request signal to the generated group as a slave terminal when receiving a subscription permission signal of the photographing device from the master photographing device to form a photographing group. , Can operate. Therefore, the digital image photographed by the master photographing device and the slave photographing device may be marked by the master photographing device and the slave photographing device according to the marking period reference of the generated group. Therefore, synchronization can be performed based on this marking information.

In addition, according to an embodiment, when the synchronization end signal is received from the master photographing equipment to the server, the server may control to stop the synchronization operation by transmitting the synchronization end signal to each slave photographing equipment.

Next, when it is determined that the server is included in the photographing group, the server transmits synchronization information and a control signal to the photographing apparatuses determined to be included. According to an embodiment, in transmitting the synchronization information and the control signal, the recording device determined to be included in the shooting group in the server, synchronization period information (for example, marking every 5 seconds) and synchronization information delivery method information ( Transmission of a control signal including at least one of synchronization information including at least one of marking or not, and shooting instruction information (eg, recording start / stop / end signal) and shooting information (frames per second, color, size information) Can be. According to an embodiment, the synchronization information transmission method information may include information on whether to mark directly on the image photographed by the photographing apparatus or to store as separate marking information.

In addition, according to an embodiment, the process of transmitting the synchronization information and the control signal is performed in the server, transmitting the synchronization period information to the imaging equipment determined to be included in the shooting group, and transmits the synchronization period information It may be determined whether the photographing preparations of the photographing equipments are completed, and when the photographing preparations are completed, the photographing start signal may be transmitted to the photographing equipments, and the acknowledgment (ACK) signal may be received from the photographing equipment that transmits the photographing start signal. have. That is, the server can control the start of shooting.

Next, an external image is photographed through the photographing apparatus. In addition, the photographing apparatus encodes the photographed image into a digital image, and performs marking on the photographed image based on the received synchronization information to generate marking information. In addition, the photographing apparatus may transmit the encoded image and marking information to the server. According to an embodiment, the marking may be performed on the encoded image and may be encoded after the marking is performed. However, the information on the order is included in the image so that it can be grasped by the decoder.

In addition, according to an embodiment, in performing the marking, the photographing apparatus performs marking on the photographed image according to a preset period based on the synchronization information received from the server. In addition, according to an embodiment, based on the information received from the server, according to a predetermined period, the photographing equipment may transmit the mark information to the server.

According to an embodiment, in performing the marking, the photographing apparatus uses the marking information in the form of dummy data, that is, information on the number of synchronizations, information on time, and information on the image image itself. Inserted into the video material can be stored in the photographing equipment, it can be transmitted to the server.

Further, according to another embodiment, in performing the marking, the imaging equipment may store the mark information in a storage unit of the imaging equipment according to a predetermined period based on the information received from the server. When the encoding is completed in the photographing equipment, the completed encoded image and the mark information stored up to the completion point may be transmitted to the server.

That is, according to an embodiment, when marking is performed, marking information may be immediately transmitted to the server. According to another exemplary embodiment, after the marking information is accumulated to some extent, the marking information may be transmitted to the server.

Through the above steps, the server may receive the encoded image and marking information from the respective photographing equipment, and provide the multi-angle screen service by providing the received information to the user. That is, since the playback time of the captured images may be synchronized using the encoded image and the marking information, the user may be smoothly provided with the multi-angle screen.

In addition, as shown in the figure, when the multi-angle image is displayed on the user terminal 300, the buffer memory may be managed to enable smooth image reproduction. Hereinafter, the steps for managing the buffer memory in the multi-angle video service will be described.

According to an embodiment, the M terminal including the first screen to the second screen, through the N buffer memory including the first buffer memory to the N-th buffer memory sequentially buffered (buffering) A buffer memory management method for simultaneously playing back pictures can be disclosed (M and N are integers greater than 1, N ≧ M).

First, a multi-angle image may be decoded and classified for each angle, and N images may be selected among the classified images. According to an embodiment, in selecting N images, the user terminal may search for an image playback history stored in the user terminal, and based on the searched history, the N angle images having the highest selection frequency may be selected. You can choose to listen.

Next, each of the N images may be stored in each of the buffer memories, and two images having different angles may be selected among the images stored in the buffer memories. According to an embodiment of the present disclosure, the user terminal may search for an image playback history stored in the user terminal, and select two angle images that have been most recently played based on the searched history.

Next, the selected first image and the second image may be displayed on the first screen and the second screen of the user terminal, respectively. Next, a selection signal of a third image having an angle distinct from images displayed on the first screen and the second screen may be input. According to an embodiment, when the user terminal receives the selection signal of the third image, the user terminal may receive the selection signal of the third image through a user interface. Also, according to another exemplary embodiment, the selection signal of the third image, which is automatically generated based on a preset screen change setting, may be input. That is, the screen change signal may be automatically input or may be input by the user.

Next, when the third image is not included among the N selected images, another image except for the first image and the second image is deleted from the buffer memory, and the image is deleted from the buffer memory. The third image may be stored, and the third image may be displayed on the first screen and the first image on the second screen.

That is, the user terminal may provide various angle images to the user through the above steps, and may provide a screen change with minimal waiting time.

In addition, in addition to the above steps, the method of providing a plurality of multi-angle video services may further include receiving a selection signal of a fourth image having an angle distinct from images displayed on the first screen and the second screen. It may include. That is, the additional angle image switching signal may be received.

The method may further include deleting one of the N selected images except for the third image and the first image from the buffer memory, and storing the fourth image in the buffer memory from which the image is deleted. can do. That is, an additional buffer memory update is possible. Next, the fourth image may be displayed on the first screen, and the third image may be displayed on the second screen.

In addition, in the above-described steps, the user terminal may further include buffering the buffer memories to correspond to the order of the images displayed on the screens. That is, the buffering order of the buffer memory may be set based on the user's action cam selection.

In addition, the selection information may be stored in a storage unit of the user terminal. That is, the selection signal of the third image and the selection signal of the fourth image may be stored as an image reproduction history.

FIG. 3 is a diagram illustrating an order in which a multi-angle video service is provided in terms of a multi-angle video service providing system.

First, images are photographed and encoded by a plurality of photographing apparatuses that photograph images of different angles at different positions, respectively (S201).

That is, according to an embodiment, after capturing an image having a specific angle and adding synchronization information for the captured image, and encoding the image, the plurality of photographing apparatuses are transmitted to the server.

Next, images photographed by the plurality of photographing apparatuses are transmitted to the server and collected (S202).

Next, among the collected images, N images are selected according to the shooting group setting (S203), and a multi-angle image is generated based on the selected images. That is, by re-encoding the image into the multi-angle image (S204), a multi-angle image is generated (S205).

Next, when the server transmits the generated multi-angle image to the user terminal (S206), the user terminal receives the multi-angle image, and the user terminal performs a process for playing the received multi-angle image. It executes (S207). That is, the user may display the received multi-angle video through the executed application and receive a multi-angle video service (S208).

Meanwhile, in order to provide a multi-angle video service, a user terminal, for example, an application for a smart terminal called an interactive player, a computer program or computer software is pre-driven to receive a multi-angle video, to execute a playback process, and to display a multi-angle video. Perform.

As described above, a method for providing a multi-angle video service in a system aspect can be described.

According to an embodiment, the photographing apparatus 100 may include a camera unit 110, a synchronization unit 120, a communication unit 130, an encoding unit 140, a transmission unit 150, and a storage unit 160. Can be. The configurations may be configured in hardware / modules. However, one module / unit may be configured to perform a function of another module / unit. That is, it can be integrated or detailed according to needs or purposes.

The camera unit 110 may capture an external image. According to an embodiment, the aperture speed may be automatically adjusted according to the external brightness or the operation speed of the object.

The synchronizer 120 may generate marking information by performing marking based on the synchronization information received from the server. The synchronization information corresponds to information for performing synchronization through markings according to a predetermined period with other photographing apparatuses that capture images of different angles at different positions.

That is, according to an embodiment, the synchronization unit 120 may perform marking on the photographed image at a predetermined period based on the synchronization information received by the imaging device from the server.

The communication unit 130 may transmit the photographing equipment information of the photographing equipment to a server, and receive the synchronization information and the control signal transmitted from the server as determined by the photographing equipment included in the preset photographing group. . The synchronization information may include at least one of synchronization period information and synchronization information delivery method information, and the control signal may include at least one of photographing instruction information and photographing information.

The encoder 140 may encode an image photographed by the camera unit. Various encoding formats according to the MPEG standard may be used, and image formats other than the MPEG standard may also be used depending on the photographing equipment setting. In addition, encoding may be performed by selecting a specific encoding format from a user.

The transmission unit 150 may control to transmit the encoded image and the marking information generated by the photographing apparatus to the server through the communication unit.

The storage unit 160 may store the encoded image and marking information. In some embodiments, the communication unit 130 may transmit the encoded image and marking information stored in the storage unit to the server. The storage unit may be configured with various storage means such as RAM, SSD, HDD, and the like.

According to an embodiment, the server 200 may include a control unit 201, a network interface unit 202, a storage unit 203, a multi-angle video generation unit 204, and a subscriber management unit 205.

The control unit 201 controls the operation of each module of the server.

The network interface unit 202 may transmit / receive data with the photographing equipment 100 and the user terminal 300.

According to an embodiment, a mobile communication network may be used as the transmission and reception means. That is, a 3G communication network or an LTE communication network may be used, and for this, photographing equipment may be subscribed to a mobile communication network. According to another embodiment, when the Wi-Fi communication is possible, the captured images may be transmitted to the server through Wi-Fi communication. That is, the communication format of various methods capable of transmitting and receiving data between the server and the photographing equipment or the user terminal is not limited to the communication means.

The storage unit 203 may store images received from the photographing apparatus 100 or store multi-angle images to be transmitted to the user terminal 300.

The multi-angle image generator 204 may generate and re-encode a multi-angle image based on the images stored in the storage 203. According to an embodiment, various encoding formats according to the MPEG standard may be used, and image formats other than the MPEG standard may also be used according to the photographing equipment setting. In addition, encoding may be performed by selecting a specific encoding format from a user.

The subscriber manager 205 may manage a photographing group of the photographing apparatuses 100 and manage data transmission / reception of the user terminal 300. That is, when not a subscriber or when the subscription period has elapsed, the multi-angle video service may not be provided.

That is, through such a configuration, the server 200 may receive the photographed images, generate a multi-angle image based on the received images, and transmit the generated multi-angle image to the user terminal. .

According to an embodiment, the user terminal may be various devices capable of playing images, such as a smartphone, a smart TV, a PC, a PDA, and the like. In addition, the user terminal 300 may include a buffer memory 301, a decoder 302, a controller 303, a screen switch controller 304, an image switch signal receiver 305, and a display 306. Can be.

The buffer memory 301 may include a first buffer memory to an Nth buffer memory. The buffer memories may be physically divided buffer memories, or one physical buffer memory may be divided into a plurality of buffer memories.

The display unit 306 may simultaneously reproduce the M screens including the first screen to the second screen. That is, by dividing one screen into several areas and displaying respective images on the divided screens, multiple angle screens can be provided to the user.

In the buffer memory and the display portion, M and N are integers larger than 1, that is, plural, and N is larger than M. That is, the number of buffer memories is larger than the number of screens displayed at the same time.

Decoder 302 decodes various angle images. According to an embodiment, images for each angle may be separately transmitted, and according to another embodiment, multiple angle images may be transmitted as one including several angle images in one data file. Therefore, in this case, the decoder can classify the images for each angle while decoding the images.

The controller 303 selects N images among the classified images, stores each of the N images in the buffer memories, and stores different action cams among the images stored in the buffer memories. Two images may be selected to control the display to display the selected first image and the second image on the first screen and the second screen, respectively. That is, the controller 303 performs basic operations for providing various angle images.

The angle conversion signal receiver 305 receives a selection signal of a third image having an action cam that is distinguished from images displayed on the first screen and the second screen.

According to an embodiment, the angle switch signal receiver 305 may receive a selection signal of the third image through a user interface, and according to another embodiment, the angle switch signal receiver 305 may switch a preset screen. The selection signal of the third image, which is automatically generated based on the setting, may be input.

In addition, the screen switching controller 304 may delete one of the N selected images other than the first image and the second image from the buffer memory, and delete the image from the buffer memory and delete the image from the third image. After storing the control, the third image is displayed on the first screen and the first image is displayed on the second screen.

In the drawing, the angle switch signal receiver 305 and the screen switch controller 304 are separately configured, and the angle switch signal receiver 305 is included in the screen switch controller 304. Accordingly, the angle switch signal receiver 305 may be merged with the screen switch controller 304 or may be configured apart from other objects. That is, the components of this drawing are only an embodiment, and each component may be merged or further subdivided.

In addition, according to an embodiment, the angle switching signal receiver 305 may further receive a selection signal of a fourth image having an angle distinct from images displayed on the first screen and the second screen, and correspondingly The controller 303 deletes one of the N selected images other than the third image and the first image from the buffer memory, and deletes the fourth image from the buffer memory from which the image is deleted. After storing, the fourth image may be controlled to be displayed on the first screen and the third image is displayed on the second screen. That is, additional screen switching can be performed.

The user terminal 300 may further include a storage unit (not shown). In this case, the storage unit may store data necessary for driving the user terminal 300, and reproduce the selection signal of the third image and the selection signal of the fourth image, which are input from the angle conversion signal receiver 305, in the image playback. You can save it as a history.

In order to utilize the stored video playback history, the controller 303 searches for the video playback history stored in the user terminal in storing the selected images in the buffer memory according to an embodiment. Based on the retrieved history, N angle images having the highest selection frequency are selected and stored in the buffer memory.

In addition, in order to utilize the stored video playback history, the controller 303 searches the video playback history stored in the user terminal in the first display of the video, according to an embodiment. Based on the history, it is possible to control to select and display the two angle images that have been most recently reproduced.

7 is a diagram illustrating a communication process between a photographing apparatus and a server according to an exemplary embodiment of the present invention.

According to an embodiment, as a result of determining the photographing equipment in the server, when the information on the terminal is pre-registered with the same group name in the server, mutual communication as shown in this figure may be performed.

First, the photographing apparatus 100 transmits the include request command and group name information to be included in the photographing group to the server 200 (JOIN Group_Name and Member_Num).

Next, the server 200 examines the information of the photographing equipment 100 included in the pre-registered photographing group and, if there is a difference, updates and stores the information of the photographing equipment stored in the server. After that, the synchronization period (Sync_Period) information is transmitted to the recording device (100).

Next, when it is determined that each of the terminals is ready for shooting, the server 200 transmits a recording start (Sync_Start) command to the terminal when an artificial judgment or completion of member configuration is detected. Then, an Ack command is received from the photographing device in response to the photographing start signal.

Accordingly, the photographing apparatus may start photographing and perform marking at a period based on the synchronization period information (eg, 5 seconds). In this case, if the value of the synchronization period is '0', the marking information is generated only once at the start of shooting.

Next, when the server 200 determines that it is time to end the shooting synchronization by artificial or systemic determination, the end of the recording (Sync_END) command is transmitted to the recording equipment 100, the shooting end of the recording equipment 100 and Indicate the end of marking.

In addition, according to the embodiment, even during the middle of the shooting, if the request for inclusion of the new imaging equipment is received, the synchronization is performed through the above steps.

8 is a diagram illustrating a communication process between a photographing apparatus and a server according to another exemplary embodiment.

According to an embodiment, as a result of determining the photographing equipment in the server, when the information on the photographing equipment is not registered in the same group name in the server, mutual communication as shown in this figure may be performed.

First, the photographing apparatus 100 may transmit a command (Master Group_Name and Sync_Info) to the server 200 to create a photographing group in which the photographing apparatus is a master photographing apparatus to the server 200. The command may include synchronization information including information on the master photographing apparatus 100 and synchronization period information.

Next, upon receiving the command, the server 200 may newly create a photographing group.

In addition, the group information request signal Get Group_Info may be transmitted from the other photographing apparatus 101 to the server 200 to select a group for photographing synchronization.

Accordingly, the server 200 may transmit information including the group name to the photographing apparatus 101 correspondingly.

In addition, the photographing apparatus 101 may transmit a join request signal JOIN Group_Name to a server in order to be included in a specific photographing group.

Correspondingly, the server 200 transmits a photographing group join permission signal (JOINED Member_Info) to the other photographing equipment 101 to the master photographing equipment 100 to determine whether to permit photographing group subscription. Can be.

Next, the master photographing equipment 101 may determine whether a photographing group is allowed by the photographing equipment 101. That is, the master photographing equipment may transmit a subscription permission signal or a subscription permission signal to the server 200 after determining whether to subscribe based on a preset criterion. If the photographing equipment 101 is subscribed, the photographing equipment 101 is included in the photographing group as a slave photographing equipment.

In addition, when the master photographing equipment determines that the formation of the photographing group is completed at a specific point in time, the recording start (Sync Start) control signal may be notified to the other photographing equipment 101 through the server 200, and the master photographing equipment 100 If you want to end the recording synchronization, by sending a recording end (Sync_End) command to the other recording equipment 101 through the server 200, it is possible to end the recording synchronization. On the other hand, when a new group is connected to the synchronization group during the synchronization shooting, it is possible to configure the shooting group through the above steps.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the above-described specific embodiment, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims

In the multi-angle video service providing method using a multi-angle video service providing system,

Capturing an image from a plurality of photographing apparatuses respectively photographing images of different angles at different positions;

Transmitting images photographed by the plurality of photographing apparatuses to a server;

Receiving the photographed images at the server;

Generating, by the server, a multi-angle image based on the received images;

Transmitting, by the server, the generated multi-angle image to a user terminal;

Receiving the multi-angle image at the user terminal;

Executing, by the user terminal, a process for playing the received multi-angle image; And

And displaying, by the user terminal, the multi-angle video.
The method of claim 1,

Taking the respective images,

The plurality of photographing apparatuses may include photographing the image including information for determining an angle of the photographed image including location information of the plurality of photographing apparatuses, respectively. How to provide angle video service.
The method of claim 1,

Receiving the photographed images in the server,

Determining, by the server, whether the plurality of photographing equipments are photographing equipment included in a preset photographing group based on photographing equipment information received from the photographing equipments;

Transmitting, by the server, synchronization information and a control signal to photographing equipment determined to be included in the photographing group;

Generating marking information by the photographing apparatus by performing marking on the photographed image based on the received synchronization information; And

And transmitting, by the photographing apparatus, the encoded image and marking information to the server.
The method of claim 3,

The transmitting of the synchronization information and the control signal,

The imaging apparatus determined to be included in the photographing group in the server, the control signal including at least one of the synchronization information and at least one of the shooting instruction information and the shooting information including at least one of synchronization period information and synchronization information transmission method information; Multi-angle video service providing method comprising the step of transmitting.
The method of claim 3,

Determining whether the plurality of photographing equipment is a photographing device included in a preset photographing group includes:

Determining information on the photographing equipment as the photographing equipment included in the preset photographing group when the information on the photographing equipment is previously registered with the same group name in the server; And

If there is a difference between the information on the photographing equipment and the information on the recording equipment previously stored in the server, the multi-angle video service providing method comprising the step of updating (up) the previously stored recording equipment information.
The method of claim 3,

Determining whether the plurality of photographing equipment is a photographing device included in a preset photographing group includes:

Determining that the photographing equipment is not included in the preset photographing group when the information on the photographing equipment is not registered in the server with the same group name;

Creating a group for photographing equipment not included in the photographing group based on the information on the photographing equipment and setting the photographing equipment as a master photographing equipment;

Generating a group table for the created group; And

And storing information on a synchronization period among the information on the master photographing equipment in the group table.
The method of claim 6,

When the group information request signal is transmitted from the photographing equipment not included in the photographing group to the server, the server transmitting information on the created group to the photographing equipment which has transmitted the request signal;

Receiving a join request signal for the generated group from a photographing apparatus that transmits information about the group;

Receiving a subscription permission signal of the photographing device from the master photographing device;

When the subscription permission signal is received, including a photographing device that transmits the subscription request signal to the generated group as a slave photographing device; And

And synchronizing the digital image photographed by the master photographing device and the slave photographing device based on marking information generated according to a specific period corresponding to the generated group. Way.
The method of claim 1,

Receiving the multi-angle image in the user terminal,

Classifying the multi-angle image for each angle;

Selecting N images among the classified images;

Storing each of the N images in each of buffer memories of the user terminal;

Selecting two images having different angles from among images stored in the buffer memories;

Displaying the selected first image and the second image on the first screen and the second screen, respectively;

Receiving a selection signal of a third image having an angle distinct from images displayed on the first screen and the second screen;

If the third image is not included among the N selected images, another image except for the first image and the second image is deleted from the buffer memory, and the image is stored in the buffer memory from which the image is deleted. 3 storing an image; And

And displaying the third image on a first screen and displaying the first image on a second screen, wherein M and N are integers greater than 1 and N≥M. .
The method of claim 8,

Receiving a selection signal of a fourth image having an angle distinct from images displayed on the first screen and the second screen;

Deleting one of the N selected images other than the third image and the first image from the buffer memory, and storing the fourth image in the buffer memory from which the image is deleted; And

And displaying the fourth image on a first screen and the third image on a second screen.
The method of claim 9,

And buffering the buffer memories to correspond to the order of the images displayed on the screens.
The method of claim 1,

The server determines whether the plurality of photographing equipments are photographing equipments included in a preset photographing group based on the photographing equipment information transmitted from the photographing equipments, and sets the master photographing equipment and the slave photographing equipment, respectively. step; And

And at least one of the photographing equipments forming a new photographing group by itself and serving as a master photographing apparatus of the new photographing group.
In the multi-angle video service providing system,

A plurality of photographing apparatuses which photograph images of different angles at different positions, and transmit the photographed images to a server;

The server receiving the photographed images, generating a multi-angle image based on the received images, and transmitting the generated multi-angle image to a user terminal; And

And a user terminal configured to receive the multi-angle image from the server and to execute an application for playing the received multi-angle image, to display the received multi-angle image. .
The method of claim 12,

The plurality of photographing equipment,

The method for providing a multi-angle video service, characterized in that for shooting the image including information for determining the angle of the image to be photographed, including the location information of the plurality of photographing equipment in each of the images to be photographed.
The method of claim 12,

The server,

Based on the photographing equipment information transmitted from the photographing equipment, it is determined whether the plurality of photographing equipments are photographing equipments included in a preset photographing group, and the photographing apparatuses are synchronized with photographing equipments determined to be included in the photographing group. Transmit information and control signals,

The photographing equipment,

And performing marking on the photographed image based on the received synchronization information to generate marking information, and transmitting the encoded image and marking information to the server.
The method of claim 14,

The server,

Transmitting, to the photographing apparatuses determined to be included in the photographing group, a control signal including at least one of synchronization information including at least one of synchronization period information and synchronization information transmission method information, and photographing instruction information and photographing information; Multi-angle video service providing system characterized in that.
The method of claim 14,

The server,

When the information on the photographing equipment is pre-registered with the same group name on the server, the photographing equipment is determined as the photographing equipment included in the preset photographing group, and the information on the photographing equipment and the photographing previously stored in the server If there is a difference in equipment information, multi-angle video service providing system, characterized in that for updating (update) the pre-stored recording equipment information.
The method of claim 14,

The server,

When the information on the photographing equipment is not registered in the server with the same group name, the photographing equipment is determined as the photographing equipment not included in the preset photographing group, and based on the information on the photographing equipment, Create a group for the photographing equipment not included in the photographing group, set the photographing equipment as a master photographing equipment, generate a group table for the created group, and synchronize information among the information on the master photographing equipment. Multi-angle video service providing system, characterized in that for storing information about the period in the group table.
The method of claim 17,

The server,

When the group information request signal is transmitted from the photographing equipment not included in the photographing group to the server, the photographing equipment which transmits the request signal is transmitted to the photographing equipment that transmits the request signal, and from the photographing equipment which transmits the information about the group. Receiving a subscription request signal for the generated group, receiving a subscription permission signal of the photographing equipment from the master photographing equipment, and if the subscription permission signal is received, the photographing to send the subscription request signal to the generated group Including a device as a slave (Slave) recording equipment, and synchronizing the digital image photographed by the master imaging device and the slave imaging device based on the marking information generated according to a specific period corresponding to the generated group. Multi-angle video service providing system.
The method of claim 12,

The user terminal,

Classify the multi-angle image by angle, select N images among the classified images, store each of the N images in buffer memories of the user terminal, and store the images in the buffer memories. Among them, two images having different angles are selected, and the selected first image and the second image are displayed on the first screen and the second screen, respectively, and the images displayed on the first screen and the second screen. When a selection signal of a third image having an angle distinct from the first and second images is received, and the third image is not included among the N selected images, the other image except for the first image and the second image is received. Deletes the third image from the buffer memory, stores the third image in the buffer memory from which the image is deleted, displays the third image on a first screen, and displays the first image on a second screen. Multi-angle video service providing system, characterized in that M and N is an integer greater than 1, N≥M.
The method of claim 19,

The user terminal,

When the selection signal of the fourth image having an angle distinct from the images displayed on the first screen and the second screen is received, the other of the N selected images except for the third image and the first image is selected. And deleting the image from the buffer memory, storing the fourth image in the buffer memory from which the image is deleted, and displaying the fourth image on the first screen and the third image on the second screen. Multi-angle video service providing system.
The method of claim 20,

The user terminal,

And buffering the buffer memories to correspond to the order of the images displayed on the screens.
The method of claim 12,

The server determines whether the plurality of photographing equipments are photographing equipments included in a preset photographing group based on photographing equipment information transmitted from the photographing equipments, and sets a master photographing equipment and a slave photographing equipment, respectively. ,

At least one of the photographing equipment, a multi-angle video service providing system, characterized in that to form a new photographing group by itself to function as a master photographing equipment of the new photographing group.