KR20150030889A - Method and apparatus for providing multi angle video broadcasting service - Google Patents

Method and apparatus for providing multi angle video broadcasting service Download PDF

Info

Publication number
KR20150030889A
KR20150030889A KR20130110196A KR20130110196A KR20150030889A KR 20150030889 A KR20150030889 A KR 20150030889A KR 20130110196 A KR20130110196 A KR 20130110196A KR 20130110196 A KR20130110196 A KR 20130110196A KR 20150030889 A KR20150030889 A KR 20150030889A
Authority
KR
South Korea
Prior art keywords
photographing
image
information
group
server
Prior art date
Application number
KR20130110196A
Other languages
Korean (ko)
Other versions
KR101542416B1 (en
Inventor
이동채
유수근
Original Assignee
주식회사 모브릭
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 모브릭 filed Critical 주식회사 모브릭
Priority to KR1020130110196A priority Critical patent/KR101542416B1/en
Priority to PCT/KR2013/008292 priority patent/WO2015037761A1/en
Publication of KR20150030889A publication Critical patent/KR20150030889A/en
Application granted granted Critical
Publication of KR101542416B1 publication Critical patent/KR101542416B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64—Addressing
    • H04N21/6405—Multicasting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H04N21/2396—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests characterized by admission policies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The present invention relates to a multi-angle video service providing method using a multi-angle video service providing system and, more specifically, to a multi-angle video service providing method and a system to perform the method. The multi-angle video service providing method includes the following steps in which: multiple shooting devices shooting videos from different angles at different positions respectively photograph a video; the multiple shooting devices transmit the shot videos to a server; the server receives the shot videos; the server generates a multi-angle video based on the received videos; the server transmits the generated multi-angle video to a user terminal; the user terminal receives the multi-angle video; the user terminal executes an application for playing the received multi-angle video; and the executed application displays the received multi-angle video.

Description

[0001] METHOD AND APPARATUS FOR PROVIDING MULTI-ANGLE VIDEO BROADCASTING SERVICE [0002]

The present invention relates to a digital broadcast service providing method and a digital broadcast service providing system, and more particularly, to a method and system for providing a multi-angle image service in which a multi-angle image is captured in a real- will be.

Recently, according to the spread of broadband communication networks and convergence of broadcasting and communication technologies, IPTV, which enables users to selectively receive desired contents through a high-speed communication network, is becoming a major field of the broadcasting communication industry.

In addition to sports broadcasting, when broadcasting a program in which a plurality of people participate, such as a game broadcast, viewers often want to concentrate on the player desired by the viewer. However, the existing television broadcasting service provides the editing screen selected by the broadcasting company through a single channel do.

In order to solve this problem, a multi-angle broadcasting service in which a plurality of cameras are arranged in a stadium and the like and video images shot by cameras at different angles are transmitted through different channels is being implemented. The user can view the image photographed at an angle desired by the user through the channel change.

However, the conventional multi-angle service has a problem that it is difficult to shoot the multi-angle image and to construct an environment for providing it to the user. Therefore, there is a problem that a large amount of cost is required to construct a system for providing a multi-angle image.

In addition, even if a multi-angle image is provided by constructing an expensive system, there arises a problem that the user does not synchronize with a specific angle, or buffering occurs.

Korean Laid-Open Patent No. 10-2013-0039521 (Publication date 201.04.22)

SUMMARY OF THE INVENTION It is an object of the present invention to provide a multi-angle service in which a plurality of terminals photograph different images and use the captured images to provide a smooth multi-angle service to a user.

A method of providing a multi-angle image service according to an exemplary embodiment of the present invention includes the steps of photographing images from a plurality of photographing equipments that respectively photograph angles of different angles at different positions, The method comprising: transmitting images to a server; receiving the photographed images from the server; generating a multi-angle image based on the received images by the server; Angle video to the user terminal, receiving the multi-angle video from the user terminal, executing a process for the user terminal to play the received multi-angle video, and transmitting the received multi- And displaying the angle image.

In another aspect of the present invention, there is provided a system for providing a multi-angle image service, comprising: a plurality of photographing devices for photographing images of angles at different angles from each other and transmitting the photographed images to a server; The server receives the images, generates a multi-angle image based on the received images, and transmits the generated multi-angle image to a user terminal, and receives the multi-angle image from the server, And a user terminal for executing an application for reproducing a multi-angle image and displaying the received multi-angle image.

The method and system for providing a multi-angle image service according to an embodiment of the present invention can easily photograph a multi-angle image and allow a user to conveniently view the multi-angle image.

Accordingly, it is possible to stably provide the multi-angle image to the user, thereby improving the user's interest and convenience, and promoting the use of the multi-angle image service.

1 is a diagram illustrating a system for providing a multi-angle image service according to an embodiment of the present invention.
2 is a flowchart illustrating steps of a method for providing a multi-angle image according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating steps of a method for providing a multi-angle image according to another embodiment of the present invention.
FIG. 4 is a diagram illustrating the configuration of an imaging device according to an embodiment of the present invention.
5 is a diagram illustrating a configuration of a server according to an embodiment of the present invention.
6 is a diagram illustrating a configuration of a user terminal according to an embodiment of the present invention.
7 is a diagram illustrating a communication process between a multi-angle image providing terminal and a server according to an exemplary embodiment of the present invention.
8 is a diagram illustrating a communication process between a multi-angle image providing terminal and a server according to another embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. Further, the suffix "part" and "device ", for the components used in the following description are given merely for ease of description in the present specification, And can be designed in hardware or software.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

1 is a diagram illustrating a system for providing a multi-angle image service according to an embodiment of the present invention.

According to an embodiment, a plurality of imaging devices 100 may be connected to the server 200 to perform an operation for providing a multi-angle screen. That is, when a plurality of photographing apparatuses capture an image at different positions and transmit the captured images to a server, the server transmits the multi-angle screen including the plurality of images to the user terminal 300 of the subscriber , A multi-angle screen providing service can be performed.

That is, for example, in a case where a football game is provided through a multi-angle image service, a plurality of shooting equipment 100 is attached to each helmet of football players, and the plurality of shooting equipment 100 Each of the images is received by the server 200 to generate a multi-angle screen, and the generated image is displayed through the user terminal 300, so that the user can enjoy the game at each point of view of the player.

In addition, according to the embodiment, the imaging devices 100 may be various devices capable of moving while photographing, such as an action cam, a smart phone equipped with a camera, a digital camera, and the like .

In addition, according to the embodiment, the user terminals 300 may be various devices capable of displaying a screen such as a smart phone, a tablet PC, a laptop PC, and the like, and capable of transmitting and receiving data.

The configuration of the photographing equipment 100, the server 200, and the user terminal shown in the figure and a method of providing a multi-angle image service using the multi-angle image service providing system including them will be described in detail below.

2 is a flowchart illustrating steps of a method for providing a multi-angle image according to an exemplary embodiment of the present invention.

According to an embodiment, a method for providing a multi-angle image service using a multi-angle image service providing system can be performed through the steps as shown in the figure.

First, images are taken from a plurality of photographing equipments which respectively photograph angles of different angles at different positions (S101).

According to an embodiment of the present invention, the plurality of photographing equipments can photograph the image including the position information of the plurality of photographing equipments in the photographed image, respectively, including information for determining the angle of the photographed image.

Next, the plurality of photographing devices transmit the photographed images to the server (S102).

According to an embodiment, a mobile communication network may be used as said transmitting means. That is, a 3G communication network or an LTE communication network may be used, and photographing equipment may be subscribed to the mobile communication network. In addition, according to another embodiment, if the area is Wi-Fi communication, the photographed images can be transmitted to the server via Wi-Fi communication. That is, various communication formats that can transmit and receive data between the server and the photographing equipment can be used without being limited to the communication means. The diversity of the use of the communication format is the same also in the case of communication between the server 200 and the user terminal 300.

Next, the server receives the photographed images (S103), and the server generates a multi-angle image based on the received images (S104).

According to the embodiment, various image formats such as AVI, MKV, and MOV can be used in the generation of the multi-angle image. In addition, a multi-angle image can be generated by encrypting data from a device other than the subscriber.

Next, the server transmits the generated multi-angle image to the user terminal (S105). According to an exemplary embodiment, the server may store subscriber information of the multi-angle image service, and may transmit the multi-angle image to one or more user terminals 300 based on the stored subscription information.

Next, the user terminal receives the multi-angle image (S106) and executes a process for reproducing the received multi-angle image (S107).

Next, the received multi-angle image is displayed through the executed application (S108).

For this purpose, in order to provide a multi-angle video service, a smart terminal application, a computer program or a computer software, for example, called an interactive player, is provided in advance in the user terminal so that the reception and reproduction process of the multi- .

That is, the multi-angle image service can be provided to the user through the interactive player through the above steps.

Further, in addition to those shown in the figure, steps for synchronization of a multi-angle image can be performed. Hereinafter, steps for maintaining synchronization in the multi-angle image service will be described.

First, a plurality of photographing equipments for photographing images of different angles transmit respective terminal information to a server. That is, according to the embodiment, a plurality of photographing equipments can be used to acquire an angle photographing screen of each other, and in order to generate a multi-angle view through the plurality of photographing equipments, Can be transmitted to the server.

Next, the server determines whether the plurality of photographing apparatuses are included in a predetermined photographing group, based on the received photographing apparatus information. According to the embodiment, upon receiving the photographing equipment information, the server can determine whether any photographing equipment is the photographing equipment included in the predetermined photographing group. The shooting group may be, for example, the 'A team' group, in which case all the shooting equipment attached to the helmet of the team A players may be included in the shooting group.

According to an embodiment of the present invention, when determining whether or not the plurality of photographing apparatuses are photographing apparatuses included in a predetermined photographing group, information about photographing apparatuses is previously registered in the server as the same group name (e.g., group A) , The photographing equipment can be determined as the photographing equipment included in the predetermined photographing group. That is, for example, the server may store a group information table, and the table may include an information item of the photographing apparatuses to be included and stored.

In addition, the server may update the pre-stored photographing equipment information when there is a difference between the information about the received photographing equipment and the photographing equipment information previously stored in the server. In other words, the server can always keep the imaging equipment information up-to-date.

On the other hand, according to the embodiment, when the information about the photographing equipment is not registered in the server with the same group name, the photographing equipment can be determined as the photographing equipment not included in the predetermined photographing group. In this case, it is possible to create a new new group on the basis of the photographing equipment information of the photographing equipment, and to select the photographing equipment as a master terminal, for the terminal determined not to be included in the photographing group. That is, a new photographing group can be constituted mainly by photographing equipment not included in the photographing group. In addition, the server may generate a group table for the created group, and may store, in the group table, information about the synchronization period from the information about the master photographing equipment. Thus, a new group is created and information about the new group can be stored and utilized in the server.

According to the embodiment, when the group information request signal is transmitted from another photographing equipment not included in the photographing group to the server, the server can transmit the information about the group to the photographing equipment that transmitted the request signal have. That is, the photographing device having no preset photographing group can request the group information from the server, and transmit the registration request signal to the server with reference to the group information. In addition, when the subscription request signal is received, the master photographing device requests a photographing group registration permission signal of another photographing device. In response to this, the master photographing equipment can determine whether or not to join based on a predetermined criterion, and then transmit a subscription permission signal or an unsubscribe signal to the server.

Meanwhile, all the photographing equipments themselves can form a new photographing group and function as a new master terminal. To this end, a request signal for forming a new group is transmitted to the server and information about a new group is transmitted to another terminal May lead to subscription. In addition, the terminal desiring to belong to the group may request information on the groups formed up to now in the server, or may select a group to be subscribed and become a slave terminal.

According to the embodiment, when the subscription request signal is transmitted, the master photographing apparatus displays a related menu on the display unit and receives a subscription permission signal or a subscription permission signal from the user through the user interface unit, Lt; / RTI >

According to another embodiment of the present invention, any one of the plurality of photographing equipments has a master mode of On, and the other photographing equipments have a master mode of Off, If the subscription request signal is transmitted, the subscription permission signal is automatically generated and transmitted.

In addition, when the subscription permission signal of the photographing equipment is received from the master photographing equipment, the server includes a photographing equipment that transmits the subscription request signal to the generated group as a slave terminal to configure a photographing group . Accordingly, the digital image photographed by the master photographic equipment and the slave photographic equipment can be marked in the master photographic equipment and the slave photographic equipment according to the marking cycle criterion of the generated group. Thus, synchronization can be performed based on this marking information.

According to an embodiment of the present invention, when a synchronization termination signal is received from the master photographing equipment, the server may transmit the synchronization termination signal to each slave photographing equipment so as to perform a synchronization operation.

Next, the server transmits synchronization information and a control signal to the photographing equipments determined to be included when it is determined that the photographing group is included in the photographing group. According to an embodiment of the present invention, in transmitting the synchronization information and the control signal, the synchronization period information (e.g., marking every 5 seconds) and the synchronization information transmission method information (Photographing start / stop / end signal) and photographing information (frame number, color, size information per second) including at least one of the presence / absence of the mark . According to an embodiment, the synchronization information transfer method information may include information on whether to directly mark an image photographed by the photographing equipment, or whether to store the marking information as separate marking information.

According to an exemplary embodiment of the present invention, the step of transmitting the synchronization information and the control signal to the server may include transmitting synchronization period information to the imaging devices determined to be included in the imaging group, (ACK) signal from the photographing equipment which has transmitted the photographing start signal to the photographing equipment when the photographing preparation of the photographing equipment is completed have. That is, the server can control the start of shooting.

Next, an external image is photographed through the photographing equipment. The photographing equipment encodes the photographed image into a digital image, and performs marking on the photographed image based on the received synchronization information to generate marking information. In addition, the imaging equipment may transmit the encoded image and marking information to the server. According to an embodiment, the marking can be performed on the encoded image and can be encoded after the marking is performed. However, information on such a sequence may be included in the image so that it can be recognized by a decoder.

According to an embodiment of the present invention, in performing the marking, the photographing equipment performs marking on the photographed image according to a predetermined period based on synchronization information received from the server. According to the embodiment, the photographing equipment can transmit the mark information to the server according to a predetermined period based on the information received from the server.

According to the embodiment, in performing the marking, the photographing equipment may store the marking information in the form of dummy data, for example, information about a certain synchronization, information about time, information about the image itself Inserted into the video material, stored in the imaging equipment, and transmitted to the server.

According to another embodiment of the present invention, in performing the marking, the photographing equipment may store mark information in a storage unit of the photographing equipment according to a predetermined period based on information received from the server, When the encoding is completed in the photographing equipment, the completed encoded image and the mark information stored until the completion time can be transmitted to the server.

That is, according to the embodiment, the marking information can be immediately transmitted to the server, and according to another embodiment, after the marking information is accumulated to some extent, the accumulated marking information can be transmitted to the server.

Through the above steps, the server can receive the encoded image and marking information from each photographing equipment, and provide the received information to the user, thereby providing the multi-angle screen service. That is, since the reproduction time of the photographed images can be synchronized using the encoded image and the marking information, the user can smoothly receive the multi-angle screen.

In addition, when the multi-angle image is displayed on the user terminal 300, the buffer memory can be managed to facilitate smooth image reproduction. Hereinafter, steps for managing the buffer memory in the multi-angle image service will be described.

According to an embodiment of the present invention, in a user terminal, M buffer memories including a first screen and a second screen are sequentially provided through N buffer memories including a first buffer memory to an Nth buffer memory sequentially buffered A buffer memory management method for simultaneously reproducing screens can be disclosed (M and N are integers greater than 1, N? M).

First, a multi-angle image can be decoded and classified by each angle, and N images among the classified images can be selected. According to an embodiment, in selecting N images, the user terminal can search the image playback history stored in the user terminal, and based on the searched history, Can be selected.

Next, each of the N images may be stored in each of the buffer memories, and two images having different angles may be selected from the images stored in the buffer memories. According to an embodiment, the user terminal may search for an image playback history stored in the user terminal, and may select the two most recently reproduced angle images based on the searched history.

Next, the selected first and second images may be displayed on the first and second screens of the user terminal, respectively. Next, a selection signal of a third image having an angle separated from the images displayed on the first and second screens may be received. According to the embodiment, when the user terminal receives the selection signal of the third image, the selection signal of the third image may be inputted through the user interface. According to another embodiment, the selection signal of the third image, which is automatically generated based on the preset screen switching setting, can be received. That is, the screen switching signal may be input automatically or may be inputted by the user.

If the third image is not included in the N selected images, another image other than the first image and the second image is deleted from the buffer memory, and the image is deleted from the buffer memory The third image can be stored, and the third image can be displayed on the first screen and the first image can be displayed on the second screen.

That is, through the above steps, the user terminal can provide a plurality of angle images to the user and can provide a screen switching with minimum waiting time.

In addition to the above steps, the plurality of multi-angle image service providing methods may include receiving a selection signal of a fourth image having an angle separated from the images displayed on the first and second screens, . That is, an additional angle image switching signal can be received.

The method may further include deleting one of the N selected images other than the third image and the first image from the buffer memory and storing the fourth image in the buffer memory in which the image is deleted can do. That is, additional buffer memory updates are possible. Next, the fourth image may be displayed on the first screen and the third image may be displayed on the second screen.

In addition, in the above-described steps, the user terminal may further include buffering the buffer memories to correspond to the order of images displayed on the screens. That is, the buffering order of the buffer memory can be set based on the selection of the action cam of the user.

In addition, the selection information may be stored in a storage unit of the user terminal. That is, the selection signal of the third video and the selection signal of the fourth video can be stored as a video playback history.

3 is a flowchart illustrating steps of a method for providing a multi-angle image according to another embodiment of the present invention.

This figure shows a sequence in which a multi-angle image service is provided in the aspect of a multi-angle image service providing system.

First, images are respectively captured in a plurality of photographing equipments which respectively photograph angles of different angles at different positions (S201).

In other words, according to the embodiment, image capturing with a specific angle in a plurality of photographing equipments, addition of synchronization information on the photographed image, and image encoding are performed and then transmitted to the server.

Next, photographed images of the plurality of photographing equipments are transmitted to a server and collected (S202).

Next, among the collected images, N images are selected according to the shooting group setting (S203), and a multi-angle image is generated based on the selected images. That is, by re-encoding the image with the multi-angle image (S204), the multi-angle image is generated (S205).

Next, when the server transmits the generated multi-angle image to the user terminal (S206), the user terminal receives the multi-angle image and the user terminal processes the received multi-angle image (S207). That is, the user can receive the multi-angle image service by displaying the received multi-angle image through the executed application (S208).

Meanwhile, in order to provide a multi-angle image service, a smart terminal application, a computer program or a computer software, for example, called an interactive player, is preliminarily driven in a user terminal so that a multi-angle image receiving and playback process is executed and a multi- .

As described above, a method of providing a multi-angle image service in terms of system can be described.

FIG. 4 is a diagram illustrating the configuration of an imaging device according to an embodiment of the present invention.

The imaging device 100 includes a camera unit 110, a synchronization unit 120, a communication unit 130, an encoding unit 140, a transmission unit 150, and a storage unit 160 . The above configurations can be configured by hardware / module / module. However, one module / unit may be configured to perform the function of another module / unit. That is, they can be configured integrally or in detail, depending on the need or purpose.

The camera unit 110 can take an external image. Depending on the embodiment, the aperture speed and the like can be automatically adjusted according to the brightness of the outside or the operation speed of the object.

The synchronization unit 120 may generate marking information by performing marking based on the synchronization information received from the server. The synchronization information corresponds to information that enables synchronization to be performed through marking according to a predetermined period with other photographing apparatuses that respectively photograph images of different angles at different positions.

That is, according to the embodiment, the synchronization unit 120 may perform marking on the photographed image according to a predetermined period based on the synchronization information received by the photographing equipment from the server.

The communication unit 130 may transmit the photographing equipment information of the photographing equipment to the server and receive the synchronization information and the control signal transmitted from the server as the photographing equipment is determined as the photographing equipment included in the predetermined photographing group . In addition, the synchronization information may include at least one of synchronization period information and synchronization information transmission method information, and the control signal may include at least one of photographing position information and photographing information.

The encoding unit 140 may encode the image captured by the camera unit. Various encoding formats according to the MPEG standard can be used, and video formats other than the MPEG standard can be used according to the photographing equipment setting. Also, a user can select a specific encoding format and perform encoding.

The transmission unit 150 may control the image encoding apparatus and the generated marking information to be transmitted to the server through the communication unit.

The storage unit 160 may store the encoded image and marking information, and the communication unit 130 may transmit the encoded image and marking information stored in the storage unit to the server according to an embodiment. The storage unit may include various storage units such as a RAM, an SSD, and a HDD.

5 is a diagram illustrating a configuration of a server according to an embodiment of the present invention.

The server 200 may include a control unit 201, a network interface unit 202, a storage unit 203, a multi-angle image generation unit 204, and a subscriber management unit 205. [

The control unit 201 controls the operation of each module of the server.

The network interface unit 202 can transmit and receive data to and from the imaging equipment 100 and the user terminal 300.

According to an embodiment, a mobile communication network may be used as the transmitting and receiving means. That is, a 3G communication network or an LTE communication network may be used, and photographing equipment may be subscribed to the mobile communication network. In addition, according to another embodiment, if the area is Wi-Fi communication, the photographed images can be transmitted to the server via Wi-Fi communication. That is, various communication formats that can transmit and receive data between the server and the photographing equipment or the user terminal can be used without being limited to the communication means.

The storage unit 203 may store images received from the imaging equipment 100 or may store multi-angle images to be transmitted to the user terminal 300. [

The multi-angle image generation unit 204 may generate a multi-angle image based on the images stored in the storage unit 203 and re-encode the multi-angle image. According to the embodiment, various encoding formats according to the MPEG standard can be used, and video formats other than the MPEG standard can be used according to the photographing equipment setting. Also, a user can select a specific encoding format and perform encoding.

The subscriber management unit 205 can manage the photographing groups of the photographing apparatuses 100 and can manage data transmission / reception with respect to the user terminal 300. [ That is, when the subscriber is not a subscriber, or the subscription period is over, the multi-angle video service may not be provided.

That is, through the above-described configuration, the server 200 can receive the photographed images, generate a multi-angle image based on the received images, and transmit the generated multi-angle image to the user terminal .

6 is a diagram illustrating a configuration of a user terminal according to an embodiment of the present invention.

According to the embodiment, the user terminal may be various devices capable of image playback such as a smartphone, a smart TV, a PC, and a PDA. The user terminal 300 includes a buffer memory 301, a decoder 302, a control unit 303, a screen switching control unit 304, a video switching signal receiving unit 305, and a display unit 306 .

The buffer memory 301 may include a first buffer memory to an Nth buffer memory. The buffer memories may be physically separated buffer memories, and one physical buffer memory may be divided into a plurality of buffer memories.

The display unit 306 may simultaneously reproduce M pictures including the first screen and the second screen. That is, a plurality of angle screens can be provided to a user by dividing one screen into a plurality of areas and displaying the respective images on the divided screens.

In the buffer memory and the display unit, M and N are integers larger than 1, that is, a plurality, and N is larger than M. That is, the number of buffer memories is larger than the number of screens simultaneously displayed.

A decoder 302 decodes a plurality of angle images. According to an embodiment, an image for each angle may be separately transmitted from several angle images, and according to another embodiment, a plurality of angle images may be included in one data file and transmitted as one. Accordingly, in this case, the decoder can decode the images and classify the images for each angle.

The control unit 303 selects N images among the classified images, stores each of the N images in each of the buffer memories, selects one of the images stored in the buffer memories, And to display the selected first and second images on the first and second screens, respectively. That is, the control unit 303 performs basic operations for providing multiple angle images.

The angle switching signal receiving unit 305 receives a selection signal of a third image having an action cam distinguished from the images displayed on the first and second screens.

According to an embodiment, the angle switching signal receiving unit 305 may receive the selection signal of the third image through a user interface. According to another embodiment, the angle switching signal receiving unit 305 may receive And receives the selection signal of the third image that is automatically generated based on the setting.

In addition, the screen switching control unit 304 deletes one of the N selected images other than the first and second images from the buffer memory, and stores the third image And controls to display the third image on the first screen and the first image on the second screen.

Although the angle switching signal receiving unit 305 and the screen switching control unit 304 are separately configured and the angle switching signal receiving unit 305 is included in the screen switching control unit 304 in this figure, The angle switching signal receiving unit 305 may be merged with the screen switching control unit 304 and may be configured as a separate object. That is, the configurations of the drawings are merely one embodiment, and each configuration may be merged or further subdivided.

Further, according to the embodiment, the angle switching signal receiving unit 305 may further receive a selection signal of a fourth image having an angle separated from the images displayed on the first and second screens, The control unit 303 deletes one of the N selected images other than the third image and the first image from the buffer memory and stores the fourth image in the buffer memory in which the image is deleted The control unit may control to display the fourth image on the first screen and the third image on the second screen. In other words, additional screen switching can be performed.

The user terminal 300 may further include a storage unit (not shown). In this case, the storage unit may store data necessary for driving the user terminal 300, and may output the selection signal of the third image and the selection signal of the fourth image, which are input from the angle switching signal receiving unit 305, It can be saved as a history.

In order to utilize the stored image playback history, the controller 303 searches the image playback history stored in the user terminal for storing images selected in the buffer memory, Based on the retrieved history, N angle images having the highest selection frequency are selected and stored in the buffer memory.

In order to utilize the stored image playback history, the control unit 303 searches the image playback history stored in the user terminal for the first time displaying the image according to the embodiment, Based on the history, it is possible to control to select and display the two most recently reproduced angle images.

7 is a diagram illustrating a communication process between a photographing device and a server according to an embodiment of the present invention.

According to an embodiment of the present invention, when information about a terminal is previously registered in the server with the same group name as a result of the determination of a photographing equipment in the server, mutual communication as shown in the figure can be performed.

First, the photographing apparatus 100 transmits an include request command and group name information to be included in the photographing group to the server 200 (JOIN Group_Name and Member_Num).

Next, the server 200 examines the information of the photographing apparatus 100 included in the pre-registered photographing group, updates the information of the photographing apparatus stored in the server and stores And transmits the synchronization period (Sync_Period) information to the photographing apparatus 100.

Next, when it is determined that each of the terminals is ready to take a picture, the server 200 transmits a start (Sync_Start) command to the terminal when an artificial judgment or completion of member configuration is detected. Then, a response (Ack) command to the photographing start signal is received from the photographing equipment.

Therefore, the imaging equipment can start shooting, and performs marking according to a cycle based on the synchronization period information (e.g., 5 seconds). At this time, if the value of the synchronization period is '0', marking information is generated only once at the photographing start time.

Next, when the server 200 determines that it is time to end the photographing synchronization by an artificial or systematic judgment, it transmits a Sync_END command to the photographing apparatus 100 to end the photographing of the photographing apparatus 100 Indicates the end of marking.

In addition, according to the embodiment, when a command to include a new imaging equipment is received even during shooting, synchronization is performed through the above steps.

8 is a diagram illustrating a communication process between a photographing device and a server according to another embodiment of the present invention.

According to the embodiment, if the server determines that the photographing equipment is not registered in the server with the same group name, the mutual communication as shown in the figure may be performed.

First, the imaging apparatus 100 may transmit commands (Master Group_Name and Sync_Info) to the server 200 to create a photographing group in which the photographing apparatus is a master photographing apparatus, to the server 200. The command may include information about the master photographing apparatus 100, synchronization information including synchronization period information.

Next, when the server 200 receives the command, the server 200 can newly create an imaging group.

Further, a group information request signal (Get Group_Info) for selecting a group for photographing synchronization may be transmitted from another photographing apparatus 101 to the server 200. [

Accordingly, the server 200 can transmit the information including the group name to the photographing apparatus 101 in response thereto.

In addition, the photographing apparatus 101 may transmit a join request signal (JOIN Group_Name) to a server to be included in a specific photographing group.

In response to this, the server 200 transmits to the master photographing apparatus 100 a photograph group join permission signal (JOINED Member_Info) with respect to the other photographing apparatus 101 to determine whether or not the photograph group enrollment is permitted .

Next, the master photographing apparatus 101 can determine whether the photographing apparatus 101 is allowed to take a photograph. In other words, the master photographing device can determine whether to join according to a predetermined criterion, and then transmit a subscription permission signal or an unsubscribe signal to the server 200 to the server 200. If the photographing apparatus 101 is subscribed to, it is included in the photographing group as a slave photographing apparatus.

When the master photographing apparatus determines that the formation of the photographing group is completed at a specific point in time, it can notify the other photographing apparatus 101 through the server 200 of the start of photographing (Sync Start) (Sync_End) command is transmitted to the other photographing apparatus 101 through the server 200, the photographing synchronization can be terminated. On the other hand, when a new photographing device is connected during the synchronization photographing, the photographing group can be configured through the steps as described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

100: Photographic equipment
200: Server
300: User terminal

Claims (22)

A method for providing a multi-angle image service using a multi-angle image service providing system,
The method comprising the steps of: capturing an image in a plurality of photographing apparatuses for respectively photographing angles at different angles;
Transmitting the photographed images of the plurality of photographing equipments to a server;
Receiving the photographed images from the server;
The server generating a multi-angle image based on the received images;
The server transmitting the generated multi-angle image to a user terminal;
Receiving the multi-angle image from the user terminal;
Executing a process for the user terminal to reproduce the received multi-angle image; And
And displaying the multi-angle image by the user terminal. The method according to claim 1,
The method of claim 1,
Wherein each of the plurality of photographing equipments includes information for determining an angle of an image to be photographed including positional information of the plurality of photographing equipments on an image to be photographed, A method of providing an angle video service. The method according to claim 1,
Wherein the receiving of the photographed images at the server comprises:
Determining whether the plurality of imaging devices are imaging devices included in a predetermined imaging group based on imaging device information transmitted from the imaging devices;
Transmitting, at the server, synchronization information and a control signal to photography equipments judged to be included in the photographing group;
The photographing equipment performing marking on the photographed image based on the received synchronization information to generate marking information; And
Wherein the photographing equipment transmits the encoded image and marking information to the server. The method of claim 3,
Wherein the step of transmitting the synchronization information and the control signal comprises:
And a control signal including at least one of synchronization information, photographing position information, and photographing information including at least one of synchronization period information and synchronization information transmission method information, to the photographing devices determined to be included in the photographing group in the server And transmitting the multi-angle video service to the multi-angle video service. The method of claim 3,
Wherein the step of determining whether the plurality of photographing equipments are photographing equipments included in a predetermined photographing group includes:
Determining that the imaging device is an imaging device included in a predetermined imaging group if the information about the imaging device is registered in the server with the same group name; And
And updating the pre-stored photographic equipment information when there is a difference between the information about the photographic equipment and the photographic equipment information previously stored in the server. The method of claim 3,
Wherein the step of determining whether the plurality of photographing equipments are photographing equipments included in a predetermined photographing group includes:
Determining that the photographing equipment is not included in a preset photographing group if the information about the photographing equipment is not registered in the server with the same group name;
Creating a group for the photographing equipment not included in the photographing group and setting the photographing equipment as a master photographing equipment based on the information about the photographing equipment;
Generating a group table for the generated group; And
And storing the information on the synchronization period in the group table among the information on the master photographing equipment. The method according to claim 6,
When the group information request signal is transmitted from the photographing equipment not included in the photographing group to the server, the server transmits information on the generated group to the photographing equipment that transmitted the request signal;
Receiving a subscription request signal for the generated group from an imaging equipment that has transmitted information about the group;
Receiving a subscription permission signal of the imaging equipment from the master imaging equipment;
Comprising the steps of: when the subscription permission signal is received, including an imaging device that transmits the subscription request signal to the generated group as a slave imaging device; And
Further comprising the step of synchronizing the digital image photographed by the master photographic equipment and the slave photographic equipment on the basis of marking information generated according to a specific period corresponding to the generated group, Way. The method according to claim 1,
Wherein the receiving of the multi-angle image from the user terminal comprises:
Classifying the multi-angle images by angles;
Selecting N images among the classified images;
Storing each of the N images in buffer memories of the user terminal;
Selecting two images having different angles from the images stored in the buffer memories;
Displaying the selected first and second images on the first and second screens, respectively;
Receiving a selection signal of a third image having an angle separated from the images displayed on the first and second screens;
If one of the N selected images does not include the third image, deletes one of the images other than the first image and the second image from the buffer memory, 3 images; And
Displaying the third image on a first screen and the first image on a second screen, wherein M and N are integers greater than 1 and N≥M. . 9. The method of claim 8,
Receiving a selection signal of a fourth image having an angle separated from the images displayed on the first and second screens;
Removing one of the N selected images other than the third image and the first image from the buffer memory and storing the fourth image in the buffer memory in which the image is deleted; And
Further comprising displaying the fourth image on a first screen and the third image on a second screen. 10. The method of claim 9,
Further comprising the step of buffering the buffer memories to correspond to the order of images displayed on the screens. The method according to claim 1,
The server determines whether the plurality of imaging devices are imaging devices included in a predetermined imaging group based on the imaging device information transmitted from the imaging devices and sets the master imaging device and the slave imaging device step; And
Wherein at least one of the photographing apparatuses forms a new photographing group and functions as a master photographing apparatus of the new photographing group. A multi-angle video service providing system,
A plurality of photographing devices for photographing images of different angles at different positions and transmitting the photographed images to a server;
The server receives the photographed images, generates a multi-angle image based on the received images, and transmits the generated multi-angle image to a user terminal. And
And a user terminal for receiving the multi-angle image from the server and executing an application for reproducing the received multi-angle image to display the received multi-angle image, . 13. The method of claim 12,
The plurality of photographing apparatuses,
Wherein the image is photographed by including information that can identify an angle of a photographed image including positional information of the plurality of photographed devices on a photographed image. 13. The method of claim 12,
The server comprises:
Determining whether the plurality of photographing equipments are included in a predetermined photographing group based on the photographing equipment information transmitted from the photographing equipments, synchronizing the photographing equipments judged to be included in the photographing group Information and control signals,
The photographic equipment,
Wherein the marking information is generated by performing marking on the photographed image based on the received synchronization information, and transmits the encoded image and marking information to the server. 15. The method of claim 14,
The server comprises:
Transmitting control signals including at least one of synchronization information, photographing time information and photographing information including at least one of synchronization period information and synchronization information transmission method information to photographing equipments determined to be included in the photographing group A multi - angle video service providing system. 15. The method of claim 14,
The server comprises:
And the information about the photographing equipment is registered in the server as the same group name, the photographing equipment is determined as the photographing equipment included in the predetermined photographing group, and the information about the photographing equipment and the photographing And updates the pre-stored photographing device information when there is a difference in the device information. 15. The method of claim 14,
The server comprises:
Determining that the photographing equipment is not included in a predetermined photographing group if the information about the photographing equipment is not registered in the server by the same group name; A group for photographing equipment not included in the photographing group is set, the photographing equipment is set as a master photographing equipment, a group table for the generated group is generated, and among the information about the master photographing equipment, Wherein the information about the period is stored in the group table. 18. The method of claim 17,
The server comprises:
When the group information request signal is transmitted from the photographing equipment not included in the photographing group to the server, information about the generated group is transmitted to the photographing equipment that has transmitted the request signal, and the photographing equipment Receiving a subscription request signal for the generated group, receiving a subscription permission signal of the imaging equipment from the master photographic equipment, and transmitting the subscription request signal to the generated group when the subscription permission signal is received And the slave photographing equipment and synchronizes the digital photographs taken by the master photographing equipment and the slave photographing equipment on the basis of the marking information generated according to the specific period corresponding to the generated group Angle video service providing system. 13. The method of claim 12,
The user terminal comprises:
The method of claim 1, further comprising: classifying the multi-angle image by angle, selecting N images from the classified images, storing each of the N images in each of the buffer memories of the user terminal, And displays the selected first and second images on the first and second screens, respectively, and displays the first and second images on the first and second screens, respectively, And if the third image is not included in the N selected images, the other image excluding the first image and the second image is selected Storing the third image in a buffer memory in which the image is deleted, displaying the third image on a first screen, and displaying the first image on a second screen (Where M and N are integers greater than 1 and N > = M). 20. The method of claim 19,
The user terminal comprises:
Wherein when the selection signal of the fourth image having the angle separated from the images displayed on the first screen and the second screen is inputted, the other one of the N selected images, excluding the third image and the first image, Storing the fourth image in a buffer memory in which the image is deleted, displaying the fourth image on a first screen, and displaying the third image on a second screen, Multi - angle video service provision system. 21. The method of claim 20,
The user terminal comprises:
And buffers the buffer memories so as to correspond to the order of images displayed on the screens. 13. The method of claim 12,
The server determines whether the plurality of imaging devices are imaging devices included in a predetermined imaging group based on imaging device information transmitted from the imaging devices, and sets the master imaging device and the slave imaging device ,
Wherein at least one of the photographing equipments forms a new photographing group by itself and functions as a master photographing equipment of the new photographing group.
KR1020130110196A 2013-09-13 2013-09-13 Method and apparatus for providing multi angle video broadcasting service KR101542416B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020130110196A KR101542416B1 (en) 2013-09-13 2013-09-13 Method and apparatus for providing multi angle video broadcasting service
PCT/KR2013/008292 WO2015037761A1 (en) 2013-09-13 2013-09-13 Method for providing multi-angle image service and system using same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130110196A KR101542416B1 (en) 2013-09-13 2013-09-13 Method and apparatus for providing multi angle video broadcasting service

Publications (2)

Publication Number Publication Date
KR20150030889A true KR20150030889A (en) 2015-03-23
KR101542416B1 KR101542416B1 (en) 2015-08-07

Family

ID=52665851

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130110196A KR101542416B1 (en) 2013-09-13 2013-09-13 Method and apparatus for providing multi angle video broadcasting service

Country Status (2)

Country Link
KR (1) KR101542416B1 (en)
WO (1) WO2015037761A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101692190B1 (en) * 2016-05-27 2017-01-02 주식회사 에스,엠,엔터테인먼트 A Multi Image Transmitting/Receiving System

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11257283B2 (en) 2019-03-07 2022-02-22 Alibaba Group Holding Limited Image reconstruction method, system, device and computer-readable storage medium
CN111669571B (en) * 2019-03-07 2023-12-19 阿里巴巴集团控股有限公司 Multi-angle free view image data generation method and device, medium and equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7196722B2 (en) * 2000-05-18 2007-03-27 Imove, Inc. Multiple camera video system which displays selected images
US7358985B2 (en) * 2001-02-16 2008-04-15 Fuji Xerox Co., Ltd. Systems and methods for computer-assisted meeting capture
JP2003230127A (en) * 2002-01-31 2003-08-15 Matsushita Electric Ind Co Ltd Digest image specifying system, digest image providing system, digest image specifying method, medium and program
KR101128848B1 (en) * 2007-09-13 2012-03-23 에스케이플래닛 주식회사 Server, System and Method for Providing Multi Angle Mobile Broadcasting Service
KR101090499B1 (en) * 2008-11-28 2011-12-07 한국전자통신연구원 Method for providing multi angle digital broadcating service

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101692190B1 (en) * 2016-05-27 2017-01-02 주식회사 에스,엠,엔터테인먼트 A Multi Image Transmitting/Receiving System

Also Published As

Publication number Publication date
WO2015037761A1 (en) 2015-03-19
KR101542416B1 (en) 2015-08-07

Similar Documents

Publication Publication Date Title
US20220116667A1 (en) Methods and systems for network based video clip generation and management
EP3238445B1 (en) Interactive binocular video display
US20150124048A1 (en) Switchable multiple video track platform
US10542058B2 (en) Methods and systems for network based video clip processing and management
KR101446995B1 (en) Helmet for imaging multi angle video and method thereof
CN104012106A (en) Aligning videos representing different viewpoints
CN105635675B (en) A kind of panorama playing method and device
US20180227501A1 (en) Multiple vantage point viewing platform and user interface
KR101542416B1 (en) Method and apparatus for providing multi angle video broadcasting service
KR101581343B1 (en) Method and apparatus for providing user interface menu of multi-angle video service
US9860487B2 (en) Video conference data generation
US9491447B2 (en) System for providing complex-dimensional content service using complex 2D-3D content file, method for providing said service, and complex-dimensional content file therefor
JP2020524450A (en) Transmission system for multi-channel video, control method thereof, multi-channel video reproduction method and device thereof
KR101529139B1 (en) Method and apparatus for providing user interface menu of multi-angle video capturing
US10616724B2 (en) Method, device, and non-transitory computer-readable recording medium for supporting relay broadcasting using mobile device
KR20140004448A (en) Method and apparatus for supplying image
US20180227504A1 (en) Switchable multiple video track platform
KR101511758B1 (en) Method and apparatus for managing buffer memory for playing video from a plurality of action cam
KR102149004B1 (en) Method and apparatus for generating multi channel images using mobile terminal
KR20150027532A (en) Method and apparatus for syncronizing video from a plurality of action cam
JP6324829B2 (en) Video providing system and program
KR20150051044A (en) Method and apparatus for providing multi angle video broadcasting service by sectional sceens

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
FPAY Annual fee payment

Payment date: 20180523

Year of fee payment: 4