WO2019117346A1 - Transmission system for multi-channel image and method of controlling the same - Google Patents

Transmission system for multi-channel image and method of controlling the same Download PDF

Info

Publication number
WO2019117346A1
WO2019117346A1 PCT/KR2017/014645 KR2017014645W WO2019117346A1 WO 2019117346 A1 WO2019117346 A1 WO 2019117346A1 KR 2017014645 W KR2017014645 W KR 2017014645W WO 2019117346 A1 WO2019117346 A1 WO 2019117346A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
channel
time
channels
event
Prior art date
Application number
PCT/KR2017/014645
Other languages
French (fr)
Inventor
Sang Yun Lee
Joon Ho Kim
Hyeong Jun Cho
Original Assignee
4Dreplay Korea, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 4Dreplay Korea, Inc. filed Critical 4Dreplay Korea, Inc.
Publication of WO2019117346A1 publication Critical patent/WO2019117346A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23109Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion by placing content in organized collections, e.g. EPG data repository
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242Synchronization processes, e.g. processing of PCR [Program Clock References]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/917Television signal processing therefor for bandwidth reduction

Definitions

  • One or more embodiments relate to a transmission system for multi-channel images and a method of controlling the transmission system.
  • a plurality of images obtained by photographing one object by using a plurality of cameras in various channels are geometrically corrected and synthesized to provide multi-channel images to users.
  • multi-channel images provide an image full of reality beyond a concept of high resolution image, and as such, users may experience an immersive feeling and an effect of transferring information via images may be greatly improved in such fields as advertisement, education, medicine, national defense, entertainment, etc.
  • channel/time switching is simply performed in a manner of reproducing the images in a combination method predetermined in advance when producing the multi-channel images. That is, according to the related art, a plurality of cameras obtain a plurality of frames, and some of the obtained frames are selected and combined to generate one channel switching image. Since the channel switching image is obtained by simply combining frames of channels that are determined in advance by a producer when producing the image, when a corresponding video file is reproduced, a channel switching effect, in which combined frames exhibit a single channel moving effect, is obtained. According to the multi-channel image of the related art, the user simply watches the channel switching effect that is produced in advance, and it is impossible for the user to manually manipulate a viewing angle switching or a channel switching in order to switch channels in a desired point of view.
  • a multi-channel or camera synchronization method, an image correction and transferring method are necessary for photographing images in various channels.
  • One or more embodiments include a transmission system for multi-channel images, a method of controlling the transmission system, and a reproducing apparatus therefor.
  • a transmission system for multi-channel images includes: a camera controller configured to control a plurality of cameras to photograph an object for a predetermined time period, and to transmit multi-channel images corresponding to the plurality of cameras to an image server via a communication network; and an image server configured to group and store the multi-channel images transmitted from the camera controller based on at least one of criterion according to time, a criterion according channels, and a criterion according to a combination of the time and the channels, and to transmit grouped images to a user terminal via the communication network according to a request from the user terminal.
  • the criterion according to the combination of the time and the channels may mix images of a first to M-th (M is 2 or greater natural number) channels corresponding to a first time point to an N-th (N is two or greater natural number) time point, or mix images of the M-th to the first channels corresponding to the first time to the N-th time.
  • the criterion according to the combination of the time and the channels may mix images of a first channel to an M-th channel corresponding to an N-th time to a first time, or mix images of the M-th to the first channels corresponding to the N-th time to the first time.
  • Images of channels may be grouped, and the channels may correspond to a ⁇ y (y is a natural number) time period from an event that occurs at a time point during the predetermined time period.
  • the camera controller may be configured to transmit a photographing synchronization signal and a photographing operation driving signal to the plurality of cameras so that the plurality of cameras photograph the object at the same time, perform a compression process on multi-channel images transmitted from the plurality of cameras, and determine a data transmission method according to the communication network.
  • the image server may be configured to perform rendering on decoded images from the channel, in which the event has occurred, in a direction in which the event occurred.
  • a method of controlling a transmission system for multi-channel images includes: controlling a plurality of cameras to photograph an object for a predetermined time period; transmitting multi-channel images corresponding to the plurality of cameras via a communication network; grouping and storing the multi-channel images transmitted from a camera controller based on at least one of a criterion according to time, a criterion according to channels, and a criterion according to a combination of the time and the channels; and transmitting grouped and stored images via the communication network according to a request from the user terminal.
  • the criterion according to the combination of the time and the channels may mix images of a first to M-th (M is 2 or greater natural number) channels corresponding to a first time point to an N-th (N is two or greater natural number) time point, images of the M-th to the first channels corresponding to the first time to the N-th time, images of a first channel to the M-th channel corresponding to the N-th time to the first time, or images of the M-th to the first channels corresponding to the N-th time to the first time.
  • M is 2 or greater natural number
  • N two or greater natural number
  • Images of channels may be grouped, and the channels may correspond to a ⁇ y (y is a natural number) time period from an event that occurs at a time point during the predetermined time period.
  • the method may further include: performing a decoding from the first channel on the grouped images, when an event corresponding to a request of the user terminal occurs in a channel from among the first to the M-th channels; performing rendering on decoded images from the channel, in which the event has occurred, in a direction in which the event occurred; and transmitting rendered images to the user terminal.
  • a reproducing apparatus for reproducing multi-channel images, the reproducing apparatus includes: a memory in which multi-channel images are stored; and a processor configured to receive an event request from a channel from among a first channel to an M-th channel corresponding to the multi-channel images, perform decoding on the multi-channel images sequentially from the first channel, perform rendering on decoded images from the channel, in which an event occurs, in a direction of the event, and control rendered images to be reproduced.
  • a method of controlling a reproducing apparatus for multi-channel images includes: receiving an event request from a channel from among a first channel to an M-th channel corresponding to the multi-channel images; performing decoding on the multi-channel images sequentially from the first channel; performing rendering on decoded images from the channel, in which the event has occurred, in a direction of the event; and controlling rendered images to be reproduced.
  • a non-transitory computer-readable recording medium has recorded thereon a program, which when executed by a computer, performs the above method of controlling the reproducing apparatus.
  • FIG. 1 is a schematic view of a transmission system for multi-channel images according to an embodiment
  • FIG. 2 is an exemplary view of generating multi-channel images
  • FIG. 3 is a flowchart illustrating a method of controlling a transmission system for multi-channel images according to another embodiment
  • FIG. 4 is a schematic view of a camera controller of FIG. 1;
  • FIGS. 5A to 5D are schematic views of an image server of FIG. 1;
  • FIGS. 6 to 9 are exemplary views illustrating grouping of multi-channel images according to another embodiment
  • FIGS. 10 and 11 are exemplary views illustrating decoding and rendering methods according to occurrence of an event, according to another embodiment.
  • FIG. 12 is a diagram showing a signal flow between an image server and a user terminal for implementing a real-time streaming, according to another embodiment.
  • FIG. 1 is a schematic view of a transmission 100 for a multi-channel image according to an embodiment.
  • the transmission system 100 includes a plurality of cameras 111 to 113, a camera controller 110 controlling the plurality of cameras 111 to 113 and processing and transferring multi-channel images captured by the plurality of cameras 111 to 113, and an image server 200 processing and storing the multi-channel images transferred from the camera controller 110.
  • the image server 200 receives a request for multi-channel images, a request for switching images, and a request for a certain event from a user terminal 150, and transmits stored multi-channel images to the user terminal 150.
  • the image server 200 may include an image processing device 130 and an image storage 140.
  • a plurality of cameras 1 to N may be arranged to photograph a certain object.
  • the image server 200 receives a plurality of images that are obtained from the plurality of cameras 1 to N photographing the object in various angles, wherein the plurality of cameras 1 to N are arranged as an array around the object.
  • the plurality of cameras may be arranged in a manner that N cameras are arranged in a row on a substantially equal plane based on an arbitrary camera.
  • N cameras may be sequentially arranged on a circumference spaced a predetermined distance apart from the object, or two cameras at opposite sides of a center camera are arranged at equal distances from the object and the other cameras may be arranged at different distances from the object.
  • the object may be a fixed object or a moving object.
  • the plurality of cameras 1 to N may communicate with the camera controller 110 through wires or wirelessly, and a plurality of camera controllers may be provided to control the plurality of cameras 1 to N.
  • the camera controller 110 may control the plurality of cameras 1 to N via synchronization signals for synchronizing the plurality of cameras 1 to N.
  • the camera controller 110 temporarily stores the images captured by the plurality of cameras 1 to N, and reduces sizes of the captured images by changing codec to make rapid transmission of the captured images possible. A detailed configuration of the camera controller 110 will be described with reference to FIG. 4.
  • the camera controller 110 may include a camera driving controller 111, an image converter 112, and a transmitter 113.
  • the camera driving controller 111 controls synchronization and photographing of the cameras.
  • the image converter 112 reduces sizes of images through codec change so that images generated by the plurality of cameras 1 to N may be transmitted fast through a communication network 120.
  • the image converter 112 may determine a data transmission method suitable for a photographing scene, or for a wired or wireless transmission.
  • the transmitter 113 transmits the converted images to the image server 200 through the communication network 120.
  • the image server 200 may group and store the multi-channel images transmitted from the camera controller 110 based on at least one of a criterion according to time, a criterion according to channels, or a criterion according to combination of the time and channels, and may transmit grouped images to the user terminal 150 via the communication network according to a request from the user terminal 150.
  • a criterion according to time a criterion according to channels
  • a criterion according to combination of the time and channels may transmit grouped images to the user terminal 150 via the communication network according to a request from the user terminal 150.
  • the image server 200 includes the image processing device 110 and the image storage 140.
  • the image processing device 110 includes an image processor 131, an image converter 132, and a transmitter 133.
  • the image processor 131 performs an image correction on the multi-channel images transmitted from the camera controller 110, that is, the images captured by the plurality of cameras. For example, since the image captured by the plurality of cameras may not have the same focuses, image processing is performed so that the plurality of cameras may have the same focuses.
  • the image processor 131 corrects the multi-channel images. A geometrical error in the arrangement of the N cameras is shown as a visual shaking during reproducing the multi-channel images, and thus, in order to remove the visual shaking, a size, inclination, or a center of each image may be corrected.
  • the image converter 132 may group the multi-channel images based on at least one of a criterion according to time, a criterion according to channels, and a criterion according to combination of the time and channels.
  • the image converter 132 may group various spaces.
  • the grouping method may be performed based on various criteria, and will be described with reference to FIGS. 6 to 9.
  • the transmission system may only transmit grouped images, without transmitting all image data and wasting data, so that data that the user requires may only be transmitted.
  • the image converter 132 may group channel images within ⁇ y time period (y is a natural number) from an event that occurs at a time point t.
  • the event may refer to a predetermined event, e.g., a home-run or an out scene in a baseball game, an event requested by the user, or a case when the user desires.
  • FIGS. 6 to 9 are exemplary views illustrating grouping of multi-channel images according to another embodiment.
  • a transverse axis denotes time and a longitudinal axis denotes a camera or a channel
  • FIG. 6 shows frames of an image generated at a corresponding time in a corresponding channel.
  • FIG. 6 shows a basic grouping method, that is, a method of grouping multi-channel images according to time.
  • images of a channel 1 to a channel 5 captured at a time point t1 are grouped to generate grouped images 600.
  • images of the channel 1 to the channel 5 captured at a time point t2 are grouped to generate grouped images 610.
  • the images may be grouped according to time, for example, when the cameras are arranged as shown in FIG.
  • the user terminal 150 may identify the images captured from all directions surrounding the object at the same time point.
  • the method of grouping the multi-channel images according to time is described above with reference to FIG. 6, but images may be grouped according to the channel. Also, as shown in FIG. 6, the images may be grouped in an order of cameras, that is, from the channel 1 to the channel 5, but as shown in FIG. 7, the images may be grouped in an opposite order, that is, from the channel 5 to the channel 1.
  • a first channel image captured at a time point t1 a second channel image captured at a time point t2, a third channel image captured at a time point t3, a fourth channel image captured at a time point t4, and a fifth channel image captured at a time point t5 are grouped to generate grouped images 800 in a descending order.
  • a first channel image captured at a time point t2, a second channel image captured at a time point t3, a third channel image captured at a time point t4, a fourth channel image captured at a time point t5, and a fifth channel image captured at a time point t6 are grouped to generate grouped images 810.
  • a fifth channel image captured at the time point t1, a fourth channel image captured at the time point t2, a third channel image captured at the time point t3, a second channel image captured at the time point t4, and a first channel image captured at the time point t5 are grouped to generate grouped images 900 in an ascending order.
  • the images are grouped according to the combination of time and channels, but the present disclosure is not limited thereto, and the images may be grouped in various manners.
  • the grouped images converted in the image converter 132 may be stored in the image storage 140.
  • the image processing device 130 extracts images stored in the image storage 140, and transmits the extracted images to the user terminal 150 via the transmitter 133.
  • the image server 130 includes the image processor 131, the image converter 132, and the transmitter 133, and the transmitter 133 may further include a message handler 133-1, a streamer 133-2, and a channel manager 133-3.
  • the transmitter 133 may be a streaming device and is included in the image server 130, but may be implemented as an additional device separate from the image server 130. Descriptions for the same components as those of FIG. 5A will be omitted, and differences from FIG. 5A will be described.
  • the transmitter 133 transmits processed images or stored images in real-time.
  • the transmitter 133 may be a device for real-time streaming.
  • the message handler 133-1 performs management of a user terminal and a session, and management of a protocol.
  • the streamer 133-2 transmits the image to the user terminal, and is a collection of images to be transmitted to the user terminal.
  • the channel manager 133-3 schedules the images in a GOP unit on receiving a signal from the user terminal, and transfers the scheduled images to the streamer 133-2.
  • the channel manager 133-3 transfers to the streamer 133-2 the images scheduled in the GOP unit.
  • images captured by the channel 5, that is, camera 5 are scheduled in an order from GOP1 to GOPN and transferred to the streamer 133-2.
  • the streamer 133-2 collects GOP images according to scheduling of the channel manager 13 ⁇ 3 and transfers the images to the user terminal.
  • the channel manager 133-3 schedules images captured in the channel 5, that is, by the camera 5, in an order of GOP1 to GOP3, GOP4 of the channel 4, GOP5 of the channel 3, GOP6 of the channel 2, and GOP7 of the channel 7, and transfers the images to the streamer 133-2.
  • the streamer 133-2 collects the GOP images according to the scheduling of the channel manager 133-3 and transfers the GOP images to the user terminal.
  • FIG. 3 is a flowchart illustrating a method of controlling a transmission system for a multi-channel image according to another embodiment.
  • an object is photographed for a predetermined time period by the plurality of cameras.
  • multi-channel images corresponding to the plurality of cameras are transmitted to the image server through a communication network.
  • the multi-channel images transmitted from the camera controller are grouped based on at least one of a criterion according to the time, a criterion according to the channels, and a criterion according to combination of the time and channels. Images grouped according to the time, images grouped according to the channels, or images grouped according to combination of the time and channels may be stored.
  • the images grouped and stored are transmitted to the user terminal through the communication network according to a request of the user terminal.
  • the communication network may be a wired communication network or a wireless communication network, and may be the same as or different from the communication network in operation 302.
  • FIGS. 10 and 11 are exemplary views illustrating a decoding and rendering methods according to occurrence of an event, according to another embodiment.
  • the image server 200 may decode and render the multi-channel images according to occurrence of an event to transmit the multi-channel images to the user terminal 150, or the image server 200 may transmit the multi-channel images or grouped images to the user terminal 150 and may decode and render images that are compressed and transmitted according to occurrence of an event based on a user request while the user terminal 150 reproduces the multi-channel images or grouped images.
  • a rapid switching between image channels is necessary for reproducing images in real-time, and thus, decoding and rendering are performed as follows.
  • the user terminal 150 is to reproduce the images captured by the camera 2 to the camera 10.
  • decoding is performed from the images of the camera 1 to the camera 2 to store a decoded image in a temporary memory or a buffer, and after that, the rendering is started from the image of the camera 2.
  • an event occurs towards left side in an image corresponding to the camera 7.
  • the user terminal 150 is to reproduce the images captured by the camera 7 to the camera 1.
  • decoding is performed from the images of the camera 1 to the camera 7 to store a decoded image in a temporary memory or a buffer, and after that, the rendering is started from the images of the camera 7 to the camera 1.
  • FIG. 12 is a diagram showing a signal flow between the image server 200 and the user terminal 150 for implementing a real-time streaming, according to another embodiment.
  • the image server 200 receives a connection request from the user terminal 150 and aligns a session to the user terminal 150.
  • the image server 200 aligns a device identification (ID) according to a certification request from the user terminal 150, and when the image server 200 responds to the certification request, a certification or device ID protocol session starts in the user terminal 150.
  • ID device identification
  • the image server 200 When the user terminal 150 sends a connection request for starting a streaming session to the image server 200, the image server 200 receives the request and aligns a stream to the user terminal 150. When the user terminal 150 requests for the certification, the image server 200 responds to the certification request. In the user terminal 150, the streaming session starts by using the certification or device ID.
  • the user terminal 150 transmits an alive maintenance request to the image server 200 at a predetermined cycle, for example, once a second, in order to maintain the protocol session alive.
  • the image server 200 responds to the above request and manages the session. Therefore, the connected state or the event state between the image server 200 and the user terminal 150 is maintained.
  • the image server 200 when the user terminal 150 sends a reproduction request to the image server 200, the image server 200 transmits a reproduction image to the user terminal 150 in response to the request.
  • the image server 200 stops the reproduction image in response to the request.
  • Some embodiments may be embodied in a storage medium including instruction codes executable by a computer or processor such as a program module executed by the computer.
  • the computer-readable storage medium may be any available medium that may be accessed by a computer, and includes volatile and non-volatile media and removable and non-removable media.
  • the computer-readable medium may include both a computer storage medium and a communication medium.
  • the computer storage medium may include volatile and non-volatile media and removable and non-removable media that are implemented using any method or technology for storing information, such as computer-readable instructions, a data structure, a program module, or other types of data.
  • the communication medium typically includes computer-readable instructions, a data structure, a program module, or other data of modulated data signal such as carrier waves, or other transmission mechanisms, and includes an arbitrary information transfer medium.
  • the transmission system for the multi-channel images may increase convenience in data transmission of the multi-channel images and may reduce a processing time period when switching channels according to time lapse.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Provided is a transmission system for multi-channel images, the transmission system including: a camera controller configured to control a plurality of cameras to photograph an object for a predetermined time period, and to transmit multi-channel images corresponding to the plurality of cameras to an image server via a communication network; and an image server configured to group and store the multi-channel images transmitted from the camera controller based on at least one of criterion according to time, a criterion according channels, and a criterion according to a combination of the time and the channels, and to transmit grouped images to a user terminal via the communication network according to a request from the user terminal.

Description

TRANSMISSION SYSTEM FOR MULTI-CHANNEL IMAGE AND METHOD OF CONTROLLING THE SAME
One or more embodiments relate to a transmission system for multi-channel images and a method of controlling the transmission system.
Recently, people prefer to reproduce videos through mobile devices. According to the trends, companies provide broadcasting platforms, e.g., V-app, Afreeca TV, Youtube Live, etc. People who watch videos via above platforms watch images captured from a point of view, that is, by one camera. However, viewers recently want to see images captured from a desired point of view.
Currently, a plurality of images obtained by photographing one object by using a plurality of cameras in various channels are geometrically corrected and synthesized to provide multi-channel images to users. Above multi-channel images provide an image full of reality beyond a concept of high resolution image, and as such, users may experience an immersive feeling and an effect of transferring information via images may be greatly improved in such fields as advertisement, education, medicine, national defense, entertainment, etc.
According to multi-channel images of the related art, channel/time switching is simply performed in a manner of reproducing the images in a combination method predetermined in advance when producing the multi-channel images. That is, according to the related art, a plurality of cameras obtain a plurality of frames, and some of the obtained frames are selected and combined to generate one channel switching image. Since the channel switching image is obtained by simply combining frames of channels that are determined in advance by a producer when producing the image, when a corresponding video file is reproduced, a channel switching effect, in which combined frames exhibit a single channel moving effect, is obtained. According to the multi-channel image of the related art, the user simply watches the channel switching effect that is produced in advance, and it is impossible for the user to manually manipulate a viewing angle switching or a channel switching in order to switch channels in a desired point of view.
Also, a multi-channel or camera synchronization method, an image correction and transferring method are necessary for photographing images in various channels.
One or more embodiments include a transmission system for multi-channel images, a method of controlling the transmission system, and a reproducing apparatus therefor.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments.
According to one or more embodiments, a transmission system for multi-channel images, the transmission system includes: a camera controller configured to control a plurality of cameras to photograph an object for a predetermined time period, and to transmit multi-channel images corresponding to the plurality of cameras to an image server via a communication network; and an image server configured to group and store the multi-channel images transmitted from the camera controller based on at least one of criterion according to time, a criterion according channels, and a criterion according to a combination of the time and the channels, and to transmit grouped images to a user terminal via the communication network according to a request from the user terminal.
The criterion according to the combination of the time and the channels may mix images of a first to M-th (M is 2 or greater natural number) channels corresponding to a first time point to an N-th (N is two or greater natural number) time point, or mix images of the M-th to the first channels corresponding to the first time to the N-th time.
The criterion according to the combination of the time and the channels may mix images of a first channel to an M-th channel corresponding to an N-th time to a first time, or mix images of the M-th to the first channels corresponding to the N-th time to the first time.
Images of channels may be grouped, and the channels may correspond to a ±y (y is a natural number) time period from an event that occurs at a time point during the predetermined time period.
The camera controller may be configured to transmit a photographing synchronization signal and a photographing operation driving signal to the plurality of cameras so that the plurality of cameras photograph the object at the same time, perform a compression process on multi-channel images transmitted from the plurality of cameras, and determine a data transmission method according to the communication network.
The transmission system of claim 1, wherein the image server is configured to perform a decoding from the first channel on the grouped images, when an event corresponding to a request of the user terminal occurs in a channel from among the first to the M-th channels
The image server may be configured to perform rendering on decoded images from the channel, in which the event has occurred, in a direction in which the event occurred.
According to one or more embodiments, a method of controlling a transmission system for multi-channel images, the method includes: controlling a plurality of cameras to photograph an object for a predetermined time period; transmitting multi-channel images corresponding to the plurality of cameras via a communication network; grouping and storing the multi-channel images transmitted from a camera controller based on at least one of a criterion according to time, a criterion according to channels, and a criterion according to a combination of the time and the channels; and transmitting grouped and stored images via the communication network according to a request from the user terminal.
The criterion according to the combination of the time and the channels may mix images of a first to M-th (M is 2 or greater natural number) channels corresponding to a first time point to an N-th (N is two or greater natural number) time point, images of the M-th to the first channels corresponding to the first time to the N-th time, images of a first channel to the M-th channel corresponding to the N-th time to the first time, or images of the M-th to the first channels corresponding to the N-th time to the first time.
Images of channels may be grouped, and the channels may correspond to a ±y (y is a natural number) time period from an event that occurs at a time point during the predetermined time period.
The method may further include: performing a decoding from the first channel on the grouped images, when an event corresponding to a request of the user terminal occurs in a channel from among the first to the M-th channels; performing rendering on decoded images from the channel, in which the event has occurred, in a direction in which the event occurred; and transmitting rendered images to the user terminal.
According to one or more embodiments, a reproducing apparatus for reproducing multi-channel images, the reproducing apparatus includes: a memory in which multi-channel images are stored; and a processor configured to receive an event request from a channel from among a first channel to an M-th channel corresponding to the multi-channel images, perform decoding on the multi-channel images sequentially from the first channel, perform rendering on decoded images from the channel, in which an event occurs, in a direction of the event, and control rendered images to be reproduced.
According to one or more embodiments, a method of controlling a reproducing apparatus for multi-channel images, the method includes: receiving an event request from a channel from among a first channel to an M-th channel corresponding to the multi-channel images; performing decoding on the multi-channel images sequentially from the first channel; performing rendering on decoded images from the channel, in which the event has occurred, in a direction of the event; and controlling rendered images to be reproduced.
According to one or more embodiments, a non-transitory computer-readable recording medium has recorded thereon a program, which when executed by a computer, performs the above method of controlling the reproducing apparatus.
These and/or other aspects will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings in which:
FIG. 1 is a schematic view of a transmission system for multi-channel images according to an embodiment;
FIG. 2 is an exemplary view of generating multi-channel images;
FIG. 3 is a flowchart illustrating a method of controlling a transmission system for multi-channel images according to another embodiment;
FIG. 4 is a schematic view of a camera controller of FIG. 1;
FIGS. 5A to 5D are schematic views of an image server of FIG. 1;
FIGS. 6 to 9 are exemplary views illustrating grouping of multi-channel images according to another embodiment;
FIGS. 10 and 11 are exemplary views illustrating decoding and rendering methods according to occurrence of an event, according to another embodiment; and
FIG. 12 is a diagram showing a signal flow between an image server and a user terminal for implementing a real-time streaming, according to another embodiment.
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. In this regard, the present embodiments may have different forms and should not be construed as being limited to the descriptions set forth herein. Accordingly, the embodiments are merely described below, by referring to the figures, to explain aspects of the present description.
All terms including descriptive or technical terms which are used herein should be construed as having meanings that are obvious to one of ordinary skill in the art. However, the terms may have different meanings according to an intention of one of ordinary skill in the art, precedent cases, or the appearance of new technologies. Also, some terms may be arbitrarily selected by the applicant. In this case, the meaning of the selected terms will be described in the detailed description. Thus, the terms used herein have to be defined based on the meaning of the terms together with the description throughout the specification.
Throughout the descriptions about embodiments, when it is mentioned that a part is "connected" with another part, it means not only "direct connection" but also "electrical connection" with different elements interposed between the two parts. Throughout the specification, when a portion "includes" an element, another element may be further included, rather than excluding the existence of the other element, unless otherwise described. In addition, the term such as "...unit" provided herein indicates a unit performing at least one function or operation, and may be realized by hardware, software, or a combination of hardware and software.
In the present application, such a terminology as "configure", "include" and the like should not be construed as necessarily including several components or steps, as not including some of the several components or steps, or as further including additional component(s) or step(s).
The following embodiments are not intended to limit or restrict the scope of the present disclosure, and techniques easily conceivable by one of ordinary skill in the art from the detailed descriptions and embodiments are interpreted as belonging to the scope of the present disclosure. Hereinafter, one or more embodiments of the present disclosure will be described in detail with reference to accompanying drawings.
FIG. 1 is a schematic view of a transmission 100 for a multi-channel image according to an embodiment.
Referring to FIG. 1, the transmission system 100 includes a plurality of cameras 111 to 113, a camera controller 110 controlling the plurality of cameras 111 to 113 and processing and transferring multi-channel images captured by the plurality of cameras 111 to 113, and an image server 200 processing and storing the multi-channel images transferred from the camera controller 110. The image server 200 receives a request for multi-channel images, a request for switching images, and a request for a certain event from a user terminal 150, and transmits stored multi-channel images to the user terminal 150.
The image server 200 may include an image processing device 130 and an image storage 140.
As shown in FIG. 2, a plurality of cameras 1 to N may be arranged to photograph a certain object. The image server 200 receives a plurality of images that are obtained from the plurality of cameras 1 to N photographing the object in various angles, wherein the plurality of cameras 1 to N are arranged as an array around the object. The plurality of cameras may be arranged in a manner that N cameras are arranged in a row on a substantially equal plane based on an arbitrary camera. In this case, N cameras may be sequentially arranged on a circumference spaced a predetermined distance apart from the object, or two cameras at opposite sides of a center camera are arranged at equal distances from the object and the other cameras may be arranged at different distances from the object. Also, the object may be a fixed object or a moving object.
The plurality of cameras 1 to N may communicate with the camera controller 110 through wires or wirelessly, and a plurality of camera controllers may be provided to control the plurality of cameras 1 to N.
The camera controller 110 may control the plurality of cameras 1 to N via synchronization signals for synchronizing the plurality of cameras 1 to N. The camera controller 110 temporarily stores the images captured by the plurality of cameras 1 to N, and reduces sizes of the captured images by changing codec to make rapid transmission of the captured images possible. A detailed configuration of the camera controller 110 will be described with reference to FIG. 4.
The camera controller 110 may include a camera driving controller 111, an image converter 112, and a transmitter 113.
The camera driving controller 111 controls synchronization and photographing of the cameras.
The image converter 112 reduces sizes of images through codec change so that images generated by the plurality of cameras 1 to N may be transmitted fast through a communication network 120. In addition, the image converter 112 may determine a data transmission method suitable for a photographing scene, or for a wired or wireless transmission.
The transmitter 113 transmits the converted images to the image server 200 through the communication network 120.
The image server 200 may group and store the multi-channel images transmitted from the camera controller 110 based on at least one of a criterion according to time, a criterion according to channels, or a criterion according to combination of the time and channels, and may transmit grouped images to the user terminal 150 via the communication network according to a request from the user terminal 150. A detailed configuration of the image server 200 will be described below with reference to FIGS. 5A to 5D.
Referring to FIG. 5A, the image server 200 includes the image processing device 110 and the image storage 140. The image processing device 110 includes an image processor 131, an image converter 132, and a transmitter 133.
The image processor 131 performs an image correction on the multi-channel images transmitted from the camera controller 110, that is, the images captured by the plurality of cameras. For example, since the image captured by the plurality of cameras may not have the same focuses, image processing is performed so that the plurality of cameras may have the same focuses. The image processor 131 corrects the multi-channel images. A geometrical error in the arrangement of the N cameras is shown as a visual shaking during reproducing the multi-channel images, and thus, in order to remove the visual shaking, a size, inclination, or a center of each image may be corrected.
The image converter 132 may group the multi-channel images based on at least one of a criterion according to time, a criterion according to channels, and a criterion according to combination of the time and channels. The image converter 132 may group various spaces. The grouping method may be performed based on various criteria, and will be described with reference to FIGS. 6 to 9. In order for the transmission system according to the embodiment to effectively transmit multi-channel images or switching images to the user terminal 150, the transmission system may only transmit grouped images, without transmitting all image data and wasting data, so that data that the user requires may only be transmitted. The image converter 132 may group channel images within ±y time period (y is a natural number) from an event that occurs at a time point t. For example, when it is assumed that an event occurs at a time point t3 in a channel 1. Here, the event may refer to a predetermined event, e.g., a home-run or an out scene in a baseball game, an event requested by the user, or a case when the user desires.
FIGS. 6 to 9 are exemplary views illustrating grouping of multi-channel images according to another embodiment.
Referring to FIG. 6, a transverse axis denotes time and a longitudinal axis denotes a camera or a channel, and FIG. 6 shows frames of an image generated at a corresponding time in a corresponding channel. FIG. 6 shows a basic grouping method, that is, a method of grouping multi-channel images according to time. As shown in FIG. 6, images of a channel 1 to a channel 5 captured at a time point t1 are grouped to generate grouped images 600. Similarly, images of the channel 1 to the channel 5 captured at a time point t2 are grouped to generate grouped images 610. In the above manner, the images may be grouped according to time, for example, when the cameras are arranged as shown in FIG. 2, the user terminal 150 may identify the images captured from all directions surrounding the object at the same time point. The method of grouping the multi-channel images according to time is described above with reference to FIG. 6, but images may be grouped according to the channel. Also, as shown in FIG. 6, the images may be grouped in an order of cameras, that is, from the channel 1 to the channel 5, but as shown in FIG. 7, the images may be grouped in an opposite order, that is, from the channel 5 to the channel 1.
Referring to FIGS. 8 and 9, grouping according to combination of the time and the channels is shown. As shown in FIG. 8, a first channel image captured at a time point t1, a second channel image captured at a time point t2, a third channel image captured at a time point t3, a fourth channel image captured at a time point t4, and a fifth channel image captured at a time point t5 are grouped to generate grouped images 800 in a descending order. Similarly, a first channel image captured at a time point t2, a second channel image captured at a time point t3, a third channel image captured at a time point t4, a fourth channel image captured at a time point t5, and a fifth channel image captured at a time point t6 are grouped to generate grouped images 810. Similarly, as shown in FIG. 9, a fifth channel image captured at the time point t1, a fourth channel image captured at the time point t2, a third channel image captured at the time point t3, a second channel image captured at the time point t4, and a first channel image captured at the time point t5 are grouped to generate grouped images 900 in an ascending order.
As shown in FIGS. 8 and 9, the images are grouped according to the combination of time and channels, but the present disclosure is not limited thereto, and the images may be grouped in various manners.
Referring back to FIG. 5A, the grouped images converted in the image converter 132 may be stored in the image storage 140. When there is a request from the user terminal 150, the image processing device 130 extracts images stored in the image storage 140, and transmits the extracted images to the user terminal 150 via the transmitter 133.
Referring to FIG. 5B, the image server 130 includes the image processor 131, the image converter 132, and the transmitter 133, and the transmitter 133 may further include a message handler 133-1, a streamer 133-2, and a channel manager 133-3. The transmitter 133 may be a streaming device and is included in the image server 130, but may be implemented as an additional device separate from the image server 130. Descriptions for the same components as those of FIG. 5A will be omitted, and differences from FIG. 5A will be described.
The transmitter 133 transmits processed images or stored images in real-time. For example, the transmitter 133 may be a device for real-time streaming.
The message handler 133-1 performs management of a user terminal and a session, and management of a protocol.
The streamer 133-2 transmits the image to the user terminal, and is a collection of images to be transmitted to the user terminal.
The channel manager 133-3 schedules the images in a GOP unit on receiving a signal from the user terminal, and transfers the scheduled images to the streamer 133-2.
As shown in FIG. 5C, when there is no particular request from the user terminal, for example, a channel change request and a channel switch request, the channel manager 133-3 transfers to the streamer 133-2 the images scheduled in the GOP unit. As shown in FIG. 5C, images captured by the channel 5, that is, camera 5, are scheduled in an order from GOP1 to GOPN and transferred to the streamer 133-2. The streamer 133-2 collects GOP images according to scheduling of the channel manager 13―3 and transfers the images to the user terminal.
As shown in FIG. 5D, when a channel switch request is transmitted from the user terminal, the channel manager 133-3 schedules images captured in the channel 5, that is, by the camera 5, in an order of GOP1 to GOP3, GOP4 of the channel 4, GOP5 of the channel 3, GOP6 of the channel 2, and GOP7 of the channel 7, and transfers the images to the streamer 133-2. The streamer 133-2 collects the GOP images according to the scheduling of the channel manager 133-3 and transfers the GOP images to the user terminal.
FIG. 3 is a flowchart illustrating a method of controlling a transmission system for a multi-channel image according to another embodiment.
Referring to FIG. 3, in operation 300, an object is photographed for a predetermined time period by the plurality of cameras.
In operation 302, multi-channel images corresponding to the plurality of cameras are transmitted to the image server through a communication network.
In operation 304, the multi-channel images transmitted from the camera controller are grouped based on at least one of a criterion according to the time, a criterion according to the channels, and a criterion according to combination of the time and channels. Images grouped according to the time, images grouped according to the channels, or images grouped according to combination of the time and channels may be stored.
In operation 306, the images grouped and stored are transmitted to the user terminal through the communication network according to a request of the user terminal. Here, the communication network may be a wired communication network or a wireless communication network, and may be the same as or different from the communication network in operation 302.
FIGS. 10 and 11 are exemplary views illustrating a decoding and rendering methods according to occurrence of an event, according to another embodiment.
The image server 200 according to the embodiment may decode and render the multi-channel images according to occurrence of an event to transmit the multi-channel images to the user terminal 150, or the image server 200 may transmit the multi-channel images or grouped images to the user terminal 150 and may decode and render images that are compressed and transmitted according to occurrence of an event based on a user request while the user terminal 150 reproduces the multi-channel images or grouped images. In this case, a rapid switching between image channels is necessary for reproducing images in real-time, and thus, decoding and rendering are performed as follows.
Referring to FIG. 10, when there are multi-channel images of a camera 1 to a camera 10, an event occurs towards right side in an image corresponding to the camera 2. For example, the user terminal 150 is to reproduce the images captured by the camera 2 to the camera 10. In this case, with respect to compressed multi-channel images, decoding is performed from the images of the camera 1 to the camera 2 to store a decoded image in a temporary memory or a buffer, and after that, the rendering is started from the image of the camera 2.
Referring to FIG. 11, when there are multi-channel images of the camera 1 to the camera 10, an event occurs towards left side in an image corresponding to the camera 7. For example, the user terminal 150 is to reproduce the images captured by the camera 7 to the camera 1. In this case, with respect to compressed multi-channel images, decoding is performed from the images of the camera 1 to the camera 7 to store a decoded image in a temporary memory or a buffer, and after that, the rendering is started from the images of the camera 7 to the camera 1.
FIG. 12 is a diagram showing a signal flow between the image server 200 and the user terminal 150 for implementing a real-time streaming, according to another embodiment.
Referring to FIG. 12, the image server 200 receives a connection request from the user terminal 150 and aligns a session to the user terminal 150. The image server 200 aligns a device identification (ID) according to a certification request from the user terminal 150, and when the image server 200 responds to the certification request, a certification or device ID protocol session starts in the user terminal 150.
When the user terminal 150 sends a connection request for starting a streaming session to the image server 200, the image server 200 receives the request and aligns a stream to the user terminal 150. When the user terminal 150 requests for the certification, the image server 200 responds to the certification request. In the user terminal 150, the streaming session starts by using the certification or device ID.
The user terminal 150 transmits an alive maintenance request to the image server 200 at a predetermined cycle, for example, once a second, in order to maintain the protocol session alive. The image server 200 responds to the above request and manages the session. Therefore, the connected state or the event state between the image server 200 and the user terminal 150 is maintained.
Although not shown in the drawings, when the user terminal 150 sends a reproduction request to the image server 200, the image server 200 transmits a reproduction image to the user terminal 150 in response to the request. When the user terminal 150 sends a suspension request, the image server 200 stops the reproduction image in response to the request.
Some embodiments may be embodied in a storage medium including instruction codes executable by a computer or processor such as a program module executed by the computer. The computer-readable storage medium may be any available medium that may be accessed by a computer, and includes volatile and non-volatile media and removable and non-removable media. Also, the computer-readable medium may include both a computer storage medium and a communication medium. The computer storage medium may include volatile and non-volatile media and removable and non-removable media that are implemented using any method or technology for storing information, such as computer-readable instructions, a data structure, a program module, or other types of data. The communication medium typically includes computer-readable instructions, a data structure, a program module, or other data of modulated data signal such as carrier waves, or other transmission mechanisms, and includes an arbitrary information transfer medium.
The foregoing description is for illustrative purposes, one of ordinary skill in the art will appreciate that other specific modifications may be easily made without departing from the technical spirit or essential features of the present disclosure. Therefore, the foregoing embodiments should be regarded as illustrative rather than limiting in all aspects. For example, some components, each of which has been described as being a single form, may be embodied in the distributed form, whereas some components, which have been described as being distributed, may be embodied in the combined form.
The transmission system for the multi-channel images according to the embodiments may increase convenience in data transmission of the multi-channel images and may reduce a processing time period when switching channels according to time lapse.
It should be understood that embodiments described herein should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each embodiment should typically be considered as available for other similar features or aspects in other embodiments.
While one or more embodiments have been described with reference to the figures, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the inventive concept as defined by the following claims.

Claims (14)

  1. A transmission system for multi-channel images, the transmission system comprising:
    a camera controller configured to control a plurality of cameras to photograph an object for a predetermined time period, and to transmit multi-channel images corresponding to the plurality of cameras to an image server via a communication network; and
    an image server configured to group and store the multi-channel images transmitted from the camera controller based on at least one of criterion according to time, a criterion according channels, and a criterion according to a combination of the time and the channels, and to transmit grouped images to a user terminal via the communication network according to a request from the user terminal.
  2. The transmission system of claim 1, wherein the criterion according to the combination of the time and the channels mixes images of a first to M-th (M is 2 or greater natural number) channels corresponding to a first time point to an N-th (N is two or greater natural number) time point, or mixes images of the M-th to the first channels corresponding to the first time to the N-th time.
  3. The transmission system of claim 1, wherein the criterion according to the combination of the time and the channels mixes images of a first channel to an M-th channel corresponding to an N-th time to a first time, or mixes images of the M-th to the first channels corresponding to the N-th time to the first time.
  4. The transmission system of claim 1, wherein images of channels are grouped, the channels corresponding to a ±y (y is a natural number) time period from an event that occurs at a time point during the predetermined time period.
  5. The transmission system of claim 1, wherein the camera controller is configured to transmit a photographing synchronization signal and a photographing operation driving signal to the plurality of cameras so that the plurality of cameras photograph the object at the same time, perform a compression process on multi-channel images transmitted from the plurality of cameras, and determine a data transmission method according to the communication network.
  6. The transmission system of claim 1, wherein the image server is configured to perform a decoding from the first channel on the grouped images, when an event corresponding to a request of the user terminal occurs in a channel from among the first to the M-th channels.
  7. The transmission system of claim 6, wherein the image server is configured to perform rendering on decoded images from the channel, in which the event has occurred, in a direction in which the event occurred.
  8. A method of controlling a transmission system for multi-channel images, the method comprising:
    controlling a plurality of cameras to photograph an object for a predetermined time period;
    transmitting multi-channel images corresponding to the plurality of cameras via a communication network;
    grouping and storing the multi-channel images transmitted from a camera controller based on at least one of a criterion according to time, a criterion according to channels, and a criterion according to a combination of the time and the channels; and
    transmitting grouped and stored images via the communication network according to a request from the user terminal.
  9. The method of claim 8, wherein the criterion according to the combination of the time and the channels mixes images of a first to M-th (M is 2 or greater natural number) channels corresponding to a first time point to an N-th (N is two or greater natural number) time point, images of the M-th to the first channels corresponding to the first time to the N-th time, images of a first channel to the M-th channel corresponding to the N-th time to the first time, or images of the M-th to the first channels corresponding to the N-th time to the first time.
  10. The method of claim 8, wherein images of channels are grouped, the channels corresponding to a ±y (y is a natural number) time period from an event that occurs at a time point during the predetermined time period.
  11. The method of claim 8, further comprising:
    performing a decoding from the first channel on the grouped images, when an event corresponding to a request of the user terminal occurs in a channel from among the first to the M-th channels;
    performing rendering on decoded images from the channel, in which the event has occurred, in a direction in which the event occurred; and
    transmitting rendered images to the user terminal.
  12. A reproducing apparatus for reproducing multi-channel images, the reproducing apparatus comprising:
    a memory in which multi-channel images are stored; and
    a processor configured to receive an event request from a channel from among a first channel to an M-th channel corresponding to the multi-channel images, perform decoding on the multi-channel images sequentially from the first channel, perform rendering on decoded images from the channel, in which an event occurs, in a direction of the event, and control rendered images to be reproduced.
  13. A method of controlling a reproducing apparatus for multi-channel images, the method comprising:
    receiving an event request from a channel from among a first channel to an M-th channel corresponding to the multi-channel images;
    performing decoding on the multi-channel images sequentially from the first channel;
    performing rendering on decoded images from the channel, in which the event has occurred, in a direction of the event; and
    controlling rendered images to be reproduced.
  14. A non-transitory computer-readable recording medium having recorded thereon a program, which when executed by a computer, performs the method of claim 13.
PCT/KR2017/014645 2017-12-12 2017-12-13 Transmission system for multi-channel image and method of controlling the same WO2019117346A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020170170453A KR101973190B1 (en) 2017-12-12 2017-12-12 Transmitting system for multi channel image and controlling method
KR10-2017-0170453 2017-12-12

Publications (1)

Publication Number Publication Date
WO2019117346A1 true WO2019117346A1 (en) 2019-06-20

Family

ID=66819353

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/014645 WO2019117346A1 (en) 2017-12-12 2017-12-13 Transmission system for multi-channel image and method of controlling the same

Country Status (2)

Country Link
KR (1) KR101973190B1 (en)
WO (1) WO2019117346A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040071555A (en) * 2003-02-06 2004-08-12 (주)피카소정보통신 Muliti-channel image data processing system and method
JP2008211417A (en) * 2007-02-26 2008-09-11 Fujitsu Ltd Multi-viewpoint moving image transmission system
KR101399951B1 (en) * 2013-07-25 2014-06-17 주식회사 넥스트이온 Multi-view video steaming system and providing method thereof
KR20150029461A (en) * 2013-09-10 2015-03-18 (주)포스트미디어 Method of synchronizing tiled image in a streaming service providing system of panoramic image
JP5920708B2 (en) * 2012-02-29 2016-05-18 国立大学法人名古屋大学 Multi-view video stream viewing system and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040071555A (en) * 2003-02-06 2004-08-12 (주)피카소정보통신 Muliti-channel image data processing system and method
JP2008211417A (en) * 2007-02-26 2008-09-11 Fujitsu Ltd Multi-viewpoint moving image transmission system
JP5920708B2 (en) * 2012-02-29 2016-05-18 国立大学法人名古屋大学 Multi-view video stream viewing system and method
KR101399951B1 (en) * 2013-07-25 2014-06-17 주식회사 넥스트이온 Multi-view video steaming system and providing method thereof
KR20150029461A (en) * 2013-09-10 2015-03-18 (주)포스트미디어 Method of synchronizing tiled image in a streaming service providing system of panoramic image

Also Published As

Publication number Publication date
KR101973190B1 (en) 2019-08-26

Similar Documents

Publication Publication Date Title
CN101083742B (en) Communication system, communication method, video output apparatus and video input apparatus
CN103442207B (en) Stage dispatching video monitoring system based on IP networking
WO2016027977A1 (en) 360 degree space image reproduction method and system therefor
WO2014069785A1 (en) Video conference call device and video conference output method using same
US20150101002A1 (en) Signal processing apparatus, signal processing method, program, and signal transmission system
WO2012161556A2 (en) Method and apparatus for controlling a data rate in a wireless communication system
WO2013077525A1 (en) Control method and device using same
KR20100073079A (en) Multiple camera control and image storing apparatus and method for synchronized multiple image acquisition
WO2015046688A1 (en) Helmet for shooting multi-angle image and shooting method
WO2018186646A1 (en) Device and method for processing high-definition 360-degree vr image
WO2020101094A1 (en) Method and apparatus for displaying stereoscopic strike zone
WO2023096392A1 (en) System for automatically producing video
WO2019004783A1 (en) Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus
WO2015064854A1 (en) Method for providing user interface menu for multi-angle image service and apparatus for providing user interface menu
WO2019117346A1 (en) Transmission system for multi-channel image and method of controlling the same
KR20190032670A (en) video service providing system using multi-view camera
WO2015064855A1 (en) Method for providing user interface menu for capturing multi-angle image and apparatus for providing user interface menu
WO2020085571A1 (en) Image converting apparatus and system for generating 360 vr image in real time
WO2016018102A1 (en) System for cloud streaming-based broadcast-associated service, client apparatus for broadcast-associated service, trigger content provision server and method utilizing same
WO2020138541A1 (en) Method and apparatus for generating multi-channel video using mobile terminal
WO2015037761A1 (en) Method for providing multi-angle image service and system using same
WO2018155910A1 (en) Method, for supporting relay broadcast, device and non-transitory computer-readable recording medium
WO2019004498A1 (en) Multichannel image generation method, multichannel image playing method, and multichannel image playing program
WO2015034123A1 (en) Buffer management method for reproducing images from multiple action cams and reproduction apparatus thereof
WO2015034122A1 (en) Method and terminal for providing synchronization of multiple action cam images

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17934681

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17934681

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22/01/2021)