WO2019004498A1 - Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal - Google Patents

Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal Download PDF

Info

Publication number
WO2019004498A1
WO2019004498A1 PCT/KR2017/006869 KR2017006869W WO2019004498A1 WO 2019004498 A1 WO2019004498 A1 WO 2019004498A1 KR 2017006869 W KR2017006869 W KR 2017006869W WO 2019004498 A1 WO2019004498 A1 WO 2019004498A1
Authority
WO
WIPO (PCT)
Prior art keywords
channel
image
images
user
reproducing
Prior art date
Application number
PCT/KR2017/006869
Other languages
English (en)
Korean (ko)
Inventor
정홍수
Original Assignee
포디리플레이 인코포레이티드
주식회사 이에스엠연구소
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 포디리플레이 인코포레이티드, 주식회사 이에스엠연구소 filed Critical 포디리플레이 인코포레이티드
Priority to KR1020197036406A priority Critical patent/KR20200001597A/ko
Priority to PCT/KR2017/006869 priority patent/WO2019004498A1/fr
Priority to PCT/KR2018/007414 priority patent/WO2019004783A1/fr
Priority to CN201880039134.0A priority patent/CN110741648A/zh
Priority to US16/619,928 priority patent/US20200213631A1/en
Priority to EP18823400.9A priority patent/EP3621309A4/fr
Priority to JP2019569808A priority patent/JP2020524450A/ja
Publication of WO2019004498A1 publication Critical patent/WO2019004498A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/87—Regeneration of colour television signals

Definitions

  • the present invention relates to a multi-channel image generating method, a multi-channel image reproducing method, and a multi-channel image reproducing program, and more particularly, And more particularly to a video playback method and a video playback program capable of switching a channel or a time by an operation of a user.
  • a video service that geometrically calibrates and synthesizes a plurality of images obtained by photographing a single subject in various channels with a plurality of cameras, and provides a multi-channel image to a user.
  • These multi-channel images provide realistic images that transcend the concept of high-quality images, thereby allowing users to feel more immersive in the media and to greatly enhance the effect of transmitting video information in advertising, education, medical care, defense and entertainment have.
  • the channel / time switching is simply reproduced by a predetermined merging method when the multi-channel image is produced. That is, conventionally, a plurality of frames are acquired from a plurality of cameras, a part of the acquired frames is selected, and a single channel switching image is produced by merging the frames. Since the channel switching image is a simple combination of a predetermined channel frame at the time of image production, when the corresponding image file is reproduced, the merged frames have a channel switching effect showing a single channel shifting effect. According to such a conventional multi-channel video, the user simply watches a pre-produced channel switching effect. When a viewer manually operates the time switching or channel switching to turn the channel to a desired timing It was impossible to do.
  • the present invention has been made to solve the above-mentioned needs, and it is an object of the present invention to provide a method and a method for generating a multi-channel image capable of manually turning an image according to a user's operation.
  • a method for generating a multi-channel image comprising: receiving a plurality of images taken from a plurality of cameras arranged in an array around a subject in multiple angles; Correcting each of the plurality of received images; Encoding each of the plurality of corrected images with an image compression standard to generate a plurality of short channel images; And generating a multi-channel image by multiplexing the plurality of short channel images, wherein the plurality of short channel images have a GOP value of 1.
  • the image compression standard may be an MJPEG, MPEG4 or H.264 codec.
  • the correcting step may correct at least one of a size, a gradient, and a center position of an image.
  • a reproducing method comprising: receiving the multi-channel image from a server; Reproducing the multi-channel image at a predetermined point in time in the received multi-channel image; Receiving at least one of a channel control event, a time control event, a channel and a time control event, and a zoom-in event from a user; And reproducing the multi-channel image while moving a channel or time of the multi-channel image according to the event.
  • the multi-channel image may be played back at the time of the end of the corresponding control event.
  • control event may be generated by a user's touch operation on a display unit of a user terminal for reproducing the multi-channel image, wherein the channel control event is generated by a continuous touch operation along a first direction on the display unit, The control event is generated by a continuous touch operation along the second direction on the display unit, and the channel and time control event may be generated by a continuous touch operation along the third direction on the display unit.
  • the present invention includes a multi-channel image reproducing program stored in a computer-readable recording medium on which a computer program executed by the multi-channel image reproducing method is recorded.
  • a method for generating a multi-channel image comprising: receiving a plurality of images of a plurality of cameras arranged in an array around a subject in multiple angles; step; Correcting each of the plurality of received images; Encoding each of the plurality of corrected images with an image compression standard to generate a plurality of short channel images; And extracting frames at a specific time from the plurality of corrected images, and generating a channel switching image composed of the extracted frames.
  • the GOP value of the channel switching image may be 1.
  • the image compression standard may be an MJPEG, MPEG4 or H.264 codec.
  • the correcting step may correct at least one of a size, a gradient, and a center position of an image.
  • a playback method comprising: a first step of transmitting a streaming request signal to a server; A second step of selectively receiving one of a plurality of short channel images or a plurality of channel switching images from the server; And a third step of reproducing the received short channel image or channel switching image upon receiving the reproduction request signal from the user.
  • the second step may receive a predetermined image from the server among the short channel image or channel switching image, or receive the image selected by the user in the step of transmitting the streaming request signal to the server.
  • the channel switching image is received from the server in the second step, after receiving the short channel image playback event from the user after the third step of reproducing the received channel switching image, Transmitting the generated information to the server; A fifth step of receiving, from the server, a short channel image corresponding to a channel at the time of receiving the short channel image reproduction event among the plurality of short channel images; And a sixth step of receiving a reproduction request signal from the user and reproducing the received short channel image.
  • a multi-channel image reproducing apparatus comprising: a multi-channel image reproducing program stored in a computer-readable recording medium having a computer program recorded thereon.
  • the user directly operates the input means of the terminal to freely switch the channel or time of the reproduced image, Channel image generating method, a multi-channel image reproducing method, and a reproducing program capable of performing multi-channel image reproduction.
  • FIG. 1 is a flowchart illustrating a method of generating a multi-channel image according to a first embodiment of the present invention.
  • FIG. 2 is a conceptual view showing a plurality of camera arrangement structures arranged in an array around a subject.
  • FIG. 3 is a diagram conceptually showing each image received from a plurality of cameras in a frame.
  • FIG. 4 conceptually shows a plurality of short channel images generated by encoding a plurality of images.
  • FIG. 5 is a diagram conceptually showing one multi-channel image generated by synthesizing a plurality of short channel images.
  • FIG. 6 is a flowchart illustrating a method of reproducing a multi-channel image according to the first embodiment of the present invention.
  • FIG. 7 is a flowchart illustrating a method of generating a multi-channel image according to a second embodiment of the present invention.
  • FIG. 8 is a diagram conceptually showing a plurality of short channel images generated by encoding a plurality of images.
  • FIG. 9 is a conceptual view illustrating a channel switching image.
  • FIG. 10 is a flowchart illustrating a method of reproducing a multi-channel image according to a second embodiment of the present invention.
  • FIG. 11 is a conceptual diagram illustrating a reproduction scenario of a multi-channel image according to a second embodiment of the present invention.
  • FIG. 11 is a conceptual diagram showing another reproduction scenario of a multi-channel image according to the second embodiment of the present invention.
  • FIG. 1 In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unnecessary.
  • the terms described below are defined in consideration of the structure, role and function of the present invention, and may be changed according to the intention of the user, the intention of the operator, or the custom.
  • Multi-channel image generation method and multi-channel image reproduction method are 1st.
  • a multi-channel image generating method includes: a step (S1) of receiving a plurality of images taken from a plurality of cameras arranged in an array around a subject in multiple angles, a step of correcting each of the plurality of received images S2), generating a plurality of short channel images by encoding each of the corrected plurality of images to an image compression standard, and generating a multi-channel image by synthesizing a plurality of short channel images (MUXING) (S4).
  • a plurality of cameras arranged in an array around a subject receives a plurality of images of the subject photographed at multiple angles.
  • 2 is a conceptual view showing a plurality of camera arrangement structures arranged in an array around a subject.
  • the plurality of camera array methods may be, for example, arranging n cameras in a line on substantially the same plane with respect to any camera.
  • n cameras may be sequentially arranged on a circle spaced a certain distance from the subject, or the distances between the two cameras disposed on both sides of the camera positioned at the center may be matched with the distance between the subject and the camera The distance to the subject may be different.
  • 3 is a diagram conceptually showing each image received from a plurality of cameras in a frame.
  • n cameras capture the same subject at multiple angles, each camera acquires an image for a predetermined time at a specific channel (viewpoint), and the server receives the acquired n images.
  • the subject is not particularly limited. For example, when a batting stadium of a baseball game is set as a subject, n-angle-specific images of the target are received by the server.
  • each of the plurality of received images is corrected. Since the geometric error of the n camera arrays appears as a visual shake in the process of reproducing a multi-channel image, at least one of size, slope or center position of each image is corrected to remove it.
  • Each corrected image may be generated as a container, for example, MP4 or TS.
  • a video stream is composed of three types of frames (Frames).
  • the three types of frames are an intra-frame (I frame), a predictive frame (P frame), and a bi-directionally predictive frame (B frame).
  • the I frame does not use the motion vector estimation / compensation but simply DCT-codes the frame.
  • the P frame performs motion estimation / compensation with reference to the I frame or another P frame, and then DCT-codes the remaining difference data
  • B frame performs motion estimation / compensation from two frames on the time axis using motion compensation like P frame.
  • a sequence is defined by a segment called a group of pictures (GOP), and I, B, B, P, B, B, P ...
  • a frame from an I frame to a next I frame is referred to as a GOP (Group of Picture).
  • a GOP is composed of a set of images having a duration of a predetermined time (e.g., 0.5 seconds) when displayed at an intended speed.
  • a predetermined time e.g. 0.5 seconds
  • each of the corrected images described above is a set of GOPs composed of a single I frame, a single number or a plurality of B frames, and a single or plural P frames.
  • Each corrected image includes one I frame and at least one P frame or B frame.
  • step S3 a plurality of (n) short channel images are generated by encoding each of the plurality of corrected images using the software with an image compression standard.
  • the image compression standard is preferably an MJPEG, MPEG4 or H.264 codec.
  • FIG. 4 conceptually shows a plurality of short channel images generated by encoding a plurality of images.
  • the short channel image generated through step S3 as described above is composed of a plurality of I frames.
  • MJPEG is an image compression method for compressing an image frame by frame, and is a kind of video stream in which each frame is compressed by JPEG and time information is inserted between JPEG frames.
  • the corrected image before being encoded by the MJPEG codec is present, for example, as an MP4 or a TS container, and the corresponding image includes one I frame and at least one P frame or B frame as shown in FIG.
  • the image compression standard that is, the short channel image encoded by the MJPEG codec, since each image is compressed for each frame, each frame has one complete image.
  • the above-described short channel image is an image having a GOP size of 1, in which all frames in the image are I frames.
  • each of the plurality of images is encoded with the MJPEG codec, thereby substantially converting the GOP size to 1.
  • the capacity becomes larger due to the compression in units of frames.
  • the GOP size of the short channel image is substantially converted to 1, which is the same as the MJPEG described above.
  • each image having a non-1 GOP size is encoded with an MJPEG, MPEG4, or H.264 codec, thereby substantially converting the GOP size to 1.
  • step S4 a plurality of short channel images are synthesized (MUXING) to generate one multi-channel image.
  • 5 is a diagram conceptually showing one multi-channel image generated by synthesizing a plurality of short channel images.
  • a multi-channel image reproduced by combining a plurality of short channel images and regenerated as one media file may be generated as a container, for example, MP4 or TS.
  • step S4 a plurality of short channel images are synthesized (MUXING) And generates a single multi-channel image.
  • the multi-channel image reproduction method of the present invention is a multi-channel image reproduction method for reproducing a multi-channel image generated by the above-described method in a user terminal.
  • the multi-channel image playback method includes receiving a multi-channel image from the server (S11), receiving a playback request signal from the user, and reproducing the multi-channel image at a predetermined point in time of the received multi- (S31) of receiving a channel control event, a time control event, a channel and a time control event, and a zoom-in event from a user (S31) (S41) of moving a channel or time of the screen or enlarging a screen and reproducing a multi-channel image.
  • a multi-channel image is received from the server.
  • a multi-channel image is a combination of images of a subject photographed at various angles for a predetermined time, and has channel information (viewpoint information) together with time information.
  • step S21 upon receipt of the user's reproduction request signal, the multi-channel image is reproduced on the user's terminal at a preset specific time point of the received multi-channel image.
  • a multi-channel image can be reproduced at the time of the fourth camera, and the channel can be preset by the user in the reproduction program and manually selected before reproduction.
  • the user receives at least one of a channel control event, a time control event, a channel and time control event, and a screen zoom event.
  • the above-described user terminal can perform both a display function and an input function, and can be a terminal equipped with a touch screen equipped with various types of touch-based user interfaces.
  • the control event may be generated by a user's touch operation on the display unit of the user terminal
  • the channel control event is generated by a continuous touch operation along the first direction on the display unit
  • the channel and time control event may be generated by a continuous touch operation along the third direction on the display unit.
  • the time can be moved by dragging the liquid crystal screen, which is the display unit, in the left and right direction by using a user's finger or a separate touch input means, and the channel can be moved by vertically dragging, And is set to simultaneously move the channels.
  • a zoom-in event can be controlled by zooming out two or more points of an area to be enlarged on the screen of the display section or by touching an enlargement icon on the display section.
  • a known touch interface input recognition technique is adopted as a method of recognizing the initial recognition position and the final recognition position when applying the touch operation and the drag input between them.
  • step S41 a multi-channel image is reproduced while moving the channel or time of the multi-channel image according to the event. Specifically, when a continuous touch operation is applied from the user along the first direction (that is, when a channel control event is recognized) while a multi-channel image is being reproduced on a specific channel, only the channel is switched while the time is fixed at t 1 The frame is reproduced to move. For example, assuming that the multi-channel image is reproduced at the viewpoint of the fourth camera and the first direction is the up-and-down direction, if the upward drag input is recognized by the user, it is fixed at time t 1 , 6, and 7 in the direction of the camera.
  • the channel is switched while being fixed at time t 1 at the time of inputting the control event while being switched in the direction of the camera 3, 2 and 1. Further, when the operation direction input from the top switch to the lower drag and drag input, is switched to channel the station only at that time t 1.
  • a continuous touch operation is applied from the user along the second direction (that is, when a time control event is recognized) while the multi-channel image is being reproduced at a specific time point, The frame is reproduced. For example, assuming that the multi-channel image is reproduced at the viewpoint of the fourth camera and the second direction is the left-right direction, when the dragging input from the user to the left direction is recognized, the channel is fixed and the time is previously switched while being reproduced.
  • control event end signal can recognize a signal that the continuous touch input from the user is no longer recognized by the terminal as a termination signal.
  • the present invention further includes a multi-channel image playback program stored in a computer-readable recording medium on which the computer program is recorded, the multi-channel image playback method.
  • FIG. 7 is a flowchart illustrating a method of generating a multi-channel image according to a second embodiment of the present invention.
  • a multichannel image generating method of the present invention comprises the steps of: (S1) receiving a plurality of images of a plurality of cameras arranged in an array around a subject at a plurality of angles; A step (S2) of generating a plurality of short channel images by encoding each of the plurality of corrected images with an image compression standard, and a step (S3) of extracting frames at a specific time with respect to the plurality of corrected images , And generating a channel switching image composed of the extracted frames (S4).
  • Steps S1 to S3 are substantially the same as the method of generating a multi-channel image according to the first embodiment of the present invention, and therefore, the above description is referred to.
  • a plurality of short-channel images are generated by encoding each of the plurality of images into an image compression standard.
  • the short-channel image may be produced such that the GOP size is 1 as necessary. That is, the GOP size of the short channel image is substantially converted to 1 by encoding each of the non-1 GOP images into the image compression standard.
  • the image compression standard is preferably MJPEG, MPEG4 or H.264.
  • the image before being encoded exists, for example, as an MP4 or a TS container, and one I frame and at least one P frame or B frame are included in the image.
  • each frame has one complete image.
  • the short channel image can be generated as an image having a GOP size of 1, in which all frames in an image are I frames.
  • step S4 the software is used to extract frames at a specific time from the plurality of corrected images, and a channel switching image composed of the extracted frames is generated.
  • 9 is a conceptual view illustrating a channel switching image. More specifically, first, frames at each time are extracted and image-processed to acquire a plurality of images having the same time but moving channels.
  • the server has a plurality of short channel images fixed at the time taken by each camera and a channel switching image for stopping at a specific time but moving only the channel for each time t.
  • the channel switching image can be made to have a GOP value of 1.
  • all frames of an image acquired by each camera may be converted into an I frame image, and a channel switching image may be generated with I frames obtained at each time t.
  • a plurality of channel switching images may be generated by encoding the corresponding channel switching image into an image compression standard. That is, by performing encoding of a channel switching image with a GOP size of not 1 as an image compression standard, the GOP size of the channel switching image is substantially converted to 1.
  • the image compression standard is preferably MJPEG, MPEG4 or H.264.
  • the multi-channel image reproduction method of the present invention is a multi-channel image reproduction method for reproducing a multi-channel image generated by the above-described method in a user terminal.
  • a first step (S11) of transmitting a streaming request signal to a server a second step (S21) of selectively receiving one of a plurality of short channel images or a plurality of channel switching images from the server, And a third step (S31) of reproducing the received short channel image or channel switching image upon receiving the reproduction request signal.
  • a streaming request signal is transmitted to the server.
  • one of the plurality of short channel images or the plurality of channel switching images is selectively received from the server.
  • the server may previously specify whether to transmit the short channel image to the user terminal or to transmit the channel switching image to the user terminal.
  • the user may select one of the short channel image or the channel switching image, transmit the streaming request signal, and receive the designated image.
  • the case of receiving a short channel image and the case of receiving a channel switching image will be described.
  • the received short channel image is reproduced upon receiving the reproduction request signal from the user in the third step.
  • the streaming request signal may include channel information regarding an initial playback start time, and may further include information on an initial playback start time.
  • the user terminal receives and reproduces a short channel image corresponding to the corresponding channel information among a plurality of short channel images from the server.
  • FIG. 11 exemplarily illustrates a video reproduction scenario when a streaming request signal includes a second camera as channel information.
  • a fourth step upon receiving a channel control event from the user, the channel control event generation information is transmitted to the server.
  • the next step 5 a channel switching image corresponding to the reception time of the channel control event among the plurality of channel switching images is received from the server.
  • the sixth step upon receiving the reproduction request signal from the user, the received channel switching image is reproduced.
  • the channel control event generation information may include information on the event generation time. Again, 11, the camera 2 when the one-channel image to the point being played, when the user of the channel control event at time t 1 recognized, the information including information of event occurrence time t 1 server And the server transmits a channel switching image corresponding to t 1 of the plurality of channel switching images to the user terminal. The user terminal reproduces the channel switching image received from the server.
  • the channel control event may be generated by a touch operation of the user with respect to the display unit of the user terminal, and may be generated by a continuous touch operation along the first direction on the display unit of the user terminal.
  • a channel viewpoint, viewpoint
  • a liquid crystal screen which is a display unit
  • a user's finger or another touch input means For example, when the first direction is to assume that the upper and lower direction, when a drag input operation is continuous along the lower side by the user at time t 1 is applied, the user terminal in the channel switching image corresponding to of t 1, a plurality of channel switching image server From the server.
  • the received channel switching image is reproduced while the channel is being switched in the direction of the camera 3, 4, 5 while the time is fixed at t 1 11).
  • the received channel switching image is reproduced while being switched to the direction of the first camera.
  • the seventh step upon reception of the channel control end event from the user, information on generation of the channel control end event is transmitted to the server.
  • a short channel image corresponding to the channel at the time of receiving the channel control event end signal among the plurality of short channel images is received from the server.
  • the reproduction request signal is received from the user, Plays the channel image.
  • the channel control end event generation information may include information on a channel (viewpoint) at the end of the event. 11, when a channel switching image at time t 1 is being reproduced and a channel control end event of the user is recognized at a time when the channel switching reaches the camera 5, Is transmitted to the server.
  • the channel control end event can recognize a continuous touch input from the user as a signal that is no longer recognized by the terminal as a termination signal.
  • the server selects a short channel image corresponding to the fifth channel among a plurality of short channel images, and transmits the short channel image to the user terminal.
  • the user terminal reproduces the short channel image received from the server from time t 1 onward.
  • a method for controlling an image processing apparatus comprising: receiving a time control event from a user; This reproduction process may be performed after the third step of reproducing the short channel image received at the user terminal, or after the ninth step of reproducing the received short channel image.
  • This reproduction process may be performed after the third step of reproducing the short channel image received at the user terminal, or after the ninth step of reproducing the received short channel image.
  • the time point view point
  • the frame is reproduced so as to be switched.
  • the multi-channel image is reproduced at the viewpoint of the fifth camera and the second direction is the left-right direction, when the dragging input from the user to the left direction is recognized, the time is previously switched while the viewpoint is fixed.
  • the received channel switching image is reproduced upon receiving the reproduction request signal from the user.
  • the streaming request signal may include time information regarding an initial playback start time, and may further include information regarding an initial playback start time.
  • the user terminal can reproduce the channel switching video from the predetermined time in the predetermined channel.
  • the image reproduction scenario is exemplarily shown when the initial reproduction start time is set to t 1 in the streaming request signal and the initial reproduction time is set to the second camera.
  • a short channel image reproduction event is received from the user, and the generation information of the short channel image reproduction event is transmitted to the server.
  • a short channel image corresponding to the channel at the time of receiving the short channel image reproduction event among the plurality of short channel images stored in the server is received from the server.
  • the reproduction request signal is received from the user and the received short channel image is reproduced.
  • the information on the channel at the time of event generation may be included in the generation information of the short channel image reproduction event. For example, referring to FIG. 12, it is assumed that the channel starts from camera No. 2 while the time is fixed at t 1 , the image is reproduced while the channel is switched to the camera No.
  • the server selects a short channel image corresponding to the fourth channel among the plurality of short channel images, and transmits the short channel image to the user terminal.
  • the user terminal reproduces the fourth channel image received from the server from time t 1 onward.
  • This reproduction process may be performed after the third step of reproducing the short channel image received by the user terminal, or after the sixth step of reproducing the received short channel image.
  • This reproduction process may be performed after the third step of reproducing the short channel image received by the user terminal, or after the sixth step of reproducing the received short channel image.
  • a continuous touch operation is applied from the user in the second direction (that is, when a time control event is recognized) when the fourth multi-channel image is being played back
  • the frame is reproduced so as to move only the time while being fixed to the channel.
  • the second direction is the horizontal direction
  • the leftward drag input recognized by the user there is the point that a fixed holding time can not be reproduced while switching between t 1 and t 2.
  • channel control event generation information is transmitted to the server. Then, a channel switching image corresponding to the reception time of the channel control event among the plurality of channel switching images is received from the server. Upon receiving the reproduction request signal from the user, the received channel switching image is reproduced.
  • the channel control event generation information may include information on the event generation time.
  • fourth camera when the one-channel image to the point being played, when the user of the channel control event at time t 2 recognized, the information including information of event occurrence time t 2 server is sent to, the server transmits a channel switch video corresponding to t 2 of the plurality of switching video channels in a user terminal.
  • the user terminal reproduces the channel switching image received from the server. For example, when the first direction is to assume that the upper and lower direction, when a drag input operation is continuous along the lower side by the user at time t 2 is applied, the user terminal in the channel switching image corresponding to of t 2 a plurality of channel switching image server From the server.
  • the received channel switching image is reproduced as only the time channels fixed in the holding t 2 5, 6, 7 by switching the direction of the camera.
  • the received channel switching image is reproduced while being channel switched to the camera direction # 3.
  • the channel control end event generation information may include information on a channel (viewpoint) at the end of the event. 12, when a channel switching image at time t 2 is being reproduced and a channel switching event is recognized at the N-1th camera, a channel control end event of the user is recognized, Is transmitted to the server.
  • the channel control end event can recognize a continuous touch input from the user as a signal that is no longer recognized by the terminal as a termination signal.
  • the server selects a short channel image corresponding to the (N-1) th channel among a plurality of short channel images and transmits the selected short channel image to the user terminal.
  • the user terminal reproduces the N-1th channel image received from the server from time t 2 onward.
  • a method for controlling an image processing apparatus comprising: receiving a time control event from a user; For example, when a continuous touch operation is applied from the user along the second direction (that is, when a time control event is recognized) while the N-1 multi-channel image is being reproduced, the viewpoint is fixed to the N-1 channel The frame is reproduced so that only the time is switched.
  • the channel switching control is possible before or after the third step, i.e., the step of reproducing the received channel switching image. That is, the user can watch an image while switching the channel even before receiving and reproducing the channel switching video or while reproducing the channel switching video.
  • the method may include receiving a channel control event from a user, and reproducing the channel switching image while moving the received channel switching image according to a channel control event. For example, when a downward drag input operation is applied from the user, the channel switching image is reproduced while switching only the channel while the time is fixed. On the other hand, if the user inputs an upward drag input, the received channel switching image is reproduced while the channel is switched in the opposite direction.
  • the present invention further includes a multi-channel image playback program stored in a computer-readable recording medium on which the computer program is recorded, the multi-channel image playback method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Un mode de réalisation de la présente invention concerne un procédé de génération d'image multicanal comprenant les étapes consistant à : recevoir une pluralité d'images obtenues en photographiant un sujet sous différents angles avec une pluralité de caméras agencées en réseau autour du sujet ; corriger chacune de la pluralité d'images reçues ; coder chacune de la pluralité d'images corrigées selon une norme de compression d'image de sorte à générer une pluralité d'images monocanal ; et multiplexer la pluralité d'images monocanal de sorte à générer une image multicanal, la pluralité d'images monocanal ayant une valeur GOP de 1.
PCT/KR2017/006869 2017-06-29 2017-06-29 Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal WO2019004498A1 (fr)

Priority Applications (7)

Application Number Priority Date Filing Date Title
KR1020197036406A KR20200001597A (ko) 2017-06-29 2017-06-29 다채널 영상 생성 방법, 다채널 영상 재생 방법 및 다채널 영상 재생 프로그램
PCT/KR2017/006869 WO2019004498A1 (fr) 2017-06-29 2017-06-29 Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal
PCT/KR2018/007414 WO2019004783A1 (fr) 2017-06-29 2018-06-29 Système de transmission d'image multicanal, procédé de commande associé ainsi que procédé et appareil de lecture d'image multicanal
CN201880039134.0A CN110741648A (zh) 2017-06-29 2018-06-29 用于多频道画像的传输系统及其控制方法、多频道画像的播放方法及其装置
US16/619,928 US20200213631A1 (en) 2017-06-29 2018-06-29 Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus
EP18823400.9A EP3621309A4 (fr) 2017-06-29 2018-06-29 Système de transmission d'image multicanal, procédé de commande associé ainsi que procédé et appareil de lecture d'image multicanal
JP2019569808A JP2020524450A (ja) 2017-06-29 2018-06-29 多チャネル映像のための伝送システム及びその制御方法、多チャネル映像再生方法及びその装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2017/006869 WO2019004498A1 (fr) 2017-06-29 2017-06-29 Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal

Publications (1)

Publication Number Publication Date
WO2019004498A1 true WO2019004498A1 (fr) 2019-01-03

Family

ID=64741959

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/006869 WO2019004498A1 (fr) 2017-06-29 2017-06-29 Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal

Country Status (2)

Country Link
KR (1) KR20200001597A (fr)
WO (1) WO2019004498A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113572975A (zh) * 2020-04-29 2021-10-29 华为技术有限公司 视频播放方法、装置及系统、计算机存储介质
WO2022222533A1 (fr) * 2021-04-22 2022-10-27 华为技术有限公司 Procédé, appareil et système de lecture de vidéo, et support de stockage lisible par ordinateur

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5235411B2 (ja) * 2005-08-26 2013-07-10 パナソニック株式会社 多重化方法、再生方法、多重化装置、記録装置、再生装置、プログラムおよび集積回路
KR20150061459A (ko) * 2013-11-27 2015-06-04 주식회사 넥스트이온 다시점 비디오 스트리밍 시스템 및 그 제공방법
KR101649752B1 (ko) * 2014-05-16 2016-08-19 주식회사 이에스엠연구소 영상 매트릭스 인터페이스를 이용한 다시점 영상 생성 방법 및 다시점 영상 생성 시스템
KR20160144486A (ko) * 2014-05-15 2016-12-16 가부시키가이샤 리코 촬상 시스템, 촬상 장치, 컴퓨터 프로그램 및 시스템
KR20170061010A (ko) * 2015-11-25 2017-06-02 주식회사 이에스엠연구소 가상 모션 제어 카메라의 영상 생성 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5235411B2 (ja) * 2005-08-26 2013-07-10 パナソニック株式会社 多重化方法、再生方法、多重化装置、記録装置、再生装置、プログラムおよび集積回路
KR20150061459A (ko) * 2013-11-27 2015-06-04 주식회사 넥스트이온 다시점 비디오 스트리밍 시스템 및 그 제공방법
KR20160144486A (ko) * 2014-05-15 2016-12-16 가부시키가이샤 리코 촬상 시스템, 촬상 장치, 컴퓨터 프로그램 및 시스템
KR101649752B1 (ko) * 2014-05-16 2016-08-19 주식회사 이에스엠연구소 영상 매트릭스 인터페이스를 이용한 다시점 영상 생성 방법 및 다시점 영상 생성 시스템
KR20170061010A (ko) * 2015-11-25 2017-06-02 주식회사 이에스엠연구소 가상 모션 제어 카메라의 영상 생성 방법

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113572975A (zh) * 2020-04-29 2021-10-29 华为技术有限公司 视频播放方法、装置及系统、计算机存储介质
WO2022222533A1 (fr) * 2021-04-22 2022-10-27 华为技术有限公司 Procédé, appareil et système de lecture de vidéo, et support de stockage lisible par ordinateur

Also Published As

Publication number Publication date
KR20200001597A (ko) 2020-01-06

Similar Documents

Publication Publication Date Title
WO2010027143A2 (fr) Système et procédé de transmission multimédia
WO2009107975A1 (fr) Dispositif de comparaison d'images utilisant un enregistreur personnel de vidéo et procédé d'utilisation de celui-ci
JP5047607B2 (ja) ストリーム記録装置、ストリーム記録方法、記録システム、および記録再生システム
CN101083742B (zh) 通信系统、通信方法、视频输出设备和视频输入设备
JP2008160748A5 (fr)
WO2011005025A2 (fr) Procédé de traitement de signal et appareil correspondant utilisant la taille de l'écran d'un dispositif d'affichage
WO2015076537A1 (fr) Procédé de fourniture de vidéo, et système de fourniture de vidéo
TW200414763A (en) Apparatus for receiving a digital information signal
WO2013077525A1 (fr) Procédé de commande et dispositif utilisant ce procédé
KR100884400B1 (ko) 영상처리장치 및 그 방법
WO2013172636A1 (fr) Appareil d'affichage, et son un procédé de commande
US7103260B1 (en) Video editing system
WO2019004783A1 (fr) Système de transmission d'image multicanal, procédé de commande associé ainsi que procédé et appareil de lecture d'image multicanal
WO2010150961A1 (fr) Dispositif de fourniture d'images 3d, dispositif d'affichage, ainsi que procédé correspondant
WO2019004498A1 (fr) Procédé de génération d'image multicanal, procédé de lecture d'image multicanal, et programme de lecture d'image multicanal
JP2003299038A (ja) フレーム変換装置及びフレーム変換方法
WO2015037761A1 (fr) Procédé permettant d'obtenir un service d'image sous plusieurs angles et système utilisant ce procédé
WO2015064855A1 (fr) Procédé pour fournir un menu d'interface utilisateur pour capturer une image multi-angles et appareil pour fournir un menu d'interface utilisateur
WO2021107708A1 (fr) Dispositif et procédé de diffusion d'images de réalité virtuelle entrées à partir d'une pluralité de caméras en temps réel
WO2015034123A1 (fr) Procédé de gestion de tampon pour la reproduction d'images provenant de plusieurs caméras d'action et appareil de reproduction associé
KR20160140509A (ko) 복수개의 동영상을 동시에 출력하는 시스템
WO2023128491A1 (fr) Procédé de fonctionnement pour système de transmission d'image multicanal, et système de réalisation associé
JP2004247937A (ja) 画像撮影装置
WO2018155910A1 (fr) Procédé de prise en charge de diffusion relais, dispositif, et support d'enregistrement non transitoire lisible par ordinateur
JP2007104540A (ja) 撮影画像配信装置、撮影画像配信プログラム及び撮影画像配信方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17915661

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20197036406

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17915661

Country of ref document: EP

Kind code of ref document: A1