WO2018026152A1

WO2018026152A1 - System and method for adaptively reproducing landscape video content

Info

Publication number: WO2018026152A1
Application number: PCT/KR2017/008242
Authority: WO
Inventors: 김남균; 이호림
Original assignee: (주)잼투고
Priority date: 2016-08-03
Filing date: 2017-07-31
Publication date: 2018-02-08
Also published as: KR101895865B1; KR20180015493A

Abstract

The present invention relates to a system and method for adaptively reproducing a landscape video content. A method for adaptively reproducing a landscape video content, according to the present invention, comprises the steps of: receiving, by a user terminal, a landscape video content, the number of horizontal pixel data of which exceeds the number of vertical pixel data thereof, through a video reproducing application which is driven by an operation processing module and visually displays a video content through a display module; determining, by the user terminal, whether the video reproducing application is in a landscape display mode in which the length of a horizontal display area exceeds the length of a vertical display area or in a portrait display mode in which the length of a vertical display area exceeds the length of a horizontal display area; reproducing the landscape video content by the video reproducing application to display, through the display module, the entire area of the landscape video content comprising all of the horizontal pixel data and all of the vertical pixel data when the video reproducing application is in the landscape display mode; reproducing the landscape video content by the video reproducing application to display, through the display module, a first partial area of the landscape video content comprising all of the vertical pixel data and a part of the horizontal pixel data when the video reproducing application is in the portrait display mode; and continuously reproducing the landscape video content by the video reproducing application to display, through the display module, a second partial area of the landscape video content comprising all of the vertical pixel data and a part of horizontal pixel data of the first partial area and of other horizontal pixel data, in response to a user input through a user interface module while the landscape video content is being reproduced in the portrait display mode.

Description

Adaptive playback system and playback method of landscape video contents

The present invention relates to an adaptive playback system and a playback method of landscape video content, and more particularly, to a playback system and a playback method capable of adaptively changing a display method of landscape video content according to a change in direction of a display module.

With the development of personal handheld IT terminals and the development of communication technology, general users, who previously remained in the consumer role of video contents, are now serving as providers of UGC (User Generated Contents).

In some cases, UGC is produced through specialized video cameras, but it is more common to produce UGC easily through personal smartphones. This is due to changes in the IT environment, such as providing a personal video broadcasting platform on SNS such as Facebook, and UGC, which is produced through a smartphone of a general user, is consumed through a smartphone of another general user. .

Conventional video content is generated as landscape video content that is longer than vertical in width, and consumed through TV screens, theater screens, and PC monitors in landscape display mode, which is also longer than vertical in width. Conventional video content consumers have a fixed aspect ratio of 4: 3 (analog TV), 16: 9 (HDTV, wide monitor), 1.85: 1 (theater screen), and because the display module does not support redirection, Specialized in landscape video content.

However, since the smartphone is designed to be operated by the user in one hand, the smartphone is provided in a narrow portrait display mode as shown in FIG. 2 instead of the conventional landscape display mode. Apple's iPhone 6, for example, has a 9:16 aspect ratio and Apple's iPad family has a 3: 4 aspect ratio.

However, a user terminal such as a smartphone or a tablet PC includes a gyro sensor, an acceleration sensor, a gravity sensor, and the like, and a method using a gravity sensing value or an acceleration sensing value and a gyro sensing value by using a Kalman filter. In general, a vertical display mode or a landscape display mode may be adaptively provided as shown in FIG. 2 by sensing the pitch of the user terminal by sensing the pitch of the user terminal.

An adaptive user terminal control technique according to the pitch sensing of the direction sensor may be used to produce video content. When the user shoots the video in the portrait display mode, it is possible to produce a portrait video content as shown in FIG. 3, and when the user shoots the video in the landscape display mode, the landscape video content as shown in FIG. Can produce.

In addition, the adaptive user terminal control technique according to the pitch sensing of the direction sensor may be used to consume the video content. When the user consumes the landscape video content in portrait display mode, the user can zoom out by adding a lot of margins to the top and bottom of the full screen to show the whole image.If the user consumes the landscape video content in landscape display mode, It is common to display the entire image with no margin or a small margin on the screen. When the aspect ratios of the landscape video and the landscape display mode are different from each other, a small margin is added to the top, bottom, left, and right sides. For example, if you play landscape video content with a 4: 3 aspect ratio on a smartphone with a 16: 9 display aspect ratio in landscape display mode, a margin is added to the left and right sides, and the landscape video content with an aspect ratio of 1.85: 1 is added. When played back, margins are added to the top and bottom sides.

On the other hand, landscape video content occupies a screen area with more background area than the character, so it is suitable for movie content and drama content that emphasizes the beauty of the image or storytelling. Since it occupies a small screen area, it is suitable for performance contents and personal broadcasting focused on one character.

However, in the use of a smartphone, the portrait display mode is suitable for a user's hand grip. In addition, considering Internet webpages and smartphone applications designed for portrait display mode, users can enjoy short video content within 5 minutes of low concentration. You can predict the tendency to watch landscape videos.

On the other hand, since the main user interface modules of smartphones and tablet PCs are touch screens and only limited operations can be performed on small screens, it is important to design a video content reproduction interface that properly predicts user needs.

Microsoft Publication No. 2003-0231189, "Altering a display on a viewing device based upon a user controlled orientation of the viewing device," US Patent No. 7,313,418, "Portable device" by Canon, and Steven D. Lawrenz, US Patent Publication No. 2009-0237379 "Automatically conforming the orientation of a display signal to the rotational position of a display device receiving the display signal" discloses a configuration for detecting the direction of the display module to rotate the direction of the video signal accordingly. do. According to this configuration, it is possible to automatically switch the video signal according to the direction of the display module, but there is no problem of initiating or implying how to display the landscape video content in the landscape display mode or the portrait display mode, respectively. have.

US Patent No. 8,676,271, "Application displaying method and mobile communication terminal based on user's habit" of Huawei Device Co., Ltd. determines whether the user uses the landscape display mode or the portrait display mode statistically. Disclosed is a configuration in which a screen is provided in a display mode which is frequently used. Although this configuration may be advantageous for the screen orientation of some applications, the display mode in which the user's terminal redirection itself distorts the exact intention of the user in terms of the user's selection of the display module orientation and is disposed with the current terminal orientation. There is a problem that provides.

Apple, U.S. Patent No. 8,736,561, "Device, method, and graphic user interface with content display mode and display rotation heuristics," shows a portrait display while playing landscape video content in full-screen mode through the landscape display mode of the user terminal. When the mode is changed, the configuration of reducing the size of the landscape video content and displaying additional image related information in another screen area is disclosed. According to such a configuration, there is an advantage that an adaptive user interface module can be provided for video content currently being played in accordance with the change of the display mode. However, first, when watching landscape video content in 16: 9 aspect ratio in full screen in the landscape display mode in 16: 9 aspect ratio, and changing to the portrait display mode, the width of the display module matches that of the video content. Even though a small image of 31.64% is displayed compared to the entire screen of the landscape display module, it is difficult to watch the video. Second, there is a problem that a smartphone user of a small screen magnifies a portion of a landscape image and is difficult to see. Third, in order to view a landscape video in an application or a homepage optimized for a portrait display mode, there is a need to change from a smartphone hand grip in a portrait display mode to a smartphone hand grip in a landscape display mode. Fourth, in landscape video where a large number of performers appear in the recent user environment that has become accustomed to the portrait video contents due to the increase in the use of SNS and the development of the personal broadcasting platform, only the preferred performers are displayed and displayed like the portrait video contents. There is a problem that cannot be done.

[Preceding technical literature]

(Patent Document 1) US Patent Publication No. 2003-0231189

(Patent Document 2) US Patent No. 7,313,418

(Patent Document 3) US Patent Publication No. 2009-0237379

(Patent Document 4) US Patent No. 8,676,271

(Patent Document 5) US Patent No. 8,736,561

The present invention is to solve the above problems, the adaptive playback system and playback method of the landscape video content according to the present invention, in the landscape display mode of a mobile terminal such as a smart phone to display the entire area of the landscape video By displaying the area and displaying a partial area of the landscape video in the portrait display mode, the user can easily enlarge and enjoy the landscape video by rotating the terminal, and a portrait display suitable for hand grip of a smartphone The purpose of the present invention is to improve user convenience by allowing a user using a web page or an application to view a landscape video without changing a hand position.

According to an embodiment of the present invention, an adaptive playback system and playback method of landscape video content tracks a main area such as a face recognized in the video content as a region of interest, and displays the region of interest of a landscape video enlarged in a portrait display mode. Another object of the present invention is to improve user convenience by allowing the user to preferentially view an area including an important object without a user's separate operation.

The adaptive playback system and playback method of landscape video content according to an embodiment of the present invention moves a main subject through a static landscape video by automatically scrolling the enlarged partial region left and right according to the left and right movement of the ROI. Another purpose is to provide a portrait video such as the camera dynamically tracking.

The adaptive playback system and playback method of landscape video content according to an embodiment of the present invention, for example, to track a plurality of performers to a plurality of regions of interest according to the user's selection, and to be located in the center of the screen in the portrait display mode Another objective is to provide a new user experience of interactive video viewing by allowing a user to select a region of interest.

Finally, the adaptive playback system and playback method of the landscape video content according to an embodiment of the present invention, for example, in the vertical display mode according to the left and right slide operation of the touch screen or the left and right movement of the smartphone in the display module It is another object of the present invention to provide a new user experience in which a user can control a camera to enlarge and view a desired area by adaptively changing a display area of a captured image.

In order to achieve the above object, the adaptive playback system of landscape video content according to the present invention, the display module for visually displaying information to the user; A user interface module configured to receive a user input; A display mode detection for detecting whether the length of the horizontal display area of the display module is a landscape display mode exceeding the length of the vertical display area or whether the length of the vertical display area of the display module is a portrait display mode exceeding the length of the horizontal display area module; A data storage module for storing data; Arithmetic processing module; And a video playback application driven by the application data stored in the data storage module in a manner driven by the arithmetic processing module, and playing back video content through the display module. The video playback application includes: a video content detector for detecting landscape video content in which the number of horizontal pixels exceeds the number of vertical pixels; The display area in which the landscape video content is played is determined, and in the landscape display mode, the entire area including all of the horizontal pixel data and the vertical pixel data of the landscape video content is determined as the display area. A display area determiner configured to determine, as the display area, a first partial area including all of the vertical pixel data of the landscape video content and a part of the horizontal pixel data in the portrait display mode; And a video reproducing unit reproducing the landscape video content through the display module according to the determination of the display area determining unit, wherein the display area determining unit reproduces the landscape video content in the portrait display mode. Display a second subregion consisting of all of the vertical pixel data of the landscape video content and a portion of the horizontal pixel data different from the horizontal pixel data of the first subregion in response to a user input through the user interface module. It is characterized by determining the area.

In the adaptive playback method of landscape video contents according to the present invention, the number of horizontal pixel data is vertical through a video playback application driven by a user terminal and visually displaying video contents through a display module. Receiving landscape video content that exceeds the number of data; Determining, by the user terminal, a landscape display mode in which the length of the horizontal display area exceeds the length of the vertical display area or a portrait display mode in which the length of the vertical display area exceeds the length of the horizontal display area; The landscape video content to display, through the display module, an entire area including all of the horizontal pixel data and all of the vertical pixel data of the landscape video content when the video reproduction application is in the landscape display mode. Playing it; The landscape video content to display, through the display module, a first partial region including all of the vertical pixel data of the landscape video content and a portion of the horizontal pixel data when the video playback application is in the portrait display mode; Playing it; The video playback application is adapted to respond to a user input through a user interface module during playback of the landscape video content in the portrait display mode and all of the vertical pixel data of the landscape video content and a horizontal pixel of the first partial region; And continuously playing the landscape video content to display, via the display module, a second partial area composed of a portion of data and other horizontal pixel data.

According to the above configuration of the present invention, the adaptive playback system and playback method of the landscape video content according to the present invention, in the landscape display mode of a mobile terminal such as a smart phone to display the entire area of the landscape video as a display area; In the portrait display mode, the partial region of the landscape video is enlarged and displayed so that the user can easily enlarge and enjoy the landscape video by rotating the terminal, and in the portrait display mode suitable for hand grip of a smartphone The user's convenience can be improved by allowing the user using the web page or the application to watch the landscape video without changing the position of the hand.

According to an embodiment of the present invention, an adaptive playback system and playback method of landscape video content tracks a main area such as a face recognized in the video content as a region of interest, and displays the region of interest of a landscape video enlarged in a portrait display mode. The central location provides the effect of improving the user's convenience by allowing the user to preferentially view the area containing the important object without the user's separate operation.

The adaptive playback system and playback method of landscape video content according to an embodiment of the present invention, by automatically scrolling left and right parts of the enlarged area according to the left and right movement of the region of interest to the movement of the main subject through the static landscape video This provides the effect of providing a portrait video, such as camera tracking dynamically.

The adaptive playback system and playback method of landscape video content according to an embodiment of the present invention, for example, to track a plurality of performers to a plurality of regions of interest according to the user's selection, and to be located in the center of the screen in the portrait display mode By allowing the user to select a region of interest, it provides a new user experience for interactive video viewing.

Finally, the adaptive playback system and playback method of the landscape video content according to an embodiment of the present invention, for example, in the vertical display mode according to the left and right slide operation of the touch screen or the left and right movement of the smartphone in the display module By adaptively changing the display area of the captured image, the user can control the camera to provide a new user experience in which the desired area can be enlarged and enjoyed.

1 is a block diagram showing an adaptive playback system of landscape video content according to an embodiment of the present invention.

2 shows an example of a portrait display mode and a landscape display mode.

3 illustrates an example of landscape video content and portrait video content.

4 is a diagram illustrating an example of a screen configuration in which an adaptive playback system of landscape video content according to an embodiment of the present invention provides the landscape video content to the entire area in the landscape display mode.

5 is a diagram illustrating an example of a screen configuration in which an adaptive playback system of landscape video content according to an embodiment of the present invention provides the landscape video content as a partial region in a portrait display mode.

FIG. 6 is a diagram illustrating an example of a screen configuration in which an adaptive playback system of landscape video content according to an embodiment of the present invention provides a second partial region according to a user input in a portrait display mode. FIG.

FIG. 7 is an exemplary view illustrating a screen configuration in which an adaptive reproduction system of landscape video content according to an embodiment of the present invention provides a second partial area centered on a plurality of ROIs according to a user input.

8 is a flowchart illustrating an adaptive playback method of landscape video content according to an embodiment of the present invention.

9 is an exemplary view of implementing source code for displaying landscape video content in a portrait display mode according to an embodiment of the present invention.

Video content playback system 100 display module 110

User Interface Module 120 Display Mode Sensing Module 130

Data storage module 140 operation processing module 150

Video playback application (160) Video content detector (161)

Display area determiner 162 Video player 163

Point of interest tracking unit (164)

The terms or words used in this specification and claims are not to be construed as limiting in their usual or dictionary meanings, and should be read in accordance with the principles by which the inventors may define terms and concepts in order to best describe the invention. It should be interpreted as meanings and concepts corresponding to the technical spirit of the invention.

Therefore, the configuration shown in the embodiments and drawings described in this specification corresponds to a preferred embodiment of the present invention, and does not represent all of the technical spirit of the present invention, the configuration will be replaced at the time of filing of the present invention. There may be various equivalents and variations.

Throughout the specification, the description that a part "includes" a certain component means that the component may further include other components, except for the absence of a special objection thereto. In addition, the terms ".. module", ".. unit", ".. system", etc. described in the specification mean a unit that processes at least one function or operation, which is hardware or software or a combination of hardware and software. It may be implemented, and may be included in one device or each other device.

1 illustrates an adaptive playback system 100 of landscape video content in accordance with the present invention. The adaptive playback system 100 of landscape video content according to the present invention includes a display module 110, a user interface module 120, a display mode sensing module 130, a data storage module 140, and a processing module 150. ), And a video playback application 160. The playback system 100 of the present invention is implemented as a personal information terminal such as, for example, a smartphone, a tablet PC, a notebook PC, a desktop PC, and the like.

The display module 110 performs a function of visually displaying information to a user, and may be an example of an LCD display, an OLED display, or the like integrally provided with a smartphone, a tablet PC, and the like. It may be a separate display device such as an LCD monitor, a TV, a projector, or the like.

The user interface module 120 performs a function of receiving a user input (input_user). The user interface module 120 may be, for example, a touch screen added to the display module 110, and may be a position sensor such as a gyro sensor, an acceleration sensor, or a gravity sensor provided in the personal portable device. It may also be a mouse, keyboard, or keypad, camera, microphone, or the like. The user interface module 120 recognizes a user's touch, key input, change of position of the terminal, behavior, voice, etc. as a user input (input_user), and a user input (input_user) signal that can be recognized by the video content playback system 100. To perform the function.

The display mode sensing module 130 is a landscape display mode (mode_landscape) in which the length of the horizontal display area of the display module 110 exceeds the length of the vertical display area, and the length of the vertical display area of the display module 110 is horizontal. This function detects whether the portrait display mode (mode_portrait) exceeds the length of the area.

The display module 110 of the present invention is limited to the display module 110 in which the length in one direction and the length in the other direction orthogonal thereto are different. That is, the landscape display mode (mode_landscape) and the portrait display mode (mode_portrait) are not distinguished from each other in a rectangular display in which the horizontal display area and the vertical display area of the display module 110 are the same.

Typical display modules 110 such as TVs, monitors, notebook PCs, etc. have a vertical display with a horizontal display area length such as 5: 4, 4: 3, 16:10, 16: 9, 1.85: 1, 2.35: 1. It takes the form of a landscape display mode (mode_landscape) that is longer than the area. Meanwhile, in the case of a smartphone or a tablet PC, the horizontal display area has a vertical display mode (mode_portrait) in which the length of the horizontal display area is shorter than the length of the vertical display area in consideration of ease of use, that is, ease of hand grip.

However, in the case of a monitor, a smartphone, a tablet PC having a pivot function, and a tablet-compatible convertible notebook PC in which a keyboard is detached or stored as needed, as shown in FIG. 2, the vertical display mode (mode_portrait) and the landscape are changed according to the tilt of the display. All display modes (mode_landscape) are supported.

The display mode sensing module 130 automatically detects the rotation of the display to provide a screen suitable for each display mode. For example, when the display mode detection module 130 detects the portrait display mode (mode_portrait), the display device provides a long screen in the vertical direction. On the contrary, when the landscape display mode (mode_landscape) is detected, the display mode detection module 130 provides a long screen in the horizontal direction.

The display mode sensing module 130 may be implemented in various ways, such as using a gravity sensing value of a gravity sensor or correcting an acceleration sensing value of an acceleration sensor and a gyro sensing value of a gyro sensor using a Kalman filter. As a result, the pitch of the user terminal may be implemented as a method of detecting a tilt. In the case of a monitor providing a pivot function, for example, the display mode sensing module 130 may be implemented by installing electrical contacts of the pivot portion in units of 90 degrees. Alternatively, if the user selects the Rotate option through the graphic control of the graphics card of the computer system without a sensor or electrical contacts, each Rotate option, such as 90 degree rotation and 270 degree rotation, is 0 or 180 degrees in portrait display mode (mode_portrait). The display mode sensing module 130 may also be implemented by a method of recognizing the rotation in the landscape display mode (mode_landscape).

The data storage module 140 performs a function of storing data. The data storage module 140 is not particularly limited, and may be implemented as an electrical, magnetic, or optical storage medium installed in the video content playback system 100 or connected through a network. The data storage module 140 may exemplify a floppy diskette and a floppy disk driver, an optical disk and an optical disk driver, a hard drive, a solid state driver using a flash memory such as a RAM, a ROM, a USB memory, an SD card, and the like as the data storage module 140. The data storage module 140 of the NAS (Network Attached Storage) or a server accessible through the network may correspond to the data storage module 140 of the present invention. The data storage module 140 stores the application data for driving the application and the multimedia data that can be used in the application.

The operation processing module 150 may illustrate a mobile processor such as a smartphone or a tablet PC, or a central processing unit such as a notebook PC or a desktop PC, and may interpret a command constituting an application through such a command. Implement the functionality of the application.

The video playback application 160 is driven in such a manner that the application data stored in the data storage module 140 is driven by the operation processing module 150, and plays the video content through the display module 110. The video playback application 160 may receive and play video content data through the Internet, or may load and play video content data stored in the data storage module 140. The video player application 160 may be implemented by only a video player function, but other functions such as a web service access function through a communication network and a video content player function may be combined.

The video player application 160 includes a video content detector 161, a display area determiner 162, and a video player 163.

The video content detector 161 detects a landscape video content (content_landscape) in which the number of horizontal pixels exceeds the number of vertical pixels. 3 illustrates landscape video content content_landscape in which the number of horizontal pixels exceeds the number of vertical pixels, and portrait video content content_portrait in which the number of vertical pixels exceeds the number of horizontal pixels.

For example, in the case of landscape video content (content_landscape) having a resolution of 1920 x 1080, the number of horizontal pixels is 1920 and the number of vertical pixels is 1080. The number of pixels of the video content and the resolution of the display module do not necessarily match. For example, if you're playing 1920 X 1080 FHD video content on a 3048 X 2160 UHD display module, upscale it to 3040 X 2160 resolution through image processing, and play 1920 X 1080 HD video content on an HD display module at 1360 X 768. Image processing can then downscale it to 1360 X 768 resolution.

Conventional TVs, theater screens, and the like are fixed landscape display modes (mode_landscape), so that general broadcast camera equipment, home camcorder equipment, and theater camera equipment generally produce landscape video content (content_landscape). Meanwhile, the smartphone or tablet PC may produce landscape video content (content_landscape) or portrait video content (content_portrait) according to the user's hand grip. For example, when a user uses a landscape or a plurality of performers whose subjects have a wide field of view as the subject, the user may shoot landscape video content (content_landscape); and when a single performer whose subject is narrow by a narrow angle of view as the subject, the user may shoot a portrait video content (content_portrait). Can be.

The video content detector 161 may detect the landscape video content (content_landscape) in various ways. For example, landscape image content (content_landscape) can be detected through image processing of the displayed image, or landscape video can be detected through aspect ratio information or horizontal pixel number information and vertical pixel number information among attribute information included in metadata of video content. Content (content_landscape) can be detected.

The display area determiner 162 determines a display area (area_present) in which the landscape video content (content_landscape) is played. In the case of the landscape display mode (mode_landscape), as shown in FIG. 4, the landscape video content (content_landscape) is displayed. The entire area (area_entire) consisting of all of the horizontal pixel data and all of the vertical pixel data of is determined as the display area (area_present), and in the vertical display mode (mode_portrait), as shown in FIG. A first partial area (area_partial_1st) including all of the vertical pixel data of the content_landscape and a part of the horizontal pixel data is determined as the display area (area_present). At this time, the entire area (area_entire) and the first partial area (area_partial_1st) are configured to maintain the aspect ratio of the original video content.

When the landscape video content (content_landscape) is played in the landscape display mode (mode_landscape), the entire area (area_entire) of the landscape video content (content_landscape) is visually provided to the user through the display module 110. In this case, when the aspect ratio of the landscape display mode (mode_landscape) is 16: 9, for example, when the aspect ratio of the video content is the same as the aspect ratio of the display, the video module is played on the display module 110, and the aspect ratio of the video content is displayed on the display. If it is larger than the aspect ratio, for example, a cinema film ratio of 1.85: 1, black margins are filled on the top and bottom of the screen, and if the aspect ratio of the video content is smaller than the aspect ratio of the display, for example, a 35 mm film ratio of 3: 2 It can be configured to fill black margins on the left and right sides of the screen.

When the landscape video content (content_landscape) is played in the portrait display mode (mode_portrait), the entire vertical pixel data of the video content is displayed on the screen so as to match the vertical display area of the display. The image viewed through the first partial area area_partial_1st is displayed as a partial image of an image in which the image viewed in the whole area area_entire is enlarged in the landscape display mode (mode_landscape).

For example, assuming that the display module 110 having an aspect ratio of 16: 9 displays a landscape video having an aspect ratio of 16: 9, the conventional technology of displaying a full screen in the portrait display mode (mode_portrait) according to the landscape display mode (mode_landscape) The image reduced to 31.6% of the entire area (area_entire) is displayed in 31.6% of the entire display area, and the remaining 68.4% is filled with black margins, making the image hard to be recognized by the user. There is a problem of shrinking. However, in the video content reproducing system 100 according to the present invention, the image of the first partial area (area_partial_1st) displayed in the portrait display mode (mode_portrait) is displayed in the entire area (area_entire) image of the landscape display mode (mode_landscape) in the same environment. A 31.6% partial image enlarged by 3.16 times is displayed in 100% of the entire display area.

Therefore, the user's act of changing from the landscape display mode (mode_landscape) to the portrait display mode (mode_portrait) acts as a command to enlarge and view the video content, thereby improving user convenience.

9 is a diagram illustrating a source code implementation for displaying a landscape video content (content_landscape) in a portrait display mode (mode_portrait) according to an embodiment of the present invention. Since the vertical resolution of the entire video content enlarged in the portrait display mode (mode_portrait) is the same as that of the display module 110 in the vertical display mode (mode_portrait), the vertical resolution of the entire video content enlarged in the portrait display mode (mode_portrait) The horizontal resolution (Xconverted) is expressed by the following equation using the horizontal resolution (Xcontent) and vertical resolution (Ycontent) of the landscape video content (content_landscape) and the vertical resolution (Ydisplay) of the display module 110 in the portrait display mode (mode_portrait). You can get it by

[Equation 1]

If the landscape video content has, for example, 1920 X 1080 resolution, and the portrait display mode has a resolution of, for example, 1242 X 2208, then the entire video content magnified in the portrait display mode (mode_portrait) has a resolution upscaled to 3925 X 2208. In addition, in the portrait display mode (mode_portrait), the display module 110 shows a partial image of 1242 X 2208. FIG. 9 illustrates an embodiment in which the display conversion process and the first partial area (area_partial_1st) shown for the first time are set as the center portion of the landscape video content (content_landscape).

The video player 163 plays the landscape video content content_landscape through the display module 110 according to the determination of the display area determiner 162. The function of the video reproducing unit 163 decodes the encoded video content file, for example, and reproduces the video in the form of a video visually recognizable to the user through the display module 110.

On the other hand, since the first partial area (area_partial_1st) provided in the portrait display mode (mode_portrait) is an enlarged partial area of the entire landscape video content (content_landscape), it may show a part other than the partial area currently displayed according to the user's selection. There is a need. To this end, the display area determiner 162 reacts to the landscape video content (content_landscape) in response to a user input (input_user) through the user interface module 120 during playback of the landscape video content (content_landscape) in the portrait display mode (mode_portrait). And a second partial area (area_partial_2nd) consisting of all of the vertical pixel data of and a portion of the horizontal pixel data of the first partial area (area_partial_1st) and other horizontal pixel data as the display area (area_present). The first partial area area_partial_1st and the second partial area area_partial_2nd may be configured to overlap each other, or may be configured to overlap some areas.

As shown in FIGS. 5 and 6, when the landscape video content (content_landscape) is reproduced in the portrait display mode (mode_portrait), the display area determiner 162 may initially have, for example, horizontal pixel data of the landscape video content (content_landscape). While showing the central portion 210 of the first partial area (area_partial_1st), when the user wants to see the right area, the display area determination unit 162 pushes the touch screen to the right 310 to display the landscape video content ( The right region 220 of the content_landscape may be shown as the second partial region area_partial_2nd.

According to this configuration, the user can freely select and enjoy a desired partial region of the landscape video content (content_landscape), thereby obtaining a user experience different from the existing video playback system provided only in the entire area (area_entire). It can be effective.

Meanwhile, the first partial area area_partial_1st first shown in the portrait display mode (mode_portrait) may be variously set according to an embodiment. The central portion 210 of the horizontal pixel data of the landscape video is typically the most important area. Therefore, the display area determiner 162 is configured such that the first visible area is the center of the landscape video content (content_landscape) so that the center portion of the horizontal pixel data of the landscape video content (content_landscape) is located at the center of the horizontal display area. It is preferable to determine one partial area area_partial_1st as the display area area_present. The central portion of the horizontal pixel data refers to the horizontal portion of the landscape video content content_landscape. The center of the horizontal display area refers to a horizontal center portion of the display module 110 in the portrait display mode (mode_portrait).

In another embodiment, the subject and the background may be separated according to the recent development of image processing technology, and the type of the subject may be distinguished with a high probability of a person, an animal, a car, a house, or a natural object, and the movement of the subject may be separated. It can also be tracked. Through such an image processing technique, it is preferable to configure the important subject area of the landscape video content (content_landscape) to be preferentially displayed in the portrait display mode (mode_portrait).

To this end, the video playback application 160 may further include a region of interest tracker 164 that tracks the region of interest through image processing during playback of the landscape video content (content_landscape). The region of interest tracking unit 164 may be implemented using, for example, a known open source code such as MeanShift or CamShift of Open CV.

For example, the ROI tracking unit 164 may track the face area of the performer of the landscape video content (content_landscape) as the ROI. The region of interest is not limited to the face of the performer, but may be a fixed subject that can be recognized through image processing of a moving subject such as an animal or a car, a building, or a natural object.

Meanwhile, as illustrated in FIG. 7, when there are a plurality of

ROIs

420, 410, and 430, the ROI located in the center of the horizontal pixel data of the landscape video content content_landscape in setting the first first partial area area_partial_1st. It is desirable to display area 410 first. To this end, the display area determiner 162 selects the first partial area (area_partial_1st) such that the first area of interest (area_interest_1st) adjacent to the center of the horizontal pixel data of the landscape video content (content_landscape) is located at the center of the horizontal display area. It is preferable to determine the display area area_present.

In the setting of the first area of interest (area_interest_1st), the center-centered subject may be displayed first as in the above-described embodiment. However, in some embodiments, when the area of interest is the face area of the performers, the user registers as an acquaintance on SNS. For example, in a landscape video content (content_landscape) with complex subjects displayed preferentially displaying the performer regardless of the position on the screen, preferentially displaying a popular actor or favorite actor, such as a human-animal-object sequence. According to the priority among the subject types, the subject type having the highest priority may be displayed first regardless of the appearance position.

On the other hand, the first partial area (area_partial_1st) determined by the display area determiner 162 is a user input (input_user) through the user interface module 120 of the user according to the horizontal movement on the screen of the first area of interest (area_interest_1st) Without this, it is preferable to automatically move horizontally by tracking the first region of interest (area_interest_1st) of the region of interest tracking unit 164.

To this end, the display area determiner 162 is configured such that the first region of interest (area_interest_1st) is positioned at the center of the horizontal display area according to the horizontal movement of the first region of interest (area_interest_1st) during the display of the first partial region (area_partial_1st). One partial area (area_partial_1st) may be horizontally scrolled to determine the area (area_present).

According to such a configuration, since the first partial area (area_partial_1st) is also moved with the movement of the first area of interest (area_interest_1st), the portrait video content recorded by tracking the subject of the first area of interest (area_interest_1st) with a camera. gives the user the same effect as watching (content_portrait).

The user input (input_user) for determining the second partial area (area_partial_2nd) of the display area determiner 162 may include a slide operation on a touch screen and a horizontal movement of a portable device such as a smartphone.

First, an embodiment in which the second partial area area_partial_2nd is determined by the slide operation on the touch screen will be described. The slide operation refers to an action of moving a finger or a touch pen to the left or right while keeping a user's finger or touch pen or the like on or near the touch screen. According to this embodiment, the user interface module 120 includes a touch screen, and the display area determiner 162 receives the user's slide operation through the touch screen as a user input (input_user), and the user's slide operation. The second partial area area_partial_2nd, which is a horizontal scrolled area in proportion to the distance of, may be configured to be determined as the display area area_present. Since this method is generally used when a user moves in an enlarged document or an enlarged image on a smartphone, the user can intuitively move the slide screen of the touch screen to move in the enlarged video without explanation of how to use it. Provide usable effects.

According to an embodiment, US Patent No. 7,469,381 "List scrolling and document translation, scaling, and rotation on a touch-screen display" to notify the user that the left end region or the right end region of the landscape video content (content_landscape) has been reached. It may further implement a "bounce back" operation as disclosed in.

Next, an embodiment in which the second partial area area_partial_2nd is determined by the horizontal movement of a portable device such as a smartphone will be described. According to this embodiment, the user interface module 120 includes a direction sensor, and the display area determiner 162 detects sensing information of the direction sensor according to the horizontal movement of the video content playback system 100 by the user. Preferably, the second partial area area_partial_2nd, which is received as a user input (input_user) and is horizontally scrolled in proportion to the distance of the horizontal movement of the system, is determined as the display area area_present.

When the display mode detection module 130 is configured to include a direction sensor, it is possible to detect a horizontal movement of the video content playback system 100 implemented as a portable device using the direction sensor of the display mode detection module 130. . Commercially available 360-degree image provides a user with a feeling as if they are in the field by adaptively changing the angle of view displayed according to the movement of the portable device up, down, left and right. It provides an effect that can provide the user experience similar to the angle of view change according to the movement of the device to play the video content.

Next, an embodiment in which the second partial area area_partial_2nd is determined by a selection operation such as selection of a user's left or right screen or selection of a left or right moving icon will be described. Although this embodiment is possible in a touch screen, it is more suitable in the user interface module 120 implemented by a keypad, a keyboard, or a mouse. According to such an embodiment, the display area determiner 162 receives a user selection operation on a left area or a right area of the horizontal display area as a user input (input_user), and sets the left or right by the number of preset horizontal pixel data. The second partial area area_partial_2nd, which is the area moved to, may be determined as the display area area_present. This selection operation may include not only selection according to a touch of a specific area, but also horizontal movement of the portable device in the specific direction or slide in the above-described specific direction.

In the user interface module 120 implemented as a touch screen capable of distinguishing the touch pressure of the user, it is also possible to implement to increase the number of horizontal pixel data moved in accordance with the increase in the touch pressure of the user.

Finally, in an embodiment in which the ROI tracking unit 164 tracks a plurality of ROIs, the display area (area_present) may be moved between ROIs in the portrait display mode (mode_portrait) according to a user's selection. have. For example, as shown in FIG. 7, when four persons are tracked as the region of interest, a first partial region (area_partial_1st) centering on the first region of interest (area_interest_1st) 410, which is a person adjacent to the horizontal center of the screen, is initially located. ), And when the user selects the left side, the second partial area (area_partial_2nd) centered on the second area of interest (area_interest_2nd) 420, which is a person located on the left side, or the right side when the user selects the right side. The second partial area (area_partial_2nd) centering on the third area of interest (area_interest_3rd) 430 which is a person located at may be configured to be displayed.

To this end, the video player application 160 further includes a region of interest tracker 164 that tracks a region of interest through image processing during playback of the landscape video content (content_landscape), and the display region determiner 162 may display a horizontal display. The display area area_present is received so that a selection operation for the left area or the right area of the area is received as a user input input_user, and the second area of interest area_interest_2nd located on the left side of the first partial area area_partial_1st is located at the center. The second subregion, which is determined to be the second partial region (area_partial_2nd), which is moved to the left, or is moved to the right, so that the third region of interest (area_interest_3rd) located on the right side of the first partial region (area_partial_1st) is located at the center. (area_partial_2nd) is preferably configured to determine the display area (area_present). The second region of interest (area_interest_2nd) may be located on the left side of the first partial area (area_partial_1st) or may be located on the left side other than the first partial area (area_partial_1st). The third region of interest (area_interest_3rd) may be located on the right side within the first partial area (area_partial_1st) or may be located on the right side other than the first partial area (area_partial_1st).

In this case, as shown in FIG. 7, the ROI tracking unit 164 may track the face area of the performer of the landscape video content (content_landscape) as the ROI.

More preferably, the display area determiner 162 may move the second region of interest (area_interest_2nd) according to the horizontal movement of the second region of interest (area_interest_2nd) or the third region of interest (area_interest_3rd) during the display of the second partial region (area_partial_2nd). ) Or horizontally scrolling the second partial area (area_partial_2nd) so that the third region of interest (area_interest_3rd) is positioned at the center of the horizontal display area to determine the display area (area_present).

According to this embodiment, in the landscape video content (content_landscape) in which a plurality of performers appear, the user provides an effect such as selecting photographed portrait video content (content_portrait) that is close up for each performer.

Meanwhile, the portrait display mode (mode_portrait) or the landscape display mode (mode_landscape) is determined at the start of the playback of the landscape video content (content_landscape) and is not fixed to the corresponding display mode, but during playback of the landscape video content (content_landscape). It is desirable that conversion between both display modes be made. In other words, if a user who is watching the landscape video content (content_landscape) in full screen through the landscape display mode (mode_landscape) wants to view a specific area in an enlarged manner, the mobile device is rotated to switch to the portrait display mode (mode_portrait). You can enjoy the partial area.

To this end, the display area determiner 162 displays the first partial area (area_partial_1st) of the landscape video content (content_landscape) when a change is detected in the portrait display mode (mode_portrait) while displaying the entire area (area_entire). area_present). On the contrary, when the display area determiner 162 detects a change in the landscape display mode (mode_landscape) while displaying the first partial area (area_partial_1st) or the second partial area (area_partial_2nd), the display area determiner 162 of the landscape video content (content_landscape) is displayed. The entire area area_entire may be configured to be determined as the display area area_present.

Hereinafter, an adaptive playback method of landscape video content (content_landscape) according to the present invention will be described with reference to FIG. 8.

First, the number of horizontal pixel data exceeds the number of vertical pixel data through the video playback application 160 driven by the arithmetic processing module 150 and visually displaying video content via the display module 110. In step S10, a landscape video content content_landscape is received. The user terminal may receive the landscape video content (content_landscape) by streaming the landscape video content (content_landscape) through a communication network or by loading the landscape video content (content_landscape) stored in the storage module of the user terminal. Can be.

Next, the user terminal determines whether the length of the horizontal display area is a landscape display mode (mode_landscape) where the length of the vertical display area exceeds the length of the vertical display area, or whether the length of the vertical display area is a portrait display mode (mode_portrait) that exceeds the length of the horizontal display area. To perform step (s20). The determining of the display mode (s20) does not necessarily have to be followed by the receiving of the landscape video content (content_landscape) (s10), but is performed prior to the receiving of the landscape video content (content_landscape) (s10). It may be.

Next, when the video playing application 160 is in the landscape display mode (mode_landscape), the display module (area_entire) including all of the horizontal pixel data and the vertical pixel data of the landscape video content (content_landscape) is displayed. In operation S50, the landscape video content content_landscape is reproduced to be displayed through 110.

Next, when the video playing application 160 is in the portrait display mode (mode_portrait), the first display area (area_partial_1st) including all of the vertical pixel data of the landscape video content (content_landscape) and part of the horizontal pixel data is displayed. In operation S60, the landscape video content content_landscape is reproduced to be displayed through 110.

Finally, the video playback application 160 receives the user input (input_user) through the user interface module 120 during the playback of the landscape video content (content_landscape) in the portrait display mode (mode_portrait) (s70) to output the landscape video content. Landscape video to display through the display module 110 a second partial area (area_partial_2nd) consisting of all of the vertical pixel data of (content_landscape), the horizontal pixel data of the first partial area (area_partial_1st), and a part of other horizontal pixel data. In step S80, the content (content_landscape) is continuously played.

In the determination of the first partial area area_partial_1st, the step S60 of displaying the first partial area area_partial_1st may be performed by the video reproducing application 160 of the landscape video content content_landscape, as shown in FIG. The first partial area area_partial_1st may be displayed such that the center portion of the horizontal pixel data is positioned at the center of the horizontal display area.

In another embodiment of determining the first partial area area_partial_1st, the adaptive reproduction method of the landscape video content content_landscape may be performed by the video reproducing application 160 through image processing during reproduction of the landscape video content content_landscape. The method further includes tracking the region of interest (s30), and playing the landscape video content (content_landscape) to display the first partial area (area_partial_1st), as shown in FIG. 160 may be configured to display the first partial area are_partial_1st such that the first area of interest area_interest_1st adjacent to the center portion of the horizontal pixel data of the landscape video content content_landscape is located at the center of the horizontal display area. .

In such an embodiment, the adaptive playback method of the landscape video content content_landscape may be performed in order to automatically change the first partial area area_partial_1st according to the horizontal movement of the first region of interest area_interest_1st. When the first region of interest (area_interest_1st) moves horizontally on the screen during playback of the landscape video content (content_landscape) so that the first partial region (area_partial_1st) is displayed, the first region of interest (area_interest_1st) is displayed in the horizontal display area. And horizontally scrolling the first partial area area_partial_1st so as to be continuously positioned at the center.

In this case, in the tracking of the region of interest (s30), it is preferable to track the face region of the performer of the landscape video content (content_landscape) as the region of interest.

Hereinafter, embodiments for determining the second partial area are_partial_2nd will be described.

First, an embodiment of determining the second partial area area_partial_2nd through a slide operation on the touch screen will be described. To this end, the playing of the landscape video content (content_landscape) to display the second partial area (area_partial_2nd) (s80) includes a slide of the user through the user interface module 120 having the video playback application 160 configured as a touch screen. The operation is received as a user input (input_user) (s70). Next, the video playback application 160 displays the horizontal scrolled area as the second partial area (area_partial_2nd) in proportion to the distance of the user's slide operation (S80).

Next, another embodiment in which the second partial area (area_partial_2nd) is determined through the horizontal movement of the playback system 100 implemented as a portable device such as a smartphone will be described. To this end, the step (s80) of playing the landscape video content (content_landscape) to display the second partial area (area_partial_2nd) may be performed by the video reproducing application 160 according to the horizontal movement of the reproduction system 100 by the user. The sensing information of the direction sensor is received as a user input (input_user) (s70), and the horizontal scrolled area is displayed as a second partial area (area_partial_2nd) in proportion to the distance of the horizontal movement of the system (s80).

Next, another embodiment in which the second partial area are_partial_2nd is determined by selecting the left area or the right area of the user will be described. To this end, in operation S80 of playing the landscape video content content_landscape to display the second partial area area_partial_2nd, the video reproducing application 160 selects the user with respect to the left or right area of the horizontal display area. Is received as a user input (input_user) (s70), and the area moved left or right by the number of preset horizontal pixel data is displayed as a second partial area (area_partial_2nd) (s80).

Finally, another embodiment in which the second partial area (area_partial_2nd) is determined as the plurality of ROIs will be described. To this end, the adaptive playback method of the landscape video content (content_landscape) is performed by the video reproducing application 160 tracking an area of interest of the landscape video content (content_landscape) through image processing during playback of the landscape video content (content_landscape). The method may further include step s30, and the step S80 of playing the landscape video content content_landscape to display the second partial area area_partial_2nd may be performed by the video reproducing application 160 on the left or right side of the horizontal display area. Receiving a selection operation for the region as a user input (sput_user) (s70), the second region is moved to the left so that the second region of interest (area_interest_2nd) located on the left side of the first sub-area (area_partial_1st) is located in the center A third area indicated by the area (area_partial_2nd) or positioned to the right of the first partial area (area_partial_1st) The region moved to the right so that the region of interest area_interest_3rd is located at the center is displayed as the second partial region area_partial_2nd (S80).

In the above embodiment, in order for the second partial area (area_partial_2nd) to automatically track the second area of interest (area_interest_2nd) or the third area of interest (area_interest_3rd), the adaptive playback method of the landscape video content (content_landscape) In response to the horizontal movement of the second region of interest (area_interest_2nd) or the third region of interest (area_interest_3rd) during the display of the second partial area (area_partial_2nd) of the landscape video content (content_landscape), the video playback application 160 may change the second interest. The method may further include horizontally scrolling the second partial area area_partial_2nd so that the area area_interest_2nd or the third area of interest area_interest_3rd is positioned at the center of the horizontal display area.

In this case, the tracking of the region of interest (S30) may be configured to track the face region of the performer of the landscape video content (content_landscape) as the region of interest.

On the other hand, it is preferable to switch between the landscape display mode (mode_landscape) and the portrait display mode (mode_portrait) even during the playback of the landscape video content (content_landscape). To this end, the adaptive playback method of the landscape video content (content_landscape) is performed by the video playback application 160 displaying the entire area (area_entire) of the landscape video content (content_landscape) in the landscape display mode (mode_landscape). And if the change is detected in the display mode (mode_portrait), further comprising continuously playing the video content to display the first partial area (area_partial_1st) of the landscape video content (content_landscape) through the display module 110. Do. In addition, the adaptive playback method of the landscape video content (content_landscape) may include a first partial area (area_partial_1st) or a second partial area of the landscape video content (content_landscape) in the portrait display mode (mode_portrait). When a change is detected in the landscape display mode (mode_landscape) while displaying any one of (area_partial_2nd), the video content is continuously displayed so that the entire area (area_entire) of the landscape video content (content_landscape) is displayed through the display module 110. It is preferable to further include the step of reproducing.

Meanwhile, in the above description, the landscape video content (content_landscape) is displayed as the entire image (area_entire) in the landscape video mode (mode_landscape), and in the vertical display mode (mode_portrait), a part composed of all of the vertical pixel data and a part of the horizontal pixel data. The case of displaying an area (area_partial) has been described. However, in a similar way, the portrait video content (content_portrait) is displayed as the entire image (area_entire) in the portrait video mode (mode_portrait), and in the landscape display mode (mode_landscape), which is composed of all of the horizontal pixel data and part of the vertical pixel data. It is also possible to indicate a partial area (area_partial).

The detailed description of the invention herein describes preferred embodiments, and the invention is not limited to these embodiments. Those skilled in the art to which the present invention pertains can make various changes and modifications to the above embodiments without departing from the technical spirit of the present invention, the technical idea of the present invention is to make all such various changes and modifications Include.

Claims

A display module for visually displaying information;

A user interface module configured to receive a user input;

A landscape display mode in which the length of the horizontal display area of the display module exceeds the length of the vertical display area or a portrait display mode in which the length of the vertical display area of the display module exceeds the length of the horizontal display area. Display mode detection module for detecting the perception;

A data storage module for storing data;

Arithmetic processing module; And

In the video data playback system comprising a; video data application is stored in the data storage module is driven in a manner driven by the operation processing module, the video content playback through the display module;

The video playback application includes a video content sensing unit for detecting landscape video content in which the number of horizontal pixels exceeds the number of vertical pixels; The display area in which the landscape video content is played is determined, and in the landscape display mode, the entire area including all of the horizontal pixel data and the vertical pixel data of the landscape video content is determined as the display area. A display area determiner configured to determine, as the display area, a first partial area including all of the vertical pixel data of the landscape video content and a part of the horizontal pixel data in the portrait display mode; And a video reproducing unit reproducing the landscape video content through the display module according to the determination of the display area determining unit, wherein the display area determining unit reproduces the landscape video content in the portrait display mode. Display a second subregion consisting of all of the vertical pixel data of the landscape video content and a portion of the horizontal pixel data different from the horizontal pixel data of the first subregion in response to a user input through the user interface module. An adaptive playback system of landscape video content, characterized in that the area is determined.
The display device of claim 1, wherein the display area determiner comprises:

And determining the first partial area as the display area such that a central portion of the horizontal pixel data of the landscape video content is located at the center of the horizontal display area.
The method of claim 1,

The video reproducing application further includes a region of interest tracking unit which tracks a region of interest through image processing during reproduction of the landscape video content.

The display area determiner may determine the first partial area as the display area such that a first ROI adjacent to the center of the horizontal pixel data of the landscape video content is located at the center of the horizontal display area. Adaptive playback system for landscape video content.
The display device of claim 3, wherein the display area determiner comprises:

Determining the display area by horizontally scrolling the first partial area so that the first ROI is positioned at the center of the horizontal display area according to the horizontal movement of the first ROI during the display of the first partial area; An adaptive playback system of landscape video content.
The method of claim 3, wherein the ROI tracking unit,

And a facial region of a performer of the landscape video content as the ROI.
The method of claim 1,

The user interface module is configured to include a touch screen,

The display area determiner is configured to receive a user's slide motion through the touch screen as the user input and determine the second partial area as a horizontal scrolled area in proportion to a distance of the user's slide motion as the display area. Adaptive playback system of landscape video content, characterized in that.
The method of claim 1,

The user interface module includes a direction sensor,

The display area determiner receives sensing information of the direction sensor according to a horizontal movement of the video content reproduction system by a user as the user input, and horizontally scrolls in proportion to a distance of the horizontal movement of the video content reproduction system. And the second partial area, which is a defined area, as the display area.
The display device of claim 1, wherein the display area determiner comprises:

Receiving a user's selection of a left region or a right region of the horizontal display area as the user input, and moving the second partial area, which is a region shifted left or right by a predetermined number of horizontal pixel data, to the display area. And adaptive landscape playback of landscape video content.
The method of claim 1,

The video reproducing application further includes a region of interest tracking unit which tracks a region of interest through image processing during reproduction of the landscape video content.

The display area determiner may receive a selection operation on a left area or a right area of the horizontal display area as the user input, and select the display area so that the second ROI located at the left side of the first partial area is located at the center. Determine the second subregion that is a region moved to the left or the display region as the second subregion that is moved to the right so that a third ROI located at the right side of the first subregion is located at the center. Adaptive playback system of landscape video content, characterized in that.
The display device of claim 9, wherein the display area determiner comprises:

The second portion such that the second region of interest or the third region of interest is located at the center of the horizontal display area according to the horizontal movement of the second region of interest or the third region of interest during display of the second partial region; And horizontally scrolling an area to determine the display area.
The method of claim 9, wherein the ROI tracking unit,

And a facial region of a performer of the landscape video content as the ROI.
The display device of claim 1, wherein the display area determiner comprises:

Adapting the landscape video content according to claim 1, wherein the first partial area of the landscape video content is determined as a display area when a change is detected in the portrait display mode while displaying the entire area in the landscape display mode. Ever Replay System.
The display device of claim 1, wherein the display area determiner comprises:

And when the change is detected in the landscape display mode while displaying the first partial region or the second partial region in the portrait display mode, the entire region of the landscape video content is determined as a display region. Adaptive playback system for landscape video content.
Receiving, by the user terminal, the landscape video content in which the number of horizontal pixel data exceeds the number of vertical pixel data through a video playback application driven by the arithmetic processing module and visually displaying the video content through the display module;

Determining, by the user terminal, a landscape display mode in which the length of the horizontal display area exceeds the length of the vertical display area or a portrait display mode in which the length of the vertical display area exceeds the length of the horizontal display area;

The landscape video content to display, through the display module, an entire area including all of the horizontal pixel data and all of the vertical pixel data of the landscape video content when the video reproduction application is in the landscape display mode. Playing it;

The landscape video content to display, through the display module, a first partial region including all of the vertical pixel data of the landscape video content and a portion of the horizontal pixel data when the video playback application is in the portrait display mode; Playing it;

The video playback application is adapted to respond to a user input through a user interface module during playback of the landscape video content in the portrait display mode and all of the vertical pixel data of the landscape video content and a horizontal pixel of the first partial region; And continuously playing the landscape video content to display, via the display module, a second partial region composed of data and a portion of horizontal pixel data different from that of the horizontal pixel data. How to play.
The method of claim 14, wherein displaying the first partial area comprises:

And the moving picture reproducing application displays the first partial area such that a central part of the horizontal pixel data of the landscape moving picture content is located at the center of the horizontal display area. .
The method of claim 14,

The adaptive playback method of landscape video content may further include: tracking, by the video reproducing application, a region of interest through image processing during playback of the landscape video content.

The playing of the landscape video content to display the first partial area may include: the video reproducing application, wherein the first region of interest adjacent to a center portion of the horizontal pixel data of the landscape video content is a portion of the horizontal display area. And displaying the first partial region so as to be positioned at the center.
The method of claim 16, wherein the adaptive playback method of the landscape video content comprises:

In response to the moving picture reproduction application playing the landscape video content such that the first partial region is displayed, the first region of interest is located at the center of the horizontal display area according to the horizontal movement of the first region of interest. Horizontally scrolling the first partial region; and adaptively playing the landscape video content.
The method of claim 16, wherein the tracking of the ROI comprises:

And tracking a face area of a performer of the landscape video content as the ROI.
The method of claim 14, wherein the playing of the landscape video content to display the second partial region comprises:

The video playback application receives a user's slide motion through the user interface module configured as a touch screen as the user input, and displays a horizontal scrolled area as the second partial area in proportion to a distance of the user's slide motion. Adaptive playback method of landscape video content, characterized in that.
The method of claim 14, wherein the playing of the landscape video content to display the second partial region comprises:

The video playback application receives sensing information of a direction sensor according to a horizontal movement of the video content playback system by a user as the user input, and is horizontally scrolled in proportion to a distance of the horizontal movement of the video content playback system. And displaying an area as the second sub-area.
The method of claim 14, wherein the playing of the landscape video content to display the second partial region comprises:

The second part of the video reproducing application receives a user's selection of a left area or a right area of the horizontal display area as the user input and moves the area moved left or right by a predetermined number of horizontal pixel data. An adaptive playback method of landscape video content characterized by displaying as an area.
The method of claim 14,

The adaptive playback method of landscape video content may further include: tracking, by the video playback application, a region of interest of the landscape video content through image processing during playback of the landscape video content.

The playing of the landscape video content to display the second partial region may include: receiving, by the user input, a selection operation of a left region or a right region of the horizontal display region as the user input; A region moved to the left so that the second region of interest located at the left side of the partial region is located at the center may be displayed as the second partial region, or the third region of interest located at the right side of the first partial region may be positioned to the right side. And displaying the moved region as the second partial region.
The method of claim 22, wherein the adaptive playback method of the landscape video content comprises:

When the video reproduction application displays the second partial region of the landscape video content, the second region of interest or the third region of interest is changed according to a horizontal movement of the second region of interest or the third region of interest. And horizontally scrolling the second partial region so as to be positioned at the center of a horizontal display area.
The method of claim 22, wherein tracking the region of interest comprises:

And tracking a face area of a performer of the landscape video content as the ROI.
The method of claim 14, wherein the adaptive playback method of the landscape video content comprises:

The display module displays the first partial region of the landscape video content when a change is detected in the portrait display mode while the video reproduction application is displaying the entire area of the landscape video content in the landscape display mode. And continuously playing the video content to be displayed through the landscape video content.
The method of claim 14, wherein the adaptive playback method of the landscape video content comprises:

The landscape video when the video reproduction application detects a change to the landscape display mode while displaying one of the first partial region and the second partial region of the landscape video content in the portrait display mode; And continuously playing the moving picture content to display the entire area of the content through the display module.