WO2018026152A1 - Système et procédé de reproduction adaptative d'un contenu vidéo en paysage - Google Patents

Système et procédé de reproduction adaptative d'un contenu vidéo en paysage Download PDF

Info

Publication number
WO2018026152A1
WO2018026152A1 PCT/KR2017/008242 KR2017008242W WO2018026152A1 WO 2018026152 A1 WO2018026152 A1 WO 2018026152A1 KR 2017008242 W KR2017008242 W KR 2017008242W WO 2018026152 A1 WO2018026152 A1 WO 2018026152A1
Authority
WO
WIPO (PCT)
Prior art keywords
landscape
area
video content
display
region
Prior art date
Application number
PCT/KR2017/008242
Other languages
English (en)
Korean (ko)
Inventor
김남균
이호림
Original Assignee
(주)잼투고
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)잼투고 filed Critical (주)잼투고
Publication of WO2018026152A1 publication Critical patent/WO2018026152A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224—Touch pad or touch panel provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/44504—Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/14—Solving problems related to the presentation of information to be displayed
    • G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens

Definitions

  • the present invention relates to an adaptive playback system and a playback method of landscape video content, and more particularly, to a playback system and a playback method capable of adaptively changing a display method of landscape video content according to a change in direction of a display module.
  • UGC is produced through specialized video cameras, but it is more common to produce UGC easily through personal smartphones. This is due to changes in the IT environment, such as providing a personal video broadcasting platform on SNS such as Facebook, and UGC, which is produced through a smartphone of a general user, is consumed through a smartphone of another general user. .
  • Conventional video content is generated as landscape video content that is longer than vertical in width, and consumed through TV screens, theater screens, and PC monitors in landscape display mode, which is also longer than vertical in width.
  • Conventional video content consumers have a fixed aspect ratio of 4: 3 (analog TV), 16: 9 (HDTV, wide monitor), 1.85: 1 (theater screen), and because the display module does not support redirection, Specialized in landscape video content.
  • the smartphone is designed to be operated by the user in one hand, the smartphone is provided in a narrow portrait display mode as shown in FIG. 2 instead of the conventional landscape display mode.
  • Apple's iPhone 6, for example has a 9:16 aspect ratio and Apple's iPad family has a 3: 4 aspect ratio.
  • a user terminal such as a smartphone or a tablet PC includes a gyro sensor, an acceleration sensor, a gravity sensor, and the like, and a method using a gravity sensing value or an acceleration sensing value and a gyro sensing value by using a Kalman filter.
  • a vertical display mode or a landscape display mode may be adaptively provided as shown in FIG. 2 by sensing the pitch of the user terminal by sensing the pitch of the user terminal.
  • An adaptive user terminal control technique may be used to produce video content.
  • the user shoots the video in the portrait display mode it is possible to produce a portrait video content as shown in FIG. 3, and when the user shoots the video in the landscape display mode, the landscape video content as shown in FIG. Can produce.
  • the adaptive user terminal control technique according to the pitch sensing of the direction sensor may be used to consume the video content.
  • the user can zoom out by adding a lot of margins to the top and bottom of the full screen to show the whole image. If the user consumes the landscape video content in landscape display mode, It is common to display the entire image with no margin or a small margin on the screen.
  • a small margin is added to the top, bottom, left, and right sides.
  • landscape video content occupies a screen area with more background area than the character, so it is suitable for movie content and drama content that emphasizes the beauty of the image or storytelling. Since it occupies a small screen area, it is suitable for performance contents and personal broadcasting focused on one character.
  • the portrait display mode is suitable for a user's hand grip.
  • users can enjoy short video content within 5 minutes of low concentration. You can predict the tendency to watch landscape videos.
  • Apple, U.S. Patent No. 8,736,561, "Device, method, and graphic user interface with content display mode and display rotation heuristics,” shows a portrait display while playing landscape video content in full-screen mode through the landscape display mode of the user terminal.
  • the mode is changed, the configuration of reducing the size of the landscape video content and displaying additional image related information in another screen area is disclosed.
  • an adaptive user interface module can be provided for video content currently being played in accordance with the change of the display mode.
  • the width of the display module matches that of the video content.
  • Patent Document 1 US Patent Publication No. 2003-0231189
  • Patent Document 2 US Patent No. 7,313,418
  • Patent Document 3 US Patent Publication No. 2009-0237379
  • Patent Document 4 US Patent No. 8,676,271
  • Patent Document 5 US Patent No. 8,736,561
  • the present invention is to solve the above problems, the adaptive playback system and playback method of the landscape video content according to the present invention, in the landscape display mode of a mobile terminal such as a smart phone to display the entire area of the landscape video
  • a mobile terminal such as a smart phone
  • the user can easily enlarge and enjoy the landscape video by rotating the terminal, and a portrait display suitable for hand grip of a smartphone
  • the purpose of the present invention is to improve user convenience by allowing a user using a web page or an application to view a landscape video without changing a hand position.
  • an adaptive playback system and playback method of landscape video content tracks a main area such as a face recognized in the video content as a region of interest, and displays the region of interest of a landscape video enlarged in a portrait display mode.
  • Another object of the present invention is to improve user convenience by allowing the user to preferentially view an area including an important object without a user's separate operation.
  • the adaptive playback system and playback method of landscape video content moves a main subject through a static landscape video by automatically scrolling the enlarged partial region left and right according to the left and right movement of the ROI.
  • Another purpose is to provide a portrait video such as the camera dynamically tracking.
  • the adaptive playback system and playback method of landscape video content for example, to track a plurality of performers to a plurality of regions of interest according to the user's selection, and to be located in the center of the screen in the portrait display mode
  • Another objective is to provide a new user experience of interactive video viewing by allowing a user to select a region of interest.
  • the adaptive playback system and playback method of the landscape video content for example, in the vertical display mode according to the left and right slide operation of the touch screen or the left and right movement of the smartphone in the display module
  • the display module for visually displaying information to the user;
  • a user interface module configured to receive a user input;
  • a display mode detection for detecting whether the length of the horizontal display area of the display module is a landscape display mode exceeding the length of the vertical display area or whether the length of the vertical display area of the display module is a portrait display mode exceeding the length of the horizontal display area module;
  • a data storage module for storing data; Arithmetic processing module; And a video playback application driven by the application data stored in the data storage module in a manner driven by the arithmetic processing module, and playing back video content through the display module.
  • the video playback application includes: a video content detector for detecting landscape video content in which the number of horizontal pixels exceeds the number of vertical pixels; The display area in which the landscape video content is played is determined, and in the landscape display mode, the entire area including all of the horizontal pixel data and the vertical pixel data of the landscape video content is determined as the display area.
  • a display area determiner configured to determine, as the display area, a first partial area including all of the vertical pixel data of the landscape video content and a part of the horizontal pixel data in the portrait display mode;
  • a video reproducing unit reproducing the landscape video content through the display module according to the determination of the display area determining unit, wherein the display area determining unit reproduces the landscape video content in the portrait display mode.
  • the number of horizontal pixel data is vertical through a video playback application driven by a user terminal and visually displaying video contents through a display module.
  • Receiving landscape video content that exceeds the number of data Determining, by the user terminal, a landscape display mode in which the length of the horizontal display area exceeds the length of the vertical display area or a portrait display mode in which the length of the vertical display area exceeds the length of the horizontal display area;
  • the landscape video content to display, through the display module, an entire area including all of the horizontal pixel data and all of the vertical pixel data of the landscape video content when the video reproduction application is in the landscape display mode.
  • the landscape video content to display, through the display module, a first partial region including all of the vertical pixel data of the landscape video content and a portion of the horizontal pixel data when the video playback application is in the portrait display mode; Playing it;
  • the video playback application is adapted to respond to a user input through a user interface module during playback of the landscape video content in the portrait display mode and all of the vertical pixel data of the landscape video content and a horizontal pixel of the first partial region; And continuously playing the landscape video content to display, via the display module, a second partial area composed of a portion of data and other horizontal pixel data.
  • the adaptive playback system and playback method of the landscape video content in the landscape display mode of a mobile terminal such as a smart phone to display the entire area of the landscape video as a display area;
  • the portrait display mode the partial region of the landscape video is enlarged and displayed so that the user can easily enlarge and enjoy the landscape video by rotating the terminal, and in the portrait display mode suitable for hand grip of a smartphone.
  • the user's convenience can be improved by allowing the user using the web page or the application to watch the landscape video without changing the position of the hand.
  • an adaptive playback system and playback method of landscape video content tracks a main area such as a face recognized in the video content as a region of interest, and displays the region of interest of a landscape video enlarged in a portrait display mode.
  • the central location provides the effect of improving the user's convenience by allowing the user to preferentially view the area containing the important object without the user's separate operation.
  • the adaptive playback system and playback method of landscape video content according to an embodiment of the present invention, by automatically scrolling left and right parts of the enlarged area according to the left and right movement of the region of interest to the movement of the main subject through the static landscape video This provides the effect of providing a portrait video, such as camera tracking dynamically.
  • the adaptive playback system and playback method of landscape video content for example, to track a plurality of performers to a plurality of regions of interest according to the user's selection, and to be located in the center of the screen in the portrait display mode
  • By allowing the user to select a region of interest it provides a new user experience for interactive video viewing.
  • the adaptive playback system and playback method of the landscape video content for example, in the vertical display mode according to the left and right slide operation of the touch screen or the left and right movement of the smartphone in the display module
  • the user can control the camera to provide a new user experience in which the desired area can be enlarged and enjoyed.
  • FIG. 1 is a block diagram showing an adaptive playback system of landscape video content according to an embodiment of the present invention.
  • FIG. 2 shows an example of a portrait display mode and a landscape display mode.
  • FIG 3 illustrates an example of landscape video content and portrait video content.
  • FIG. 4 is a diagram illustrating an example of a screen configuration in which an adaptive playback system of landscape video content according to an embodiment of the present invention provides the landscape video content to the entire area in the landscape display mode.
  • FIG. 5 is a diagram illustrating an example of a screen configuration in which an adaptive playback system of landscape video content according to an embodiment of the present invention provides the landscape video content as a partial region in a portrait display mode.
  • FIG. 6 is a diagram illustrating an example of a screen configuration in which an adaptive playback system of landscape video content according to an embodiment of the present invention provides a second partial region according to a user input in a portrait display mode.
  • FIG. 7 is an exemplary view illustrating a screen configuration in which an adaptive reproduction system of landscape video content according to an embodiment of the present invention provides a second partial area centered on a plurality of ROIs according to a user input.
  • FIG. 8 is a flowchart illustrating an adaptive playback method of landscape video content according to an embodiment of the present invention.
  • FIG. 9 is an exemplary view of implementing source code for displaying landscape video content in a portrait display mode according to an embodiment of the present invention.
  • Video content playback system 100 display module 110
  • Video playback application (160) Video content detector (161)
  • a part includes a certain component means that the component may further include other components, except for the absence of a special objection thereto.
  • the terms ".. module”, “.. unit”, “.. system”, etc. described in the specification mean a unit that processes at least one function or operation, which is hardware or software or a combination of hardware and software. It may be implemented, and may be included in one device or each other device.
  • the adaptive playback system 100 of landscape video content includes a display module 110, a user interface module 120, a display mode sensing module 130, a data storage module 140, and a processing module 150. ), And a video playback application 160.
  • the playback system 100 of the present invention is implemented as a personal information terminal such as, for example, a smartphone, a tablet PC, a notebook PC, a desktop PC, and the like.
  • the display module 110 performs a function of visually displaying information to a user, and may be an example of an LCD display, an OLED display, or the like integrally provided with a smartphone, a tablet PC, and the like. It may be a separate display device such as an LCD monitor, a TV, a projector, or the like.
  • the user interface module 120 performs a function of receiving a user input (input_user).
  • the user interface module 120 may be, for example, a touch screen added to the display module 110, and may be a position sensor such as a gyro sensor, an acceleration sensor, or a gravity sensor provided in the personal portable device. It may also be a mouse, keyboard, or keypad, camera, microphone, or the like.
  • the user interface module 120 recognizes a user's touch, key input, change of position of the terminal, behavior, voice, etc. as a user input (input_user), and a user input (input_user) signal that can be recognized by the video content playback system 100. To perform the function.
  • the display mode sensing module 130 is a landscape display mode (mode_landscape) in which the length of the horizontal display area of the display module 110 exceeds the length of the vertical display area, and the length of the vertical display area of the display module 110 is horizontal. This function detects whether the portrait display mode (mode_portrait) exceeds the length of the area.
  • the display module 110 of the present invention is limited to the display module 110 in which the length in one direction and the length in the other direction orthogonal thereto are different. That is, the landscape display mode (mode_landscape) and the portrait display mode (mode_portrait) are not distinguished from each other in a rectangular display in which the horizontal display area and the vertical display area of the display module 110 are the same.
  • Typical display modules 110 such as TVs, monitors, notebook PCs, etc. have a vertical display with a horizontal display area length such as 5: 4, 4: 3, 16:10, 16: 9, 1.85: 1, 2.35: 1. It takes the form of a landscape display mode (mode_landscape) that is longer than the area. Meanwhile, in the case of a smartphone or a tablet PC, the horizontal display area has a vertical display mode (mode_portrait) in which the length of the horizontal display area is shorter than the length of the vertical display area in consideration of ease of use, that is, ease of hand grip.
  • mode_portrait the vertical display mode in which the length of the horizontal display area is shorter than the length of the vertical display area in consideration of ease of use, that is, ease of hand grip.
  • the vertical display mode (mode_portrait) and the landscape are changed according to the tilt of the display. All display modes (mode_landscape) are supported.
  • the display mode sensing module 130 automatically detects the rotation of the display to provide a screen suitable for each display mode. For example, when the display mode detection module 130 detects the portrait display mode (mode_portrait), the display device provides a long screen in the vertical direction. On the contrary, when the landscape display mode (mode_landscape) is detected, the display mode detection module 130 provides a long screen in the horizontal direction.
  • mode_portrait portrait display mode
  • mode_landscape landscape display mode
  • the display mode sensing module 130 may be implemented in various ways, such as using a gravity sensing value of a gravity sensor or correcting an acceleration sensing value of an acceleration sensor and a gyro sensing value of a gyro sensor using a Kalman filter.
  • the pitch of the user terminal may be implemented as a method of detecting a tilt.
  • the display mode sensing module 130 may be implemented by installing electrical contacts of the pivot portion in units of 90 degrees.
  • each Rotate option such as 90 degree rotation and 270 degree rotation, is 0 or 180 degrees in portrait display mode (mode_portrait).
  • the display mode sensing module 130 may also be implemented by a method of recognizing the rotation in the landscape display mode (mode_landscape).
  • the data storage module 140 performs a function of storing data.
  • the data storage module 140 is not particularly limited, and may be implemented as an electrical, magnetic, or optical storage medium installed in the video content playback system 100 or connected through a network.
  • the data storage module 140 may exemplify a floppy diskette and a floppy disk driver, an optical disk and an optical disk driver, a hard drive, a solid state driver using a flash memory such as a RAM, a ROM, a USB memory, an SD card, and the like as the data storage module 140.
  • the data storage module 140 of the NAS (Network Attached Storage) or a server accessible through the network may correspond to the data storage module 140 of the present invention.
  • the data storage module 140 stores the application data for driving the application and the multimedia data that can be used in the application.
  • the operation processing module 150 may illustrate a mobile processor such as a smartphone or a tablet PC, or a central processing unit such as a notebook PC or a desktop PC, and may interpret a command constituting an application through such a command. Implement the functionality of the application.
  • the video playback application 160 is driven in such a manner that the application data stored in the data storage module 140 is driven by the operation processing module 150, and plays the video content through the display module 110.
  • the video playback application 160 may receive and play video content data through the Internet, or may load and play video content data stored in the data storage module 140.
  • the video player application 160 may be implemented by only a video player function, but other functions such as a web service access function through a communication network and a video content player function may be combined.
  • the video player application 160 includes a video content detector 161, a display area determiner 162, and a video player 163.
  • the video content detector 161 detects a landscape video content (content_landscape) in which the number of horizontal pixels exceeds the number of vertical pixels.
  • content_landscape in which the number of horizontal pixels exceeds the number of vertical pixels.
  • 3 illustrates landscape video content content_landscape in which the number of horizontal pixels exceeds the number of vertical pixels, and portrait video content content_portrait in which the number of vertical pixels exceeds the number of horizontal pixels.
  • the number of horizontal pixels is 1920 and the number of vertical pixels is 1080.
  • the number of pixels of the video content and the resolution of the display module do not necessarily match. For example, if you're playing 1920 X 1080 FHD video content on a 3048 X 2160 UHD display module, upscale it to 3040 X 2160 resolution through image processing, and play 1920 X 1080 HD video content on an HD display module at 1360 X 768. Image processing can then downscale it to 1360 X 768 resolution.
  • Conventional TVs, theater screens, and the like are fixed landscape display modes (mode_landscape), so that general broadcast camera equipment, home camcorder equipment, and theater camera equipment generally produce landscape video content (content_landscape).
  • the smartphone or tablet PC may produce landscape video content (content_landscape) or portrait video content (content_portrait) according to the user's hand grip.
  • landscape video content content_landscape
  • portrait video content content_portrait
  • the user may shoot landscape video content (content_landscape); and when a single performer whose subject is narrow by a narrow angle of view as the subject, the user may shoot a portrait video content (content_portrait).
  • the video content detector 161 may detect the landscape video content (content_landscape) in various ways.
  • landscape image content content_landscape
  • landscape video can be detected through aspect ratio information or horizontal pixel number information and vertical pixel number information among attribute information included in metadata of video content.
  • Content content_landscape
  • the display area determiner 162 determines a display area (area_present) in which the landscape video content (content_landscape) is played.
  • the landscape display mode (mode_landscape) as shown in FIG. 4, the landscape video content (content_landscape) is displayed.
  • the entire area (area_entire) consisting of all of the horizontal pixel data and all of the vertical pixel data of is determined as the display area (area_present), and in the vertical display mode (mode_portrait), as shown in FIG.
  • a first partial area (area_partial_1st) including all of the vertical pixel data of the content_landscape and a part of the horizontal pixel data is determined as the display area (area_present).
  • the entire area (area_entire) and the first partial area (area_partial_1st) are configured to maintain the aspect ratio of the original video content.
  • the entire area (area_entire) of the landscape video content (content_landscape) is visually provided to the user through the display module 110.
  • the aspect ratio of the landscape display mode (mode_landscape) is 16: 9
  • the video module is played on the display module 110, and the aspect ratio of the video content is displayed on the display.
  • a cinema film ratio of 1.85: 1 black margins are filled on the top and bottom of the screen, and if the aspect ratio of the video content is smaller than the aspect ratio of the display, for example, a 35 mm film ratio of 3: 2 It can be configured to fill black margins on the left and right sides of the screen.
  • the entire vertical pixel data of the video content is displayed on the screen so as to match the vertical display area of the display.
  • the image viewed through the first partial area area_partial_1st is displayed as a partial image of an image in which the image viewed in the whole area area_entire is enlarged in the landscape display mode (mode_landscape).
  • the display module 110 having an aspect ratio of 16: 9 displays a landscape video having an aspect ratio of 16: 9, the conventional technology of displaying a full screen in the portrait display mode (mode_portrait) according to the landscape display mode (mode_landscape)
  • mode_portrait portrait display mode
  • mode_landscape landscape display mode
  • the image reduced to 31.6% of the entire area (area_entire) is displayed in 31.6% of the entire display area, and the remaining 68.4% is filled with black margins, making the image hard to be recognized by the user.
  • the image of the first partial area (area_partial_1st) displayed in the portrait display mode (mode_portrait) is displayed in the entire area (area_entire) image of the landscape display mode (mode_landscape) in the same environment.
  • a 31.6% partial image enlarged by 3.16 times is displayed in 100% of the entire display area.
  • the user's act of changing from the landscape display mode (mode_landscape) to the portrait display mode (mode_portrait) acts as a command to enlarge and view the video content, thereby improving user convenience.
  • FIG. 9 is a diagram illustrating a source code implementation for displaying a landscape video content (content_landscape) in a portrait display mode (mode_portrait) according to an embodiment of the present invention. Since the vertical resolution of the entire video content enlarged in the portrait display mode (mode_portrait) is the same as that of the display module 110 in the vertical display mode (mode_portrait), the vertical resolution of the entire video content enlarged in the portrait display mode (mode_portrait) The horizontal resolution (Xconverted) is expressed by the following equation using the horizontal resolution (Xcontent) and vertical resolution (Ycontent) of the landscape video content (content_landscape) and the vertical resolution (Ydisplay) of the display module 110 in the portrait display mode (mode_portrait). You can get it by
  • the display module 110 shows a partial image of 1242 X 2208.
  • FIG. 9 illustrates an embodiment in which the display conversion process and the first partial area (area_partial_1st) shown for the first time are set as the center portion of the landscape video content (content_landscape).
  • the video player 163 plays the landscape video content content_landscape through the display module 110 according to the determination of the display area determiner 162.
  • the function of the video reproducing unit 163 decodes the encoded video content file, for example, and reproduces the video in the form of a video visually recognizable to the user through the display module 110.
  • the display area determiner 162 reacts to the landscape video content (content_landscape) in response to a user input (input_user) through the user interface module 120 during playback of the landscape video content (content_landscape) in the portrait display mode (mode_portrait).
  • a second partial area consisting of all of the vertical pixel data of and a portion of the horizontal pixel data of the first partial area (area_partial_1st) and other horizontal pixel data as the display area (area_present).
  • the first partial area area_partial_1st and the second partial area area_partial_2nd may be configured to overlap each other, or may be configured to overlap some areas.
  • the display area determiner 162 may initially have, for example, horizontal pixel data of the landscape video content (content_landscape). While showing the central portion 210 of the first partial area (area_partial_1st), when the user wants to see the right area, the display area determination unit 162 pushes the touch screen to the right 310 to display the landscape video content ( The right region 220 of the content_landscape may be shown as the second partial region area_partial_2nd.
  • the user can freely select and enjoy a desired partial region of the landscape video content (content_landscape), thereby obtaining a user experience different from the existing video playback system provided only in the entire area (area_entire). It can be effective.
  • the first partial area area_partial_1st first shown in the portrait display mode may be variously set according to an embodiment.
  • the central portion 210 of the horizontal pixel data of the landscape video is typically the most important area. Therefore, the display area determiner 162 is configured such that the first visible area is the center of the landscape video content (content_landscape) so that the center portion of the horizontal pixel data of the landscape video content (content_landscape) is located at the center of the horizontal display area. It is preferable to determine one partial area area_partial_1st as the display area area_present.
  • the central portion of the horizontal pixel data refers to the horizontal portion of the landscape video content content_landscape.
  • the center of the horizontal display area refers to a horizontal center portion of the display module 110 in the portrait display mode (mode_portrait).
  • the subject and the background may be separated according to the recent development of image processing technology, and the type of the subject may be distinguished with a high probability of a person, an animal, a car, a house, or a natural object, and the movement of the subject may be separated. It can also be tracked.
  • image processing technique it is preferable to configure the important subject area of the landscape video content (content_landscape) to be preferentially displayed in the portrait display mode (mode_portrait).
  • the video playback application 160 may further include a region of interest tracker 164 that tracks the region of interest through image processing during playback of the landscape video content (content_landscape).
  • the region of interest tracking unit 164 may be implemented using, for example, a known open source code such as MeanShift or CamShift of Open CV.
  • the ROI tracking unit 164 may track the face area of the performer of the landscape video content (content_landscape) as the ROI.
  • the region of interest is not limited to the face of the performer, but may be a fixed subject that can be recognized through image processing of a moving subject such as an animal or a car, a building, or a natural object.
  • the display area determiner 162 selects the first partial area (area_partial_1st) such that the first area of interest (area_interest_1st) adjacent to the center of the horizontal pixel data of the landscape video content (content_landscape) is located at the center of the horizontal display area. It is preferable to determine the display area area_present.
  • the center-centered subject may be displayed first as in the above-described embodiment.
  • the area of interest is the face area of the performers
  • the user registers as an acquaintance on SNS.
  • a landscape video content content_landscape
  • a popular actor or favorite actor such as a human-animal-object sequence.
  • the subject type having the highest priority may be displayed first regardless of the appearance position.
  • the first partial area (area_partial_1st) determined by the display area determiner 162 is a user input (input_user) through the user interface module 120 of the user according to the horizontal movement on the screen of the first area of interest (area_interest_1st) Without this, it is preferable to automatically move horizontally by tracking the first region of interest (area_interest_1st) of the region of interest tracking unit 164.
  • the display area determiner 162 is configured such that the first region of interest (area_interest_1st) is positioned at the center of the horizontal display area according to the horizontal movement of the first region of interest (area_interest_1st) during the display of the first partial region (area_partial_1st).
  • One partial area (area_partial_1st) may be horizontally scrolled to determine the area (area_present).
  • the portrait video content recorded by tracking the subject of the first area of interest (area_interest_1st) with a camera. gives the user the same effect as watching (content_portrait).
  • the user input (input_user) for determining the second partial area (area_partial_2nd) of the display area determiner 162 may include a slide operation on a touch screen and a horizontal movement of a portable device such as a smartphone.
  • the slide operation refers to an action of moving a finger or a touch pen to the left or right while keeping a user's finger or touch pen or the like on or near the touch screen.
  • the user interface module 120 includes a touch screen, and the display area determiner 162 receives the user's slide operation through the touch screen as a user input (input_user), and the user's slide operation.
  • the second partial area area_partial_2nd which is a horizontal scrolled area in proportion to the distance of, may be configured to be determined as the display area area_present. Since this method is generally used when a user moves in an enlarged document or an enlarged image on a smartphone, the user can intuitively move the slide screen of the touch screen to move in the enlarged video without explanation of how to use it. Provide usable effects.
  • US Patent No. 7,469,381 "List scrolling and document translation, scaling, and rotation on a touch-screen display" to notify the user that the left end region or the right end region of the landscape video content (content_landscape) has been reached. It may further implement a "bounce back" operation as disclosed in.
  • the user interface module 120 includes a direction sensor, and the display area determiner 162 detects sensing information of the direction sensor according to the horizontal movement of the video content playback system 100 by the user.
  • the second partial area area_partial_2nd which is received as a user input (input_user) and is horizontally scrolled in proportion to the distance of the horizontal movement of the system, is determined as the display area area_present.
  • the display mode detection module 130 is configured to include a direction sensor, it is possible to detect a horizontal movement of the video content playback system 100 implemented as a portable device using the direction sensor of the display mode detection module 130.
  • Commercially available 360-degree image provides a user with a feeling as if they are in the field by adaptively changing the angle of view displayed according to the movement of the portable device up, down, left and right. It provides an effect that can provide the user experience similar to the angle of view change according to the movement of the device to play the video content.
  • the second partial area area_partial_2nd is determined by a selection operation such as selection of a user's left or right screen or selection of a left or right moving icon.
  • a selection operation such as selection of a user's left or right screen or selection of a left or right moving icon
  • the display area determiner 162 receives a user selection operation on a left area or a right area of the horizontal display area as a user input (input_user), and sets the left or right by the number of preset horizontal pixel data.
  • the second partial area area_partial_2nd which is the area moved to, may be determined as the display area area_present.
  • This selection operation may include not only selection according to a touch of a specific area, but also horizontal movement of the portable device in the specific direction or slide in the above-described specific direction.
  • the user interface module 120 implemented as a touch screen capable of distinguishing the touch pressure of the user, it is also possible to implement to increase the number of horizontal pixel data moved in accordance with the increase in the touch pressure of the user.
  • the display area may be moved between ROIs in the portrait display mode (mode_portrait) according to a user's selection.
  • the display area may be moved between ROIs in the portrait display mode (mode_portrait) according to a user's selection.
  • mode_portrait portrait display mode
  • FIG. 7 when four persons are tracked as the region of interest, a first partial region (area_partial_1st) centering on the first region of interest (area_interest_1st) 410, which is a person adjacent to the horizontal center of the screen, is initially located.
  • the second partial area (area_partial_2nd) centering on the third area of interest (area_interest_3rd) 430 which is a person located at may be configured to be displayed.
  • the video player application 160 further includes a region of interest tracker 164 that tracks a region of interest through image processing during playback of the landscape video content (content_landscape), and the display region determiner 162 may display a horizontal display.
  • the display area area_present is received so that a selection operation for the left area or the right area of the area is received as a user input input_user, and the second area of interest area_interest_2nd located on the left side of the first partial area area_partial_1st is located at the center.
  • the second subregion which is determined to be the second partial region (area_partial_2nd), which is moved to the left, or is moved to the right, so that the third region of interest (area_interest_3rd) located on the right side of the first partial region (area_partial_1st) is located at the center.
  • (area_partial_2nd) is preferably configured to determine the display area (area_present).
  • the second region of interest (area_interest_2nd) may be located on the left side of the first partial area (area_partial_1st) or may be located on the left side other than the first partial area (area_partial_1st).
  • the third region of interest (area_interest_3rd) may be located on the right side within the first partial area (area_partial_1st) or may be located on the right side other than the first partial area (area_partial_1st).
  • the ROI tracking unit 164 may track the face area of the performer of the landscape video content (content_landscape) as the ROI.
  • the display area determiner 162 may move the second region of interest (area_interest_2nd) according to the horizontal movement of the second region of interest (area_interest_2nd) or the third region of interest (area_interest_3rd) during the display of the second partial region (area_partial_2nd). ) Or horizontally scrolling the second partial area (area_partial_2nd) so that the third region of interest (area_interest_3rd) is positioned at the center of the horizontal display area to determine the display area (area_present).
  • the user in the landscape video content (content_landscape) in which a plurality of performers appear, the user provides an effect such as selecting photographed portrait video content (content_portrait) that is close up for each performer.
  • the portrait display mode (mode_portrait) or the landscape display mode (mode_landscape) is determined at the start of the playback of the landscape video content (content_landscape) and is not fixed to the corresponding display mode, but during playback of the landscape video content (content_landscape). It is desirable that conversion between both display modes be made. In other words, if a user who is watching the landscape video content (content_landscape) in full screen through the landscape display mode (mode_landscape) wants to view a specific area in an enlarged manner, the mobile device is rotated to switch to the portrait display mode (mode_portrait). You can enjoy the partial area.
  • the display area determiner 162 displays the first partial area (area_partial_1st) of the landscape video content (content_landscape) when a change is detected in the portrait display mode (mode_portrait) while displaying the entire area (area_entire). area_present).
  • the display area determiner 162 detects a change in the landscape display mode (mode_landscape) while displaying the first partial area (area_partial_1st) or the second partial area (area_partial_2nd)
  • the entire area area_entire may be configured to be determined as the display area area_present.
  • a landscape video content content_landscape is received.
  • the user terminal may receive the landscape video content (content_landscape) by streaming the landscape video content (content_landscape) through a communication network or by loading the landscape video content (content_landscape) stored in the storage module of the user terminal. Can be.
  • the user terminal determines whether the length of the horizontal display area is a landscape display mode (mode_landscape) where the length of the vertical display area exceeds the length of the vertical display area, or whether the length of the vertical display area is a portrait display mode (mode_portrait) that exceeds the length of the horizontal display area.
  • mode_landscape a landscape display mode
  • mode_portrait a portrait display mode
  • the determining of the display mode (s20) does not necessarily have to be followed by the receiving of the landscape video content (content_landscape) (s10), but is performed prior to the receiving of the landscape video content (content_landscape) (s10). It may be.
  • the display module (area_entire) including all of the horizontal pixel data and the vertical pixel data of the landscape video content (content_landscape) is displayed.
  • the landscape video content content_landscape is reproduced to be displayed through 110.
  • the first display area (area_partial_1st) including all of the vertical pixel data of the landscape video content (content_landscape) and part of the horizontal pixel data is displayed.
  • the landscape video content content_landscape is reproduced to be displayed through 110.
  • the video playback application 160 receives the user input (input_user) through the user interface module 120 during the playback of the landscape video content (content_landscape) in the portrait display mode (mode_portrait) (s70) to output the landscape video content.
  • landscape video to display through the display module 110 a second partial area (area_partial_2nd) consisting of all of the vertical pixel data of (content_landscape), the horizontal pixel data of the first partial area (area_partial_1st), and a part of other horizontal pixel data.
  • the content (content_landscape) is continuously played.
  • the step S60 of displaying the first partial area area_partial_1st may be performed by the video reproducing application 160 of the landscape video content content_landscape, as shown in FIG.
  • the first partial area area_partial_1st may be displayed such that the center portion of the horizontal pixel data is positioned at the center of the horizontal display area.
  • the adaptive reproduction method of the landscape video content content_landscape may be performed by the video reproducing application 160 through image processing during reproduction of the landscape video content content_landscape.
  • the method further includes tracking the region of interest (s30), and playing the landscape video content (content_landscape) to display the first partial area (area_partial_1st), as shown in FIG. 160 may be configured to display the first partial area are_partial_1st such that the first area of interest area_interest_1st adjacent to the center portion of the horizontal pixel data of the landscape video content content_landscape is located at the center of the horizontal display area. .
  • the adaptive playback method of the landscape video content content_landscape may be performed in order to automatically change the first partial area area_partial_1st according to the horizontal movement of the first region of interest area_interest_1st.
  • the first region of interest area_interest_1st
  • the first region of interest area_interest_1st
  • the first region of interest is displayed in the horizontal display area.
  • horizontally scrolling the first partial area area_partial_1st so as to be continuously positioned at the center.
  • the tracking of the region of interest it is preferable to track the face region of the performer of the landscape video content (content_landscape) as the region of interest.
  • the playing of the landscape video content (content_landscape) to display the second partial area (area_partial_2nd) (s80) includes a slide of the user through the user interface module 120 having the video playback application 160 configured as a touch screen.
  • the operation is received as a user input (input_user) (s70).
  • the video playback application 160 displays the horizontal scrolled area as the second partial area (area_partial_2nd) in proportion to the distance of the user's slide operation (S80).
  • the step (s80) of playing the landscape video content (content_landscape) to display the second partial area (area_partial_2nd) may be performed by the video reproducing application 160 according to the horizontal movement of the reproduction system 100 by the user.
  • the sensing information of the direction sensor is received as a user input (input_user) (s70), and the horizontal scrolled area is displayed as a second partial area (area_partial_2nd) in proportion to the distance of the horizontal movement of the system (s80).
  • the video reproducing application 160 selects the user with respect to the left or right area of the horizontal display area. Is received as a user input (input_user) (s70), and the area moved left or right by the number of preset horizontal pixel data is displayed as a second partial area (area_partial_2nd) (s80).
  • the adaptive playback method of the landscape video content is performed by the video reproducing application 160 tracking an area of interest of the landscape video content (content_landscape) through image processing during playback of the landscape video content (content_landscape).
  • the method may further include step s30, and the step S80 of playing the landscape video content content_landscape to display the second partial area area_partial_2nd may be performed by the video reproducing application 160 on the left or right side of the horizontal display area.
  • the second region is moved to the left so that the second region of interest (area_interest_2nd) located on the left side of the first sub-area (area_partial_1st) is located in the center
  • the region moved to the right so that the region of interest area_interest_3rd is located at the center is displayed as the second partial region area_partial_2nd (S80).
  • the adaptive playback method of the landscape video content In response to the horizontal movement of the second region of interest (area_interest_2nd) or the third region of interest (area_interest_3rd) during the display of the second partial area (area_partial_2nd) of the landscape video content (content_landscape), the video playback application 160 may change the second interest.
  • the method may further include horizontally scrolling the second partial area area_partial_2nd so that the area area_interest_2nd or the third area of interest area_interest_3rd is positioned at the center of the horizontal display area.
  • the tracking of the region of interest may be configured to track the face region of the performer of the landscape video content (content_landscape) as the region of interest.
  • the adaptive playback method of the landscape video content (content_landscape) is performed by the video playback application 160 displaying the entire area (area_entire) of the landscape video content (content_landscape) in the landscape display mode (mode_landscape). And if the change is detected in the display mode (mode_portrait), further comprising continuously playing the video content to display the first partial area (area_partial_1st) of the landscape video content (content_landscape) through the display module 110.
  • the adaptive playback method of the landscape video content may include a first partial area (area_partial_1st) or a second partial area of the landscape video content (content_landscape) in the portrait display mode (mode_portrait).
  • the video content is continuously displayed so that the entire area (area_entire) of the landscape video content (content_landscape) is displayed through the display module 110. It is preferable to further include the step of reproducing.
  • the landscape video content (content_landscape) is displayed as the entire image (area_entire) in the landscape video mode (mode_landscape), and in the vertical display mode (mode_portrait), a part composed of all of the vertical pixel data and a part of the horizontal pixel data.
  • the case of displaying an area (area_partial) has been described.
  • the portrait video content (content_portrait) is displayed as the entire image (area_entire) in the portrait video mode (mode_portrait), and in the landscape display mode (mode_landscape), which is composed of all of the horizontal pixel data and part of the vertical pixel data. It is also possible to indicate a partial area (area_partial).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention concerne un système et un procédé de reproduction adaptative d'un contenu vidéo en paysage. Un procédé de reproduction adaptative d'un contenu vidéo en paysage, selon la présente invention, comporte les étapes consistant à: faire recevoir, par un terminal d'utilisateur, un contenu vidéo en paysage, dont le nombre de données de pixels horizontaux dépasse son nombre de données de pixels verticaux, via une application de reproduction de vidéo qui est pilotée par un module de traitement d'opérations et affiche visuellement un contenu vidéo par l'intermédiaire d'un module d'affichage; faire déterminer, par le terminal d'utilisateur, si l'application de reproduction de vidéo est dans un mode d'affichage en paysage dans lequel la longueur d'une zone d'affichage horizontale dépasse la longueur d'une zone d'affichage verticale ou dans un mode d'affichage en portrait dans lequel la longueur d'une zone d'affichage verticale dépasse la longueur d'une zone d'affichage horizontale; reproduire le contenu vidéo en paysage par l'application de reproduction de vidéo pour afficher, via le module d'affichage, la superficie entière du contenu vidéo en paysage comportant la totalité des données de pixels horizontaux et la totalité des données de pixels verticaux lorsque l'application de reproduction de vidéo se trouve dans le mode d'affichage en paysage; faire reproduire le contenu vidéo en paysage par l'application de reproduction de vidéo pour afficher, via le module d'affichage, une première superficie partielle du contenu vidéo en paysage comportant la totalité des données de pixels verticaux et une partie des données de pixels horizontaux lorsque l'application de reproduction de vidéo se trouve dans le mode d'affichage en portrait; et faire reproduire en continu le contenu vidéo en paysage par l'application de reproduction de vidéo pour afficher, via le module d'affichage, une deuxième superficie partielle du contenu vidéo en paysage comportant la totalité des données de pixels verticaux et une partie des données de pixels horizontaux de la première superficie partielle et d'autres données de pixels horizontaux, en réaction à une entrée d'utilisateur via un module d'interface d'utilisateur pendant que le contenu vidéo en paysage est en cours de reproduction dans le mode d'affichage en portrait.
PCT/KR2017/008242 2016-08-03 2017-07-31 Système et procédé de reproduction adaptative d'un contenu vidéo en paysage WO2018026152A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2016-0099076 2016-08-03
KR1020160099076A KR101895865B1 (ko) 2016-08-03 2016-08-03 랜드스케이프 동영상 컨텐츠의 적응적 재생 시스템 및 재생방법

Publications (1)

Publication Number Publication Date
WO2018026152A1 true WO2018026152A1 (fr) 2018-02-08

Family

ID=61073736

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/008242 WO2018026152A1 (fr) 2016-08-03 2017-07-31 Système et procédé de reproduction adaptative d'un contenu vidéo en paysage

Country Status (2)

Country Link
KR (1) KR101895865B1 (fr)
WO (1) WO2018026152A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11144099B1 (en) * 2018-12-28 2021-10-12 Facebook, Inc. Systems and methods for providing content

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008099246A (ja) * 2006-09-13 2008-04-24 Ricoh Co Ltd 撮像装置および被写体検出方法
KR20090112130A (ko) * 2008-04-23 2009-10-28 삼성디지털이미징 주식회사 디지털 영상 처리장치 및 그 제어방법
KR20100090876A (ko) * 2009-02-09 2010-08-18 에스케이 텔레콤주식회사 컨텐츠 리스트를 나타내는 방법, 터치 스크린 단말기 및 컴퓨터로 읽을 수 있는 기록매체
KR20110122557A (ko) * 2010-05-04 2011-11-10 엘지전자 주식회사 영상표시장치 및 그 동작 방법
KR20140089269A (ko) * 2013-01-04 2014-07-14 엘지전자 주식회사 이동 단말기 및 이의 제어 방법, 및 이의 기록 매체

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080075950A (ko) * 2007-02-14 2008-08-20 삼성전자주식회사 이동통신 단말기 및 그의 자세에 따른 촬영 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008099246A (ja) * 2006-09-13 2008-04-24 Ricoh Co Ltd 撮像装置および被写体検出方法
KR20090112130A (ko) * 2008-04-23 2009-10-28 삼성디지털이미징 주식회사 디지털 영상 처리장치 및 그 제어방법
KR20100090876A (ko) * 2009-02-09 2010-08-18 에스케이 텔레콤주식회사 컨텐츠 리스트를 나타내는 방법, 터치 스크린 단말기 및 컴퓨터로 읽을 수 있는 기록매체
KR20110122557A (ko) * 2010-05-04 2011-11-10 엘지전자 주식회사 영상표시장치 및 그 동작 방법
KR20140089269A (ko) * 2013-01-04 2014-07-14 엘지전자 주식회사 이동 단말기 및 이의 제어 방법, 및 이의 기록 매체

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11144099B1 (en) * 2018-12-28 2021-10-12 Facebook, Inc. Systems and methods for providing content

Also Published As

Publication number Publication date
KR101895865B1 (ko) 2018-09-06
KR20180015493A (ko) 2018-02-13

Similar Documents

Publication Publication Date Title
US20180013974A1 (en) Display apparatus, display method, and computer program
EP3125524A1 (fr) Terminal mobile et son procédé de commande
US8255825B2 (en) Content aware adaptive display
WO2010013892A2 (fr) Dispositif et procédé d'affichage d'une région cible agrandie d'une image reproduite
US20100058254A1 (en) Information Processing Apparatus and Information Processing Method
CN110636354A (zh) 一种显示设备
WO2013022224A1 (fr) Appareil électronique utilisant la reconnaissance de mouvement et procédé associé permettant de commander un appareil électronique
US20080256485A1 (en) User Interface for Controlling Video Programs on Mobile Computing Devices
US20110151926A1 (en) Method and system for controlling output of a mobile device
WO2018038428A1 (fr) Dispositif électronique, et procédé de rendu de contenu multimédia à 360°
US20160071491A1 (en) Multitasking and screen sharing on portable computing devices
CN112073798B (zh) 一种数据传输方法及设备
WO2012165845A2 (fr) Appareil et procédé d'affichage
US10257411B2 (en) Electronic device, method, and storage medium for controlling touch operations
JP2021512436A (ja) グローバル特効の切替方法、装置、端末装置及び記憶媒体
WO2020248697A1 (fr) Dispositif d'affichage et procédé de traitement des données de communication vidéo
JP4724242B2 (ja) 電子機器および画像表示方法
CN112399233A (zh) 显示设备和视频聊天窗口的位置自适应调整方法
WO2018026152A1 (fr) Système et procédé de reproduction adaptative d'un contenu vidéo en paysage
WO2021179361A1 (fr) Appareil d'affichage
US11928381B2 (en) Display device and operating method thereof
WO2022105345A1 (fr) Dispositif d'affichage
US8463052B2 (en) Electronic apparatus and image search method
WO2022193475A1 (fr) Dispositif d'affichage, procédé de réception d'un contenu de projection d'écran et procédé de projection d'écran
WO2021218473A1 (fr) Procédé et dispositif d'affichage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17837203

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03.06.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17837203

Country of ref document: EP

Kind code of ref document: A1