WO2022055256A1

WO2022055256A1 - Electronic device and method for operating same

Info

Publication number: WO2022055256A1
Application number: PCT/KR2021/012230
Authority: WO
Inventors: 최길수; 김세현; 양관식; 박지원; 이종인
Original assignee: 삼성전자 주식회사
Priority date: 2020-09-08
Filing date: 2021-09-08
Publication date: 2022-03-17
Also published as: KR20220032938A

Abstract

According to embodiments, an electronic device and a method for operating same are disclosed. The electronic device according to embodiments comprises: a communication interface; a memory storing one or more instructions; and a processor which executes the one or more instructions stored in the memory, wherein the processor executes, by executing the one or more instructions, a multi-view function of simultaneously displaying a first view screen capable of outputting content of a first resolution and a second view screen capable of outputting content of a second resolution which is lower than the first resolution, so as to output first content of the first resolution, onto the first view screen, and output second content of the second resolution, onto the second view screen, and upon receiving, during the outputting, a request for switching between the view screens of the first content and the second content, the processor decodes the buffered second content of the second resolution by using a first decoder corresponding to the first view screen and outputs same onto the first view screen, and decodes the first content of the second resolution, which is received by requesting the first content of the second resolution, instead of the first content of the first resolution, from a server, by using a second decoder corresponding to the second view screen and outputs same onto the second view screen.

Description

Electronic device and method of operation thereof

Various embodiments relate to an electronic device and an operating method thereof, and more particularly, to an electronic device capable of effectively providing screen switching in a multi-view mode for displaying content on a plurality of screens, and an operating method thereof.

Conventionally, a display device such as a television receives one broadcast content and displays it on a single screen of the display device. Recently, in order to provide users with a variety of content experiences, a plurality of content related to broadcast content is provided, and a display device divides a display screen into a plurality of screens and displays different content on each of the divided screens. Attempts are being made to provide services.

While the display device displays content on a single screen, the single screen may be divided into a plurality of screens to display different content on each split screen. In addition, screens on which different contents displayed on the plurality of split screens are displayed may be switched. In this case, natural screen switching is required.

Various embodiments aim to provide an electronic device capable of naturally providing screen switching in a multi-view mode that provides a plurality of different contents through a plurality of split screens, and an operating method thereof.

An electronic device according to an embodiment includes a communication interface; a memory storing one or more instructions; and a processor that executes one or more instructions stored in the memory, wherein the processor executes the one or more instructions to output a first view screen capable of outputting content of a first resolution and a second lower than the first resolution By executing a multi-view function that simultaneously displays a second view screen capable of outputting content of two resolutions, the first content of the first resolution is output on the first view screen, and the second screen of the second resolution is output on the second view screen. An operation of receiving a view screen switching request of the first content and the second content while outputting 2 contents, and receiving the view screen switching request, buffered second content of a second resolution to the first view The first content of the second resolution received by decoding using the first decoder corresponding to the screen and outputting it to the first view screen, and requesting the first content of the second resolution from the server instead of the first content of the first resolution is decoded by a second decoder corresponding to the second view screen and output to the second view screen.

According to an embodiment, by executing the one or more instructions, the processor executes the one or more instructions, from the time the switching request is received until the time when the output preparation for outputting the first content of the second resolution to the second view screen is completed. During the period, a still image based on the buffered first content of the first resolution may be output to the second view screen.

According to an embodiment, the processor executes the one or more instructions, from the time of receiving the switching request to the time when the output preparation for outputting the first content of the second resolution to the second view screen is completed During the period of , a black image may be output on the second view screen.

According to an embodiment, the processor outputs the second content of the buffered second resolution to the first view screen when the switching request is received by executing the one or more instructions, so that the first content and the It is possible to control the switching of the second content to be performed.

According to an embodiment, the processor receives the second content of the first resolution by executing the one or more instructions by requesting the second content of the first resolution from the server at the time of receiving the switching request, and The received second content of the first resolution is decoded using a first decoder corresponding to the first view screen, and the second content of the first resolution is displayed following the display of the second content of the second resolution. It can be output to the view 1 screen.

According to an embodiment, by executing the one or more instructions, the processor is configured to output the first content of the second resolution to be output to the second view screen at a point in time when the output preparation of the first content of the second resolution is completed. The content may be output on the first view screen, and the first content of the second resolution may be output on the second view screen.

According to an embodiment, the processor requests the server for second content corresponding to the first resolution of the first view screen at the time when the switching request is received by executing the one or more instructions, and the first content When the output preparation is completed, the second content of the first resolution received from the server may be output to the first view screen.

According to an embodiment, by executing the one or more instructions, the processor is configured to display the first content on the first view screen until a point in time when preparation of the first content of the second resolution to be output on the second view screen is completed. The output of the first content may be maintained, and the output of the second content may be maintained on the second view screen.

According to an embodiment, by executing the one or more instructions, the processor determines the resolution of the first content output on the first view screen while maintaining the output of the first content on the first view screen. The first resolution may be controlled to be lowered to the second resolution.

According to an exemplary embodiment, in the method of operating an electronic device, a first view screen capable of outputting content having a first resolution and a second view screen capable of outputting content having a second resolution lower than the first resolution are simultaneously displayed. while outputting the first content of the first resolution on the first view screen and outputting the second content of the second resolution on the second view screen by executing a multi-view function, the first content and the second The operation of receiving a view screen switching request of the content, upon receiving the view screen switching request, the buffered second content of the second resolution is decoded using a first decoder corresponding to the first view screen to decode the first content an operation of outputting to the view screen, and requesting the server for the first content of the second resolution instead of the first content of the first resolution to the server and applying the received first content of the second resolution to the second view screen and decoding by a decoder and outputting the decoding to the second view screen.

According to an embodiment, in a computer-readable recording medium in which one or more programs executed by a processor of an electronic device are recorded to implement a method of operating an electronic device, the operating method of the electronic device includes: By executing a multi-view function that simultaneously displays a first view screen that can be output and a second view screen that can output content of a second resolution lower than the first resolution, the first view screen is displayed at the first resolution. While outputting 1 content and outputting the second content of the second resolution on the second view screen, receiving a view screen switching request between the first content and the second content, receiving the view screen switching request Accordingly, an operation of decoding the buffered second content of the second resolution using the first decoder corresponding to the first view screen and outputting the buffered second content on the first view screen, and the first content of the first resolution instead of the and requesting the first content of the second resolution from the server, decoding the received first content of the second resolution with a second decoder corresponding to the second view screen, and outputting the received first content to the second view screen.

According to various embodiments of the present disclosure, screen switching may be provided naturally in a multi-view mode in which a plurality of different contents are provided through a plurality of split screens.

1 is a reference diagram for explaining a single-view mode, a multi-view mode, and a transition from a single-view mode to a multi-view mode.

2 is a reference diagram for explaining a screen switching operation in an electronic device according to an exemplary embodiment.

3 is a schematic block diagram of an electronic device according to an exemplary embodiment.

4 is a detailed block diagram of an electronic device according to an exemplary embodiment.

5 is a flowchart of an example of an operation of performing screen switching in an electronic device, according to an embodiment.

6 is an example of an operation flowchart of a method of performing screen switching at a time of a screen switching request according to an embodiment.

7 illustrates an example of outputting a user interface for screen switching selection on each screen constituting a multi-view according to an exemplary embodiment.

8 is a reference diagram for explaining a method of performing screen switching at a time of a screen switching request according to an embodiment.

FIG. 9A is an example for explaining a content display operation in the electronic device 100 operating according to a multi-view mode including a plurality of screens having different resolutions, according to an embodiment.

9B is an example for explaining a content display operation in the electronic device 100 that operates in response to a content switching request, according to an embodiment.

9C is an example for explaining a content display operation in the electronic device 100 that operates in response to a content switching request according to an embodiment.

10 is an example of an operation flowchart of a method of performing screen switching after receiving a screen switching request and waiting until output of low-resolution content is ready, according to an embodiment.

11 is a reference diagram for explaining a method of performing screen switching after waiting until low-resolution content is ready for switching after receiving a screen switching request, according to an exemplary embodiment;

12A is an example for explaining a content display operation in the electronic device 100 operating according to a multi-view mode including a plurality of screens having different resolutions, according to an embodiment.

12B is an example for explaining a content display operation in the electronic device 100 that operates in response to a content switching request, according to an embodiment.

Terms used in this specification will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected as currently widely used general terms as possible while considering the functions in the present invention, but these may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, and the like. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than the name of a simple term.

In the entire specification, when a part "includes" a certain element, this means that other elements may be further included, rather than excluding other elements, unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. .

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

In the embodiment of the present specification, the term “user” means a person who controls a function or operation of a computing device or an electronic device using a control device, and may include a viewer, an administrator, or an installer.

In an embodiment of the present specification, the term “multi-streaming service” refers to a service in which the display screen of the electronic device is divided into a plurality of regions, and each divided region is used as a sub-screen to provide different contents on each sub-screen. can The display screen may be divided into two or more sub screens. The content provided to each sub screen may be main content and content related to the main content. The content provided to each sub-screen may be content from the same source or content from different sources. The multi-streaming service may be referred to as a multi-view service or a multi-screen service.

Referring to FIG. 1 , single view mode 1 is a mode in which one content is displayed on one single screen of a display device such as a television. The content displayed in the single view mode 1 may include broadcast content directly received through the RF signal 50 from a broadcasting station, broadcast content received through an external source, and content received from a content providing server through the Internet.

In order to provide users with a more diverse content experience, the multi-view mode 2 may be provided for broadcast content. The multi-view mode 2 is a mode in which the display screen of the display device is divided into a plurality of screens, and different contents are simultaneously displayed on the divided screens. Each divided screen may also be referred to as a sub-screen to distinguish it from a case in which the display consists of one single screen.

The display mode of the display device may be displayed in the single view mode and then switched to the multi-view mode. When a content is displayed in the single-view mode and then switched to the multi-view mode, the content displayed in the multi-view mode may be content related to the content displayed in the single-view mode. For example, in the case of sports game content such as baseball, the content displayed on the plurality of sub screens in the multi-view mode may be content corresponding to a plurality of scenes that can be captured in the corresponding sports game content. For example, each sub screen in the multi-view mode may display content centered on the batter, content centered on the catcher, content centered on the coach, and content centered on the spectators. For example, in the case of content relaying a performance, each sub-screen of the multi-view mode may display content that is centered on each performer performing or performing in the corresponding performance.

The content displayed in the multi-view mode may include content that provides additional information about the content displayed in the single-view mode. For example, the additional information about the content may include information about the score of a baseball game, team information, and baseball players in a baseball game broadcast, and information about performers and performances in a performance relay broadcast. may contain information.

A plurality of screens provided in the multi-view mode may be determined in various numbers. The number of sub screens provided in the multi-view mode may be 2, 3, 4, or more. In FIG. 1, four sub screens are shown as an example. Referring to FIG. 1 , the multi-view mode 2 may include a first screen 10 , a second screen 20 , a third screen 30 , and a fourth screen 40 .

The arrangement of the plurality of screens provided in the multi-view mode may be variously determined. 1 exemplarily shows that one screen is arranged in the upper center of the display and three screens are arranged side by side on the lower side of the display.

The sizes of the plurality of screens provided in the multi-view mode may be determined in various ways. The sizes of the plurality of sub screens may all be the same or may have different sizes.

Resolutions of a plurality of screens provided in the multi-view mode may be determined in various ways. For example, referring to FIG. 1 , when four screens are configured in the multi-view mode, the first view screen 10 is the first resolution, the second view screen 20 is the second resolution, and the third view screen 30 is the third Resolution, the fourth view The screen 40 may have a fourth resolution. The first resolution, the second resolution, the third resolution, and the fourth resolution may all be the same, some may be the same, or all may be different. For example, the first resolution may be determined as 8K, the second resolution as 2K, the third resolution as 4K, and the fourth resolution as 4K.

In the multi-view mode, the first content included in the IP streaming signal 60, which is a source of content signals provided to a plurality of screens, is through the first view screen 10 of the first resolution, and the second content is the second view screen of the second resolution. Through 20, the third content may be displayed through the third view screen 30 of the third resolution, and the fourth content may be displayed through the fourth view screen 40 of the fourth resolution. The electronic device 100 may perform an operation for processing a content signal suitable for a screen having each resolution. For example, the electronic device 100 receives the first content having the first resolution or a resolution lower than the first resolution to display the first content on the first view screen of the first resolution, and the received first content By decoding the content using a decoder having the first resolution processing capability, it can be displayed on the first view screen of the first resolution. A decoder having a certain maximum resolution processing capability may receive and decode content less than or equal to the maximum resolution, but cannot decode content having a resolution exceeding the maximum resolution. For example, when the first view screen has 8K resolution, the electronic device 100 receives first content of 8K or 8K or less, and decodes the first content using a decoder having an 8K resolution processing capability to achieve 8K resolution. It can be displayed on the first view screen. A decoder with 8K resolution processing capability can process 8K or less than 8K content. Accordingly, a decoder having 8K resolution processing capability can decode 8K content, 4K content, and 2K content. For example, when the second view screen has a 2K resolution, the electronic device 100 may display the second content by decoding using a decoder having a 2K resolution. A decoder with 2K resolution cannot decode 4K or 8K content higher than 2K because it can decode content with 2K or less than 2K resolution.

Accordingly, when screen switching is performed between a plurality of screens in the multi-view mode, the resolution processing capability of the decoder corresponding to each screen is different, and thus management is required. For example, when switching between an 8K screen and a 2K screen, 2K content can be directly displayed on the 8K screen because it can be directly decoded using the 8K decoder, but it is difficult to decode the 8K content using the 2K decoder.

The present disclosure provides a method for more effectively providing screen switching in a multi-view mode.

The electronic device 100 may display a plurality of different contents through a plurality of screens in the multi-view mode. For example, referring to FIG. 2 , in the multi-view mode, the electronic device 100 displays 4 different screens through four screens, that is, a first view screen 10, a second view screen 20, a third view screen 30, and a fourth view screen 40. Content, first content, second content, third content, and fourth content may be displayed. For example, the first view screen 10 is a screen capable of displaying content with a maximum resolution of 8K, the second view screen 20 is a screen capable of displaying content with a maximum resolution of 2K, and the third view screens 30 and 4 The view screen 40 is a screen capable of displaying content of up to 4K resolution, respectively. The electronic device 100 decodes and displays the first content using the first decoder 921 having an 8K resolution processing capability, and decodes and displays the second content using the second decoder 922 having a 2K resolution processing capability, and displays a third The content may be decoded and displayed using the third decoder 923 having the 4K resolution processing capability, and the third content may be decoded and displayed using the fourth decoder 924 having the 4K resolution processing capability. Each decoder can process content below the maximum resolution that each decoder can process. Accordingly, the first decoder 921 having an 8K resolution processing capability can decode up to 8K content and content having a resolution lower than that, for example, 4K content and 2K content. In addition, the second decoder 922 having a 2K resolution processing capability can decode up to 2K content, and thus cannot decode 4K content or 8K content.

The electronic device 100 may provide switching between a plurality of screens provided in the multi-view mode. Screen switching refers to displaying the first content displayed on the first view screen by exchanging the second content displayed on the second view screen. That is, by switching between the first view screen displaying the first content and the second view screen displaying the second content, the first view screen displays the second content and the second view screen displays the first content. can indicate that Of course, screen switching between the second-view screen and the third-view screen, between the second-view screen and the fourth-view screen, and between the third-view screen and the fourth-view screen is also possible. However, since the main reason for screen switching is to be performed when a user desires to view content viewed on a small screen on a large screen, screen switching is mainly performed between screens with different resolutions or screens with different screen sizes. will be.

A user input instructing screen switching may be received in various forms. For example, a user input instructing screen switching may be received by various methods, such as a voice utterance, a gesture, a control button provided on a remote control device, or a user interface displayed on a display of the electronic device. For example, the electronic device 100 may display an item for screen switching for each screen constituting the multi-view and implement screen switching by selecting the item. For example, referring to FIG. 2 ,

control items

21, 31, and 41 such as <Move main screen> may be displayed on each of the second view screen 20, the third view screen 30, and the fourth view screen 40. According to a user input for selecting any one of the

control items

21, 31, and 41, the screen corresponding to the corresponding item and the main screen, that is, the first view screen 10 may be switched. For example, when the user wants to enjoy the second content viewed at 2K resolution on the second view screen 20 at a high resolution on the larger first view screen 10, select the <Move main screen> control item 21 displayed on the second view screen. You can choose. For example, when the user selects the <move main screen> control item 21 displayed on the second view screen using the pointer 70, the electronic device 100 displays the first content and the second view screen on the first view screen 10 The second content displayed at 20 may be exchanged for display.

According to an embodiment, the electronic device 100 may display the <single view switch> control item 11 on the screen for content that can be switched to a single view in a plurality of screens constituting the multi-view. For example, referring to FIG. 1 , if the first content displayed on the first view screen is the content that was received as an RF signal in the single view, the electronic device 100 places the <single view switch> control item at a predetermined position on the first view screen. 11, and according to a user input for selecting the control item 11, it is possible to switch to a mode in which the first content is displayed on a single full screen.

According to an embodiment, the electronic device 100 receives a screen switching input of a first view screen displaying first content of a first resolution and a second view screen displaying second content of a second resolution lower than the first resolution and the first content is displayed on the second view screen and the second content is displayed on the first view screen.

At this time, the electronic device 100 transmits the buffered second content directly to the first decoder 921 for the second content having the second resolution, which is a resolution lower than the first resolution, and decodes it by the first decoder to decode the first view screen 10 can be displayed in That is, even before the electronic device 100 requests and receives the second content of the first resolution from the server, the second content of the second resolution, which has already been buffered, is decoded by the first decoder to be displayed on the first view screen 10. can This is possible because the first decoder having the first resolution processing capability is capable of decoding content having a lower resolution than the first resolution. When displaying the second content on the first view screen, the electronic device 100 requests the second content of the first resolution from the server while displaying the buffered second content on the first view screen, When the second content is received, the received second content of the first resolution may be displayed on the first view screen by decoding it using the first decoder 921.

When the electronic device 100 displays the first content having the first resolution on the second view screen 20, the buffered first content of the first resolution is decoded using a decoder of the second resolution, which is a lower resolution than the first resolution. Since this is not possible, the electronic device 100 requests the first content of the second resolution from the server, and decodes the first content of the second resolution received from the server using the second decoder to display it on the second view screen. there is. If the buffered first content of the first resolution is directly transmitted to the second decoder, an error may occur due to input data that the second decoder cannot process. Accordingly, it is necessary for the electronic device 100 to discard the buffered first content of the first resolution and manage it so that it is not inputted to the second decoder.

In this way, when the screen switching request is received, in the case of the second content, the buffered second content can be directly decoded using the first decoder, so that it can be displayed on the first view screen immediately, whereas in the case of the first content , the buffered first content cannot be used, and after receiving the first content of the second resolution from the server, it can be displayed on the second view screen. Accordingly, a waiting time may occur until the first content is displayed on the second view screen.

According to an embodiment, the electronic device 100 may display a black image on the second view screen during a waiting time until the first content is displayed on the second view screen.

According to an embodiment, the electronic device 100 may display a still image of the first content on the second view screen during the waiting time by using some frames of the buffered first content.

As such, for screen switching, even if the first content to be displayed on the second view screen is not ready, the second content is displayed on the first view screen 10 at the time of the screen switching request, so that the second content is displayed on the first view screen may be displayed immediately at the time of the user's screen switching request. From the user's point of view, the main purpose of the screen switching request is to display the second content displayed on the second view screen on the first view screen 10, which is the main screen, so the display of the first content on the second view screen 20 is Even if it is not done immediately, the user's needs can be satisfied by displaying the second content directly on the first view screen.

According to another embodiment, the electronic device 100 displays the first content on the first view screen and the second content on the second view screen until the preparation of the first content to be displayed on the second view screen is completed. By maintaining the screen switching delay, the screen switching may be performed when all preparations for outputting the first content to be displayed on the second view screen are completed.

According to an embodiment, the electronic device 100 may output a user interface defining an action that can be performed on the corresponding content based on the attribute of the content displayed on each screen of the plurality of screens constituting the multi-view. For example, when the electronic device 100 analyzes a property of content displayed on each screen of a plurality of screens constituting the multi-view and confirms that the corresponding content can be received as an RF signal, the electronic device 100 performs the corresponding content A control item indicating that the corresponding screen can be converted into a single view can be output to a part of the screen on which is displayed. For example, referring to FIG. 2 , it is confirmed that the first content displayed on the first view screen can be received as an RF signal before screen switching, and the electronic device 100 displays <single view switch on a part of the first view screen 10 . > Control item 11 can be output. Since the first content is displayed on the second view screen after screen switching, the electronic device 100 may output the <single view switch> control item 22 to a part of the second view screen.

According to an embodiment, the electronic device 100 may output a user interface defining an action that can be performed on a corresponding screen based on a property of a screen displayed on each screen of a plurality of screens constituting a multi-view. For example, the electronic device 100 may output a user interface indicating that the main screen can be moved to the main screen for each screen of a plurality of screens constituting the multi-view and can be switched to the main screen. For example, for the second view screen, the third view screen, and the fourth view screen, the electronic device 100 displays <main screen Go to >

Control items

21, 31, and 41 can be output to the second view screen, the third view screen, and the fourth view screen, respectively.

Referring to FIG. 3 , the electronic device 100 may include a memory 110 and a processor 120 . However, the electronic device 100 may be implemented by more components than the illustrated components, and is not limited to the above-described example.

The memory 110 according to an embodiment may store a program for processing and controlling the processor 120 and may store data input to or output from the electronic device 100 .

The memory 110 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), and a RAM (RAM). , Random Access Memory SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, optical disk It may include at least one type of storage medium.

The processor 120 controls the overall operation of the electronic device 100 . For example, the processor 120 may perform the function of the electronic device 100 described in the present disclosure by executing one or more instructions stored in the memory 110 .

In an embodiment of the present disclosure, the processor 120 may execute one or more instructions stored in the memory 110 to control the above-described operations to be performed. In this case, the memory 110 may store one or more instructions executable by the processor 120 .

Also, in an embodiment of the present disclosure, the processor 120 stores one or more instructions in an internally provided memory and executes one or more instructions stored in an internally provided memory to control the above-described operations to be performed. That is, the processor 120 may perform a predetermined operation by executing at least one instruction or program stored in the internal memory or the memory 110 provided in the processor 120 .

Also, although one processor 120 is illustrated in FIG. 3 , a plurality of processors may be provided. In this case, each of the operations performed by the electronic device according to an embodiment of the present disclosure may be performed through at least one of a plurality of processors.

According to an embodiment, the processor 120 may output a first view screen capable of outputting content of a first resolution and content of a second resolution lower than the first resolution by executing one or more instructions stored in the memory 110. The first content is output through the first view screen of the multi-view screen including the second view screen, and the second content is output through the second view screen, and the first content and the second content are Upon receiving the screen switching request, the buffered second content of the second resolution is decoded using the first decoder corresponding to the first resolution, and outputted to the first view screen, and the second content corresponding to the second resolution is decoded. Upon requesting one content to the server and receiving the first content of the requested second resolution, the received first content of the second resolution is decoded using a second decoder corresponding to the second resolution. It can be output to the second view screen.

According to an embodiment, when the processor 120 executes one or more instructions stored in the memory 110, when outputting the first content to the second view screen, from the time of receiving the switching request to the second view screen During the waiting period until the time when the output preparation of the first content of the second resolution is completed, the buffered still image of the first content may be output on the second view screen.

According to an embodiment, by executing one or more instructions stored in the memory 110, the processor 120 prepares to output the first content of the second resolution to be output to the second view screen from the time when the switching request is received. During the waiting period up to the point in time, a black image may be output on the second view screen.

According to an embodiment, the processor 120 outputs the buffered second content of the second resolution to the first view screen at the time of receiving the switching request by executing one or more instructions stored in the memory 110 to the first view screen. The content and the second content may be controlled to be switched.

According to an embodiment, the processor 120, by executing one or more instructions stored in the memory 110, at the time when the switching request is received, requests the server for second content corresponding to the first resolution, and As the second content is received and the output of the buffered second content of the second resolution on the first view screen is completed, the received second content of the first resolution is converted into a second content corresponding to the first resolution. It can be decoded using a decoder and output to the first view screen.

According to an embodiment, the processor 120 executes one or more instructions stored in the memory 110, so that at a point in time when the output preparation of the first content of the second resolution to be output on the second view screen is completed, the second content may be output on the first view screen, and the first content of the second resolution may be output on the second view screen.

According to an embodiment, the processor 120 requests the server for second content corresponding to the first resolution of the first view screen at the time of receiving the switching request by executing one or more instructions stored in the memory 110, When the preparation for outputting the first content is completed, the second content of the first resolution received from the server may be output to the first view screen.

According to an embodiment, the processor 120 executes one or more instructions stored in the memory 110, so as to complete the preparation of the first content of the second resolution to be output on the second view screen, the first view screen may maintain the output of the first content, and maintain the output of the second content on the second view screen.

According to an embodiment, the processor 120 executes one or more instructions stored in the memory 110, thereby maintaining the output of the first content on the first view screen, while maintaining the output of the first content on the first view screen. The resolution may be controlled to be lowered from the first resolution to the second resolution.

The electronic device 100 may be any type of device that performs a function, including a processor and a memory. The electronic device 100 may be a fixed or portable device. For example, the electronic device 100 may include various electronic devices such as a desktop, a laptop computer, a computer such as a tablet, a television, a set-top box, a smartphone, a cellular phone, a game player, a music player, a video player, a medical device, and a home appliance. can The electronic autonomy 100 may also be referred to as a display device, a computing device, or a media device.

In FIG. 4 , the same configuration as in FIG. 3 is illustrated using the same reference numerals. Therefore, in describing the electronic device 100 , a description overlapping with that of FIG. 3 will be omitted.

Referring to FIG. 4 , the electronic device 100 includes, in addition to the memory 110 and the processor 120, a display 130, a video processing unit 135, an audio processing unit 145, an audio output unit 140, a communication unit 150, an antenna 155, a sensing unit 160, an input/output unit 180, and a user input unit 190 may be further included. The processor 120 may control each component of the electronic device 100 to perform an operation.

With respect to the memory 110 and the processor 120 , the same contents as those described with reference to FIG. 3 will be omitted from FIG. 4 .

The display 130 may display an image on the screen under the control of the processor 120 . The image displayed on the screen may be received from the communication unit 150, the input/output unit 180, and the memory 110.

The video processing unit 135 may process image data to be displayed by the display 130, and may perform various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, and resolution conversion on the image data.

According to an embodiment, the video processing unit 135 may configure the screen of the display 130 as a single view screen to display one video content.

According to an embodiment, the video processing unit 135 may configure the screen of the display 130 as a multi-view screen to display different video contents on a plurality of sub-screens constituting the multi-view screen.

According to an embodiment, the video processing unit 135 includes a playback pipeline module 900 as shown in FIGS. 9 and 12 to perform screen switching and adaptive streaming functions in a multi-view mode according to embodiments disclosed in the present disclosure. can do.

The audio processing unit 145 processes audio data. In the audio processing unit 145, various processes such as decoding, amplification, and noise filtering on audio data may be performed.

The audio output unit 140 may output audio included in a broadcast signal received under the control of the processor 120, audio input through the communication unit 150 or the input/output unit 180, and audio stored in the memory 110. The audio output unit 140 may include at least one of a speaker 141, a headphone output terminal 142, and a Sony/Philips Digital Interface (S/PDIF: output terminal 143).

The transmit/receive antenna 155 serves to receive signals transmitted by other devices or transmit signals to the other devices. Although the transmit/receive antenna 155 is illustrated as one, it can support a multiple input multiple output (MIMO) system by having a plurality of antennas.

The communication unit 150 may include one or more modules that enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network in which another electronic device is located. For example, the communication unit 150 may include a broadcast reception module 151 , a mobile communication module 152 , a wireless Internet module 153 , and a short-range communication module 154 . The communication unit 150 may be referred to as a transmitter/receiver.

The broadcast reception module 151 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

According to an embodiment, the broadcast reception module 151 may receive an RF signal under the control of the processor 120 for the electronic device 100 to display content in the single view mode.

The mobile communication module 152 transmits/receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 153 refers to a module for wireless Internet access, and may be built-in or external to the device. As wireless Internet technologies, wireless LAN (WLAN) (WiFi), wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), etc. may be used. The device may establish a Wi-Fi peer-to-peer (P2P) connection with another device through the wireless Internet module 153 .

According to an embodiment, the wireless Internet module 153 may receive a plurality of content streams from the server under the control of the processor 120 so that the electronic device 100 displays content in the multi-view mode.

The short-range communication module 154 refers to a module for short-distance communication. As short-distance communication technologies, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.

The sensing unit 160 detects a user's voice, a user's image, or a user's interaction, and may include a microphone 161, a camera unit 162, and a light receiving unit 163.

The microphone 161 receives the user's uttered voice. The microphone 161 may convert the received voice into an electrical signal and output it to the processor 120 .

The camera unit 162 may receive an image (eg, a continuous frame) corresponding to a user's motion including a gesture in a camera recognition range.

The light receiver 163 receives an optical signal (including a control signal) received from the remote control device. The light receiver 163 may receive an optical signal corresponding to a user input (eg, touch, press, touch gesture, voice, or motion) from the remote control device. A control signal may be extracted from the received optical signal under the control of the processor 120 .

The input/output unit 180 receives video (eg, moving picture, etc.), audio (eg, voice, music, etc.) and additional information (eg, EPG, etc.) from the outside of the electronic device 100 under the control of the processor 120 . receive etc. The input/output unit 180 may include one of an HDMI port (High-Definition Multimedia Interface port, 181, a component jack, 182), a PC port (PC port, 183), and a USB port (USB port, 184). The input/output unit 180 may include a combination of an HDMI port 181, a component jack 182, a PC port 183), and a USB port 184).

According to an embodiment, the HDMI port 181 may receive content from a set-top box or an external content providing device under the control of the processor 120 so that the electronic device 100 displays content in the single view mode.

The user input unit 190 means a means for a user to input data for controlling the electronic device 100 . For example, the user input unit 190 may include, but is not limited to, a key pad, a dome switch, a touch pad, a jog wheel, a jog switch, and the like.

The memory 110 according to an embodiment may store a program for processing and control of the processor 120 and may store data input to or output from the electronic device 100 . Also, the memory 110 may store data necessary for the operation of the electronic device 100 .

Also, the programs stored in the memory 110 may be classified into a plurality of modules according to their functions.

According to an embodiment, the memory 110 may include a multi-view manager 111 and a resource manager 112 .

When receiving a request for converting a single view into a multi-view, the multi-view manager 111 may divide the display screen into a plurality of screens and control and manage to display a plurality of contents on the divided screens.

The resource manager 112 communicates with the server to receive content information, and based on the received content information, requests a content stream signal suitable for the environment on each screen of the electronic device 100 from the server, and screen switching is performed in the multi-view mode. In this case, it may play a role of requesting the server to switch and send a content stream signal according to screen switching.

In FIG. 4 , the multi-view manager 111 and the resource manager 112 are implemented as software stored in the memory 110, but are not limited thereto, and the multi-view manager 111 and the resource manager 112 may be operated to perform the multi-streaming service function disclosed in the present disclosure. It may be implemented in any suitable combination of software, logic, circuitry, interfaces, and/or code.

The processor 120 controls the overall operation of the electronic device 100 and a signal flow between internal components of the electronic device 100, and performs a function of processing data. The processor 120 may execute an operating system (OS) and various applications stored in the memory 110 when there is a user input or a preset stored condition is satisfied.

In addition, the processor 120 may include an internal memory. In this case, at least one of data, programs, and instructions stored in the memory 110 may be stored in an internal memory (not shown) of the processor 120 .

Meanwhile, a block diagram of the electronic device 100 illustrated in FIGS. 3 to 4 is a block diagram for an exemplary embodiment. Each component of the block diagram may be integrated, added, or omitted according to specifications of the electronic device 100 that are actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. In addition, the function performed in each block is for describing the embodiments, and the specific operation or device does not limit the scope of the present invention.

Referring to FIG. 5 , in operation 510, the electronic device outputs the first content of the first resolution through the first view screen of the multi-view screen including at least the first view screen and the second view screen, and the second view screen It is possible to output the second content of the second resolution lower than the first resolution through .

In operation 520, upon receiving the request for switching between the first content and the second content, the electronic device decodes the buffered second content of the second resolution using the first decoder corresponding to the first resolution to decode the first view screen can be printed on

In operation 530, the electronic device requests the first content corresponding to the second resolution from the server, and as the first content of the requested second resolution is received, the electronic device converts the received first content of the second resolution to the second resolution. It can be decoded using a second decoder corresponding to , and outputted to the second view screen.

Referring to FIG. 6 , in operation 610, the electronic device 100 switches between a first view screen displaying first content and a second view screen displaying second content in a multi-view mode displaying content through a plurality of screens. request can be received.

According to an embodiment, the request for switching between screens may be received through various user interfaces.

For example, the electronic device 100 receives a user's voice utterance, for example, "switch the first view screen and the second view screen," through a microphone, etc., and recognizes the uttered voice to display the screen. A switching request may be received. For example, the electronic device 100 may receive such a voice utterance for the screen switching request through a voice service device communicating with the electronic device 100 .

For example, the electronic device 100 may receive a user's gesture through a camera or the like, and may receive a screen switching request by recognizing the received gesture.

For example, the electronic device 100 may manage property information of a corresponding screen for each screen of a plurality of screens constituting the multi-view, and output a user interface for selecting screen switching for each screen based on the property information. can

Referring to FIG. 7 , the electronic device 100 may display content in a multi-view mode including, for example, four screens. The four screens may have various sizes and arrangements, but in FIG. 7 , the first view screen 10 is one main screen, and the second view screen 20, the third view screen 30, and the fourth view screen 40 are smaller than the main screen. may include The electronic device 100 may output a control item to each screen constituting the multi-view based on attribute information corresponding to each screen.

According to an embodiment, the electronic device 100 may distinguish a main screen and a sub screen according to a size of a screen constituting a multi-view or a resolution of a screen constituting a multi-view, and whether the corresponding screen is the main screen for each screen. Attribute information indicating whether it is a sub screen can be managed. For example, in the multi-view mode shown in FIG. 7 , the largest screen, the first view screen, may have information indicating that it is the main screen as attribute information, and the second view screen to the fourth view screens that are small screens may have information indicating that the first view screen is the largest screen. , may have information indicating that it is a sub screen as attribute information. The electronic device 100 may output a control item based on attribute information corresponding to each of these screens. For example, since the electronic device 100 has information indicating that it is a sub screen as property information in the case of the second view screen, the electronic device 100 displays the second view screen 20 in order to indicate that the sub screen can be switched with the main screen. Control item 21 called <Move to main screen> can be output to some. Similarly, the electronic device may output the

control items

31 and 41 of <movement to main screen> for the third screen 30 and the fourth screen 40 as well. When a user input for selecting the control item 21 called <Move to main screen> of the second view screen 20 is received using the pointer 70, the electronic device 100 displays the second view screen 20 and the main screen from which the corresponding user input is received. An operation of switching the contents of the first view screen 10 that is a screen may be performed. As for the first view screen 10, which is the main screen, the first view screen 10 itself is the main screen, so the control item <Move to the main screen> is not displayed.

According to an embodiment, the electronic device 100 may display a control item based on a property of content displayed on each screen of a plurality of screens constituting the multi-view. For example, the electronic device 100 may identify whether the corresponding content is the content received through RF broadcasting or the content provided as an IP stream from the properties of the content displayed on the screen constituting the multi-view. When the property of the content is content provided only as an IP stream, it cannot be converted to a single view, but in the case of content received through RF broadcasting, the corresponding content can be converted to a single view. Accordingly, when the property of the content displayed on the screen constituting the multi-view indicates that the content is received through RF broadcasting, the electronic device 100 may output a control item for selecting single-view switching on the corresponding screen. Referring to FIG. 7 , when the property of the content displayed on the first view screen indicates that the content is received through RF broadcasting, the electronic device 100 outputs the <single view switch> control item 11 to a part of the first view screen 10. can In response to a user input of selecting the <single view conversion> control item 11 as described above, the electronic device 100 may convert the first content displayed on the first view screen into a single view full screen and display it.

Returning to FIG. 6 , in operation 620 , the electronic device 100 may determine that the resolution of the first-view screen is higher than the resolution of the second-view screen. Although it is possible for a screen switching request to be received on screens having the same resolution, a screen switching request will be mainly received between a main screen having a large screen size or high resolution and a sub screen having a small screen size or low resolution. In this case, a screen having a high resolution is usually a main screen, and a screen having a low resolution is a sub screen.

In the flowchart of FIG. 6 , 600A indicates an operation when switching the second content displayed on the second view screen to the first view screen, and 600B indicates that the first content displayed on the first view screen is switched to the second view screen indicates the action in the case.

An operation 600A of switching the second content displayed on the second view screen to the first view screen will be described.

In operation 630a, the electronic device 100 may display the second content on the first view screen by decoding the buffered second content using the first decoder corresponding to the first view screen. Since the buffered second content is a second resolution lower than the first resolution, the second content of the first resolution level is not directly output on the first view screen, but the first decoder is the content of the second resolution lower than the first resolution. Since it is possible to decode the second content buffered in this way, it is possible to directly display the second content on the first view screen without time delay by sending the buffered second content to the first decoder to decode it and output it on the first view screen.

In operation 640a, the electronic device 100 may request the second content of the first resolution from the server. The second content is displayed on the first view screen according to the screen switching. In this case, the first view screen has the capability to display the content up to the first resolution, so the electronic device 100 uses adaptive streaming to display the content. It may request the server to provide the second content of the first resolution higher than the second resolution.

In operation 650a, when the electronic device 100 receives the second content of the first resolution from the server, the electronic device 100 decodes the second content of the first resolution using the first decoder to display the second content on the first view screen. can be displayed

Now, an operation 600B of switching the first content displayed on the first view screen to the second view screen will be described.

In operation 630b, since the second decoder corresponding to the second view screen cannot decode content higher than its resolution, the second decoder corresponding to the second view screen directly receives the buffered first content of the first resolution. Unable to decode Accordingly, the electronic device 100 cannot directly display the first content on the second view screen, but may display a predetermined still image on the second view screen.

According to an embodiment, the electronic device 100 may display a black image as a predetermined image on the second view screen until the first content of the second resolution is prepared.

According to an embodiment, the electronic device 100 may output a still image based on the buffered frame of the first content as a predetermined image until the first content of the second resolution is prepared.

In operation 640b, the electronic device 100 may request the first content of the second resolution from the server. The first content is displayed on the second view screen according to the screen switching. In this case, the second view screen has the capability to display the content up to the second resolution, so the electronic device 100 uses the adaptive streaming to display the second resolution screen. 1You can request the server to provide the content.

In operation 650b, when the electronic device 100 receives the first content of the second resolution from the server, the electronic device 100 decodes the first content of the second resolution using the second decoder to display the first content on the second view screen. can be displayed

Referring to FIG. 8 , the electronic device 100 displays the first content on the first view screen 10 of the first resolution in the multi-view mode of the electronic device 100 before t1, which is the screen switching request time, that is, from t0 to t1. The second content may be displayed on the second view screen 20 of the second resolution, the third content may be displayed on the third view screen 30 of the third resolution, and the fourth content may be displayed on the fourth view screen 40 of the fourth resolution. The first view screen may correspond to the highest resolution as the main screen, and the second, third, and fourth view screens may correspond to a resolution lower than the first resolution. For example, the first resolution may be 8K, and the second and third resolutions may be resolutions lower than 8K, that is, 2K, 4K, or the like. For convenience of explanation, hereinafter, the second resolution will be described as 2K, the third resolution as 4K, and the fourth resolution as 4K. (800A)

When the electronic device 100 receives a screen switching request at time t1, for example, when a switching request between the first content of the first view screen and the second content of the second view screen is received, the electronic device 100 performs the first The content may be controlled to be displayed on the second view screen and the second content to be displayed on the first view screen. Since the 8K decoder corresponding to the first view screen can decode 8K or 8K or less content, the electronic device 100 directly decodes the buffered 2K second content with the 8K decoder, so that the decoded second content has a delay time It can be output to the first view screen 10 without Of course, since 2K content is displayed on the 8K first view screen, the resolution may be slightly lowered, but the time to output the buffered second content is not long, and the second content is displayed on the first view screen without delay from the user's point of view. Letting go can be important. Meanwhile, the electronic device 100 may request the 8K second content from the server using the adaptive streaming technology in order to output the second content that fits the 8K first view screen. Alternatively, since the currently buffered second content is 2K, the electronic device 100 may first request 4K second content from the server and then request 8K second content in order to improve resolution naturally. Accordingly, in response to a screen switching request, the electronic device 100 first outputs the buffered 2K second content to the 8K first view screen, and then outputs 4K second content and 8K second content while gradually increasing the resolution according to adaptive streaming. can do.

On the other hand, since the 2K decoder corresponding to the second view screen cannot decode content exceeding 2K, the buffered 8K first content cannot be transmitted to the 2K decoder. Accordingly, the electronic device 100 cannot display the first content on the second view screen until it requests and receives the first content of 2K, which is a resolution corresponding to the second view screen, from the server. Accordingly, the electronic device 100 outputs a still image based on some frames of the buffered first content on the second view screen until the output preparation of the first content is completed by requesting and receiving the first content of 2K from the server, or (800B), or a black image may be output on the second view screen. (800C)

That is, the electronic device 100 may output a still image or a black image of the first content on the second view screen from the time t1 of the screen switching request to t2, which is the time when the preparation for outputting the first content of the second resolution is completed.

And when the output preparation of the first content is completed by receiving the first content of the second resolution from the server at time t2 and decoding it with a decoder corresponding to the second view screen, the electronic device 100 displays the second resolution, that is, on the second view screen. 2K first content may be displayed.

Hereinafter, a specific example of the screen switching operation described with reference to FIGS. 6 and 8 will be described with reference to FIGS. 9 to 11 .

Referring to FIG. 9A , the display 130 of the electronic device 100 includes a plurality of screens according to the multi-view mode, for example, a first view screen 10 of 8K, a second view screen 20 of 2K, a third view screen 30 of 4K, A plurality of contents may be displayed on the 4K fourth view screen 40 .

The electronic device 100 may include a reproduction pipeline module 900 having a plurality of reproduction pipelines and a resource manager 112 to support multi-view.

The reproduction pipeline module 900 may include a reproduction pipeline corresponding to each screen of a plurality of screens constituting the multi-view. Each playback pipeline may include buffers, decoders, and scalers. Specifically, the first playback pipeline corresponding to the first view screen includes a first buffer 911, a first decoder 921, and a first scaler 931, and the second playback pipeline corresponding to the second view screen includes a second buffer 912, a second decoder 922, and a second scaler 932, and a third playback pipeline corresponding to the third view screen includes a third buffer 913, a third decoder 923, and a third scaler 933, and a fourth view screen The fourth reproduction pipeline corresponding to may include a fourth buffer 914 , a fourth decoder 924 , and a fourth scaler 934 .

In the multi-view mode, in the first playback pipeline corresponding to 8K, the first buffer 911 receives and stores the first content of 8K, the first decoder 921 reads and decodes the first 8K content stored in the first buffer 911, The first scaler 931 may scale and output the decoded first content. Similarly, in the second reproduction pipeline corresponding to 2K, the second buffer 912 receives and stores the second content of 2K, the second decoder 922 reads and decodes the 2K second content stored in the second buffer 912, and the second The scaler 932 may scale and output the decoded second content. Similarly, the third reproduction pipeline and the fourth reproduction pipeline may receive and process the 4K third content and the fourth content, respectively.

The resource manager 112 may include an adaptive streaming client 115 that performs an adaptive streaming function that controls the server to request and receive content suitable for each playback pipeline in the multi-view mode.

The server providing the adaptive streaming service provides a list of available content segment URLs to the client, and the adaptive streaming client 115 may request and receive a content segment suitable for the environment of the client based on this list. Such a list may include, for example, a Media Presentation Description (MPD) file in MPEG-DASH (Dynamic Adaptive Streaming of Video over HTTP).

Specifically, the adaptive streaming client 115 may obtain a list of contents provided by the server from the server. The list of content may include information about content attributes such as content availability, content type, time, resolution, minimum and maximum bandwidth, location on a network (content segment URL), access characteristics, and digital rights management (DRM). .

The adaptive streaming client 115 may select an appropriate content segment based on such a content list and may request the server to transmit the selected content segment. In addition, the adaptive streaming client may request the server to switch to receive a content segment with a higher bit rate or a lower bit rate according to changes in the environment or bandwidth environment of the client device even during content playback. .

9A, for example, the adaptive streaming client 115 requests a first content segment of 8K, a second content segment of 2K, a third content segment of 4K, and a fourth content segment of 4K to the server for implementation of the multi-view mode. can be received.

The server 200 stores a plurality of content, and may store content segments having different resolutions for each content. For example, the server 200

stores

8K, 4K, and 2K content segments for the first content 901, respectively, and similarly stores 8K, 4K 2K content segments for the second content 902, and the rest of the third content and the fourth content. can be saved When receiving a content request of a specific resolution from the adaptive streaming client 115, the server 800 may provide a content segment of the requested resolution to the electronic device 100 .

As shown in FIG. 9A , the electronic device 100 requests to switch the first view screen to the second view screen while displaying it in the multi-view mode including the 8K first view screen, the 2K second view screen, the 4K third screen, and the 4K fourth screen. Upon receiving , the adaptive streaming client 115 may request content having a resolution suitable for each screen from the server 200 in order to move the first content to the second view screen and the second content to the first view screen. That is, the adaptive streaming client 115 may request the server 200 by switching the first content from 8K to 2K and switching the second content from 2K to 8K.

In response to the screen switching request in FIG. 9A , the resource manager 112 switches the 2K second content stored in the second buffer 912 to the first decoder 921 so that the first decoder 921 decodes the 2K second content. The second content may be output on the view screen without delay. Since the first decoder 921 is an 8K decoder, it can decode 8K and content having a resolution of 8K or less.

In addition, in FIG. 9A , it is indicated that the second buffer 912 partially stores 8K second content as the resource manager requests the server.

Meanwhile, since the 8K second content stored in the first buffer 911 cannot be directly input to the second decoder 922, which is a 2K decoder, the 8K second content stored in the first buffer 911 has to be discarded as it is. In addition, a black image or a still image using some frames of the buffered first content may be output on the second view screen until the first 2K content is prepared.

Therefore, in the state shown in FIG. 9B , in response to a screen switching request, the electronic device 100 may display 2K second content on the first view screen, and a black image on the second view screen until the 2K first content is prepared Alternatively, a still image of the first content may be displayed.

Referring to FIG. 9C , the electronic device 100 may display the 8K second content on the first view screen by the first decoder 921 reading and decoding the 8K second content stored in the second buffer 912 . Also, the electronic device 100 may display the 2K first content on the second view screen by the second decoder 922 reading and decoding the 2K first content from the first buffer.

In the example shown in FIGS. 9A to 9C , it has been described that the resource manager immediately switches from 2K content to 8K content and requests the server in response to the screen switching request. According to another example, in response to the screen switching request, the resource manager switches the 2K second content to the 4K second content and makes a request to the server, and then gradually requests the 8K second content, so that the second content is transferred to the first view It is also possible to control the resolution to gradually increase when displayed on the screen.

The operation illustrated in FIG. 10 is mostly the same as the operation illustrated in FIG. 6 , except that operations 1030a and 1030b are different.

In the embodiment illustrated in FIG. 6 , when a screen switching request is received, the electronic device 100 is ready to output the first content of the second resolution to the second view screen in order to show an immediate response in response to the screen switching request. By outputting the second content of the second resolution to the first view screen, even before the change of the content, the content conversion was performed on the main screen of the electronic device 100 .

In the embodiment shown in FIG. 10 , when a screen switching request is received, the electronic device 100 is ready to output the first content of the second resolution to the second view screen instead of showing an immediate response in response to the screen switching request It maintains the current screen state for the time until it becomes available. Therefore, from the user's point of view, screen switching does not occur for a certain period of time after issuing a screen switching request command, and the current screen state, that is, a state in which the first content is displayed on the first view screen and the second content is displayed on the second view screen is maintained. do.

Referring to FIG. 10 , in operation 1030a, the electronic device may maintain displaying the first content on the first view screen until preparing to switch the first content to the second view screen. That is, since the second decoder cannot directly decode the first content of the first resolution corresponding to the second view screen, the first content of the second resolution that can be decoded by the second decoder is requested from the server and received. Until then, the state of displaying the first content of the first resolution on the first view screen may be maintained.

Similarly in operation 1030b, the electronic device 100 may maintain displaying the second content of the second resolution on the second view screen until the preparation for switching the first content to the second view screen is completed.

Referring to FIG. 11 , the electronic device 100 displays the first content on the first view screen 10 of the first resolution in the multi-view mode of the electronic device 100 before t1, which is the screen switching request time, that is, from t0 to t1. The second content may be displayed on the second view screen 20 of the second resolution, the third content may be displayed on the third view screen 30 of the third resolution, and the fourth content may be displayed on the fourth view screen 40 of the fourth resolution. The first view screen may correspond to the highest resolution as the main screen, and the second, third, and fourth view screens may correspond to a resolution lower than the first resolution. For example, the first resolution may be 8K, and the second and third resolutions may be resolutions lower than 8K, that is, 2K, 4K, or the like. For convenience of explanation, the second resolution will be described as 2K, the third resolution as 4K, and the fourth resolution as 4K below. (1100A)

When the electronic device 100 receives a screen switching request at time t1, for example, when receiving a request for switching between the first content of the first view screen and the second content of the second view screen, the electronic device 100 corresponds to the second view screen Since the 2K decoder cannot decode content exceeding 2K, the buffered first content of 8K cannot be directly sent to the 2K decoder. can keep That is, during the time period between time t1 and time t2, that is, during the time from receiving the 2K first content until the output preparation is completed, the electronic device 100 displays the first content on the first view screen and displays the second view A state of displaying the second content on the screen may be maintained.

Meanwhile, the electronic device 100 may request the 8K second content from the server using the adaptive streaming technology in order to output the second content that fits the 8K first view screen. In addition, the electronic device 100 may request the 2K first content from the server using the adaptive streaming technology in order to output the first content suitable for the 2K second view screen.

And when the 2K first content is received from the server at the time t2 and output preparation is completed, then the electronic device decodes the 8K second content with a decoder corresponding to the first view screen to display the second content on the first view screen and decoding the 2K first content with a decoder corresponding to the second view screen to display the first content on the second view screen.

12A, for example, the adaptive streaming client 115 requests a first content segment of 8K, a second content segment of 2K, a third content segment of 4K, and a fourth content segment of 4K to the server for implementation of the multi-view mode. can be received.

As shown in FIG. 12A , the electronic device 100 requests to switch between the first view screen and the second view screen while displaying in the multi-view mode including the 8K first view screen, the 2K second view screen, the 4K third screen, and the 4K fourth screen. Upon receiving , the adaptive streaming client 111 may request content having a resolution suitable for each screen from the server 200 in order to move the first content to the second view screen and the second content to the first view screen. That is, the adaptive streaming client 115 may request the server 200 by switching the first content from 8K to 2K and switching the second content from 2K to 8K.

In response to this request, the server 200 may switch and transmit the first content from 8K to 2K, and may switch and transmit the second content from 2K to 8K. In the example shown in FIG. 12A , it is indicated that the 2K first content received from the server 200 is stored in a part of the first buffer 911 and that the 8K second content is stored in a part of the second buffer 912 .

In the example shown in FIG. 12A , unlike the example shown in FIG. 9B , the electronic device 100 does not immediately switch and display the second content to the first view screen at the time of the screen switching request, but the electronic device 100 displays the current state That is, the operation of decoding the 8K first content by the first decoder 921 and displaying it on the first view screen, and decoding the 2K second content by the second decoder 922 and displaying it on the second view screen can be maintained. In this way, the first view screen is not displayed by switching the second content immediately when the screen switching request is received from the user, but it is possible to prevent the black image from being output to the second view screen.

Referring to FIG. 12B , since the first buffer 911 is filled with all the 2K first content and now the 2K first content is ready to be decoded by the second decoder 922, the second decoder 922 transmits the 2K first content. By reading from the first buffer and decoding, it is possible to display the first content of 2K on the second view screen. Also, the first decoder 921 may display the 8K second content on the first view screen by reading and decoding the 8K second content stored in the second buffer 912 .

Some embodiments may also be implemented in the form of a recording medium containing instructions executable by a computer, such as program modules to be executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The disclosed embodiments may be implemented as a S/W program including instructions stored in a computer-readable storage medium.

The computer may include an electronic device according to the disclosed embodiments as a device capable of calling a stored instruction from a storage medium and operating according to the called instruction according to the disclosed embodiment.

The computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not include a signal and is tangible, and does not distinguish that data is semi-permanently or temporarily stored in the storage medium.

In addition, the control method according to the disclosed embodiments may be provided included in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities.

The computer program product may include a S/W program and a computer-readable storage medium in which the S/W program is stored. For example, the computer program product may include a product (eg, a downloadable app) in the form of a S/W program distributed electronically through a device manufacturer or an electronic market (eg, Google Play Store, App Store). . For electronic distribution, at least a portion of the S/W program may be stored in a storage medium or may be temporarily generated. In this case, the storage medium may be a server of a manufacturer, a server of an electronic market, or a storage medium of a relay server temporarily storing a SW program.

The computer program product, in a system consisting of a server and a device, may include a storage medium of the server or a storage medium of the device. Alternatively, when there is a server or a third device (eg, a smart phone) that is communicatively connected to the device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include the S/W program itself transmitted from the server to the device or the third apparatus, or transmitted from the third apparatus to the device.

In this case, one of the server, the device and the third apparatus may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of a server, a device, and a third apparatus may execute a computer program product to distribute the method according to the disclosed embodiments.

For example, a server (eg, a cloud server or an artificial intelligence server, etc.) may execute a computer program product stored in the server to control a device communicatively connected with the server to perform the method according to the disclosed embodiments.

As another example, the third apparatus may execute a computer program product to control a device communicatively connected with the third apparatus to perform the method according to the disclosed embodiment. When the third device executes the computer program product, the third device may download the computer program product from the server and execute the downloaded computer program product. Alternatively, the third device may execute the computer program product provided in a preloaded state to perform the method according to the disclosed embodiments.

Also, in this specification, "unit" may be a hardware component such as a processor or circuit, and/or a software component executed by a hardware component such as a processor.

The description of the present disclosure described above is for illustration, and those of ordinary skill in the art to which the present disclosure pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present disclosure is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present disclosure. do.

Claims

In an electronic device,

communication interface;

a memory storing one or more instructions; and

A processor for executing one or more instructions stored in the memory;

The processor, by executing the one or more instructions,

The first view screen by executing a multi-view function of simultaneously displaying a first view screen capable of outputting content of a first resolution and a second view screen capable of outputting content of a second resolution lower than the first resolution Receives a view screen switching request between the first content and the second content while outputting the first content of the first resolution and outputting the second content of the second resolution on the second view screen,

Upon receiving the view screen switching request, the buffered second content of the second resolution is decoded using the first decoder corresponding to the first view screen and outputted to the first view screen,

The first content of the second resolution is requested from the server instead of the first content of the first resolution, and the received first content of the second resolution is decoded with a second decoder corresponding to the second view screen, and the second view An electronic device that outputs to the screen.
According to claim 1,

The processor, by executing the one or more instructions,

During the period from the time of receiving the switching request to the time when the output preparation for outputting the first content of the second resolution to be output to the second view screen is completed, the buffered still image of the first content of the first resolution is displayed. An electronic device that outputs to the second view screen.
3. The method of claim 2,

The processor, by executing the one or more instructions,

Outputting a black image to the second view screen during a period from the time when the switching request is received until the time when the output preparation for outputting the first content of the second resolution to the second view screen is completed Device.
According to claim 1,

The processor, by executing the one or more instructions,

Controlling the switching of the first content and the second content to be performed by outputting the buffered second content of the second resolution to the first view screen when the switching request is received.
5. The method of claim 4,

The processor, by executing the one or more instructions,

Upon receiving the switching request, the server receives the second content of the first resolution by requesting the second content of the first resolution,

The received second content of the first resolution is decoded with a first decoder corresponding to the first view screen, and the second content of the first resolution is displayed following the display of the second content of the second resolution. An electronic device that outputs to a one-view screen.
According to claim 1,

The processor, by executing the one or more instructions,

When the preparation for outputting the first content of the second resolution to be output to the second view screen is completed, the second content of the first resolution is output to the first view screen, and the second content of the second resolution is outputted to the first view screen. An electronic device for outputting one content to the second view screen.
7. The method of claim 6,

The processor, by executing the one or more instructions,

When the switching request is received, the second content of the first resolution of the first view screen is requested to the server and received, and when the output preparation of the first content of the second resolution is completed, the received An electronic device that outputs second content of a first resolution to the first view screen.
8. The method of claim 7,

The processor, by executing the one or more instructions,

Until the time when the preparation of the first content of the second resolution to be output on the second view screen is completed, the output of the first content of the first resolution is maintained on the first view screen, and the second view screen To maintain the output of the second content of the second resolution, the electronic device.
9. The method of claim 8,

The processor, by executing the one or more instructions,

while maintaining the output of the first content on the first view screen, control to lower the resolution of the first content output on the first view screen from the first resolution to the second resolution.
A method of operating an electronic device, comprising:

The first view screen by executing a multi-view function that simultaneously displays a first view screen capable of outputting content of a first resolution and a second view screen capable of outputting content of a second resolution lower than the first resolution outputting the first content of the first resolution and outputting the second content of the second resolution on the second view screen, receiving a view screen switching request between the first content and the second content;

In response to receiving the view screen switching request, decoding the buffered second content of the second resolution using the first decoder corresponding to the first view screen and outputting it to the first view screen, and

The first content of the second resolution is requested from the server instead of the first content of the first resolution, and the received first content of the second resolution is decoded with a second decoder corresponding to the second view screen, and the second view A method of operating an electronic device, comprising outputting to a screen.
11. The method of claim 10,

During the period from the time of receiving the switching request to the time when the output preparation for outputting the first content of the second resolution to be output to the second view screen is completed, the buffered still image of the first content of the first resolution is displayed. The method of operating an electronic device, further comprising outputting the second view screen.
12. The method of claim 11,

Outputting a black image to the second view screen during the period from the time the switching request is received until the time when the output preparation for outputting the first content of the second resolution to the second view screen is completed Further comprising, a method of operating an electronic device.
13. The method of claim 12,

The method further comprising controlling the switching of the first content and the second content to be performed by outputting the buffered second content of the second resolution to the first view screen when the switching request is received; How the device works.
14. The method of claim 13,

receiving the second content of the first resolution by requesting the second content of the first resolution from the server at the time of receiving the switching request; and

The received second content of the first resolution is decoded with a first decoder corresponding to the first view screen, and the second content of the first resolution is displayed following the display of the second content of the second resolution. The method of operating an electronic device, further comprising outputting the one-view screen.
A computer-readable recording medium in which one or more programs to be executed by a processor of an electronic device are recorded for implementing the method of operating an electronic device, the method of operating the electronic device comprising:

The first view screen by executing a multi-view function of simultaneously displaying a first view screen capable of outputting content of a first resolution and a second view screen capable of outputting content of a second resolution lower than the first resolution outputting the first content of the first resolution and outputting the second content of the second resolution on the second view screen, the operation of receiving a view screen switching request between the first content and the second content.

In response to receiving the view screen switching request, decoding the buffered second content of the second resolution using the first decoder corresponding to the first view screen and outputting it to the first view screen, and

The first content of the second resolution is requested from the server instead of the first content of the first resolution, and the received first content of the second resolution is decoded with a second decoder corresponding to the second view screen, and the second view A computer-readable recording medium comprising an operation of outputting to a screen.