KR20210005832A - Method for outputting screen and display device for executing the same - Google Patents

Abstract

Provided are a method for outputting a screen and a display device for performing the same. According to one embodiment of the present invention, the display device comprises: a sensing unit sensing the running of an application or sensing the connection with a mobile device in which the application is run; and an input/output unit separating a component area disposed inside an application screen related to a currently running application from the application screen to dispose the component area outside the application screen and outputting an extended screen including the application screen from which the component area is removed and the component area disposed outside.

Description

Screen output method and display device for performing it {METHOD FOR OUTPUTTING SCREEN AND DISPLAY DEVICE FOR EXECUTING THE SAME}

The disclosed embodiments relate to a technology for outputting an application screen.

In recent years, as the spread of mobile devices such as smart phones and tablet PCs is accelerated, the use of online game services using the mobile devices is also increasing. However, in the case of a mobile device such as a smartphone, it is inconvenient for a user to play an online game due to the limitation of the screen size. In particular, in the case of an online game that requires a lot of input, this inconvenience becomes even greater. In addition, as the number of component areas such as a menu window, a chat window, and a skill window in the game screen increases, the user may have difficulty concentrating on various situations and functions of the online game.

Korean Patent Application Publication No. 10-2017-0103378 (2017.09.13)

According to an embodiment, there is provided a sensing unit that detects driving of an application or a connection with a mobile device on which the application is driven; And the component area disposed inside the application screen related to the currently running application is separated from the application screen and placed outside the application screen, and the application screen from which the component area is removed and an extended screen including the component area disposed outside are displayed. A display device is provided that includes an input/output unit to output, and the input/output unit configures a second screen layout corresponding to an extended screen from a first screen layout corresponding to an application screen from which a component area is not removed.

The first screen layout may be provided on the set first layer panel, and the second screen layout may be provided on the second layer panel positioned above the first layer panel.

The input/output unit may configure a second screen layout by receiving at least one of a plurality of component areas arranged inside the application screen from the user, and receiving at least one of an arrangement position and size of each of the selected component areas from the user.

The placement position of each component area is preset for each component area, and the input/output unit receives the placement location of the component area by a user's touch command, and inputs when the placement location of the input component area deviates from the preset placement location. The placement position of the component area can be corrected to a preset placement position.

The input/output unit may detect a user's input in the component area disposed outside the application screen on the extended screen.

The display device may further include an interface unit that transmits location information of a point in the component area where a user's input is sensed to the mobile device.

The display device may be a touch beam projector that projects a laser beam to form a screen on the outside and senses a touch input on the screen through a sensor provided therein.

The display device may be a display panel equipped with a touch sensor.

According to another embodiment, a method for outputting a screen performed on a display device may include: detecting driving of an application or detecting a connection with a mobile device on which the application is driven; Separating the component area disposed inside the application screen related to the currently running application from the application screen and disposing it outside the application screen; And outputting the application screen from which the component area has been removed and the extended screen including the component area disposed outside, and the operation of separating the component area from the application screen and placing it outside the application screen, the component area is removed. A screen output method of configuring a second screen layout corresponding to an extended screen from a first screen layout corresponding to an unused application screen is provided.

The first screen layout may be provided on the set first layer panel, and the second screen layout may be provided on the second layer panel positioned above the first layer panel.

In the operation of separating the component area from the application screen and placing it outside the application screen, the user selects one or more of the plurality of component areas placed inside the application screen, and one or more of the placement positions and sizes of each selected component area The second screen layout may be configured by receiving input from the user.

The arrangement position of each component area is set in advance for each component area, and the operation of separating the component area from the application screen and placing it outside the application screen receives the location of the component area by a user's touch command and inputs When the arrangement position of the configured component area deviates from the preset arrangement position, the arrangement position of the input component region may be corrected to the pre-set arrangement position.

The screen output method may further include an operation of detecting a user's input within a component area disposed outside the application screen on the extended screen.

The screen output method may further include an operation of transmitting location information of a point within a component area where a user's input is sensed to the mobile device.

According to another embodiment, one or more processors; And one or more input/output devices, wherein the at least one processor detects driving of an application or a connection to a mobile device on which the application is driven, and the at least one input/output device is located inside an application screen related to the currently running application. The deployed component area is separated from the application screen and placed outside the application screen, and the application screen from which the component area has been removed and the extended screen including the externally placed component area are output, but the component area is separated from the application screen to be applied. A display device is provided that configures a second screen layout corresponding to an extended screen from a first screen layout corresponding to an application screen in which a component area has not been removed in the arrangement outside the screen.

1 is an example of an application screen and a component area output from a mobile device according to an embodiment.
2 is an example of a screen output system according to an embodiment.
3 is an example of an extended screen according to an embodiment.
4 is an example of a screen output system according to another embodiment.
5 is a block diagram showing a detailed configuration of a display device according to an exemplary embodiment.
6 is a flowchart of a method for outputting a screen according to an exemplary embodiment.
7 is a block diagram illustrating and describing a computing environment including a computing device suitable for use in example embodiments.

Hereinafter, a specific embodiment will be described with reference to the drawings. The following detailed description is provided to aid in a comprehensive understanding of the methods, devices, and/or systems described herein. However, this is only an example and is not limited thereto.

In describing the embodiments, when it is determined that a detailed description of a related known technology may unnecessarily obscure the subject matter of the invention, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions and may vary according to the intention or custom of users or operators. Therefore, the definition should be made based on the contents throughout this specification. The terms used in the detailed description are only for describing the embodiments, and should not be limiting. Unless explicitly used otherwise, expressions in the singular form include the meaning of the plural form. In this description, expressions such as "comprising" or "feature" are intended to refer to certain features, numbers, steps, actions, elements, some or combination thereof, and one or more other than those described. It should not be construed to exclude the presence or possibility of other features, numbers, steps, actions, elements, any part or combination thereof.

Hereinafter, "game" means software that one or more gamers can enjoy using an input device mounted on or connected to a gaming device. Usually, the player character is directly manipulated or the movement of objects in the game is manipulated, and the genre is divided into role-playing, adventure, and arcade.

Hereinafter, “gaming device” refers to hardware that executes game software, performs an operation according to a user's input through an input device, and outputs a result through an output device. For example, Personal Computer, Laptop Computer, Game Console, Smart Phone, Tablet PC, Smart Band or Smart Watch, etc. It may be in the form of a wearable device. In addition, any hardware that satisfies the above definition is interpreted as belonging to a gaming device.

Hereinafter, the term "online game" means a game that must be passed through a network in order to play the game. Usually, it means a game in which two or more gaming devices in a remote location are connected to each other through a network or synchronized through a server. If it satisfies the above definition, there is no restriction on the type of gaming device that executes the game. In addition to games running on personal computers or game consoles, games running on mobile devices such as smartphones, or games running in the cloud or in conjunction with a plurality of different gaming devices (including different types of gaming devices) are also mentioned above. Anything that satisfies the definition is interpreted as belonging to an online game.

Hereinafter, the "input device" refers to a device for inputting data to a gaming device. For example, a joystick, a mouse, a keyboard, a touch screen, a hardware button or an input device exclusively for game operation manufactured in the form of a steering wheel, a musical instrument, a gun, gloves, or a footrest. In addition, various sensors (temperature sensor, infrared sensor, motion sensor, gyro sensor, acceleration sensor, gravity sensor, etc.) mounted or interlocked with gaming devices, global positioning system (GPS), indoor positioning system ), etc. may also be an example of an input device.

Hereinafter, "OutputDevice" means a device for displaying the operation result of the gaming device. The calculation result is displayed in a form that can be recognized using the human five senses. The display is not necessarily visually or audibly displayed, and may be displayed in an olfactory or tactile form. For example, typical hardware such as speakers, monitors, and head-mounted displays satisfy the above definition, but a device that outputs in a tactile form, such as a 3D printer, or generates vibration, fragrance, and wind, may also be an example of an output device. .

The input device and the output device may be included in the gaming device as an element of the gaming device, or may be connected to the gaming device through a separate wired or wireless interface.

1 is an example of an application screen 100 and a component area 110 output from a mobile device (not shown) according to an embodiment.

In the present embodiments, the mobile device is a device on which an application is driven, and may be, for example, a smartphone, a tablet PC, or a laptop. Also, an application is a computer program that provides a specific service to a user or helps to perform a function related to the service. Here, the service may be, for example, an online game service, an instant message service, or the like, but the type of the service is not particularly limited. Hereinafter, for convenience of description, it is assumed that the service is an online game service.

The mobile device may output an application screen 100 related to the application by driving an application provided therein according to a user's command. Referring to FIG. 1, the application screen 100 may be, for example, a game screen. In this case, a plurality of component areas 110 such as a menu window, a chat window, a skill window, a status window, and a quest window may be disposed inside the application screen 100. The number and type of the component areas 110 may vary depending on the type of service provided by the application, the application screen 100 currently being output, and the like.

As an example, the user may play an online game while staring at the application screen 100, and may enter the component area 110 as necessary to execute various additional functions related to the online game. In this case, the user may execute a function corresponding to the component area 110 by touching the component area 110.

However, in the case of such a mobile device, there is a problem that the screen size is small and user input is inconvenient due to this, and as a plurality of component areas 110 exist in the above-described application screen 100, the user completely concentrates on the application screen 100. There is a problem that is difficult to do.

Hereinafter, a screen output method capable of improving the concentration of a user related to a service provided by the application will be described in detail with reference to FIGS. 2 to 6.

2 is an example of a screen output system according to an embodiment. As shown in FIG. 2, a screen output system according to an embodiment includes a display device 200 and a mobile device 300. As described above, the mobile device 300 may output the application screen 100.

The display device 200 interworks with the mobile device 300 to transmit and receive application-related information, and output a screen related to a service provided by the application.

In an embodiment, the display apparatus 200 may be a touch beam projector that forms a screen on the outside by projecting a laser beam, and senses a touch input on the screen through a sensor provided therein. The display device 200 may sense a touch input on the screen by recognizing motion on the screen while scanning at 60 frames per second through an infrared sensor built in, for example, a part that sees a laser beam. . Accordingly, the user can directly touch the screen while gazing at the screen formed by the laser beam to execute additional functions related to the service.

In this case, the display device 200 may output an extended screen instead of the application screen 100 on the screen so as to improve the user's concentration.

Specifically, the display device 200 separates the component area 110 disposed inside the application screen 100 related to the currently running application from the application screen 100 and arranges it outside the application screen 100, An application screen 100 from which the component area 110 has been removed and an extended screen including the externally disposed component area 110 may be output.

To this end, the display device 200 may configure a second screen layout corresponding to the extended screen from the first screen layout corresponding to the application screen 100 from which the component area 110 has not been removed, and when outputting the screen The extended screen corresponding to the second screen layout may be output without loading the application screen 100 corresponding to the first screen layout as it is.

As an example, the display device 200 may output the extended screen when detecting a connection with the mobile device 300 on which the application is driven. As another example, the display device 200 outputs the application screen 100 corresponding to the first screen layout as it detects the connection with the mobile device 300 on which the application is driven, and displays the first screen according to the user's screen switching command. The application screen 100 corresponding to the screen layout may be converted to an extended screen corresponding to the second screen layout.

In addition, the user may directly set the second screen layout by customizing the arrangement position or size of the component area 110 on the screen output from the display apparatus 200.

3 is an example of an extended screen 120 according to an embodiment. Here, it is assumed that eight component A regions 110 to H component regions 110 are disposed inside the initial application screen 100 (ie, an application screen corresponding to the first screen layout).

The display device 200 receives one or more of the plurality of component areas 110 arranged inside the application screen 100 from the user, and selects one or more of the placement positions and sizes of each of the selected component areas 110 from the user. The second screen layout can be configured by receiving input. As an example, a user selects a specific component area 110 by touching a specific component area 110 on a screen output from the display device 200, and a desired location for the specific component area 110 while touching the specific component area 110 By dragging to, a second screen layout can be configured.

Referring to FIG. 3, a user configures a second screen layout by disposing a component B area, a component C area, and a component H area outside the application screen 100, respectively, and adjusting the size of the component areas. In this case, the B component area, C component area, and H component area are removed from the inside of the application screen 100 according to the newly configured second screen layout.

The display device 200 may output an extended screen corresponding to the second screen layout set by the user. In this case, the user gazes at the application screen 100 with a larger screen and at the same time By manipulating the component area 110 in, it is possible to focus more on various situations and functions in the application screen 100.

In addition, for each component area 110, an arrangement position of each component area 110 may be preset. In this case, the display apparatus 200 may receive an arrangement position of the component region 110 by a user's touch command, but if the arrangement position of the input component region 110 deviates from the preset arrangement position, the input The arrangement position of the component area 110 may be corrected to the predetermined arrangement position.

Meanwhile, the first screen layout and the second screen layouts customized by a user or preset by an administrator may be stored in an internal database (not shown) of the display apparatus 200. In this case, the first screen layout may be provided on the set virtual first layer panel, and the second screen layout may be provided on the second layer panel positioned above the first layer panel. That is, the first screen layout and the second screen layout may be sequentially accumulated in the form of a layer. The user may newly configure a new second screen layout from the first layer panel, and may change or newly configure the second screen layout from the already configured second layer panel.

The display device 200 may output an extended screen corresponding to the second screen layout configured as described above, and detect a user's input in the component area 110 disposed outside the application screen 100 on the extended screen. . Here, the user's input may be, for example, a user's touch input, but is not limited thereto. The display device 200 may detect a user input from the mobile controller by interlocking the extended screen with a separate mobile controller (not shown), for example.

Thereafter, the display apparatus 200 may transmit location information of a point in the component area 110 in which a user's input is sensed to the mobile device 300. In this case, a function corresponding to the component area 110 may be executed based on the location information on an application installed in the mobile device 300.

4 is an example of a screen output system according to another embodiment. here,

Referring to FIG. 4, the display apparatus 200 has an application therein, and after detecting the driving of the application, outputs a screen related to a service provided by the application. Unlike the previous embodiment, the display device 200 itself includes an application and an operating system (OS) for driving the application, so that interlocking with the mobile device 300 is unnecessary.

As an example, the display device 200 may be a display panel equipped with a touch sensor. The display apparatus 200 may output the above-described extended screen and sense a touch input on the extended screen through a touch sensor provided therein. Since the method of configuring the extended screen and the method of outputting it is the same as described above, a detailed description thereof will be omitted here.

5 is a block diagram showing a detailed configuration of the display apparatus 200 according to an exemplary embodiment. As shown in FIG. 5, the display apparatus 200 according to an embodiment includes a sensing unit 202, an input/output unit 204, and an interface unit 206.

In one embodiment, the sensing unit 202, the input/output unit 204, and the interface unit 206 are implemented using one or more physically separated devices, or implemented by one or more processors or a combination of one or more processors and software. In contrast to the illustrated example, specific operations may not be clearly distinguished.

The sensing unit 202 detects the driving of the application or detects a connection with the mobile device 300 in which the application is driven. As an example, when the display device 200 itself includes an application and an operating system (OS) for driving the application, the detection unit 202 may detect the driving of the application installed on the display device 200. have. As another example, when the display device 200 operates in conjunction with the mobile device 300, the detection unit 202 may detect a connection with the mobile device 300 on which the application is driven.

The input/output unit 204 separates the component area 110 arranged inside the application screen 100 related to the currently running application from the application screen 100 and arranges it outside the application screen 100, and the component area ( The application screen 100 from which 110) is removed and the extended screen including the component area 110 disposed outside are output. Specifically, the input/output unit 204 may configure a second screen layout corresponding to the extended screen from the first screen layout corresponding to the application screen 100 from which the component area 110 has not been removed, and when outputting the screen The extended screen corresponding to the second screen layout may be output without loading the application screen 100 corresponding to the first screen layout as it is. In this case, the input/output unit 204 outputs the application screen 100 corresponding to the first screen layout and then transfers the application screen 100 corresponding to the first screen layout to the second screen layout according to the user's screen switching command. The extended screen corresponding to the second screen layout may be immediately output by switching to a corresponding extended screen or detecting driving of the application or connection with the mobile device 300 on which the application is driven.

In addition, the user may directly set the second screen layout by customizing the arrangement position or size of the component area 110 on the screen output from the display apparatus 200. Specifically, the input/output unit 204 receives one or more of the plurality of component regions 110 arranged inside the application screen 100 from the user, and one or more of the arrangement positions and sizes of the selected component regions 110 The second screen layout may be configured by receiving input from the user.

In this case, an arrangement position of each component region may be preset for each component region. The input/output unit 204 receives an arrangement position of the component region 110 by a user's touch command, and when the arrangement position of the input component region 110 deviates from the preset arrangement position, the input component region 110 The arrangement position of the can be corrected to the pre-set arrangement position.

Also, the input/output unit 204 may detect a user's input within the component area 110 disposed outside the application screen 100 on the extended screen.

The interface unit 206 communicates with the mobile device 300 to transmit and receive information related to an application. The interface unit 206 may include a wireless communication module such as a Bluetooth module or a Wi-Fi module, and may be connected to the mobile device 300 through the wireless communication module to transmit and receive application-related information.

As an example, when the display device 200 is connected to the mobile device 300, the interface unit 206 provides driving information of the application from the mobile device 300 (for example, the current mobile device 300 Screen information, location information of each component area in the screen, etc.) can be received.

In addition, when the input/output unit 204 detects a user's input in the component area 110 disposed outside the application screen 100 on the extended screen, the interface unit 206 is a component in which the user's input is detected. Location information of a point in the area 110 may be transmitted to the mobile device 300.

6 is a flowchart of a method for outputting a screen according to an exemplary embodiment. The method illustrated in FIG. 6 may be performed, for example, by the display apparatus 200 described above. Meanwhile, in the flowchart illustrated in FIG. 6, the method is described by dividing the method into a plurality of operations, but at least some operations are performed in a different order, combined with other operations, performed together, omitted, or divided into detailed operations. Or, one or more operations not shown may be added and performed.

In operation 602, the display device 200 detects a connection with the mobile device 300. If the display device 200 itself includes an application and an operating system (OS) for driving the application, the display device 200 may detect driving of an application installed therein.

In operation 604, the display device 200 separates the component area 110 disposed inside the application screen 100 related to the currently running application from the application screen 100 and arranges it outside the application screen 100. , The application screen 100 from which the component area 110 has been removed and the extended screen including the externally disposed component area 110 are displayed.

In operation 606, the display device 200 detects a user's input in the component area 110 disposed outside the application screen 100 on the extended screen.

In operation 608, the display device 200 transmits location information of a point in the component area 110 where a user's input is sensed to the mobile device 300.

7 is a block diagram illustrating and describing a computing environment including a computing device suitable for use in example embodiments. In the illustrated embodiment, each component may have different functions and capabilities in addition to those described below, and may include additional components in addition to those not described below.

The illustrated computing environment 10 includes a computing device 12. In one embodiment, the computing device 12 may be one or more components included in the display device 200 or the mobile device 300.

The computing device 12 includes at least one processor 14, a computer-readable storage medium 16 and a communication bus 18. The processor 14 may cause the computing device 12 to operate according to the exemplary embodiments mentioned above. For example, the processor 14 may execute one or more programs stored in the computer-readable storage medium 16. The one or more programs may include one or more computer-executable instructions, and the computer-executable instructions are configured to cause the computing device 12 to perform operations according to an exemplary embodiment when executed by the processor 14 Can be.

The computer-readable storage medium 16 is configured to store computer-executable instructions or program code, program data, and/or other suitable form of information. The program 20 stored in the computer-readable storage medium 16 includes a set of instructions executable by the processor 14. In one embodiment, the computer-readable storage medium 16 includes memory (volatile memory such as random access memory, nonvolatile memory, or a suitable combination thereof), one or more magnetic disk storage devices, optical disk storage devices, flash It may be memory devices, other types of storage media that can be accessed by computing device 12 and store desired information, or a suitable combination thereof.

The communication bus 18 interconnects the various other components of the computing device 12, including the processor 14 and computer-readable storage medium 16.

Computing device 12 may also include one or more input/output interfaces 22 and one or more network communication interfaces 26 that provide interfaces for one or more input/output devices 24. The input/output interface 22 and the network communication interface 26 are connected to the communication bus 18. The input/output device 24 may be connected to other components of the computing device 12 through the input/output interface 22. The exemplary input/output device 24 includes a pointing device (such as a mouse or trackpad), a keyboard, a touch input device (such as a touch pad or a touch screen), a voice or sound input device, and various types of sensor devices and/or a photographing device. Input devices and/or output devices such as display devices, printers, speakers, and/or network cards. The exemplary input/output device 24 may be included in the computing device 12 as a component constituting the computing device 12, and may be connected to the computing device 12 as a separate device distinct from the computing device 12. May be.

According to the present embodiment, the component area 110 existing inside the application screen 100 is disposed outside the application screen 100, the application screen 100 from which the component area 110 is removed, and the By outputting the extended screen 120 including the component area 110 disposed outside, the user can focus on various situations and functions within the application screen 100.

Although the present invention has been described in detail through the exemplary embodiments above, those of ordinary skill in the art to which the present invention pertains have found that various modifications can be made to the above embodiments without departing from the scope of the present invention. I will understand. Therefore, the scope of the present invention is limited to the described embodiments and should not be determined, and should not be determined by the claims to be described later, but also by those equivalents to the claims.

10: computing environment
12: computing device
14: processor
16: computer readable storage medium
18: communication bus
20: program
22: input/output interface
24: input/output device
26: network communication interface
100: Application screen
110: component area
120: extended screen
200: display device
202: detection unit
204: input/output unit
206: interface unit
300: mobile device

Claims (15)

A sensing unit that detects driving of an application or a connection with a mobile device on which the application is driven; And
The component area disposed inside the application screen related to the currently running application is separated from the application screen and disposed outside the application screen, and the application screen from which the component area is removed and the component area disposed outside are included. Including an input and output unit for outputting the expanded screen,
The input/output unit configures a second screen layout corresponding to the extended screen from a first screen layout corresponding to an application screen from which the component area is not removed. The method according to claim 1,
The first screen layout is provided on the set first layer panel,
The second screen layout is provided on a second layer panel positioned above the first layer panel. The method according to claim 1,
The input/output unit receives a selection of one or more of a plurality of component regions arranged inside the application screen from a user, and receives one or more of an arrangement position and size of each of the selected component regions from the user, and determines the second screen layout. Constituting the display device. The method of claim 3,
The arrangement position of each component area is preset for each component area,
The input/output unit receives the arrangement position of the component region according to the user's touch command, and sets the arrangement position of the input component region when the arrangement position of the input component region deviates from the preset arrangement position. A display device that corrects to the placement position. The method according to claim 1,
The input/output unit is configured to detect the user's input in a component area disposed outside the application screen on the extended screen. The method of claim 5,
The display device further comprising an interface unit for transmitting location information of a point in the component area where the user's input is sensed to the mobile device. The method according to claim 1,
The display device is a touch beam projector that projects a laser beam to form a screen on the outside and senses a touch input on the screen through a sensor provided therein. The method according to claim 1,
The display device is a display panel provided with a touch sensor, a display device. As a screen output method performed in a display device,
Detecting driving of an application or detecting a connection with a mobile device on which the application is driven;
Separating a component area disposed inside an application screen related to the currently running application from the application screen and disposing it outside the application screen; And
An operation of outputting an application screen from which the component area is removed and an extended screen including the externally disposed component area,
The operation of separating the component area from the application screen and placing it outside the application screen comprises configuring a second screen layout corresponding to the extended screen from a first screen layout corresponding to an application screen in which the component area has not been removed. That, the screen output method. The method of claim 9,
The first screen layout is provided on the set first layer panel,
The second screen layout is provided on a second layer panel positioned above the first layer panel. The method of claim 9,
The operation of separating the component area from the application screen and disposing it outside the application screen may include selecting one or more of a plurality of component areas disposed inside the application screen by a user, and placing the selected component area And configuring the second screen layout by receiving at least one of sizes from the user. The method of claim 11,
The arrangement position of each component area is preset for each component area,
The operation of separating the component area from the application screen and disposing it outside the application screen includes receiving an arrangement position of the component area by the user's touch command, and setting the arrangement position of the input component area in advance. A screen output method of correcting the arrangement position of the input component area to the pre-set arrangement position when deviating from the arrangement position. The method of claim 9,
The screen output method further comprising sensing the user's input in a component area disposed outside the application screen on the extended screen. The method of claim 13,
The method further comprising transmitting location information of a point in the component area where the user's input is sensed to the mobile device. One or more processors; And
Including one or more input and output devices,
The one or more processors detect driving of an application or detect a connection with a mobile device on which the application is driven,
The one or more input/output devices,
The component area disposed inside the application screen related to the currently running application is separated from the application screen and disposed outside the application screen,
Output an application screen from which the component area has been removed and an extended screen including the component area disposed outside,
By separating the component area from the application screen and disposing it outside the application screen, a second screen layout corresponding to the extended screen is constructed from a first screen layout corresponding to an application screen in which the component area is not removed. That, the display device.

Images