WO2023055213A1 - 디스플레이 장치 및 그 동작 방법 - Google Patents
디스플레이 장치 및 그 동작 방법 Download PDFInfo
- Publication number
- WO2023055213A1 WO2023055213A1 PCT/KR2022/014851 KR2022014851W WO2023055213A1 WO 2023055213 A1 WO2023055213 A1 WO 2023055213A1 KR 2022014851 W KR2022014851 W KR 2022014851W WO 2023055213 A1 WO2023055213 A1 WO 2023055213A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- content
- latency
- display device
- value
- buffer
- Prior art date
Links
- 238000011017 operating method Methods 0.000 title claims abstract description 9
- 238000004891 communication Methods 0.000 claims description 44
- 238000000034 method Methods 0.000 claims description 37
- 230000009467 reduction Effects 0.000 claims description 35
- 230000002452 interceptive effect Effects 0.000 claims description 24
- 230000008929 regeneration Effects 0.000 claims 1
- 238000011069 regeneration method Methods 0.000 claims 1
- 230000004044 response Effects 0.000 abstract description 2
- 230000000694 effects Effects 0.000 description 22
- 238000004590 computer program Methods 0.000 description 15
- 238000012545 processing Methods 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000003111 delayed effect Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000011010 flushing procedure Methods 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- APTZNLHMIGJTEW-UHFFFAOYSA-N pyraflufen-ethyl Chemical compound C1=C(Cl)C(OCC(=O)OCC)=CC(C=2C(=C(OC(F)F)N(C)N=2)Cl)=C1F APTZNLHMIGJTEW-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/358—Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4335—Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4781—Games
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
- A63F2300/53—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
- A63F2300/534—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for network load management, e.g. bandwidth optimization, latency reduction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G2340/0435—Change or adaptation of the frame rate of the video stream
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/18—Use of a frame buffer in a display terminal, inclusive of the display panel
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
Definitions
- Various embodiments relate to a display device and an operating method thereof, and more specifically, to a display device capable of effectively reducing latency that may occur in a display device and an operating method thereof.
- Latency may occur between a server and a client device when content provided by a real-time interactive communication service is reproduced.
- content provided by a real-time interactive communication service latency is displayed on the screen of the game contents displayed on the client device due to various reasons such as the performance of the client device that receives and plays the game contents from the server or the control operation of the client device. can happen
- there is a method of providing a gaming mode and in the gaming mode, a client device performs a frame drop at a constant rate.
- frame drops are uniformly performed at a constant rate for game content, and a method for reducing latency in a flexible manner suitable for content is required in a game environment.
- An object of various embodiments is to provide a display device capable of adaptively adjusting playback latency of content according to the characteristics of content and reproducing the same, and an operation method thereof.
- a display device includes a display, a playback unit that reproduces content, a memory that stores one or more instructions, and a processor that executes the one or more instructions stored in the memory, wherein the processor executes the one or more instructions.
- a display By executing, to acquire the characteristics of the content requested to be reproduced, obtain a first value according to the characteristics of the content as a first latency threshold that is a criterion for a latency adjustment operation, and reproduce the content by the playback unit.
- the playback unit is controlled to drop at least some of the corresponding frames.
- the processor determines how much the characteristics of the obtained content affect the latency of the content
- the first value is determined as the first latency threshold according to how much the characteristics of the obtained content affect the latency of the content.
- the content includes game content performed by a real-time interactive communication service, and the characteristics of the content include a category of the game content.
- the processor determines a latency reduction rate based on the characteristics of the content, determines a frame drop rate corresponding to the latency reduction rate, and determines that the latency of the content is the second. When it is determined that the value exceeds 1, the playback unit is controlled to drop frames according to the determined frame drop rate.
- the processor acquires a second value according to the characteristics of the content as a second latency threshold that is a criterion for a buffer flush operation, and the latency of the content is the second latency threshold.
- the playback unit is controlled to request a frame corresponding to the content from a source providing the content and perform a buffer flush operation to empty the buffer.
- the processor requests an I frame among frames corresponding to the content from a source providing the content when the latency of the content exceeds the second value by executing the one or more instructions.
- the processor controls the playback unit to perform a buffer flush operation upon receiving the I frame from the source by executing the one or more instructions.
- the playback unit may include a main buffer receiving and storing frames corresponding to the content, a decoder decoding frames output from the main buffer, a display buffer receiving and storing the decoded frames, and the display buffer. and a renderer configured to receive the decoded frames from and render the received decoded frames, and a latency handler to manage latency of the content.
- the latency handler may measure latency of the content based on frames stored in the main buffer and frames stored in the display buffer.
- the display buffer when the latency of the content is determined to exceed the first value, the display buffer is stored in the display buffer according to a frame drop rate corresponding to a latency reduction rate determined based on the characteristics of the content. At least some of the frames may be dropped.
- the processor obtains a second value based on the characteristics of the content as a second latency threshold serving as a reference value for a buffer flush operation by executing the one or more instructions, and the main buffer , When the latency of the content exceeds the second value, the buffer flush operation of emptying the frames stored in the main buffer may be performed.
- a method of operating a display device includes an operation of acquiring characteristics of content requested to be reproduced, an operation of obtaining a first value according to characteristics of the content as a first latency threshold that is a criterion for a latency adjustment operation, An operation of measuring the latency of the content while reproducing the content, an operation of determining whether the latency of the content exceeds the first value determined in correspondence to the content characteristic, and an operation of determining whether the latency of the content exceeds the first value and controlling to drop at least some of the frames corresponding to the content according to the decision to do so.
- a method of operating a display device includes an operation of determining how much the characteristics of the acquired content affect the latency of the content, and how much the characteristics of the obtained content affect the latency of the content. Accordingly, an operation of determining the first value as the first latency threshold may be further included.
- the content may include game content performed by a real-time interactive communication service, and the characteristics of the content may include a category of the game content.
- a method of operating a display device includes determining a latency reduction rate based on the characteristics of the content, determining a frame drop rate corresponding to the latency reduction rate, and determining whether the latency of the content is the first When it is determined that the drop rate exceeds the value, an operation of controlling to drop frames according to the determined frame drop rate may be further included.
- a method of operating a display device includes an operation of obtaining a second value according to the characteristics of the content as a second latency threshold that is a criterion for a buffer flush operation, and the latency of the content is the second value
- the method may further include controlling the playback unit to request a frame corresponding to the content from a source providing the content and to perform a buffer flush operation of emptying the buffer.
- the operating method of the display device further includes requesting an I frame among frames corresponding to the content from a source providing the content when the latency of the content exceeds the second value. can do.
- the operating method of the display device may further include controlling to perform a buffer flush upon receiving the I frame from the source.
- the method of operating the display device includes an operation of acquiring characteristics of content requested to be reproduced. , an operation of acquiring a first value according to the characteristics of the content as a first latency threshold that is a criterion for a latency adjustment operation, an operation of measuring the latency of the content while playing the content, and an operation of measuring the latency of the content according to the content An operation of determining whether the content exceeds the first value determined corresponding to the characteristic, and an operation of controlling to drop at least some of the frames corresponding to the content when the latency of the content exceeds the first value.
- FIG. 1 is a reference diagram for explaining an environment to which a method for reducing latency in a display device 100 according to an exemplary embodiment is applied.
- FIG. 2 is an example of a block diagram of a display device according to an embodiment.
- FIG. 3 is a detailed block diagram of a display device 200 according to an exemplary embodiment.
- FIG. 4 is a flowchart illustrating an example of a method of operating a display device according to an exemplary embodiment.
- FIG. 5 illustrates an example of a latency threshold set according to a content category according to an exemplary embodiment.
- FIG. 6 is a flowchart illustrating another example of a method of operating a display device according to an exemplary embodiment.
- FIG. 7 illustrates another example of a latency threshold set according to a category of content according to an embodiment.
- FIG. 8 is a detailed block diagram of the playback unit shown in FIG. 3 according to an exemplary embodiment.
- FIG. 9 is an example of a flowchart of a method of operating a display device performing a latency reduction operation according to an exemplary embodiment.
- FIG. 10 illustrates a game hub 800 as an example of a game-only application platform that the display device 100 can provide according to an embodiment.
- the term "user” refers to a person who controls a function or operation of a computing device or electronic device using a control device, and may include a viewer, administrator, or installer.
- Various embodiments relate to providing a display device capable of adaptively adjusting reproduction latency of content according to characteristics of the content and reproducing the same, and an operation method thereof.
- FIG. 1 is a reference diagram for explaining an environment to which a method for reducing latency in a display device 100 according to an exemplary embodiment is applied.
- an environment 10 may include a display device 100 , a communication network 50 , and a server computer 200 .
- the server computer 200 may be connected to the display device 100 through a communication network 50 .
- the server computer 200 is an entity capable of providing various contents, and upon receiving a content request from the display device 100, it can provide the requested content to the display device 100 through the communication network 50.
- contents may include, for example, video contents, audio contents, and real-time interactive communication service contents.
- Real-time two-way communication service content is provided to the display device 100 by the server computer 200, and the server computer 200 also receives control data controlled by the user of the display device 100 and performs an operation corresponding to the control data.
- content provided by For example, real-time interactive communication service content may include game content.
- the display device 100 is an entity capable of displaying various contents, and when it requests contents from the server computer 200 and receives the requested contents from the server computer 200 through the communication network 50, it can display the received contents. For example, when the display device 100 receives game content from the server computer 200 and displays it, the user of the display device 100 can control the game content displayed on the display device 100 .
- Game content may include video content and audio content.
- the display device 100 may display video content included in game content on the display of the display device 100 .
- the display device 100 may output audio content included in game content through a speaker provided in the display device 100 or an audio output device connected to the display device 100, for example, the headset 40 .
- a user of the display device 100 can play the game by controlling the game content while viewing the game content displayed on the display of the display device 100 .
- Users can control game contents using various controllers.
- a user of the display device 100 may control game content using a game controller 30 wirelessly connected to the display device 100 by communication.
- the display device 100 may refer to a device capable of displaying image content, video content, game content, graphic content, and the like by having a display.
- the display device 100 may include various types of electronic devices capable of receiving and outputting content, such as, for example, network TV, smart TV, Internet TV, web TV, IPTV, PC, and the like.
- the display device 100 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, a sink device, an electronic device, a computing device, and the like.
- the display device 100 may display various types of real-time interactive communication service contents.
- Real-time interactive communication service content may include, for example, game content.
- the display device 100 may reproduce the requested content upon receiving a content playback request from the user.
- the requested content to be reproduced is the content displayed by the server computer and a real-time interactive communication service
- latency of the content may occur during reproduction of the content.
- Latency may indicate a delay caused by a difference between a speed at which the server computer 200 transmits content to the display device 100 and a speed at which the display device 100 processes content received from the server computer 200 .
- This latency may be caused by differences in display device performance including decoding speed in a network environment or the display device 100 . Therefore, the display device 100 needs to reduce this latency in order to provide content in an optimal environment.
- the display device 100 since the effect of latency is different for each characteristic of content, the display device 100 according to the embodiments disclosed in the present disclosure provides a method of adaptively processing latency to suit the characteristics of content.
- an RPG Role Playing Game
- MMORPG Massive Multiplayer Online Role Playing Game
- RPG role-playing game
- MMORPGs are a type of role-playing game, concurrency with other users is important, so minimal latency can be important.
- a first-person shooter refers to a shooting game in which the player's point of view and the point of view of the player engage in combat using weapons or tools on the same screen.
- FPS first-person shooter
- seamless playback may be more important than latency. Therefore, RPGs can be included in the low latency impact category, and games such as FPS and MMORPG have latency impact. It can be included in the high degree category.
- the display device 100 may classify types of content according to various criteria.
- the display device 100 may classify content based on latency influence.
- the degree of latency influence may represent the degree to which content is affected by latency. For example, in the case of a shooting game such as shooting a gun among game contents, if you miss the point of shooting, the meaning of the shooting motion will be lost. can For example, in the case of a pioneering game played by one person, continuous playback is more important than latency, so content with low latency impact can be classified. In this way, even in the case of game contents, there may be games in which latency is more important and there may be games in which latency is less important depending on the characteristics of the game contents.
- the disclosed display apparatus 100 is intended to provide reproduction optimized for characteristics of game contents by performing latency processing according to characteristics of game contents, rather than performing processing corresponding to latency uniformly.
- the display device 100 may manage latency more strictly when playing game content having a large latency impact, and manage latency more loosely when playing game content having a small latency impact.
- the display device 100 may divide content categories into a plurality of categories based on characteristics of reproduced content.
- the display device 100 may variously determine the number of categories of content based on the characteristics of the reproduced content, such as two, three, or four.
- the display device 100 may variously determine the content category according to the characteristics of the content. For example, the display device 100 may divide content categories into a plurality of categories based on the latency effect of the content.
- the display device 100 may set a first latency threshold that is a criterion for a latency adjustment operation based on characteristics of reproduced content.
- the display device 100 may perform a latency processing operation more precisely by setting a threshold value that is a criterion for a latency adjustment operation differently according to the characteristics of content. For example, when the display device 100 divides the content category into two based on the characteristics of the content being played, when the content being played corresponds to the first category, the display device 100 sets the first latency threshold as the first value. When the set and reproduced content corresponds to the second category, the display apparatus 100 may set the first latency threshold to a second value.
- the display apparatus 100 may set the first latency threshold to a relatively low first value.
- the display device 100 may set the first latency threshold to a relatively high second value.
- the display apparatus 100 may perform a frame drop operation corresponding to the content when the latency of the content being played exceeds the first latency threshold set for the content.
- the display device 100 may drop frames according to a frame drop rate determined according to a latency reduction speed determined based on the characteristics of the content.
- the display apparatus 100 may determine whether the latency of the content exceeds the second latency threshold in addition to determining whether the latency of the content exceeds the first latency threshold.
- the second latency threshold may be a reference value for performing the buffer flush operation when the latency of content is not reduced even by the frame drop operation.
- the second latency threshold may also be determined differently according to the characteristics of content.
- the display apparatus 100 may perform a buffer flush operation of emptying frames stored in the buffer. To perform such a buffer flush operation, the display apparatus 100 may request a frame corresponding to the content from a source providing the content, and upon receiving the frame again, may perform a buffer flush operation of emptying the buffer.
- the display device 100 may request an I frame corresponding to the content from a source providing the content. This is because the display apparatus 100 can perform a decoding operation only when an I frame, which is a key frame basic for video processing, is received since buffer flushing is scheduled to be performed.
- FIG. 2 is an example of a block diagram of a display device according to an embodiment.
- the display device 100 may include a communication unit 110, a display 130, a memory 140, and a controller 150.
- the communication unit 110 may receive content received from the server computer 200 according to a communication protocol under the control of the control unit 150 .
- the display 130 may display content received from the server computer 200 on the screen.
- the memory 140 may store programs related to the operation of the display device 100 and various data generated during operation of the display device 100 .
- the controller 150 controls the overall operation of the display device 100, processes content received from the server computer 200, and displays the content on the display 130.
- the controller 150 obtains the characteristics of the content requested to be reproduced by executing one or more instructions, and obtains a first value according to the characteristics of the content as a first latency threshold that is a criterion for a latency adjustment operation, , while the content is being reproduced, the latency of the content is measured, it is determined whether the latency of the content exceeds the first value determined in correspondence to the content characteristics, and the latency of the content exceeds the first value It may be controlled to drop at least some of the frames corresponding to the content.
- the control unit 150 determines the latency influence according to the characteristics of the obtained content by executing one or more instructions, and sets the first value as the first latency threshold according to the determined latency influence. can decide
- the content includes game content performed by a real-time interactive communication service, and the characteristics of the content include a category of the game content.
- the controller 150 determines a latency reduction rate based on the characteristics of the content, determines a frame drop rate corresponding to the latency reduction rate, and determines that the latency of the content is the first When the value is exceeded, it may be controlled to drop frames according to the determined frame drop rate.
- the controller 150 obtains a second value according to the characteristics of the content as a second latency threshold that is a criterion for a buffer flush operation by executing one or more instructions, and determines that the latency of the content is the second value. When it exceeds , it is possible to request a frame corresponding to the content from a source providing the content and to perform a buffer flush operation of emptying the buffer.
- the controller 150 may request an I frame among frames corresponding to the content from a source providing the content when the latency of the content exceeds the second value. .
- the controller 150 may control to perform a buffer flush operation upon receiving the I frame from the source by executing one or more instructions.
- FIG. 3 is a detailed block diagram of a display device 200 according to an exemplary embodiment.
- the display device 100 may further include a communicator 110, a receiver 120, a display 130, a memory 140, and a controller 150, as well as a playback unit 160, an audio processing unit 170, an audio output unit 180, and a sensing unit 190.
- the communication unit 110 may include one or more modules enabling wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network where other electronic devices are located.
- the communication unit 110 may include a mobile communication module 111, a wireless Internet module 112, and a short-distance communication module 113.
- the mobile communication module 111 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network.
- the wireless signal may include a voice call signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.
- the wireless Internet module 112 refers to a module for wireless Internet access, and may be built into or external to a device.
- Wireless Internet technologies include wireless LAN (WLAN) (WiFi), wireless broadband (Wibro), world interoperability for microwave access (Wimax), high speed downlink packet access (HSDPA), and the like.
- Wi-Fi wireless LAN
- Wibro wireless broadband
- Wimax wireless broadband
- HSDPA high speed downlink packet access
- P2P Wi-Fi peer to peer
- the short distance communication module 113 refers to a module for short distance communication.
- Bluetooth Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used as short-distance communication technologies.
- BLE Bluetooth Low Energy
- RFID Radio Frequency Identification
- IrDA Infrared Data Association
- UWB Ultra Wideband
- ZigBee ZigBee
- the communication unit 110 may request the server computer 200 to transmit content requested to be reproduced under the control of the controller 150 and receive the requested content from the server computer 200 .
- the receiving unit 120 receives video (eg, motion picture, etc.), audio (eg, voice, music, etc.), and additional information (eg, EPG, etc.) from the outside of the display apparatus 100 under the control of the controller 150. can do.
- the receiver 110 includes one of an HDMI port (High-Definition Multimedia Interface port, 111, a component jack, 112), a PC port (PC port, 113), and a USB port (USB port, 114), or one or more
- the receiver 120 may further include DisplayPort (DP), Thunderbolt, and Mobile High-Definition Link (MHL).
- DP DisplayPort
- Thunderbolt Thunderbolt
- MHL Mobile High-Definition Link
- the playback unit 160 may process the video signal received from the reception unit 120 or the communication unit 110 and output it to the display 130 under the control of the control unit 150 .
- the playback unit 160 manages a main buffer for receiving frames corresponding to content, a decoder for decoding frames output from the main buffer, a display buffer for receiving decoded frames, a renderer, and latency of content.
- a latency handler may include a latency handler that
- the latency handler may determine the latency of the content based on the frames stored in the main buffer and the frames stored in the display buffer.
- the display buffer when the latency of the content exceeds the first latency threshold, stores the latency of the content stored in the display buffer according to a frame drop rate corresponding to a latency reduction rate determined based on the characteristics of the content. At least some of the frames may be dropped.
- the main buffer may perform a buffer flush to empty frames stored in the main buffer when the latency of the content exceeds the second latency threshold.
- the display 130 may display the image signal received from the image processing unit 160 on the screen.
- the audio processing unit 170 may convert an audio signal received from the receiving unit 120 or the communication unit 110 into an analog audio signal and output the converted analog audio signal to the audio output unit 180.
- the audio output unit 180 may output a received analog audio signal through a speaker.
- the memory 140 may store programs related to the operation of the display device 100 and various data generated during operation of the display device 100 .
- the memory 140 may include one or more instructions for implementing an operation performed for latency management during reproduction of content.
- the control unit 150 obtains the characteristics of the content requested to be reproduced by executing one or more instructions, and obtains a first value as a first latency threshold that is a criterion for a latency adjustment operation according to the characteristics of the content, , while the content is being reproduced, the latency of the content is measured, it is determined whether the latency of the content exceeds the first value determined in correspondence to the content characteristics, and the latency of the content exceeds the first value
- the playback unit 160 may be controlled to drop at least some of the frames corresponding to the content.
- control unit 150 determines the latency influence according to the characteristics of the obtained content by executing one or more instructions, and sets the first value as the first latency threshold according to the determined latency influence. Decide.
- the content includes game content performed by a real-time interactive communication service, and the characteristics of the content include a category of the game content.
- the controller 150 determines a latency reduction rate based on the characteristics of the content by executing one or more instructions, and when the latency of the content exceeds the first value, a response corresponding to the latency reduction rate A frame drop rate may be determined, and the playback unit 160 may be controlled to drop frames according to the determined frame drop rate.
- the controller 150 obtains a second value according to the characteristics of the content as a second latency threshold that is a criterion for a buffer flush operation by executing one or more instructions, and determines that the latency of the content is the second value.
- the playback unit 160 may be controlled to request a frame corresponding to the content from a source providing the content and to perform a buffer flush operation of emptying the buffer.
- the controller 150 may request an I frame among frames corresponding to the content from a source providing the content as the latency of the content exceeds the second value.
- the controller 150 may control the playback unit 160 to perform a buffer flush operation upon receiving the I frame from the source by executing one or more instructions.
- FIG. 4 is a flowchart illustrating an example of a method of operating a display device according to an exemplary embodiment.
- the display device 100 may receive a content playback request.
- Content may include content serviced by real-time interactive communication.
- Content serviced by real-time interactive communication may include, for example, game content.
- the display apparatus 100 reproduces content by displaying a graphic user interface displaying one or more content items provided by a server computer on the display and receiving a user input for selecting one content item through the graphic user interface. request can be received.
- the display device 100 may acquire the characteristics of the requested content to play.
- the display apparatus 100 may acquire property information of content by requesting metadata for content requested to be reproduced from a server computer providing the corresponding content and receiving metadata about the content from the server computer.
- Metadata about the content may include characteristic information such as a type or category of the corresponding content. Accordingly, the display device 100 may obtain content property information from metadata about the content.
- the display device 100 may acquire metadata about content requested to be reproduced from the memory of the display device 100 .
- the display device 100 may store metadata of content corresponding to a content item provided through a graphic user interface in advance. Accordingly, in this case, the display apparatus 100 may acquire the characteristic information of the content by reading the metadata of the content stored in the memory.
- the display device 100 may obtain metadata about content requested to be reproduced from an external server using fingerprint technology.
- the external server may be a server computer that provides the corresponding content or may be a server dedicated to fingerprint printing separate from the server that provides the corresponding content.
- the fingerprint providing server identifies the corresponding content based on the received analysis information and displays information about the identified content.
- device 100 may be provided.
- the display device 100 may acquire characteristic information of the corresponding content based on the received information about the content.
- the content requested to be reproduced by the user may include content provided by a real-time interactive communication service.
- contents provided by the real-time interactive communication service when the server provides the contents, such as game contents, the user sends a signal to control the contents to the server, and the server provides the content controlled according to the contents control signal to the user again. In such a way, it is possible to indicate the content provided with the service while communicating in both directions.
- Contents provided by such real-time interactive communication service are representative of game contents, but are not limited thereto. For example, even in the case of movie content, a user controls a specific scenario and the resulting content that changes according to the result of the control may be provided. Movie contents completed by such interactions may also be contents provided by a real-time interactive communication service.
- the display device 100 may differently set a latency threshold based on the characteristics of content.
- the display device 100 may set the latency threshold as a first value or a second value based on the characteristics of content.
- the latency threshold value may represent a threshold value that is a criterion for adjusting latency.
- the latency threshold value may represent a value serving as a standard for starting frame drops when the latency of content becomes a constant standard.
- Content provided by a real-time interactive communication service may have an important effect on latency. Accordingly, the display device 100 may differently set a threshold value as a criterion for adjusting the latency according to the characteristics of the content requested to be reproduced. Depending on the characteristics of the content, there may be content with a high latency effect or content with a low latency effect.
- an RPG Role Playing Game
- MMORPG Massive Multiplayer Online Role Playing Game
- RPG role-playing game
- MMORPGs are a type of role-playing game, concurrency with other users is important, so minimal latency can be important.
- a first-person shooter refers to a shooting game in which the player's point of view and the point of view of the player engage in combat using weapons or tools on the same screen.
- FPS first-person shooter
- seamless playback may be more important than latency. Therefore, RPGs can be included in the low latency impact category, and games such as FPS and MMORPG have latency impact. It can be included in the high degree category.
- the display device 100 may classify content categories according to the latency influence based on the characteristics of the content requested to be reproduced, and determine threshold values serving as standards for latency adjustment in various ways according to the content categories.
- FIG. 5 illustrates latency threshold values set according to content categories according to an exemplary embodiment.
- a content category may include RPG, MMORPG, FPS, and the like.
- the display device 100 may classify content categories according to whether the latency effect is large or small. For example, FPS or MMORPG may be classified as a category having a large latency impact, and RPG may be classified as a category having a low latency impact.
- the latency threshold may be set as low as the first value. That is, the latency threshold may be set low, for example, to a first value so that the frame drop operation can be performed even if the latency increases slightly.
- the latency threshold can be set relatively high. That is, the latency threshold may be set relatively high, for example, to a second value higher than the first value, so that the frame drop operation can be performed after the latency has risen to a certain level.
- the latency threshold may be set relatively high, for example, to a second value higher than the first value, so that the frame drop operation can be performed after the latency has risen to a certain level.
- content categories are divided into two categories and latency threshold values are determined for each category, but this is only an example.
- the display device 100 divides a predetermined number of categories of content based on characteristics of the content and sets a latency threshold of a predetermined number by setting a latency threshold for each category. For example, when four content categories are set corresponding to characteristics of content, the display device 100 may set a latency threshold for each content category.
- the display device 100 may reproduce the requested content. Specifically, the display device 100 may request playback-requested content from the server computer, receive frames corresponding to the playback-requested content from the server computer, decode, and play them.
- the display device 100 may determine whether the latency of content exceeds a threshold value.
- the server computer may transmit frames of the playback-requested content to the display device 100 .
- the display device 100 may decode and reproduce frames of content received from the server computer.
- the display device 100 may periodically measure and monitor latency to manage latency of reproduced frames.
- Latency may indicate a degree of delay occurring in processing and displaying frames received by the display apparatus 100 .
- the latency may be set to the number of delayed frames, or it may be set to a delayed time unit, eg a few msec (milliseconds).
- the display device 100 may determine whether the latency of the content being played exceeds a threshold value set for the content being played.
- the latency threshold of the content may be set differently according to the characteristics of the content. For example, a content latency threshold may be set to a first value for content of a first category, and a content latency threshold may be set to a second value for content of a second category. Accordingly, when the content being reproduced is the content of the first category, the display device 100 may determine whether the latency of the content exceeds the first value. Also, if the content being reproduced is the content of the second category, the display device 100 may determine whether the second value of the latency of the content is exceeded.
- the display device 100 may continue monitoring if it is determined that the latency of the content does not exceed the threshold value set for the corresponding content in operation 430 . While monitoring the latency of the content, the display device 100 may proceed to operation 460 when it is determined that the latency of the content exceeds the threshold value set for the corresponding content in operation 430 .
- the display device 100 may perform a frame drop according to the latency reduction rate set for the content when detecting that the latency of the content exceeds the threshold set for the content.
- the display device 100 may set a latency reduction rate based on the characteristics of content requested to be reproduced. Specifically, the display device 100 may set a latency reduction speed according to the category of content requested to be reproduced. The display device 100 may classify content categories according to latency influence. For example, referring to FIG. 5, the latency reduction rate is set to “high” because the latency effect is large for game categories such as FPS and MMORPG, and the latency reduction rate is set to “High” for game categories such as RPG that have low latency impact. It can be set to "Ha". Also, the display device 100 may determine a drop rate corresponding to each latency reduction rate.
- set the drop rate to 50% of delayed frames (1 frame drop per 2 frames) for categories with “high” latency reduction rate, and set the drop rate to 10% of delayed frames (10 frames for categories with “low” latency reduction rate). 1 frame per drop) can be set.
- the drop rate can be determined in various ways according to the system's policy. As described above, the drop rate may be set as a percentage, such as a few frames per few frames on a frame basis.
- the display device 100 may perform a frame drop operation according to the drop rate determined based on the characteristics of the content requested to be played when the latency of the content being played exceeds a threshold value set for the content.
- the frame drop operation may represent discarding some of the frames stored in a buffer included in the playback unit of the display device 100 as they are without rendering. In this way, while performing the frame drop, the content may be continuously reproduced and the latency of the content may be continuously monitored. At this time, if the frame drop is performed for a sufficient time and it is determined in operation 450 that the latency of the content does not exceed the threshold value, the frame drop may be stopped by proceeding to operation 440 .
- FIG. 6 is a flowchart illustrating an example of a method of operating a display device according to an exemplary embodiment.
- the first latency threshold is used as the latency threshold, but in the operation shown in FIG. 6, two latency thresholds, that is, the first latency threshold and the second latency threshold are used.
- operations 610 and 620 are the same as operations 410 and 420 shown in FIG. 4 .
- the display device 100 classifies content categories according to the latency influence based on the characteristics of the content requested to be reproduced, and a first latency threshold and a second latency threshold serving as criteria for latency adjustment according to the content category. value can be determined.
- the first latency threshold may be a latency that is a criterion at which the display apparatus 100 starts a latency reduction operation.
- the second latency threshold is a criterion for performing a buffer flush when the content latency is not reduced even though the display device 100 starts a latency reduction operation when the content latency exceeds the first latency threshold and performs a frame drop.
- latency can be When it is determined that it is difficult to maintain latency in a desired state even by a frame drop operation, the display apparatus 100 may empty all frames in the buffer and then perform a buffer flush operation to receive and process new frames from the server computer.
- FIG. 7 illustrates latency threshold values set according to content categories according to an exemplary embodiment.
- a content category may include RPG, MMORPG, FPS, and the like.
- the display device 100 may classify content categories according to whether the latency effect is large or small. For example, FPS or MMORPG may be classified as a category having a large latency impact, and RPG may be classified as a category having a low latency impact.
- the first latency threshold may be set low. That is, the first latency threshold may be set low so that the frame drop operation can be performed even if the latency increases slightly.
- the first latency threshold can be set relatively high. That is, the first latency threshold may be set relatively high so that the frame drop operation may be performed after the latency is left as it is until the latency increases to a certain level. Since the second latency threshold becomes a reference point for buffer flushing in a state where the latency exceeds the first latency threshold, it will be set to a larger value than the first latency threshold. Referring to FIG. 7 , the first value set as the first latency threshold of content such as FPS or MMORPG may be set to a lower value than the second value set as the first latency threshold of content such as RPG. .
- the second latency threshold may be set differently according to the characteristics of content. For example, in the case of content of a category having a large latency effect, since the latency of the content must be strictly managed, the second latency threshold may be set low. On the other hand, in the case of content of a category having a small latency impact, the second latency threshold may be set relatively high because the latency of the content may be relatively less strictly managed. Referring to FIG. 7 , the third value set as the second latency threshold for content such as FPS or MMORPG may be set to a lower value than the fourth value set as the second latency threshold for content such as RPG. .
- the display device 100 may reproduce the requested content. Specifically, the display device 100 may request playback-requested content from the server computer, receive frames corresponding to the playback-requested content from the server computer, decode, and play them.
- the display device 100 may determine whether the latency of content exceeds a first latency threshold.
- the display device 100 may periodically measure and monitor content latency to manage content latency while decoding and playing reproduced frames. Latency may indicate a degree of delay occurring in processing and displaying frames received by the display apparatus 100 .
- the display device 100 may determine whether the latency of the content being played exceeds a first latency threshold set for the content being played.
- the first latency threshold of the content may be set differently according to the characteristics of the content. For example, a first latency threshold may be set to a first value for content of a first category, and a second latency threshold may be set to a second value for content of a second category. Accordingly, when the content being reproduced is the content of the first category, the display device 100 may determine whether the latency of the content exceeds the first value. Also, if the content being reproduced is the content of the second category, the display device 100 may determine whether the second value of the latency of the content is exceeded.
- the display device 100 may continuously monitor the latency when it is determined in operation 630 that the latency of the content does not exceed the first latency threshold set for the corresponding content.
- the display device 100 may proceed to operation 660.
- the display device 100 may perform a frame drop according to the latency reduction rate set for the corresponding content.
- the display device 100 may set a latency reduction rate based on the characteristics of content requested to be reproduced. Specifically, the display device 100 may set a latency reduction speed according to the category of content requested to be reproduced.
- the display device 100 may classify content categories according to latency influence. For example, referring to FIG. 7 , since the latency reduction rate is set to “high” for game categories such as FPS and MMORPG, since the latency effect is large, and for game categories such as RPG, latency reduction rate is set to “high” because the latency effect is low for game categories such as RPG It can be set to "Ha".
- the display device 100 may determine a drop rate corresponding to each latency reduction rate. For example, set the drop rate to 50% of delayed frames (1 frame drop per 2 frames) for categories with “high” latency reduction rate, and set the drop rate to 10% of delayed frames for categories with “low” latency reduction rate ( 1 frame drop per 10 frames).
- the display device 100 may perform a frame drop operation according to the drop rate determined based on the characteristics of the content requested to be played when the latency of the content being played exceeds the first latency threshold set for the content.
- the frame drop operation may represent discarding some of the frames stored in a buffer included in the playback unit of the display device 100 as they are without rendering. In this way, while performing the frame drop, the content may be continuously reproduced and the latency of the content may be continuously monitored. At this time, if the frame drop is performed for a sufficient time and it is determined in operation 650 that the latency of the content does not exceed the threshold value, the frame drop may be stopped by proceeding to operation 640 .
- the display device 100 may drop frames corresponding to the content when the latency of the content exceeds the first latency threshold.
- the display device 100 may perform a frame drop operation according to a drop rate determined based on characteristics of content requested to be reproduced.
- the frame drop operation may represent discarding some of the frames stored in a buffer included in the playback unit of the display device 100 as they are without rendering.
- the display device 100 may determine whether the latency of content exceeds a second latency threshold.
- the display device 100 may determine whether the latency of the content exceeds the second latency threshold while continuously monitoring the latency of the content while performing a frame drop when the latency of the content exceeds the first latency threshold. When the latency of the content does not exceed the second latency threshold, the display device 100 may monitor the latency of the content while continuously performing frame drops. When the latency of the content exceeds the second latency threshold, the display device 100 determines that the latency cannot be maintained at a desired level through the frame drop operation, and determines that it is more desirable to flush the buffer. Accordingly, when the latency of the content exceeds the second latency threshold, the display device 100 may proceed to operation 680 to flush the buffer.
- the display device 100 may perform a buffer flush operation.
- the display apparatus 100 may first request a frame corresponding to the content from a source providing content, that is, a server computer, and perform a buffer flush upon receiving the frame from the server computer.
- Buffer flushing refers to an operation of emptying all frames stored in a buffer included in a playback unit of the display device 100 .
- the display apparatus 100 may transmit a request to send an I frame among frames currently being sent to a source providing the content.
- the display apparatus 100 performs a buffer flush, all frames stored in the buffer are discarded. Therefore, in order for the display apparatus 100 to receive and decode a new frame, an I frame serving as a key frame is required. Accordingly, the display device 100 may request an I frame from the server computer providing content.
- GOP is an abbreviation of Group Of Picture, which is a basic option of MPEG-1/2 encoding and means a collection of frames from a key frame to the next key frame.
- the frame types of GOP include I, B, and P.
- I frame is an abbreviation of intra frame and means key frame. Frames with the best picture quality are independently encoded without reference to other frames.
- P frame is an abbreviation of Predicted Frame. It is a frame composed by referring to the information of the previous key frame, and the picture quality and capacity are medium.
- B frame is an abbreviation of Bidirectional Frame, and it is a frame composed by referring to the information of the previous and subsequent I/P frames, and has the smallest picture quality and capacity.
- the frames constituting the alternative content are composed of frames having different characteristics.
- the display apparatus 100 when receiving a requested I-frame from the server computer, the display apparatus 100 performs a buffer flush, decodes from the newly received I-frame, and reproduces content.
- FIG. 8 is a detailed block diagram of the playback unit shown in FIG. 3 according to an exemplary embodiment.
- the playback unit 160 may receive and process frames corresponding to the content requested for playback from the controller 150 and output the processed frames to the display 130 .
- the playback unit 160 may include a main buffer 161, a decoder 162, a display buffer 163, a renderer 164, and a latency handler 165.
- the main buffer 161 may store frames received from the controller 150 and transfer them to the decoder 162 .
- the decoder 162 may decode frames received from the main buffer 161 and output the decoded frames to the display buffer 163 .
- the display buffer 163 may store decoded frames and output them to the renderer 164.
- the renderer 164 may receive decoded frames from the display buffer 163 and render them, and output the rendered data to the display 130 .
- Frames received from the controller 150 may be displayed on the display 130 via the main buffer 161 , decoder 162 , display buffer 163 , and renderer 164 .
- the latency handler 165 continuously measures and monitors the latency of content while decoding and displaying the received frames, and may perform a latency reduction operation according to the monitoring result.
- the latency handler 165 may receive and manage setting information about a first latency threshold, a second latency threshold, and a drop rate from the controller 150 as the content requested to be reproduced is identified in the display device 100 .
- the latency handler 165 may measure the latency of content reproduced by the playback unit 160 . Latency may be determined in various ways. According to an example, the latency handler 165 may measure the current latency using the amount of frames accumulated in the main buffer 161 and the amount of frames accumulated in the display buffer 163 . For example, when frames of 9 seconds are accumulated in the main buffer 161 and frames of 1 second are accumulated in the display buffer 163, the latency handler 165 may calculate the latency as 10 seconds. According to an example, the latency handler 165 may measure the current latency using the amount of frames accumulated in the main buffer 161 and the amount of frames accumulated in the display buffer 163 .
- the latency handler 165 may detect that the latency exceeds the first latency threshold while continuously measuring and monitoring the latency. Upon detecting that the latency exceeds the first latency threshold, the latency handler 165 may control the display buffer 163 to drop decoded frames included in the display buffer 163 according to the drop rate information received from the controller 150 .
- the latency handler 165 may control the display buffer 163 to stop the drop when detecting that the latency becomes lower than the first latency threshold.
- the latency handler 165 may transmit an event notifying that the latency exceeds the second latency threshold value to the controller 150 .
- the control unit 150 may perform an operation to reduce latency. That is, the control unit 150 transmits an I frame request to the server computer to receive a new content frame and upon receiving the I frame, the control unit 150 forwards the received I frame to the main buffer 161 and also requests the latency handler 165 to control the buffer flush. can Upon receiving the buffer flush control, the latency handler 165 may control the main buffer 161 to empty all frames accumulated in the main buffer 161 .
- FIG. 9 is an example of a flowchart of a method of operating a display device performing a latency reduction operation according to an exemplary embodiment.
- the display device 100 may receive a content play request from the user 900 .
- the display device 100 may provide a graphic user interface for selecting one or more content items and receive a user input for selecting one content item through the graphic user interface.
- An example of a graphic user interface capable of selecting one or more content items will be described with reference to FIG. 10 .
- FIG. 10 illustrates a game hub 1000 as an example of a game-only application platform that the display device 100 can provide according to an embodiment.
- the game hub 1000 may provide one or more items for selecting an external input source, one or more items for selecting a cloud source, and various menus.
- the user can reproduce content corresponding to the item by inputting to select an item provided by the game hub 1000. For example, when a user inputs an input to select a first cloud game item, the display device 100 receives a request for playing game contents corresponding to the first cloud game item.
- the display device 100 may acquire property information about the content requested to play.
- the display device 100 may obtain characteristic information about content requested to be played through various methods.
- the display device 100 may store characteristic information about content in a memory.
- the display device 100 may obtain characteristic information about the content by reading the characteristic information about the corresponding content from the memory.
- the display device 100 requests metadata about content requested to be reproduced from a server computer, receives metadata about content requested to be reproduced from the server computer, and obtains characteristic information of the content from the received metadata.
- the display device 100 extracts a fingerprint through some frame or thumbnail information of the content requested to be reproduced, transmits the extracted fingerprint to the fingerprint server, receives metadata about the content, and receives the received metadata. Characteristic information about content can be obtained from meta data.
- Characteristic information of content related to the embodiments disclosed in the present disclosure may include information on characteristics capable of determining the degree of influence on latency of content.
- characteristics for determining the degree of latency influence may vary according to the type of game content.
- a shooting game such as FPS
- latency is important content, and such a game may be classified as content having a large latency effect.
- a role-playing game such as an RPG
- it is important to play content without interruption rather than latency and such a game can be classified as content having a relatively smaller effect on latency than FPS.
- the controller 150 of the display device 100 may register a latency threshold, a drop rate, and an event based on the characteristics of content.
- the display device 100 monitors the latency while playing the content, and may set a threshold value serving as a reference point for taking some action when the latency increases.
- the display device 100 may set two threshold values, a first latency threshold value and a second latency threshold value, in order to more elaborately design a reference point at which an action should be taken due to increased latency.
- the first latency threshold represents a latency threshold that becomes a reference point for performing a frame drop due to increased latency
- the second latency threshold represents a reference point for performing a buffer flush as the latency becomes larger and cannot be solved by frame drops only. may indicate a latency threshold that is
- the display device 100 may set a first latency threshold and a second latency threshold based on the characteristics of the content requested to be reproduced.
- the control unit 150 of the display device 100 may set the first latency threshold and the second latency threshold relatively low because the threshold must be strictly managed. That is, in this case, even if latency is slightly exceeded, frame drop or buffer flushing can be performed immediately.
- the control unit 150 of the display device 100 may set the first latency threshold and the second latency threshold relatively high by loosely managing the threshold. That is, in this case, it is to ensure that the frame drop or buffer flush can be performed only when the latency exceeds a certain level.
- the display device 100 may set a drop rate for frame drop performed when the latency exceeds the first latency threshold.
- the frame drop rate may indicate a degree of dropping the frames piled up in the display buffer at a rate or at a rate.
- the display device 100 may determine a frame drop rate based on characteristics of content requested to be played. Specifically, if the characteristic of the content is that the effect of latency is large, the control unit 150 of the display device 100 may set a high frame drop rate because the latency needs to be quickly lowered. If the characteristic of the content is that the effect of latency is small, the controller 150 of the display device 100 can lower the latency relatively slowly, and thus set a low frame drop rate.
- the display device 100 registers a second latency threshold exceeding notification event to receive a second latency threshold exceeding notification event from the playback unit 160 in order to flush the buffer. can In this way, when the second latency threshold exceeding notification event is registered and transmitted to the playback unit 160, the playback unit 160 reports this situation when the corresponding condition is satisfied, that is, when the latency exceeds the second latency threshold. may be generated and transmitted to the control unit 150.
- the controller 150 may transfer the set thresholds, that is, the first latency threshold and the second latency threshold, the drop rate, and the set event to the playback unit 160.
- the latency handler 165 of the playback unit 160 may register the received threshold value and the event.
- the controller 150 may request the server computer 200 for a frame of the requested content to be reproduced.
- the controller 150 receives frames requested for playback from the server computer 200, and in operation 940, the controller 150 transfers the received frames to the playback unit 160.
- the playback unit 160 may process and reproduce the received frames through the main buffer 161, the decoder 162, the display buffer 163, and the renderer 164.
- the latency handler 165 of the playback unit 160 may measure the latency of the content played by the playback unit 160.
- the latency handler 165 continuously periodically measures and monitors the latency of the content while the content is being reproduced in the playback unit 160 in order to manage the latency of the content being played back in the playback unit 160 .
- the latency handler 165 may determine whether the latency exceeds a first latency threshold while measuring and monitoring the latency. When the latency does not exceed the first latency threshold, the latency measurement may be repeated in operation 950 .
- the latency handler 165 may perform a frame drop when it is determined that the measured latency exceeds a first latency threshold.
- the latency handler 165 may control the display buffer 163 to drop some frames according to the frame drop rate received from the controller 150 .
- the latency handler 165 continuously monitors the latency while performing the frame drop, and determines whether the latency exceeds the second latency threshold. If the latency does not exceed the second latency threshold, the latency handler 165 proceeds to operation 950, measures the latency, determines whether the latency exceeds the first latency threshold, and determines whether or not to drop the frame according to the determination result. .
- the latency handler 165 may transfer a notification event notifying that the latency exceeds the second latency threshold to the controller 150.
- the control unit 150 receiving the second threshold exceeding notification event may generate an event requesting a new frame from the server computer 200.
- the new frame request may include an I frame request. If the latency exceeds the second latency threshold, buffer flushing is performed and a new playback frame is received and decoded from the server computer. Therefore, the playback unit may request an I frame because an I frame, which is a key frame for decoding, is required.
- the controller 150 transmits an I-frame request event to the server computer 200, and in operation 985, the server computer 200 transmits the I-frame to the display device 100.
- the controller 150 may transfer the I frame and the buffer flush request received from the server computer to the playback unit 160.
- the playback unit 160 that has received the I frame and the buffer flush request performs a buffer flush, and proceeds to operation 945 to perform a playback operation of the received frame.
- Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
- the disclosed embodiments may be implemented as a S/W program including instructions stored in computer-readable storage media.
- a computer is a device capable of calling instructions stored in a storage medium and performing operations according to the disclosed embodiments according to the called instructions, and may include electronic devices according to the disclosed embodiments.
- a computer-readable storage medium may be provided in the form of a non-transitory storage medium.
- 'non-temporary' only means that the storage medium does not contain a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.
- control method according to the disclosed embodiments may be provided by being included in a computer program product.
- Computer program products may be traded between sellers and buyers as commodities.
- a computer program product may include a S/W program and a computer-readable storage medium in which the S/W program is stored.
- the computer program product may include a product (eg, downloadable app) in the form of a S/W program that is distributed electronically through a device manufacturer or an electronic market (eg, Google Play Store, App Store).
- a product eg, downloadable app
- the storage medium may be a storage medium of a manufacturer's server, an electronic market server, or a relay server temporarily storing SW programs.
- a computer program product may include a storage medium of a server or a storage medium of a device in a system composed of a server and a device.
- the computer program product may include a storage medium of the third device.
- the computer program product may include a S/W program itself transmitted from the server to the device or the third device or from the third device to the device.
- one of the server, the device and the third apparatus may execute the computer program product to perform the method according to the disclosed embodiments.
- two or more of the server, the device, and the third device may execute the computer program product to implement the method according to the disclosed embodiments in a distributed manner.
- a server may execute a computer program product stored in the server to control a device communicatively connected to the server to perform a method according to the disclosed embodiments.
- the third apparatus may execute a computer program product to control a device communicatively connected to the third apparatus to perform a method according to the disclosed embodiment.
- the third device may download the computer program product from the server and execute the downloaded computer program product.
- the third device may perform the method according to the disclosed embodiments by executing a computer program product provided in a preloaded state.
- unit may be a hardware component such as a processor or a circuit, and/or a software component executed by the hardware component such as a processor.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims (15)
- 디스플레이 장치에 있어서,디스플레이,컨텐츠를 재생하는 재생부,하나 이상의 인스트럭션을 저장하는 메모리, 및상기 메모리에 저장된 상기 하나 이상의 인스트럭션을 실행하는 프로세서를 포함하고,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,재생 요청된 컨텐츠의 특성을 획득하고,레이턴시 조정 동작의 기준이 되는 제1 레이턴시 임계값으로서 상기 컨텐츠의 특성에 따라서 제1값을 획득하고,상기 재생부에 의해 상기 컨텐츠를 재생하는 동안 상기 컨텐츠의 레이턴시를 측정하고,상기 컨텐츠의 레이턴시가 상기 컨텐츠 특성에 대응하여 결정된 상기 제1값을 초과하는지 판단하고,상기 컨텐츠의 레이턴시가 상기 제1값을 초과하는 것으로 결정됨에 따라 상기 컨텐츠에 대응하는 프레임들의 적어도 일부의 드랍을 수행하도록 상기 재생부를 제어하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,상기 획득된 컨텐츠의 특성이 상기 컨텐츠의 레이턴시에 얼마나 영향을 주는지 판단하고,상기 획득된 컨텐츠의 특성이 상기 컨텐츠의 레이턴시에 얼마나 영향을 주는지에 따라 상기 제1레이턴시 임계값으로서 상기 제1값을 결정하는, 디스플레이 장치.
- 제2항에 있어서,상기 컨텐츠는 실시간 양방향 통신 서비스에 의해 수행되는 게임 컨텐츠를 포함하고,상기 컨텐츠의 특성은 상기 게임 컨텐츠의 카테고리를 포함하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,상기 컨텐츠의 특성에 기반하여 레이턴시 감소 속도를 결정하고,상기 레이턴시 감소 속도에 대응하는 프레임 드랍률을 결정하고,상기 컨텐츠의 레이턴시가 상기 제1값을 초과한다고 결정됨에 따라, 상기 결정된 프레임 드랍률에 따라, 프레임들의 드랍을 수행하도록 상기 재생부를 제어하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,버퍼 플러시 동작의 기준이 되는 제2 레이턴시 임계값으로서 상기 컨텐츠의 특성에 따라서 제2값을 획득하고,상기 컨텐츠의 레이턴시가 상기 제2값을 초과함에 따라, 상기 컨텐츠를 제공하는 소스에 상기 컨텐츠에 대응하는 프레임을 요청하고, 상기 버퍼를 비우는 버퍼 플러시 동작을 수행하도록 상기 재생부를 제어하는, 디스플레이 장치.
- 제5항에 있어서,상기 프로세서는, 상기 하나 이상의 인스트럭션을 실행함으로써,상기 컨텐츠의 레이턴시가 상기 제2값을 초과함에 따라, 상기 컨텐츠를 제공하는 소스에 상기 컨텐츠에 대응하는 프레임들 중 I 프레임을 요청하는, 디스플레이 장치.
- 제6항에 있어서,상기 프로세서는, 상기 하나 이상의 인스트럭션을 실행함으로써,상기 소스로부터 상기 I 프레임을 수신함에 따라 버퍼 플러시를 수행하도록 상기 재생부를 제어하는, 디스플레이 장치.
- 제1항에 있어서,상기 재생부는,상기 컨텐츠에 대응하는 프레임들을 수신하여 저장하는 메인 버퍼,상기 메인 버퍼로부터 출력되는 프레임들을 디코딩하는 디코더,상기 디코딩된 프레임들을 수신하여 저장하는 디스플레이 버퍼,상기 디스플레이 버퍼로부터 상기 디코딩된 프레임들을 수신하고 상기 수신된 디코딩된 프레임들을 랜더링하도록 구성된 랜더러, 및상기 컨텐츠의 레이턴시를 관리하는 레이턴시 핸들러를 포함하는, 디스플레이 장치.
- 제8항에 있어서,상기 레이턴시 핸들러는,상기 메인 버퍼에 저장된 프레임 및 상기 디스플레이 버퍼에 저장된 프레임에 기반하여 상기 컨텐츠의 레이턴시를 측정하는, 디스플레이 장치.
- 제8항에 있어서,상기 디스플레이 버퍼는,상기 컨텐츠의 레이턴시가 상기 제1값을 초과하는 것으로 결정됨에 따라, 상기 컨텐츠의 특성에 기반하여 결정된 레이턴시 감소 속도에 대응하는 프레임 드랍률에 따라 상기 디스플레이 버퍼에 저장된 상기 프레임들의 적어도 일부를 드랍시키는, 디스플레이 장치.
- 제8항에 있어서,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,버퍼 플러시 동작을 위한 기준 값으로서 역할하는 제2 레이턴시 임계값으로서, 상기 컨텐츠의 특성에 기반한 제2값을 획득하고,상기 메인 버퍼는,상기 컨텐츠의 레이턴시가 상기 제2값을 초과함에 따라, 상기 메인 버퍼에 저장된 프레임들을 비우는 상기 버퍼 플러시 동작을 수행하는, 디스플레이 장치.
- 디스플레이 장치의 동작 방법에 있어서,재생 요청된 컨텐츠의 특성을 획득하는 동작,레이턴시 조정 동작의 기준이 되는 제1 레이턴시 임계값으로서 상기 컨텐츠의 특성에 따라서 제1값을 획득하는 동작,상기 컨텐츠를 재생하는 동안 상기 컨텐츠의 레이턴시를 측정하는 동작,상기 컨텐츠의 레이턴시가 상기 컨텐츠 특성에 대응하여 결정된 상기 제1값을 초과하는지 판단하는 동작, 및상기 컨텐츠의 레이턴시가 상기 제1값을 초과하는 것으로 결정됨에 따라 상기 컨텐츠에 대응하는 프레임들의 적어도 일부의 드랍을 수행하도록 제어하는 동작을 포함하는, 디스플레이 장치의 동작 방법.
- 제12항에 있어서,상기 획득된 컨텐츠의 특성이 상기 컨텐츠의 레이턴시에 얼마나 영향을 주는지 판단하는 동작, 및상기 획득된 컨텐츠의 특성이 상기 컨텐츠의 레이턴시에 얼마나 영향을 주는지 에 따라서 상기 제1레이턴시 임계값으로서 상기 제1값을 결정하는 동작을 포함하는, 디스플레이 장치의 동작 방법.
- 제13항에 있어서,상기 컨텐츠는 실시간 양방향 통신 서비스에 의해 수행되는 게임 컨텐츠를 포함하고,상기 컨텐츠의 특성은 상기 게임 컨텐츠의 카테고리를 포함하는, 디스플레이 장치의 동작 방법.
- 디스플레이 장치의 동작 방법을 컴퓨터에 구현하기 위한 하나 이상의 인스트럭션을 포함하는 프로그램을 기록한 컴퓨터 판독가능한 기록 매체에 있어서,상기 디스플레이 장치의 동작 방법은,재생 요청된 컨텐츠의 특성을 획득하는 동작,레이턴시 조정 동작의 기준이 되는 제1 레이턴시 임계값으로서 상기 컨텐츠의 특성에 따라서 제1값을 획득하는 동작,상기 컨텐츠를 재생하는 동안 상기 컨텐츠의 레이턴시를 측정하는 동작,상기 컨텐츠의 레이턴시가 상기 컨텐츠 특성에 대응하여 결정된 상기 제1값을 초과하는지 판단하는 동작, 및상기 컨텐츠의 레이턴시가 상기 제1값을 초과하는 것으로 결정됨에 따라 상기 컨텐츠에 대응하는 프레임들의 적어도 일부의 드랍을 수행하도록 제어하는 동작을 포함하는, 컴퓨터 판독가능 기록 매체.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202280066374.6A CN118044210A (zh) | 2021-09-30 | 2022-09-30 | 显示装置及其操作方法 |
EP22876984.0A EP4362475A1 (en) | 2021-09-30 | 2022-09-30 | Display device and operating method thereof |
US18/092,714 US20230146209A1 (en) | 2021-09-30 | 2023-01-03 | Display apparatus and operating method thereof |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2021-0130286 | 2021-09-30 | ||
KR1020210130286A KR20230046801A (ko) | 2021-09-30 | 2021-09-30 | 디스플레이 장치 및 그 동작 방법 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/092,714 Continuation US20230146209A1 (en) | 2021-09-30 | 2023-01-03 | Display apparatus and operating method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023055213A1 true WO2023055213A1 (ko) | 2023-04-06 |
Family
ID=85783301
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2022/014851 WO2023055213A1 (ko) | 2021-09-30 | 2022-09-30 | 디스플레이 장치 및 그 동작 방법 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20230146209A1 (ko) |
EP (1) | EP4362475A1 (ko) |
KR (1) | KR20230046801A (ko) |
CN (1) | CN118044210A (ko) |
WO (1) | WO2023055213A1 (ko) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20150116220A (ko) * | 2014-04-07 | 2015-10-15 | 삼성전자주식회사 | 미디어 스트리밍 방법 및 그 전자 장치 |
KR20180013921A (ko) * | 2015-05-28 | 2018-02-07 | 퀄컴 인코포레이티드 | 저 레이턴시 스크린 미러링 |
KR20190016306A (ko) * | 2017-08-08 | 2019-02-18 | 삼성전자주식회사 | 영상 처리 장치, 영상 처리 방법 및 영상 디스플레이 시스템 |
WO2021009255A1 (en) * | 2019-07-17 | 2021-01-21 | Dolby International Ab | Latency management for content delivery |
KR20210105161A (ko) * | 2020-02-18 | 2021-08-26 | 주식회사 케이티 | 영상 스트리밍 서비스의 품질을 관리하는 품질 관리 서버, 방법 및 컴퓨터 프로그램 |
-
2021
- 2021-09-30 KR KR1020210130286A patent/KR20230046801A/ko unknown
-
2022
- 2022-09-30 CN CN202280066374.6A patent/CN118044210A/zh active Pending
- 2022-09-30 EP EP22876984.0A patent/EP4362475A1/en active Pending
- 2022-09-30 WO PCT/KR2022/014851 patent/WO2023055213A1/ko active Application Filing
-
2023
- 2023-01-03 US US18/092,714 patent/US20230146209A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20150116220A (ko) * | 2014-04-07 | 2015-10-15 | 삼성전자주식회사 | 미디어 스트리밍 방법 및 그 전자 장치 |
KR20180013921A (ko) * | 2015-05-28 | 2018-02-07 | 퀄컴 인코포레이티드 | 저 레이턴시 스크린 미러링 |
KR20190016306A (ko) * | 2017-08-08 | 2019-02-18 | 삼성전자주식회사 | 영상 처리 장치, 영상 처리 방법 및 영상 디스플레이 시스템 |
WO2021009255A1 (en) * | 2019-07-17 | 2021-01-21 | Dolby International Ab | Latency management for content delivery |
KR20210105161A (ko) * | 2020-02-18 | 2021-08-26 | 주식회사 케이티 | 영상 스트리밍 서비스의 품질을 관리하는 품질 관리 서버, 방법 및 컴퓨터 프로그램 |
Also Published As
Publication number | Publication date |
---|---|
CN118044210A (zh) | 2024-05-14 |
KR20230046801A (ko) | 2023-04-06 |
US20230146209A1 (en) | 2023-05-11 |
EP4362475A1 (en) | 2024-05-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2013105782A1 (en) | Image display apparatus and method of controlling the same | |
WO2014092509A1 (en) | Glasses apparatus and method for controlling glasses apparatus, audio apparatus and method for providing audio signal and display apparatus | |
WO2015026058A1 (en) | Method, terminal, and system for reproducing content | |
WO2016200018A1 (en) | Method and apparatus for sharing application | |
WO2016137134A1 (en) | Broadcast receiving apparatus and method for controlling the same | |
WO2015068932A1 (en) | Display apparatus and method of controlling display apparatus | |
WO2020116896A1 (ko) | 미디어 콘텐트 처리를 관리하기 위한 방법, 장치 및 컴퓨터 판독 가능한 기록 매체 | |
WO2019054791A1 (ko) | 컨텐트를 실행하는 방법 및 장치 | |
WO2016111502A1 (en) | System and method for transmitting information about task to external device | |
WO2021101275A1 (en) | Method, system and device for sharing contents | |
WO2023055213A1 (ko) | 디스플레이 장치 및 그 동작 방법 | |
WO2010071303A4 (ko) | 데이터 전송 방법 및 장치 | |
WO2023090863A1 (ko) | 전자 장치 및 그 동작 방법 | |
WO2016080586A1 (en) | System and method for providing cloud based user interfaces | |
WO2022080866A1 (ko) | 전자 장치 및 그 동작 방법 | |
WO2020262920A1 (en) | Display apparatus and the control method thereof | |
WO2023132589A1 (ko) | 전자 장치, 서버 컴퓨터 및 그 동작 방법 | |
WO2019112224A1 (ko) | 전자 장치 및 전자 장치의 영상 데이터 전송 방법 | |
WO2019160289A1 (ko) | 전자장치 및 그 제어방법 | |
WO2022055256A1 (ko) | 전자 장치 및 그 동작 방법 | |
WO2023140684A1 (ko) | 전자 장치 및 그 동작 방법 | |
WO2023068871A1 (ko) | 디스플레이 장치 및 그 동작 방법 | |
WO2024005444A1 (ko) | 가상 무선 접속 네트워크의 스케일링 제어 방법 및 전자 장치 | |
WO2024090710A1 (ko) | 전자 장치, 서버 장치 및 그 제어 방법 | |
WO2023191122A1 (ko) | 디스플레이 장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22876984 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022876984 Country of ref document: EP Ref document number: 22876984.0 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2022876984 Country of ref document: EP Effective date: 20240122 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |