KR20240037556A - Method, computer device, and computer program for enhancing video quality based on artificial intelligence - Google Patents

Abstract

A method, computer device, and computer program for enhancing video quality based on artificial intelligence are disclosed. In a video quality enhancement method executed on a computer device according to an embodiment, the computer device includes at least one processor configured to execute computer-readable instructions included in a memory, and the video quality enhancement method includes: determining, by a processor, quality enhancement operating conditions with respect to video played in a video service; and executing, by the at least one processor, a quality processing operation on the video included in the quality enhancement operation condition through the determination.

Description

Method, computer device, and computer program for enhancing video quality based on artificial intelligence {METHOD, COMPUTER DEVICE, AND COMPUTER PROGRAM FOR ENHANCING VIDEO QUALITY BASED ON ARTIFICIAL INTELLIGENCE}

The explanation below is about video playback technology.

Consumption of online and mobile video content is rapidly increasing due to high-speed mobile communications and the widespread use of mobile devices. With the expansion of online streaming platforms on the web and mobile, the range of viewer choices for video content and use is expanding.

As high-spec action cameras and high-refresh rate video shooting become possible, high-quality video content is being produced in various fields. However, high-quality video content is uploaded in low quality to services that play video content (e.g., players, SNS, etc.). Therefore, there is a need for technology to provide high-quality video by converting the video content to be played through software without separate hardware equipment.

By determining the quality enhancement operation conditions of the video played in the video service, the video can be converted into a quality-enhanced video through a quality processing operation, and the converted quality-enhanced video can be played through the video service.

A video quality enhancement method executed on a computer device, wherein the computer device includes at least one processor configured to execute computer-readable instructions included in a memory, and the video quality enhancement method includes: determining quality enhancement operation conditions in relation to a video played in a video service; and executing, by the at least one processor, a quality processing operation on the video included in the quality enhancement operation condition through the determination.

The determining step may include determining whether the user's video editing request for the video played in the video service is included in the quality enhancement operation conditions for the video played in the video service.

The determining step may include receiving a user's video editing request for slow motion of a video played on the video service.

The determining step may include receiving a user's video editing request to enlarge a portion of the screen of the video played on the video service.

The determining step may include determining whether quality information of a video played in the video service or an electronic device running a video played in the video service is included in the quality enhancement operation condition.

The determining step may include detecting a decrease in the frame rate of the video played on the video service.

The determining step may include detecting a decrease in resolution of the video played on the video service.

The determining step may include determining whether display environment information of the electronic device executing the video service is set to output a resolution higher than a preset standard.

The executing step includes determining at least one quality processing operation including video frame interpolation or video super resolution of the video played in the video service according to the quality enhancement operation condition. May include steps.

The executing step may include playing the quality enhanced video converted according to the determined at least one quality processing operation on the video service.

The quality enhancement operating conditions include a user's video editing request to enlarge the screen portion of the video played in the video service, a decrease in resolution played in the video service, or a display of an electronic device running a video played in the video service. If the environment information includes any one condition information among the resolution information set, it may be decided to perform video super-resolution from the server.

The quality enhancement operation condition includes a video frame from the server when any of condition information of a user's video editing request for slow motion of a video played in the video service or a frame rate reduction of a video played in the video service is included. It may be decided to perform interpolation.

The executing step may include receiving a quality-enhanced video converted from a low frame rate video to a high frame rate video through video frame interpolation for the video played in the video service.

The executing step may include receiving a quality-enhanced video converted from a low-resolution video to a high-resolution image through video super-resolution for the video played in the video service.

The executing step may include recommending a quality enhancement operation mode through monitoring conditions related to video played on the video service.

It may include a computer program stored in a non-transitory computer-readable recording medium for executing the video quality enhancement method on the computer device.

It may include a non-transitory computer-readable recording medium on which a program for executing a video quality enhancement method on a computer is recorded.

The computer device includes at least one processor configured to execute computer readable instructions included in a memory, wherein the at least one processor determines a quality enhancement operation condition with respect to video played in a video service, and makes the determination. Through this, a quality processing operation can be performed on the video included in the quality enhancement operation conditions.

Video quality can be enhanced by performing a quality processing operation on the video included in the quality enhancement operation conditions.

Quality processing, including video frame interpolation or video super-resolution, enables quality-enhanced video playback in video services.

1 is a diagram illustrating an example of a network environment according to an embodiment.
Figure 2 is a block diagram illustrating an example of a computer device according to an embodiment.
Figure 3 is a flowchart showing an example of a method that a computer device can perform according to an embodiment.
FIG. 4 is a flowchart illustrating a method of determining a quality processing operation of a video played in a video service, according to an embodiment.
Figure 5 is a diagram for explaining a video quality enhancement operation, according to one embodiment.
Figure 6 is an example to explain the operation of playing quality enhanced video in a video service, according to one embodiment.
Figure 7 is a diagram for explaining an operation of selecting a user's video editing request, according to one embodiment.
Figure 8 is a diagram for explaining an operation of recommending a quality enhancement operation mode, according to an embodiment.
Figure 9 is a diagram for explaining a video resolution conversion operation to enhance video quality, according to one embodiment.
FIG. 10 is a diagram illustrating a video frame interpolation operation for video quality enhancement, according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

In the embodiment, a technology for enhancing video quality will be described.

Embodiments including those specifically disclosed in this specification can enhance video quality by performing a quality processing operation on a video according to video quality enhancement operation conditions.

The video quality enhancement system according to embodiments of the present invention may be implemented by at least one computer device, and the video quality enhancement method according to embodiments of the present invention may be implemented by at least one computer device included in the video quality enhancement system. It can be performed through . At this time, the computer program according to an embodiment may be installed and driven in the computer device, and the computer device may perform the video quality enhancement method according to the embodiments under the control of the driven computer program. The above-described computer program can be combined with a computer device and stored on a computer-readable recording medium to execute the video quality enhancement method on the computer.

1 is a diagram illustrating an example of a network environment according to an embodiment. The network environment in FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, and 140, a plurality of servers 150 and 160, and a network 170. Figure 1 is an example for explaining the invention, and the number of electronic devices or servers is not limited as in Figure 1. In addition, the network environment in FIG. 1 only explains one example of environments applicable to the present embodiments, and the environment applicable to the present embodiments is not limited to the network environment in FIG. 1.

The plurality of electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals implemented as computer devices. Examples of the plurality of electronic devices 110, 120, 130, and 140 include smart phones, mobile phones, navigation devices, computers, laptops, digital broadcasting terminals, Personal Digital Assistants (PDAs), and Portable Multimedia Players (PMPs). ), tablet PC, etc. For example, in FIG. 1, the shape of a smartphone is shown as an example of the electronic device 110, but in embodiments, the electronic device 110 actually communicates with other electronic devices through the network 170 using a wireless or wired communication method. It may refer to one of a variety of physical computer devices capable of communicating with (120, 130, 140) and/or servers (150, 160).

The communication method is not limited, and may include not only a communication method utilizing a communication network that the network 170 may include (for example, a mobile communication network, wired Internet, wireless Internet, and a broadcast network), but also short-range wireless communication between devices. For example, the network 170 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , may include one or more arbitrary networks such as the Internet. Additionally, the network 170 may include any one or more of network topologies including a bus network, star network, ring network, mesh network, star-bus network, tree or hierarchical network, etc. Not limited.

Each of the servers 150 and 160 is a computer device or a plurality of computers that communicate with a plurality of electronic devices 110, 120, 130, 140 and a network 170 to provide commands, codes, files, content, services, etc. It can be implemented with devices. For example, the server 150 may be a system that provides a service (for example, a video quality enhancement service, etc.) to a plurality of electronic devices 110, 120, 130, and 140 connected through the network 170. .

Figure 2 is a block diagram illustrating an example of a computer device according to an embodiment. Each of the plurality of electronic devices 110, 120, 130, and 140 described above or each of the servers 150 and 160 may be implemented by the computer device 200 shown in FIG. 2.

As shown in FIG. 2, this computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input/output interface 240. The memory 210 is a computer-readable recording medium and may include a non-permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. Here, non-perishable large-capacity recording devices such as ROM and disk drives may be included in the computer device 200 as a separate permanent storage device that is distinct from the memory 210. Additionally, an operating system and at least one program code may be stored in the memory 210. These software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such separate computer-readable recording media may include computer-readable recording media such as floppy drives, disks, tapes, DVD/CD-ROM drives, and memory cards. In another embodiment, software components may be loaded into the memory 210 through the communication interface 230 rather than a computer-readable recording medium. For example, software components may be loaded into memory 210 of computer device 200 based on computer programs installed by files received over network 170.

The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, processor 220 may be configured to execute received instructions according to program code stored in a recording device such as memory 210.

The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (eg, the storage devices described above) through the network 170. For example, a request, command, data, file, etc. generated by the processor 220 of the computer device 200 according to a program code stored in a recording device such as memory 210 is transmitted to the network ( 170) and can be transmitted to other devices. Conversely, signals, commands, data, files, etc. from other devices may be received by the computer device 200 through the communication interface 230 of the computer device 200 via the network 170. Signals, commands, data, etc. received through the communication interface 230 may be transmitted to the processor 220 or memory 210, and files, etc. may be stored in a storage medium (as described above) that the computer device 200 may further include. It can be stored as a permanent storage device).

The input/output interface 240 may be a means for interfacing with the input/output device 250. For example, input devices may include devices such as a microphone, keyboard, or mouse, and output devices may include devices such as displays and speakers. As another example, the input/output interface 240 may be a means for interfacing with a device that integrates input and output functions, such as a touch screen. The input/output device 250 may be configured as a single device with the computer device 200.

Additionally, in other embodiments, computer device 200 may include fewer or more components than those of FIG. 2 . However, there is no need to clearly show most prior art components. For example, the computer device 200 may be implemented to include at least some of the input/output devices 250 described above, or may further include other components such as a transceiver, a database, etc.

Hereinafter, specific embodiments of the video quality enhancement method and device will be described.

The computer device 200 according to the embodiment may provide a video service to a client through a dedicated application installed on the client or a connection to a web/mobile site related to the computer device 200. The computer device 200 may be configured with a computer-implemented video quality enhancement system. For example, a video quality enhancement system may be implemented in the form of a program that operates independently, or may be implemented in the form of an in-app of a specific application so that it can operate on the specific application.

The processor 220 of the computer device 200 may be implemented as a component for performing the following video quality enhancement method. Depending on the embodiment, components of the processor 220 may be selectively included in or excluded from the processor 220. Additionally, depending on the embodiment, components of the processor 220 may be separated or merged to express the functions of the processor 220.

The processor 220 and its components may control the computer device 200 to perform steps included in the video quality enhancement method below. For example, the processor 220 and its components may be implemented to execute instructions according to the code of an operating system included in the memory 210 and the code of at least one program.

Here, the components of the processor 220 may be expressions of different functions performed by the processor 220 according to instructions provided by program codes stored in the computer device 200.

The processor 220 may read necessary instructions from the memory 210 where instructions related to controlling the computer device 200 are loaded. In this case, the read command may include an command for controlling the processor 220 to execute steps that will be described later.

Steps including the video quality enhancement method to be described later may be performed in an order different from the order shown, and some of the steps may be omitted or additional processes may be included.

In the embodiment, an operation to enhance the quality of a video by determining quality enhancement operation conditions in relation to a video played in a video service will be described.

Figure 3 is a flowchart showing an example of a method that a computer device can perform according to an embodiment.

In step S310, the processor 220 may determine quality enhancement operation conditions related to the video played in the video service. The processor 220 may determine quality information of video played in a video service. The processor 220 may determine whether quality information including the frame rate (fps) and resolution of the video played in the video service are included in the quality-enhanced operation condition. For example, the processor 220 may determine quality information for a video played in a video service for a preset time. The processor 220 may detect that the frame rate of the video is reduced for a preset time, or may detect that the resolution of the video is reduced. Additionally, the processor 220 may determine whether a user's video editing request for a video played in a video service is included in the quality enhancement operating conditions for a video played in a video service. For example, the processor 220 may receive a user's video editing request for enlarging a portion of the screen or slow motion of a video played on a video service through a video service. Additionally, the processor 220 may detect display environment information of an electronic device executing a video service. For example, the processor 220 may determine whether the electronic device or an external electronic device connected to the electronic device has a high-resolution display.

In step S320, the processor 220 may perform a quality processing operation on the video included in the determined quality enhancement operation condition. Referring to FIG. 4, it is a flowchart for explaining a method of determining the quality processing operation of a video played in a video service. The processor 220 may determine whether the video played in the video service is included in the quality enhancement operation condition (S410). When the video played in the video service is included in the quality enhancement operation condition, the processor 220 may determine a quality processing operation for the video played in the video service according to the determined quality enhancement operation condition (S420). The processor 220 performs video frame interpolation (S430), video super resolution (S440), or video frame interpolation + video second of the video played in the video service according to the determined quality enhancement operation conditions. Quality processing operations including resolution (S450) can be determined. For example, the processor 220 may request a user to edit a video to enlarge the screen portion of a video played in a video service, reduce the resolution played in a video service, or perform an electronic device that executes a video played in a video service. If any one of the set resolution information is included in the display environment information, it may be decided to perform video super-resolution from the server. In addition, the processor 220 performs video frame interpolation from the server when the video service includes condition information such as a user's video editing request for slow motion of the video played or a frame rate reduction of the video played in the video service. You can decide to do it. In addition, the processor 220 may determine that the video frame interpolation operation and the super-resolution operation are performed sequentially or simultaneously when the video played in the video service includes both quality enhancement operation conditions including video frame interpolation and video super-resolution. . As another example, processor 220 may use a learning model for quality processing operations to determine quality processing operations, including video frame interpolation or video super-resolution. At this time, the learning model can classify the quality processing operation by learning the user's preference pattern of the video watched by the user or the preference pattern using the preference category (eg, action). For example, the processor 220 may determine to perform video super-resolution to increase resolution as it is determined that the user prefers 1080p picture quality in the video service. Additionally, the processor 220 may determine to perform video frame interpolation so that the user can view action scenes more naturally and smoothly as it is determined that the user frequently watches videos containing action in the video service.

Referring to FIG. 9, a video resolution conversion operation to enhance video quality will be described. Video Super Resolution (SR) refers to a technology that converts low-resolution video into high-resolution video, and exists in a variety of ways, from methods such as Nearest Neighbor, Bilinear, and Bicubic to methods using deep learning technology. The processor 220 can convert low-resolution video into high-resolution video using various video super-resolution technologies. Referring to FIG. 10, this is a diagram to explain a video frame interpolation operation for video quality enhancement. Video frame interpolation is a technology that combines several frames in the middle of two adjacent frames of an original video composed of frames. For example, by combining the first frame and the third frame, the The second frame is derived. There are a variety of video frame interpolation technologies, including CNN-based, PAHSE-based, Flow-based, GAN-based, and Hybrid-based. For example, finding out how an object moves in a frame at the pixel level, or concatenating two resulting candidate frames generated by warping each of two frames, inputting a concatenated frame into a refinement network. Thus, video frame interpolation can be performed.

The processor 220 may receive quality-enhanced video converted from low frame rate video to high frame rate video through video frame interpolation for video played in a video service. The processor 220 can receive quality-enhanced video converted from a low-resolution video to a high-resolution image through video super-resolution for the video played in the video service. The processor 220 may play the quality-enhanced video converted through at least one quality processing operation including video frame interpolation or video super-resolution on a video service.

Figure 5 is a diagram for explaining a video quality enhancement operation, according to one embodiment.

The video quality enhancement server may store video information related to the video uploaded through the video service 510 in the video storage 501. At this time, the video information stored in the video storage 501 may store the original video and quality information of the original video.

A user can run the video service 510 using the electronic device 110. The video service 510 can play the uploaded video according to the user's video upload request. In an environment where video is played through the video service 510, quality enhancement operating conditions may be determined with respect to the video.

The logic of the quality enhancement operation condition is when the display resolution information of the user's electronic device or an external electronic device connected to the electronic device requires a resolution (higher resolution) higher than the preset standard or when a decrease in the resolution of the original video is detected. Video super-resolution operation is performed when partial screen enlargement is requested, and video frame interpolation operation is performed when slow motion is requested from the user and a decrease in the frame rate of the original video is detected. These quality enhancement operating conditions are only examples and are not limited thereto.

Quality processing for video played to the video service 510 may be requested from the processor 220. For example, a user may request video editing for slow motion or partial screen enlargement of a video played on the video service 510 using the electronic device 110. Slow motion refers to the effect of making the movement of the video screen played on a video service appear slower. Since it is played at a slower speed than the actual speed, the higher the number of frame rates of the video, the more natural the slow motion video appears. Partial screen enlargement means that the screen size is enlarged for the area desired by the user regarding the video played in the video service. As the video screen is enlarged, the resolution decreases. In this way, AI video quality enhancement ( 540) The operation can be performed.

Alternatively, a request for quality processing for the video may be sent to the video quality enhancement server according to the operating environment of the video detected by the processor 220 and the electronic device running the video played on the video service 510 or the video played on the video service 510. An AI video quality enhancement operation 540 may be performed. For example, when the display environment information of the electronic device 110 or an external electronic device (for example, a TV) connected to the electronic device is set to high resolution, the processor 220 uses a video quality enhancement server to provide video quality information. You can request processing. Alternatively, the processor 220 may request quality processing for the video from the video quality enhancement server as it detects a decrease in frame rate or resolution of the video played in the video service 510. Alternatively, the video quality enhancement server may perform an AI video quality enhancement 540 operation as it is determined that the frame rate or resolution of the original video stored in the video storage 501 is below a preset standard.

The video quality enhancement server may perform an AI video quality enhancement 540 operation according to a quality processing request from the processor 220 for quality enhancement operation conditions. The video quality enhancement server may perform at least one quality processing operation including video frame interpolation 520 or video super-resolution 530 to enhance video quality according to quality enhancement operation conditions. The video enhancement server can generate quality-enhanced video by performing video frame interpolation through the GPU server. Additionally, the video quality enhancement server may generate quality enhanced video by performing video super-resolution 530 through the GPU server. For example, the video quality enhancement server may perform video frame interpolation 520 when one of the quality enhancement operating conditions includes a user's editing request for slow motion or a reduction in the frame rate of the video. The video quality enhancement server provides video super-resolution when any of the quality enhancement operation conditions include a user's editing request to enlarge a portion of the screen, a decrease in video resolution, or a case where the display environment information of an electronic device playing a video service requires high resolution. (530) can be performed. For example, the video enhancement server may perform video frame interpolation 520 for the video and then video super-resolution 530, or the video enhancement server may perform video super-resolution 530 for the video. ), video frame interpolation 520 can be performed.

The quality enhancement server may transmit the quality enhancement video converted from a low frame rate video to a high frame rate video to the video service 510 through video frame interpolation for the video played on the video service 510. The video quality enhancement server can transmit the quality-enhanced video converted from a low-resolution video to a high-resolution image to the video service 510 through the video super-resolution for the video played on the video service 510. Quality-enhanced video may be played in the video service 510. For example, slow motion or partial image enlargement may be performed using quality enhanced video played on the video service 510.

Figure 6 is an example to explain the operation of playing quality enhanced video in a video service, according to one embodiment.

The processor 220 may output video played through a video service to the video service screen 600. A video service may provide a service that plays and controls videos uploaded by users. For example, video services may be provided by various services such as video players, social network services, and messaging services. For example, the processor 220 may execute a video service provided by a messaging service. The processor 220 can play video through a video service provided by a messaging service.

The processor 220 can play a video uploaded by a user through a video service. For example, the processor 220 may provide a user interface for uploading a video to a video service and receive that at least one video is uploaded through the provided user interface. At this time, if one video is uploaded, the video service may be terminated after one video is played, and if two or more videos are uploaded, the videos may be played in the order in which they were uploaded. In addition, the processor 220 provides a user interface for controlling the video uploaded to the video service, and plays, stops, pauses, records, and reverts the uploaded video based on the user's control command through the provided user interface. You can perform functions such as:

As the processor 220 determines the quality enhancement operation condition in relation to the video played in the video service, it may perform a quality processing operation on the video included in the quality enhancement operation condition. As shown in FIG. 6, the processor 220 plays the quality-enhanced video converted through quality information of the video played on the video service, display quality information of the electronic device, and quality processing for the user's editing request on the video service. You can do it. In this way, a video with improved quality may be output on the video service screen 600 on the right compared to the video output on the video service screen 600 on the left of FIG. 6 .

Figure 7 is a diagram for explaining an operation of selecting a user's video editing request, according to one embodiment.

The processor 220 may display a user interface 710 for receiving a user's video editing request on the video service screen 600 in an environment where a video is played through a video service. The user interface 710 for receiving a user's video editing request shown in FIG. 7 is only an example, and the shape and location of the user interface are not limited thereto. The processor 220 may provide user interfaces 720 and 730 for slow motion and partial screen enlargement as the interface for receiving the user's video editing request is selected. The processor 220 may receive from the user that the user interface 720 for slow motion or the user interface 730 for partial screen enlargement is selected.

Figure 8 is a diagram for explaining an operation of recommending a quality enhancement operation mode, according to an embodiment.

In an environment where video is played through a video service, the processor 220 may recommend a quality enhancement operation mode on the video service screen 600 through status monitoring related to the video played through the video service. The processor 220 may perform state monitoring related to the video while the video is played in a video service in real time or periodically/non-periodically. At this time, status monitoring related to the video played in the video service can also be performed on the server. For example, the processor 220 may analyze display environment information (e.g., resolution) of an electronic device playing a video service or an external electronic device connected to the electronic device through status monitoring related to the video. If the display resolution of the electronic device or external electronic device is set to output at high resolution, the processor 220 may recommend a quality enhancement operation mode through the video service. Alternatively, the processor 220 may analyze a decrease in resolution or frame rate of the video through status monitoring related to the video. The processor 220 may display the user interface 800 on the video service screen 600 to inquire whether to enter the quality enhancement operation mode through video-related status monitoring. At this time, the user interface that queries whether to enter the quality enhancement operation mode may be displayed in various forms such as a pop-up window, message, or push. The processor 220 may enter the quality enhancement operation mode in response to a positive response (yes) received through a user interface that queries whether to enter the quality enhancement operation mode. When the processor 220 enters the quality enhancement operation mode, it can play the converted quality enhanced video through quality processing of the video played in the video service. If a negative response is received through a user interface that queries whether to enter the quality enhancement operation mode, the processor 220 may output the video being played on the video service as is. In this way, the recommendation of the quality enhancement operation mode prevents conversion into artificial video by simply increasing the frame rate or resolution, and allows it to be selectively applied according to the user's choice or display environment.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), etc. , may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. It can be embodied in . Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (20)

In a method of video quality enhancement performed on a computer device,
The computer device includes at least one processor configured to execute computer-readable instructions contained in a memory,
The video quality enhancement method is,
determining, by the at least one processor, a quality enhancement operating condition with respect to video played on a video service; and
Executing, by the at least one processor, a quality processing operation on a video included in the quality enhancement operation condition through the determination.
Video quality enhancement method comprising: According to paragraph 1,
The above judgment step is,
Determining whether a user's video editing request for a video played in the video service is included in the quality enhancement operation conditions for the video played in the video service
Video quality enhancement method comprising: According to paragraph 2,
The above judgment step is,
Receiving a user's video editing request for slow motion of a video played on the video service
Video quality enhancement method comprising: According to paragraph 2,
The above judgment step is,
Receiving a video editing request from a user to enlarge a portion of the screen of a video played on the video service through the video service
Video quality enhancement method comprising: According to paragraph 1,
The above judgment step is,
Determining whether quality information of the video played in the video service or the electronic device running the video played in the video service is included in the quality enhancement operation condition.
Video quality enhancement method comprising: According to clause 5,
The above judgment step is,
Detecting a decrease in the frame rate of video played on the video service
Video quality enhancement method comprising: According to clause 5,
The above judgment step is,
Detecting a decrease in resolution of video played on the video service
Video quality enhancement method comprising: According to clause 5,
The above judgment step is,
Determining whether the electronic device running the video service is set to output a resolution higher than a preset standard based on display environment information
Video quality enhancement method comprising: According to paragraph 1,
The steps to execute are:
Determining at least one quality processing operation including video frame interpolation or video super resolution of the video played in the video service according to the quality enhancement operation condition.
Video quality enhancement method comprising: According to clause 9,
The steps to execute are:
Playing the quality-enhanced video converted according to the determined at least one quality processing operation on the video service.
Video quality enhancement method comprising: According to clause 9,
The quality enhancement operation conditions are,
Among the user's video editing requests to enlarge the screen portion of the video played in the video service, reduce the resolution played in the video service, or resolution information set in the display environment information of the electronic device running the video played in the video service. A method for enhancing video quality, characterized in that it is determined to perform video super-resolution from the server when any one condition information is included. According to clause 9,
The quality enhancement operation conditions are,
When the video service includes condition information such as a user's video editing request for slow motion of a video played in the video service or a frame rate reduction of the video played in the video service, it is determined to perform video frame interpolation from the server. Featured video quality enhancement methods. According to clause 9,
The steps to execute are:
Receiving a quality-enhanced video converted from a low frame rate video to a high frame rate video through video frame interpolation for the video played in the video service.
Video quality enhancement method comprising: According to clause 9,
The steps to execute are:
Receiving a quality-enhanced video converted from a low-resolution video to a high-resolution image through video super-resolution for the video played in the video service.
Video quality enhancement method comprising: In number 1,
The steps to execute are:
Recommending a quality enhancement operation mode through monitoring conditions related to video played in the video service.
Video quality enhancement method comprising: A computer program stored in a non-transitory computer-readable recording medium for executing the video quality enhancement method of any one of claims 1 to 15 on the computer device. A non-transitory computer-readable recording medium recording a program for executing the video quality enhancement method of any one of claims 1 to 15 on a computer. In computer devices,
At least one processor configured to execute computer readable instructions contained in memory
Including,
The at least one processor,
Determine quality enhancement operation conditions in relation to video played in a video service,
Executing a quality processing operation on the video included in the quality enhancement operation condition through the determination
A computer device characterized in that. According to clause 18,
The at least one processor,
Determining at least one quality processing operation including video frame interpolation or video super resolution of the video played in the video service according to the quality enhancement operation conditions.
A computer device characterized in that. According to clause 19,
The at least one processor,
Playing the quality-enhanced video converted according to the determined at least one quality processing operation to the video service.
A computer device characterized in that.

Images