WO2020111333A1 - Système d'amélioration de la qualité d'image et procédé associé - Google Patents

Système d'amélioration de la qualité d'image et procédé associé Download PDF

Info

Publication number
WO2020111333A1
WO2020111333A1 PCT/KR2018/015028 KR2018015028W WO2020111333A1 WO 2020111333 A1 WO2020111333 A1 WO 2020111333A1 KR 2018015028 W KR2018015028 W KR 2018015028W WO 2020111333 A1 WO2020111333 A1 WO 2020111333A1
Authority
WO
WIPO (PCT)
Prior art keywords
image quality
user command
image
quality improvement
dictionary
Prior art date
Application number
PCT/KR2018/015028
Other languages
English (en)
Korean (ko)
Inventor
박종빈
정종진
박성주
김경원
Original Assignee
전자부품연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 전자부품연구원 filed Critical 전자부품연구원
Publication of WO2020111333A1 publication Critical patent/WO2020111333A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/60—Memory management
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems

Definitions

  • the present invention relates to a system and method for improving image quality.
  • the present invention has been proposed to solve the above-mentioned problems, and it is possible to indicate an image quality improvement direction or an image quality improvement purpose through text or voice received from a service requester, and a large amount of data without a complicated user interface.
  • An object of the present invention is to provide a system and method for improving image quality capable of processing.
  • the image quality improvement system includes a receiver for receiving image data and a user command, and a processor for executing a memory and a program in which a program for performing image quality improvement for an object of interest in the image data according to the user command is stored,
  • the processor is characterized in that it analyzes a user command to determine a detection area and an image quality restoration method of image data, and performs image quality improvement.
  • the image quality improvement method includes receiving image data and a user command, analyzing a user command to determine a user's intention, and performing image restoration on a detection area of the image data according to the user's intention And, it characterized in that it comprises a step of performing an image quality improvement.
  • an embodiment of the present invention it is possible to grasp a user's intention by analyzing a user command (voice, text, etc.), and perform image quality improvement on an object of interest in an image according to the user's intention, without a complicated user interface. It is possible to provide an image quality improvement service.
  • FIG. 1 and 2 are block diagrams illustrating an image quality improvement system according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating a method for improving image quality according to an embodiment of the present invention.
  • FIG. 1 is a block diagram showing an image quality improvement system according to an embodiment of the present invention.
  • An image quality improvement system includes a receiver 100 that receives image data and a user command, and a program that performs image quality improvement on an object of interest in image data (still image, video) according to a user command. It includes a stored memory 200 and a processor 300 for executing a program, and the processor 300 analyzes a user command to determine a detection area and an image quality restoration method of image data, and performs image quality improvement.
  • the receiving unit 100 receives a user command in the form of voice or text, and when the receiving unit 100 receives the voice information, the processor 300 converts it into a text type sentence.
  • the processor 300 analyzes the user command in a morphological unit to obtain a key word, and detects the similarity to the word included in the first dictionary related to the detectable area and the second dictionary related to the image quality restoration method for the key word do.
  • the first dictionary is a dictionary mapping related words for detectable regions
  • the second dictionary is a dictionary mapping related words related to image quality restoration processing technology.
  • the processor 300 calculates the similarity between the key words obtained as a result of the analysis of the user command and the words included in the first dictionary and the second dictionary, and performs area detection on areas where the similarity is greater than or equal to a preset threshold.
  • the image quality restoration processing is performed using a picture quality restoration processing technique in which the similarity is equal to or greater than a predetermined threshold.
  • the processor 300 extracts a still image from the moving image and repeatedly processes region detection and image quality restoration.
  • FIG. 2 is a block diagram showing an image quality improvement system according to an embodiment of the present invention.
  • a blurry object of interest (O_0) is converted into an object of interest (O_1) with improved image quality.
  • the image quality to be improved for the detection area A_0 is improved, but the final image to be provided is provided only to the object of interest (O_1) having improved image quality, or as the image I_1 having the same size as the received image. You may.
  • the service requester is a monitoring agent of the Video Management System (VMS).
  • VMS Video Management System
  • the service requester is an employee who works for the police station, "Please increase the image quality of a person with a black hair 180cm tall”, “OOO OO minutes, increase the image quality of cars in certain OO regions", “Red cars "Please show me clearly”.
  • a voice recognition unit 310 for receiving voice information as a user command and a sentence analysis unit 320 for receiving text information as a user command are included.
  • the speech recognition unit 310 uses the Speech To Text engine to create a text-type sentence, and the text-type sentence is provided as an input of the sentence analysis unit 320.
  • the sentence analysis unit 320 may receive a sentence directly from the service requester, and may also be provided with a text sentence through the voice recognition unit 310.
  • the speech recognition unit 310 and the sentence analysis unit 320 acquire "information for detecting which areas to be detected (detection area)" and “how to restore image quality” Information (how to restore image quality)".
  • the area detection unit 330 receives a result of analyzing a user command from the sentence analysis unit 320.
  • the area detection unit 330 detects "face area”, “body area”, “leg area”, “whole area”, and “car area” through image processing, and detectable areas are continuously added to perform This can be improved.
  • the region detection unit 330 determines a detection region by using a dictionary (first dictionary) that maps related words to detectable regions.
  • Face area ⁇ Face, old man, elderly, infant, child, impression, face, head, glasses, nose, mouth, ear, cheek, cheek, sunglasses, hat, muffler, scarf, mask, .... ⁇ Body area ⁇ Body, shoulder, belly, belly, chest, chest, ... ⁇ Leg area ⁇ Legs, feet, knees, shins, thighs, ... ⁇ Whole body area ⁇ Elderly, elderly, infant, child, full body, whole body, person, man, woman, human, ... ⁇ Automotive area ⁇ Car, car, wheel, license plate, vehicle, escape vehicle, taxi, bus, truck ... ⁇
  • the sentence analysis unit 320 obtains a key word by decomposing sentence information (a sentence as a result of converting an input sentence or an input voice) corresponding to a user command provided by a service requester into morphological units.
  • the area detection unit 330 compares the obtained key keyword with a word included in the first dictionary, and calculates the similarity using a metric such as cosine similarity.
  • the area detection unit 330 performs area detection on areas having a similarity level greater than or equal to a threshold.
  • word analysis techniques such as word2vec technology, TF-IDF (Term Frequency-Inverse Document Frequency), Latent Semantic Analysis, and Latent Dirichlet allocation, which map word sets to a high-dimensional vector space and support similarity calculation. .
  • the image quality restoration unit 340 can improve JPEG image quality, improve super resolution, improve blur area, improve noise, and improve depth of field as an image processing method.
  • the image quality restoration unit 340 uses a dictionary (second dictionary) including words related to image quality restoration processing technology.
  • JPEG quality improvement ⁇ Linging phenomenon, blocking shape, JPEG, dices, dices, blocking, grid pattern removal, ... ⁇
  • Super Resolution Improvement ⁇ Low pixel, high definition, resolution increase, super resolution, image growth, ... ⁇ Blur area improvement ⁇ Night, Cloudy, Blur, Motion, Motion Blur, Motion Blur, .... ⁇ Noise improvement ⁇ Noise, sizzling, jizzling, salt pepper, low light, darkness, gain, ... ⁇ Depth improvement ⁇ Multifocal, depth improvement, DOF, depth of field, ... ⁇
  • the sentence analysis unit 320 obtains a key word by decomposing sentence information (a sentence as a result of converting an input sentence or an input voice) corresponding to a user command provided by a service requester into morphological units.
  • the image quality restoration unit 340 calculates the similarity using metrics such as cosine similarity by comparing key keywords with words in the second dictionary.
  • the image quality restoration unit 340 performs image quality restoration processing using an image quality restoration processing technique having a similarity of a threshold or higher.
  • a service requester may be provided with a plurality of processed images. For example, if “face area” and “whole area” are detected and blur area improvement and noise improvement are performed for each area, Results such as “Block area improvement” for “Face area”, “Noise improvement” for “Face area”, “Blur area improvement” and “Noise improvement” for "Full area” are processed simultaneously Can be.
  • a service requester who wants to receive a service to provide a still image or video that needs to be improved to the service platform, and to indicate the direction or purpose of improving the image quality through text or voice.
  • the service requester when the service requester according to the embodiment of the present invention is a monitoring agent of the Video Management System (VMS) operated by a specific local government, "find the face of a 7-year-old child who is lost and make it clear without blurring.” If instructed by text or voice, the service platform according to an embodiment of the present invention may perform a quality improvement process on an object of interest to meet a user's intention, thereby providing a reconstructed image Do.
  • VMS Video Management System
  • FIG. 3 is a flowchart illustrating a method for improving image quality according to an embodiment of the present invention.
  • An image quality improvement method includes receiving image data and a user command (S310), analyzing a user command to determine a user's intention (S320), and displaying the image data according to the user's intention. And performing image quality restoration on the detection area to perform image quality improvement (S330).
  • step S310 when voice information is received by a user command, the voice information is converted into a text-type sentence.
  • Step S320 calculates the similarity between the key word obtained by analyzing the user command in morphological units and the second dictionary including the first dictionary including the related word for the detectable region and the related word for the image quality restoration method, Determine the user's intention (requests for objects of interest and how to restore image quality).
  • step S330 when the image data is a moving image, a process of restoring the image quality of the extracted detection region of the still image is repeatedly performed.
  • a method for improving image quality may be implemented in a computer system or recorded on a recording medium.
  • the computer system may include at least one processor, memory, a user input device, a data communication bus, a user output device, and storage. Each of the above-described components communicates through a data communication bus.
  • the computer system can further include a network interface coupled to the network.
  • the processor may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in memory and/or storage.
  • the memory and storage may include various types of volatile or nonvolatile storage media.
  • the memory may include ROM and RAM.
  • a method for improving image quality according to an embodiment of the present invention may be implemented in a method executable on a computer.
  • computer-readable instructions may perform the method for improving image quality according to the present invention.
  • Computer-readable recording media includes all kinds of recording media storing data that can be read by a computer system.
  • ROM read only memory
  • RAM random access memory
  • magnetic tape magnetic tape
  • magnetic disk magnetic disk
  • flash memory an optical data storage device
  • the computer-readable recording medium may be distributed over computer systems connected through a computer communication network, and stored and executed as code readable in a distributed manner.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Image Processing (AREA)

Abstract

L'invention concerne un système d'amélioration de la qualité d'image; et un procédé associé. Le système de l'invention comprend : une unité de réception de données d'image et une instruction d'utilisateur; une mémoire pour stocker un programme qui améliore la qualité d'image sur un objet d'intérêt des données d'image selon une instruction d'utilisateur; et un processeur d'exécution du programme, qui analyse l'instruction d'utilisateur pour déterminer une zone de détection des données d'image et la manière de restaurer la qualité d'image, et accomplit une amélioration de la qualité d'image.
PCT/KR2018/015028 2018-11-26 2018-11-30 Système d'amélioration de la qualité d'image et procédé associé WO2020111333A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020180147309A KR102166841B1 (ko) 2018-11-26 2018-11-26 영상 화질 개선 시스템 및 그 방법
KR10-2018-0147309 2018-11-26

Publications (1)

Publication Number Publication Date
WO2020111333A1 true WO2020111333A1 (fr) 2020-06-04

Family

ID=70852994

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/015028 WO2020111333A1 (fr) 2018-11-26 2018-11-30 Système d'amélioration de la qualité d'image et procédé associé

Country Status (2)

Country Link
KR (1) KR102166841B1 (fr)
WO (1) WO2020111333A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102599525B1 (ko) * 2023-04-10 2023-11-08 (주)클라모스 관심 이미지의 시인성을 개선한 화면 표출 방법, 장치 및 시스템
KR102608208B1 (ko) * 2023-04-10 2023-12-01 (주)클라모스 관심 이미지의 시인성을 개선한 스트리밍 서비스 방법, 장치 및 시스템
KR102589306B1 (ko) * 2023-06-29 2023-10-12 주식회사 휴데이터스 블랙박스 영상을 생성하는 방법 및 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008119151A1 (fr) * 2007-03-30 2008-10-09 Optosecurity Inc. Interface utilisateur destinée à être utilisée lors des contrôles de sécurité et comportant des fonctions d'amélioration d'image, et dispositif mettant en œuvre ladite interface
KR101185138B1 (ko) * 2005-03-09 2012-09-24 콸콤 인코포레이티드 비디오 전화기를 위한 관심 영역 추출
KR101462930B1 (ko) * 2008-04-30 2014-11-19 엘지전자 주식회사 이동 단말기 및 그 화상통화 제어방법
KR20180051772A (ko) * 2016-11-09 2018-05-17 삼성전자주식회사 영상처리장치 및 영상처리방법
KR20180055707A (ko) * 2016-03-29 2018-05-25 삼성전자주식회사 이미지 관리 방법 및 그 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101185138B1 (ko) * 2005-03-09 2012-09-24 콸콤 인코포레이티드 비디오 전화기를 위한 관심 영역 추출
WO2008119151A1 (fr) * 2007-03-30 2008-10-09 Optosecurity Inc. Interface utilisateur destinée à être utilisée lors des contrôles de sécurité et comportant des fonctions d'amélioration d'image, et dispositif mettant en œuvre ladite interface
KR101462930B1 (ko) * 2008-04-30 2014-11-19 엘지전자 주식회사 이동 단말기 및 그 화상통화 제어방법
KR20180055707A (ko) * 2016-03-29 2018-05-25 삼성전자주식회사 이미지 관리 방법 및 그 장치
KR20180051772A (ko) * 2016-11-09 2018-05-17 삼성전자주식회사 영상처리장치 및 영상처리방법

Also Published As

Publication number Publication date
KR20200061703A (ko) 2020-06-03
KR102166841B1 (ko) 2020-10-16

Similar Documents

Publication Publication Date Title
WO2020111333A1 (fr) Système d'amélioration de la qualité d'image et procédé associé
WO2018230832A1 (fr) Appareil et procédé de traitement d'images utilisant une carte de caractéristiques multicanaux
KR102299564B1 (ko) 비식별화 영상 데이터를 이용한 인공지능 학습 방법 및 시스템
EP3827366A1 (fr) Procédé d'apprentissage et de test de réseau de brouillage pouvant traiter des données à dissimuler à des fins de confidentialité, et dispositif d'apprentissage ainsi que dispositif de test l'utilisant
EP3533229A1 (fr) Systèmes et procédés d'enrichissement de données capturées
ATE203844T1 (de) Gegenstands-überwachungsystem
WO2022039319A1 (fr) Procédé de désidentification d'informations personnelles, procédé de vérification et système
WO2018151357A1 (fr) Procédé de reconnaissance de visage humain basé sur un filtre de gabor multicanal amélioré
WO2022086145A1 (fr) Procédé permettant d'entraîner et de tester un réseau de brouillage pouvant traiter des données à brouiller à des fins de confidentialité, et dispositif d'entraînement et dispositif de test faisant appel à celui-ci
KR102629732B1 (ko) 외곽선 기반 프라이버시 마스킹 장치, 외곽선 기반 프라이버시 마스킹 복원 장치 및 프라이버시 마스킹 영역 디스크립터 공유 방법
EP4232994A1 (fr) Procédé permettant d'entraîner et de tester un réseau d'apprentissage utilisateur à utiliser pour reconnaître des données brouillées créées par brouillage de données originales pour protéger des informations personnelles et dispositif d'apprentissage utilisateur et dispositif de test faisant appel à celui-ci
WO2023061082A1 (fr) Procédé et appareil de traitement de sécurité d'image, dispositif électronique et support de stockage
WO2015099249A1 (fr) Appareil et procédé de détermination d'une similarité de lésions dans une image médicale
CN111597985A (zh) 设备佩戴的动态识别方法、装置和电子设备
WO2022108057A1 (fr) Appareil multi-modal et procédé de classification d'émotions
CN112235598B (zh) 一种视频结构化处理方法、装置及终端设备
CN113963193A (zh) 车身颜色分类模型生成的方法、装置以及存储介质
WO2024101466A1 (fr) Appareil et procédé de suivi de personne disparue basé sur des attributs
CN116503596A (zh) 图片分割方法、装置、介质和电子设备
WO2022260392A1 (fr) Procédé et système pour générer un modèle de réseau neuronal artificiel de traitement d'image fonctionnant dans un terminal
CN112712015B (zh) 一种人体关键点识别方法、装置、智能终端及存储介质
WO2021261763A1 (fr) Système d'affinement de rapport de résultat d'examen pathologique par apprentissage profond fondé sur une base de données d'ontologie
WO2021118047A1 (fr) Procédé et appareil pour évaluer une responsabilité d'accident dans une image d'accident en utilisant l'apprentissage profond
CN106375773B (zh) 基于动态阈值的帧复制粘贴篡改检测方法
WO2020175729A1 (fr) Appareil et procédé pour détecter un point de caractéristique faciale à l'aide d'une carte de points caractéristiques gaussiens et d'un schéma de régression

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18941937

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18941937

Country of ref document: EP

Kind code of ref document: A1