KR20150030039A - Apparatus and method for converting tactile image from tv image and displaying - Google Patents

Apparatus and method for converting tactile image from tv image and displaying Download PDF

Info

Publication number
KR20150030039A
KR20150030039A KR20130109225A KR20130109225A KR20150030039A KR 20150030039 A KR20150030039 A KR 20150030039A KR 20130109225 A KR20130109225 A KR 20130109225A KR 20130109225 A KR20130109225 A KR 20130109225A KR 20150030039 A KR20150030039 A KR 20150030039A
Authority
KR
South Korea
Prior art keywords
image
tactile
tactile image
downsampling
output device
Prior art date
Application number
KR20130109225A
Other languages
Korean (ko)
Inventor
양규태
김태균
조용성
이용태
배병준
윤정일
임형수
허남호
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR20130109225A priority Critical patent/KR20150030039A/en
Publication of KR20150030039A publication Critical patent/KR20150030039A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Image Processing (AREA)

Abstract

The present invention relates to a tactile image conversion method, comprising: downsampling an image; Converting the downsampled image into a series of tactile images; Transmitting the converted tactile image to a tactile output device via wireless communication; And outputting the converted tactile image through the tactile output device.

Figure P1020130109225

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for converting a TV image into a tactile image,

The present invention relates to a method of converting a multimedia image into a tactile image which can be recognized by a visually impaired person and displaying the tactile image.

Due to the recent digitization of terrestrial TV, users are providing high-quality images. However, visually impaired people accept all the information by voice and audio signals and tactile signals. Therefore, they are less informed than ordinary people in recognizing such image information. In order to compensate for this, it is necessary to convert the TV image into a tactile image and provide it to the visually impaired.

Korean Patent Publication No. 2010-0125059 discloses a display system in which a user touches a screen on which an image is displayed and transmits a tactile sense that can feel a touch to the image, and a method of operating the same. The user touches the position of the image viewed through the touch screen and rubs the touch screen to touch the object displayed on the screen and proposes a method of maximizing the realism of the image information to the user.

When a TV is viewed using a conventional tactile device, it is possible to convert a TV video signal into a tactile image only if the camera installed on the tactile device accurately captures the TV screen. However, it is necessary to accurately convert the TV video signal into a tactile image and display it regardless of the position of the visually impaired.

The present invention proposes a method for converting an image of various media such as a digital TV, a terrestrial DMB, and a cable TV into a tactile image for a visually impaired person, and displaying the converted tactile image through a tactile output device.

According to another aspect of the present invention, there is provided a method of converting a tactile image, the method comprising: down sampling a video; Converting the downsampled image into a series of tactile images; And transmitting the converted tactile image to a tactile output device via wireless communication.

According to one aspect, downsampling the image includes temporally downsampling the image according to a predetermined number of frames per second.

According to another aspect, the predetermined number of frames per second provides a tactile image conversion method that is at most one frame per second.

According to another aspect, downsampling the image comprises spatial downsampling a selected frame of the image with a predetermined tactile image resolution.

According to another aspect, the predetermined tactile image resolution provides a tactile image conversion method with a resolution of up to 640 x 360.

According to another aspect, the predetermined tactile image resolution provides a tactile image conversion method that includes a brightness resolution of up to 3 bits.

According to another aspect, downsampling the image comprises: time downsampling the image according to a predetermined number of frames per second and spatial downsampling a selected frame of the image with a predetermined tactile image resolution A tactile image conversion method is provided.

According to another aspect of the present invention, there is provided a tactile image conversion method, further comprising outputting the converted tactile image through the tactile output device.

In the tactile image conversion apparatus according to an embodiment of the present invention, a downsampling unit downsamples an image video; A converting unit converting the downsampled image into a series of tactile images; A transmitting unit for transmitting the converted tactile image to a tactile output device through wireless communication; And an output unit for outputting the converted tactile image through the tactile output unit.

According to one aspect, the downsampling unit temporally downsamples the image according to a predetermined number of frames per second, and downsamples the selected frame of the image by a predetermined tactile image resolution.

The present invention can reduce the error caused when converting to a tactile image, so that the user can recognize the entire outline level of the image through the outputted tactile image, and understand the whole image contents with the voice.

1 is a view showing an operation of converting a tactile image in the tactile image conversion apparatus according to an embodiment of the present invention.
2 is a block diagram showing a configuration of a tactile image conversion apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating a tactile image conversion method according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing an operation of converting a tactile image in the tactile image conversion apparatus according to an embodiment of the present invention.

Assistive devices that help the visually impaired to communicate include voice synthesizers, braille printers, computer braille printing systems, and plain point pens. In the present invention, an operation of converting a downsampled image into a tactile image through the tactile image conversion device and outputting a tactile image through the tactile output device will be described.

FIG. 1 illustrates the operation of the tactile image transformation apparatus 100. The tactile image transformation apparatus 100 includes an auxiliary device 110 capable of helping the user to recognize the tactile image 113 through the operation between the image device 110 and the tactile output device 120. FIG. to be. At this time, the video apparatus 110 may be a video output apparatus capable of reproducing multimedia such as TV, video, and moving picture.

The tactile image 113 has a difference in sensitivity with respect to the reaction depending on the combination of related factors such as the speed of the stimulus, the depth of the stimulus, the intensity of the force, and the like on the contact surface such as the human hand. It is necessary to perform the down-sampling 112 with a resolution and a frame enough for a human to recognize the image 111. [

The tactile image transformation apparatus 100 may set the tactile image resolution to be used in the tactile output unit 120 to convert the image 111 to the tactile image 113 and then downsample 112 the image 111 have. At this time, the tactile image transformation apparatus 100 performs time downsampling on the basis of the predetermined number of frames per second when the downsampling is performed, and outputs the selected frame of the image 111 as a predetermined tactile image Downsampling can be performed. For example, the tactile image transformation apparatus 100 may downsample the image 111 to a resolution sufficient for the visually impaired to recognize the selected frame of the image 111 at a maximum of about 640 x Spatial downsampling can be performed at a resolution of 360. In addition, the tactile image transformation apparatus 100 can space-sample an image with a brightness resolution of up to 3 bits, and time downsample the image at a maximum of one frame per second.

The tactile image conversion apparatus 100 may convert the downsampled image into a tactile image 113 and then transmit the converted tactile image 113 to the tactile output unit 120 through the wireless communication units 131 and 132. For example, the tactile image conversion apparatus 100 can transmit the tactile image 113 converted via Bluetooth, which is the short-distance wireless communication 131, 132, to the tactile output device 120. [ The tactile image conversion apparatus 100 can output the converted tactile image 113 through the tactile output unit 120. [

The wireless communication units 131 and 132 are capable of communicating information such as signals, codes, images, and sounds through radio waves without passing through wires between two points. Wi-Fi, 3G, LTE, WiBro, ZigBee Bluetooth, and the like are examples of the types of the wireless communication 131 and 132, and Bluetooth according to the present invention is a short-range wireless communication.

Bluetooth refers to a short-range wireless technology standard that exchanges information by connecting mobile devices such as mobile phones, notebooks, earphones, and headphones. It is used when low-power wireless connections are needed in very short distances, typically around 10 meters. For example, with a Bluetooth headset, you can listen to music from your MP3 player in your pocket without the hassle of cables. Bluetooth wireless systems use the Industrial Scientific and Medical (ISM) frequency band of 2400 to 2483.5 MHz. ISM is a frequency band allocated for industrial, scientific, and medical use, and is often used for personal wireless devices that emit low-power radio waves without the need for permission to use radio waves.

In the present invention, the tactile image converted from the image device 110 is transmitted to the tactile output device 120 at a distance of about 10 meters using Bluetooth during wireless communication between the image device 110 and the tactile output device 120, The output device 120 may receive the converted tactile image from the imaging device 110. [

The tactile image conversion apparatus according to an exemplary embodiment of the present invention may downsample an image, convert the downsampled image into a series of tactile images, and transmit the converted tactile image to a tactile output unit through wireless communication, It is possible to provide a device capable of effectively recognizing the tactile image displayed through the display device.

Downsampling 112 may time downsample the image 111 according to the number of frames per second and space downsample a selected frame of the image 111 to a predetermined tactile image. Since downsampling reduces the number of frames and resolution, differences from the original image can occur. In the present invention, downsampling performs time downsampling of an image at a maximum rate of 1 frame per second, spatial down-sampling of a selected frame of the image at a maximum resolution of 640 x 360 or a selected frame of the image at a brightness resolution of 3 bits at maximum So that the difference from the original image can be minimized.

 The tactile image conversion apparatus according to an exemplary embodiment can provide a tactile image together with voice by connecting to a video device, so that the visually impaired person can more effectively recognize the overall outline of the image.

2 is a block diagram showing a configuration of a tactile image conversion apparatus according to an embodiment of the present invention.

The tactile image conversion apparatus 200 may include a downsampling unit 210, a conversion unit 220, a transmission unit 230, and an output unit 240. The tactile image conversion device 200 can transmit a tactile image through wireless communication between the image device and the tactile output device. At this time, the video apparatus can be a video output apparatus capable of reproducing multimedia such as TV, video, and moving picture. In the present invention, the tactile image conversion device 200 transmits a tactile image to the tactile output device using Bluetooth, which is a short distance wireless communication during wireless communication, and the tactile output device can receive the tactile image through Bluetooth. A description of Bluetooth will be made with reference to FIG.

The downsampling unit 210 may downsample the image. In downsampling an image, the downsampling unit 210 may time-downsample the image according to a predetermined number of frames per second, and may space-downsample a selected frame of the image to a predetermined tactile image resolution. Since downsampling reduces the number of frames and resolution, differences from the original image can occur. For example, temporal downsampling may perform temporal downsampling of an image at up to one frame per second, and spatial downsampling may perform spatial sampling of a selected frame of an image at a maximum of 640 x 360 resolution. In addition, the spatial sampling can reduce the difference from the original image by minimizing spatial downsampling of the selected frame of the image with a brightness resolution of up to 3 bits.

In addition, the tactile image has sensitivity to the reaction depending on various factors such as the speed of stimulation, the depth of stimulation, the strength of the force, etc., on the contact surface such as a human hand, Therefore, it is necessary to perform downsampling so that ordinary users can recognize the converted tactile image.

The conversion unit 220 may convert the downsampled image into a series of tactile images. The conversion unit 220 may convert the downsampled image in the downsampling unit 210 into a series of tactile images so that the blind can recognize the image through the tactile sense, such as braille. For example, a method of converting a down-sampled image into a tactile image is a method of converting a down-sampled image to a tactile image so that a user can feel a tactile image after storing tactile properties such as stiffness, friction, . ≪ / RTI >

The transmission unit 230 may transmit the converted tactile image to the tactile output unit through wireless communication. In other words, the transmission unit 230 can transmit the converted tactile image from the conversion unit 220 to the tactile output device through short-range wireless communication such as Bluetooth. The present invention can transmit and receive data between a tactile output device and a video device using Bluetooth, and can transmit a tactile image to a tactile output device through a radio wave without passing through a wire.

The output unit 240 can output the converted tactile image through the tactile output unit. The output unit 240 may output the tactile image transmitted from the transmitting unit 230 via Bluetooth, which is a short distance wireless communication. At this time, the tactile output device may be an auxiliary device for connecting to the image device and helping to recognize the tactile image together with the audio output. For example, the tactile output device can be a portable braille display that can be connected to a video device to recognize braille information along with audio output.

The tactile image conversion apparatus according to an exemplary embodiment can accurately convert an image into a tactile image irrespective of the position of the blind person and display the converted tactile image through the tactile output device.

The tactile image conversion apparatus according to an exemplary embodiment can recognize the overall outline of the blind people's vision image and can understand the image contents more easily with audio.

3 is a flowchart illustrating a tactile image conversion method according to an embodiment of the present invention.

In step 310, the tactile image transformation device may set the tactile image resolution to be used in the tactile output device, and then downsample the image. At this time, the tactile image conversion device may perform time down sampling based on the number of frames per second for the image, and perform spatial down-sampling on the selected frame of the image based on the horizontal and vertical image resolution. For example, the tactile image may be sampled at a resolution sufficient for the blind to recognize and received, time downsampled to a maximum of one frame per second, and selected frames of the image to a maximum of about 640 x 360 resolution Space downsampling with up to 3-bit brightness resolution is possible.

In step 320, the tactile image conversion device may convert the downsampled image into a series of tactile images. At this time, the tactile image transformation device may convert the time down sampling and spatial downsampled images performed in step 310 to a tactile image.

In step 330, the tactile image conversion device may transmit the converted tactile image to the tactile output device through wireless communication. In this case, wireless communication means that signals, codes, images, and sounds can communicate with each other through radio waves without passing through wires between two points. The tactile image conversion apparatus of the present invention can transmit the tactile image by using Bluetooth, which is a short distance wireless communication, such as Wi-Fi, 3G, LTE, WiBro, ZigBee and Bluetooth.

In step 340, the tactile image conversion device may output the converted tactile image through the tactile output device. For example, the tactile image may refer to an image output through a tactile output device so that a visually impaired person can feel the image tactile, such as a braille, in various application programs.

The tactile image conversion device according to an embodiment can help the user understand the image more easily as an assistant device for the visually impaired person and can convert the image into an accurate tactile image and output it regardless of the position of the visually impaired person.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100: tactile image conversion device
110: Imaging device
111: Video
112: Downsampling
113: Tactile image
120: tactile output device
131, 132: Wireless communication

Claims (1)

A tactile image conversion method comprising:
Downsampling the video;
Converting the downsampled image into a series of tactile images; And
Transmitting the converted tactile image to a tactile output device through wireless communication
Wherein the tactile image conversion method comprises:
KR20130109225A 2013-09-11 2013-09-11 Apparatus and method for converting tactile image from tv image and displaying KR20150030039A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR20130109225A KR20150030039A (en) 2013-09-11 2013-09-11 Apparatus and method for converting tactile image from tv image and displaying

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR20130109225A KR20150030039A (en) 2013-09-11 2013-09-11 Apparatus and method for converting tactile image from tv image and displaying

Publications (1)

Publication Number Publication Date
KR20150030039A true KR20150030039A (en) 2015-03-19

Family

ID=53024236

Family Applications (1)

Application Number Title Priority Date Filing Date
KR20130109225A KR20150030039A (en) 2013-09-11 2013-09-11 Apparatus and method for converting tactile image from tv image and displaying

Country Status (1)

Country Link
KR (1) KR20150030039A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017078457A1 (en) * 2015-11-04 2017-05-11 주식회사 닷 Electronic display device and information display method of same

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017078457A1 (en) * 2015-11-04 2017-05-11 주식회사 닷 Electronic display device and information display method of same
US10217389B2 (en) 2015-11-04 2019-02-26 Dot Incorporation Electronic display device and information display method of same
US10438523B2 (en) 2015-11-04 2019-10-08 Dot Incorporated Electronic display device and information display method of same
US10679532B2 (en) 2015-11-04 2020-06-09 Dot Incorporation Electronic display device and information display method of same
US10971041B2 (en) 2015-11-04 2021-04-06 Dot Incorporation Electronic display device and information display method of same
US11263935B2 (en) 2015-11-04 2022-03-01 Dot Incorporation Electronic display device and information display method of same

Similar Documents

Publication Publication Date Title
US11546410B2 (en) Device and method for adaptively changing task-performing subjects
US20200322747A1 (en) Distance determination using camera images
KR102052153B1 (en) Mobile terminal for controlling a hearing aid and method therefor
US9271103B2 (en) Audio control based on orientation
EP2834995B1 (en) Flexible spatial audio capture apparatus
US10754608B2 (en) Augmented reality mixing for distributed audio capture
US20150067521A1 (en) Method and apparatus for presenting content using electronic devices
KR20170128820A (en) Mobile terminal and method for controlling the same
US11432097B2 (en) User interface for controlling audio rendering for extended reality experiences
EP2777040B1 (en) Voice control device, voice control method and program
KR20140023079A (en) Method for displaying for image and an electronic device thereof
US11240623B2 (en) Rendering audio data from independently controlled audio zones
US9807497B2 (en) Sound source localization device, sound processing system, and control method of sound source localization device
KR20160127606A (en) Mobile terminal and the control method thereof
CN107251542B (en) Visualization for viewing guidance during data set generation
EP3068128A1 (en) Information processing device, information processing method, and information processing system
KR20150030039A (en) Apparatus and method for converting tactile image from tv image and displaying
KR102166719B1 (en) Apparatus and method for information exchange
KR20160035908A (en) Electronic Device And Method Of Controlling The Same
KR20140147057A (en) Wearable glass-type device and method of controlling the device
CN103529935A (en) User interface method and apparatus therefor
US10694567B1 (en) Systems and methods for establishing a data connection
US11656683B2 (en) Signal generation device, signal generation method, and reproduction device
KR20170082382A (en) Mobile terminal and screen zooming method thereof
EP3511801A1 (en) Output control device, output control method, and program

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination