KR20200102152A - Communication help service system using mobile terminal - Google Patents

Abstract

The present invention relates to a communication assistance service system using a mobile communication terminal. The communication assistance service system comprises at least one communication assistance means, a mobile communication terminal, and a communication assistance management server. According to the present invention, impaired people who have difficulties in making expression by speaking can actively communicate with non-impaired people.

Description

Communication help service system using mobile communication terminal {COMMUNICATION HELP SERVICE SYSTEM USING MOBILE TERMINAL}

The present invention relates to a system for providing a help service so that disabled people can communicate smoothly with the general public using a communication aid means and a mobile communication terminal in which a QR code and/or barcode is displayed.

Currently, many people with disabilities with severe speech impairment are seen in the vicinity, but the reality is that a communication support system for people with severe speech impairments developed so that these speech impairments can properly express their intentions has not been developed at all.

In addition, social interest for communication with the disabled is increasing, but systems, systems, social environments, and devices for this are extremely insufficient. Moreover, it is a reality that research on dedicated input processors for the speech impaired is not being conducted at all.

In general, in order to communicate with the visually impaired and/or the hearing impaired who are inconvenient to communicate, there is a method of using sign language or braille to communicate.

However, since sign language and Braille also require considerable time and effort for the general public to learn, most of them have a difficult point in conversing with communication-impaired persons.

In order to overcome this problem, localization of some input devices such as a visual recognition mouse is being attempted in Korea, but most of the dedicated devices rely on imports, and this is also not very helpful to people with severe speech impairments. There is a fact.

Eventually, there is currently no system developed to facilitate communication with family members, fellow disabled persons, or the general public by speech-impaired persons with severe speech impairments. The reality is that it not only causes discomfort, but is not helping at all for improving the quality of life of the person with speech impairment.

Domestic Patent Registration No. 10-1169249 (2012.08.06. Announcement)

The present invention has been conceived to solve the above-described problem, and an object of the present invention is to provide for persons with disabilities who have difficulty in expressing in words temporarily or permanently using a communication aid means and a mobile communication terminal on which a QR code and/or barcode is displayed. It is to provide a communication assistance service system using a mobile communication terminal that enables smooth communication with the general public through various methods (eg, gestures, facial expressions, sign language, photos, drawings, figures, numbers, letters, etc.).

In order to achieve the above object, a first aspect of the present invention includes at least one communication aiding means on which a QR code or a barcode having a preset unique code identification information is displayed; A mobile communication terminal equipped with a QR code recognition module or a barcode recognition module to recognize a QR code or barcode displayed on each communication aiding means; And communication assistance management that stores and manages the previously registered communication assistance information data corresponding to the unique code identification information of the QR code or barcode displayed on each communication assistance means into a database (DB) for each QR code or barcode. Including a server, when the QR code or barcode displayed on each communication assistance means is photographed with the mobile communication terminal, it is connected to the communication help management server to help the mobile communication terminal to communicate corresponding to the QR code or barcode Information data is displayed on the display screen, and the communication aid information data displayed on the display screen of the mobile communication terminal is provided with gestures, facial expressions, and facial expressions so that users who have difficulty in expressing them temporarily or permanently can communicate smoothly with the other party. It includes at least one communication help object among sign language, photos, pictures, figures, numbers, and letters, and when the user selects any one of the communication help objects displayed on the display screen of the mobile communication terminal, The communication assistance service using a mobile communication terminal, characterized in that the mobile communication terminal provides a service for outputting a voice so that the other party can audibly hear preset communication help voice data corresponding to the selected communication help object. To provide a system.

Here, the communication assistance management server generates a QR code or barcode displayed on each communication assistance means through the mobile communication terminal or an external user terminal, and communication assistance information corresponding to the generated QR code or barcode It is desirable to provide a service so that data and communication assistance voice data are registered.

Preferably, the communication help management server, a previously registered communication help app (App) corresponding to the unique code identification information of the QR code or barcode displayed on each communication help means is a database for each QR code or barcode ( DB) can be saved and managed.

Preferably, when a QR code or barcode displayed on each communication assistance means is photographed with the mobile communication terminal, a communication assistance app corresponding to the QR code or barcode is connected to the communication help management server ( App) can be installed.

Preferably, gestures, facial expressions, sign language, photos, drawings, and figures so that users who have difficulty in expressing words temporarily or permanently through a communication assistance app installed in the mobile communication terminal can communicate smoothly with the other party. A service can be provided so that at least one communication help object of, numbers, or letters is displayed on the display screen, and when the user selects any one of the communication help objects displayed on the display screen, the selected communication help object It is possible to provide a service for outputting a voice so that the other party can audibly hear the preset communication aid voice data corresponding to.

A second aspect of the present invention includes at least one communication aiding means displaying a QR code or a barcode having a preset unique code identification information; A mobile communication terminal equipped with a QR code recognition module or a barcode recognition module to recognize a QR code or barcode displayed on each communication aiding means; And a previously registered communication assistance app corresponding to the unique code identification information of the QR code or barcode displayed on each communication assistance means, and a database (DB) for each QR code or barcode to store and manage. Including a help management server, when a QR code or barcode displayed on each communication assistance means is photographed with the mobile communication terminal, a doctor corresponding to the QR code or barcode is connected to the communication help management server to the mobile communication terminal A communication help app is installed, and gestures, facial expressions, and facial expressions are installed so that users who have difficulty in expressing words temporarily or permanently through the communication help app installed in the mobile communication terminal can communicate smoothly with the other party. Provides a service to display at least one communication help object among sign language, photos, pictures, figures, numbers, or letters on the display screen, and when the user selects any one of the communication help objects displayed on the display screen It is to provide a communication assistance service system using a mobile communication terminal, characterized in that it provides a service for outputting a voice so that a counterpart can audibly hear preset communication help voice data corresponding to the selected communication help object.

Here, the communication assistance management server generates a QR code or barcode displayed on each communication assistance means through the mobile communication terminal or an external user terminal, and a communication assistance app corresponding to the generated QR code or barcode It is desirable to provide a service so that (App) is registered.

Preferably, the communication help management server or a separate app management server may store and manage a communication help app that is previously registered for each public institution or individual company into a database (DB).

Preferably, the mobile communication terminal provides a service so that a communication assistance app desired by the user is installed by accessing the communication help management server or a separate app management server through a communication network, and the mobile communication terminal At least one of gestures, facial expressions, sign language, photos, drawings, figures, numbers, or letters so that users who have difficulty in expressing words temporarily or permanently through the installed communication assistance app can communicate smoothly with the other party. Provides a service to display the communication help object of the display on the display screen, and when the user selects any one of the communication help objects displayed on the display screen, preset communication help voice data corresponding to the selected communication help object It is possible to provide a service that outputs a voice so that the other party can hear it aurally.

Preferably, each communication aid may be affixed in the form of a sticker or plate to a designated place of a public institution or private business that provides services to people in a specific community.

Preferably, each communication aiding means may be made in the form of displaying a QR code or barcode having a preset unique code identification information on the display screen of the personal computer (PC).

Preferably, the QR code or barcode displayed on the display screen of the personal computer (PC) may be generated by a user's request using a pre-installed application for creating a communication assistance app.

Preferably, the pre-installed application for creating a communication aid app may provide a service so that one communication aid app is produced for each preset category according to a user's request.

Preferably, the unique code identification information of the QR code or barcode displayed on each communication aid means is at least one of a URL (Uniform Resource Locator) address, a domain name address, or an IP (Internet Protocol) address. May include an address.

Preferably, the communication aid object displayed on the display screen of the mobile communication terminal is formed in a picture type, a character type, and an eye-gaze plate for each preset category, and a person who is difficult to understand the character is Those who know can use the form of a letter, and those who can gaze out of those who understand letters but have difficulty making choices with their fingers can use the form of a gaze board.

Preferably, the mobile communication terminal may be formed of at least one of a smart phone, a smart pad, or a smart note.

According to the communication assistance service system using the mobile communication terminal of the present invention as described above, it is difficult to express in words temporarily or permanently using a communication aid means and a mobile communication terminal displaying a QR code and/or barcode. There is an advantage that people with disabilities can communicate smoothly with the general public.

1 is an overall block diagram illustrating a communication assistance service system using a mobile communication terminal according to an embodiment of the present invention.
2 is a detailed block diagram illustrating a mobile communication terminal applied to an embodiment of the present invention.
3A to 3O are diagrams for explaining a communication help object displayed on a display screen of a mobile communication terminal when a communication help means applied to an embodiment of the present invention is attached to a public institution, a community center.
4A to 4S are diagrams for explaining a communication help object displayed on a display screen of a mobile communication terminal when a communication help means applied to an embodiment of the present invention is attached to an earth zone or a police box which is a public institution.

The above-described objects, features, and advantages will be described later in detail with reference to the accompanying drawings, and accordingly, one of ordinary skill in the art to which the present invention pertains will be able to easily implement the technical idea of the present invention. In describing the present invention, if it is determined that a detailed description of known technologies related to the present invention may unnecessarily obscure the subject matter of the present invention, a detailed description will be omitted.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

The terms used in the present invention have been selected from general terms that are currently widely used while considering functions in the present invention, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention exemplified below may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to more completely describe the present invention to those of ordinary skill in the art.

Combinations of each block of the attached block diagram and each step of the flowchart may be executed by computer program instructions (execution engine), and these computer program instructions are executed on the processor of a general purpose computer, special purpose computer or other programmable data processing equipment. As it may be mounted, its instructions executed by the processor of a computer or other programmable data processing equipment generate means for performing the functions described in each block of the block diagram or each step of the flowchart. These computer program instructions may also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular manner, so that the computer-usable or computer-readable memory It is also possible to produce an article of manufacture containing instruction means for performing the functions described in each block of the block diagram or each step of the flow chart.

In addition, since computer program instructions can be mounted on a computer or other programmable data processing equipment, a series of operation steps are performed on a computer or other programmable data processing equipment to create a process that is executed by a computer, It is also possible for the instructions to perform possible data processing equipment to provide steps for executing the functions described in each block of the block diagram and each step of the flowchart.

In addition, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing specified logical functions, and in some alternative embodiments mentioned in the blocks or steps. It should be noted that it is also possible for functions to occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially simultaneously, and the blocks or steps may be performed in the reverse order of a corresponding function as necessary.

1 is an overall block diagram illustrating a communication assistance service system using a mobile communication terminal according to an embodiment of the present invention, and FIG. 2 is a detailed block diagram illustrating a mobile communication terminal applied to an embodiment of the present invention. It is a block diagram.

1 and 2, a communication assistance service system using a mobile communication terminal according to an embodiment of the present invention includes at least one communication assistance means 100, a mobile communication terminal 200, and a doctor. It comprises a communication help management server 300 and the like. Meanwhile, since the components shown in FIGS. 1 and 2 are not essential, the communication assistance service system using a mobile communication terminal according to an embodiment of the present invention has more components or fewer components. May be.

Hereinafter, components of a communication assistance service system using a mobile communication terminal according to an embodiment of the present invention will be described in detail.

Each communication assistance means 100 is a public institution (e.g., government office, ward office, city hall, community center, district, police box, etc.) or private business (e.g., restaurant, convenience store, mart) that provides services to people in a specific community. , Hospitals, pharmacies, cafes, etc.), and a QR (Quick Response) code 150 and/or a bar code (not shown) with preset unique code identification information is displayed. .

In addition, the unique code identification information of the QR code 150 and/or barcode displayed on each communication aiding means 100 is, for example, a URL (Uniform Resource Locator) address, a domain name (Domain Name) address, or IP (Internet Protocol) It is preferable to include at least one Internet address of the address.

Each of these communication aids 100 may be formed in the form of, for example, a sticker, a plate, and/or a book, and are attached to the entrance door and/or near the counter of public institutions and/or private businesses. This is desirable.

On the other hand, although not shown in the drawing, each communication aiding means 100 is a QR code 150 having a preset unique code identification information set on the display screen of a typical personal computer (PC) and / or a bar code is displayed It can also be made of.

At this time, it is preferable that the QR code 150 and/or barcode displayed on the display screen of the personal computer (PC) are generated at the request of the user using an application for creating a communication assistance app installed in advance.

In addition, the pre-installed application for creating a communication assistance app may provide a service so that one communication assistance app is produced and/or installed for each preset category according to a user's request.

Therefore, it is possible to change the location of a category, modify it, and make a folder for each category, so that the handicapped can quickly and easily communicate using an app to help communicate quickly and efficiently.

In addition, since one category becomes one communication aid app, the mobile communication terminal 200 itself can be an Augmentative and Alternative Communication (AAC) tool.

That is, after creating a communication help app that suits the needs of each handicapped using an application for making a communication help app pre-installed on the personal computer (PC), QR corresponding to the created communication help app The code 150 and/or barcode are generated and displayed on the display screen. Thereafter, the created communication help app and the corresponding information data on the QR code 150 and/or barcode are stored and managed as a database (DB) in the communication help management server 300.

Then, each communication aiding means 100, that is, the QR displayed on the display screen of the personal computer (PC) using a conventional QR code recognition module and/or a barcode recognition module provided in the mobile communication terminal 200 When the code 150 and/or the barcode is photographed, it is connected to the communication help management server 300 and the corresponding QR code 150 and/or a communication help app corresponding to the barcode is installed in the mobile communication terminal 200. .

The mobile communication terminal 200 includes a QR code recognition module (not shown) and/or a barcode recognition module (not shown) to recognize the QR code 150 and/or barcode displayed on each communication aiding means 100. It is equipped.

The QR code recognition module and/or the barcode recognition module, although not shown in the drawing, may be implemented in conjunction with a camera module through a dedicated app for generally QR code and/or barcode recognition. Detailed description will be omitted.

In addition, by using the QR code recognition module and/or the barcode recognition module provided in the mobile communication terminal 200 to photograph the QR code 150 and/or barcode displayed on each communication aiding means 100, the doctor Communication assistance information data corresponding to the QR code 150 and/or barcode is displayed on the display screen of the mobile communication terminal 200 by being connected to the communication assistance management server 300.

In addition, the communication assistance information data displayed on the display screen of the mobile communication terminal 200 may be used for users who have difficulty in temporarily or permanently expressing them in words, ie, gestures, so that users with disabilities can communicate smoothly with the other, that is, the general public. , Facial expressions, sign language, photographs, drawings, figures, numbers, and/or letters. It is preferable to include at least one communication aid object.

In addition, when the user selects any one of the communication help objects displayed on the display screen of the mobile communication terminal 200, the mobile communication terminal 200 provides a preset communication help voice corresponding to the selected communication help object. It is possible to provide a service that outputs audio so that the other party can hear data aurally.

In addition, when the QR code 150 and/or barcode displayed on each communication assistance means 100 is photographed with the mobile communication terminal 200, it is connected to the communication assistance management server 300 and is connected to the mobile communication terminal 200. A communication assistance app corresponding to the QR code 150 and/or barcode may be installed.

In addition, for example, gestures, facial expressions, sign language, photos, etc. so that users who have difficulty in expressing words temporarily or permanently through a communication assistance app installed in the mobile communication terminal 200 can communicate smoothly with the other party. A service can be provided so that at least one communication aid object among pictures, figures, numbers, and/or letters is displayed on the display screen.

In addition, when the user selects any one of the communication help objects displayed on the display screen through the communication help app installed in the mobile communication terminal 200, a preset doctor corresponding to the selected communication help object Communication assistance It is possible to provide a service that outputs voice so that the other party can hear the voice data audibly.

In addition, the mobile communication terminal 200 connects to the communication help management server 300 and/or a separate app management server (not shown) (e.g., Play Store, App Store, etc.) through the communication network 10 to allow the user to A service can be provided so that the desired communication aid app is installed.

At this time, the communication network 10 is a communication network that is a high-speed backbone network of a large communication network capable of large-capacity, long-distance voice and data services, and Wi-Fi, WiGig, for providing Internet or high-speed multimedia services. It may be a next-generation wireless communication network including Wibro (Wireless Broadband Internet, Wibro) and Wimax (World Interoperability for Microwave Access, Wimax).

The Internet is a TCP/IP protocol and various services existing at its upper layer, namely HTTP (Hyper Text Transfer Protocol), Telnet, FTP (File Transfer Protocol), DNS (Domain Name System), SMTP (Simple Mail Transfer Protocol), It refers to a worldwide open computer network structure that provides Simple Network Management Protocol (SNMP), Network File Service (NFS), Network Information Service (NIS), etc., and the mobile communication terminal 200 communicates with the help management server 300 And/or it provides an environment that allows access to a separate app management server. Meanwhile, the Internet may be a wired or wireless Internet, or may be a core network integrated with a wired public network, a wireless mobile communication network, or a portable Internet.

If the communication network 10 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a wideband code division multiple access (WCDMA) communication network may be used. In this case, although not shown in the drawing, the mobile communication network may include, for example, a Radio Network Controller (RNC). Meanwhile, although the WCDMA network was exemplified as an example, it may be a next-generation communication network such as a cellular 3G network, an LTE network, a 4G network, and a 5G network, and other IP-based IP networks. The communication network 10 serves to mutually transmit signals and data of the mobile communication terminal 200 and the communication help management server 300 and/or a separate app management server.

On the other hand, the above-described mobile communication terminal 200 is composed of at least one mobile terminal device of a smart phone, a smart pad, or a smart note communicating through wireless Internet or portable Internet. This is preferable, and in addition to the palm (Palm) PC, mobile game console (Mobile play-station), DMB (Digital Multimedia Broadcasting) phone with communication function, tablet PC, iPad (iPad), etc. Communication help management server 300 and / Or may mean all wired and wireless home appliances / communication devices that have a user interface for accessing a separate app management server.

As shown in FIG. 2, the mobile communication terminal 200 includes a wireless communication module 210, an audio/video (A/V) input module 220, a user input module 230, a sensing module 240, and It may include an output module 250, a storage module 260, an interface module 270, a terminal control module 280, a power module 290, and the like. Meanwhile, since the components shown in FIG. 2 are not essential, the mobile communication terminal 200 may have more components or fewer components.

Hereinafter, the components of the mobile communication terminal 200 will be described in detail.

The wireless communication module 210 may include one or more modules that enable wireless communication between the mobile communication terminal 200 and the communication help management server 300 and/or a separate app management server. For example, the wireless communication module 210 may include a broadcast reception module 211, a mobile communication module 212, a wireless Internet module 213, a short-range communication module 214, a location information module 215, and the like.

The broadcast receiving module 211 broadcasts broadcast signals (eg, TV broadcast signals, radio broadcast signals, data broadcast signals, etc.) and/or broadcasts from an external broadcast management server through various broadcast channels (eg, satellite channels, terrestrial channels, etc.). Receive related information.

The mobile communication module 212 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 213 is a module for wireless Internet access, and may be built-in or external to the mobile communication terminal 200. As the wireless Internet technology, for example, WLAN (Wi-Fi), Wibro, Wimax, HSDPA, LTE, and the like may be used.

The short-range communication module 214 is a module for short-range communication, for example, Bluetooth communication, ZigBee communication, UWB (Ultra Wideband) communication, RFID (Radio Frequency Identification) communication, or infrared (IR) communication, etc. Can be used.

The location information module 215 is a module for confirming or obtaining the location of the mobile communication terminal 200, and may obtain current location information of the mobile communication terminal 200 using a Global Position System (GPS) or the like.

The A/V input module 220 is a module for inputting an audio signal or a video signal, and may basically include a camera unit 221 and a microphone unit 222. The camera unit 221 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a photographing mode. The microphone unit 222 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc. and processes it as electrical voice data.

The user input module 230 is a module for generating input data for the user to control the operation of the terminal, and may include, for example, a keypad dome switch, a touch pad (static pressure/power failure), a jog wheel, a jog switch, and the like.

The sensing module 240 is the open/closed state of the mobile communication terminal 200, the location of the mobile communication terminal 200, the presence or absence of user contact, the user's touch motion to a specific part, the orientation of the mobile communication terminal 200, and the mobile communication terminal. A sensing signal for controlling the operation of the mobile communication terminal 200 is generated by detecting the current state of the mobile communication terminal 200 such as acceleration/deceleration of the 200. Such a sensing signal is transmitted to the terminal control module 280, and may serve as a basis for the terminal control module 280 to perform a specific function.

The output module 250 is a module for generating an output related to visual, auditory or tactile sense, and basically includes a display unit 251, an audio output unit 252, an alarm unit 253, and a haptic unit 254. I can.

The display unit 251 displays and outputs information processed by the mobile communication terminal 200. For example, when the mobile communication terminal 200 is in a call mode, a UI (User Interface) or GUI (Graphical User Interface) related to a call is displayed, and in the case of a video call mode or a photographing mode, a photographed and/or received image or UI , Display the GUI.

The sound output unit 252 may output audio data received from the wireless communication module 210 or stored in the storage module 260 in, for example, a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, etc. .

The alarm unit 253 may output a signal for notifying the occurrence of an event of the mobile communication terminal 200. Examples of events occurring in the mobile communication terminal 200 include call signal reception, message reception, key signal input, and touch input.

The haptic unit 254 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic unit 254 is vibration. The intensity and pattern of the vibration generated by the haptic unit 254 can be controlled.

The storage module 260 may store a program for the operation of the terminal control module 280 and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The storage module 260 may store data on vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The storage module 260 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, PROM, It may include at least one type of storage medium among magnetic memory, magnetic disk, and optical disk.

The interface module 270 serves as a passage for all external devices connected to the mobile communication terminal 200. The interface module 270 receives data from an external device or receives power and transmits it to each component inside the mobile communication terminal 200 or transmits data inside the mobile communication terminal 200 to an external device.

The terminal control module 280 generally controls the overall operation of the mobile communication terminal 200 and performs related control and processing for, for example, a voice call, data communication, and a video call.

In addition, the terminal control module 280 controls the communication help app (App) program stored in the storage module 260 to be executed, and the communication help management server 300 using the executed communication help app service. ) To generate various function settings and registration information, and to control the transmission to the communication help management server 300 through the wireless communication module 210.

In addition, the terminal control module 280 may constantly monitor the charging current and the charging voltage of the battery unit 295 and temporarily store the monitoring value in the storage module 260. In this case, the storage module 260 preferably stores not only battery charging status information such as monitored charging current and charging voltage, but also battery specification information (product code, rating, etc.).

The power module 290 receives external power and internal power under the control of the terminal control module 280 and supplies power necessary for the operation of each component. The power module 290 supplies power from the built-in battery unit 295 to each component to operate, and a charging terminal (not shown) can be used to charge the battery.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). , Processors, controllers, micro-controllers, microprocessors, and electric units for performing functions may be used. In some cases, such embodiments may be implemented by the terminal control module 280.

According to a software implementation, embodiments such as procedures or functions may be implemented together with separate software modules that perform at least one function or operation. The software code can be implemented by a software application written in an appropriate programming language. In addition, the software code may be stored in the storage module 260 and executed by the terminal control module 280.

On the other hand, when the mobile communication terminal 200 is made of a smartphone, the smartphone can freely use and delete various application programs desired by the user, unlike a general mobile phone (a feature phone). As a phone based on a possible open operating system, not only functions such as voice/video calls and Internet data communication, which are commonly used, but also all mobile phones with mobile office functions or all Internet that do not have voice call functions but can access the Internet It is preferable to understand it as a communication device including a phone or a tablet PC.

Such a smartphone can be implemented as a smartphone equipped with a variety of open operating systems, and examples of the open operating systems include Symbian from NOKIA, Blackberry from RIMS, iPhone from Apple, and Microsoft. (MS)'s Windows Mobile, Google's Android, and Samsung Electronics' Sea.

As described above, since a smartphone uses an open operating system, unlike a mobile phone having a closed operating system, a user can arbitrarily install and manage various application programs.

That is, the aforementioned smart phone basically includes a control unit, a memory unit, a screen output unit, a key input unit, a sound output unit, a sound input unit, a camera unit, a wireless network communication module, a short-range wireless communication module, and a battery for power supply. do.

The control unit is a generic term for functional configurations for controlling the operation of the smartphone, includes at least one processor and an execution memory, and is connected to each functional configuration unit provided in the smartphone through a bus.

The control unit controls the operation of the smartphone by loading at least one program code provided in the smartphone through the processor to the execution memory for calculation, and transmitting the result to at least one functional configuration unit through the bus. .

The memory unit is a generic term for a nonvolatile memory provided in a smartphone, and stores and maintains at least one program code executed through the control unit and at least one data set used by the program code. The memory unit basically stores a system program code and a system data set corresponding to an operating system of a smartphone, a communication program code and a communication data set for processing wireless communication connection of the smartphone, and at least one application program code and application data set, and , The program code and data set for implementing the present invention are also stored in the memory unit.

The screen output unit is composed of a screen output device (e.g., a liquid crystal display (LCD) device) and an output module driving the same, and is connected to the control unit via a bus to receive an operation result corresponding to the screen output among various operation results of the control unit. Output to the screen output device.

The key input unit is composed of a key input device having at least one key button (or a touch screen device interlocking with the screen output unit) and an input module driving the same, and is connected to the control unit via a bus to perform various operations of the control unit. A command for commanding is inputted or data required for calculation of the control unit is inputted.

The sound output unit is composed of a speaker that outputs a sound signal and a sound module that drives the speaker, and is connected to the control unit by a bus to output an operation result corresponding to the sound output among various calculation results of the control unit through the speaker. . The sound module decodes sound data to be output through an existing speaker and converts it into a sound signal.

The sound input unit includes a microphone receiving a sound signal and a sound module driving the microphone, and transmits sound data input through the microphone to the control unit. The sound module encodes and encodes a sound signal input through the microphone.

The camera unit is composed of an optical unit, a charge coupled device (CCD), and a camera module driving the same, and acquires bitmap data input to the CCD through the optical unit. The bitmap data may include both image data of a still image and video data.

The wireless network communication module is a generic term for a communication configuration connecting wireless communication, and includes at least one antenna for transmitting and receiving radio frequency signals of a specific frequency band, an RF module, a baseband module, and a signal processing module, and the control unit and It is connected by a bus and transmits the calculation result corresponding to wireless communication among various calculation results of the control unit through wireless communication, or receives data through wireless communication and transmits it to the control unit, and at the same time, accessing and registering the wireless communication Maintain the procedures of communication, handoff.

In addition, the wireless network communication module includes a mobile communication configuration that performs at least one access to a mobile communication network, location registration, call processing, call connection, data communication, and handoff according to the CDMA/WCDMA standard. Meanwhile, according to the intention of a person skilled in the art, the wireless network communication module may further include a portable Internet communication configuration for performing at least one access to the portable Internet, location registration, data communication, and handoff according to the IEEE 802.16 standard, and the wireless network It is to be clear that the present invention is not limited by the wireless communication configuration provided by the communication module.

The short-range wireless communication module is composed of a short-range wireless communication module that connects a communication session using a radio frequency signal as a communication medium within a certain distance, and preferably, RFID communication, Bluetooth communication, Wi-Fi communication, and public communication according to ISO 180000 series. It may include at least one of wireless communication. In addition, the short-range wireless communication module may be integrated with the wireless network communication module.

The smart phone configured as described above means a terminal capable of wireless communication, and any device may be applied as long as it is a terminal capable of transmitting and receiving data through a network including the Internet in addition to a smart phone. That is, the smart phone may include at least one notebook PC, a tablet PC having a function of transmitting a short message and a function of connecting to a network, and a portable terminal capable of carrying and moving.

Further, the communication help management server 300 is connected to the mobile communication terminal 200 (or user terminal) through the communication network 10, and the QR code 150 displayed on each communication assistance means 100 and/ Alternatively, it performs a function of storing and managing the previously registered communication aid information data corresponding to the unique code identification information of the barcode into a database (DB) for each QR code and/or barcode.

In addition, the communication help management server 300 is a previously registered communication help app (App) corresponding to the unique code identification information of the QR code 150 and / or barcode displayed on each communication help means 100 It is possible to perform a function of storing and managing a database (DB) for each QR code and/or for each barcode.

In addition, the communication help management server 300 is connected to the personal computer (PC) (not shown) through the communication network 10, the QR code 150 displayed on the display screen of the personal computer (PC) and/or It is possible to perform a function of storing and managing the communication aid app corresponding to the unique code identification information of the barcode into a database (DB) for each QR code and/or for each barcode.

In addition, the communication help management server 300 generates a QR code 150 and/or a barcode displayed on each communication assistance means 100 through the mobile communication terminal 200 and/or an external user terminal. It is possible to perform a function of providing a service so that communication help information data and/or communication help voice data corresponding to the generated QR code 150 and/or barcode are registered.

In addition, the communication help management server 300 generates a QR code 150 and/or a barcode displayed on each communication assistance means 100 through the mobile communication terminal 200 and/or an external user terminal. It is possible to perform a function of providing a service so that a communication assistance app corresponding to the generated QR code 150 and/or barcode is registered.

In addition, the communication help management server 300 and / or a separate app management server, for example, for storing and managing a communication assistance app (App) previously registered for each public institution and / or private company into a database (DB) Function can be performed.

3A to 3O are diagrams for explaining a communication help object displayed on a display screen of a mobile communication terminal when a communication help means applied to an embodiment of the present invention is attached to a public institution, which is a community center. For example, administration, welfare, etc.) is divided into a picture form (see FIGS. 3A to 3D), a letter form (see FIGS. 3E to 3I), and an eye gaze plate (see FIGS. 3J to 3O), making it difficult to understand the letters. People can use the form of pictures, those who know the letters can use the form of letters, and those who understand letters but have difficulty making choices with their fingers can use the form of an eye gaze plate.

4A to 4S are diagrams for explaining a communication help object displayed on a display screen of a mobile communication terminal when a communication help means applied to an embodiment of the present invention is attached to an earth zone or a police box, which is a public institution. For example, civil petitions, when, where, who, impressions, etc.) in the form of a picture (see FIGS. 4A to 4H), a letter form (see FIGS. 4I to 4M), and the form of a gaze plate (see FIGS. 4N to 4S). Those who have difficulty understanding the letters because they are divided can use the form of pictures, those who know the letters in the form of letters, and those who understand the letters but who have difficulty making choices with their fingers can use the form of the eye gaze plate.

In other words, the front chapter can be implemented to express the subject or the front part of a sentence in a short form, and the back chapter can be implemented so that a sentence can be quickly created and expressed by mounting greetings, yes/no, adverbs, verbs, and adjectives.

In addition, people with disabilities who have difficulty making sentences can be implemented so that they can quickly express what they want by presenting a small number of symbols using only the front page.

In addition, in the form of letters, high-frequency words or sentences that are frequently used for each institution are put in advance so that communication can be quickly performed. People who have difficulty entering letters due to their athletic ability by putting a number at the beginning of a word or sentence can encode numbers and letters like shortcut keys and select and express only the number of the corresponding sentence.

Although a preferred embodiment of the communication assistance service system using a mobile communication terminal according to the present invention has been described above, the present invention is not limited thereto, and the scope of the claims, the detailed description of the invention, and the accompanying drawings have been described. It is possible to implement it by transforming it into a branch, and this also belongs to the present invention.

100: communication aid means,
200: mobile communication terminal,
300: Communication help management server

Claims (12)

At least one communication assistance means on which a QR code or a barcode having a preset unique code identification information is displayed;
A mobile communication terminal equipped with a QR code recognition module or a barcode recognition module to recognize a QR code or barcode displayed on each communication aiding means; And
A communication help management server that stores and manages the previously registered communication help information data corresponding to the unique code identification information of the QR code or barcode displayed on each communication help means into a database (DB) for each QR code or barcode Including,
When a QR code or barcode displayed on each communication assistance means is photographed by the mobile communication terminal, the communication help information data corresponding to the QR code or barcode is displayed on the mobile communication terminal by being connected to the communication assistance management server. Is displayed in
The communication aid information data displayed on the display screen of the mobile communication terminal is gestures, facial expressions, sign language, photos, pictures, figures, and numbers so that users who have difficulty in expressing them temporarily or permanently can communicate smoothly with the other party. , Or at least one communication help object among letters,
When the user selects any one of the communication help objects displayed on the display screen of the mobile communication terminal, the mobile communication terminal transmits preset communication help voice data corresponding to the selected communication help object. A communication assistance service system using a mobile communication terminal, characterized in that it provides a service for outputting a voice so that it can be heard by a user.
The method of claim 1,
The communication assistance management server generates a QR code or barcode displayed on each communication assistance means through the mobile communication terminal or an external user terminal, and communication assistance information data corresponding to the generated QR code or barcode, and Communication assistance service system using a mobile communication terminal, characterized in that providing a service so that communication assistance voice data is registered.
The method according to claim 1 or 2,
The communication help management server, a previously registered communication help app (App) corresponding to the unique code identification information of the QR code or barcode displayed on each communication help means is converted into a database (DB) for each QR code or barcode To store and manage,
When a QR code or barcode displayed on each communication help means is photographed with the mobile communication terminal, the communication help app (App) corresponding to the QR code or barcode is connected to the communication help management server. It is installed, and gestures, facial expressions, sign language, photos, drawings, and figures are installed so that users who have difficulty in expressing words temporarily or permanently through the communication help app installed in the mobile communication terminal can communicate smoothly with the other party. Provides a service so that at least one communication help object of, numbers, or letters is displayed on the display screen, and when the user selects any one of the communication help objects displayed on the display screen, it responds with the selected communication help object A communication assistance service system using a mobile communication terminal, characterized in that providing a service for outputting a voice so that the other party can audibly hear the preset communication aid voice data.
At least one communication assistance means on which a QR code or a barcode having a preset unique code identification information is displayed;
A mobile communication terminal equipped with a QR code recognition module or a barcode recognition module to recognize a QR code or barcode displayed on each communication aiding means; And
Communication assistance that stores and manages a previously registered communication assistance app that corresponds to the unique code identification information of the QR code or barcode displayed on each communication aid means into a database (DB) for each QR code or barcode Including a management server,
When a QR code or barcode displayed on each communication help means is photographed with the mobile communication terminal, the communication help app (App) corresponding to the QR code or barcode is connected to the communication help management server. It is installed, and gestures, facial expressions, sign language, photos, drawings, and figures so that users who have difficulty in expressing words temporarily or permanently through the communication assistance app installed in the mobile communication terminal can communicate smoothly with the other party. Provides a service so that at least one communication help object of, numbers, or letters is displayed on the display screen, and when the user selects any one of the communication help objects displayed on the display screen, it responds with the selected communication help object A communication assistance service system using a mobile communication terminal, characterized in that it provides a service for outputting a voice so that the other party can audibly hear the preset communication aid voice data.
The method of claim 4,
The communication help management server generates a QR code or barcode displayed on each communication help means through the mobile communication terminal or an external user terminal, and a communication help app corresponding to the generated QR code or barcode (App ) Communication assistance service system using a mobile communication terminal, characterized in that providing a service to be registered.
The method of claim 1 or 4,
The communication help management server or a separate app management server stores and manages a communication help app (App) previously registered for each public institution or individual company into a database (DB),
The mobile communication terminal connects to the communication help management server or a separate app management server through a communication network to provide a service so that a communication assistance app desired by the user is installed, and the communication installed in the mobile communication terminal Communication of at least one of gestures, facial expressions, sign language, photos, pictures, figures, numbers, or letters so that users who have difficulty in expressing words temporarily or permanently through the help app can communicate smoothly with the other person. A service is provided so that the help object is displayed on the display screen, and when the user selects any one of the communication help objects displayed on the display screen, the other party can receive the preset communication help voice data corresponding to the selected communication help object. A communication assistance service system using a mobile communication terminal, characterized in that it provides a service for outputting a voice so that it can be heard aurally.
The method of claim 1 or 4,
Each communication assistance means is a communication assistance service system using a mobile communication terminal, characterized in that it is attached in the form of a sticker or plate to a designated place of a public institution or private business that provides services to people in a specific community.
The method of claim 1 or 4,
Each communication assistance means is a communication assistance service system using a mobile communication terminal, characterized in that the QR code or barcode having a preset unique code identification information is displayed on the display screen of the personal computer (PC).
The method of claim 8,
The QR code or barcode displayed on the display screen of the personal computer (PC) is generated at the request of a user using an application for creating a communication aid app installed in advance,
The communication assistance service system using a mobile communication terminal, characterized in that the pre-installed application for creating a communication assistance app provides a service so that one communication assistance app is produced for each preset category according to a user's request.
The method of claim 1 or 4,
The unique code identification information of the QR code or barcode displayed on each communication aid includes at least one Internet address of a URL (Uniform Resource Locator) address, a domain name (Domain Name) address, or an IP (Internet Protocol) address. Communication assistance service system using a mobile communication terminal, characterized in that.
The method of claim 1 or 4,
The communication aid object displayed on the display screen of the mobile communication terminal is formed in a picture form, a text form, and an eye-gaze plate for each preset category,
Mobile communication characterized by using the form of a picture for those who are difficult to understand letters, in the form of letters for those who know letters, and for those who can gaze among those who understand letters but have difficulty selecting with a finger. Communication assistance service system using a terminal.
The method of claim 1 or 4,
The mobile communication terminal is a communication assistance service system using a mobile communication terminal, characterized in that consisting of at least one of a smart phone (Smart Phone), a smart pad (Smart Pad), or a smart note (Smart Note).

Images