KR101627936B1 - The security input method and apparatus of voice control for display device - Google Patents

Abstract

(Hereinafter may be referred to as a symbol) of a video display device having a voice recognition and processing unit and a password (hereinafter, referred to as security information that is not to be exposed / leaked) A method and apparatus designed to facilitate secure input with voice while ensuring high security.

Description

[0001] The present invention relates to a security input method and apparatus using voice control of a video display apparatus,

The present invention solves the problem of exposure of letters (hereinafter may be referred to as symbols) and passwords (hereinafter referred to as " security information " (Including doorways) of bank ATM machines, various multi-family houses, offices, factories, and other buildings. The present invention relates to a method and an apparatus for easily inputting security by voice, Devices and other security inputs (especially in the coming days of IoT (Internet of things), we will share information by connecting more objects to the network, .) To recognize the voice command of the user and use the security input As to prevent the exposure, the present invention relates to information such as a password '1234' in the embodiment is described hereinafter a method and apparatus for achieving that are not inherently prevent a) the user to any exposure.

      2. Description of the Related Art As a recent image display device has become increasingly multifunctional and sophisticated, various input methods for controlling an image display device have been developed. A mouse, a keyboard, a touch pad, a motion sensing remote controller, and a touch screen input method have been developed.

Particularly, among the various input methods, a voice recognition control method for controlling a video display device by recognizing a user's voice in order to control the video display device more easily by a user is highlighted, and the development of the technology is extended to a phonemic unit The recognition of the technology has improved the reliability of voice recognition rate, but its application was somewhat limited. A method and apparatus for achieving security input by applying the features of Application No. 10-2014-0056992 filed prior to the filing of the present application are provided.

Application No. 10-2014-0056992 (2014.05.13)

The present invention proposes an application field of the above-described speech recognition. Conventional security input devices use biometrics such as fingerprint recognition, iris recognition, and voice recognition, and input using a password (any one of letters, numbers, symbols, and combinations of two or more). Fingerprint recognition, iris recognition, speech recognition, and other methods can maintain high security, but implementation and research will be costly. The method of inputting a password is usually implemented through a physical keypad and a touch screen. In this case, physical keypads are used for bank ATMs, private safes, and home door locks. When these keypads are printed on silk screen, frequently used keys can be peeled off, And the keypad of the touch screen type (video display device) in which the recent adoption rate is getting higher is left with a fingerprint and oil on the screen, and the likelihood of leakage of the password is increased as described above. As a result, the user has to change the password frequently, and the risk of the password being exposed and the password change are inconvenient.

A security input method using speech recognition in an image display apparatus having a speech recognition and processing unit including a speech recognition unit, an information processing unit, a memory unit, a display unit, and a control unit,

Detecting coordinates of a unit of an execution area to which an input signal is to be generated through the speech recognition and processing unit using a voice command uttered by a user on a screen area displayed through a display unit of the image display apparatus,

(a) the information processing unit forms and divides a virtual execution area unit of the display unit, and coordinates are given for each area within the virtual execution area unit, and a virtual execution area unit is formed, Dividing the region into at least one region;

(b) The memory unit assigns coordinates assigned to each area within the execution area unit to voice data to be matched to an area in a virtual execution area unit in a database, and constructs a database mapped to each area, and the voice data and the voice command data for constructing the database are assigned a pattern such that they do not overlap with letters or numbers unique to the input window execution marker area (Algorithm);

(c) receiving the voice of the user by the voice recognition unit, searching for voice data matched in the database, and discriminating from the information processing unit whether there is voice data to be matched;

(d) detecting coordinates corresponding to an area in the execution area unit mapped to the voice data when the voice processing unit matches the voice of the user with the voice data in the database;

And a security input is performed by generating an input / execution signal in a control unit in the detected coordinates. The steps (a) and (b) may be executed every time a new screen is input, The pattern can not be used again before it is used. The present invention also provides a method and apparatus for security input using voice control of a video display device.

The present invention provides a method for making a security input to a video display device by speaking a voice command in units of a short word, which is displayed on a divided area of a virtual execution area on a video display device by a user, It is possible to prevent exposure and leakage of the actual input contents through the contents of the utterance, thereby avoiding frequent changes of the password and the like, and giving high efficiency of security.

When bi-directional wireless communication between a first device and a second device to be described later is started and connected to exchange information of a unique ID and the like between the first and second devices and is applied to the security input device of the access system using the information It is also possible to utilize it in the security system because it can acquire real time, exit time, and information of the passengers based on the connection point in security input.

[Drawing (1)] A flowchart showing an execution process of the present invention
[Drawings (2)] to [Figure (8)] are diagrams showing screen-specific screen changes showing smartphone screen changes in the embodiment of the present invention
9 is a conceptual diagram for mapping to a database in the process of FIG. 3, FIG. 4, FIG. 6, and FIG. 7 in the embodiment of the present invention.
[Drawing (10)] In another embodiment of the drawings (2) to (8), a phone mode screen
[Drawings (11)] A conceptual diagram in which only the upper and lower menu portions of the smartphone screen of the drawing (10)
[Drawings (12)] A conceptual diagram separately setting dials in the center lower portion of the smartphone screen of the drawing (10)
[13] A conceptual diagram of the database to be mapped to the set unique coordinate in the drawing (11)
[Figure 14] A conceptual diagram of a database to be mapped to the set unique coordinates in the drawing (12)
[Drawing (15)] A numeric keypad
(16) A conceptual diagram partitioning the input window execution cover area 101 of FIG. 15 into four areas by execution area unit
[Figure 17] A conceptual diagram of a database to be mapped to a unique coordinate set corresponding to the drawing (15)
[18] The bidirectional wireless communication relationship between the first device and the second device

Before describing in detail several embodiments of the invention, it will be appreciated that the application is not limited to the details of construction and arrangement of components set forth in the following detailed description or illustrated in the drawings. The invention may be embodied and carried out in other embodiments and carried out in various ways. It should also be noted that the device or element orientation (e.g., "front," "back," "up," "down," "top," "bottom, Expressions and predicates used herein for terms such as "left," " right, "" lateral," and the like are used merely to simplify the description of the present invention, Or that the element has to have a particular orientation. Also, terms such as " first "and" second "are used herein for the purpose of the description and the appended claims, and are not intended to indicate or imply their relative importance or purpose.

The present invention has the following features in order to achieve the above object.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Prior to this, terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms, and the inventor should appropriately interpret the concepts of the terms appropriately It should be construed in accordance with the meaning and concept consistent with the technical idea of the present invention based on the principle that it can be defined.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and do not represent all the technical ideas of the present invention. Therefore, It is to be understood that equivalents and modifications are possible.

The present invention has the following features.

A security input method using speech recognition in an image display apparatus having a speech recognition and processing unit including a speech recognition unit, an information processing unit, a memory unit, a display unit, and a control unit,

Detecting coordinates of a unit of an execution area to which an input signal is to be generated through the speech recognition and processing unit using a voice command uttered by a user on a screen area displayed through a display unit of the image display apparatus,

(a) the information processing unit forms and divides a virtual execution area unit of the display unit, and coordinates are given for each area within the virtual execution area unit, and a virtual execution area unit is formed, Dividing the region into at least one region;

(b) The memory unit assigns coordinates assigned to each area within the execution area unit to voice data to be matched to an area in a virtual execution area unit in a database, and constructs a database mapped to each area, and the voice data and the voice command data for constructing the database are assigned a pattern such that they do not overlap with letters or numbers unique to the input window execution marker area And comprising at least one digit as a combination of letters and numbers or a combination of letters and numbers;

(c) receiving the voice of the user by the voice recognition unit, searching for voice data matched in the database, and discriminating from the information processing unit whether there is voice data to be matched;

(d) detecting coordinates corresponding to an area in the execution area unit mapped to the voice data when the voice processing unit matches the voice of the user with the voice data in the database;

And a security input is performed by generating an input / execution signal in a control unit in the detected coordinates. The steps (a) and (b) may be executed every time a new screen is input, The pattern can not be used again before it is used.

The security input device using the voice control of the video display device has the following features.

A video display device capable of voice control comprising a voice recognition and processing section including a voice recognition section, an information processing section, a memory section, a display section, and a control section,

A memory unit for storing a database mapped with voice data in units of execution regions on the screen displayed through the display unit;

A voice recognition unit for receiving a voice command of a user;

An information processing unit for searching the database when the voice recognition unit receives a voice command of the user and determining whether voice data corresponding to the voice command of the user exists;

And a control unit for generating an input / execution signal in units of execution regions to which the corresponding voice data is assigned when voice data corresponding to the user voice command exists as a result of the determination by the information processing unit; And a control unit.

The 'execution area unit' described above is a concept corresponding to a contact surface in which a touch screen and a touch means (for example, a stylus pen, a hand, and the like) make contact when touching the touch screen, It is a factor that defines the range in which the execution signal is generated. The size and the number of each screen may be different, and shapes such as circle, square, triangle, star, and honeycomb may be variously set. (Not shown). (Since it is a publicly known technology, a detailed description is omitted, but the screen is made up of a number of pixels, and the 'execution area unit' is an element that defines the range of these pixels.)

The 'coordinates' described above are the coordinates of the 'execution area unit', and do not include or match any control command in the coordinates itself as position information on the screen.

The above-described 'voice command' is the utterance content to be spoken by the user, and is configured to be displayed on the screen, and is an object to be compared with 'voice data' stored in the database.

The above-described 'voice data' is an object to be compared with the signal analysis data of the 'voice command word' uttered by the user, and is used only for finding the coordinates of the execution region unit through user's utterance.

The 'input window execution cover area' corresponds to a GUI construction unit (a kind of GUI layout concept) such as a rectangular area for identification when a numeric keypad, a virtual keyboard or the like is executed (for example, Quot; keypad area "; " numeral 1 " and " rectangular area ").

If the virtual execution region unit is formed and the input window execution marker region is divided into at least one region and the minimum region in the division, the virtual execution region unit is partitioned in accordance with the GUI layout of the input window execution marker . In this case, the virtual execution area unit, the assigned voice command and the voice data, and the input window execution cover correspond to each 1: 1: 1 relationship. In this case, the reliability of the security input depends on the configuration of digits of the voice command (For example, assuming a single-digit number configuration and a four-digit confidence in the input content is 4, the four-digit reliability will be obtained by simply looking at the four-digit configuration, and the four- The number of configurations will vary depending on the number of configurations.

When the virtual execution region unit is formed and the input window execution marker region is divided into at least one region and four regions, the GUI layout of the input window execution marker is divided into four regions. In this case, the virtual execution area unit, the assigned voice command and the voice data, and the input window execution mark correspond to each other in a 4: 4: 1 relationship. In this case, depending on the number of digits of the voice command and the number of execution area units Reliability of the security input is determined (for example, in a one-digit configuration, the reliability when the input content is "1, 2, 3, 4" four digits is proportional to the number of execution area units = 4 16, and if you have a four-digit configuration, you will get four times the reliability of 16 even if you look at it simply, and you will actually get a reliability of four or more times 16 because the number of elements in the configuration depends on the number of elements that make up the four digits will be.)

In the case of the above-described 'input window execution marker area unique letter and number', the exemplary embodiment described below is limited to a video display apparatus having a voice recognition and processing unit, but a 'first device (having a speech recognition and processing unit) And a second device (not including the voice recognition and processing unit but including the information processing unit, the memory unit, and the control unit) may be a physical keypad, a touch screen type video display device, or a security input device of the IoT device ), It can be seen that the range of the device can be expanded and applied depending on the range and the use of the device.

The above-mentioned 'Algorithm' uses the existing disclosed algorithm, and in the step of building the voice data to be paired with the voice command to be described later in the database, the order, directionality and likelihood of arrangement in the numeric keypad, In the case of the element 17 in which the contents of the security information can be deduced by using the voice command having a strong order, directionality and probability for simplification of description, (Including numerals and symbols) existing in the input window execution area, and it is possible to use any one of letters, numbers and symbols A pattern of voice data to be paired with a voice command is formed by combining at least two digits, As an algorithm for determining whether or not a pattern is to be excluded, the above-mentioned " excluded pattern "

In addition, the above-described algorithm (Algorithm) can be updated and executed every new screen input, and can be executed in the number of all cases created by combination of unique characters such as numbers, characters, The pattern used includes a rule for restricting that all remaining unused patterns can not be used again before they are used so that they can not be used.

In addition, the control unit generates an input / execution signal in the above-described execution process and the coordinates of the execution unit area detected in FIG. 1. In a normal case in which a security input is not required (i.e., A configuration in which a speech balloon is displayed or a configuration in which a user recognizes that the input is being performed, such as a change in the state of the GUI when a keypad is input in a bank ATM, is displayed on the screen). However, It is preferable to exclude the above configuration during execution.

Hereinafter, a voice control input method of the video display apparatus according to the preferred embodiment of the present invention will be described in detail.

As an example, FIG. 2 shows an Android smartphone home screen. The application 'abc' (①) of the drawing (2) is displayed on the lower right side of the Android smartphone home screen of FIG. 2 (2) instead of the home screen by using a conventional smart phone using the touch screen, Abc '(3) in the figure (5) by touching the' abs 'icon in the drawing (2) when the user touches the' Touch the icon to execute the application as shown in Fig.

  At this time, in each touch process, the control unit that senses the input signal issues an execution command. The process of executing this process in the method of the present invention is as follows.

  When the user enters the voice recognition mode on the screen of Fig. 2, an area in the execution area unit is set (in this case, basically, it is not necessary to be displayed in the user's eyes as shown in Fig. 3) And can be configured to be displayed), and unique coordinates that can be expressed in a matrix form are set as shown in FIG.

At this time, the library of the database drawing 9 assigned to this screen is called while the screens of Figs. 3 and 4 are being displayed, so that voice commands can be discriminated. The library at this time is referred to as a 'library 1', and the 'library 1' has voice command data mapped to 24 unique coordinates.

When the 'abs' (2) in FIG. 2 is executed as a voice command, it is a coordinate area corresponding to 'F4' in FIG. In the 'F4' area, specific voice command data called 'apps' is stored in the voice database 'library 1'.

When the user speaks "APPS", the user enters a step of "whether there is voice data consistent with the recognized voice data?" As in the process of the drawing (1), and the voice data stored in the database " If the coincidence is found, the process proceeds to the step 'coordinate detection and mapping to the coincident speech data and the generation of the input / execution signal at the detected coordinates' in the figure (1) (2) of the drawing (2) located at the coordinate 'F4' mapped to the library (1) as shown in FIG.

That is, a specific voice command signal of a user named " abs " is checked as to whether or not there is voice data matching the recognized voice data, and " detected coordinate mapped to the matching voice data "Quot; F4 " field of FIG. 2 through the step of " generating an input / execution signal at the control unit ", and recognizing and executing the input signal in the same manner as the method of processing the input signal. When the above process is executed, the screen is switched to the screen of FIG. 5, and at this time, a database is called to prepare voice command discrimination. The library of the voice database allocated to the screen of FIG. 5 is referred to as 'library 2' as shown in FIG. 9.

Similarly, when entering the voice recognition mode as shown in FIG. 6, an area in the form of an execution area unit is set, and 'library 2' can have 24 voice command data. The 'abc' (③) icon in the figure (5) corresponds to the 'C1' coordinate area in the figure (7). Specific voice command data "abc" mapped to the 'C1' coordinate area is stored in the voice database 'library 2' as shown in FIG. When the user speaks "abc", it checks whether the voice data coincides with the recognized voice data in FIG. 1 and confirms that they are coincident with each other. Therefore, Quot; C1 " in the figure (5) through the step of " generating input / execution signals in the detected coordinates " in the control unit, And the screen is switched to the drawing (8), and the application is executed.

As another embodiment of the voice control input method of the video display device, the drawing (10) is a call screen of the Android smartphone. A user normally inputs a telephone number through a touch, and a call is made by touching a call button. A process of switching to a voice recognition mode and proceeding with this process will be described.

  In the case of switching to the voice recognition mode on the screen of FIG. 10, it may be difficult to express a single (m, n) matrix.

  For example, the first line includes elements such as 'keypad', 'recent record', 'favorites', and 'contact'. In the second line, There are three elements of '1', '2', and '3', three elements of numbers '4', '5', and '6' There are three elements of '9', there are three elements of '*', '0', and '#' on line 6 and four elements of 'call', 'video call', 'message', ' There is an element. In the above-described method, three combinations of 1x4 matrix, 4x3 matrix, and 1x4 matrix, two combinations of 6x4 matrix, and 7x3 matrix, rather than one (m, n) . In FIGS. 11 and 12, a virtual execution area unit is set and displayed by dividing the combination of the latter, that is, a combination of a 6 × 4 matrix and a 7 × 3 matrix. At this time, two pre-stored speech database libraries are also called. This library stores data with 24 and 21 unique coordinates, each of which can be represented by a 6 × 4 matrix and a 7 × 3 matrix. .

The two libraries called at this stage are called 'library ③' and 'library ④', and they are expressed by the respective diagrams (13) and (14). The process of pressing the 'call' button after the user presses the 'keypad' and inputs '0 1 0 - 1 2 3 4 - 5 6 7 8' is performed in the process of the drawing (1) , '1', 'p2', 'j1', 'p2', 'j1', 'j2', 'j3', 'k1', 'k2', 'k3' ',' m1 ',' m2 ', and then' bar 1 'in' library ③ 'again.

In the above, a method of controlling an image display device based on the existing user experience (UX) using speech recognition has been described. The virtual execution area unit described above is an element that defines the range of the input / execution signal (corresponding to the contact surface when touching the touch screen), and therefore there is no necessity to be displayed, but it may be displayed according to the necessity of implementation. In addition, it is an example that the execution unit area is partitioned according to the icon or the execution window of the input window, and can be divided into various patterns irrespective of whether there is an icon or not.) Using the above technical idea, Let's look at the method.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a security input method and apparatus using voice control of a video display device according to a preferred embodiment of the present invention will be described in detail.

The process of dividing the input window execution mark region into one region in the step (a) is as follows. Referring to the drawing (15) The present invention can be applied not only to the screen of the smart phone but also to the numeric keypad of the ATM of the bank. 15 to 17 and the following description. (The scope of the technical idea of the present invention is not limited to the password input on the numeric keypad described later.)

If the four digits of the preset password '1234' are input in the drawing (15), an execution signal is generated on the screens of '1', '2', '3', and '4' .

Figure 17 is a database of voice commands in which the size of the execution area unit corresponding to the figure 15 is allocated and mapped by each execution marker area (GUI layout for the numeric keypad of the drawing 15) (voice command display, An example in parentheses is an exemplary unique coordinate, in which coordinates are not shown). The voice command word and voice data 'coordinate (a1)' in FIG. 17 are stored in the '1' area of FIG. 15 and the voice command word and voice data (Coordinate a2) 'of the figure 15 and the voice command word and voice data' min (a3) 'of the figure 17 and the' 4 'area of the figure 15 in the area' 3 ' (Coordinates) b1 'of the speech data and the voice command word of the speech data 17 are allocated and mapped. At this time, the coordinates' a1 ',' a2 ',' a3 ', and' b1 'of the area of each of' 1 ',' 2 ',' 3 ', and' ',' Min ', and' Station '. If the user speaks "big, small, small, small", he goes through step (1). 1, 2, 3, and 4 "by generating input signals at the coordinates" a1 "," a2 "," a3 ", and" b1 "detected through the steps of (1) In order to simplify the explanation, the data of the voice data and the voice command to construct the database mapped by the coordinates of each execution area unit area when the screen is divided into the virtual execution area unit is divided into the input window execution area unique In the actual implementation, the data of the voice command word, which is a sentence so as to be sequentially increased in number and probable as shown in (17), is given as Algorithm is used as a means to exclude patterns corresponding to the number of cases to be allocated.)

When the mode is switched to the voice recognition mode, voice commands in the database of the voice command word and the voice data in Fig. 17 (coordinate values should be excluded, for example, 'a1' (Identifiable position within the area, whether it is superimposed on the number on one side of the figure, upper, lower, left, or right), or identifiable. If only the voice command is displayed as shown in the screen (17) on the screen of the above figure 15, the user can recognize the position of the keypad and the password of the input window, 1 ',' 2 ',' 3 ', and' 4 'to be input by the user are called' Republic of Korea 'by voice. do.

Next, a description will be made of a case where the input window execution cover region is divided into four regions in the step (a). (When the input window execution cover region is divided into two regions, (16) is the same as that of the keypad of FIG. 15 except for the case of dividing the area of " 1 " Is an enlarged view of only the input window execution marker area 101 corresponding to the " When inputting '1', input '201', '202', '203', and '204' are input. The voice command and voice data (input window execution) of "large 8", "large 7", "large 7", "large 6", and "large 6" Numbered digits as a combination of letters and numbers or a combination of letters and numbers) is divided into quarters by dividing the region of 101 into a virtual execution region And if the corresponding database is also configured to correspond to the algorithm, the subsequent execution process is different from the description of the process of dividing the input window execution cover region into one region in the above described step (a) not.

Although inputting '1' is described as above, inputting '1' by using any of voice commands such as '8', '7', '6', and '5' The result of the input is the same, but you can enter it without exposing the '1' input. (There are means for users to refer to symbols such as '@, #, *, $' and numbers such as '8,7,6,5' in advance by designating and providing them as pronunciation symbols when users speak. Or '@' is pre-stored in the database in consideration of the possibility of utterance as speech data such as '[at]' or '[at]'.

In the above description, the embodiments according to the above-described steps (a) and (b) have been described, and when inputting '1', '2', '3' It is possible to guess the security effect that can be obtained by expressing a digit more than one digit. In addition, the steps (a) and (b) may be updated and executed every new screen input, and the used pattern may be configured so that unused patterns can not be used again in all cases, The original input information is not exposed and can not be inferred.

As described above, the security input method using the voice control of the video display apparatus including the voice recognition and processing unit including the voice recognition unit, the information processing unit, the memory unit, the display unit, and the control unit has been described. The video display device having the above-described voice recognition and processing unit may be referred to as a first device, the video display device and the security input device not provided with the voice recognition and processing unit may be referred to as a second device , A memory unit, and a control unit, and may be an image display device, a physical keypad method, or a security input device of the IoT device), and transmits a security input to a second device using the first device A brief description will be given.

First, when the first device and the second device are two-way wireless communication (for example, NFC, BLUETOOTH, WIFI, and the like, when the communication standard between the first device and the second device is different, And the connection is started, and the first device enters the voice recognition mode to prepare a security input, and at the same time, the second device transmits the signal and information of the keypad to the first device. The display unit of the first device receiving the signal and information of the first device keypad outputs an image of the input window execution sign of the second device on the screen of the first device and executes the security input through the step of FIG. And transmits the security input signal and information generated in the process to the second device. The second device processes the received security input signal and information to form a security input using voice control of the second device that does not have the voice recognition and processing unit. (In this case, the first device and the second device Only the transmission and reception relationship and process of the signal and information of the device are different from each other, but the actual execution process of the security input is omitted because it is not largely deviated from the case where it is executed in the first device alone.

Further, it will be understood that the two-way radio communication between the first device and the second device described above is initiated and connected, meaning that information such as the unique ID between the first and second devices is also exchanged. This information can be applied to the security input device of the access system (for example, when the first device is used alone, or when it is configured as the second device, and it is possible to use the first device which is a smart device of each accessing person) ('Smart device', 'Smart phone', 'Tablet PC', 'Tablet PC', etc.) can be acquired based on the time of connection when the security input is performed. 'Smart watch', 'smart glass', etc.). That is, primary authentication using the unique ID information when the first device and the second device are connected and secondary authentication using the present invention are possible .

It is needless to say that other signal processing techniques such as noise cancellation may be applied to the first device in order to increase the reliability of speech recognition.

The program code (including the algorithm) for performing the security input method using the voice control of the video display device as described above can be stored in various types of recording media. More specifically, it may be a random access memory (RAM), a flash memory, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an Electrically Erasable and Programmable ROM (EEPROM) Card, a USB memory, a CD-ROM, or the like, and if a recording medium on which the above-described program code is recorded is connected or mounted on the first device, A security input method using voice control of a video display device can be supported.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

(1) in the drawing (2) indicates that the smartphone application 'abc'
(2) in Fig. 2 shows an icon
(4) in the drawing (3) shows an area where there is no application executable when the smartphone is operated
3 of the drawing (5) shows an application icon 'abc' located on the smartphone application collection screen
"App" in the figure (9) means that the voice command mapped to the library ① is corresponded
"Abc" in the figure (9) means that a voice command mapped to the library ② is corresponded
"101" in the drawing (15) indicates an input window execution mark corresponding to the number "1" on the numeric keypad
"201", "202", "203", and "204" in the drawing (16)
&Quot; 102 " in the drawing (17) is assigned to " 101 &

Claims (6)

A security input method using a voice control method of a video display apparatus having a voice recognition and processing unit including a voice recognition unit, an information processing unit, a memory unit, a display unit, and a control unit,
Detecting coordinates of a unit of an execution area to which an input signal is to be generated through the speech recognition and processing unit using a voice command uttered by a user on a screen area displayed through a display unit of the image display apparatus,
(a) dividing the input window execution mark region into at least one region by dividing the display unit into a virtual execution region unit, and assigning coordinates for each region within the virtual execution region unit;
(b) constructing a database mapped with the coordinates assigned to the respective areas within the execution area unit by assigning the coordinates to the database with voice data matched with the area in the virtual execution area unit, and constructing the database The data of the voice data and the voice command includes an algorithm (Algorithm) for giving a pattern such that it is not overlapped with a letter or a number unique to the input window execution mark region, and is allocated and mapped by each coordinate of each execution region Configuring an instruction of voice data to be displayed on the display unit;
(c) receiving the voice of the user by the voice recognition unit, searching for voice data matched in the database, and discriminating from the information processing unit whether there is voice data to be matched;
(d) detecting coordinates corresponding to an area in the execution area unit mapped to the voice data when the voice processing unit matches the voice of the user with the voice data in the database;
And generating an input / execution signal in a control unit in the detected coordinates to form an input. The method according to claim 1,
Wherein the algorithm (Algorithm) assigns the voice data for constructing the database and the data of the voice command word to be a pattern composed of at least one digit as a combination of any one of letters and numbers or letters and numbers. A security input method using voice control of. The method according to claim 1,
wherein the steps (a) and (b) are updated and executed every new screen input, and the used pattern can not be used again before an unused pattern is used. . A security input device using voice control of a video display device performed by the security input method according to any one of claims 1 to 3,
Detecting coordinates of an execution region unit to be generated by the speech recognition and processing unit using the voice command uttered by the user on the screen region displayed through the display unit of the image display apparatus,
An information processing unit for forming and dividing the display unit into virtual execution region units and assigning coordinates for each region within the virtual execution region units;
Wherein the database is mapped by assigning coordinates assigned to each region within the execution region unit to voice data matched with a region in a virtual execution region unit in a database, The data includes an algorithm (Algorithm) for giving a pattern such that it is not overlapped with letters or numbers unique to the input window execution marker area, and the instruction of voice data mapped and allocated for each coordinate of each execution area is A memory unit configured to be displayed on a display unit;
A voice recognition unit for receiving the voice of the user;
A matching unit for matching the voice data to be matched with the voice data of the user and the matching voice data if the voice data matches the voice data of the user, And an information processing unit for detecting coordinates corresponding to the coordinates of the input unit and the control unit, and generating a security input by generating an input / execution signal in the detected coordinates. A first device, which is a security input device using voice control of the video display device of claim 4, a video display device not equipped with the voice recognition and processing section, and a second device which is a security input device,
(e) the first device and the second device are connected by bidirectional wireless communication;
and (f) an interface for establishing a bidirectional wireless communication connection and processing and controlling signal conversion in step (e), wherein the input information of the second device is transmitted to the first device, and the security input is performed in the first device And transmits the security input information to the second device to form a security input of the second device. delete

Images