JP2002041199A - Operation processing method for computer device using shortcut symbol, and shortcut processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation processing method of a computer using a shortcut symbol for executing processing for allowing a computer to execute a prescribed job only by operating and reading a symbol displayed on a display screen by a scanner or an electronic camera. SOLUTION: A series of macro-commands formed in program language processable by a computer device 1 and symbols I1 and I2 to be displayed with pictures or graphics on a display screen 11 are registered so as to be made correspond to each other in a computer device 1. In the computer device 1, when the symbols I1 and I2 displayed on a page space or the display screen 11 are read by a picture reading means 2 such as a scanner or an electronic camera, the symbols I1 and I2 are identified, and the macro-commands registered so as to be made correspond to the symbols I1 and I2 are decoded and executed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention executes at least a part of a predetermined job registered in a computer by simply reading a symbol displayed on a display screen by operating an image reading means. Operation processing method of a computer device using the shortcut symbol as described above,
And a shortcut processing system for realizing the method.

[0002]

2. Description of the Related Art Recently, computer devices have become widespread in offices and homes, and work such as document input, spreadsheets, and Internet connection can be efficiently performed using applications registered in the computer devices. I can do it.

[0003]

By the way, conventionally,
An application in which a plurality of hierarchically structured input operation screens are prepared to execute a plurality of related jobs, for example, when performing a spreadsheet operation using spreadsheet software, a predetermined function expression When the numerical values of the cells are totaled by using, it is necessary to sequentially open the lower hierarchy from the upper hierarchy and execute the target processing. This operation is not only troublesome for a user, but also difficult for an unskilled user.The present invention solves the above problem by operating a symbol displayed on a display screen using an image reading unit. It is an object of the present invention to provide a computer operation processing method using a shortcut symbol that causes a computer to execute a predetermined job when read, and a shortcut processing system that realizes this method.

[0004]

According to a first aspect of the present invention, there is provided an operation processing method for a computer device, comprising: a series of macro commands formed in a language processable by the computer device; In the computer device, a symbol displayed as a picture or a figure on the display screen is registered in advance in a computer device in association with the symbol. In the computer device, when the symbol displayed on the display screen is read by a scanner or an electronic camera, the symbol is read. Is identified, a macro command registered in advance corresponding to the symbol is decoded, and a predetermined job is executed.
Here, as a display screen, it is desirable to use a plasma display having a higher resolution in addition to a CRT monitor, a liquid crystal monitor, or the like.

According to a second aspect of the present invention, a symbol displayed on a display screen is touched to an image reading means, an operation button of the image reading means is operated, and a mouse and a keyboard are operated. When a specific operation is performed, for example, the information such as the macro command registered corresponding to the specific operation is opened on the display screen and can be edited.

According to a third aspect of the present invention, the macro command registered in the macro command registration table corresponding to the symbol includes at least the communication address of the specific service server, and is displayed on the display screen. When the displayed symbol is read by a computer device using a scanner or an electronic camera, the communication address is handled by communication browser software on the computer device side to link to a specific homepage. In this case, by including specific information in the symbol, it is also possible to automatically start the communication browser simply by reading with a scanner or an electronic camera and to access the pinpoint.

In the operation processing method for a computer device according to the present invention, the symbol registered in the computer device is formed of a one-dimensional barcode such as JAN, a two-dimensional code, a multidimensional code, or the like.

According to a fifth aspect of the present invention, the two-dimensional code includes an area marking for specifying a two-dimensional reading area, and a secondary coordinate in the two-dimensional reading area specified by the area marking. Symbols such as pictures and characters are written on an information display surface defined by a coordinate scale for designating a position, thereby reducing errors in reading the symbols.

According to a sixth aspect of the present invention, the two-dimensional reading area is further provided with an end marking for specifying an end point thereof.

[0010] In the shortcut processing system according to the present invention, an image reading means for reading image data, a symbol registration means including a symbol / command registration table for registering symbols and macro commands in association with each other,
When a symbol is read by the image reading unit, an interrupt is made to the OS running on the computer device, an image processing unit that extracts features on an image from image information of the read symbol, and a specific job is executed. For,
From the features on the image extracted by the image processing means,
A computer device comprising symbol / command conversion means for reading and decoding a macro command registered corresponding to the symbol with reference to the command registration table.

In the shortcut processing system according to the present invention, when a specific operation is performed by the image reading means, the computer device displays the macro command registered in the symbol / command registration table on a display screen, A means for editing the displayed macro command is provided.

Here, in claims 7 and 8, all the constituent means may be included in one file, so that it can be easily applied to other computer devices having a uniform command standard. Data can be transferred, for example, 1
A single business establishment can implement the method of the present invention on a plurality of computer devices.

In the shortcut processing system according to the ninth aspect, the image reading means wirelessly sends the read image data to a computer device, and the computer uses a signal medium such as a weak radio wave or infrared light from the image reading means. And wirelessly transmitted image data.

In the shortcut processing system according to the present invention, the image reading means has a function of storing the read image data as still image data or moving image data.

[0015]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing an example of a main configuration of a shortcut processing system proposed to realize a method of the present invention.

This system comprises a computer device 1 driven by a predetermined OS and image reading means 2 such as a scanner or an electronic camera.
A signal processing unit 10 configured by a PU or the like and controlling the following units; a display unit 11 having a display screen such as a CRT device, a liquid crystal device, and a plasma display device; and an operation unit 12 configured by a keyboard and a mouse. The storage unit 13 that previously stores various programs necessary for the operation of the computer device 1 and various applications such as dictionary search software, Internet browser, mailer software, and spreadsheet software, and a symbol / command registration table 14A. A symbol / command registration unit 14 having
An image processing unit 15, a symbol / command conversion unit 16,
Through a macro command editing unit 17, an interface unit 18 conforming to the USB standard, and the Internet N,
A communication control unit 19 that controls communication with another computer device or server; Note that the interface unit 18 may be an interface conforming to the RS-232C standard or the like. Note that the symbol / command registration unit 14 is a symbol / command registration unit.
Reference numeral 5 denotes an image processing unit, a symbol / command conversion unit 16 denotes a symbol / command conversion unit, and a macro command editing unit 17 denotes a macro command editing unit.
These functions will be described later.

Here, the image reading means 2 comprises a digital camera, and has a function of storing the read image data as still image data or moving image data. The image reading unit 2 includes a CPU for high-speed processing, and is configured by a signal processing unit 20 that controls the following units, an image reading unit 21 including a CCD, and the like. Processing unit 22 (which may be one that can support black and white processing) for converting the read image into color image data, a read command button 23, and an operation lamp 24 composed of an LED or the like.
Image data between the computer and the computer 1
An interface unit 25 for transmitting data in conformity with the standard, and a storage unit 26 configured by a memory stick or the like and storing read image data are provided.

This macro command registration table 14A
Has a configuration as shown in FIG. 3, and reads a symbol displayed on the paper surface or the display unit 21 with the image reading unit 2 or creates the symbol with predetermined symbol creation software on the computer device 1. The symbols I1 and I
2 can be registered as image information.

In response to these, macro commands I1 'and I2' created by performing object-oriented programming such as Visual Basic, Java, and C ++ languages and other commercially available ones can be registered. The edited program may be incorporated in a DLL file or the like and operated on an OS running on a computer device. Here, the macro command I1 'is a command for summing cell numbers in a predetermined range on spreadsheet software, and the macro command I2' is a command for calculating an average value of cell numbers in a predetermined range on a spreadsheet. The macro commands I1 'and I2' can include normal character data and symbol data. The storage unit 13 stores OCR software and stores predetermined character and symbol data. If an arbitrary application is handled, the computer device 1 can identify the character and symbol data and automatically perform a process related to the corresponding application. A bar code can be registered as a symbol, and a one-dimensional code I3 and a two-dimensional code I4 can be registered, and a macro command I
3 ′ and I4 ′ are registered. For example, the macro commands I1 'and I2' may include at least the communication address of a specific service server. When the symbols I1 and I2 displayed on the display screen are read by the image reading means 2, the communication addresses are used. Can be handled by the communication browser software, when the computer 1 identifies the communication address, the communication browser software can be activated to access a specific service server. As a handling method, when the identification symbol (for example, 記号) of the communication address is identified by the OCR software, the communication browser software is activated, or the appearance of the symbols I1 and I2 is made characteristic, and the image information of the appearance is displayed. A method is considered in which communication browser software is automatically started when is input, and a desired homepage or the like is accessed in a pinpoint manner (use for Internet access).

As described above, multi-dimensional codes such as a one-dimensional code I3 and a two-dimensional code I4 can be used as the symbols I1 and I2. In this case, these symbol images are directly used as symbol symbols. Can be used as Furthermore, when using a multidimensional code such as the two-dimensional code I4, if character and symbol data are stored in them, the stored information can be converted into characters,
It can be decoded into symbol data and used.

Since the two-dimensional code I4 has a configuration as shown in FIG. 4, symbols can be registered in the symbol / command registration table 14A as shown in FIG. That is, the two-dimensional code I4 is
As shown in FIG. 4, 12 (1 to 12 rows) × 12 (A to L
The matrix is configured by arranging dots on a matrix composed of 144 cells constituted by the squares of the column.

The code I4 is an X-axis base line b formed by arranging dots in order to specify the two-dimensional reading area g.
(X reference line) and a Y-axis base line c (Y reference line) are provided as area markings. Further, two dots of the two-dimensional reading area g specified by the X-axis base line b and the Y-axis base line c are provided. In order to specify the next coordinate position (cell position on the matrix), a coordinate scale is written on each of the X-axis base line b and the Y-axis base line c. In the illustrated example, the coordinate scale is formed by adding timing marks d and e formed by arranging dots at equal intervals, and these form an information display surface a on which the symbol h is written. These area markings and timing marks indicate the area on which the symbol mark is written in order to facilitate image processing by a computer.
Even in the case of a missing part, when a normalization process or the like is performed, the two-dimensional reading area g is correctly recognized so that the symbol image can be easily decoded.

F is an end marking, which is indicated at a diagonal position of an intersection of the X-axis base line b and the Y-axis base line c to indicate the end point of the reading area. In the illustrated example, the code I4
However, even when the symbol h is turned upside down, left and right, or turned upside down and read by the computer apparatus 1, the up, down, left and right are asymmetric so that the symbol h can be correctly recognized. A corner mark f composed of three cells is written.

Such a two-dimensional code I4 is useful for reducing errors at the time of reading. With this configuration, the computer apparatus 1 can use only the symbols h to h3 in FIG. Can be accurately identified, and the corresponding macro commands h ′ to h3 ′ can be executed. Note that the macro command h ′ is a command for activating specific spreadsheet software, the macro command h1 ′ is for reading image information such as a photograph,
The command for activating the image database software to be edited and managed, the macro command h2 ', displays an X-ray photograph, a CT image, or the like stored corresponding to a patient used in a hospital or the like on a screen, and performs diagnosis. Command to do,
The macro command h3 ′ is a command and a command group of a personal chart management system that displays patient information stored in a database on a screen, inputs data when a diagnosis or treatment is performed, and edits and manages the data. As shown, these commands are appropriately programmed according to the purpose of use, and can execute a desired job or a part thereof.

Next, the operation of the shortcut processing system having such a configuration will be described with reference to the flowchart of FIG. That is, the image reading means 2 is operated to generate symbols I1 and I2 (see FIG. 1) as symbols.
Is read (100), the read symbols I1, I
2 is sent to the computer device 1 as image information (101), and in the computer device 1 receiving the image information, the image processing unit 15 is operated by the computer device 1.
S (for example, Microsoft Windows 98 (registered trademark of Microsoft Corporation)) is interrupted, the received symbols I1 and I2 are identified, and features on the image are extracted from the image information (102). , The symbol / command conversion unit 16 calculates
The corresponding macro commands I1 'and I2' are read from the macro command registration table 14A (103), and the read macro commands I1 'and I2' are read by the signal processing unit 10.
Is executed (104).

FIG. 7 shows an example in which the above-mentioned symbols are displayed on paper. The sheet S plays a role as a command sheet, and symbols I5 to I7 are printed on the sheet. The symbol I5 is a symbol for activating document creation software such as a word, and when read by the image reading means 2, the computer apparatus 1 activates the document creation software. The symbol I6 is a symbol for starting spreadsheet software such as Excel, and when read by the image reading means 2, the spreadsheet software is started in the computer device 1.

The symbol I7 is stored in the computer device 1 in advance.
The symbol search for the dictionary search software
Is a symbol for prompting a search for the character data identified before reading the character data. That is, if a character displayed on a paper surface or a display screen is read by a specific operation of the image reading means 2, dictionary search software is started in the computer device 1, and then, when the symbol I7 is read, the OCR of the computer device 1 is read. Characters read as image data are converted into character data by the software, and a corresponding meaning is searched from the dictionary search software based on the character data. Here, the computer device 1 can edit the contents of the macro commands I1 'and I2' in the macro command registration table 14A. When the symbols I1 and I2 (see FIG. 1) displayed on the paper surface or on the display screen are read by a specific operation of the image reading means 2, the read symbols I1 and I2 are transmitted to the computer device 1 as image information. Therefore, in the computer device 1 receiving this, the macro command editing unit 16 opens and displays a macro command editing screen as shown in FIG.

On the macro command editing screen, the read symbol, for example, the symbol I1, is displayed, and the macro command I corresponding to the symbol I1 is displayed.
1 'is displayed in the macro command display column 11A,
The contents of the macro command I1 'in the display section 11A can be edited by operating the keyboard or the like. If the contents of the display section 11A are acceptable, the OK button 11B is operated, the editing operation is stopped, and the original contents can be used. In this case, the cancel button 11C is operated.

Such a macro command can be used not only in a general-purpose computer but also in various modes and responsively in a medical device, a complicated management device of an operator's operation, a multifunctional database device in a specific field, and the like.

[0030]

As can be understood from the above description, in the operation processing method for a computer device according to the first aspect of the present invention, a desired job is stored in the computer only by operating the image reading means to read the symbol. Can be executed in a predetermined process, which is very convenient for the user, unlike the conventional shortcut displayed on the display screen only for activating the application.

According to a second aspect of the present invention, when a specific operation is performed by the image reading means, information such as a macro command registered corresponding to the symbol displayed on the display screen is displayed. Open on the display screen,
Since editing is possible, the contents of the macro command corresponding to the symbol can be automatically edited, and the user can arbitrarily customize the contents of the macro command.

According to a third aspect of the present invention, the macro command includes at least the communication address of the specific service server, and converts the symbol displayed on the display screen using the image reading means. When read by the computer device, the communication address is handled by the communication browser software on the computer device side, and a specific service server is accessed.
If the symbol is read by the image reading means, the computer device can start communication browser software and access the service server of the communication address included in the symbol in a pinpoint manner.

In the operation processing method for a computer device according to the present invention, the symbols registered in the computer device are bar codes, two-dimensional codes, and multi-dimensional codes. Can be stored, and in that case, the information of the code can be used effectively, and the computer device can decode the code from the image information into character and symbol data and use it.

According to a fifth aspect of the present invention, the two-dimensional code includes an area marking,
Since the information is indicated on the specified information display surface by the coordinate scale, the symbols can be easily and accurately identified. Further, even if a manual or a catalog describing the two-dimensional code expands or contracts or becomes dirty, the decoding process on the computer side can be easily and accurately performed.

In the operation processing method for a computer device according to the present invention, the two-dimensional code is provided with an end marking for specifying an end point.
Even if the left and right sides are in different directions, the entire code is deformed, or the front and back sides are reversed, the symbols can be correctly identified and reading errors can be reduced.

In the shortcut processing system according to the present invention, an image reading unit, a symbol registration unit including a symbol / command registration table, and an image processing unit for extracting a feature on an image from image information of the read symbol are provided. ,
Since the computer is provided with a symbol / command conversion means for reading a macro command registered corresponding to a symbol from the extracted image feature, the method of the present invention can be easily implemented. Can be.

In the shortcut processing system according to the present invention, the computer device performs a specific operation of the macro command registered in the symbol / command registration table, the symbol displayed on the display screen by the image reading means. Thus, a macro command editing means for displaying on the display screen and editing a part of the displayed macro command is provided, so that it is possible to provide a system exhibiting the effect of the above-described claim 2.

In the shortcut processing system according to the ninth aspect, the image reading means wirelessly sends the read image data to the computer, and the computer receives the image data wirelessly sent from the image reading means. Therefore, there is no need to wire-connect the image reading means and the computer device with a cable or the like, and the symbols can be read by the image reading means from anywhere as long as the wireless signal can reach the computer. It is.

In the shortcut processing system according to the tenth aspect, since the image reading means has a function of storing the read image data as still image data or moving image data, the image reading means can be used as a digital camera. Can be useful.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an example of a main configuration of a shortcut processing system according to the present invention.

FIG. 2 is a diagram illustrating an example of an internal configuration of an image reading unit.

FIG. 3 is a diagram illustrating an example of a configuration of an address / command registration table.

FIG. 4 is a diagram illustrating an example of a configuration of a two-dimensional code.

FIG. 5 is a diagram showing another example of the configuration of the address / command registration table.

FIG. 6 is a flowchart for explaining a basic operation of the shortcut processing system.

FIG. 7 is a diagram showing an example in which symbols are displayed on paper.

FIG. 8 is a diagram showing an example of a macro command editing screen.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Computer apparatus 2 ... Image reading means 11 ... Display part 14 ... Symbol / command registration part 14A ... Symbol / command registration table 15 ... Image processing part 16 ... Symbol / Command conversion unit 17: Symbol / command editing unit I1 to I7, h to h3: Symbol I1 'to I4', h 'to h3': Macro command S: Paper space

Claims (10)

[Claims] 1. A computer system in which a series of macro commands formed in a language that can be processed by a computer device are registered in the computer device in correspondence with symbols displayed as pictures or figures on a display screen. Then, when the symbol displayed on the display screen is read by image reading means such as a scanner or an electronic camera, the symbol is identified, and a macro command registered corresponding to the symbol is decoded. An operation processing method for a computer device, wherein a shortcut symbol for executing a predetermined job is used. 2. The method according to claim 1, wherein when a specific operation is performed on the symbol displayed on the display screen by the image reading means, information such as a macro command registered corresponding thereto is displayed on the display screen. An operation processing method for a computer device, characterized in that the computer device can be opened and edited. 3. The macro command according to claim 1, wherein the macro command registered in the macro command registration table corresponding to the symbol includes at least a communication address of a specific service server, and is displayed on the display screen. The read symbol is read by the computer device using the image reading means, and the communication address is handled by the communication browser software on the computer device side to access a specific service server. , Computer device operation processing method. 4. The symbol according to claim 1, wherein the symbols registered in the computer device are symbol images such as one-dimensional bar codes, two-dimensional codes, and multi-dimensional codes. , Computer device operation processing method. 5. The two-dimensional code according to claim 4, wherein the two-dimensional code is an area marking for specifying a two-dimensional reading area, and coordinates specifying a secondary coordinate position in the two-dimensional reading area specified by the area marking. An operation processing method for a computer device, wherein a symbol such as a picture or a character is written on an information display surface defined by a scale. 6. The computer processing method according to claim 5, wherein an end marking for specifying an end point is further provided in the two-dimensional reading area. 7. An image reading means such as a scanner or an electronic camera for reading image data, and a symbol / command registration table for registering symbols displayed on paper or on a display screen in association with macro commands. When a symbol is read by the symbol reading means and the image reading means,
An image processing means for interrupting S and extracting a feature on the image from the image information of the read symbol; and extracting a feature from the symbol read by the image processing means to execute a specific job. And a symbol / command conversion means for decoding a macro command registered corresponding to the symbol with reference to the symbol / command registration table. When you read
A shortcut processing system that executes a specific job specified by a macro command registered in advance in a registration unit in accordance with the symbol. 8. The computer system according to claim 7, wherein when the computer device performs a specific operation,
Displaying a macro command registered in the symbol / command registration table on a display screen, and editing the displayed macro command.
Shortcut processing system. 9. The shortcut processing system according to claim 7, wherein the image reading means and the computer device are wirelessly connected. 10. The shortcut processing system according to claim 7, wherein the image reading means has a function of storing the read image data as still image data or moving image data.