JPS63228874A - Image file system and its device - Google Patents

Abstract

PURPOSE:To enable a user to retrieve an image by means of his own added information by constituting the titled system so that a user inputs various added information to an image as retireaval keys, and these keys are stored as files proper to each user. CONSTITUTION:At the time of registering an image or retrieving an image, a user inputs an added information to a display image, which is converted into a data formatable to be outputted as image signals or voice signals depending on the kinds of an input medium. Thus converted added information is stored, and at the same time an attribute file in which the ID number of the user, the added information to be stored and its attribute, and a display image are made corresponding to each other is generated, and this file is stored. At the time of the following retrieval of an image, the attribute of the added information is inputted as a retrieval key, so that an image that an added information meeting the condition is selected by referring to the stored attribute file, accordingly, the added information proper to the user is outputted together with the image. In such a case, the added information basically is a composite of a information from different media. Also, the attribute represents the feature of an added information from each input medium.

Description

[Detailed Description of the Invention] [Field of Industrial Application] The present invention provides an image file system in which a user can input additional information to a registered image or a searched image, and can retain and reuse it as the user's personal database. and its equipment.

[Conventional technology]

In recent years, double-headed file devices have been put into practical use, and opportunities for many people to access image databases have increased.
Document image filing systems such as the one described in ``Overview of the Electronic Filing System NEOFILE100O'' are becoming popular in offices.In this system, document images are input from a scanner, registered on an optical disk, and each image is registered as search information. Add bibliographic information such as date and title, keywords, etc.

When searching for an image, enter this search information, and the corresponding image will be displayed on a high-resolution disk/image monitor, and a hard copy will be taken if necessary. It is thought that the use of image databases will become more popular as more low-cost personal terminals are developed in the future.

[Problem that the invention seeks to solve]

However, when considering the usage of image files, the functions of currently provided devices are insufficient.

For example, when we read a paper file, we underline, mark important parts, and write annotations on the paper. Adding personal additional information to information in this way is a collection of information, and can be said to be a very important act in understanding and organizing information. Such additional information often becomes an important search key when searching for files.

For example, the underlines we draw with colored pencils on paper files and the marks we put at the edges of pages are often useful as tools for our own searches. Additionally, users often remember the act of adding their own information and search for the file.

Conventional image file devices provide this type of search function called ``bookmark'' search, which allows users to directly access images by inserting a virtual ``bookmark'' into the image file. . However, "bookmarks" are only intended for temporary direct access to frequently searched data, and do not attach effective search keys suitable for individual data.Additional search keys given to image data may be modified by individuals or data. There are various possibilities depending on the content, but conventional devices do not have the functionality to realize them.

Therefore, an object of the present invention is to compensate for the above-mentioned drawbacks of conventional image file devices, and to enable each user to input various additional information suitable for the image as a search key, and to input various additional information suitable for the image as a search key. The object of the present invention is to provide a function that allows the user to store images as an image search key, input them as an image search key, store them as user-specific files, and allow users to search using their own additional information when searching for images.

[Means for solving problems]

According to the present invention, at the time of image registration or image search,
The user inputs additional information for the displayed image, converts the input additional information into a data format that can be output as an image signal or audio signal depending on the type of input media, stores the converted additional information, and uses it at the same time. Create an attribute file that associates the ID number of the user, the additional information to be stored, its attributes, and the displayed image, store the created attribute file, and enter the attribute of the additional information as a search key the next time you search for an image. , an image file method that selects an image with additional information that matches the conditions by referring to a stored attribute file, and outputs user-specific additional information along with the image; and an addition method that inputs additional information for the displayed image. an information input means; an additional information conversion means for converting input additional information into a data format that can be output as an image signal or an audio signal according to the type of input media; and temporarily storing the input additional information; additional information output means for outputting the additional information temporarily stored as an image signal or audio signal; additional information storage means for storing the additional information temporarily stored in the additional information converting means; and the additional information converting means. Additional information storage management means for managing the input/output of additional information between the additional information storage means, and an attribute file for creating an attribute file that associates the user's ID number, the additional information to be stored and its attributes, and the display image. a creation means, an attribute file storage means for storing an attribute file, an attribute input means for inputting an attribute of additional information as a search key, and an attribute file in the attribute file storage means and an attribute of the additional information input by a user. It is possible to realize an image file device having an image selection means that compares the images, selects a display image having additional information that matches the conditions, and displays the image and outputs the additional information.

[Effect]

The image file method and device according to the present invention solves the drawbacks of the prior art by adopting the above-described configuration.

The image file system and its device according to the present invention are premised on having an image data management section for managing image data and an image data display section for displaying it. In image registration or search, the user inputs additional information using the provided additional information input means. Additional information is not limited to a single medium, but is basically a composite of information from different media, such as text information manually input using a keypad or vector information handwritten using a keypad/mouse input. The additional information converting means converts these additional information into a data format that can be output as an image signal or an audio signal depending on the type of input media, and temporarily stores the converted information. The stored data is outputted by the f-sizing information output means so that the user can confirm it.

Thereafter, the additional information data is converted into files for each input medium by the additional information storage management means and stored in the additional information storage means. At this time, the attribute file creation means creates or updates an attribute file that associates the user's ID number, the media type and its attributes of the input additional information, and the display image. The attributes here characterize the additional information for each input medium. For example, in the case of handwritten input using a mouse, the input date, the position of writing on the image plane, the type of handwritten information (box, underline, symbol, etc.), and color. , etc. are possible. The attribute file creation means receives notification of these attributes from the additional information conversion means, creates or updates a file record, and sets the user's ID.
A number is attached to the file header and stored in the attribute file storage means.

In the next image search, the user inputs the media type or attribute of the additional information previously given by the user from the attribute input means. Here, the image selection means searches the attribute file in the attribute file storage means and selects an image having additional information that matches the input search condition. , keywords, and other information used as search keys in conventional devices) are posted to the user, and the user is asked to specify the image to be displayed.The display of management information is an additional information output means, and the input of specifying the display image is performed by the additional information. When the user makes a designation using the input means or attribute input means, the image selection means reads the image from the image data management section and displays it on the image data display section. At the same time, the image selection means reads the corresponding additional information file from the additional information storage means via the additional information storage management means and sends it to the additional information conversion means.

The additional information conversion means identifies the media type of each file and stores each file in an outputtable format.

The stored information is output by the additional information output means.

If you overlay handwritten marks or text input using the mouse or keypad on the displayed image,
An interface similar to that used for adding information to paper files can be realized. Since the additional information and image data of Shikachi Toshikawa Sound are managed separately, even if it is shared image data, each user can check whether it is their own image data by simultaneously referring to the information that they have added. You can add a search key like this. In addition, it is also possible to add multifaceted search keys that cannot be achieved with paper files, such as adding unique icons or adding explanations by voice input. Adding your own unique search keys is important for better understanding and organizing data, and promotes effective use of image files.

(Example〕 Hereinafter, the present invention will be explained in detail with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of an image file device according to the present invention. In the figure, image data storage unit 1
1 stores image data. Image database management section 1
2 stores a database management system that describes image data. The image memory 13 expands and stores image data read from the image data storage section 11. mouse 14
and a keyboard], 5 constitutes additional information input means.

The keyboard 15 also serves as an attribute input means. The input controller 16, image buffer 17, and text buffer 18 constitute additional information conversion means. The image buffer 17 is a bitmap memory for outputting the input from the mouse 14 as a video, and the text buffer 18 is for the keyboard 1.
In order to output the text input of No. 5 as a video, the present invention is composed of a character code memory for storing character codes and a character font generator. Alternatively, it may be configured with a bitmap memory that stores character fonts as images. One overlay controller and display monitors IJ, O constitute additional information output means. At the same time, they also serve as image data output means. The attribute file creation section 111 is an attribute file creation means, the additional information storage management section 112 is an additional information storage management means, the additional information storage section 113 is an additional information storage means, the attribute file storage section 114 is an attribute file storage means, The drawing selection section 115 corresponds to an image selection means.

With the image file method and device according to the present invention, it is possible to input additional information for a displayed image during image registration or search. Additional information is not limited to a single medium;
This embodiment is based on a composite of information from different media, such as text information manually inputted from keys, and handwritten vector information inputted using a keypad/mouse. In this embodiment, a mouse and a keyboard are used as input devices. When the image is displayed on the display monitor 110, the user can input additional information using the mouse 14 and keyboard 15. In the following, adding handwritten marks using the mouse 14 and adding text using the keyboard 15 will be explained.

Input from the mouse 14 is monitored by an input controller 16 and is constantly written into the image buffer 7. The input is displayed as a cursor on display monitor 110 via overlay controller 19 . Handwritten marks are information added to noteworthy or important parts of image data, and are often used in daily document files. This is useful as a guide for searching, as well as for understanding and summarizing the data itself. Of course, a handwritten mark specifically for search may also be used. This is achieved as follows.

Consider the following types of marks:

Enclosure: Something that surrounds characters/shapes Underline: Underline of characters, text...
These selection menus are displayed on a part of the screen of the display monitor 110, such as letters/numeric values, symbols...→, O1×, Δ, and the user selects one of them with the mouse. Next, move the cursor and press the mouse button at the desired position. Then, the subsequent trajectory of the mouse cursor is written onto the image buffer], 7. The trajectory continues as long as the mouse button is held down. Repeat this as many times as necessary. The track you have written is on the display monitor 110.
It is displayed as an overlay with the image data on the top.

This makes it possible to express handwritten underlines, boxes around important parts, marks such as OLX on images, and it is possible to add information similar to paper documents. If you want to correct the input, use the mouse button to specify two points on the image plane (top left and bottom right, etc.) and clear the drawing data within the rectangle surrounded by the two points.

In the image file method and device according to the present invention,
An attribute characterizing the input additional information is used as a search key. Examples of attributes that characterize a handwritten mark input with a mouse include the following.

(B) Scratching position When displaying a mark as an overlay on image data, the scratching position is information that specifies where the mark is located on the image data plane. Virtual coordinates are set on the 0 image data plane, and these coordinate values are set. In the case of a 0 handwritten mark using 0, consider a rectangular area surrounding the mark, and use the coordinate values of the rectangle to indicate the mark position, for example, the coordinates of the two points at the top left and bottom right of the rectangle. !
For example, when writing a mark, the input controller 16 checks its coordinate values and constantly updates the upper and lower limits of the coordinate values, thereby obtaining the coordinate values of the smallest rectangle surrounding the mark. These coordinate values are notified to the attribute file creation unit 111, and are held in the attribute file creation unit 111 as a table.

(I7) Mark Type The type of mark is also effective as a search tool. When the type of mark is selected with the mouse 14, the input controller 16 notifies the attribute file creation unit 111 of the selection, where it is held as a table.

(8) Color The default value for the color of the mark is black and white, but if a plurality of bit brains are prepared in the image buffer 17, the color can be specified. Adding color marks with different colors is effective as a search key, and color marks can also be used to identify the main points of the data at a glance0
The color may be specified by a command using the keyboard 15 immediately before inputting a handwritten mark, or a color specification menu may be prepared on a part of the display screen and selected using the mouse 14. The input controller 16 also notifies the attribute file creation unit 111 about the color, where it is held as a table.

(d) Input Date Since it is possible to remember and search for the act of writing at some point, it is assumed that the attribute file creation unit 111 internally manages the 0 date information that also records the input date.

The user inputs comments or summaries regarding the image data using the keyboard 15. If input data is not specified by the user, the input controller 16 writes the data into a certain memory area of the text buffer 18, and the text is always displayed in a certain area (for example, at the bottom of the screen) on the display monitor 110. . If you want to display a comment at a specified position on the screen, for example, a manual cursor is displayed as an overlay on the screen, and you move the cursor to input text. Input controller 16
writes a series of text data up to the input of the carriage return into the corresponding area of the text buffer 18. Alternatively, a rectangular window may be opened at an arbitrary position on the screen using the mouse 14, and the input controller 16 may set a corresponding area of the text buffer 18 and write the rectangular window there. Multiple areas may be set. The attributes of key manual data include the scratched position, color, and input date in the same way as for mouse input.

When the input of the additional information is finished and the display image is changed, the additional information is converted into a file for each media type by the additional information storage management section 112 and stored in the additional information storage section 1'13. In the case of the embodiment, a file is created in the following data format, for example.

Regarding handwritten data input with a mouse, the additional information storage management unit 112 reads the position coordinates recorded in the attribute file creation unit 111, reads out the corresponding image block in the image buffer 17, adds the position coordinates to the header, and writes the code. shall be. It is also possible to set a large rectangular area surrounding all image blocks and read out the inside of the area at once. Similarly, in the case of manual input, the position coordinates are read from the attribute file creation unit 111, the corresponding text data is read from the writing area of the text buffer "18, and the position coordinates are added to the header to create a code. In this way, mouse input is performed. , each key data record is created manually, each is compiled into a file, and the media type of the file is written in the file header. Figure 2 shows a conceptual diagram of the mouse data file and key data file. 21 and P2 in the figure are These are file pointers for the mouse data, file, and key data file, respectively.Bounters P1 and P2 notify the attribute file creation units 1], 1.

Here, the attribute file creation unit 111 creates or updates an attribute file that associates the user's ID number, the stored additional information and its attributes, and the display image, and stores it in the attribute file storage unit 114. Here, for the security of personal information, an attribute file is created for each user, and the user's ID number is attached to the file header. It is assumed that the ID number is stored in the image selection unit 115 at the time of login, and the image selection unit 115 is notified of the ID number.
Furthermore, it is assumed that the image selection unit 115 also stores the ID number of the image being displayed (for example, the ID number is the logical file number of the image data), and this is also notified. As a result, the attribute file creation unit 11 creates a file record and stores it in the attribute file storage unit 114. FIG. 3 shows an example of the file format of the attribute file.

In the figure, Ii (i=1.2...n) is the ID number of the display image data, and Pi1 and Pi2 are pointers to the additional information file just created. In the figure, Pil is a mouse data file and Pi2 is a key data file. Since each file consists of multiple records (marks or text) at one time, multiple records appear for each file. Since this file has some redundancy, it may be managed by dividing it into two records that relate the image ID number and the additional information file pointer, and the additional information file pointer and the accompanying attributes, respectively. Fourth
An example is shown in the figure 0 In the record that describes the file pointer and attributes in the figure, the attribute field is repeated a finite number of times,
The length is indefinite. Furthermore, transposed files using each attribute item as an index may be created separately to improve the efficiency of searching for a file pointer and image ID number from the attribute item.

In the next image search, when the user logs in, the image selection unit 115 reads the attribute file of the corresponding user from the attribute file storage unit 114.By referring to this attribute file, the attribute of the additional information is set as the search condition. For example, a search menu in the following format is prepared so that it is possible to search for images.

Media type (mouse, keyboard) Scratch position (left, middle, right) and (top, middle, bottom) Mark type (box, underline, text, symbol) Text () Color (white, red, blue) Input date ( ``Media type j'', ``Writing position'', ``
Select one of the items in parentheses for ``mark type'' and ``color.'' For example, if you want to see ``data with a handwritten circle mark in the upper right corner of the page,'' select the media type (mouse).
, Scratch position (right) and (top), Mark type (symbol)
, and so on. "Mark type" is the media type (
It has meaning only when the mouse (mouse) is selected. Furthermore, "text" has meaning only when the media type (keyboard) is selected. In the "text" parentheses, write the character string you want to search for as a keyword. This data is compared with the text data recorded in the additional information file, and only records that match are selected. "
For "input date", it is also possible to specify only either the year, month, or day. There are no restrictions on attribute items that are not specified in parentheses; if nothing is specified, all additional information file records will be searched.

Here, the reason why the scratching positions are specified as upper left and lower right is because it is difficult for humans to memorize the positions accurately.0 The image selection unit 11 receives the position specification input.
Step 5 prepares in advance a conversion table for specified input and coordinates, and uses this to determine whether the position information described by coordinates in the attribute file is what the user desires.

FIG. 5 is a diagram showing an example of correspondence between coordinates and attribute items.

For example, coordinates (100,100), (200,200)
The mark described by is located on the ``top'' of the ``left''. A mark that spans an area, for example (100, 200),
If the underline is (1400, 300), the horizontal direction is applicable regardless of "left", "middle", or "right", and the vertical direction is "top". This mark can also be used to specify the horizontal direction. Regardless, if the vertical direction is specified as "top", it will be selected (the horizontal direction is not required).

The image selection unit 115 searches the attribute files to find one that matches the search conditions. If the key manual "text" attribute is specified, the image selection unit 115 looks at the key data file pointer of the attribute file record to be referenced, reads it via the additional information storage management unit 112, and selects the specified character string. After completing the search, the image selection unit 115 notifies the image database management unit 12 of the ID number of the image that meets the conditions, and reads the corresponding database record.The database record includes the image title, image Information used as a search key in conventional devices, such as input date and additional keywords, is recorded.

(In the attribute file, the image ID number may be used as the logical record number ID of the corresponding database record.) The image selection means 115 writes this record into the text buffer 18 and displays it on the display monitor 110.

In this way, users can obtain more search information from their personal search information input and select images they wish to display.

The user selects a display image using keystrokes or the like, and in response to this, the image selection section 115 reads out the corresponding image from the image data storage section 11 and writes it into the image memory 13.
It is displayed on the display monitor 110. On the other hand, the image selection unit 115 notifies the additional information storage management unit 112 of the additional information file pointer corresponding to the displayed image. The additional information storage management section 112 reads the necessary additional information file from the additional information storage section 113 according to the above file pointer, and sends it to the input controller 16. The input controller 16 identifies the media type of each file, assigns each file to an image buffer 17 and a text buffer 18, and performs scraping according to the address written in the header.

The overlay controller 19 overlays the written additional information and image and displays it on the display monitor 110.
Output to.

In the above, the image database system presents the search information held as shared data and asks the user to select the displayed image, but when the attribute file search is completed, reading of the selected image is started, Images may be read and displayed one after another until the image data desired by the user is displayed.

When using a mouse or a keypad, an icon may be displayed on a desired part of the image data in the same way as a handwritten mark. An arrow or a mark such as O1× may be used as an icon, but it is also possible to add an impressive search key that would not work well if written by hand. To select an icon, for example, a menu icon is displayed in advance in a certain area of the display screen, and the menu icon is selected using a mouse button. It can also be a pop-up menu. Next, use the mouse button to specify the location where you want the icon to be overlaid.

Although an example has been shown above in which additional information is output as an overlay as an image, it is also possible to use a microphone as the additional information input means and a speaker as the additional information output means to add audio annotations to the image. in this case,
An A/D converter, a D/A converter, a compression/expansion circuit, and an audio data buffer are added to the input controller (lt).

Audio data from the microphone is digitized by an A/D converter, compressed by a compression circuit, and then transferred to additional information storage section 113 via an audio data buffer. The simplest file format may be just a header indicating the media type and compressed data. In the case of audio data, the attribute information may be, for example, only the input date.

If you want to output audio together with image display, for example, media (audio), input size (61
The image selection section 115 reads the image data using the same algorithm as before, and at the same time the additional information storage section 113
The compressed data stored in the audio data buffer is decompressed by the decompression circuit by a start command such as a manual key, and then converted to an analog signal by the D/A converter and sent to the speaker. Sent. Reproduction may be repeated. Adding information by voice is very easy to input and does not interfere with thinking, so it can be expected to be used effectively.

In the present invention, additional information and attribute information are managed separately from image data for each user, so multiple users can add their own search clues to the same image data.
It is possible to provide an image file search environment tailored to each user. As mentioned earlier, by overlaying handwritten marks, underlines, or text input using a mouse or keypad on an image, you can create an interface similar to adding information to a paper file. It is also possible to add functions that cannot be achieved with paper files, such as adding unique icons or adding explanations by voice input. Of course, you can output additional information only if there is a request, and if there is no request, you can use the conventional image file search format.Adding your own unique search information is important for better understanding and organizing data. and promotes effective use of image files.

〔Effect of the invention〕

With conventional devices, searching using personal additional information was only possible with an insufficient function similar to that of a "bookmark," but with the image file system and its device of the present invention, searching using personal additional information can be performed in the same way as adding search information to a paper file. An interface like this can be realized. This allows each user to add additional information suitable for the image data, or additional information in the form of their preference, as a search key, which not only improves search efficiency but also improves understanding and memorization of image data. It also has a big effect. Moreover, since the additional information is managed separately from the image data for each user, each user can use the shared image data as if it were his or her own image data. Also, by using voice input, you can use search functions that cannot be achieved with paper files. Adding such unique information is important for better understanding and organizing image data, and promotes effective use of image files.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of an image file device according to the present invention;
Figure 2 is a conceptual diagram showing an example of the file format of an additional information file entered by mouse or keyboard input. Figure 3 is a conceptual diagram showing an example of the file format of an attribute file. Figure 4 is a conceptual diagram showing an example of the file format of an attribute file. Figure 4 shows two record formats of an attribute file. FIG. 5 is a diagram showing an example of the correspondence between the position coordinates on the image plane and the attribute item "marking position" input by the user. In the figure, 11 is an image data storage unit, 1.2 is an image database management unit, 13 is an image memory, 14 is a mouse,
15 is a keyboard, 16 is an input controller, 17 is an image buffer, 18 is a text buffer, 19 is an overlay controller, 110 is a display monitor,
111 is an attribute file creation section, 1 and 12 are additional information storage management sections, 113 is an additional information storage section, 114 is an attribute file storage section, and 115 is an image selection section.

Claims (2)

[Claims] (1) During image registration or image search, the user inputs additional information for the displayed image, and converts the input additional information into a data format that can be output as an image signal or audio signal depending on the type of input media. , stores the converted additional information, and at the same time creates an attribute file that associates the user's ID number, the additional information to be stored, its attributes, and the displayed image, stores the created attribute file, and uses it for the next image search. The user inputs the attributes of additional information as a search key, refers to the stored attribute file, selects an image with additional information that matches the conditions, and outputs the user's own additional information along with the image. Image file format. (2) In an image file device having an image display means for displaying a registered image or a search image, an additional information input means for inputting additional information for the displayed image, and an image signal for inputting the input additional information according to the type of input media. or additional information converting means for converting the data into a data format that can be output as an audio signal and temporarily storing the converted information; and additional information outputting means for outputting the additional information temporarily stored in the additional information converting means as an image signal or an audio signal. ; Additional information storage means for storing additional information temporarily stored in the additional information conversion means; Additional information storage management means for managing input/output of additional information between the additional information conversion means and the additional information storage means. ; Attribute file creation means for creating an attribute file that associates a user's ID number, additional information to be stored, its attributes, and a display image; Attribute file storage means for storing the attribute file; The attribute input means input as a search key compares the attribute file in the attribute file storage means with the attribute of the additional information input by the user, selects a display image having additional information matching the conditions, and displays the image. and image selection means for outputting additional information.