JP3513308B2 - Filing device and control method thereof - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention is directed to other applications.
® emissions and at the same time operational test to handle multimedia data a
Filing device for controlling search application and
Regarding the control method .

[0002]

2. Description of the Related Art Conventionally, as a document processing device such as a word processor, there is a document processing device built on a personal computer or a workstation. When editing a document created by this document processing apparatus, multimedia data, especially an image, may be embedded in this document.

For example, Microsoft Word for operating on Microsoft Windows (registered trademark of Microsoft Corporation in the United States)
In document processing by Windows (a product of Microsoft Corporation in the United States), embedding multimedia data into a document can be inserted as it is (copies an image into the document), or can be an object. By associating with.

In the above-mentioned form of copying an image in a document, if a different image is accidentally copied in the document, the image copied in the document is deleted, and after the image is corrected by a graphics processor or image retouching software. , I need to copy the image into the document.

In Microsoft Windows, OLE (Object Linking) is used as a method of associating objects.
and Embedding), which allows information created by other applications to be included in a document and this information can be modified in the document.

[0006] In the OLE form, it is possible to correct the image in the state of being fitted in the document, but when selecting the image to be fitted, it is necessary to specify the image by the file name. When there are multiple files to be selected when selecting an image, specify the file name that stores the desired multimedia data from each file, and read the specified multimedia from this specified file. , It is necessary to insert this multimedia data into the document.

[0007]

However, at the time of this selection, the user imagines the contents from the file name and specifies the file which is presumed to store the predetermined multimedia data. When the specified file does not include the multimedia data intended by the user, the user needs to perform the operation for selecting the file again, and the operation for selecting the file does not include the predetermined multimedia data. It is repeated until it is found. Therefore, the operability is poor and the work efficiency is reduced.

An object of the present invention is to provide a filing device and a control method which can improve operability in selecting multimedia data and can improve work efficiency.

[0009]

[0010]

[0011]

The invention according to claim 1 is
A filing device that controls a search application that handles multimedia data and that can operate simultaneously with other applications, and is a backup device for the other applications.
In the background, on the other application
Based on the input information and retrieval means for retrieving multimedia data, in accordance with the detection Sakuyui results of the searching means, the search of
The retrieved data used by the search application
Window or other application
Or a a Ru switching <br/> Rikae changeover means is displayed on the display window of data down handled, selected in the search window
The data used by the other application to handle the selected data.
Display control means for displaying the data in a display window of the computer .

According to a second aspect of the present invention, in the filing apparatus according to the first aspect, when the number of the multimedia data retrieved by the retrieval means is one, the retrieved multimedia data is stored in the other multimedia data . application
When the number of multimedia data retrieved by the retrieval means is plural, the retrieved multimedia data is retrieved
It is characterized in that it is provided with a multimedia data fitting means for fitting into the working window .

According to a third aspect of the present invention, in the filing apparatus according to the second aspect, the multimedia data fitting means determines whether or not a special code is input to the clipboard, and the search is performed according to the determination result. applique multimedia data retrieved by means of the other
It is characterized in that it is inserted into multimedia data according to the application .

According to a fourth aspect of the present invention, in the filing apparatus according to the second aspect, the multimedia data fitting means determines whether or not a special code has been input to the clipboard, and the search is performed according to the determination result. applique multimedia data retrieved by means of the other
It is characterized in that it is associated with multimedia data according to the application .

According to a fifth aspect of the present invention, in the filing apparatus according to the second aspect, inter-application communication means for mutually communicating with the other application is provided, and the multimedia data fitting means is the inter-application communication. The other application through means
Receiving the multimedia data fitting event from Deployment, based on this multimedia data fitting event by operating the search means, multimedia data by <br/> multimedia data retrieved by said retrieval means to said other application It is characterized by inserting into.

According to a sixth aspect of the present invention, in the filing apparatus according to the second aspect, inter-application communication means for mutually communicating with the other application is provided, and the multimedia data fitting means is the inter-application communication. The other application through means
Receiving the multimedia data fitting event from Deployment, based on this multimedia data fitting event by operating the search means, multimedia data by <br/> multimedia data retrieved by said retrieval means to said other application It is characterized by being associated with.

According to a seventh aspect of the invention, in the media filing apparatus according to the second to sixth aspects,
Another application is a word processor, and the multimedia data fitting means uses the macro function of the word processor.

The invention according to claim 8 is the frame according to claim 2.
In the sailing device, the search window is
A multi-screen display of the retrieved multimedia data
It is characterized by including the screen shown .

According to a ninth aspect of the present invention, in the filing apparatus according to the second aspect , the search window is
Display multiple retrieved multimedia data in chronological order
It is characterized by including the screen shown .

According to a tenth aspect of the invention, in the filing apparatus according to the second aspect , the search window is
Current among the searched multimedia data
Displayed multimedia data and remaining multimedia data
It is characterized by comprising a screen for displaying together with the number of media data .

The invention according to claim 11 is another application.
And can handle multimedia data
Control of the filing device that controls the search application
It is a method of backing up the other application.
In the round, the entry on the other application
Search engine to search multimedia data based on force information
According to the search result of the search process.
The search data used by the search application.
Window or other application
To display in the data display window
Switching process, and selected in the search window
Table of data handled by other applications
And a display control step for displaying in a display window.
And are characterized.

The invention according to claim 12 is that according to claim 11.
In the control method of the
When the number of media data is 1, this searched
Other applications handle multimedia data
Insert the data in the window for displaying
If the number of multimedia data retrieved by
Each searched multimedia data to the search window
Multimedia data fitting process to fit in the window
It is characterized by having. The invention according to claim 13 is
The control method according to claim 12, wherein the multimedia is provided.
A special code is placed on the clipboard during the data fitting process.
Mode is entered, and depending on the result of this decision,
The multimedia data retrieved in the retrieval step is
Insert into multimedia data by other applications
It is characterized by entering. The invention according to claim 14 is a contract
The control method according to claim 12, wherein the multimedia
In the data fitting process, a special code is placed on the clipboard.
It is determined whether or not the
Other than the multimedia data searched in the search step
Related to multimedia data by application of
It is characterized by attaching. The invention according to claim 15 is a contract
The control method according to claim 12, wherein the filing device is
To communicate with other applications.
And an inter-application communication means of
At the ear data fitting process,
Malware from the other applications via communication means
After receiving the Chimedia data inset event, this multi
The search step based on the media data fitting event
The search performed by the
Media data from other applications.
It is characterized by being inserted into the multimedia data. Claim
The invention according to claim 16 is the control method according to claim 12.
The filing device is used for other applications.
Inter-application communication means for communicating with each other
In the step of inserting the multimedia data,
The other application is transmitted through the inter-application communication means.
Application of multimedia data from application
Event, this multimedia data embedded event
The search means is operated based on the
The retrieved multimedia data is used for the other applications.
Special feature to associate with multimedia data
To collect. The invention according to claim 17 is the invention according to claim 12 or
The control method according to claim 16, wherein the other application
The application consists of a word processor.
In the ear data fitting step, the word processor
It is characterized by using the macro function. Claim 18
The described invention is the control method according to claim 12, wherein
The search window is a window for searching
A special feature is that it consists of a multi-image display screen
To collect. The invention according to claim 19 is the invention according to claim 12.
In the control method, the search window is the search
Multiple displayed multimedia data in time series
It consists of a screen. Invention of Claim 20
Is a search window in the control method according to claim 12.
Indo is a search for multiple multimedia
Currently displayed multimedia data and remaining
Image to be displayed together with the number of multimedia data
It is characterized by being composed of faces.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 is a block diagram showing the configuration of a first embodiment of a filing apparatus of the present invention and a peripheral device such as a word processor connected thereto. Although the filing device and the word processor are software that is activated on the OS, they will be described below with reference to this block diagram in order to schematically represent their functions.

As shown in FIG. 1, a word processor 101 and an OS unit 103 are connected to the filing apparatus 102, and the operation of the entire apparatus is controlled by the CPU 100.

The word processor 101 has a word processor main 101a, a copy means 101b, a cutting means 101c, an OLE client 101d, and a clipboard writing section 101d. The word processor 101 is, for example, Microsoft Word for Win.
It is built with software such as dows, WordPerfect for Windows (a product of Word Perfect, Inc. in the US), AmiPro (a product of Lotus, Inc. in the US), and is activated on the OS unit 103. A key input from the keyboard 104 is processed by the word processor main 101a and can be written in the clipboard 103a described later.

The filing device 102 includes a user selection unit 102a, a foreground search unit 102b, a data transformation unit 102c, an OLE server 102d, a selector 102e, a search unit 102f, a background search unit 102g, and a data retrieval. It has means 102h and a clipboard monitoring unit 102i.

The OS section 103 includes a clipboard 103a.
, OS 103b, keyboard driver 103c,
Pointing device driver 103d, display driver 103e, and data storage device driver 10
3f.

The word processor main 101a of the word processor 101 has a document creating function in response to a key input from the keyboard 104.

The copy means 101b is a keyboard 104.
In response to a copy instruction of the pointing device 105 from the clipboard 103a (O
It has a function of copying to a shared memory provided by S etc.).

The cutting means 101c is a keyboard 104.
In response to a cut instruction from the pointing device 105 from the device, the target data to be cut is written to the clipboard 103a, and the data is erased from the memory of the application including the target data.

The OLE client 101d comprises means for calling an application for managing the object from the fitted object. In the present embodiment, since an image that is multimedia data is used as an object below as an application, an image processing application is used. Further, the processing contents are notified to the data transformation unit 102c described later.
This processing content is input by the keyboard 104 and the pointing device 105. This detail is
Since it is described in the manual of Microsoft Word for Windows, its explanation is omitted.

The clipboard writing unit 101e is means for writing the data obtained through the cutting means 101b and the copying means 101c to the clipboard 103a.

User selection unit 1 of the filing device 102
02a receives what is selected by the user with the pointing device 105 from the search screen displayed on the display 106 according to the data of the clipboard 103a described later, and sends a signal to the data transformation unit 102c.

Further, the selected multimedia data can be edited (for example, the target area can be designated in the multimedia data displayed on the display 106, the area can be cut out according to the designation, the trimming or reduction, the enlargement can be designated. The data transformation unit 1 issues an instruction to enlarge or reduce the image with a corresponding scaling factor.
Output to 02c.

The foreground search unit 102b requests a plurality of multimedia data to the search unit 102f, retrieves the requested data from the data storage device 107 via the OS unit 103b, and displays it on the display 106. Become.

The data transforming unit 102c comprises means for performing operations such as partial clipping of the searched multimedia data, trimming and enlargement / reduction of image data, by inputting the above-mentioned processing contents.

The OLE server 102d receives an event sent from the OLE client 101d, and by this event, for example, activates the filing device 102 or notifies the data transformation 102c of the event.

The selector 102e comprises means for determining whether the number of multimedia data retrieved by the background retrieval unit 102g is one or more. When the number of retrieved multimedia data is one, data transformation is performed. The searched multimedia data is sent to the section 102c, and when the number of searched multimedia data is plural, a signal to that effect is sent to the foreground search section 102b.

The search unit 102f is composed of means for searching for a file that matches the keyword and requesting the data extracting means 102h.

The background search unit 102g comprises means for sending a search request to the search unit 102f for a keyword obtained from the clipboard 103a without displaying it.

The clipboard monitoring unit 102i monitors the data stored in the clipboard 103a, and when the data is a special code for calling the filing device 102, it comprises means for sending the keyword described after the code to the background search unit 102g. .

Clipboard 103a of OS section 103
Reads and writes data from the respective applications, that is, the word processor 101 and the filing device 102, in the memory area provided by the OS 103b. OS
Reference numeral 103b includes a clipboard and means for managing each device driver, and the application operates on this means.

The keyboard driver 103c is a means for operating the keyboard 104, and the pointing device driver 103d is a pointing device 1.
05 is operated. The display driver 103e is a unit for operating the display 106, and the data storage device driver 103f is a unit for operating the data storage device 107.

The keyboard 104 is used for data input in the word processor. The pointing device 105 is composed of a mouse, a pen, or a tablet, and is an instruction means for selecting multimedia data on a search screen described later. The display 106 comprises means for displaying multimedia data, sentences by the word processor 101, etc. As this means, a CRT or a liquid crystal display device such as TFT or FLCD is used.

The data storage device 107 is a storage medium such as a hard disk, a magneto-optical disk or a floppy disk, and is arranged outside or inside the OS section 103. The data storage device 107 is composed of a bitmap memory for storing multimedia data, and an address of the above-mentioned bitmap memory and a table address that associates a keyword.

Next, the operation of the filing apparatus of this embodiment will be described with reference to the drawings. 2 is a diagram showing an example for explaining a search of a word processor generated by the filing apparatus of FIG. 1, and FIG. 3 is a flowchart showing an operation in the word processor and the filing apparatus of FIG.

First, a procedure for fitting the multimedia data created by the filing device 102 into the document created by the word processor 101 into the word processing document will be described with reference to the flowchart shown in FIG.

First, the pointing device 105 indicates the position for writing the multimedia data in the document created by the word processor 101 and displayed on the display 106.

Next, a keyword is input by the keyboard 104 together with a predetermined code "!!" for activating the filing device 102 (software).

The above code is the predetermined code "!".
!! The code is not limited to "" and any code that is rarely used in a normal word processor may be used, and examples thereof include "\\" and "$$".

The input code and keyword are cut or copied by the cutting unit 101c or the copying unit 101b, and the clipboard writing unit 1
It is written to the clipboard 103a via 01e (step SA301).

This code is a request from the word processor 101 to the filing apparatus 102 for multimedia data according to the keyword (step SA302).

In order to detect the above code, the clipboard monitor 102i constantly monitors whether the code written in the clipboard 103a is the above-mentioned predetermined code (step SB301). When the clipboard monitoring unit 102i detects that the code is not the predetermined code, the clipboard monitoring unit 102i determines that the filing apparatus 02 is not requesting multimedia data, and returns an NG response to the word processor 101 (step SB3).
02, SB303).

On the other hand, the clipboard monitoring unit 102
When the predetermined code is detected in i, the clipboard monitoring unit 102i acquires the keyword following the predetermined code from the clipboard 103a and notifies the background search unit 102g.

The background search unit 102g requests the search unit 102f to search for multimedia data according to the keyword. The search unit 102f uses the data extracting unit 102h and the OS 103b to store data in the data storage device 107.
The table memory inside is accessed to obtain information on the type of multimedia data according to the keyword (step S
B304).

The information about the type of multimedia data obtained from the search unit 102f is the background search unit 102g.
Then, it is determined whether the type of multimedia data is one type or plural types (step SB305).

When the number of multimedia data obtained by the search is plural, a search screen for selecting a predetermined multimedia data from each multimedia data is displayed on the display 106, and the search screen is displayed. Meanwhile, the user selects predetermined multimedia data on the display 106 with the pointing device 105 (step SB306). The multimedia data displayed on the search screen is obtained by reducing and combining the multimedia data in order to display the multimedia data in a multi-window display.

As shown in FIG. 2A, the search screen 201 is displayed on the screen 201 without being superimposed on the document of the word processor 101, and the search screen 201 displays a plurality of searched multimedia data ( In this example, according to the keyword "computer", an image 202 corresponding to the computer stored in the bitmap memory is displayed. By clicking on one of the displayed multimedia data, the periphery of that multimedia data changes (highlighted), and this multimedia data becomes the target multimedia data to be fitted. To be selected. In addition,
The display according to the click is not limited to the highlight display, and color change, image inversion, or the like may be used.

When the number of multi-data obtained by the search is one, as shown in FIG. 2B, immediately after editing without displaying the search screen, it is immediately displayed at the specified position in the created document of the word processor 101. The search image 203 is fitted.

When the number of the multi-data obtained by the search is one, or after the predetermined multi-media data is selected from the plurality of multi-media data, it is determined whether or not the multi-media data is modified and the content of the modification. Is performed in the data transformation unit 102c (step SB307).

In this embodiment, the search data is O
Since the word processor 101 and the filing device 102 are linked using LE, the multimedia data can be edited before the multimedia data is embedded in the document created by the word processor 101. Of course, it is also possible to edit the data on the word processor 101 after fitting the multimedia data.

In the transformation process for the multimedia data, the transformation for the multimedia data is performed with the designated contents (step SB308). As described above, for example, enlarging / reducing, partial cutting, trimming, etc. are performed on the multimedia data.

When it is determined that the transformation process for the multimedia is not performed or if the transformation process for the multimedia is not performed, in order to shift the fitting and processing of predetermined multimedia data to the word processor 101 side,
That is returned to the word processor 101 via LE as a response (steps SB309, SB31).
0). After sending the response, the processing of the filing apparatus 102 ends and the operation of the filing apparatus 102 stops. The operation stop state of the filing apparatus 102 indicates that the processing is in the idle state in the background, and when the word processor 101 makes a request, it operates as a foreground process.

After receiving the above response, the operation of the keyboard 104 pointing device 105 becomes an operation for operating the word processor 101 (step SA303).

As described above, the operability for fitting the multimedia data into the created data can be improved, and the working efficiency can be improved.

(Second Embodiment) Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 4 is a block diagram showing the configuration of the second embodiment of the filing apparatus of the present invention.

This embodiment has almost the same configuration as the first embodiment, and additionally includes multimedia data embedding event 401b and inter-application communication means 402.
The difference is that i and 402d are provided. In the present embodiment, unlike the first embodiment in which search instructions are exchanged using the clipboard, DDE (Dynamic Data E
xchange). About this DDE, Microsof
t It is described in the Windows manual and its explanation is omitted.

As shown in FIG. 4, the filing apparatus in this embodiment has a word processor 401 and an OS.
The unit 403 is connected, and the operation of the entire device is performed by the CPU 400.
Controlled by.

The word processor 401 has a word processor main 401a, a multimedia data fitting means 401b, an OLE client 401c, and an inter-application communication means 401d.

The filing device 402 includes a user selection unit 402a, a foreground search unit 402b, a data transformation unit 402c, an OLE server 402d, a selector 402e, a search unit 402f, a background search unit 402g, and a data retrieval. It has means 402h and inter-application communication means 402i.

The OS section 403 has an OS 403a, a keyboard driver 403b, a pointing device driver 403c, a display driver 403d, and a data storage device driver 403e.

The word processor main 401a of the word processor 401 is composed of a word processor main body,
The word processor itself performs the document creation function.

Multimedia data fitting means 401
b is a means for fetching an event instructing the fitting of multimedia data from the word processor main 401a and sending this event to the inter-application communication means 401d.

The OLE client 401c comprises means for calling an application for managing the object from the fitted object. In the present embodiment, since an image that is multimedia data is used as an object below as an application, an image processing application is used.

The inter-application communication means 401d is
It comprises means for sending a multimedia data inset event to the filing device 402.

User selection unit 4 of filing device 402
02a receives the information selected by the user with the keyboard 404 and the pointing device 405 from the displayed search screen, and receives the multimedia data transformation unit 40a.
Send a signal to 2c. Foreground search unit 402b
Is a unit for requesting a plurality of multimedia data to the search unit 402f and displaying the extracted data.

The data transforming section 402c comprises means for performing operations such as partial clipping of the retrieved multimedia data, trimming of image data, and enlargement / reduction.

The OLE server 402d is used by the OLE client 4 of another application such as a word processor.
It comprises means for receiving an event sent from 01c and activating this event as a database.

The selector 402e comprises means for determining whether the number of multimedia data searched by the background search unit 402g is one or more. When the number of searched multimedia data is one, the data transformation is performed. A signal is sent to the unit 402c, and when the number of searched multimedia data is plural, a signal is sent to the foreground searching unit 402b.

The search unit 402f is composed of means for searching for a file that matches the keyword and requesting it to the data extracting means 402h.

The background search section 402g comprises means for sending a search request to the search section 402f for a keyword or title given from the word processor 401 without displaying it.

The inter-application communication means 402i is
It comprises means for receiving a multimedia data embedding event sent from the word processor 401.

The OS section 403a of the OS section 403 comprises means for managing protocol for transmission / reception between applications and means for managing each device driver, and the application operates on this means.

The keyboard driver 403b is a means for operating the keyboard 404, and the pointing device driver 403c is a pointing device 4.
05 is operated. The display driver 403d is a unit for operating the display 406, and the data storage device driver 403e is a unit for operating the data storage device 407.

The keyboard 404 comprises means for inputting data in a computer such as a personal computer or a workstation. The pointing device 405 is a mouse,
It consists of input instruction means such as a pen and a tablet. The display 406 comprises means for displaying multimedia data, sentences, etc. As this means, a CRT, a liquid crystal display device or the like is used.

The data storage device 407 uses a storage medium such as a hard disk, a magneto-optical disk, or a floppy disk, and is arranged outside or inside the OS section 403. The data storage device 407 includes a bitmap memory for storing multimedia data, and the address of the bitmap memory described above and a table address that associates a keyword.

Next, the operation of the filing apparatus of this embodiment will be described with reference to the drawings. FIG. 5 is a flow chart showing the operation of the filing apparatus of FIG.

Referring to FIG. 5, first, a multimedia data embedding event and a keyword are input from the word processor 401 from the keyboard 404 or the pointing device 405, and the event is input by the inter-application communication means 401d to the filing device 40.
2 is requested (steps SA501 and SA502).

Next, the filing apparatus 402 which has received the above request receives the multimedia data embedding event (step SB501) and searches for a file that matches the keyword (step SB502).

Similar to the first embodiment, after the search, it is determined whether the number of multimedia data obtained by the search is one or more (step SB5).
03).

When the number of multimedia data obtained by the search is plural, a search screen for selecting a predetermined multimedia data from each multimedia data is displayed on the display 406. Meanwhile, the user selects predetermined multimedia data on the display 406 with the pointing device 406 (step SB504). The search screen and the display form are the same as those in the first embodiment.

When there is one multi-data obtained by the search, or after a predetermined multi-media data is selected from a plurality of multi-media data, it is determined whether or not the multi-media data is modified and the content of the modification. Is performed (step SB505).

When the transformation process for multimedia data is performed, the transformation for multimedia data is performed with the designated contents (step SB506). For example,
Enlargement / reduction, partial cutting, trimming, etc. are performed on multimedia data.

After the modification processing for multimedia, or when it is determined that the modification processing for multimedia is not performed, it is transmitted to the word processor 401 that the probability of predetermined multimedia data and the processing shift to the word processor 401 side. (Step SB5
07), and a response to the word processor 401 is returned (step SB508). After sending the response, the processing of the filing device 402 ends and the operation of the filing device 402 stops. The operation stop state of the filing device 402 indicates that the process is in the idle state in the background, and when requested by the word processor 401, it operates as a foreground process.

After receiving the above-mentioned response, the operation of the keyboard 404 or the pointing device 405 becomes an operation for operating the word processor 401 (step SA503).

(Third Embodiment) Next, a third embodiment of the present invention will be described with reference to the drawings.

FIG. 6 is a block diagram showing the configuration of a third embodiment of the filing apparatus of the present invention and the peripheral devices such as a word processor connected thereto. Although the present embodiment does not use OLE but uses Microsoft Windows (3.1 or higher) as the OS,
Other OS different from Microsoft Windows (3.1 or higher) can also be used.

Filing device 6 in the present embodiment
02 includes a word processor 601 as shown in FIG.
And the OS unit 603 are connected, and the operation of the device is performed by the CPU 60.
It is controlled by 0.

The word processor 601 includes a word processor main 601a, a multimedia embedding event 601b, and a multimedia data pasting event 6
01c and inter-application communication means 601d.

The filing device 602 includes a user selection unit 602a, a foreground search unit 602b, a data transformation unit 602c, a selector 602d, and a search unit 602.
e, the background search unit 602f, the data extraction unit 602g, and the inter-application communication unit 602h.
Have and.

The OS section 603 has an OS 603a, a keyboard driver 603b, a pointing device driver 603c, a display driver 603d, and a data storage device driver 603e.

The word processor main 601a of the word processor 601 is composed of a word processor main body,
The word processor itself performs the document creation function.

Event 6 for multimedia data fitting
01b is given an event for inserting multimedia data by the keyboard 604 or the pointing device 605 in the word processor 601, and this event is sent to the inter-application communication means 60.
It is a means to send to 1d.

Multimedia data pasting event 60
Reference numeral 1c is a means for transmitting the edited multimedia data sent from the filing device 602 via the inter-application communication means 601d to the word processor main 601a.

The inter-application communication means 601d is
It comprises means for sending a multimedia data embedding event to the filing device 602, or for receiving a response from the filing device 602 and the transformed image, and the protocol follows the OS.

User selection unit 6 of filing device 602
02a receives what is selected by the user with the keyboard 604 and the pointer device 605 from the displayed search screen, and sends a signal to the data transformation unit 602c.

The foreground search unit 602b comprises means for requesting the search unit 602e for a plurality of multimedia data and displaying the extracted data.

The data transforming unit 602c comprises means for performing operations such as partial cutting out of the searched multimedia data, trimming of image data, and enlargement / reduction.

The selector 602d comprises means for determining whether the number of multimedia data retrieved by the background retrieval unit 602f is one or more, and when the number of retrieved multimedia data is one, the multimedia is retrieved. When a signal is sent to the data transformation unit 602c and the number of searched multimedia data is plural, a signal is sent to the foreground search unit 602b.

The search unit 602e comprises means for searching for a file corresponding to a keyword and requesting the data extracting means 602g.

The background search unit 602f comprises means for sending a search request to the search unit 602e in response to a word processor search request sent via the inter-application communication means 602h without displaying.

The inter-application communication means 602h is
It comprises means for receiving the multimedia data embedding event 601b sent from the word processor 602 and transmitting the result to the background searching unit 602f.

The OS 603a of the OS section 603 comprises means for managing the protocol for transmission / reception between applications and for managing each device driver, and the application operates on this means.

The keyboard driver 603b comprises means for operating the keyboard 604, and the pointing device driver 603c comprises the pointing device 6
05 is operated. The display driver 603d comprises means for operating the display 606, and the data storage device driver 603e comprises means for operating the data storage device 607.

The keyboard 604 comprises means for inputting data in a computer such as a personal computer or a workstation. The pointing device 605 is a mouse,
It consists of input instruction means such as a pen and a tablet. The display 606 includes means for displaying multimedia data, documents and the like, and a CRT, a liquid crystal display device or the like is used as this means.

The data storage device 607 is a storage medium such as a hard disk, a magneto-optical disk or a floppy disk, and is arranged outside or inside the OS section 603. The data storage device 607 is composed of a bitmap memory for storing multimedia data, and the address of the above-mentioned bitmap memory and a table address for associating a keyword.

Next, the operation of the filing apparatus of this embodiment will be described with reference to the drawings. FIG. 7 is a flow chart showing the operation of the filing apparatus of FIG.

Referring to FIG. 7, first, a multimedia data embedding event and a keyword are input from the word processor 601 from the keyboard 604 or the pointing device 605, and the event is input to the filing device 60 by the inter-application communication means 601d.
2 is requested (steps SA701 and SA702).

Next, the filing apparatus 602 which has received the above request receives the multimedia data fitting event (step SB701) and searches for a file that matches the keyword (step SB702).

Similar to the first embodiment, after the search, it is determined whether the number of multimedia data obtained by the search is one or more (step SB7).
03).

When the number of multimedia data obtained by the search is plural, a search screen for selecting a predetermined multimedia data from each multimedia data is displayed on the display 606, and the search screen is displayed. Meanwhile, the user selects predetermined multimedia data on the display 606 with the pointing device 605 (step SB704). The search screen and the display form are the same as those in the first embodiment described above.

When there is one multi-data obtained by the search, or after a predetermined multi-media data is selected from a plurality of multi-media data, it is determined whether or not the multi-media data is modified and the content of the modification. Is performed (step SB705).

When the transformation process for multimedia data is performed, the transformation for multimedia data is performed with the designated contents (step SB706). For example,
Enlargement / reduction, partial cutting, trimming, etc. are performed on multimedia data.

After the modification processing for multimedia, or when it is determined that the modification processing for multimedia is not performed, it is transmitted to the word processor 601 that the probability of predetermined multimedia data and the processing shift to the word processor 601 side. (Step SB7
07), and a response to the word processor 601 is returned (step SB708). After sending the response, the processing of the filing device 602 ends and the operation of the filing device 602 stops. The operation stop state of the filing device 602 indicates that the process is idle in the background, and the word processor 60
When there is a request from 1, it operates as a foreground process.

The word processor 601 receives the above response (step SA703), and the operation of the keyboard 604 or the pointing device 605 becomes the operation for operating the word processor 601 (step S703).
A704).

(Fourth Embodiment) Next, a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 8 is a block diagram showing the configuration of a fourth embodiment of the filing device of the present invention and the configuration of peripheral devices such as a word processor connected thereto.

Filing device 8 in the present embodiment
02 includes a word processor 801 as shown in FIG.
And the OS unit 803 are connected, and the operation of the device is performed by the CPU 80.
It is controlled by 0.

The word processor 801 has a word processor main 801a, a macro interpretation unit 801b, a multimedia data fitting event 801c, a multimedia data pasting event 801d, and an inter-application communication means 401e.

The filing device 802 includes a user selection unit 802a, a foreground search unit 802b, a data transformation unit 802c, a selector 802d, and a search unit 802.
e, the background search unit 802f, the data extraction unit 802g, and the inter-application communication unit 802h.
Have and.

The OS section 803 has an OS 803a, a keyboard driver 803b, a pointing device driver 803c, a display driver 803d, and a data storage device driver 803e.

The word processor main 801a of the word processor 801 is composed of a word processor main body,
The word processor itself performs the document creation function.

The macro interpretation unit 801b comprises means for interpreting a language (simple programming language or script) supported by the word processor 801.
For example, in Microsoft Word for Windows, WORD BASIC
Is. Also, the macro may be a language such as a script, or may be a recording of a method representing a certain procedure.
This language is developed in accordance with a protocol that allows communication between applications (this depends on the OS).

Multimedia data fitting event 8
Reference numeral 01c is a means for fetching the interpreted language extracted as a fitting event in the macro interpreting unit 801b and sending it to the inter-application communication means 801e.

Multimedia data pasting event 80
1d comprises means for sending an event sent from the filing device 802 via the inter-application communication means 801e to the word processor main 801a.

The inter-application communication means 801e is
It comprises means for sending a multimedia data embedding event to the filing device 802 and receiving a response from the filing device 802, and this protocol follows the OS.

User selection unit 8 of filing device 802
02a receives what is selected by the user with the keyboard 804 and the pointer device 805 from the displayed search screen, and sends a signal to the data transformation unit 802c.

The foreground search section 802b comprises means for requesting the search section 802e for a plurality of multimedia data and displaying the extracted data.

The data transforming unit 802c comprises means for performing operations such as partial clipping of the retrieved multimedia data, trimming of image data, and enlargement / reduction.

The selector 802d comprises means for judging whether the number of multimedia data retrieved by the background retrieval unit 802f is one or more. When the number of searched multimedia data is one, a signal is sent to the multimedia data transformation unit 802c, and when the number of searched multimedia data is plural, a signal is sent to the foreground search unit 802b. To be

The search unit 802e searches for a file that matches the keyword or title, and retrieves the data from the data extracting means 80.
It consists of a means to request 2g.

The background search unit 802f is a keyword given from the word processor 801 through the inter-application communication means 802h without displaying it,
It comprises means for sending a search request to the search unit 802e for the title.

The inter-application communication means 802h is
It comprises means for receiving a multimedia data embedding event 801c sent from the word processor 801.

The OS section 803a of the OS section 803 comprises means for managing protocol of transmission and reception between applications and means for managing each device driver, and the application operates on this means.

The keyboard driver 803b comprises means for operating the keyboard 804, and the pointing device driver 803c comprises the pointing device 8
05 is operated. The display driver 803d is a unit for operating the display 806, and the data storage device driver 803e is a unit for operating the data storage device 807.

The keyboard 804 is a means for inputting data in a computer such as a personal computer or a workstation. The pointing device 805 is a mouse,
It consists of input instruction means such as a pen and a tablet. The display 806 comprises means for displaying multimedia data, sentences, etc. As this means, a CRT, a liquid crystal display device or the like is used. Data storage device 807
Is a storage medium such as a hard disk, a magneto-optical disk, or a floppy disk, and is arranged outside or inside the OS unit 803. The data storage device 807 includes a bitmap memory for storing multimedia data, and the address of the bitmap memory described above and a table address that associates a keyword.

Next, the operation of the filing apparatus of this embodiment will be described with reference to the drawings. FIG. 9 is a flow chart showing the operation of the filing device of FIG.

Referring to FIG. 9, first, the word processor 801 performs macro interpretation and develops into a communicable protocol (step SA901). Then
A multimedia data embedding event is transmitted to the filing device 802 (step SA902), and the event is requested to the filing device 802 by the inter-application communication means 801d (step SA90).
3).

The filing apparatus 80 which has received the above request
In 2, the multimedia data fitting event is received (step SB901), and a file matching the keyword is searched (step SB902).

Similar to the first embodiment described above, after the search, it is determined whether the number of multimedia data obtained by the search is one or more (step SB903).

When the number of multimedia data obtained by the search is plural, a search screen for selecting a predetermined multimedia data from each multimedia data is displayed on the display 806, and the search screen is displayed. Meanwhile, the user selects predetermined multimedia data on the display 806 with the pointing device 805 (step SB904). The search screen and the display form are the same as those in the first embodiment described above.

When there is one multi-data obtained by the search, or after a predetermined multi-media data is selected from a plurality of multi-media data, it is determined whether or not the multi-media data is modified and the content of the modification. Is performed (step SB905).

When the transformation processing for multimedia data is performed, the transformation for multimedia data is performed with the designated contents (step SB906). For example,
Enlargement / reduction, partial cutting, trimming, etc. are performed on multimedia data.

After the transformation processing for multimedia, or when it is determined that the transformation processing for multimedia is not performed, it is transmitted to the word processor 801 that the probability of predetermined multimedia data and the processing shift to the word processor 801 side. (Step SB9
07), and a response to the word processor 801 is returned (step SB908). After sending the response, the processing of the filing device 802 ends and the operation of the filing device 802 stops. The operation stop state of the filing device 802 indicates that the process is in the idle state in the background, and when requested by the word processor 801, it operates as a foreground process.

The word processor 801 receives the above-mentioned response (step SA904), and then the keyboard 804 or the pointing device 805 is operated.
The operation is for operating the word processor 801 (step SA905).

(Fifth Embodiment) Next, a fifth embodiment of the present invention will be described with reference to the drawings. FIG. 10 is a diagram showing an example of a word processor search screen generated according to the fifth embodiment of the filing apparatus of the present invention.

In the first embodiment described above, as shown in FIG. 2A, a plurality of multimedia data 202 searched corresponding to the keyword are displayed on the search screen, and each of the displayed multimedia data is displayed. Clicking on one multimedia data in the data changes (highlights) the periphery of that multimedia data and selects this multimedia data as the multimedia data to be fitted, but it corresponds to the keyword When the amount of multimedia data to be processed becomes very large, the size of each image becomes small in the multi-image display, which makes it very difficult to see.

Therefore, in the present embodiment, the plurality of retrieved multimedia data are displayed in time series on the retrieval screen without being reduced.

In this time-series display, the foreground search section is controlled so that a plurality of multimedia data searched in the display window are displayed one by one in a time-series manner according to an instruction from the pointing device. I,
This control makes the displayed image easier to see. For example, as shown in FIG. 10A, one of a plurality of searched multimedia data is displayed in the display window according to the instruction of the pointing device, and one of the plurality of multimedia data searched is displayed in the next in the display window. As shown in, the multimedia data is switched so that the next retrieved multimedia data is displayed.

Also, the number of types of multimedia data retrieved in the icon for the pointing device is set to be displayed as a number. In this example, it is displayed in the icon of the pointing device, but the present invention is not limited to this.

The above-mentioned display form may use a method which is determined in advance based on the setting from the keyboard, or the filing device determines the number of searched multimedia data based on the search result of the background search section. , When the number of retrieved multimedia data is small,
When the number of multi-image displays is large, a method of selecting a time-series display can be used.

In each of the above-described embodiments, an image is used as an example of multimedia data. However, by storing an explanatory text (text) corresponding to a keyword in a memory as a bitmap, the explanatory text for the image is stored. It becomes possible to perform the same processing as the processing.

[0163]

According to the present invention, as it was more than above Description, according to the present invention,
Simply search from multiple candidates that are searched based on search criteria.
Not only can you select the data you want,
For example, if there is only one search result,
Be aware of the behavior of the application and the behavior of selecting from the candidate data.
And work efficiency can be improved. You
Ie, it is possible to improve the operability in selecting the multimedia data, it is possible to improve the work efficiency.

[0164] Moreover, search when the number of search multimedia data is one, display Huy data dealing with the retrieved multimedia data other applications
Fitting the window, when the number of the retrieved multimedia data is plural, by fitting the multimedia data each retrieved search windows, thereby improving the operability when fitting the multimedia data to other data be able to.

Also, it is determined whether or not a special code is input to the clipboard, and the multimedia data retrieved according to the determination result is inserted into the multimedia data by another application, so that the multimedia data can be saved. It is possible to improve the operability when fitting in the data of.

[0166] Further, it is determined whether or not the input of the special code to the clipboard, by associating multimedia data retrieved in response to the determination result to the multimedia data by other applications, the multimedia data It is possible to improve the operability when fitting in other data and the processing speed when fitting in other data.

[0167] Further, other applications and mutually provided with inter-application communication means for communicating multimedia data fitting event of another application or <br/> et via the communication means between the applica- <br/> application In response to this, the search operation is performed based on this multimedia data embedding event, and the searched multimedia data is transferred to another application.
Insert into multimedia data by application
As a result, it is possible to improve the operability when the multimedia data is embedded in other data and the processing speed when the multimedia data is embedded.

[0168] Further, other applications and mutually provided with inter-application communication means for communicating multimedia data fitting event of another application or <br/> et via the communication means between the applica- <br/> application In response to this, the search operation is performed based on this multimedia data embedding event, and the searched multimedia data is transferred to another application.
By associating the multimedia data with the multimedia data by application, it is possible to improve the operability when the multimedia data is embedded in other data and the processing speed when the multimedia data is embedded.

Another application is a word processor, and by using the macro function of the word processor, it is possible to improve the operation of inserting the multimedia data into the document prepared by the word processor.

Also, the search window is for
Screen for displaying multiple images of multimedia data
You can

[0171] Further , the search window is used to display the searched files.
Screen that displays a number of multimedia data in chronological order
The number of multimedia data retrieved by
When there are many, list the multimedia data to be displayed.
The multimedia data displayed compared to the displayed
It is possible to obtain a display form that is easy for the data to see.

Further , the search window is used to display the searched files.
Of the multimedia data currently displayed
Number of multimedia data and remaining multimedia data
The screen is displayed by combining and
Selected from multiple multimedia data
Can be easy.

[0173]

[0174]

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a first embodiment of a filing device of the present invention and a peripheral device such as a word processor connected thereto.

FIG. 2 is a diagram showing an example of a search screen of a word processor generated by the filing apparatus of FIG.

FIG. 3 is a flowchart showing an operation in the filing device of FIG.

FIG. 4 is a block diagram showing a configuration of a second embodiment of a filing device of the present invention and a peripheral device such as a word processor connected thereto.

5 is a flowchart showing an operation in the filing device of FIG.

FIG. 6 is a block diagram showing configurations of a third embodiment of the media filing apparatus of the present invention and peripheral devices such as a word processor connected thereto.

7 is a flowchart showing an operation in the filing device of FIG.

FIG. 8 is a block diagram showing a configuration of a fourth embodiment of a filing device of the present invention and a peripheral device such as a word processor connected thereto.

9 is a flowchart showing an operation in the filing device in FIG.

FIG. 10 is a diagram showing an example of a search screen of a word processor generated according to the fifth embodiment of the filing apparatus of the present invention.

[Explanation of symbols]

101, 401, 601, 801 Word processor 102, 402, 602, 802 Filing apparatus 102a, 402a, 602a, 802a User selection
Parts 102b, 402b, 602b, 802b Foie gras
Data retrieval unit 102c, 402c, 602c, 802c
Part 102d, 402d OLE server 102e, 602d, 802d Selector 102f, 402f, 602e, 802e Search part 102g, 402g, 602f, 802f Background
Data retrieval unit 102h, 402h, 602g, 802g
Means 102i Clipboard monitor 103, 403, 603, 803 OS 103a Clipboard 106, 406, 606, 806 Display 402i, 602h, 802i Inter-application communication
Belief

Continuation of the front page (56) Reference JP-A-3-4374 (JP, A) JP-A-59-214959 (JP, A) JP-A-5-336322 (JP, A) Furujo Ayumu, the first Windows PC 11 Using OLE to challenge decrypted documents, Nikkei PC, Nikkei BP, Japan, September 12, 1994, No. 224, p. 230-233 Masayuki Oyo, Ichitaro Ver. 5 Appearance Interview with Justsystem President Kazunori Ukikawa, Nikkei Bytes, Nikkei, Nikkei BP, December 1, 1992, No. 107, p. 108-118 (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 17/30 G06F 12/00 G06F 17/21

Claims (20)

(57) [Claims] 1. It can operate simultaneously with other applications.
The search application to handle the multi-media data in
A filing device to control , which is in the background of the other applications.
Based on the information entered on other applications
Search means for searching the multimedia data Te, depending on the test Sakuyui results of the searching means, the retrieved data
The search window used by the search application
C or display the data handled by the other application.
Or a switching <br/> switching means for Ru switched to be displayed on the display window over data, the data selected in the retrieval window the
Window for displaying data handled by other applications
And a display control means for displaying on the filing device. 2. When the number of multimedia data searched by the searching means is one, the data processed by the other application handles the searched multimedia data.
When the number of the multimedia data searched by the searching means is plural, each searched multimedia data is fitted into the display window of the computer.
2. The filing apparatus according to claim 1, further comprising a multimedia data fitting means to be fitted in the c . 3. The multimedia data fitting means determines whether or not a special code is input to the clipboard, and the multimedia data retrieved by the retrieval means is stored in the other application according to the determination result. The filing device according to claim 2, wherein the filing device is inserted into the multimedia data. 4. The multimedia data fitting means determines whether or not a special code is input to the clipboard, and the multimedia data retrieved by the retrieval means is stored in the other application according to the determination result. The filing apparatus according to claim 2, wherein the filing apparatus is associated with multimedia data according to the above. 5. An inter-application communication means for mutually communicating with the other application , wherein the multimedia data embedding means includes a multimedia data embedding event from the other application via the inter-application communication means. In response to this, the search means is operated based on the multimedia data embedding event, and the multimedia data searched by the search means is inserted into the multimedia data by the other application . Filing equipment. 6. An inter-application communication means for mutually communicating with the other application, wherein the multimedia data embedding means includes a multimedia data embedding event from the other application via the inter-application communication means. In response to this, the search means is operated based on the multimedia data embedding event, and the multimedia data searched by the search means is associated with the multimedia data by the other application.
The described filing device. 7. The media filing apparatus according to claim 2, wherein the other application comprises a word processor, and the multimedia data fitting means uses a macro function of the word processor. 8. The search window is searched for
A screen for displaying multiple images of multiple multimedia data
The filing device according to claim 2, wherein the filing device comprises: 9. The search window is searched for
A screen that displays multiple multimedia data in time series
It is made of the filing apparatus according to claim 2, wherein. 10. The search window is the search window.
Currently displayed among multiple multimedia data
Existing multimedia data and remaining multimedia data
The filing apparatus according to claim 2 , wherein the filing apparatus comprises a screen for displaying together with the number of data. 11. It is possible to operate simultaneously with other applications.
Search application that handles multimedia data
Controlling the method of controlling an filing apparatus, a background smell of the other applications
Based on the input information on other applications
A search process for searching multimedia data, and data searched according to the search result of the search process.
The search window used by the search application
C or display the data handled by the other application.
Select whether to display in the data display window.
And the data selected in the search window
Window for displaying data handled by other applications
And a display control step for displaying
Control method. 12. The multimedia device searched in the searching step.
When the number of ear data is 1, this searched
Media data handled by the other application.
Insert it in the data display window and check it in the search process.
When the number of searched multimedia data is plural,
Each searched multimedia data is stored in the search window.
There is a multimedia data fitting process that fits in the dough.
The control method according to claim 11, further comprising: 13. The multimedia data inlayer
By the way, whether the special code is entered in the clipboard
It is judged whether or not it is searched in the search step according to the judgment result.
The stored multimedia data to the other application.
It is characterized by inserting into multimedia data by
The control method according to claim 12. 14. The multimedia data inlayer
By the way, whether the special code is entered in the clipboard
It is judged whether or not it is searched in the search step according to the judgment result.
The stored multimedia data to the other application.
Characterized by associating with multimedia data
The control method according to claim 12. 15. The filing device is configured to access the other file.
Application to interact with the application
Inter-communication means, embedded with the multimedia data
In the only process, via the inter-application communication means
Multimedia data from other applications
The multimedia data was received after receiving the inset event.
Operate the search by the search process based on the embedded event
And the multimedia data retrieved in the retrieval step
The other application by multimedia day
13. The control method according to claim 12, characterized in that
Law. 16. The filing device is configured to access the other file.
Application to interact with the application
Inter-communication means, embedded with the multimedia data
In the only process, via the inter-application communication means
Multimedia data from other applications
The multimedia data was received after receiving the inset event.
The search means is operated based on the embedded event,
The multimedia data retrieved by the retrieval means is
Associated with multimedia data by application
13. The control method according to claim 12, wherein the control is performed. 17. The other application is WordPad.
It consists of a processor and is embedded with the multimedia data.
In the process, using the macro function of the word processor
17. The method according to claim 12 to claim 16, characterized in that
Control method. 18. The search window is the search window.
Image to display multiple multimedia data
13. The control method according to claim 12, characterized by comprising a surface.
Law. 19. The search window is the search window.
Image that displays multiple multimedia data in time series.
13. The control method according to claim 12, characterized by comprising a surface.
Law. 20. The search window is the search window.
Currently displayed among multiple multimedia data
Existing multimedia data and remaining multimedia data
It is characterized by a screen that is displayed together with the number of
The control method according to claim 12.