JP2012256116A - Information processing display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide more convenient information processing display device capable of easily exchanging information between applications whose development periods are different and allowing interoperation of applications.SOLUTION: An information processing display device can simultaneously execute a plurality of applications. The information processing display device includes input/output means for writing and reading text information to and from a file owned by the application for each application and detection means for detecting a process number from the name of the application. The application reads out text information written into the file of the application specified based on the process number detected by the detection means. As a result, the plurality of applications performs cooperative operation.

Description

  The present invention relates to an information processing display device.

  2. Description of the Related Art Conventionally, in an operating system of a personal computer, an environment for executing a plurality of applications simultaneously is provided, and each application is executed independently in a virtual memory space managed by the operating system. Communication means between applications includes a shared memory function, a pipe function, a device driver, and the like by an operating system, and information is exchanged between applications by using them.

  An application is often created by including a function for displaying a list of information and a function for performing processing on the displayed information. However, in some cases, it is preferable to perform processing different from the processing included in the application on the target information. In such a case, an application for performing another processing using a filer function of a personal computer is executed. In other words, with the filer function displaying a thumbnail of image information and a list of document files, double-clicking on a file using the GUI to start an application associated with the file extension such as * jpg, * doc, etc. Processing of the file targeted by the application is executed. Alternatively, by performing a GUI operation by drag and drop with respect to the files displayed in a list, the file is selected and the activation application is selected, and the processing of the file selected by the activated application is executed.

  As for information sharing of applications, there are a method of using a shared folder (for example, refer to Patent Document 1), a method of putting target information in a clipboard, a method of interposing an agent role application that mediates information, and the like.

JP 2010-154377 A

  However, when using the inter-application communication, there are restrictions such as clarifying rules for exchanging information and developing the application at the same time as application development. In addition, when an application is started by double-clicking a file, only the associated application can be processed. When an application is started by a drag and drop operation, a plurality of files are processed. There is a problem that the same operation needs to be repeated and the operation becomes very complicated.

  An object of the present invention is to provide an information processing display device that is capable of interoperating applications and is more convenient.

  The information processing display device of the present invention is an information processing display device capable of simultaneously executing a plurality of applications, and an input / output unit that writes and reads text information to and from a file included in the application for each application; Detecting means for detecting a process number from the application name, and the application reads text information written in the file of the application specified based on the process number detected by the detecting means, The plurality of applications perform a cooperative operation.

  The information processing display device of the present invention is an information processing display device capable of simultaneously executing a plurality of applications, and an input / output unit that writes and reads text information to and from a file included in the application for each application; Detecting means for detecting a process number from the application name, wherein the application writes text information in the file of the application specified based on the process number detected by the detecting means, and the specified application Is characterized in that the plurality of applications perform a cooperative operation by reading text information written in the file.

  According to the information processing display device of the present invention, it is possible to easily exchange information between applications with different development times, and to provide a more convenient information processing display device capable of interoperating applications. it can.

1 is a diagram illustrating a system configuration of an information processing display device according to an embodiment. It is a figure which shows the output file of the application 1. FIG. It is a figure which shows the setting file of the application 2. FIG. It is a figure which shows the screen displayed on the display apparatus. It is a figure which shows the output file of the application 1. FIG. It is a figure which shows the input file of the application 1. FIG. It is a figure which shows the input file of the application 2. FIG. It is a figure which shows the output file of the application 2. FIG. It is a figure which shows the output file of the application 3. FIG.

  Hereinafter, an information processing display device according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a system configuration of an information processing display device according to an embodiment. The information processing display device 2 includes a CPU 4 that controls the entire information processing display device 2. The CPU 4 is connected to the bus 6. The bus 6 performs display control of a ROM 8 that stores application programs executed by the CPU 4, a RAM 10 that stores application programs read from the ROM 8 or a storage medium 26 described later, and a display device 12 that displays information such as images. A display control unit 14 is connected. The bus 6 is connected to an I / O 24 that performs input control from an operation member 22 such as a mouse or a keyboard. Further, a recording I / F 28 for controlling recording and reading of data on the recording medium 26 is connected to the bus 6.

  The display control unit 14 includes a frame memory 30, a synthesis unit 32, and a display drive unit 34 that are provided corresponding to a plurality of layers. The frame memory 30 stores display image data corresponding to each of the plurality of layers. The combining unit 32 combines the display image data of each layer stored in the frame memory 30 to generate a display image. The display driving unit 34 causes the display device 12 to display the display image combined by the combining unit 32.

  The ROM 4 has an application 1 having a function of displaying a list of a plurality of images by thumbnail display, which is an application having a display function with high visibility (hereinafter referred to as App1), and an application having an image processing function such as filter processing. 2 (hereinafter referred to as App2), an application 3 having an electronic mail function including an image attachment function (hereinafter referred to as App3), and the like are stored. Here, the PID (process number) of App1 is 1011, the name is “thumb”, the PID of App2 is 1012, the name is “retouch”, the PID of App3 is 1013, and the name is “p-mail”.

  Each application has an input / output device file (/ dev / PID / fd0 /, / dev / PID / fd1) as an information input / output interface. For the input / output device file, a PID directory is created under the / dev directory, and an fd0 file and an fd1 file are created in that directory. For example, in App1, / dev / 1011 / fd0 is the output file, and / dev / 1011 / fd1 is the input file.

  Each application is activated by an input operation using the operation member 22 by the user. For example, when the user operates the operation member 22 to give an instruction to activate App1, the CPU 4 reads App1 stored in the ROM 8, stores it in the RAM 10, and activates App1. Further, the CPU 4 creates an output file and an input file of App 1 in the RAM 10. When the application is activated, the CPU 4 reads out the window manager recorded in the ROM 8 or the recording medium 26, stores it in the RAM 10, and activates it. The window manager has a function of managing the position and overlapping order of windows displayed on the display device 12 by each activated application, and notifying the application of input results from a mouse, keyboard, etc. (not shown).

  FIG. 2 is a diagram showing an output file of the application 1. The format of the information written in the output file and the input file conforms to the XML description, and items are separated by <tag> </ tag> as shown in FIG. When the image is displayed on the display device 12 by App1 and the user places a pointer on the displayed image by operating the mouse (not shown), an item indicated by <mouseover> </ mouseover> is included in the output file. The name of the image on which the pointer is placed is written, and when the mouse is clicked, the output file has an image on which the pointer is placed when the mouse click is performed on the item indicated by <mouseclick> </ mouseclick> Is written. Such image names are written as needed according to the image on which the pointer is placed. In addition, information (<srcpath> / home / user1 / Picture </ srcpath>) indicating the storage location of the images to be displayed in a list is written in the output file of App1.

  Next, a method for performing a cooperative operation between applications based on public information will be described. When App1 is activated, an App1 window in which a plurality of images are displayed as thumbnails is displayed on the display device 12 (see FIG. 4). Here, as shown in the output file of App1 in FIG. 2, since App2 (retouch) and App3 (p-mail) are designated in advance as the client of App1 by the user, the names of App2 and App3 are displayed in the window for App1. A button indicating (retouch, p-mail) is displayed.

  In this state, when the user selects an icon (not shown) for instructing activation of the execution file “retouch” of App 2 using the operation member 22, App 2 is activated and a window for App 2 is displayed on the display device 12. (See FIG. 4). Further, App2 recognizes that App1 becomes a server by an argument (> retouch -s thumb <CR>) input by icon selection.

  As shown in FIG. 3, App1 may be designated as a server by writing <server> thum </ server> in advance in the App2 configuration file. Further, by writing the default path indicated by <srcpath> / home / user1 / Picture / Tokyo </ srcpath> as shown in FIG. 3 together with the application name that can be the server, App1 that is the server is activated. Even if not, App2 can read out the image to be processed based on the default path.

  App 2 recognizes the application “Server”, ie, the name “thum” of App 1, and recognizes the PID (1011) of App 1 based on the name. A function for detecting the PID from the name of the application is provided by the OS. App2 opens the output file / dev / 10111 / fd0 of App1 created in the RAM 10 based on the PID.

  App1 writes the name of the image on which the pointer is placed in the output file / dev / 10111 / fd0 of App1 when the pointer displayed on the display device 12 by the user's mouse operation or the like is placed on the thumbnail-displayed image. When App1 writes to the output file, a write event occurs, and event notification is sent to App2 that is opening the file.

  When App2 receives notification of the occurrence of a write event, App2 recognizes the name and storage location of the image on which the pointer written in the output file of App1 is placed. App2 reads the image of the recognized name from the recognized storage location, performs a predetermined process such as a processing process, and displays the processing result in the window for App2 displayed on the display device 12.

  Next, when the user further selects an icon (not shown) for instructing activation of the execution file “p-mail” of App3 using the operation member 22, App3 is activated and the window for App3 is displayed on the display device 12. Is displayed (see FIG. 4). App3 recognizes that App1 is a server by an argument (> p-mail-s thumb <CR>) input by selecting an icon.

  App3 recognizes the name “thumb” of App1 as a server and recognizes the PID of App1 based on the name. App3 opens the output file of App1 created in the RAM 10 based on the PID. App1 writes the name of the clicked image to the output file of App1 when a mouse click is performed in a state where the pointer displayed on the display device 12 is placed on the thumbnail-displayed image by the user's mouse operation or the like. When App1 writes to the output file, a write event occurs, and event notification is sent to App2 and App3 that open the file.

  When App2 and App3 are notified of the occurrence of a write event, App2 reads the output file of App1 and recognizes the name of the clicked image and its storage location. App2 reads the image of the recognized name from the recognized storage location, performs a predetermined process such as a processing process, and displays the processing result in the window for App2 displayed on the display device 12. App3 reads the image of the recognized name from the recognized storage location, performs image attachment processing to the e-mail, and displays the content indicating that the image is attached to the e-mail in the window for App3.

  As described above, App2 and App3 open the output file of App1 as a server set in the argument and setting file, recognize the image to be processed by reading the text information written in the output file, and between applications Cooperative operation is realized. Also, cooperative operation between applications can be realized more easily by using text information without a protocol.

  Note that when both App2 and App3 open the output file of App1, an application as a client who receives the information of App1 may be specified. In this case, when the user performs an input operation of a button indicating the names (retouch, p-mail) of App2 and App3 displayed at the top of the list of thumbnail images in the App1 window by the operation member 22. App1 sets the presence or absence of cooperative operation with App2 and App3. For example, when the user performs an input operation of a button indicating the name (retouch) of App2, App1 performs a cooperative operation with App2. In addition, when the user performs an input operation of a button indicating the name (p-mail) of App3, App1 performs a cooperative operation with App3. When App1 is set to perform a cooperative operation, App1 displays a button with the name of the corresponding application so that the user can see it by highlighting or the like.

  In addition, App1 writes information on an application that performs a cooperative operation to an output file, such as <active> <client> retouch </ client> </ active> shown in FIG. As a result, when each App2 and App3 read the output file of App1, it is determined whether or not to perform a cooperative operation, and only when it is determined that a cooperative operation is to be performed, image processing or an image to an e-mail Perform attachment processing.

  Further, in order to switch the presence / absence of the cooperative operation, App2 and App3 serving as clients may have a selection function, and App2 and App3 may accept the switching operation of the presence / absence of the cooperative operation by the user. For example, App2 and App3 arrange an active button on a window to be displayed on the display device 12 at the time of activation, and recognize whether the active button is turned on or off by an input using the operation member 22 of the user. Then, App2 and App3 recognize that the cooperative operation is performed when the active button is on, recognize the contents written in the output file of App1, process the image, attach the image to the e-mail, etc. I do.

  Next, a method will be described in which App2 and App3 request communication from App1 to acquire information about an image to be processed. When App1 is activated, an App1 window in which a plurality of images are displayed as thumbnails is displayed on the display device 12 (see FIG. 4). In this state, when the user selects an icon (not shown) for instructing activation of the execution file “retouch” of App 2 using the operation member 22, App 2 is activated and a window for App 2 is displayed on the display device 12. (See FIG. 4). Further, App2 recognizes that App1 becomes a server by an argument (> retouch -s thumb <CR>) input by icon selection.

  App2 recognizes the PID of App1 based on the name “thumb” of App1 as a server. App2 opens the input file / dev / 1011 / fd1 of App1 created in the RAM 10 based on the PID of App1. As shown in FIG. 6, App2 is the name of App2 (<name> retouch </ name>), PID (<pid> 1012 </ pid>), App1 is the server, and App2 is the client. Information indicating that a coordinated operation is performed in response to processing by a mouse dependency or mouse click (<function> thumb </ server>, <client> retouch <client>), mouse over, or mouse click (<function> mouseover <// function>, <function> moussecrick <function>), etc. are written.

  App1 opens the App2 input file / dev / 1012 / fd1 created in the RAM 10 based on the PID of App2 written in the input file, and writes to the App2 input file as a response to App2. As shown in FIG. 7, the contents written by App1 at this time are the name (thumb) and PID (1011) of App1 as a server, the name (retouch) and PID (1012) of App2 as a client, and App2 is mouse over and mouse. This is information (<function> mouseover </ function>, <function> mousseclic <function>) indicating that a cooperative operation is performed for the processing by clicking.

  When the pointer displayed on the display device 12 by the user's mouse operation is placed on the thumbnail image, App1 writes the name of the image on which the pointer is placed in the output file of App1, and the list of images displayed in the output file is displayed. Information on the storage location, the name of the image on which the pointer is placed, etc. are written in the input file of App2. App2 recognizes the name of the image on which the pointer is placed and the storage location based on the contents written in the input file. App2 reads the recognized image from the recognized storage location, performs predetermined processing such as processing, and displays the processing result in the window for App2.

  Note that App2 stores the processed image with another name, as shown in FIG. 8, in the output file, the storage location (srcpath) of the original image subjected to the processing and the name of the image (srcname). ), The storage location (destpath) of the processed image and the name (destname) of the processed image are written. As a result, it is possible to set so that another application (not shown) reads the contents written in the output file of App2 and performs another processing using the processed image.

  Further, when App3 cooperates with App1, App3 activated by a user's activation instruction using the operation member 22 is similar to the case where App2 cooperates with App1, and RAM 10 based on the PID recognized from the name of App1. Open the input file of App1 created in App3 writes the name and PID of App3 in the App1 input file, the dependency that App1 is a server and App3 is a client, information that the cooperative operation is performed in response to a mouse click, and the like.

  App1 opens the input file / dev / 1013 / fd1 of App3 created in the RAM 10 based on the PID (1013) of App3 written to the input file, and writes to the input file of App3 as a response to App3. Do. The contents written by App1 are information indicating that the name and PID of App1 serving as a server and the name of App3 serving as a client (and PID and App3 cooperate in processing by mouse click).

  Then, App1 writes the name of the clicked image to the output file of App1 when the mouse click is performed on the image on which the pointer displayed on the display device 12 is displayed as a thumbnail, and the contents of the output file are written in App3. Write to input file.

  App3 recognizes the name of the clicked image and the storage location of the image based on the contents written in the input file, reads the corresponding image from the recognized name and storage location, and attaches it to the e-mail And the processing result is displayed in the window for App3. As shown in FIG. 9, App3 writes the original storage location (srcpath) of the image attached to the e-mail and the name (srcname) of the image to the output file of App3.

  As described above, by using the framework that defines the read / write method of the input file and the output file, it is possible to easily exchange information between applications having different development times. Further, only by placing the pointer on the thumbnail-displayed image by the user's mouse operation, other applications can recognize it and execute the respective processes, thereby allowing a plurality of applications to operate in cooperation.

  Note that the window manager recognizes the dependency of each application, and manages each window so that the App2 window and the App3 window that are clients are displayed at a higher level than the App1 window that is always the server. May be. Thus, even if the user places the pointer on the App1 window and clicks, there is no inconvenience that the App2 window and the App3 window are hidden under the App1 window. Therefore, it is possible for the user to check the processing result by App2 or App3 while selecting the thumbnail-displayed image.

  Further, by setting the communication partner when first activated in the setting file and the communication partner when activated secondly, the same application can cooperate with a different partner (server). Thus, for example, when two App2 are activated simultaneously, each App2 can be operated so that one uses App1 as a server and the other uses a map display application (not shown) as a server. At this time, if the map display application is “map”, App2 recognizes that the map display application is a server by an argument (> retouch-s map <CR>) input by selecting an icon or the like.

  In the above-described embodiment, an application having a list display function of images by thumbnail display has been described as an application having a display function with high visibility. However, the present invention is not limited to this. An application having a display function, a file list list display function, a database list display function, or the like may be used.

  2 ... Information processing display device, 4 ... CPU, 6 ... Bus, 8 ... ROM, 10 ... RAM, 12 ... Display device, 14 ... Display control unit, 22 ... Operation member, 24 ... I / O, 26 ... Recording medium, 28 ... Recording I / F, 30 ... Frame memory, 32 ... Composition unit, 34 ... Display drive unit.

Claims (6)

An information processing display device capable of simultaneously executing a plurality of applications,
Input / output means for writing and reading text information to and from the file of the application for each application;
Detecting means for detecting a process number from the application name;
With
The information processing system is characterized in that the plurality of applications perform a cooperative operation by reading out text information written in the file of the application specified based on the process number detected by the detecting unit. Display device. An information processing display device capable of simultaneously executing a plurality of applications,
Input / output means for writing and reading text information to and from the file of the application for each application;
Detecting means for detecting a process number from the application name;
With
The application writes text information in the file of the application specified based on the process number detected by the detection means, and the specified application reads the text information written in the file, thereby The information processing display device is characterized in that the application performs cooperative operation.   The information processing display apparatus according to claim 1, wherein the application can be executed independently, and writes to the file for each operation.   The application is capable of dynamically setting a partner application that performs a cooperative operation, and dynamically changes an execution state of the application based on an operation state of the partner application at the time of activation and operation. The information processing display device according to any one of claims 1 to 3.   5. The information processing display device according to claim 1, wherein the file of the application is associated with a process number of the application and includes a read file and a write file. 6. . Window display means for displaying a window showing the processing content executed by the application;
At least one of the applications has a display function with high visibility and distributes selection information to other applications.
The said window display means displays the window which shows the processing content of the application which has a display function with the said high visibility in the lower rank rather than the window which shows the processing content of the other said application. Item 6. The information processing display device according to any one of Items 5 to 6.

Images