KR20190115401A - Method, apparatus and program for linked view - Google Patents

Abstract

The present invention relates to a method for linked view that at least some regions of output of one or more separate P-link applications, which are executed by an operating system (OS) of an information processing device, are outputted to a linked view application in a predetermined arrangement state. The method for linked view comprises: a P-link application registration step of registering each P-link application in a linked view application; a view window setting step of setting one or more view windows in the linked view application; a view area setting step of setting one or more view areas in each of the P-link applications corresponding to each of the view windows; and an integrated view display step of displaying images as integrated views by integrating images of the view areas corresponding to each of the view windows in a linked state.

Description

Link view method, link view device and link view program {METHOD, APPARATUS AND PROGRAM FOR LINKED VIEW}

The present invention relates to a link view method, a link view device, and a link view program, and more particularly, to view at least a portion of a screen display of each app for two or more apps (application programs) designated at a specific position on a screen. Link view method that shows the integrated view by connecting to the arranged view window, shows other apps visually (visual recognition) when editing any of the apps displayed in the integrated view, and automatically updates and reflects the latest edited state. A link view device and a link view program.

In general, information processing devices such as computers, tablet PCs, and smart phones include a keyboard, a mouse, a touch screen, a microphone, a camera, etc. as input devices, and a screen, a touch screen, a printer, a speaker, a vibration module, etc. as an output device. Equipped with. The application (application program executed by the OS) is loaded and executed by the control processing function blocks such as the CPU, memory, and circuit inside the information processing apparatus.

In general, certain apps are designed to perform a single specific function well. Word processor apps, for example, are specialized and specialized for writing and sentence typing. For example, word processor apps typically do not have functions for other fields, such as music playback.

Of course, some non-professional functions are provided in the app for user convenience. For example, a word processor app is provided with, for example, drawing and table calculation functions. However, this non-professional add-on is, of course, extremely vulnerable compared to the functionality of the specialized app for that feature. Apps are evolving towards more specialized within their respective fields of expertise. In addition, these specialized apps, such as word processor programs, allocate resources such as CPUs and screens to their specialized functions first, so that the results of drawing and spreadsheet functions by these non-specialized add-ons have their attributes. It is common to be limited, for example, where free placement is extremely limited.

On the other hand, a recent information processing device is capable of multitasking by loading a plurality of apps. In this case, outputs can be generated from a plurality of apps, and they can act on the same output device, such as the same screen display. When the screen data from the plurality of apps overlap in the output position, the screen output of the other is obscured by one screen output. This is a result of the OS's priority processing logic.

For example, a case where a word processor program is loaded and executed as a first app and a spreadsheet program is loaded and executed as a second app will be described as an example. These first and second apps are all apps that use the screen as a main output device.

In this case, if the first app is activated, the input from the input device is delivered only to the first app and not to the second app. Therefore, in the case of keyboard typing, character typing is performed in the first app.

When the output positions of the first app and the second app overlap, if the first app is activated, the screen data of the first app covers the screen data of the second app as much as the overlapped range. Therefore, the screen data of the second app in the overlapped range cannot be visually recognized.

As another example, during multitasking, for example, the same printer may be requested to output printer data from a plurality of apps together. In this case, it is output for each app one by one by the printer queue process. In other words, the data covered by the printer output is not generated, and all the output data are sequentially output to the printer. However, printer data of a plurality of apps is not well arranged at one time and output to a printer. This is the result of the printer data priority processing logic of the current OS.

The OS's processing logic is logical and useful in the general case. However, this processing logic is useful only in situations where it is assumed that only one app produces output at a time, and that the user only uses one output in multitasking, and may be more useful. It is not assumed.

Recently, in the era of the fourth industrial revolution, as the society develops toward more persuasive power when more specialized high-level data such as AI can be presented at a glance, it is necessary to use the specialized app for the screen presentation of the data and the printout of the printer. Functional processing is required. The various components that make up the contents of these screen presentations or printer outputs are processed by specialized apps in the field to ensure professionalism, and the components processed by these specialized apps are useful and systematic in one screen or printer output. As such, it needs to be assembled at a glance. This will allow the output from various apps of various kinds to be properly arranged in one output so that one comprehensive information can be represented.

As a method of collectively arranging the outputs of several specialized apps and gathering them into one output, conventionally, one application is mainly used, and functions that are not implemented in the app are borrowed from other apps and used or included and displayed. Desire exists. For example, there is a desire to use the free drawing function of a graphics program while using a word processor program. Pre-drawing can be used, for example, in handwriting memo while taking a lecture.

In general, however, when one app is activated, data of another app on the screen that overlaps the output location is hidden. Therefore, the data of the two apps cannot be displayed at the same time in the overlapped position.

In addition, it is impossible to insert and display some elements of the output of another app at a specific position in one app. Thus, for example, when using a word processor program as a first app and using a spreadsheet program as a second app, it is impossible to display only the final total part of the spreadsheet program at a specific location of the word processor program, for example. .

However, conventionally, a method using an OLE object is known as in Patent Document 1 below. According to this method, when both the first app and the second app are apps that conform to the OLE specification, the OLE object of the second app can be inserted into the first app.

Further, in the following Patent Document 2, in the screen window display method independent of the main screen window of the application program, the main screen window and the corresponding screen data is displayed on the child screen window displayed in the inner region of the main screen window and A first screen window event monitoring step of continuously monitoring whether a first specific event occurs in the child screen window; An independent screen window generation step of generating an independent screen window on an external area of the main screen window as a result of the first screen window event monitoring, when a first specific event occurs and the child screen window leaves the internal area of the main screen window; An independent screen window changing step of changing the size and position of the generated independent screen window based on the size and the moving position of the child screen window; A first screen data connection step of connecting screen data previously displayed on the child screen window to an independent screen window in which the size and position are changed; A child screen window hiding step of hiding the child screen window previously displayed in an inner region of the main screen window on a screen; An independent screen window display step of displaying the screen data by displaying the independent screen window connected with the screen data on a screen; A second screen window event monitoring step of continuously monitoring whether a second specific event occurs in the main screen window and the independent screen window while displaying corresponding screen data on an independent screen window displayed in an external area of the main screen window; As a result of monitoring the second screen window event, as the second specific event occurs and the independent screen window completely enters the inner region of the main screen window, the size and position of the child screen window previously hidden on the screen is moved and the size of the independent screen window. Changing the child screen window based on the position; A second screen data connection step of connecting screen data previously displayed in the independent screen window to a child screen window in which the size and position are changed; An independent screen window hiding step of hiding the independent screen window previously displayed in an external area of the main screen window on a screen; A child screen window display step of displaying the screen data by displaying the child screen window connected with the screen data on the screen; Continuously monitoring whether a screen window termination event occurs in the independent screen window while displaying corresponding screen data on the independent screen window displayed in an external area of the main screen window; And erasing the independent screen window displaying the screen data and the child screen window previously hidden on the screen when the screen window ending event occurs in the independent screen window. A window display method is disclosed.

Patent Document 1: Japanese Patent Application Laid-Open No. 2001-118077 Patent Document 2: Patent Registration 10-0639807

By the way, the technique of the said patent document 1 is possible when both a 1st app and a 2nd app have the function which satisfy | fills the specification called OLE. For example, the Notepad app does not meet the OLE specification. In this case, the screen output and printer output of the notepad cannot be loaded into an OLE object from a word processor such as Microsoft Word (TM). Therefore, there is a limit that the screen presentation or printer output cannot be formed by forming an integrated view of the apps.

In addition, many operating systems do not support the OLE specification. It is a limitation of the conventional OLE method that an app running in the non-OLE supported OS cannot include the contents of another app in a manner of including an OLE object.

And the technique of the said patent document 2 only discloses the screen adjustment relationship between a main screen window and a child screen window in one app, and does not disclose the screen link relationship between different separate apps. In the case of different separate apps, the screen output schemes are different from each other, and the allocation areas handled by the operating system (OS) are also different, and thus there is no tunable relationship.

In the technology of Patent Document 2, when the child screen window leaves the main screen window, only the technology of switching from the child screen window to the independent screen window, and when the child screen window enters the main screen window, switches from the independent screen window to the child screen window. It has only begun, and there is no worry about the problem that the child screen window hides the main screen window and makes it impossible to recognize, and it does not suggest a solution.

The present invention is to solve the problems of the prior art, and is applied to any app having a visual property, regardless of whether the app or the OS is an OLE specification, so that an image of at least part of a specified area of one or more piclink app It is to provide a link view method, a link view device, and a link view program that can be displayed in an integrated state.

In addition, by adjusting the transparency of the image of the view window or the view area, when the images of the plurality of view windows are overlapped may be displayed in an overlapping state, so that the transparency of the desktop of the program of the present invention is also adjusted, To provide a link view method, a link view device, and a link view program that can be displayed in an overlapping state with the OS desktop so that the visual effects can be controlled in relation to the OS desktop even when an image is not overlapped. It is.

Another object of the present invention is to provide a link view method, a link view device, and a link view program for setting a vertical rank in overlapping view windows.

If the P-Link app includes a module for sound or video playback, the sound or video can be set to be played only while the view window is displayed on the screen, and the image of the P-link app displayed in the view window is activated. When an input event such as typing, voice input, etc. occurs, the input event is transmitted to the Plink app through an OS in order to generate the input event in a corresponding portion of the view area of the Plink app that is enlarged and reduced in proportion. To provide a link view method, a link view device, and a link view program in which control is returned to a link view app after the input event processing, and an image of the view area can be updated.

In addition, it is to provide a link view method, a link view device, and a link view program for allowing the rest to be visually displayed upon editing of any one of the P-link apps, and the latest state of the edit result is automatically updated in the view window.

The link view data stored in the link view app is intended to provide a link view method, a link view device, and a link view program such that information about a view window property, a view area property connected thereto, and a linked link property is connected thereto.

When the link view data is loaded, the link view app executes the linking app, loads the linking data, and updates the image of each view window according to the property of each view area. It is an object of the present invention to provide a method, a link view device, and a link view program.

In the link view method of the present invention for achieving the above object, at least a portion of the output of one or more separate P-link app that is executed by the operating system (OS) of the information processing device, the arrangement state is preset in the link view app A link view method for outputting the link view, comprising: a linking app registering step in which each of the linking apps is registered in the linking view app , a view window setting step of setting one or more view windows in the linking view app , and in each of the viewing windows. Correspondingly, a view area setting step of setting one or more view areas in each of the P-link app, and an integrated view in which the images of the view areas corresponding to each of the view windows are integrated in a linked state and displayed as an integrated view. It characterized in that the display step is included.

In addition, the transparency of the image inside the view window or the view area is preferably adjustable.

And it is preferable that the vertical direction at the time of overlapping the view window is configured to be set.

And when an input event occurs in a state in which the image of the P-link app displayed in the view window is activated, to generate the input event to the corresponding portion of the view region of the P-link app, the P-link app through the OS Preferably, the input event is delivered to the control unit, and control is returned to the link view app after the input event processing, and the image of the view area is updated.

When the editing of any one of the P-link app, the rest is displayed visually , (1) at every editing operation, (2) at a predetermined period during editing, or (3) at the completion of editing, Preferably, the latest state of the view region of the P-link app is automatically updated and reflected in the image of the view window.

In addition, the link view data stored in the link view app includes an attribute including the position and size of each view window, and the position and size of each view region of the P-link data of each P-link app corresponding to each view window. It is preferable that an attribute including a is included.

Here, when the link view data is loaded into the link view app, each P link app corresponding to each view window is executed, and the P link data is loaded into each P link app, and the integrated view display step is performed. Preferably performed.

On the other hand, the link view device of the present invention, so that at least a portion of the output of one or more separate P-link app to be executed by the operating system (OS) of the information processing device is output in a predetermined arrangement state to the link view app A link view device, comprising: a linking app registration module for registering each of the linking apps in the link view app , a view window setting module for setting one or more view windows in the link view app , and corresponding to each of the view windows. And a view area setting module for setting at least one view area in each of the P-link apps, and an integrated view in which an image of each view area corresponding to each view window is integrated in a linked state and displayed as an integrated view. It is characterized in that the display module is included.

On the other hand, the link view program of the present invention is a link view program stored in a recording medium on which a program for executing each step of the method described above to the information processing apparatus is recorded.

According to the present invention, irrespective of the OLE specification, an app having a visual property is applied to any app so that an image of at least some designated areas of at least one P-link app can be displayed in an integrated state. A view device and a link view program are provided.

In addition, the transparency of the image of the view window or the view area is adjusted, so that when the images of the plurality of view windows overlap, it may be displayed in an overlapping state, even when the images do not overlap visually in relation to the desktop Link view methods, link view devices, and link view programs are provided that allow control of effects.

In addition, there is provided a link view method, a link view device, and a link view program for setting a vertical rank at the time of overlapping view windows.

In addition, when the P-Link app includes a module for playing a sound or a video, a link view method, a link view device, and a link view program are provided so that the sound or video is played only while the view window is displayed on the screen.

In addition, a link view method, a link view device, and a link view program are provided so that the rest is visually displayed upon editing of any one of the P-link apps, and the latest state of the edit result is automatically updated in the view window.

The link view data stored in the link view app is provided with a link view method, a link view device, and a link view program for including information of a view window property, a view area property connected thereto, and a Plink app property connected thereto.

When the link view data is loaded, the link view app executes the linking app, loads the linking data, and updates the image of each view window according to the property of each view area. A method, link view device, and link view program are provided.

1 is a perspective view as an exemplary schematic view for explaining the concept of a link view method according to an embodiment of the present invention.
2 is a plan view of one more specific embodiment.
3 is a block diagram of a link view device according to an embodiment of the present invention.
4 is a flowchart showing a processing method of a link view method according to an embodiment of the present invention.
5 is a schematic perspective view according to another embodiment.
FIG. 6 is a diagram illustrating a configuration for switching control between apps, and illustrates an embodiment in which a plurality of apps are switched by a plurality of tabs provided in an upper row of a screen, wherein (a) is a state where a first tab is activated ( b) is a state in which the second tap is activated.

EMBODIMENT OF THE INVENTION Hereinafter, the preferred embodiment of this invention is described in detail, referring an accompanying drawing. However, the examples are merely to aid the understanding of the invention and are not intended to limit the claims. In addition, about the part which has the same function by the same structure, the detailed description may be abbreviate | omitted by keeping same code | symbol even if drawing differs. In addition, one module may be divided into two or more modules in terms of its function, and on the contrary, two or more modules may be implemented in one module in its function. And hard wiring and soft wiring are treated equally.

The present invention is applicable to any OS, computer, smart phone, other central processing unit including a desktop, laptop, tablet PC, etc. to the information processing device to run the app (application program executed by the OS) in memory This apparatus does not exclude systems that can emerge in the near future, such as processing systems using networks by AI, big data, IoT, and the like.

<Basic Configuration>

In the link view method of the present invention, at least some regions of the output of one or more separate P-link apps p1, p2, and p3 executed by the operating system (OS) of the information processing device are connected to the link view app p0. This is a link view method that outputs the preset layout. In this method, a separate independent app unique to the present invention called a link view app p0 is set, and the view windows a ', s' and m' connected to the view areas a, s and m are set and managed. As a result, it is possible to ensure that various Plink apps (p1, p2, p3) having specialized functions such as word processors, spreadsheets, and drawing tools may be developed to have only unique specialized functions. In other words, specialized apps do not have to waste time, money and effort to develop non-specialized add-ons, nor do they need to add unnecessary features to their native expertise, such as OLE objects. Even data stored by specialized apps, which are various P-link apps, does not need to store information related to the link. This is because the function to show the link is in charge of the link view app (p0) of the present invention.

According to the method of the present invention, by separately preparing and executing a link view app (p0) for mediating an image, regardless of whether the existing piclink apps (p1, p2, p3) comply with the OLE specification and the type of OS. It's a breakthrough way to apply it to any app.

The method of the present invention includes the registration of the P-link app (S11, S12) , the view window setting step (S13) , the view area setting step (S14, S15) , and the integrated view display step (S16) It features. The method of the present invention may be implemented as a program (p0, link view app) configured to be executed by each information processing device.

The P-link app registration step (S11, S12) is a step in which each of the P-link app (p1, p2, p3) is registered in the link view app (p0).

When the link view app p0 is executed by the OS, parameters such as the screen size and position of the program are adjusted according to the setting data of the link view app setting unit 10.

The P-link app (p1, p2, p3) is an app having a portion (view area (a, s, m)) to be seen in the link view app (p0) of the present invention. There is no specific restriction on the requirements to be the P-link app (p1, p2, p3), but the contents are arranged on the screen or the printer according to the user's settings through one or more view windows (a ', s', m'). In consideration of the function of the present invention that can be output, it is preferable that the app that handles visual data is set as the P-link app (p1, p2, p3). The view areas a, s, and m are not limited to being set only in the data portion of the piclink apps p1, p2, and p3. The app control unit or the interface unit of the P-link app (p1, p2, p3), for example, may be set in the upper title bar, menu bar, app border, toolbar, lower status bar. The view areas a, s, and m of the P-link app may be designated so as to be mixed so as not to select the type of the area such as the app control unit, the interface unit, or the data part. Thus, for example, even in the case of a video player for playing multimedia data or a sound player for playing sound data, if there is a visual display portion for the user interface such as play, pause, fast forward, go to first, etc. Since the view areas (a, s, m) can be freely set in an area including a part, these kinds of apps can be used as the piclink apps (p1, p2, p3).

When there are a plurality of view windows a ', s', m' connected to the view areas a, s, and m of the P-link apps p1, p2, and p3, they may overlap each other on the screen. It is a feature of the present invention that an integrated view in which a plurality of view windows a ', s', and m' are arranged is controlled to be displayed and controlled by the link view app p0 based on the image of the view areas a, s, and m. .

Parameters such as the size, position, and the like of the P-link app (p1, p2, p3) are stored in the P-link app setting unit 20.

The view window setting step S13 is a step in which one or more view windows a ', s', and m' are set in the link view app p0.

The view windows a ', s', and m' are screen areas for displaying a source image of a view area designated and collected on at least part of the P-link apps p1, p2, and p3. Here, even if the view windows a ', s', and m' are set in the link view app p0, the piclink data of the piclink apps p1, p2, and p3 is not changed. The P-link data of the P-link apps p1, p2, and p3 are maintained, and all the parameters related to the setting of the view windows a ', s', and m' are all views of the link view app p0 of the present invention. It is stored in the window setting unit 11.

View window related parameters may include, for example, parameters relating to position and size, shape, and transparency. For setting the position, it is possible to set which position of the link view app p0, for example, at which pixel position from the top left of the page, and where it ends. For the setting of the size, for example, the number of pixels such as the width and length, or the diameter can be specified. For setting the shape, shape parameters such as rectangles, ellipses, circles, triangles and the like can be specified. To adjust the visibility contention between the contents of the link view app (p0) and the contents of the view windows (a ', s', m '), the transparency of the view windows (a', s ', m') is set to 0 to 100, for example. Alternatively, it can be adjusted from 0 to 255.

The view area setting steps S14 and S15 correspond to each of the view windows a ', s', and m', and include at least one view area a, respectively, in each of the P-link apps p1, p2, and p3. s, m) is set.

The view regions a, s, and m are screen output data of the Plink apps p1, p2, and p3 to be displayed on the screen d or the printer through the view windows a ', s', and m'. Screen area for identifying and capturing at least a portion. The setting of the view areas a, s, and m does not change the data of the piclink apps p1, p2, and p3. The data of the P-link apps p1, p2, and p3 are maintained, and the parameters related to the setting of the view areas a, s, and m are all view area setting units 21 of the link view app p0 of the present invention. )

The view area (a, s, m) related parameters may include, for example, parameters related to position, size, shape, and transparency. For the setting of the position, it is possible to set which position of the P-link app p1, p2, p3, for example, at which pixel position from the top left of the page, and where it ends. For the setting of the size, for example, the number of pixels such as the width and length, or the diameter can be specified. For setting the shape, shape parameters such as rectangles, ellipses, circles, triangles and the like can be specified. To adjust the visibility contention between the contents of the link view app (p0) and the contents of the image of the view areas (a, s, m) in the view windows (a ', s', m'), the view areas (a, s, The transparency of the image of m) can be made multi-level adjustable, for example from 0-100 or 0-255. The image of the view area (a, s, m) may be composed of image data obtained by image capturing of the current screen, for example, screen capture, and is provided in the background on the memory even though it is not currently displayed on the screen. It may be configured to obtain an image of the view area (a, s, m) by using the P-link app (p1, p2, p3) of the preliminary screen image data.

The integrated view display step S16 may include an enlarged and reduced size in a state in which an image of each of the view areas a, s, and m corresponding to each of the view windows a ', s', and m' is linked. It is the step that is integrated and matched with the position, shape, etc. and displayed as the integrated view.

As shown in FIG. 1, the current screen d displayed as described above shows the contents a 'and s' of the P-link app p1 and the contents m' of the P-link app p2. The integrated view (refer to the red dotted line border of p0 in FIG. 1), the screen (d) of the integrated view, as if the content is generated and output by one app (link view app (p0) from the beginning of the P-link app (p1) Relative positions on the screen of the contents (a ', s') and the contents (m') of the P-link app (p2) may be maintained in the state.

For example, as illustrated in FIG. 2, a calculation result is derived through a complicated calculation process in a spreadsheet app p4 which is a P-link app, and the calculation process is not shown on the screen d, and only the calculation result is displayed on the screen d. When it is necessary to indicate to, set the view window (s') in the link view app (p0) of the present invention, and after performing a complex calculation in the Plink app (p4) is a specialized app, as a result only the partial screen position of the present invention In the link view app (p0) of the set to the view area (s), it is possible to process by displaying the instant capture image of the view area (s) in the view window (s'). By doing so, when displaying the integrated view on the screen, there is no effect on the Plink app (p4), which is a specialized app, no modification is required, and the link view app (p0) of the present invention is a view window (s'), By managing and storing the view area s entirely, only the necessary data part (total part) is linked and shown. However, at the time of modifying or playing the data of the P-link app, the link view app may affect the data of the P-link app through the OS, and the result is applied to the integrated view again, which will be described later.

Here, as illustrated in FIG. 1, the 'zoom' between the view areas a, s and m and the view windows a ', s' and m' does not simply mean a change in size. Includes variations in form and delivery. For example, when the view areas (a, s, m) have a rectangular shape and the aspect ratio is 2: 5 (any unit), the view windows (a ', s', m') have an aspect ratio of 4 even though they are the same rectangular shape. May be 3: In this case, the aspect ratio may be enlarged and reduced in proportion to each other. As another example, the view areas (a, s, m) may be square and the view windows (a ', s', m') may be triangular, in which case the four corners and four sides of the square and the three corners of the triangle and An arrangement correspondence between the three sides needs to be specified. Also, for example, the view areas (a, s, m) may be circular and the view windows (a ', s', m') may be triangular, in which case the arrangement between a specific point of the circle and the three corners and three sides of the triangle Correspondence needs to be specified. In this way, various correspondences can be set.

In such various enlargement and reduction, it is preferable to perform the conversion according to the proportional relationship. For example, if a square view area with a 2: 2 ratio of 200 pixels: 500 pixels is converted to a copy with a ratio of 4: 3 pixels of 1000 pixels: 750 pixels, the width of each pixel is increased five times while the height is 1.5 times each pixel. It can be configured to scale proportionally to increase.

On the other hand, when 'save' of the link view data of the link view app of the present invention, the P-link app (p1, p2, p3), regardless of the storage method of the link link data of the link view app (p0) of the present invention, the original They are stored separately as specified in the apps. That is, they are used by the link view app (p0) of the present invention and displayed on the screen to produce a useful result, but there is no correlation at all with the OS level. When storing the link view app p0 of the present invention, the information about the link links app p1, p2, and p3 and their link information, that is, view window related parameters and view area related parameters, are inherent to the data of the present invention. It is stored in the storage unit 90 of the present invention. At this time, it is preferable to store the final screen position information or the final edit position information that finally appeared on the screen (link view app setting unit 10). However, at the end of the link view app p0 of the present invention, it may be more convenient if the termination command for the piclink apps p1, p2, and p3 is configured to be delivered by the operating system OS.

Subsequently, when 'loading' the data by the link view app p0 of the present invention, if the information and the link information of the pelink app (p1, p2, p3), which are the original data of the present invention, are read, LinkView app (p0) sends commands to the operating system (OS) to load and execute (p1, p2, p3), and to load and load their data as well as the respective view windows (a ', s', m'). ) And the corresponding parameters of the view areas a, s, and m are read, so that the display contents of the piclink apps p1, p2, and p3 are restored on the screen d. At this time, it is preferable that the link view app p0 sends a command to the operating system OS to move to the final screen position or the final edit position.

As described above, according to the present invention, a part of another Plink app is displayed on the screen of the P link app, centering on one P link app, thereby forming an integrated view and displaying a useful screen.

<Transparency>

Transparency of the image inside the view windows (a ', s', m') or the view area (a, s, m) is preferably adjustable.

If the transparency of the image in the view window (a ', s', m') or view area (a, s, m) is 100%, the background content remains visible and 0% transparency (100% opacity). In this case, the content of the background is hidden and the content of the image is displayed as it is. If the transparency is at any ratio within its intermediate range, such as 50% as illustrated in Fig. 1, both contents (a 'and s') are superimposed on one another, but they are viewed in a state of knowing the content, and are useful because they can be understood. . Alternatively, as illustrated in FIG. 2, for example, in a manner in which the control of the multimedia (movie) is arranged fb2 such that the transparency changes to 0% only in the mouse-over state, and the transparency changes to 100% when the mouse-over state is not. Transparency may be utilized.

 As described below, when one of the Plink apps (for example, p1) is visible, another Plink app (p2 to p4) may be usefully used for editing in an edit mode.

<Vertical arrangement of vertical direction>

The view windows a ', s', and m 'may be provided in plural, and at least some of the plurality of view windows a', s 'and m' may be overlapped. . In this case, as illustrated in the overlapping portion fb1 of FIG. 2, according to the overlapping vertical rank (for example, t2 '>n') set for the overlapped view windows t2 'and n', the upper view. It is preferable that the view window image (the 'year' portion) is output with the window t2 'covering the lower view window n'. To this end, it is preferable to be configured to set the vertical direction at the time of overlapping the view window.

In the present invention, since the arrangement of the view windows according to the set order is possible, it is possible to arrange freely and appropriately to the form to be output.

<Playback timing of sound or movie view area>

When the P-link app (p1, p2, p3) is an app including a module for sound or video playback, the sound or video is preferably set to be played only while the view window is displayed on the screen.

Sound reproduction is to generate an output including speaker output-oriented output or speaker output by the app or data. For example, an mp3 player app is an example of such a sound playback app. Video playback means that the app or data generates output on both the video and speaker output on the screen. For example, a DVD player app or a web browser that can connect to a site including video data on the web is an example of such a video playback app.

The sound playback or video playback app may need to display a display that visually expresses the app, such as a view window (s ', m') such as an icon or a player control interface on the screen. In this case, the playback of the sound or the video may be set to be possible only when the view windows s 'and m' of the view areas s and m are visible, that is, when they are moved to a position exposed to the screen d. have. Accordingly, when the view window is not visible on the screen d, playback is stopped, so that only when the related content is displayed on the screen, there is an effect. However, the present invention is not limited thereto, and in some cases, it may be necessary that playback of a sound or a video is always made possible regardless of whether a copy of the view windows s 'and m' is visible. Accordingly, as in the background music, no matter what work is performed, there is an effect that the sound can flow out.

<Shift of integrated view>

The visual data of the plurality of view windows displayed together as described above is preferably moved together as if the screen is formed by a single app during screen movement, that is, scrolling, page up, and page down. That is, when the data of the link view app p0 is moved , the relative positions of the view windows b ', m', s ', a' are maintained while maintaining the positional relationship with the link view app p0. It is moved. Of course, if the screen is scrolled together, the view window does not necessarily need to be indistinguishably integrated into the link view app, but a display, for example, a border may be displayed explicitly so that the view window can be recognized.

<Edit screen and update>

When editing any one of the P-link apps, the rest is visually displayed , and (1) at every editing operation, (2) at predetermined intervals during editing, or (3) at the completion of editing. The latest state of the view area of the P-link app is automatically updated to be reflected in the image of the view window.

Since the P-link apps p1, p2, and p3 are independent apps, they can be edited by the function of the app. P-link app (p1, p2, p3) may be displayed on the screen (d), for example, to be assigned to each one tab for each app, as shown in Figure 6, the window showing the contents of the lower side by the selection of the assigned tab The content may be configured to be changed into the editable state as the content is changed to the content of the selected app.

When a plurality of P-link apps are overlapped through the view window, when the view window is edited after being placed according to the vertical position when the view windows are overlapped, it is placed in the lower order on the vertical rank. It may be configured to be editable, or it may be configured to change the arrangement order to priority for editing and to edit it, and then to change it to subordinate order after completion of editing.

<Independent Plink App>

On the other hand, even in the integrated view state as shown in Figure 1 by the link view app (p0) of the present invention, at least one (p1) of the plurality of P-link apps (p1, p2, p3) is designated as an independent P-link app and edited in advance It can be set to enable. The independent Plink app is a Plink app in which no view area or view window is set. Since such independent P-link app does not need to edit and update the view area-view window, the system resource can be saved.

Here, since the independent P-link app that is set to be editable in advance is usually displayed in the state where the screen display area is the largest, it is reasonable that it is set to be editable by default (default) and managed by the link view app. At this time, the wallpaper of the link view app that overlaps with the position of the independent P-link app may be set to transparent. Alternatively, the independent P-link app may be set to always be displayed in front of the link view app. Since the independent P-link app is always displayed directly on the screen, it is not necessary to update the link view app, thereby saving resources. The other P-link apps p2 and p3 may be designated by an image editing tool such as Paint or Photoshop, and the view area and the view window may be set and managed by the link view app.

In this case, for example, during the lecture, data is mainly input by the independent P-link app, and updating of the data by the link-view app is unnecessary. And when the pre-drawing (handwriting, handwriting) data for handwriting memo can be used, these other Plink app can be used, and when updating the input data, it can be set to be editable, for editing, The app can be loaded and displayed on the screen.

In particular, for the sake of convenience, such as maintaining the layout relationship at the time of editing and maintaining the consistency of contents, it is preferable that any other Plink app is set to be visually displayed during editing of any one P link app p1. Do. Thus, for example, when editing an app through the view window, the data of the current state of another app can be visually edited through the view window, and when editing another app through the view window, You can make the data of the state editable while viewing it through the view window. Or, for example, when directly editing an app that is an independent Plink app, data of the current state of another app can be visually edited through the view window, and when the other app is edited through the view window, the independent Plink You can edit the data of the current state of any one app as you see it directly in the app. Or, for example, when directly editing one app that is an independent Plink app, the data of the current state of another app that is an independent Plink app can be viewed and viewed directly in the app, and when editing another app that is an independent Plink app. In the app, you can edit the data of the current state of any one app as an independent P-Link app. This helps to edit and form information related to each other.

Here, the other apps (p2 ~ p4) is displayed visually at the time of editing the independent P-link app (p1) that is set to be editable by default, because the other apps (p2 ~ p4) does not change the content is very difficult There may not be. On the other hand, when the editable independent Plink app (p1) is displayed visually at the time of editing one of the other apps (p2 ~ p4), as shown in the example of Figure 6, for editing the other apps (p2 ~ p4) When the other apps (p2 ~ p4) is activated, since the operating system (OS) is exposed to the front in the screen (d), the current other app under editing hides the original editable independent Plink app. Then, there is a problem that the contents of the editable independent Plink app cannot be displayed in a visually readable manner.

Therefore, in the present invention, when an input event occurs in the state that the image of the P-link app displayed in the view window is activated, in order to generate the input event to the corresponding portion of the view area of the P-link app, OS The input event may be delivered to the P-link app, and control may be returned to the link view app after the input event is processed, and the image of the view area may be updated.

For example, when the first app is a word processor and the other app to be edited is Paint, a command for editing another app, etc., to prevent the other app from being edited while the first app is displayed visually, is not blocked. When an input event (for example, a click in a specific view window of another app to be edited) occurs, the Plink app is configured to activate an input in a background state that does not appear on the screen through an operating system (OS). Then, the link view app (p0) of the present invention first receives the input data by the input event, such as a keyboard, a mouse for editing the corresponding link link app, and delivers it to the operating system (OS), the corresponding link link app It is configured to be input as edit data of. The P-Link app processes this input data, and the operating system (OS) returns control to the link-view app. Then, the changed contents of the screen data of the area corresponding to the view area (a) of the background screen data (screen data that does not appear on the screen but exists in the memory) of the P-link app are instantly displayed in the view window (a '). It is configured to update and reflect on the view window (a 'position) of the integrated view. Thus, when the integrated view is visible on the screen, when editing the Plink app, the input content to be used for editing the Plink app is delivered to the corresponding Plink app, and the edited result is immediately reflected in the integrated view. Can be.

At this time, if the view area a and the view window a 'are enlarged and reduced according to the proportional relationship, when a certain part of the image shown in the view window a' is clicked, according to the proportional relationship The position of the corresponding view area a can be specified. Thus, for example, in the case where the edited pilink app is a sound player, the portion where the play, stop, forward, and back buttons of the sound player are set is set as the view area a, and the view window of the program p0 of the present invention. If a copy (a ') is displayed in a zoomed-in area, click a specific part of the copy (a') to trigger a click event, and activate a specific part of the view area (a) to send the click event to the OS. In addition, the sound player, which is a P-link app, can be operated in a visible state of the link-view app. The OS switches control to the Plink app to handle the click event, returns control back to the link view app, and the link view app updates the screen.

However, the editing result is reflected on the screen, for each editing operation (for example, a figure 'line' for the editing unit such as a line, a polygon, an image, etc. for the P-link apps p2 to p4). Each time the operation handle is moved, or (2) every predetermined period of time (e.g., 0.1 seconds, 0.5 seconds, 5 seconds, or 10 seconds) during editing, or (3) upon completion of editing (e.g., the final 'Edit Complete' button After clicking), the latest status is automatically updated in the view windows (b ', m', s ', a') of the view area (b, m, s, a) of the app being edited, and the view window of the integrated view is updated. (b ', m', s ', a' place) can be set to reflect. For example, when the edited Plink app is, for example, a spreadsheet, the update cycle may be slow, and the edit result may be reflected only after the final result is output. On the other hand, if the P-link app to be edited, for example, paint, it may be preferable that the editing results are reflected at the same time as the editing operation. When any one of the P-link apps is updated in this way, the edited contents are reflected in the integrated view.

<Save and Recall>

In the link view data stored in the link view app, the property including the position and size of each view window and the position and size of each view region of the P-link data of each P-link app corresponding to each view window are displayed. It is preferable that the containing attribute is included.

Meanwhile, when the link view data is loaded into the link view app, each P link app corresponding to each view window is executed, and the P link data is loaded into each P link app, and the integrated view display step Is preferably performed.

As a result, the P-link app can concentrate only on its specialty as a specialized app, and the function of linking and displaying can be implemented by the function of the link view app of the present invention, which has a great effect on specialization and simplicity.

<Link view device>

The link view method of the present invention as described above, may be configured in electronically controlled hardware, which is one or more separate Plink app running by the operating system (OS) of the information processing device corresponding to the method A link view device for outputting at least a portion of the output of the link view app in a preset layout state, the link link app module , a view window setting module , a view area setting module , and an integrated view display module are included. Characterized in that made.

The P-link app registration module is a module to register each of the P-link app to the link view app. The set registration information is stored in the storage unit 90.

The view window setting module is a module for setting one or more view windows in the link view app. The set registration information is stored in the storage unit 90.

The view region setting module is a module for setting one or more view regions in each of the P-link apps, corresponding to each of the view windows. The set registration information is stored in the storage unit 90. Since the registration of these P-link apps, the setting of the view window and the view area can all be referred to as the setting of the link-related information, they may be configured to be integrated and set in the link setting unit 30 to perform the setting and registration.

The integrated view display module is a module configured to display an integrated view by integrating images of the view areas corresponding to each of the view windows in a linked state. Integrated views are controlled to be scrollable together.

<Link view program>

In addition, the present invention is preferably implemented as a link view program stored in a recording medium on which a program for executing each step of the method described above is executed by the information processing apparatus.

As mentioned above, although this invention was demonstrated according to the preferred embodiment, it is not limited to this, Comprising: It should be understood that all the deformation | transformation, improvement, and a change which were made in the range as described in a claim are included in the scope of the present invention.

The invention can be used in the industry of link view methods, link view devices and link view programs.

10: link view app settings
11: View window setting part
20: Plink App Settings
21: View Area Setting Section
30: link setting section
40: integrated view control unit
50: edit control unit
60: update unit
70: input / output unit
80: interface unit
90: storage
d: display screen
p0: Linkview app, p1, p2, p3, p4: Plink app (program)

Claims (9)

A link view method in which at least some regions of the output of one or more separate P-link apps executed by the operating system (OS) of the information processing device are output in a predetermined arrangement state in the link view app,
A piclink app registration step of registering each piclink app with the link view app ;
A view window setting step of setting one or more view windows in the link view app;
A view area setting step of setting one or more view areas in each of the P-link apps corresponding to each of the view windows;
An integrated view display step of displaying the integrated view by integrating the images of the respective view areas corresponding to each of the view windows in a linked state.
Link view method comprising a. The method according to claim 1,
Transparency of the image inside the view window or the view area is adjustable
Link view method, characterized in that. The method according to claim 1 or 2,
It is configured to set the vertical direction at the time of overlapping the view window.
Link view method, characterized in that. The method according to claim 1 or 2,
When an input event occurs in a state in which the image of the Plink app displayed in the view window is activated, in order to generate the input event in a corresponding portion of the view area of the Plink app, the Plink app is transmitted through the OS. The input event is delivered, and control is returned to the link view app after the input event is processed, and the image of the view area is updated.
Link view method, characterized in that. The method according to claim 1 or 2,
When editing any one of the P-link app, the rest is displayed visually ,
(1) every editing operation, or
(2) every predetermined period during editing, or
(3) At the time of editing completion,
The latest state of the view region of the P-link app is automatically updated and reflected in the image of the view window.
Link view method, characterized in that. The method according to claim 1 or 2,
In the link view data stored in the link view app, the property including the position and size of each view window and the position and size of each view region of the P-link data of each P-link app corresponding to each view window are displayed. Contains attributes are included
Link view method, characterized in that. The method according to claim 6,
When the link view data is loaded into the link view app, each P link app corresponding to each view window is executed, the P link data is loaded into each P link app, and the integrated view display step is performed.
Link view method, characterized in that. A link view device for outputting at least a portion of the output of one or more separate P-link apps, which are executed by an operating system (OS) of the information processing device, in a predetermined arrangement state in the link view app,
A linking app registration module for allowing each linking app to be registered to the link view app ;
A view window setting module for setting one or more view windows in the link view app;
A view region setting module for setting at least one view region in each of the P-link apps, corresponding to each of the view windows;
Integrated view display module for displaying the image of each view area corresponding to each of the view windows in a linked state to be integrated and displayed as an integrated view
Link viewing device comprising a. A link view program stored in a recording medium on which a program for executing each step of the method according to claim 1 is executed.

Images