WO2015056482A1 - Information processing device, storage medium, and control method - Google Patents

Information processing device, storage medium, and control method Download PDF

Info

Publication number
WO2015056482A1
WO2015056482A1 PCT/JP2014/071242 JP2014071242W WO2015056482A1 WO 2015056482 A1 WO2015056482 A1 WO 2015056482A1 JP 2014071242 W JP2014071242 W JP 2014071242W WO 2015056482 A1 WO2015056482 A1 WO 2015056482A1
Authority
WO
WIPO (PCT)
Prior art keywords
window
unit
applications
event
information processing
Prior art date
Application number
PCT/JP2014/071242
Other languages
French (fr)
Japanese (ja)
Inventor
哲男 池田
嘉人 大木
翼 塚原
大輔 永野
佐藤 大輔
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2015056482A1 publication Critical patent/WO2015056482A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management

Definitions

  • This disclosure relates to an information processing device, a storage medium, and a control method.
  • a so-called multi-window display in which a plurality of windows are displayed in a superimposed manner is put into practical use.
  • the first window and the second window are partially overlapped and displayed on the display screen
  • the first window is displayed preferentially (front)
  • the second window This window is in a state where a portion that does not overlap with the first window is visible.
  • the second window is displayed preferentially (in front), and a part of the first window is hidden by the second window. The user can perform work while viewing a plurality of windows alternately.
  • Patent Document 1 proposes a method of simultaneously displaying a plurality of windows. Specifically, the display information of the two windows is displayed in a portion where the first and second windows overlap so that the display information of the rear window is lighter than the display information of the front window. Yes.
  • Patent Document 1 is a technique related to a multi-window display method and management, and does not mention anything about estimating the relationship between the windows.
  • the present disclosure proposes an information processing apparatus, a storage medium, and a control method that can estimate the relationship between a plurality of applications.
  • an input unit that receives an operation input from the outside, a system processing unit that outputs an event to a plurality of specific applications according to an input signal received by the input unit, and an output from the system processing unit Proposed is an information processing apparatus comprising: an application processing unit that executes processing of a plurality of applications according to an event; and an estimation unit that estimates a mutual relationship between the plurality of applications according to the event .
  • the computer includes an input unit that receives an operation input from the outside, a system processing unit that outputs an event to a plurality of specific applications according to an input signal received by the input unit, and the system processing unit
  • a program that functions as an application processing unit that executes processing of a plurality of applications in response to an event output from and an estimation unit that estimates a mutual relationship between the plurality of applications in accordance with the event is stored. Proposed storage media.
  • a step of receiving an operation input from the outside a step of outputting an event to a plurality of specific applications according to the received input signal, and a process of the plurality of applications according to the output event And a step of estimating a mutual relationship between the plurality of applications in response to the event.
  • the relationship estimation system includes an information processing device 1 and a server 2.
  • the information processing apparatus 1 is connected to the server 2 via the network 3.
  • the information processing apparatus 1 does not necessarily have to go through the network 3 and may be directly connected to the server 2 by wireless / wired.
  • the information processing apparatus 1 includes a display unit (an example of the output unit 14) and a keyboard (an example of the input unit 11).
  • a display unit an example of the output unit 14
  • a keyboard an example of the input unit 11
  • the display unit a plurality of applications are executed, and multi-window display is performed.
  • the user can display a plurality of Web browsers and perform comparison while browsing a plurality of shopping sites simultaneously.
  • the technique conventionally proposed regarding the display of the multi-window relates to the display method and management of the multi-window, and there is no mention of estimating the relationship between the windows.
  • FIG. 2 is a diagram illustrating a basic configuration of the information processing apparatus 1 and the server 2 according to the present embodiment. Hereinafter, the basic configurations of the information processing apparatus 1 and the server 2 will be sequentially described.
  • the information processing apparatus 1 includes an input unit 11, a system processing unit 12, an application processing unit 13, an output unit 14, an estimation processing unit 15, an estimation result storage unit 16, a score table storage unit 17, and a communication. Part 18.
  • the input unit 11 has a function of receiving an operation input from the outside.
  • the input unit 11 is realized by an operation input unit having a physical structure such as a keyboard, a button, and a switch, a touch panel that detects contact / proximity, and a pointing device such as a mouse and a track pad.
  • the input unit 11 also includes a camera capable of detecting a line of sight (line of sight detecting unit) and a microphone capable of collecting sound.
  • the input unit 11 outputs the received input information (input signal) to the system processing unit 12.
  • the system processing unit 12 controls multi-window drawing based on input information (input signal) output from the input unit 11 (display control), and outputs (distributes) an event to a plurality of specific applications. To do.
  • the function of the system processing unit 12 can be realized by a control layer of a general OS (Operating System).
  • system processing unit 12 also distributes the event distributed to the application processing unit 13 to the estimation processing unit 15.
  • the event includes window operations (window generation, window selection, window position change, window display area change, window end, etc.).
  • the distribution of the window operation to the estimation processing unit 15 may be performed from the system processing unit 12 as illustrated in FIG. 2 or may be performed by the application processing unit 13 described later.
  • the application processing unit 13 executes processing of a plurality of applications according to the event output from the system processing unit 12.
  • the plurality of applications include an application for processing locally recorded content and an application for processing content obtained from the outside.
  • An example of an application that processes content obtained from the outside is a Web browser.
  • the Web browser is software that is used when browsing websites and blog sites on the Internet, downloads HTML files, image files, music files, and the like from the Internet, analyzes the layout, and displays / reproduces them.
  • the application processing unit 13 outputs the processing result of the executed application by the output unit 14.
  • the output unit 14 has a function of presenting the processing result by the application processing unit 13 to the user. Specifically, the output unit 14 performs display output, audio output, projection output, and the like.
  • the display output is realized by a display device such as a liquid crystal display (LCD) device and an OLED (Organic Light Emitting Diode) device.
  • LCD liquid crystal display
  • OLED Organic Light Emitting Diode
  • the estimation processing unit 15 performs a process of estimating a mutual relationship between a plurality of applications according to an event for the application. Specifically, as illustrated in FIG. 2, the estimation processing unit 15 functions as a dynamic element analysis unit 151, a static element analysis unit 152, and a competition point calculation unit 153, thereby allowing a plurality of applications to communicate with each other. It is possible to estimate the relationship (competitive relationship / coexistence relationship).
  • the dynamic element analysis unit 151 analyzes a dynamic element of a plurality of applications based on an event for the application.
  • a dynamic element is an element that can change dynamically based on a window operation by a user.
  • the window operation is, for example, an operation for performing window generation (display start), window selection (operation object / line-of-sight movement), window position change, window display area change, window end (display end), and the like.
  • a click operation, a cursor (an example of an operation body) movement operation, a drag and drop operation, a pinch-in / pinch-out operation, and the like are performed.
  • the elements that can be dynamically changed include time parameters such as the window operation time, the display time, and the attention time in addition to the window change described above.
  • the window operation time is measured based on a click operation, scroll operation, flick operation, or the like on the window.
  • the window display time is measured from the time when the display start event occurs until the time when the display end event occurs. Further, as the parallel time of windows, the time during which the first window and the second window are displayed in parallel in time (at the same time) can also be measured.
  • the attention time of the window can be measured when the user's line of sight faces the window.
  • the dynamic element analysis unit 151 analyzes dynamic elements of a plurality of applications and calculates dynamic element points.
  • FIG. 3 shows an example of a dynamic element scoring table used when calculating dynamic element points.
  • the dynamic element score table 171 is stored in the score table storage unit 17.
  • the allocation of each dynamic element point will be described in detail in the dynamic element allocation operation process described later.
  • Each element point and analysis content shown in FIG. 3 are examples, and are not necessarily limited to the example shown in FIG.
  • the static element analysis unit 152 analyzes static elements of a plurality of applications based on events for the applications.
  • a static element is an element that cannot be changed by a user operation.
  • the static element analysis unit 152 analyzes static elements of a plurality of applications and calculates static element points (basic points).
  • FIG. 4 shows an example of a static element stipulation table used when calculating static element points.
  • the static element score table 172 is stored in the score table storage unit 17.
  • the competition point calculation unit 153 calculates a competition point between a plurality of applications (windows) based on the dynamic element points calculated by the dynamic element analysis unit 151 and the static element analysis unit 152 and the static element points. .
  • the competitive point calculation unit 153 calculates a competitive point by multiplying all static element points and dynamic element points. In the present embodiment, the higher the competitive point, the higher the competitiveness.
  • the estimation processing unit 15 functions as the dynamic element analysis unit 151, the static element analysis unit 152, and the competition point calculation unit 153, so that a relationship between a plurality of applications (here, a competition relationship is taken as an example). ) Can be estimated.
  • the estimation processing unit 15 stores the estimation result in the estimation result storage unit 16. Further, the estimation processing unit 15 may store, in addition to the competition points, static element points, dynamic element points, user operation history, and the like as estimation results in the estimation result storage unit 16.
  • the timing for storing the static element points, dynamic element points, user operation history, and the like in the estimation result storage unit 16 is not particularly limited. For example, each analysis unit (dynamic element analysis unit 151, static element analysis unit) 152) may be stored at any time when analyzed.
  • the estimation result storage unit 16 accumulates the relationship between the plurality of applications estimated by the estimation processing unit 15 as a log for each application.
  • FIG. 5 shows an example of the calculation table 161 of the data value non-input state accumulated in the estimation result storage unit 16.
  • the calculation table 161 includes a first window (own window), a display start / end time, an activation source (launcher / parent window), a comparison target window and its parallel time, a static element point, Dynamic element points and competitive points are recorded and registered.
  • the scoring table 161 shown in FIG. 5 there are eight dynamic element point input fields. However, this is an example, and the input of dynamic element points is not limited to eight. Can be input sequentially.
  • each company grasps other applications that are used in parallel with their own sites (web sites browsed by web browser applications) and dedicated applications (dedicated programs such as games, communication, and navigation). Can do. Specifically, each company must know what website and dedicated application it is used with, and how competitive it is, and use it for improvement and marketing of the website and dedicated application. Can do.
  • the estimation result stored in the estimation result storage unit 16 is transmitted to the server 2 periodically / irregularly, and each company can obtain the estimation result by accessing the server 2. Further, the estimation processing unit 15 may transmit the estimation result to the immediate server 2.
  • the score table storage unit 17 is used when a static element is analyzed by the static element analysis unit 152 and when a dynamic element is analyzed by the dynamic element analysis unit 151.
  • the information processing apparatus 1 may periodically / irregularly acquire the latest static element / dynamic element score table from the server 2 and update the data in the score table storage unit 17 or statically.
  • a static element / dynamic element score table may be acquired from the server 2.
  • the communication unit 18 has a function of connecting to an external device by wireless / wired and transmitting / receiving data.
  • the communication unit 18 can be connected to a wireless AP (access point) via a wireless LAN, infrared rays, Wi-Fi (registered trademark), and the like, and can be connected to a network via the wireless AP.
  • the communication part 18 can acquire the program etc. which comprise the software for performing the objective table data mentioned later, a white / black list, and a series of processes by this embodiment from the server 2 on a network. .
  • the configuration of the information processing apparatus 1 according to the present embodiment has been specifically described above.
  • the information processing apparatus 1 includes a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory, and an interface unit.
  • the RAM is used as a work area for the CPU.
  • a program for the CPU to execute each process is written in the ROM.
  • the server 2 includes a communication unit 21, a purpose table storage unit 22, and a white / black list storage unit 23.
  • the communication unit 21 is connected to the information processing apparatus 1 to transmit and receive data.
  • the purpose table storage unit 22 stores a purpose table for each application that is used as necessary when the static element analysis unit 152 analyzes static elements.
  • the purpose table will be described later with reference to FIG.
  • the white / black list storage unit 23 stores a white / black list for each application used as necessary when the static element analysis unit 152 analyzes static elements.
  • the white list is a table listing dedicated applications and Web sites that are unconditionally excluded from the competition targets for a predetermined application. As a result, for example, websites and dedicated applications of a parent company, a subsidiary, a group company, etc. can be excluded from competing targets.
  • the black list is a table listing dedicated applications and websites that are unconditionally regarded as competing targets for a given application. As a result, for example, websites and dedicated applications of other companies in the same industry can always be handled as competing targets.
  • a text mining process (see FIG. 10 and FIG. 11) described later is performed according to the contents of the EC site.
  • the static element point goes up and down depending on the sales contents.
  • the static element can be analyzed more accurately.
  • the configuration of the server 2 according to the present embodiment has been described above.
  • the server 2 is configured by a microcomputer including a CPU, ROM, RAM, nonvolatile memory, and the like, and the above-described components are controlled.
  • the configurations of the information processing apparatus 1 and the server 2 according to the present embodiment are not limited to the example shown in FIG.
  • the information processing apparatus 1 may have a purpose table storage unit 22 and a white / black list storage unit 23 included in the server 2. In this case, it is possible for the information processing apparatus 1 alone to estimate the relationship between a plurality of applications according to the present embodiment.
  • the information processing apparatus 1 may be realized by a server apparatus. That is, in a relationship estimation system including a user terminal and a server device, the main processing is performed on the server device (information processing device 1) side, and the user terminal uses the input signal (window operation) acquired from the user terminal. Estimate the relationship between multiple applications.
  • the server device includes an estimation processing unit 15, a score table storage unit 17, an estimation result storage unit 16, an objective table storage unit 22, and a white / black list storage unit 23.
  • FIG. 6 is a flowchart showing event type determination processing of the relationship estimation system according to the present embodiment.
  • step S ⁇ b> 103 the input unit 11 of the information processing apparatus 1 receives an operation input by the user and outputs the received input information (input signal) to the system processing unit 12.
  • step S106 the system processing unit 12 distributes an event corresponding to the input information to the application processing unit 13 and the estimation processing unit 15.
  • the estimation processing unit 15 determines the type of the distributed event. Specifically, the estimation processing unit 15 determines whether any of the distributed events is a window display start event, a window position change event, a window display area change event, an operation tool movement event, a line-of-sight movement event, or a display end. Determine if there is. For example, events such as new application activation, unlock from the screen lock state, and return from a state where the display area is zero because all of the windows are hidden behind other windows are classified as a display start event (A).
  • A display start event
  • window position change event B
  • the display area of the window is changed, such as when the display area (size) of the window is changed by a user operation, or when a plurality of windows are overlapped, it is classified as a window display area change event (C).
  • an operation body such as a mouse pointer or a finger moves from one window to the other window by a user operation, it is classified as an operation body movement event (D).
  • D operation body movement event
  • the line-of-sight movement is an event that occurs when the user's line-of-sight tracking is performed using a camera or the like attached to the information processing apparatus 1 that captures the direction of the user's face.
  • an eye movement event does not occur, but other events according to the present embodiment can be mainly generated by an operation input unit such as a mouse, a keyboard, or a touch pad.
  • the estimation processing unit 15 analyzes a dynamic element and a static element for estimating a relationship between a plurality of applications according to the type of distributed event.
  • the analysis of the dynamic element and the static element performed using each event input as a trigger will be specifically described with reference to FIGS.
  • FIG. 7 is a flowchart showing static / dynamic element analysis processing when a display start event occurs.
  • step S110 the estimation processing unit 15 calculates the first window (own window) displayed in response to the occurrence of the display start event and the activation source of the first window from the calculation table. 181 (see FIG. 5), and the display start time is also recorded.
  • the activation source is a caller of a window whose display has been newly started, and corresponds to, for example, a launcher or a parent window.
  • step S113 the estimation processing unit 15 determines whether there is a second window (another window).
  • the second window is one or more windows currently displayed on the display screen in addition to the first window, and is a window that has already been registered in the calculation table 181 and whose display end time has not been determined.
  • step S116 the estimation processing unit 15 sets the second window in the first window, the first window in the second window, Each is added to the calculation table 161 as a window to be compared.
  • step S119 the static element analysis unit 152 analyzes the static elements of the first window and the second window, and records the basic points (static element points) in the calculation table 161.
  • the static element analysis processing will be described below with reference to FIG.
  • FIG. 8 is a flowchart showing the static element analysis processing.
  • the static element analysis unit 152 determines whether or not the first window and the second window (target window) are the same. Specifically, for example, the static element analysis unit 152 determines that the same application or the same domain in the case of a web browser application is the same. Note that different pages on the same Web site are considered identical because the domains match.
  • step S233 the static element analysis unit 152 refers to the static element allocation table 172 (see FIG. 4), and determines the static element point (a ) Is set.
  • the static element point (a) is set to “0.00” or a value close thereto as shown in FIG. 4, for example. This is because the same window is less competitive.
  • step S236 determines whether the target window (second window) is registered in the white list of the first window. Judge whether or not.
  • the white list is a list of dedicated applications and websites that are unconditionally excluded from competition targets.
  • step S239 the static element analysis unit 152 sets the static element point (b) with reference to the static element allocation table 172 (see FIG. 4). To do.
  • the static element point (b) is set to “0.00” as shown in FIG. 4, for example. This is because the window registered in the white list is unlikely to be in a conflict state.
  • the competitive point calculation unit 153 calculates the competitive point by multiplying the static element point and the dynamic element point. Therefore, if the basic point (static element point) is 0.00, the dynamic element point is Regardless of the number, the competition is 0.00.
  • step S242 determines whether the target window (second window) is registered in the black list of the first window. Judge whether or not.
  • the black list is a list of dedicated applications and websites that are unconditionally regarded as competing targets.
  • step S245 When registered in the black list (S242 / Yes), in step S245, the static element analysis unit 152 sets the static element point (c) with reference to the static element allocation table 172 (see FIG. 4). To do.
  • the static element point (c) is a relatively large value such as “30.00” as shown in FIG. This is because windows registered in the black list are always in a conflict state.
  • the static element analysis unit 152 determines whether the first and second windows are windows capable of text mining. Determine whether. For example, the static element analysis unit 152 determines that text mining is possible if the window is a Web site displayed by a Web browser application, and determines that text mining is not possible if the window is a dedicated application.
  • the static element analysis unit 152 performs the first and second windows. It is determined whether or not both windows are described in the objective table.
  • the purpose table is a table in which the purpose of use of each window (dedicated application, Web site) is listed. The purpose of use may be a purpose from the standpoint of the user or a purpose from the standpoint of the management side.
  • FIG. 9 shows an example of the purpose table.
  • the purpose table 221 is stored in the purpose table storage unit 22 of the server 2, for example.
  • the information processing apparatus 1 accesses the server 2 as necessary, and refers to the purpose table 221 stored in the purpose table storage unit 22. .
  • the purpose table 221 includes the type of each window (whether it is a dedicated application or a website), a title, and a purpose.
  • the purpose of each window is described as communication, game / killing time, purchasing, traffic search, media viewing, news browsing, auction, price survey.
  • step S263 the static element analysis unit 152 determines whether or not the purposes of both windows match.
  • step S266 the static element analysis unit 152 refers to the static element allocation table 172 and sets a static element point (d).
  • the static element point (d) is “15.00” as shown in FIG.
  • the static element point (d) is not as large as the static element point (c), but is set to a large value. This is because windows with the same purpose are highly competitive.
  • the static element analysis unit 152 in step S269, 172, the static element point (e) is set.
  • the static element point (e) is, for example, “5.00” as shown in FIG.
  • the static element point (e) is set to a relatively small value. This is because windows that do not match the purpose are less competitive.
  • step S254 the static element analysis unit 152 performs a common element calculation process by text mining.
  • text mining it is possible to calculate static element points with higher accuracy by using a character string constituting a Web site as a reference.
  • the common element calculation process by text mining will be described with reference to FIGS.
  • FIG. 10 is a diagram showing an example of a display screen on which a text minable window is displayed.
  • the static element analysis unit 152 applies the character string of each window. Text mining is performed using a general algorithm such as morphological analysis.
  • FIG. 11 is a diagram showing a totaling result of words extracted by text mining.
  • the total result of the words extracted from the window of the purchase site 31 is shown as “data1”
  • the total result of the words extracted from the window of the purchase site 32 is shown as “data2”.
  • the static element analysis unit 152 performs processing such as counting the number of matched words based on the total result of the words extracted from each window, and quantifies the closeness, thereby approximating the degree of approximation of the two windows. (Common element) can be calculated. In the example shown in FIG. 11, the number of appearances of words is simply counted, but other general algorithms in the text mining field can be applied.
  • step S257 the static element analysis unit 152 uses the calculated number of matching words to calculate “static element score (f) ⁇ number of matching words in the static element score table 172” as the static element point.
  • the static element point (f) is, for example, “1.00” as shown in FIG. This is because as the character strings constituting the Web site match, the competitiveness is higher.
  • step S122 the estimation processing unit 15 determines whether or not the activation source of the first window is a launcher.
  • the activation source is a launcher (S122 / Yes)
  • step S125 the dynamic element analysis unit 151 adds a dynamic element point to the parent window in the target window registered as a comparison target in the calculation table 161.
  • Add (a) The dynamic element point (a) is set to “0.50” as shown in FIG. 3, for example, and is set lower than 1.0. This is because the parent window viewed from the first window is an activation source, and thus the competition is low.
  • step S128 the dynamic element analysis unit 151 determines whether there is another sibling-related window (second window) having the same parent window in the comparison target window of the first window. to decide.
  • step S131 the dynamic element analysis unit 151 causes the target window (the same parent in the comparison target of the first window in the calculation table 161).
  • a dynamic element point (b) is added to a second window having a window.
  • the dynamic element analysis unit 151 also adds the dynamic element point (b) to the first window registered in the comparison target of the target window in the calculation table 161.
  • the dynamic element point (b) is set to “1.51” as shown in FIG. 3, for example.
  • the case where there is a second window having the same parent window is, for example, a case where a plurality of windows are opened from a search result of a predetermined keyword by a search engine (search site), and the plurality of windows are not competitive. This is because it is expensive.
  • FIG. 12 is a flowchart showing a dynamic element analysis process when a window position change event occurs.
  • step S140 the dynamic element analysis unit 151 determines whether there is a second window closer to the center of the screen than the first window.
  • step S143 the dynamic element analysis unit 151 adds the dynamic element point (c) to the target window in the comparison target of the first window in the calculation table 161.
  • Add The dynamic element point (c) is set to “1.21” as shown in FIG. 3, for example. This is because when the first window is moved to the screen edge, the second window located at the center of the screen is more competitive than the first window.
  • FIG. 13 is a flowchart showing a dynamic element analysis process when a window display area change event occurs.
  • step S150 the dynamic element analysis unit 151 determines whether or not the display area of the first window has decreased.
  • step S153 the dynamic element analysis unit 151 determines whether or not the cause of the decrease in the display area is covered by the second window. to decide.
  • the second window is superimposed and displayed in front of the first window, the overlapped portion is hidden, so the display area of the first window is reduced.
  • step S156 the dynamic element analysis unit 151 changes the display area of the first window before the display area change. Divide by the subsequent area to calculate the area change rate. For example, when the area of the half of the first window is covered with the second window and the area becomes small, the area change rate is 2.0. When the area after the change becomes 0, it is handled not as “window display area change event (C)” but as “display end event (F)”, so this sequence is not reached.
  • step S159 the dynamic element analysis unit 151 uses the calculated area change rate to calculate the target window (the first window covering the first window) within the comparison target of the first window in the calculation table 161. 2), “dynamic element point (d) ⁇ area change rate” is added.
  • the dynamic element point (d) is set to “1.23” as shown in FIG. 3, for example. This is because as the area covered by the second window is larger (the area change rate is higher), the competitiveness is higher.
  • the dynamic element analysis unit 151 can determine that the first window has been resized by the user operation alone ( S153 / Yes).
  • step S162 the dynamic element analysis unit 151 determines whether or not there is a second window having a larger display area than the first window. to decide.
  • step S165 the dynamic element analysis unit 151 displays the target window (the display area from the first window) within the comparison target of the first window in the calculation table 161.
  • the dynamic element point (e) is added to the second window having a large.
  • the dynamic element point (e) is set to “1.25” as shown in FIG. 3, for example. This is because the second window having a size larger than the first window when the first window is resized to a small size is highly competitive.
  • FIG. 14 is a flowchart showing a dynamic element analysis process when an operation tool movement event occurs.
  • step S170 the dynamic element analysis unit 151 determines whether or not the operating body has moved to the first window (whether or not the first window has become an operation target). To do.
  • step S173 the dynamic element analysis unit 151 determines whether or not the second window (another window) exists.
  • step S176 the dynamic element analysis unit 151 has been operated by the operating body immediately before the operating body moves to the first window. It is determined whether or not the second window (which was the operation target) exists.
  • step S179 the dynamic element analysis unit 151 causes the target window (the second window that has been operated immediately before) to be calculated in the calculation table 161.
  • the dynamic element point (f) is added to the first window within the comparison target of the window.
  • the dynamic element point (f) is, for example, “1.05” as shown in FIG. This is because when the user moves the operating tool from the target window to the first window, it can be said that the first window with respect to the target window is highly competitive.
  • FIG. 15 is a flowchart showing a dynamic element analysis process when a line-of-sight movement event occurs.
  • step S180 the dynamic element analysis unit 151 determines whether or not the line of sight is directed to the first window (whether or not the first window is a target of attention).
  • step S183 the dynamic element analysis unit 151 determines whether or not the second window (another window) exists.
  • step S186 the dynamic element analysis unit 151 is directed to the line of sight just before the line of sight is directed to the first window (attention) It is determined whether the second window (which was the subject) exists.
  • step S189 the dynamic element analysis unit 151 causes the target window (the line of sight to be directed immediately before) in the calculation table 161.
  • the dynamic element point (g) is added to the first window in the comparison target of the second window).
  • the dynamic element point (g) is, for example, “1.06” as shown in FIG. This is because when the user moves his / her line of sight from the target window to the first window, it can be said that the first window with respect to the target window is highly competitive.
  • FIG. 16 is a flowchart showing a dynamic element analysis process when a display end event occurs.
  • step S190 the dynamic element analysis unit 151 records the display end time of the first window in the calculation table 161.
  • step S193 it is determined whether or not there is a second window whose display time overlaps with the first window and whose display end time is fixed.
  • step S196 the dynamic element analysis unit 151 sets a predetermined window as a target window in the comparison target of the first window in the calculation table 161. Add element point of. Specifically, the dynamic element analysis unit 151 adds “dynamic element point (h) ⁇ parallel time”.
  • the parallel time means that two windows derived from the display start time and the display end time of the first window and the target window were displayed in parallel in time (they existed at the same time). It's time. ⁇ Represents power.
  • the dynamic element point (h) is set to “1.10” as shown in FIG. 3, for example. The first window and the target window were displayed in parallel in time, but the first window was displayed longer, so the target window for the first window is in a competitive state. This is because the competitiveness of things is not so high.
  • step S199 the dynamic element analysis unit 151 compares the target window (the second window whose display time overlaps with the first window and whose display end time is fixed) in the calculation table 161. Add "dynamic element point (i) ⁇ parallel time" to the first window.
  • the dynamic element point (i) is set to “1.32” as shown in FIG. 3, for example.
  • the dynamic element point (i) is set to a larger value than the dynamic element point (h). This is because the target window that existed in parallel in time is the first window. This is because the self-window for the target window is more competitive when it is terminated earlier.
  • the estimation processing unit 15 records the static element points and the dynamic element points in the calculation table 161 as shown in each flow corresponding to each distribution event, and then uses the calculation table 161 by the competitive point calculation unit 153. By calculating the competitive point, it is possible to estimate the competitive relationship of a plurality of applications.
  • Example of estimation process >> ⁇ 4-1.
  • FIG. 17 is a diagram illustrating screen transitions until the first purchase site is displayed.
  • the estimation processing unit 15 detects the display start event, and registers the search site 30 (for example, the title “Search WEB”) and the start source (in this case, the launcher) of the search site 30 in the calculation table 161-1. And the display start time are stored.
  • the user inputs “mineral water” in the search field of the search site 30 and executes the search. Then, the link of the purchase site 31 included in the search result list is selected, and the purchase site 31 is opened in a new window as shown on the right side of FIG.
  • the estimation processing unit 15 detects the display start event, and in the calculation table 161-1, the purchase site 31 (for example, the title “ABCD shop”) and the activation source of the purchase site 31 (here, the parent window)
  • the search site 30) is registered and the display start time is stored.
  • the estimation processing unit 15 registers the purchase site 31 (“ABCD shop”), which is the other displayed window, for the search site 30 (“Search WEB”) as a window to be compared in the calculation table 161-1. To do.
  • the estimation processing unit 15 selects the search site 30 (“Search WEB”), which is the other displayed window, for the purchase site 31 (“ABCD shop”) in the calculation table 161-1.
  • the static element analysis unit 152 of the estimation processing unit 15 places static element points on each comparison target window. Specifically, for example, in the calculation table 161-1, the static element analysis unit 152, when the purchase site 31 that is the comparison target for the search site 30 (“Search WEB”) is registered in the white list, As the static element point (b), “0.00 point” is set. Further, when the search site 30 to be compared with the purchase site 31 (“ABCD shop”) is registered in the white list, the static element analysis unit 152 sets “0” as the static element point (b). .00 ”is set.
  • the dynamic element analysis unit 151 of the estimation processing unit 15 places dynamic element points on each comparison target window. Specifically, for example, the dynamic element analysis unit 151 assigns a dynamic element point (a) when the comparison target window is a parent window, and the operation body / line of sight moves between the two windows. When it occurs, dynamic element points (e) and (f) are assigned.
  • FIG. 18 is a diagram showing screen transitions until the second purchase site is displayed and compared. The user finds the second purchase site from the search result list of the search site 30, and opens the purchase site 32 in a new window, as shown on the left side of FIG.
  • the estimation processing unit 15 detects the display start event, and in the calculation table 161-1, the second purchase site 32 (for example, the title “Free Market Site”) and the start source of the purchase site 32 (here, Registration of the search site 30), which is the parent window, and storage of the display start time.
  • the estimation processing unit 15 compares the search site 30 and the first purchase site 31 that are the other displayed windows for the purchase site 32 (“Free Market Site”) in the calculation table 161-1. Register as a window.
  • the second purchase site 32 is added as a comparison target window for each of the search site 30 and the first purchase site 31.
  • the static element analysis unit 152 of the estimation processing unit 15 places static element points on each comparison target window. Specifically, for example, in the calculation table 161-1, the static element analysis unit 152, when the purchase site 32 that is the comparison target for the search site 30 (“Search WEB”) is registered in the white list, As the static element point (b), “0.00 point” is set. In addition, when the search site 30 to be compared with the purchase site 32 (“Free Market Site”) is registered in the white list, the static element analysis unit 152 sets the static element point (b) as “ Set “0.00 points”. In addition, when the purposes of the purchase sites 31 and 32 match, the static element analysis unit 152 sets “15.00 points” as the static element point (d).
  • the dynamic element analysis unit 151 of the estimation processing unit 15 places dynamic element points on each comparison target window.
  • the purchase sites 31 and 32 are sibling-related windows having the same window (search site 30) as a parent. Points (b) “1.51 points” are assigned respectively. Further, for the purchase site 32, the search site 30 among the comparison target windows corresponds to the parent window, so the dynamic element point (a) “0.50 points” is assigned.
  • the user browses the purchase sites 31 and 32 while alternately scrolling and compares the products.
  • the dynamic element analysis unit 151 detects the operating body movement event and the line-of-sight movement event, and the dynamic element point (e) “1.05 points”, ( f) “1.06 points” are assigned.
  • FIG. 19 is a diagram showing screen transitions until the purchase site to be used is determined and the purchase process is completed.
  • the estimation processing unit 15 detects the display end event, and determines the display end time of the purchase site 32 in the calculation table 161-1.
  • the parallel time with other windows that existed in parallel with the purchase site 32 is also determined and registered in the calculation table 161-1.
  • the estimation processing unit 15 detects the display end event, and determines the display end time of the purchase site 31 and the search site 30 in the calculation table 161-1. Further, when the display end times of the purchase site 31 and the search site 30 are determined, the parallel time with other windows that existed in parallel with the purchase site 31 and the search site 30 is also determined, and the calculation table 161- 1 is registered.
  • the dynamic element analysis unit 151 uses the parallel time of the target window with respect to the first window and the dynamic element point (h) to dynamically The element points are calculated and recorded in the calculation table 161-1.
  • the dynamic element analysis unit 151 uses the first window parallel time for the target window and the dynamic element point (i) to dynamically The element points are calculated and recorded in the calculation table 161-1.
  • the competition point calculation unit 153 calculates a competition point between each window and the target window using the calculation table 161-1 illustrated in FIG. .
  • the competing points between a plurality of windows are calculated by multiplying all of the static element points and the dynamic element points, for example.
  • the estimation processing unit 15 can estimate that each window (each Web site) is not a competition target, that is, there is no competition relationship between them.
  • the competition point of the purchase site 32 with respect to the purchase site 31 is calculated as “45.72”, and it is estimated that the purchase site 32 is a competition target. Further, the competition point of the purchase site 31 with respect to the purchase site 32 is calculated as “85.18” as shown in FIG. 20, and it is estimated that the purchase site 31 is a competition target.
  • the competitive points of the purchase site 31 viewed from the purchase site 32 are higher than the competitive points of the purchase site 32 viewed from the purchase site 31.
  • the dynamic factor is that the purchase site 31 is finally used out of the two purchase sites 31 and 32 and the display of the purchase site 32 is terminated first. This is because the points (h) and (i) are reflected.
  • the operator of the purchase site 32 refers to such an estimation result, for example, it can be seen that the purchase site 31 is more competitive among big data including a large number of Web sites browsed by the user. Further, the site operator of the purchase site 32 can take measures by paying attention to the purchase site 31 having high competitiveness.
  • FIGS. 21 to 23 show screen transition diagrams
  • FIG. 24 shows a calculation table 161-2.
  • the information processing apparatus 1 when the information processing apparatus 1 is realized by a PC (person computer), the relationship between a plurality of windows (Web sites) displayed in a multi-window on the display unit is estimated.
  • the information processing apparatus according to the present disclosure when the information processing apparatus according to the present disclosure is realized by a smartphone (high function mobile phone terminal), the relationship between windows displayed on the display unit is estimated.
  • a mobile terminal smart phone, mobile phone, tablet terminal, etc.
  • one window is displayed in full screen, and it is necessary to perform screen transition in order to view other windows.
  • a smartphone that can display a plurality of windows corresponding to a plurality of applications in parallel is newly used.
  • Such a smartphone employs, for example, the display unit 140 formed with an aspect ratio of approximately 3: 1, and each of the plurality of windows has a pixel area of 1: 1 with the same display area height and display area width. It is possible to display in parallel at a ratio (square pixel) (see FIGS. 21 to 23).
  • FIG. 21 is a diagram illustrating screen transitions until a traffic search site is displayed.
  • the traffic search site 41 is a Web site displayed by a Web browser.
  • the estimation processing unit 15 detects the display start event, and in the calculation table 161-2, the traffic search site 41 (for example, the title “Halo! Route information”) and the start source of the traffic search site 41 (here, (Launcher) registration and display start time storage.
  • the user inputs “Station A” in the departure station input field of the traffic search site 41 and “B Station” in the arrival station input field, and taps the search button to start a traffic search from the station A to the station B. .
  • the search button to start a traffic search from the station A to the station B.
  • FIG. 22 is a diagram showing screen transitions until the traffic search application is displayed and the traffic search is similarly started.
  • the user activates a traffic search application 42 that is a dedicated application for traffic search from the launcher 40.
  • the launcher 40, the traffic search site 41, and the traffic search application 42 are displayed side by side in a display area of square pixels.
  • the estimation processing unit 15 detects the display start event, and in the calculation table 161-2, registers the traffic search application 42 (for example, the title “NAVI / NAVI”) and the activation source (here, the launcher), and Store the display start time. Further, the estimation processing unit 15 registers the traffic search site 41, which is the other displayed window, for the traffic search application 42 as a window to be compared in the calculation table 161-2. In the calculation table 161-2, a traffic search application 42 is added as a comparison target window of the traffic search site 41.
  • the traffic search application 42 for example, the title “NAVI / NAVI”
  • the activation source here, the launcher
  • the static element analysis unit 152 of the estimation processing unit 15 places static element points on each comparison target window. Specifically, for example, when the purpose of the traffic search site 41 and the traffic search application 42 match in the calculation table 161-2, the static element analysis unit 152 sets “15. 00 points "is set.
  • the dynamic element analysis unit 151 assigns dynamic element points (e) and (f), respectively, when an operation body / line of sight movement occurs between two windows.
  • the dynamic element analysis unit 151 applies the dynamic element point (c) “1.21” to the traffic search application 42 in the target window of the traffic search site 41 in the calculation table 161-2 (see FIG. 3). Scoring.
  • the user also inputs “A station” in the departure station input field and “B station” in the arrival station input field, taps the search button, and then travels from the A station to the B station. Start the search.
  • FIG. 23 is a diagram showing screen transitions until the application to be used is determined and the traffic search process is completed. As shown in FIG. 23, when the user decides to use the traffic search application 42, the user closes the window of the traffic search site 41 that is no longer necessary, and performs an operation for displaying the traffic search application 42 on the full screen.
  • Each of the screens 42a (menu screen), 42b (route screen), and 42c (map screen) shown in FIG. 23 is a screen of the traffic search application 42.
  • the estimation processing unit 15 detects the display end event, and determines the display end time of the traffic search site 41 in the calculation table 161-2.
  • the parallel time with other windows (traffic search application 42) that existed in parallel with the traffic search site 41 is also determined, and the calculation table 161- 2 is registered.
  • the estimation processing unit 15 detects the display end event, and determines the display end time of the traffic search application 42 in the calculation table 161-2.
  • the dynamic element analysis unit 151 since the traffic search application 42 has existed for a longer time, the dynamic element analysis unit 151 has a parallel time of the target window (traffic search site 41) with respect to the traffic search application 42 and a dynamic element point (h). The dynamic element point is calculated using and is recorded in the calculation table 161-2. In addition, when the traffic search application 42 has existed for a longer time, the dynamic element analysis unit 151 determines the parallel time of the traffic search application 42 for the target window (traffic search site 41) and the dynamic element point (i ) To calculate the dynamic element point and record it in the calculation table 161-2.
  • the competition point calculation unit 153 calculates a competition point between each window and the target window using the calculation table 161-2 shown in FIG. .
  • the competing points between a plurality of windows are calculated by multiplying all of the static element points and the dynamic element points, for example.
  • the competition point of the traffic search application 42 with respect to the traffic search site 41 is calculated as “86.59” as shown in FIG. 24, and it is estimated that the traffic search application 42 is a competition target. Further, the competition point of the traffic search site 41 with respect to the traffic search application 42 is calculated as “18.15” as shown in FIG. 24, and it is estimated that the traffic search site 41 is a competition target.
  • the competition point of the traffic search application 42 viewed from the traffic search site 41 is higher than the competition point of the traffic search site 41 viewed from the traffic search application 42. Yes. As described with reference to FIG. 22 and FIG. 23, this is because the traffic search application 42 is finally used out of the two applications, and the traffic search site 41 is displayed first. This is because the element points (h) and (i) are reflected.
  • this embodiment it is possible to estimate the relationship between a plurality of applications displayed in parallel on the smartphone.
  • FIG. 25 is a diagram for explaining a case where a less relevant web site and a dedicated application are used. As shown in the upper part of FIG. 25, the user starts the news site 45 and browses the news as shown in the lower part of FIG. 25 while activating the music player application 44 and listening to music.
  • the static element point (e) “5.00” is assigned.
  • the score is lower than the static element point (d) “15.00” when the purposes match.
  • both windows are displayed in parallel in time over a long period of time, and even if the dynamic element point is high, the calculated competitive point is not so high.
  • the estimation processing unit 15 calculates a lower competitive point for the competitive relationship between the music player application 44 and the news site 45 than when both windows have the same purpose.
  • the competition point is set to 0.00 by adding the music player application to the white list.
  • the potential needs are taken from the user behavior that “news sites are often viewed while listening to music”, and BGM and music playback functions are also added to the news site 45 to improve the ability to attract customers It is possible to take measures such as
  • the information processing apparatus 100 used in the above embodiment can display a plurality of windows corresponding to a plurality of applications in parallel, and can also divide a single application into a plurality of displays. The relationship estimation between a plurality of windows in this case will be described below with reference to FIG.
  • FIG. 26 is a screen transition diagram for explaining a case where the same application is divided and displayed.
  • the user browses the news by displaying the news site 46 on the display unit 140 of the information processing apparatus 100 as shown on the left in FIG.
  • the news site 46 is a Web site acquired and displayed from the outside by a Web browser.
  • Users can browse news while scrolling through news sites.
  • the user can continue scrolling the article while reproducing the moving image on another screen.
  • the user operates to display the same news site in a plurality of windows, and in the window of the news site 46b, scrolls to the portion where the video is displayed and plays the video. Start.
  • the convenience of the information processing apparatus 100 is further improved by displaying and browsing the same news site 46 in a plurality of windows (news sites 46a and 46b).
  • the static element analysis unit 152 of the estimation processing unit 15 considers the same window based on the domain of the Web site displayed in both windows. When it is determined that they are the same window, as shown in FIG. 4, since “0.00” or a value close thereto is assigned as the static element point (a), the competition between the same windows is high. It can prevent being calculated.
  • FIG. 27 a description will be given using the information processing apparatus 100 that can display a plurality of windows corresponding to a plurality of applications in parallel on the display unit 140.
  • FIG. 27 is a diagram for explaining a case where a plurality of news sites are browsed side by side. If the news site is not listed in the purpose table or the white / black list, the static element analysis unit 152 performs text mining to calculate the approximate degree of the two windows.
  • each news site since the contents of each news site are composed of character strings that change according to daily news, the result of static element analysis by text mining also changes daily.
  • news sites 47A and 48A on a certain day both of them are mainly disaster-related news headlines, so the number of matching words calculated by text mining increases, and static element points
  • the score according to (f) also increases.
  • the news sites 47B and 48B on different days mainly have headlines for disaster-related news on the one hand and Olympic-related news on the other hand, and therefore match words calculated by text mining. The number is reduced, and the score by the static element point (f) is also lowered.
  • the target application is registered in the black list. This makes it possible to give a relatively high score as a static element point as a fixed point (see the static element point (c) shown in FIG. 4).
  • the static element points of news sites that change daily can be stabilized by using the black list.
  • FIG. 28 is a diagram for explaining a case where a plurality of websites with different purposes are browsed side by side. As shown in FIG. 28, on the display unit 140, the EC site 49 and the auction application 50 are displayed side by side.
  • the static element analysis unit 152 analyzes the static element of each window according to the purpose table (see FIG. 6), the purpose of the EC site 49 is “purchase” and the purpose of the auction application 50 is “auction”. Because the purpose of both does not match, it is analyzed that the competitiveness is low. However, in reality, even if there is a competitive relationship in which the same product is compared with the EC site 49 and the auction application 50 and is considered to be purchased, if the purpose is different and it is estimated that the competitiveness is low, There is a risk of being buried in a Web site or a dedicated application.
  • the target application is registered in the black list. This makes it possible to give a relatively high score as a static element point as a fixed point (see the static element point (c) shown in FIG. 4).
  • FIG. 29 is a diagram for explaining a case where two websites of the same group company are browsed side by side. As shown in FIG. 29, on the display unit 140, the EC site 51 and the EC site 52 are displayed side by side.
  • the EC site 51 and the EC site 52 are both windows for the purpose of “purchasing a dedicated application” and have high competitiveness.
  • the operator of the EC site 51 that refers to the estimation result for example, if the EC site 52 picked up as a competing site belongs to its own group company, eliminates duplication of websites, etc. Efficiency measures can be taken.
  • the relationship estimation system can analyze what applications the user is using at the same time, and can estimate the relationship among a plurality of applications being used.
  • the creator and operator of each application can grasp the potential needs of consumers by referring to the estimation results.
  • the relationship can be estimated more accurately.
  • a black / white list, a purpose table, a static element score table used for static element analysis, and a dynamic element score table used for dynamic element analysis are appropriately stored on the website operator. By updating it according to the intention and necessity of the side, it is possible to obtain a relationship estimation result tailored to the purpose.
  • the competitive relationship of multiple applications is estimated (competitive points are calculated), but this embodiment is not limited to this, and the coexistence relationship of multiple applications and the affinity It is also possible to estimate the height.
  • the information processing apparatuses 1 and 100 are not limited to the notebook PC illustrated in FIG. 1 or the smartphone illustrated in FIG. 21, but are a desktop PC, a mobile terminal, or a wearable device (for example, glasses-type HMD, watch-type Device).
  • a computer-readable storage medium storing the computer program is also provided.
  • this technique can also take the following structures.
  • An input unit that accepts external operation inputs;
  • a system processing unit for outputting an event to a plurality of specific applications in accordance with an input signal received by the input unit;
  • an application processing unit that executes processing of a plurality of applications,
  • an estimation unit that estimates a mutual relationship between the plurality of applications,
  • An information processing apparatus comprising: (2) The information processing apparatus according to (1), wherein the estimation unit estimates a mutual relationship between the plurality of applications according to a window operation with respect to the plurality of applications.
  • the information processing apparatus further includes a line-of-sight detection unit, The estimation unit estimates a mutual relationship between the plurality of applications according to the line-of-sight information detected by the line-of-sight detection unit input via the system processing unit. ).
  • the first application processes locally recorded content, and the second application processes content acquired from the outside, any one of (1) to (3)
  • the information processing apparatus includes: The information processing apparatus according to any one of (1) to (4), further including an accumulation unit that accumulates the relationship estimated by the estimation unit as a log for each application.
  • the information processing apparatus according to any one of (1) to (5), wherein the estimation unit estimates that the plurality of applications have a competition relationship or a coexistence relationship with each other.
  • the estimation unit analyzes at least one of a static element and a dynamic element of a plurality of windows corresponding to the plurality of applications according to the event, and estimates a mutual relationship between the plurality of applications.
  • the information processing apparatus according to any one of (1) to (6).
  • the elements that can be changed by the window operation include at least one of a window display position, a display area change, an operation target / attention target change, and a window operation time, attention time, and display time. ).
  • Computer An input unit that accepts external operation inputs; A system processing unit for outputting an event to a plurality of specific applications in accordance with an input signal received by the input unit; In response to an event output from the system processing unit, an application processing unit that executes processing of a plurality of applications, In response to the event, an estimation unit that estimates a mutual relationship between the plurality of applications, A storage medium storing a program that functions as a computer. (12) A step of accepting an operation input from the outside; Outputting an event to a plurality of specific applications according to the received input signal; Executing a plurality of application processes in response to the output event; In response to the event, estimating a mutual relationship between the plurality of applications; Including a control method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Operations Research (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

[Problem] To provide an information processing device, a storage medium, and a control method, with which the relationship between a plurality of applications can be estimated. [Solution] This information processing device is provided with: an input unit which receives an operation input from an external unit; a system processing unit which outputs an event to a plurality of specific applications in accordance with an input signal received by the input unit; an application processing unit which executes, in accordance with the event outputted from the system processing unit, processing related to the plurality of applications; and an estimation unit which estimates a relationship between each of the plurality of applications in accordance with the event.

Description

情報処理装置、記憶媒体、および制御方法Information processing apparatus, storage medium, and control method
 本開示は、情報処理装置、記憶媒体、および制御方法に関する。 This disclosure relates to an information processing device, a storage medium, and a control method.
 通常、PC(パーソナルコンピュータ)において、複数のウィンドウが重ねて表示されるいわゆるマルチウィンドウ表示が実用化されている。例えば、第1のウィンドウと第2のウィンドウが一部重畳して表示画面に表示されている際、第1のウィンドウを選択すると、第1のウィンドウが優先的(前面)に表示され、第2のウィンドウは、第1のウィンドウと重畳していない部分が見えている状態となる。一方、第2のウィンドウを選択すると、第2のウィンドウが優先的(前面)に表示され、第1のウィンドウの一部は第2のウィンドウにより隠れた状態となる。ユーザは、複数のウィンドウを交互に見ながら、作業を行うことができる。 Usually, in a PC (personal computer), a so-called multi-window display in which a plurality of windows are displayed in a superimposed manner is put into practical use. For example, when the first window and the second window are partially overlapped and displayed on the display screen, if the first window is selected, the first window is displayed preferentially (front), and the second window This window is in a state where a portion that does not overlap with the first window is visible. On the other hand, when the second window is selected, the second window is displayed preferentially (in front), and a part of the first window is hidden by the second window. The user can perform work while viewing a plurality of windows alternately.
 このようなマルチウィンドウの表示制御に関し、下記特許文献1では、複数のウィンドウを同時に表示させる方法が提案されている。具体的には、第1および第2のウィンドウが重複する部分で、後方にあるウィンドウの表示情報を前面のウィンドウの表示情報よりも薄く表示させることで、両ウィンドウの表示情報を視認可能にしている。 Regarding such multi-window display control, Patent Document 1 below proposes a method of simultaneously displaying a plurality of windows. Specifically, the display information of the two windows is displayed in a portion where the first and second windows overlap so that the display information of the rear window is lighter than the display information of the front window. Yes.
特開平8-123652号公報Japanese Patent Laid-Open No. 8-123365
 しかしながら、上記特許文献1は、マルチウィンドウの表示方法や管理に関する技術であって、各ウィンドウ間の関係を推定することについては何ら言及されていない。 However, the above-mentioned Patent Document 1 is a technique related to a multi-window display method and management, and does not mention anything about estimating the relationship between the windows.
 そこで、本開示では、複数のアプリケーションの関係を推定することが可能な情報処理装置、記憶媒体、および制御方法を提案する。 Therefore, the present disclosure proposes an information processing apparatus, a storage medium, and a control method that can estimate the relationship between a plurality of applications.
 本開示によれば、外部からの操作入力を受け付ける入力部と、前記入力部により受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するシステム処理部と、前記システム処理部から出力されたイベントに応じて、複数のアプリケーションの処理を実行するアプリケーション処理部と、前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定する推定部と、を備える、情報処理装置を提案する。 According to the present disclosure, an input unit that receives an operation input from the outside, a system processing unit that outputs an event to a plurality of specific applications according to an input signal received by the input unit, and an output from the system processing unit Proposed is an information processing apparatus comprising: an application processing unit that executes processing of a plurality of applications according to an event; and an estimation unit that estimates a mutual relationship between the plurality of applications according to the event .
 本開示によれば、コンピュータを、外部からの操作入力を受け付ける入力部と、前記入力部により受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するシステム処理部と、前記システム処理部から出力されたイベントに応じて、複数のアプリケーションの処理を実行するアプリケーション処理部と、前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定する推定部と、として機能させるプログラムが記憶された、記憶媒体を提案する。 According to the present disclosure, the computer includes an input unit that receives an operation input from the outside, a system processing unit that outputs an event to a plurality of specific applications according to an input signal received by the input unit, and the system processing unit A program that functions as an application processing unit that executes processing of a plurality of applications in response to an event output from and an estimation unit that estimates a mutual relationship between the plurality of applications in accordance with the event is stored. Proposed storage media.
 本開示によれば、外部からの操作入力を受け付けるステップと、受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するステップと、前記出力されたイベントに応じて、複数のアプリケーションの処理を実行するステップと、前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定するステップと、を含む、制御方法を提案する。 According to the present disclosure, a step of receiving an operation input from the outside, a step of outputting an event to a plurality of specific applications according to the received input signal, and a process of the plurality of applications according to the output event And a step of estimating a mutual relationship between the plurality of applications in response to the event.
 以上説明したように本開示によれば、複数のアプリケーションの関係を推定することが可能となる。 As described above, according to the present disclosure, it is possible to estimate the relationship between a plurality of applications.
 なお、上記の効果は必ずしも限定的なものではなく、上記の効果とともに、または上記の効果に代えて、本明細書に示されたいずれかの効果、または本明細書から把握され得る他の効果が奏されてもよい。 Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.
本開示の一実施形態による関係推定システムの概要について説明するための図である。It is a figure for demonstrating the outline | summary of the relationship estimation system by one Embodiment of this indication. 本実施形態による情報処理装置およびサーバの基本構成を示す図である。It is a figure which shows the basic composition of the information processing apparatus and server by this embodiment. 本実施形態による動的要素点を算出する際に用いられる動的要素の配点表の一例を示す図である。It is a figure which shows an example of the dynamic element score table used when calculating the dynamic element point by this embodiment. 本実施形態による静的要素点を算出する際に用いられる静的要素の配点表の一例を示す図である。It is a figure which shows an example of the static element stipulation table used when calculating the static element point by this embodiment. 本実施形態による推定結果記憶部に記憶される、データ値未入力状態の算出表の一例を示す図である。It is a figure which shows an example of the calculation table of the data value non-input state memorize | stored in the estimation result memory | storage part by this embodiment. 本実施形態による関係推定システムのイベント種別判断処理を示すフローチャートである。It is a flowchart which shows the event classification judgment process of the relationship estimation system by this embodiment. 本実施形態による表示開始イベント発生時の静的・動的要素解析処理を示すフローチャートである。It is a flowchart which shows the static and dynamic element analysis process at the time of the display start event generation by this embodiment. 本実施形態による静的要素の解析処理を示すフローチャートである。It is a flowchart which shows the analysis process of the static element by this embodiment. 本実施形態による目的表の一例を示す図である。It is a figure which shows an example of the objective table by this embodiment. テキストマイニング可能なウィンドウが表示されている表示画面の一例を示す図である。It is a figure which shows an example of the display screen on which the window which can be text mined is displayed. テキストマイニングにより抽出された単語の集計結果を示す図である。It is a figure which shows the total result of the word extracted by text mining. 本実施形態によるウィンドウ位置変更イベント発生時の動的要素解析処理を示すフローチャートである。It is a flowchart which shows the dynamic element analysis process at the time of window position change event generation by this embodiment. 本実施形態によるウィンドウの表示面積変更イベント発生時の動的要素解析処理を示すフローチャートである。It is a flowchart which shows the dynamic element analysis process at the time of the display area change event of the window by this embodiment. 本実施形態による操作体移動イベント発生時の動的要素解析処理を示すフローチャートである。It is a flowchart which shows the dynamic element analysis process at the time of the operating body movement event by this embodiment. 本実施形態による視線移動イベント発生時の動的要素解析処理を示すフローチャートである。It is a flowchart which shows the dynamic element analysis process at the time of the eyes | visual_axis movement event by this embodiment. 本実施形態による表示終了イベント発生時の動的要素解析処理を示すフローチャートである。It is a flowchart which shows the dynamic element analysis process at the time of the display end event generation by this embodiment. 第1の購入サイトを表示させるまでの画面遷移図である。It is a screen transition figure until it displays a 1st purchase site. 第2の購入サイトを表示させて比較するまでの画面遷移図である。It is a screen transition diagram until a 2nd purchase site is displayed and compared. 利用する購入サイトを決定し、購入処理が終了するまでの画面遷移図である。It is a screen transition diagram until a purchase site to be used is determined and purchase processing is completed. 複数のWebサイトを利用した場合の推定処理で利用される算出表の一例を示す図である。It is a figure which shows an example of the calculation table utilized by the estimation process at the time of using a some web site. 交通探索サイトを表示させるまでの画面遷移図である。It is a screen transition diagram until a traffic search site is displayed. 交通探索アプリケーションを表示させて同様に交通探索を開始するまでの画面遷移図である。It is a screen transition figure until it displays a traffic search application and similarly starts a traffic search. 利用するアプリケーションを決定し、交通探索処理が終了するまでの画面遷移図である。It is a screen transition diagram until the application to be used is determined and the traffic search process ends. Webサイトと専用アプリケーションを利用した場合の推定処理で利用される算出表の一例を示す図である。It is a figure which shows an example of the calculation table utilized by the estimation process at the time of utilizing a website and a dedicated application. 関連性の低いWebサイトと専用アプリケーションを利用した場合について説明するための図である。It is a figure for demonstrating the case where a low-relevance Web site and a dedicated application are used. 同じアプリケーションを分割表示した場合について説明するための画面遷移図である。It is a screen transition diagram for demonstrating the case where the same application is divided and displayed. 複数のニュースサイトを並べて閲覧している場合について説明するための図である。It is a figure for demonstrating the case where the several news site is browsed side by side. 目的が異なる複数のWebサイトを並べて閲覧している場合について説明するための図である。It is a figure for demonstrating the case where the some web site from which the objective differs is browsed side by side. 同じグループ会社の2つのWebサイトを並べて閲覧している場合について説明するための図である。It is a figure for demonstrating the case where two Web sites of the same group company are browsed side by side.
 以下に添付図面を参照しながら、本開示の好適な実施の形態について詳細に説明する。なお、本明細書及び図面において、実質的に同一の機能構成を有する構成要素については、同一の符号を付することにより重複説明を省略する。 Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.
 また、説明は以下の順序で行うものとする。
 1.本開示の一実施形態による関係推定システムの概要
 2.基本構成
  2-1.情報処理装置の構成
  2-2.サーバの構成
 3.動作処理
  3-1.表示開始イベント時の静的・動的要素解析処理
  3-2.ウィンドウ位置変更イベント時の動的要素解析処理
  3-3.ウィンドウの表示面積変更イベント時の動的要素解析処理
  3-4.操作体移動イベント時の動的要素解析処理
  3-5.視線移動イベント時の動的要素解析処理
  3-6.表示終了イベント時の動的要素解析処理
 4.推定処理の実施例
  4-1.Webサイトを2つ利用した場合の推定処理
  4-2.Webサイトと専用アプリケーションを利用した場合の推定処理
  4-3.同じアプリケーションを分割表示した場合の推定処理
  4-4.推定処理の安定化
 5.まとめ
The description will be made in the following order.
1. 1. Overview of relationship estimation system according to an embodiment of the present disclosure Basic configuration 2-1. Configuration of information processing apparatus 2-2. 2. Server configuration Operation processing 3-1. Static / dynamic element analysis processing at display start event 3-2. Dynamic element analysis processing at window position change event 3-3. Dynamic element analysis processing at window display area change event 3-4. Dynamic element analysis processing at operation object movement event 3-5. Dynamic element analysis process during eye movement event 3-6. 3. Dynamic element analysis processing at display end event Example of estimation process 4-1. Estimation process when two websites are used 4-2. Estimating process when using website and dedicated application 4-3. Estimation process when the same application is divided and displayed 4-4. 4. Stabilization of estimation processing Summary
  <<1.本開示の一実施形態による関係推定システムの概要>>
 まず、本開示の一実施形態による関係推定システムの概要について図1を参照して説明する。図1に示すように、本実施形態による関係推定システムは、情報処理装置1およびサーバ2を含む。情報処理装置1は、ネットワーク3を介してサーバ2と接続される。なお情報処理装置1は、必ずしもネットワーク3を介さなくてもよく、無線/有線によりサーバ2と直接接続してもよい。
<< 1. Overview of Relationship Estimation System According to One Embodiment of Present Disclosure >>
First, an overview of a relationship estimation system according to an embodiment of the present disclosure will be described with reference to FIG. As shown in FIG. 1, the relationship estimation system according to the present embodiment includes an information processing device 1 and a server 2. The information processing apparatus 1 is connected to the server 2 via the network 3. The information processing apparatus 1 does not necessarily have to go through the network 3 and may be directly connected to the server 2 by wireless / wired.
 また、情報処理装置1は、表示部(出力部14の一例)およびキーボード(入力部11の一例)を有する。表示部では、複数のアプリケーションが実行され、マルチウィンドウ表示が行われる。ユーザは、例えば複数のWebブラウザを表示させ、複数のショッピングサイトを同時に閲覧しながら比較検討することができる。 In addition, the information processing apparatus 1 includes a display unit (an example of the output unit 14) and a keyboard (an example of the input unit 11). In the display unit, a plurality of applications are executed, and multi-window display is performed. For example, the user can display a plurality of Web browsers and perform comparison while browsing a plurality of shopping sites simultaneously.
  (背景)
 ここで、マルチウィンドウの表示に関して従来提案されている技術は、マルチウィンドウの表示方法や管理に関するものであって、各ウィンドウ間の関係を推定することについては何ら言及されていない。
(background)
Here, the technique conventionally proposed regarding the display of the multi-window relates to the display method and management of the multi-window, and there is no mention of estimating the relationship between the windows.
 しかしながら、ユーザがどのようなアプリケーションを同時に利用しているかを分析し、複数アプリケーションの関係を推定することができれば、潜在的なニーズを把握することが可能である。 However, if it is possible to analyze what applications the user is using at the same time and estimate the relationship between multiple applications, it is possible to grasp potential needs.
 そこで、本実施形態では、複数のアプリケーションの関係を推定する関係推定システムを提案する。 Therefore, in this embodiment, a relationship estimation system for estimating the relationship between a plurality of applications is proposed.
 以上、本開示の一実施形態による関係推定システムの概要について説明した。続いて、本開示による関係推定システムに含まれる情報処理装置1およびサーバ2の構成について図2を参照して説明する。 Heretofore, an overview of the relationship estimation system according to an embodiment of the present disclosure has been described. Next, configurations of the information processing apparatus 1 and the server 2 included in the relationship estimation system according to the present disclosure will be described with reference to FIG.
  <<2.基本構成>>
 図2は、本実施形態による情報処理装置1およびサーバ2の基本構成を示す図である。以下、情報処理装置1およびサーバ2の基本構成について順次説明する。
<< 2. Basic configuration >>
FIG. 2 is a diagram illustrating a basic configuration of the information processing apparatus 1 and the server 2 according to the present embodiment. Hereinafter, the basic configurations of the information processing apparatus 1 and the server 2 will be sequentially described.
  <2-1.情報処理装置の構成>
 図2に示すように、情報処理装置1は、入力部11、システム処理部12、アプリケーション処理部13、出力部14、推定処理部15、推定結果記憶部16、配点表記憶部17、および通信部18を有する。
<2-1. Configuration of information processing apparatus>
As shown in FIG. 2, the information processing apparatus 1 includes an input unit 11, a system processing unit 12, an application processing unit 13, an output unit 14, an estimation processing unit 15, an estimation result storage unit 16, a score table storage unit 17, and a communication. Part 18.
  (入力部)
 入力部11は、外部からの操作入力を受け付ける機能を有する。入力部11は、キーボード、ボタン、スイッチ等の物理的な構造を有する操作入力部の他、接触/近接を検知するタッチパネル、マウスやトラックパッド等のポインティングデバイスにより実現される。また、入力部11は、視線検出が可能なカメラ(視線検出部)や、音声収音が可能なマイクも含まれる。
(Input section)
The input unit 11 has a function of receiving an operation input from the outside. The input unit 11 is realized by an operation input unit having a physical structure such as a keyboard, a button, and a switch, a touch panel that detects contact / proximity, and a pointing device such as a mouse and a track pad. The input unit 11 also includes a camera capable of detecting a line of sight (line of sight detecting unit) and a microphone capable of collecting sound.
 入力部11は、受け付けた入力情報(入力信号)をシステム処理部12に出力する。 The input unit 11 outputs the received input information (input signal) to the system processing unit 12.
  (システム処理部)
 システム処理部12は、入力部11から出力された入力情報(入力信号)に基づいて、マルチウィンドウの描画を制御したり(表示制御)、特定の複数のアプリケーションにイベントを出力(配信)したりする。システム処理部12の機能は、一般的なOS(Operating System)の制御レイヤーにより実現され得る。
(System processing part)
The system processing unit 12 controls multi-window drawing based on input information (input signal) output from the input unit 11 (display control), and outputs (distributes) an event to a plurality of specific applications. To do. The function of the system processing unit 12 can be realized by a control layer of a general OS (Operating System).
 また、本実施形態によるシステム処理部12は、アプリケーション処理部13に配信されるイベントを、推定処理部15にも配信する。当該イベントには、ウィンドウ操作(ウィンドウ生成、ウィンドウ選択、ウィンドウの位置変更、ウィンドウの表示面積変更、ウィンドウ終了等)が含まれる。なおウィンドウ操作の推定処理部15への配信は、図2に示すようにシステム処理部12から行われてもよいし、後述するアプリケーション処理部13により行われてもよい。 Further, the system processing unit 12 according to the present embodiment also distributes the event distributed to the application processing unit 13 to the estimation processing unit 15. The event includes window operations (window generation, window selection, window position change, window display area change, window end, etc.). The distribution of the window operation to the estimation processing unit 15 may be performed from the system processing unit 12 as illustrated in FIG. 2 or may be performed by the application processing unit 13 described later.
  (アプリケーション処理部)
 アプリケーション処理部13は、システム処理部12から出力されたイベントに応じて、複数のアプリケーションの処理を実行する。複数のアプリケーションには、ローカルに記録されたコンテンツを処理するアプリケーションと、外部から所得したコンテンツを処理するアプリケーションが含まれる。外部から所得したコンテンツを処理するアプリケーションとしては、例えばWebブラウザが挙げられる。Webブラウザは、インターネット上のウェブサイト、ブログサイトを閲覧するときに利用され、インターネットからHTMLファイルや画像ファイル、音楽ファイルなどをダウンロードして、レイアウトを解析し、表示・再生するソフトウェアである。
(Application processing part)
The application processing unit 13 executes processing of a plurality of applications according to the event output from the system processing unit 12. The plurality of applications include an application for processing locally recorded content and an application for processing content obtained from the outside. An example of an application that processes content obtained from the outside is a Web browser. The Web browser is software that is used when browsing websites and blog sites on the Internet, downloads HTML files, image files, music files, and the like from the Internet, analyzes the layout, and displays / reproduces them.
 また、アプリケーション処理部13は、実行したアプリケーションによる処理結果を出力部14により出力する。 In addition, the application processing unit 13 outputs the processing result of the executed application by the output unit 14.
  (出力部)
 出力部14は、アプリケーション処理部13による処理結果をユーザに対して提示する機能を有する。具体的には、出力部14は、表示出力や音声出力、投影出力等を行う。表示出力は、例えば、液晶ディスプレイ(LCD)装置およびOLED(Organic Light Emitting Diode)装置などの表示装置により実現される。
(Output part)
The output unit 14 has a function of presenting the processing result by the application processing unit 13 to the user. Specifically, the output unit 14 performs display output, audio output, projection output, and the like. The display output is realized by a display device such as a liquid crystal display (LCD) device and an OLED (Organic Light Emitting Diode) device.
  (推定処理部)
 推定処理部15は、アプリケーションに対するイベントに応じて、複数のアプリケーション同士の互いの関係を推定する処理を行う。具体的には、推定処理部15は、図2に示すように、動的要素解析部151、静的要素解析部152、および競合点算出部153として機能することで、複数のアプリケーション同士の互いの関係(競合関係/共存関係)を推定することが可能である。
(Estimation processing unit)
The estimation processing unit 15 performs a process of estimating a mutual relationship between a plurality of applications according to an event for the application. Specifically, as illustrated in FIG. 2, the estimation processing unit 15 functions as a dynamic element analysis unit 151, a static element analysis unit 152, and a competition point calculation unit 153, thereby allowing a plurality of applications to communicate with each other. It is possible to estimate the relationship (competitive relationship / coexistence relationship).
 動的要素解析部151は、アプリケーションに対するイベントに基づいて、複数のアプリケーションの動的要素を解析する。本明細書において、動的要素とは、ユーザによるウィンドウ操作に基づいて動的に変化し得る要素である。ウィンドウ操作とは、例えばウィンドウ生成(表示開始)、ウィンドウ選択(操作体/視線の移動)、ウィンドウ位置変更、ウィンドウの表示面積変更、ウィンドウ終了(表示終了)等を行うための操作である。具体的には、例えばクリック操作、カーソル(操作体の一例)移動操作、ドラッグ&ドロップ操作、ピンチイン/ピンチアウト操作等により行われる。また、動的に変化し得る要素には、上述したウィンドウの変化の他、ウィンドウの操作時間、表示時間、注目時間といった時間パラメータも含まれる。ウィンドウの操作時間は、ウィンドウに対するクリック操作、スクロール操作、フリック操作等に基づいて計測される。また、ウィンドウの表示時間は、表示開始イベントの発生から表示終了イベントが発生するまでの時間が計測される。また、ウィンドウの並列時間として、第1のウィンドウと第2のウィンドウが時間的に並列して(同時刻に)表示されていた時間も計測され得る。また、ウィンドウの注目時間は、ユーザの視線がウィンドウに向いていた場合に計測され得る。 The dynamic element analysis unit 151 analyzes a dynamic element of a plurality of applications based on an event for the application. In this specification, a dynamic element is an element that can change dynamically based on a window operation by a user. The window operation is, for example, an operation for performing window generation (display start), window selection (operation object / line-of-sight movement), window position change, window display area change, window end (display end), and the like. Specifically, for example, a click operation, a cursor (an example of an operation body) movement operation, a drag and drop operation, a pinch-in / pinch-out operation, and the like are performed. The elements that can be dynamically changed include time parameters such as the window operation time, the display time, and the attention time in addition to the window change described above. The window operation time is measured based on a click operation, scroll operation, flick operation, or the like on the window. The window display time is measured from the time when the display start event occurs until the time when the display end event occurs. Further, as the parallel time of windows, the time during which the first window and the second window are displayed in parallel in time (at the same time) can also be measured. The attention time of the window can be measured when the user's line of sight faces the window.
 動的要素解析部151は、複数のアプリケーションの動的要素を解析して、動的要素点を算出する。ここで、動的要素点を算出する際に用いられる動的要素の配点表の一例を、図3に示す。かかる動的要素配点表171は、配点表記憶部17に格納されている。 The dynamic element analysis unit 151 analyzes dynamic elements of a plurality of applications and calculates dynamic element points. Here, FIG. 3 shows an example of a dynamic element scoring table used when calculating dynamic element points. The dynamic element score table 171 is stored in the score table storage unit 17.
 図3に示す動的要素配点表171では、実行中の複数のアプリケーションに対応する複数のウィンドウのうち、第1のウィンドウ(自ウィンドウ)の比較対象である第2のウィンドウ(他のウィンドウ)の競合性が高い程、要素点が高く配点されている。各動的要素点の配点については、後述する動的要素配点動作処理において詳細に説明する。なお、図3に示す各要素点、解析内容は一例であって、必ずしも図3に示す例に限定されない。 In the dynamic element scoring table 171 shown in FIG. 3, the second window (other window) to be compared with the first window (own window) among the plurality of windows corresponding to the plurality of applications being executed. The higher the competitiveness, the higher the element points. The allocation of each dynamic element point will be described in detail in the dynamic element allocation operation process described later. Each element point and analysis content shown in FIG. 3 are examples, and are not necessarily limited to the example shown in FIG.
 静的要素解析部152は、アプリケーションに対するイベントに基づいて、複数のアプリケーションの静的要素を解析する。本明細書において、静的要素とは、ユーザの操作によっては変化し得ない要素である。静的要素解析部152は、複数のアプリケーションの静的要素を解析して、静的要素点(基本点)を算出する。ここで、静的要素点を算出する際に用いられる静的要素の配点表の一例を、図4に示す。かかる静的要素配点表172は、配点表記憶部17に格納されている。 The static element analysis unit 152 analyzes static elements of a plurality of applications based on events for the applications. In this specification, a static element is an element that cannot be changed by a user operation. The static element analysis unit 152 analyzes static elements of a plurality of applications and calculates static element points (basic points). FIG. 4 shows an example of a static element stipulation table used when calculating static element points. The static element score table 172 is stored in the score table storage unit 17.
 図4に示す静的要素配点表172では、実行中の複数のアプリケーションに対応する複数のウィンドウのうち、第1のウィンドウ(自ウィンドウ)の比較対象である第2のウィンドウ(他ウィンドウ)の競合性が高い程、要素点が高く配点されている。各静的要素点の配点については、後述する静的要素配点動作処理において詳細に説明する。なお、図4に示す各要素点および解析内容は一例であって、必ずしも図4に示す内容に限定されない。 In the static element scoring table 172 shown in FIG. 4, among the plurality of windows corresponding to the plurality of applications being executed, there is a conflict with the second window (other window) to be compared with the first window (own window). The higher the property, the higher the element points. The allocation of each static element point will be described in detail in the static element allocation operation process described later. The element points and analysis contents shown in FIG. 4 are examples, and are not necessarily limited to the contents shown in FIG.
 競合点算出部153は、動的要素解析部151、静的要素解析部152により算出された動的要素点、および静的要素点に基づいて、複数アプリケーション(ウィンドウ)間の競合点を算出する。例えば、競合点算出部153は、静的要素点と動的要素点を全て乗算して競合点を算出する。本実施形態では、競合点が高い程、競合性が高いとされる。 The competition point calculation unit 153 calculates a competition point between a plurality of applications (windows) based on the dynamic element points calculated by the dynamic element analysis unit 151 and the static element analysis unit 152 and the static element points. . For example, the competitive point calculation unit 153 calculates a competitive point by multiplying all static element points and dynamic element points. In the present embodiment, the higher the competitive point, the higher the competitiveness.
 以上説明したように、推定処理部15は、動的要素解析部151、静的要素解析部152、および競合点算出部153として機能することにより、複数アプリケーションの関係(ここでは、一例として競合関係)を推定することができる。推定処理部15は、推定結果を推定結果記憶部16に記憶する。また、推定処理部15は、推定結果として、競合点の他、静的要素点、動的要素点、ユーザによる操作履歴等も推定結果記憶部16に記憶させてもよい。また、静的要素点、動的要素点、ユーザによる操作履歴等を推定結果記憶部16に記憶させるタイミングは特に限定せず、例えば各解析部(動的要素解析部151、静的要素解析部152)により解析された際に随時記憶させてもよい。 As described above, the estimation processing unit 15 functions as the dynamic element analysis unit 151, the static element analysis unit 152, and the competition point calculation unit 153, so that a relationship between a plurality of applications (here, a competition relationship is taken as an example). ) Can be estimated. The estimation processing unit 15 stores the estimation result in the estimation result storage unit 16. Further, the estimation processing unit 15 may store, in addition to the competition points, static element points, dynamic element points, user operation history, and the like as estimation results in the estimation result storage unit 16. The timing for storing the static element points, dynamic element points, user operation history, and the like in the estimation result storage unit 16 is not particularly limited. For example, each analysis unit (dynamic element analysis unit 151, static element analysis unit) 152) may be stored at any time when analyzed.
  (推定結果記憶部)
 推定結果記憶部16は、推定処理部15により推定された複数アプリケーションの関係を、アプリケーション毎にログとして蓄積する。ここで、図5に、推定結果記憶部16に蓄積されるデータ値未入力状態の算出表161の一例を示す。図5に示すように、算出表161には、第1のウィンドウ(自ウィンドウ)、表示開始/終了時刻、起動元(ランチャー/親ウィンドウ)、比較対象ウィンドウとその並列時間、静的要素点、動的要素点、および競合点が記録、登録される。図5に示す配点表161では、動的要素点の入力欄が8個あるが、これは一例であって、動的要素点の入力は8個に限定されず、算出された動的要素点が順次入力できればよい。
(Estimation result storage unit)
The estimation result storage unit 16 accumulates the relationship between the plurality of applications estimated by the estimation processing unit 15 as a log for each application. Here, FIG. 5 shows an example of the calculation table 161 of the data value non-input state accumulated in the estimation result storage unit 16. As shown in FIG. 5, the calculation table 161 includes a first window (own window), a display start / end time, an activation source (launcher / parent window), a comparison target window and its parallel time, a static element point, Dynamic element points and competitive points are recorded and registered. In the scoring table 161 shown in FIG. 5, there are eight dynamic element point input fields. However, this is an example, and the input of dynamic element points is not limited to eight. Can be input sequentially.
 かかる推定結果に基づいて、各社は、自社のサイト(Webブラウザアプリケーションで閲覧されるWebサイト)や専用アプリケーション(ゲームやコミュニケーション、ナビゲーション等の専用プログラム)と並列利用される他のアプリケーションを把握することができる。具体的には、各社は、どのようなWebサイトや専用アプリケーションと共に利用されているか、その際の競合性はどの程度かといったことを把握し、Webサイトや専用アプリケーションの改善やマーケティングに利用することができる。なお、推定結果記憶部16に記憶される推定結果は、定期的/不定期的に、サーバ2に送信され、各社はサーバ2にアクセスすることで、推定結果を取得することが可能である。また、推定処理部15は、推定結果を即時サーバ2に送信してもよい。 Based on the estimation results, each company grasps other applications that are used in parallel with their own sites (web sites browsed by web browser applications) and dedicated applications (dedicated programs such as games, communication, and navigation). Can do. Specifically, each company must know what website and dedicated application it is used with, and how competitive it is, and use it for improvement and marketing of the website and dedicated application. Can do. The estimation result stored in the estimation result storage unit 16 is transmitted to the server 2 periodically / irregularly, and each company can obtain the estimation result by accessing the server 2. Further, the estimation processing unit 15 may transmit the estimation result to the immediate server 2.
  (配点表記憶部)
 配点表記憶部17は、静的要素解析部152により静的要素が解析される際に用いられる静的要素の配点表と、動的要素解析部151により動的要素が解析される際に用いられる動的要素の配点表と、を記憶する。情報処理装置1は、定期的/不定期的に、サーバ2から最新の静的要素・動的要素の配点表を取得して配点表記憶部17のデータを更新してもよいし、静的要素解析時、動的要素解析時に、サーバ2から静的要素・動的要素の配点表をそれぞれ取得してもよい。
(Scoring table storage)
The score table storage unit 17 is used when a static element is analyzed by the static element analysis unit 152 and when a dynamic element is analyzed by the dynamic element analysis unit 151. A dynamic element scoring table to be stored. The information processing apparatus 1 may periodically / irregularly acquire the latest static element / dynamic element score table from the server 2 and update the data in the score table storage unit 17 or statically. At the time of element analysis and dynamic element analysis, a static element / dynamic element score table may be acquired from the server 2.
  (通信部)
 通信部18は、無線/有線により外部装置と接続し、データの送受信を行う機能を有する。例えば通信部18は、無線LAN、赤外線、Wi-Fi(登録商標)等により無線AP(アクセスポイント)に接続し、無線APを介してネットワークに接続することができる。そして、通信部18は、ネットワーク上のサーバ2から、後述する目的表データや、ホワイト/ブラックリスト、本実施形態による一連の処理を実行するためのソフトウェアを構成するプログラム等を取得することができる。
(Communication Department)
The communication unit 18 has a function of connecting to an external device by wireless / wired and transmitting / receiving data. For example, the communication unit 18 can be connected to a wireless AP (access point) via a wireless LAN, infrared rays, Wi-Fi (registered trademark), and the like, and can be connected to a network via the wireless AP. And the communication part 18 can acquire the program etc. which comprise the software for performing the objective table data mentioned later, a white / black list, and a series of processes by this embodiment from the server 2 on a network. .
 以上、本実施形態による情報処理装置1の構成について具体的に説明した。なお情報処理装置1は、CPU(Central Processing Unit)、ROM(Read Only Memory)、RAM(Random Access Memory)、不揮発性メモリ、インタフェース部を備えたマイクロコンピュータにより構成され、上述した各構成が制御される。RAMは、CPUの作業領域として利用される。また、ROMには、CPUが各処理(具体的には、システム処理部12、アプリケーション処理部13、推定処理部15による各処理)を実行するためのプログラムが書き込まれている。 The configuration of the information processing apparatus 1 according to the present embodiment has been specifically described above. The information processing apparatus 1 includes a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory, and an interface unit. The The RAM is used as a work area for the CPU. In addition, a program for the CPU to execute each process (specifically, each process by the system processing unit 12, the application processing unit 13, and the estimation processing unit 15) is written in the ROM.
  <2-2.サーバの構成>
 図2に示すように、サーバ2は、通信部21、目的表記憶部22、およびホワイト/ブラックリスト記憶部23を有する。
<2-2. Server configuration>
As shown in FIG. 2, the server 2 includes a communication unit 21, a purpose table storage unit 22, and a white / black list storage unit 23.
 通信部21は、情報処理装置1と接続してデータの送受信を行う。 The communication unit 21 is connected to the information processing apparatus 1 to transmit and receive data.
 目的表記憶部22には、静的要素解析部152により静的要素を解析する際に必要に応じて用いられる各アプリケーションの目的表が記憶されている。目的表については、図9を参照して後述する。 The purpose table storage unit 22 stores a purpose table for each application that is used as necessary when the static element analysis unit 152 analyzes static elements. The purpose table will be described later with reference to FIG.
 ホワイト/ブラックリスト記憶部23は、静的要素解析部152により静的要素を解析する際に必要に応じて用いられるアプリケーション毎のホワイト/ブラックリストが記憶されている。ホワイトリストとは、所定のアプリケーションに対して、無条件で競合対象から外す専用アプリケーションやWebサイトを列挙した表である。これにより、例えば親会社、子会社、またはグループ会社等のWebサイトや専用アプリケーションを、競合対象から外すことが可能である。 The white / black list storage unit 23 stores a white / black list for each application used as necessary when the static element analysis unit 152 analyzes static elements. The white list is a table listing dedicated applications and Web sites that are unconditionally excluded from the competition targets for a predetermined application. As a result, for example, websites and dedicated applications of a parent company, a subsidiary, a group company, etc. can be excluded from competing targets.
 また、ブラックリストとは、所定のアプリケーションに対して、無条件で競合対象とみなす専用アプリケーションやWebサイトを列挙した表である。これにより、例えば同業他社のWebサイトや専用アプリケーションを、必ず競合対象として扱うことが可能である。具体的には、2つのEC(Electronic Commerce)サイトが競合関係にあることが自明である場合、ECサイトの内容に応じて後述のテキストマイニング処理(図10、図11参照)を行うと日々の販売内容により静的要素点が上下してしまう。しかし、ブラックリストを用いることで、静的要素点に固定点を与えることが可能である。 In addition, the black list is a table listing dedicated applications and websites that are unconditionally regarded as competing targets for a given application. As a result, for example, websites and dedicated applications of other companies in the same industry can always be handled as competing targets. Specifically, when it is obvious that two EC (Electronic Commerce) sites are in a competitive relationship, a text mining process (see FIG. 10 and FIG. 11) described later is performed according to the contents of the EC site. The static element point goes up and down depending on the sales contents. However, by using a black list, it is possible to give a fixed point to a static element point.
 このように、ホワイト/ブラックリストが用いられることで、静的要素の解析がより正確に行われ得る。 As described above, by using the white / black list, the static element can be analyzed more accurately.
 以上、本実施形態によるサーバ2の構成について説明した。サーバ2は、CPU、ROM、RAM、不揮発性メモリ等を備えたマイクロコンピュータにより構成され、上述した各構成が制御される。なお本実施形態による情報処理装置1およびサーバ2の構成は、図2に示す例に限定されない。例えば、サーバ2が有する目的表記憶部22およびホワイト/ブラックリスト記憶部23を、情報処理装置1が有する構成であってもよい。この場合、情報処理装置1単体で本実施形態による複数アプリケーションの関係推定を行うことが可能である。 The configuration of the server 2 according to the present embodiment has been described above. The server 2 is configured by a microcomputer including a CPU, ROM, RAM, nonvolatile memory, and the like, and the above-described components are controlled. Note that the configurations of the information processing apparatus 1 and the server 2 according to the present embodiment are not limited to the example shown in FIG. For example, the information processing apparatus 1 may have a purpose table storage unit 22 and a white / black list storage unit 23 included in the server 2. In this case, it is possible for the information processing apparatus 1 alone to estimate the relationship between a plurality of applications according to the present embodiment.
 また、本実施形態による情報処理装置1がサーバ装置により実現されてもよい。すなわち、ユーザ端末とサーバ装置とを含む関係推定システムにおいて、サーバ装置(情報処理装置1)側で主な処理を行い、ユーザ端末から取得した入力信号(ウィンドウ操作)に基づいて、ユーザ端末で利用されている複数アプリケーションの関係を推定する。この場合、サーバ装置(情報処理装置1)は、推定処理部15、配点表記憶部17、推定結果記憶部16、目的表記憶部22、およびホワイト/ブラックリスト記憶部23を有する。 Further, the information processing apparatus 1 according to the present embodiment may be realized by a server apparatus. That is, in a relationship estimation system including a user terminal and a server device, the main processing is performed on the server device (information processing device 1) side, and the user terminal uses the input signal (window operation) acquired from the user terminal. Estimate the relationship between multiple applications. In this case, the server device (information processing device 1) includes an estimation processing unit 15, a score table storage unit 17, an estimation result storage unit 16, an objective table storage unit 22, and a white / black list storage unit 23.
  <<3.動作処理>>
 続いて、本実施形態の関係推定システムによる静的要素および動的要素の配点処理について、図6~図16を参照して説明する。図6は、本実施形態による関係推定システムのイベント種別判断処理を示すフローチャートである。
<< 3. Action processing >>
Next, the allocating process of static elements and dynamic elements by the relationship estimation system of the present embodiment will be described with reference to FIGS. FIG. 6 is a flowchart showing event type determination processing of the relationship estimation system according to the present embodiment.
 図6に示すように、まず、ステップS103において、情報処理装置1の入力部11は、ユーザによる操作入力を受け付け、受け付けた入力情報(入力信号)をシステム処理部12に出力する。 As shown in FIG. 6, first, in step S <b> 103, the input unit 11 of the information processing apparatus 1 receives an operation input by the user and outputs the received input information (input signal) to the system processing unit 12.
 次いで、ステップS106において、システム処理部12は入力情報に応じたイベントを、アプリケーション処理部13と推定処理部15に配信する。 Next, in step S106, the system processing unit 12 distributes an event corresponding to the input information to the application processing unit 13 and the estimation processing unit 15.
 続いて、ステップS109において、推定処理部15は、配信されたイベントの種別を判断する。具体的には、推定処理部15は、配信されたイベントが、ウィンドウの表示開始イベント、ウィンドウ位置変更イベント、ウィンドウの表示面積変更イベント、操作体移動イベント、視線移動イベント、および表示終了のいずれであるかを判断する。例えば、アプリケーションの新規起動、画面ロック状態からのアンロック、他のウィンドウの背面に全て隠れてしまい表示面積がゼロの状態からの復帰というイベントは、表示開始イベント(A)に分類される。 Subsequently, in step S109, the estimation processing unit 15 determines the type of the distributed event. Specifically, the estimation processing unit 15 determines whether any of the distributed events is a window display start event, a window position change event, a window display area change event, an operation tool movement event, a line-of-sight movement event, or a display end. Determine if there is. For example, events such as new application activation, unlock from the screen lock state, and return from a state where the display area is zero because all of the windows are hidden behind other windows are classified as a display start event (A).
 また、ユーザ操作によりウィンドウの位置が変更された場合、ウィンドウ位置変更イベント(B)に分類される。 Also, when the window position is changed by a user operation, it is classified as a window position change event (B).
 また、ユーザ操作によりウィンドウの表示面積(サイズ)が変更されたり、複数のウィンドウが重なったりした場合など、ウィンドウの表示面積が変更された場合、ウィンドウ表示面積変更イベント(C)に分類される。 Also, when the display area of the window is changed, such as when the display area (size) of the window is changed by a user operation, or when a plurality of windows are overlapped, it is classified as a window display area change event (C).
 また、ユーザ操作により、マウスポインタや指等の操作体が、一方のウィンドウから他方のウィンドウに移動した場合、操作体移動イベント(D)に分類される。 Also, when an operation body such as a mouse pointer or a finger moves from one window to the other window by a user operation, it is classified as an operation body movement event (D).
 また、ユーザの視線が、一方のウィンドウから他方のウィンドウに移動した場合、視線移動イベント(E)に分類される。視線移動は、情報処理装置1に取り付けられた、ユーザの顔の方向を撮影するカメラ等を用いてユーザの視線追跡を行った場合に発生するイベントである。情報処理装置1がカメラを有しない場合、視線移動のイベントは発生しないが、本実施形態による他のイベントは主にマウスやキーボード、タッチパッド等の操作入力部により発生し得る。 Also, when the user's line of sight moves from one window to the other, it is classified as a line-of-sight movement event (E). The line-of-sight movement is an event that occurs when the user's line-of-sight tracking is performed using a camera or the like attached to the information processing apparatus 1 that captures the direction of the user's face. When the information processing apparatus 1 does not have a camera, an eye movement event does not occur, but other events according to the present embodiment can be mainly generated by an operation input unit such as a mouse, a keyboard, or a touch pad.
 また、アプリケーションの終了、画面ロック、または他のウィンドウの背面に全て隠れてしまって表示面積がゼロの状態になるというイベントが配信された場合、表示終了イベント(F)に分類される。 Also, when an event that the application is terminated, the screen is locked, or the display area is completely hidden behind the back of another window is delivered, it is classified as a display end event (F).
 推定処理部15は、配信されたイベントの種別に応じて、複数アプリケーションの関係推定を行うための動的要素、静的要素の解析を行う。以下、各イベント入力をトリガとして行われる動的要素、静的要素の解析について、図7~図16を参照して具体的に説明する。 The estimation processing unit 15 analyzes a dynamic element and a static element for estimating a relationship between a plurality of applications according to the type of distributed event. Hereinafter, the analysis of the dynamic element and the static element performed using each event input as a trigger will be specifically described with reference to FIGS.
  <3-1.表示開始イベント時の静的・動的要素解析処理>
 配信されたイベントが表示開始イベントに分類された場合の処理について、図7~図11を参照して説明する。図7は、表示開始イベント発生時の静的・動的要素解析処理を示すフローチャートである。
<3-1. Static and dynamic element analysis processing at display start event>
Processing when a distributed event is classified as a display start event will be described with reference to FIGS. FIG. 7 is a flowchart showing static / dynamic element analysis processing when a display start event occurs.
 図7に示すように、まず、ステップS110において、推定処理部15は、表示開始イベントの発生に応じて表示した第1のウィンドウ(自ウィンドウ)と、第1のウィンドウの起動元を、算出表181(図5参照)に登録し、さらに表示開始時刻も記録する。起動元とは、新たに表示が開始されたウィンドウの呼び出し元であって、例えばランチャーまたは親ウィンドウが該当する。 As shown in FIG. 7, first, in step S110, the estimation processing unit 15 calculates the first window (own window) displayed in response to the occurrence of the display start event and the activation source of the first window from the calculation table. 181 (see FIG. 5), and the display start time is also recorded. The activation source is a caller of a window whose display has been newly started, and corresponds to, for example, a launcher or a parent window.
 次に、ステップS113において、推定処理部15は、第2のウィンドウ(他のウィンドウ)が存在するか否かを判断する。第2のウィンドウとは、第1のウィンドウの他に現在表示画面に表示されている1以上のウィンドウであり、算出表181に既に登録され、かつ表示終了時刻が確定していないウィンドウである。 Next, in step S113, the estimation processing unit 15 determines whether there is a second window (another window). The second window is one or more windows currently displayed on the display screen in addition to the first window, and is a window that has already been registered in the calculation table 181 and whose display end time has not been determined.
 次いで、第2のウィンドウが存在する場合(S113/Yes)、ステップS116において、推定処理部15は、第1のウィンドウに第2のウィンドウを、また、第2のウィンドウに第1のウィンドウを、それぞれ比較対象ウィンドウとして算出表161に追加する。 Next, when the second window exists (S113 / Yes), in step S116, the estimation processing unit 15 sets the second window in the first window, the first window in the second window, Each is added to the calculation table 161 as a window to be compared.
 続いて、ステップS119において、静的要素解析部152は、第1のウィンドウおよび第2のウィンドウの静的要素を解析し、基本点(静的要素点)を算出表161に記録する。静的要素の解析処理について、以下図8を参照して説明する。 Subsequently, in step S119, the static element analysis unit 152 analyzes the static elements of the first window and the second window, and records the basic points (static element points) in the calculation table 161. The static element analysis processing will be described below with reference to FIG.
 図8は、静的要素の解析処理を示すフローチャートである。図8に示すように、まず、ステップS230において、静的要素解析部152は、第1のウィンドウと第2のウィンドウ(対象ウィンドウ)が同一か否かを判断する。具体的には、例えば静的要素解析部152は、同一アプリケーション、または、Webブラウザアプリの場合は同一ドメインの場合に、同一であると判断する。なお同じWebサイトの異なるページはドメインが一致するので、同一とみなされる。 FIG. 8 is a flowchart showing the static element analysis processing. As shown in FIG. 8, first, in step S230, the static element analysis unit 152 determines whether or not the first window and the second window (target window) are the same. Specifically, for example, the static element analysis unit 152 determines that the same application or the same domain in the case of a web browser application is the same. Note that different pages on the same Web site are considered identical because the domains match.
 次に、同一であると判断された場合(S230/Yes)、ステップS233において、静的要素解析部152は、静的要素配点表172(図4参照)を参照し、静的要素点(a)を設定する。静的要素点(a)は、例えば図4に示すように、「0.00」若しくはそれに近い値とされる。同一のウィンドウは競合性が低いためである。 Next, when it is determined that they are the same (S230 / Yes), in step S233, the static element analysis unit 152 refers to the static element allocation table 172 (see FIG. 4), and determines the static element point (a ) Is set. The static element point (a) is set to “0.00” or a value close thereto as shown in FIG. 4, for example. This is because the same window is less competitive.
 一方、同一ではないと判断された場合(S233/No)、ステップS236において、静的要素解析部152は、対象ウィンドウ(第2のウィンドウ)が、第1のウィンドウのホワイトリストに登録されているか否かを判断する。ホワイトリストとは、上述したように無条件で競合対象から外す専用アプリケーションやWebサイトのリストである。 On the other hand, when it is determined that they are not the same (S233 / No), in step S236, the static element analysis unit 152 determines whether the target window (second window) is registered in the white list of the first window. Judge whether or not. As described above, the white list is a list of dedicated applications and websites that are unconditionally excluded from competition targets.
 ホワイトリストに登録されている場合(S236/Yes)、ステップS239において、静的要素解析部152は、静的要素配点表172(図4参照)を参照し、静的要素点(b)を設定する。静的要素点(b)は、例えば図4に示すように、「0.00」とされる。ホワイトリストに登録されているウィンドウは、競合状態である可能性が無いためである。なお競合点算出部153では、静的要素点および動的要素点が乗算されて競合点が算出されるので、基本点(静的要素点)が0.00であれば、動的要素点がいくつであっても競合点は0.00となる。 When registered in the white list (S236 / Yes), in step S239, the static element analysis unit 152 sets the static element point (b) with reference to the static element allocation table 172 (see FIG. 4). To do. The static element point (b) is set to “0.00” as shown in FIG. 4, for example. This is because the window registered in the white list is unlikely to be in a conflict state. The competitive point calculation unit 153 calculates the competitive point by multiplying the static element point and the dynamic element point. Therefore, if the basic point (static element point) is 0.00, the dynamic element point is Regardless of the number, the competition is 0.00.
 一方、ホワイトリストに登録されていない場合(S236/No)、ステップS242において、静的要素解析部152は、対象ウィンドウ(第2のウィンドウ)が、第1のウィンドウのブラックリストに登録されているか否かを判断する。ブラックリストとは、上述したように無条件で競合対象とみなす専用アプリケーションやWebサイトのリストである。 On the other hand, if it is not registered in the white list (S236 / No), in step S242, the static element analysis unit 152 determines whether the target window (second window) is registered in the black list of the first window. Judge whether or not. As described above, the black list is a list of dedicated applications and websites that are unconditionally regarded as competing targets.
 ブラックリストに登録されている場合(S242/Yes)、ステップS245において、静的要素解析部152は、静的要素配点表172(図4参照)を参照し、静的要素点(c)を設定する。静的要素点(c)は、例えば図4に示すように、「30.00」といった比較的大きな値とされる。ブラックリストに登録されているウィンドウは、必ず競合状態であるためである。 When registered in the black list (S242 / Yes), in step S245, the static element analysis unit 152 sets the static element point (c) with reference to the static element allocation table 172 (see FIG. 4). To do. The static element point (c) is a relatively large value such as “30.00” as shown in FIG. This is because windows registered in the black list are always in a conflict state.
 ホワイトリストにもブラックリストにも登録されていなかった場合(S242/No)ステップS248、S251において、静的要素解析部152は、第1、第2のウィンドウがテキストマイニング可能なウィンドウであるか否かを判断する。例えば静的要素解析部152は、ウィンドウがWebブラウザアプリケーションにより表示されたWebサイトの場合、テキストマイニング可能と判断し、専用アプリケーションの場合、テキストマイニング不可能と判断する。 When neither the white list nor the black list is registered (S242 / No) In steps S248 and S251, the static element analysis unit 152 determines whether the first and second windows are windows capable of text mining. Determine whether. For example, the static element analysis unit 152 determines that text mining is possible if the window is a Web site displayed by a Web browser application, and determines that text mining is not possible if the window is a dedicated application.
 次いで、第1、第2の少なくともいずれかのウィンドウがテキストマイニング不可能と判断された場合(S248/No、またはS251/No)、ステップS260において、静的要素解析部152は、第1、第2のウィンドウが、共に目的表に記載されているか否かを判断する。目的表とは、各ウィンドウ(専用アプリケーション、Webサイト)の利用目的が列挙された表である。かかる利用目的は、ユーザの立場に立った目的であってもよいし、運営側の立場に立った目的であってもよい。ここで、図9に、目的表の一例を示す。目的表221は、例えばサーバ2の目的表記憶部22に記憶され、情報処理装置1は、必要に応じてサーバ2にアクセスし、目的表記憶部22に記憶されている目的表221を参照する。 Next, when it is determined that at least one of the first and second windows is not capable of text mining (S248 / No or S251 / No), in step S260, the static element analysis unit 152 performs the first and second windows. It is determined whether or not both windows are described in the objective table. The purpose table is a table in which the purpose of use of each window (dedicated application, Web site) is listed. The purpose of use may be a purpose from the standpoint of the user or a purpose from the standpoint of the management side. Here, FIG. 9 shows an example of the purpose table. The purpose table 221 is stored in the purpose table storage unit 22 of the server 2, for example. The information processing apparatus 1 accesses the server 2 as necessary, and refers to the purpose table 221 stored in the purpose table storage unit 22. .
 図9に示すように、目的表221には、各ウィンドウの種別(専用アプリケーションか、Webサイトか)と、タイトルと、目的が含まれている。例えば、図9に示すように、各ウィンドウの目的が、コミュニケーション、ゲーム・暇つぶし、購買、交通探索、メディア視聴、ニュース閲覧、オークション、価格調査と記載されている。 As shown in FIG. 9, the purpose table 221 includes the type of each window (whether it is a dedicated application or a website), a title, and a purpose. For example, as shown in FIG. 9, the purpose of each window is described as communication, game / killing time, purchasing, traffic search, media viewing, news browsing, auction, price survey.
 次に、両ウィンドウ共に目的表221に記載がある場合(S260/Yes)、ステップS263において、静的要素解析部152は、両ウィンドウの目的が一致するか否かを判断する。 Next, when both windows are described in the purpose table 221 (S260 / Yes), in step S263, the static element analysis unit 152 determines whether or not the purposes of both windows match.
 両ウィンドウの目的が一致する場合(S263/Yes)、ステップS266において、静的要素解析部152は、静的要素配点表172を参照し、静的要素点(d)を設定する。静的要素点(d)は、例えば図4に示すように「15.00」とされる。静的要素点(d)は、静的要素点(c)程ではないが、大きな値に設定される。目的が一致するウィンドウは、競合性が高いためである。 If the purposes of both windows match (S263 / Yes), in step S266, the static element analysis unit 152 refers to the static element allocation table 172 and sets a static element point (d). For example, the static element point (d) is “15.00” as shown in FIG. The static element point (d) is not as large as the static element point (c), but is set to a large value. This is because windows with the same purpose are highly competitive.
 一方、両ウィンドウの目的が一致しない場合(S263/No)、または両ウィンドウの目的が記載されていない場合(S260/No)、ステップS269において、静的要素解析部152は、静的要素配点表172を参照し、静的要素点(e)を設定する。静的要素点(e)は、例えば図4に示すように「5.00」とされる。静的要素点(e)は、比較的小さな値に設定される。目的が一致しないウィンドウは、競合性が低いためである。 On the other hand, when the purposes of both windows do not match (S263 / No), or when the purposes of both windows are not described (S260 / No), the static element analysis unit 152, in step S269, 172, the static element point (e) is set. The static element point (e) is, for example, “5.00” as shown in FIG. The static element point (e) is set to a relatively small value. This is because windows that do not match the purpose are less competitive.
 続いて、両ウィンドウ共にWebサイトであり、テキストマイニングが可能な場合(S251/Yes)、ステップS254において、静的要素解析部152は、テキストマイニングによる共通要素算出処理を行う。テキストマイニングでは、Webサイトを構成している文字列を基準にすることで、より確度の高い静的要素点の算出が可能である。テキストマイニングによる共通要素算出処理について、図10、図11を参照して説明する。 Subsequently, when both windows are Web sites and text mining is possible (S251 / Yes), in step S254, the static element analysis unit 152 performs a common element calculation process by text mining. In text mining, it is possible to calculate static element points with higher accuracy by using a character string constituting a Web site as a reference. The common element calculation process by text mining will be described with reference to FIGS.
 図10は、テキストマイニング可能なウィンドウが表示されている表示画面の一例を示す図である。図10に示すように、例えば表示部(出力部14の一例)に購入サイト31、32のウィンドウがそれぞれ表示されている場合に、静的要素解析部152は、各ウィンドウの文字列に対して、形態素解析などの一般的なアルゴリズムを用いてテキストマイニングを行う。 FIG. 10 is a diagram showing an example of a display screen on which a text minable window is displayed. As shown in FIG. 10, for example, when the windows of the purchase sites 31 and 32 are displayed on the display unit (an example of the output unit 14), the static element analysis unit 152 applies the character string of each window. Text mining is performed using a general algorithm such as morphological analysis.
 図11は、テキストマイニングにより抽出された単語の集計結果を示す図である。図11では、購入サイト31のウィンドウから抽出された単語の集計結果を「data1」、購入サイト32のウィンドウから抽出された単語の集計結果を「data2」として示す。静的要素解析部152は、各ウィンドウからそれぞれ抽出した単語の集計結果に基づいて、一致した単語数をカウントする等の処理を行い、近似性を定量化することで、2つのウィンドウの近似程度(共通要素)を算出することができる。なお図11に示す例では、単純に単語の登場数をカウントしているが、他にもテキストマイニング分野における一般的なアルゴリズムが適用可能である。 FIG. 11 is a diagram showing a totaling result of words extracted by text mining. In FIG. 11, the total result of the words extracted from the window of the purchase site 31 is shown as “data1”, and the total result of the words extracted from the window of the purchase site 32 is shown as “data2”. The static element analysis unit 152 performs processing such as counting the number of matched words based on the total result of the words extracted from each window, and quantifies the closeness, thereby approximating the degree of approximation of the two windows. (Common element) can be calculated. In the example shown in FIG. 11, the number of appearances of words is simply counted, but other general algorithms in the text mining field can be applied.
 次いで、ステップS257において、静的要素解析部152は、算出された一致単語数を用いて、「静的要素配点表172の静的要素点(f)×一致単語数」を、静的要素点として設定する。静的要素点(f)は、例えば図4に示すように「1.00」とされる。Webサイトを構成する文字列が一致するほど、より競合性が高いためである。 Next, in step S257, the static element analysis unit 152 uses the calculated number of matching words to calculate “static element score (f) × number of matching words in the static element score table 172” as the static element point. Set as. The static element point (f) is, for example, “1.00” as shown in FIG. This is because as the character strings constituting the Web site match, the competitiveness is higher.
 以上、静的要素解析部152による静的要素点(基本点)の配点処理について説明した。続いて、図7に戻り、ステップS122以降の処理について説明する。 In the foregoing, the stipulation process for static element points (basic points) by the static element analysis unit 152 has been described. Subsequently, returning to FIG. 7, the processing after step S122 will be described.
 ステップS122において、推定処理部15は、第1のウィンドウの起動元がランチャーであるか否かを判断する。起動元がランチャーである場合(S122/Yes)、ランチャーから第1のウィンドウが生成されるのは当然であるので、動的要素の配点は行わない。 In step S122, the estimation processing unit 15 determines whether or not the activation source of the first window is a launcher. When the activation source is a launcher (S122 / Yes), it is natural that the first window is generated from the launcher, so that dynamic elements are not assigned.
 一方、起動元がランチャーではない場合(S122/No)、ステップS125において、動的要素解析部151は、算出表161における、比較対象として登録された対象ウィンドウ内の親ウィンドウに、動的要素点(a)を追加する。動的要素点(a)は、例えば図3に示すように「0.50」とされ、1.0よりも低く設定される。第1のウィンドウから見た親ウィンドウは起動元であるので、競合性は低いためである。 On the other hand, if the activation source is not a launcher (S122 / No), in step S125, the dynamic element analysis unit 151 adds a dynamic element point to the parent window in the target window registered as a comparison target in the calculation table 161. Add (a). The dynamic element point (a) is set to “0.50” as shown in FIG. 3, for example, and is set lower than 1.0. This is because the parent window viewed from the first window is an activation source, and thus the competition is low.
 次に、ステップS128において、動的要素解析部151は、第1のウィンドウの比較対象ウィンドウ内に、同じ親ウィンドウを持つ兄弟関係の他のウィンドウ(第2のウィンドウ)が存在するか否かを判断する。 Next, in step S128, the dynamic element analysis unit 151 determines whether there is another sibling-related window (second window) having the same parent window in the comparison target window of the first window. to decide.
 同じ親ウィンドウを持つ第2のウィンドウが存在する場合(S128/Yes)、ステップS131において、動的要素解析部151は、算出表161における、第1のウィンドウの比較対象内の対象ウィンドウ(同じ親ウィンドウを持つ第2のウィンドウ)に、動的要素点(b)を追加する。また、動的要素解析部151は、算出表161における、当該対象ウィンドウの比較対象内に登録されている第1のウィンドウにも、動的要素点(b)を追加する。動的要素点(b)は、例えば図3に示すように「1.51」とされる。同じ親ウィンドウを持つ第2のウィンドウが存在する場合とは、例えば検索エンジン(検索サイト)による所定のキーワードの検索結果から複数のウィンドウを開いた場合であって、当該複数のウィンドウは競合性が高いためである。 When there is a second window having the same parent window (S128 / Yes), in step S131, the dynamic element analysis unit 151 causes the target window (the same parent in the comparison target of the first window in the calculation table 161). A dynamic element point (b) is added to a second window having a window. The dynamic element analysis unit 151 also adds the dynamic element point (b) to the first window registered in the comparison target of the target window in the calculation table 161. The dynamic element point (b) is set to “1.51” as shown in FIG. 3, for example. The case where there is a second window having the same parent window is, for example, a case where a plurality of windows are opened from a search result of a predetermined keyword by a search engine (search site), and the plurality of windows are not competitive. This is because it is expensive.
  <3-2.ウィンドウ位置変更イベント時の動的要素解析処理>
 配信されたイベントがウィンドウ位置変更イベントに分類された場合の処理について、図12を参照して説明する。図12は、ウィンドウ位置変更イベント発生時の動的要素解析処理を示すフローチャートである。
<3-2. Dynamic element analysis processing at window position change event>
A process when the distributed event is classified as a window position change event will be described with reference to FIG. FIG. 12 is a flowchart showing a dynamic element analysis process when a window position change event occurs.
 図12に示すように、まず、ステップS140において、動的要素解析部151は、第1のウィンドウよりも画面中央に近い第2のウィンドウが存在するかを判断する。 As shown in FIG. 12, first, in step S140, the dynamic element analysis unit 151 determines whether there is a second window closer to the center of the screen than the first window.
 次いで、存在すると判断した場合(S140/Yes)、ステップS143において、動的要素解析部151は、算出表161における、第1のウィンドウの比較対象内の対象ウィンドウに、動的要素点(c)を追加する。動的要素点(c)は、例えば図3に示すように「1.21」とされる。第1のウィンドウが画面端に移動された場合、第1のウィンドウよりも画面中心に位置する第2のウィンドウは、競合性が高いためである。 Next, when it is determined that it exists (S140 / Yes), in step S143, the dynamic element analysis unit 151 adds the dynamic element point (c) to the target window in the comparison target of the first window in the calculation table 161. Add The dynamic element point (c) is set to “1.21” as shown in FIG. 3, for example. This is because when the first window is moved to the screen edge, the second window located at the center of the screen is more competitive than the first window.
  <3-3.ウィンドウの表示面積変更イベント時の動的要素解析処理>
 配信されたイベントがウィンドウの表示面積変更イベントに分類された場合の処理について、図13を参照して説明する。図13は、ウィンドウの表示面積変更イベント発生時の動的要素解析処理を示すフローチャートである。
<3-3. Dynamic element analysis process at window display area change event>
Processing when the distributed event is classified as a window display area change event will be described with reference to FIG. FIG. 13 is a flowchart showing a dynamic element analysis process when a window display area change event occurs.
 図13に示すように、まず、ステップS150において、動的要素解析部151は、第1のウィンドウの表示面積が小さくなったか否かを判断する。 As shown in FIG. 13, first, in step S150, the dynamic element analysis unit 151 determines whether or not the display area of the first window has decreased.
 次に、小さくなったと判断された場合(S150/Yes)、ステップS153において、動的要素解析部151は、表示面積が小さくなった原因が第2のウィンドウにより覆われたためであるか否かを判断する。第2のウィンドウが第1のウィンドウよりも前面で重畳表示される場合、重畳部分は隠れるので、第1のウィンドウの表示面積は小さくなる。 Next, when it is determined that the display area has become smaller (S150 / Yes), in step S153, the dynamic element analysis unit 151 determines whether or not the cause of the decrease in the display area is covered by the second window. to decide. When the second window is superimposed and displayed in front of the first window, the overlapped portion is hidden, so the display area of the first window is reduced.
 次いで、第2のウィンドウにより覆われたためであると判断された場合(S153/Yes)、ステップS156において、動的要素解析部151は、表示面積変化前の第1のウィンドウの表示面積を、変化後の面積で割り、面積変化率を算出する。例えば第1のウィンドウの半分の領域が第2のウィンドウにより覆われて面積が小さくなってしまった場合、面積変化率は2.0となる。なお変化後の面積が0になる場合は、「ウィンドウの表示面積変更イベント(C)」ではなく、「表示終了イベント(F)」として扱われるので、本シーケンスには到達しない。 Next, when it is determined that the display area is covered by the second window (S153 / Yes), in step S156, the dynamic element analysis unit 151 changes the display area of the first window before the display area change. Divide by the subsequent area to calculate the area change rate. For example, when the area of the half of the first window is covered with the second window and the area becomes small, the area change rate is 2.0. When the area after the change becomes 0, it is handled not as “window display area change event (C)” but as “display end event (F)”, so this sequence is not reached.
 次に、ステップS159において、動的要素解析部151は、算出した面積変化率を用いて、算出表161における、第1のウィンドウの比較対象内の対象ウィンドウ(第1のウィンドウを覆っている第2のウィンドウ)に、「動的要素点(d)×面積変化率」を追加する。動的要素点(d)は、例えば図3に示すように「1.23」とされる。第2のウィンドウにより覆われる面積が大きい程(面積変化率が高い程)、競合性が高いためである。 Next, in step S159, the dynamic element analysis unit 151 uses the calculated area change rate to calculate the target window (the first window covering the first window) within the comparison target of the first window in the calculation table 161. 2), “dynamic element point (d) × area change rate” is added. The dynamic element point (d) is set to “1.23” as shown in FIG. 3, for example. This is because as the area covered by the second window is larger (the area change rate is higher), the competitiveness is higher.
 一方、表示面積変化の原因が第2のウィンドウにより覆われたためではない場合(S153/No)、動的要素解析部151は、第1のウィンドウがユーザ操作により単体でリサイズされたためと判断できる(S153/Yes)。 On the other hand, when the cause of the display area change is not due to being covered by the second window (S153 / No), the dynamic element analysis unit 151 can determine that the first window has been resized by the user operation alone ( S153 / Yes).
 続いて、第1のウィンドウがリサイズされた場合(S153/Yes)、ステップS162において、動的要素解析部151は、第1のウィンドウより表示面積が大きい第2のウィンドウが存在するか否かを判断する。 Subsequently, when the first window is resized (S153 / Yes), in step S162, the dynamic element analysis unit 151 determines whether or not there is a second window having a larger display area than the first window. to decide.
 次に、存在すると判断した場合(S162/Yes)、ステップS165において、動的要素解析部151は、算出表161における、第1のウィンドウの比較対象内の対象ウィンドウ(第1のウィンドウより表示面積が大きい第2のウィンドウ)に、動的要素点(e)を追加する。動的要素点(e)は、例えば図3に示すように「1.25」とされる。第1のウィンドウが小さくリサイズされた場合に第1のウィンドウよりもサイズが大きい第2のウィンドウは、競合性が高いためである。 Next, when it is determined that it exists (S162 / Yes), in step S165, the dynamic element analysis unit 151 displays the target window (the display area from the first window) within the comparison target of the first window in the calculation table 161. The dynamic element point (e) is added to the second window having a large. The dynamic element point (e) is set to “1.25” as shown in FIG. 3, for example. This is because the second window having a size larger than the first window when the first window is resized to a small size is highly competitive.
  <3-4.操作体移動イベント時の動的要素解析処理>
 配信されたイベントが操作体移動イベントに分類された場合の処理について、図14を参照して説明する。図14は、操作体移動イベント発生時の動的要素解析処理を示すフローチャートである。
<3-4. Dynamic element analysis processing at operation object movement event>
Processing when the distributed event is classified as an operation tool movement event will be described with reference to FIG. FIG. 14 is a flowchart showing a dynamic element analysis process when an operation tool movement event occurs.
 図14に示すように、まず、ステップS170において、動的要素解析部151は、第1のウィンドウに操作体が移動したか否か(第1のウィンドウが操作対象となったか否か)を判断する。 As shown in FIG. 14, first, in step S170, the dynamic element analysis unit 151 determines whether or not the operating body has moved to the first window (whether or not the first window has become an operation target). To do.
 次いで、操作体が移動したと判断した場合(S170/Yes)、ステップS173において、動的要素解析部151は、第2のウィンドウ(他のウィンドウ)が存在するか否かを判断する。 Next, when it is determined that the operating body has moved (S170 / Yes), in step S173, the dynamic element analysis unit 151 determines whether or not the second window (another window) exists.
 次に、第2のウィンドウが存在すると判断した場合(S173/Yes)、ステップS176において、動的要素解析部151は、第1のウィンドウに操作体が移動する直前に操作体により操作されていた(操作対象だった)第2のウィンドウは存在するか否かを判断する。 Next, when it is determined that the second window exists (S173 / Yes), in step S176, the dynamic element analysis unit 151 has been operated by the operating body immediately before the operating body moves to the first window. It is determined whether or not the second window (which was the operation target) exists.
 次いで、直前に操作されていた第2のウィンドウが存在する場合(S176/Yes)、ステップS179において、動的要素解析部151は、算出表161における、対象ウィンドウ(直前に操作されていた第2のウィンドウ)の比較対象内の第1のウィンドウに動的要素点(f)を追加する。動的要素点(f)は、例えば図3に示すように「1.05」とされる。ユーザが対象ウィンドウから第1のウィンドウに操作体を移動したことにより、対象ウィンドウに対しての第1のウィンドウは競合性が高いと言えるためである。 Next, when there is a second window that has been operated immediately before (S176 / Yes), in step S179, the dynamic element analysis unit 151 causes the target window (the second window that has been operated immediately before) to be calculated in the calculation table 161. The dynamic element point (f) is added to the first window within the comparison target of the window. The dynamic element point (f) is, for example, “1.05” as shown in FIG. This is because when the user moves the operating tool from the target window to the first window, it can be said that the first window with respect to the target window is highly competitive.
  <3-5.視線移動イベント時の動的要素解析処理>
 配信されたイベントが視線移動イベントに分類された場合の処理について、図15を参照して説明する。図15は、視線移動イベント発生時の動的要素解析処理を示すフローチャートである。
<3-5. Dynamic element analysis processing during eye movement event>
Processing when the distributed event is classified as a line-of-sight movement event will be described with reference to FIG. FIG. 15 is a flowchart showing a dynamic element analysis process when a line-of-sight movement event occurs.
 図15に示すように、まず、ステップS180において、動的要素解析部151は、第1のウィンドウに視線が向けられたか(第1のウィンドウが注目対象となったか)否かを判断する。 As shown in FIG. 15, first, in step S180, the dynamic element analysis unit 151 determines whether or not the line of sight is directed to the first window (whether or not the first window is a target of attention).
 次いで、視線が向けられたと判断した場合(S180/Yes)、ステップS183において、動的要素解析部151は、第2のウィンドウ(他のウィンドウ)が存在するか否かを判断する。 Next, when it is determined that the line of sight is directed (S180 / Yes), in step S183, the dynamic element analysis unit 151 determines whether or not the second window (another window) exists.
 次に、第2のウィンドウが存在すると判断した場合(S183/Yes)、ステップS186において、動的要素解析部151は、第1のウィンドウに視線が向けられる直前に視線が向けられていた(注目対象だった)第2のウィンドウは存在するか否かを判断する。 Next, when it is determined that the second window exists (S183 / Yes), in step S186, the dynamic element analysis unit 151 is directed to the line of sight just before the line of sight is directed to the first window (attention) It is determined whether the second window (which was the subject) exists.
 次いで、直前に視線が向けられていた第2のウィンドウが存在する場合(S186/Yes)、ステップS189において、動的要素解析部151は、算出表161における、対象ウィンドウ(直前に視線が向けられていた第2のウィンドウ)の比較対象内の第1のウィンドウに動的要素点(g)を追加する。動的要素点(g)は、例えば図3に示すように「1.06」とされる。ユーザが対象ウィンドウから第1のウィンドウに視線を移動したことにより、対象ウィンドウに対しての第1のウィンドウは競合性が高いと言えるためである。 Next, when there is a second window to which the line of sight was directed immediately before (S186 / Yes), in step S189, the dynamic element analysis unit 151 causes the target window (the line of sight to be directed immediately before) in the calculation table 161. The dynamic element point (g) is added to the first window in the comparison target of the second window). The dynamic element point (g) is, for example, “1.06” as shown in FIG. This is because when the user moves his / her line of sight from the target window to the first window, it can be said that the first window with respect to the target window is highly competitive.
  <3-6.表示終了イベント時の動的要素解析処理>
 配信されたイベントが表示終了イベントに分類された場合の処理について、図16を参照して説明する。図16は、表示終了イベント発生時の動的要素解析処理を示すフローチャートである。
<3-6. Dynamic element analysis processing at display end event>
A process when the distributed event is classified as a display end event will be described with reference to FIG. FIG. 16 is a flowchart showing a dynamic element analysis process when a display end event occurs.
 図16に示すように、まず、ステップS190において、動的要素解析部151は、第1のウィンドウの表示終了時刻を、算出表161に記録する。 As shown in FIG. 16, first, in step S190, the dynamic element analysis unit 151 records the display end time of the first window in the calculation table 161.
 次に、ステップS193において、第1のウィンドウと表示時刻が重なり、かつ表示終了時刻が確定している第2のウィンドウが存在するか否かを判断する。 Next, in step S193, it is determined whether or not there is a second window whose display time overlaps with the first window and whose display end time is fixed.
 次いで、当該第2のウィンドウが存在すると判断された場合(S193/Yes)、ステップS196において、動的要素解析部151は、算出表161における、第1のウィンドウの比較対象内の対象ウィンドウに所定の要素点を追加する。具体的には、動的要素解析部151は、「動的要素点(h)^並列時間」を追加する。ここで並列時間とは、第1のウィンドウと対象ウィンドウの表示開始時刻と表示終了時刻から導出される、2つのウィンドウが時間的に並列して表示されていた(同時刻に存在していた)時間である。また^はべき乗を表す。また、動的要素点(h)は、例えば図3に示すように「1.10」とされる。第1のウィンドウと対象ウィンドウは時間的に並列して表示されていたが、第1のウィンドウの方が長く表示されていたので、第1のウィンドウに対しての対象ウィンドウは、競合状態にあるものの競合性はそれほど高くないためである。 Next, when it is determined that the second window exists (S193 / Yes), in step S196, the dynamic element analysis unit 151 sets a predetermined window as a target window in the comparison target of the first window in the calculation table 161. Add element point of. Specifically, the dynamic element analysis unit 151 adds “dynamic element point (h) ^ parallel time”. Here, the parallel time means that two windows derived from the display start time and the display end time of the first window and the target window were displayed in parallel in time (they existed at the same time). It's time. ^ Represents power. The dynamic element point (h) is set to “1.10” as shown in FIG. 3, for example. The first window and the target window were displayed in parallel in time, but the first window was displayed longer, so the target window for the first window is in a competitive state. This is because the competitiveness of things is not so high.
 次に、ステップS199において、動的要素解析部151は、算出表161における、対象ウィンドウ(第1のウィンドウと表示時刻が重なり、かつ表示終了時刻が確定している第2のウィンドウ)の比較対象内の第1のウィンドウに、「動的要素点(i)^並列時間」を追加する。動的要素点(i)は、例えば図3に示すように「1.32」とされる。ここで、動的要素点(i)は動的要素点(h)よりも大きな値に設定されているが、これは、時間的に並列して存在していた対象ウィンドウが、第1のウィンドウよりも先に終了された場合、対象ウィンドウに対しての自ウィンドウは、競合性がより高いためである。 Next, in step S199, the dynamic element analysis unit 151 compares the target window (the second window whose display time overlaps with the first window and whose display end time is fixed) in the calculation table 161. Add "dynamic element point (i) ^ parallel time" to the first window. The dynamic element point (i) is set to “1.32” as shown in FIG. 3, for example. Here, the dynamic element point (i) is set to a larger value than the dynamic element point (h). This is because the target window that existed in parallel in time is the first window. This is because the self-window for the target window is more competitive when it is terminated earlier.
 以上、本実施形態の関係推定システムによる静的要素および動的要素の配点処理について詳細に説明した。推定処理部15は、上記各配信イベントに応じた各フローに示したように静的要素点および動的要素点を算出表161に記録した後、競合点算出部153により算出表161を用いて競合点を算出することで、複数アプリケーションの競合関係を推定することができる。 As described above, the allocating process of static elements and dynamic elements by the relationship estimation system of the present embodiment has been described in detail. The estimation processing unit 15 records the static element points and the dynamic element points in the calculation table 161 as shown in each flow corresponding to each distribution event, and then uses the calculation table 161 by the competitive point calculation unit 153. By calculating the competitive point, it is possible to estimate the competitive relationship of a plurality of applications.
 続いて、本実施形態の関係推定システムによる推定処理の実施例について、図17~図29を参照して具体的に説明する。 Subsequently, an example of estimation processing by the relationship estimation system of the present embodiment will be specifically described with reference to FIGS.
  <<4.推定処理の実施例>>
  <4-1.複数のWebサイトを利用した場合の推定処理>
 まず、ユーザが、複数のWebサイトを比較して、ミネラルウォーターを購入する場合の複数アプリケーション(Webサイト)間の関係推定処理について、図17~図20を参照して説明する。図17~図19には、画面遷移図、図20には、算出表161-1をそれぞれ示す。
<< 4. Example of estimation process >>
<4-1. Estimation process when multiple websites are used>
First, relationship estimation processing between a plurality of applications (Web sites) when a user compares a plurality of Web sites and purchases mineral water will be described with reference to FIGS. 17 to 19 show screen transition diagrams, and FIG. 20 shows a calculation table 161-1.
  (4-1-1.第1の購入サイトの表示開始)
 図17は、第1の購入サイトを表示させるまでの画面遷移を示す図である。ユーザは、ランチャーからWebブラウザを起動すると、図17左に示すように、予めホームページに設定されていた検索サイト30の表示が開始される。この際、推定処理部15は、表示開始イベントを検出し、算出表161-1において、検索サイト30(例えばタイトル「Search WEB」)と、検索サイト30の起動元(ここでは、ランチャー)の登録、および表示開始時刻の記憶を行う。
(4-1-1. Display of first purchase site)
FIG. 17 is a diagram illustrating screen transitions until the first purchase site is displayed. When the user activates the Web browser from the launcher, display of the search site 30 set in advance on the home page is started as shown in the left of FIG. At this time, the estimation processing unit 15 detects the display start event, and registers the search site 30 (for example, the title “Search WEB”) and the start source (in this case, the launcher) of the search site 30 in the calculation table 161-1. And the display start time are stored.
 ユーザは、検索サイト30の検索欄に「ミネラルウォーター」と入力し、検索を実行させる。そして、検索結果一覧に含まれる購入サイト31のリンクを選択し、図17右に示すように、購入サイト31を新たなウィンドウで開く。この際、推定処理部15は、表示開始イベントを検出し、算出表161-1において、購入サイト31(例えばタイトル「ABCD shop」)と、購入サイト31の起動元(ここでは、親ウィンドウである検索サイト30)の登録、および表示開始時刻の記憶を行う。推定処理部15は、検索サイト30(「Search WEB」)にとって、表示されている他のウィンドウとなる購入サイト31(「ABCD shop」)を、算出表161-1において、比較対象のウィンドウとして登録する。また、推定処理部15は、購入サイト31(「ABCD shop」)にとって、表示されている他のウィンドウとなる検索サイト30(「Search WEB」)を、算出表161-1において、比較対象のウィンドウとして登録する。 The user inputs “mineral water” in the search field of the search site 30 and executes the search. Then, the link of the purchase site 31 included in the search result list is selected, and the purchase site 31 is opened in a new window as shown on the right side of FIG. At this time, the estimation processing unit 15 detects the display start event, and in the calculation table 161-1, the purchase site 31 (for example, the title “ABCD shop”) and the activation source of the purchase site 31 (here, the parent window) The search site 30) is registered and the display start time is stored. The estimation processing unit 15 registers the purchase site 31 (“ABCD shop”), which is the other displayed window, for the search site 30 (“Search WEB”) as a window to be compared in the calculation table 161-1. To do. In addition, the estimation processing unit 15 selects the search site 30 (“Search WEB”), which is the other displayed window, for the purchase site 31 (“ABCD shop”) in the calculation table 161-1. Register as
 さらに、推定処理部15の静的要素解析部152は、各比較対象のウィンドウに静的要素点を配点する。具体的には、例えば静的要素解析部152は、算出表161-1において、検索サイト30(「Search WEB」)にとっての比較対象である購入サイト31が、ホワイトリストに登録されている場合、静的要素点(b)として、「0.00点」を設定する。また、静的要素解析部152は、購入サイト31(「ABCD shop」)にとっての比較対象である検索サイト30が、ホワイトリストに登録されている場合、静的要素点(b)として、「0.00点」を設定する。 Furthermore, the static element analysis unit 152 of the estimation processing unit 15 places static element points on each comparison target window. Specifically, for example, in the calculation table 161-1, the static element analysis unit 152, when the purchase site 31 that is the comparison target for the search site 30 (“Search WEB”) is registered in the white list, As the static element point (b), “0.00 point” is set. Further, when the search site 30 to be compared with the purchase site 31 (“ABCD shop”) is registered in the white list, the static element analysis unit 152 sets “0” as the static element point (b). .00 ”is set.
 また、推定処理部15の動的要素解析部151は、各比較対象のウィンドウに動的要素点を配点する。具体的には、例えば動的要素解析部151は、比較対象のウィンドウが親ウィンドウの場合には動的要素点(a)を配点し、また、2つのウィンドウ間で操作体/視線の移動が発生した場合には動的要素点(e)、(f)を配点する。 Also, the dynamic element analysis unit 151 of the estimation processing unit 15 places dynamic element points on each comparison target window. Specifically, for example, the dynamic element analysis unit 151 assigns a dynamic element point (a) when the comparison target window is a parent window, and the operation body / line of sight moves between the two windows. When it occurs, dynamic element points (e) and (f) are assigned.
  (4-1-2.第2の購入サイトの表示開始)
 次いで、ユーザは、商品を比較するために新たな購入サイトを開く操作を行う。以下、図18を参照して説明する。
(4-1-2. Start of displaying the second purchase site)
Next, the user performs an operation of opening a new purchase site in order to compare commodities. Hereinafter, a description will be given with reference to FIG.
 図18は、第2の購入サイトを表示させて比較するまでの画面遷移を示す図である。ユーザは、検索サイト30の検索結果一覧から第2の購入サイトを見つけ、図18左に示すように、購入サイト32を新しいウィンドウで開く。 FIG. 18 is a diagram showing screen transitions until the second purchase site is displayed and compared. The user finds the second purchase site from the search result list of the search site 30, and opens the purchase site 32 in a new window, as shown on the left side of FIG.
 この際、推定処理部15は、表示開始イベントを検出し、算出表161-1において、第2の購入サイト32(例えばタイトル「Free Market Site」)と、購入サイト32の起動元(ここでは、親ウィンドウである検索サイト30)の登録、および表示開始時刻の記憶を行う。また、推定処理部15は、購入サイト32(「Free Market Site」)にとって、表示されている他のウィンドウとなる検索サイト30および第1の購入サイト31を、算出表161-1において、比較対象のウィンドウとして登録する。なお算出表161-1において、検索サイト30および第1の購入サイト31のそれぞれの比較対象ウィンドウとして、第2の購入サイト32が追加される。 At this time, the estimation processing unit 15 detects the display start event, and in the calculation table 161-1, the second purchase site 32 (for example, the title “Free Market Site”) and the start source of the purchase site 32 (here, Registration of the search site 30), which is the parent window, and storage of the display start time. In addition, the estimation processing unit 15 compares the search site 30 and the first purchase site 31 that are the other displayed windows for the purchase site 32 (“Free Market Site”) in the calculation table 161-1. Register as a window. In the calculation table 161-1, the second purchase site 32 is added as a comparison target window for each of the search site 30 and the first purchase site 31.
 さらに、推定処理部15の静的要素解析部152は、各比較対象のウィンドウに静的要素点を配点する。具体的には、例えば静的要素解析部152は、算出表161-1において、検索サイト30(「Search WEB」)にとっての比較対象である購入サイト32が、ホワイトリストに登録されている場合、静的要素点(b)として、「0.00点」を設定する。また、静的要素解析部152は、購入サイト32(「Free Market Site」)にとっての比較対象である検索サイト30が、ホワイトリストに登録されている場合、静的要素点(b)として、「0.00点」を設定する。また、静的要素解析部152は、購入サイト31、32の目的が一致する場合、静的要素点(d)として、「15.00点」を設定する。 Furthermore, the static element analysis unit 152 of the estimation processing unit 15 places static element points on each comparison target window. Specifically, for example, in the calculation table 161-1, the static element analysis unit 152, when the purchase site 32 that is the comparison target for the search site 30 (“Search WEB”) is registered in the white list, As the static element point (b), “0.00 point” is set. In addition, when the search site 30 to be compared with the purchase site 32 (“Free Market Site”) is registered in the white list, the static element analysis unit 152 sets the static element point (b) as “ Set “0.00 points”. In addition, when the purposes of the purchase sites 31 and 32 match, the static element analysis unit 152 sets “15.00 points” as the static element point (d).
 また、推定処理部15の動的要素解析部151は、各比較対象のウィンドウに動的要素点を配点する。具体的には、例えば動的要素解析部151は、算出表161-1において、購入サイト31、32は、同じウィンドウ(検索サイト30)を親に持つ兄弟関係のウィンドウであるので、動的要素点(b)「1.51点」をそれぞれ配点する。また、購入サイト32にとって、比較対象ウィンドウのうち検索サイト30は親ウィンドウに該当するので、動的要素点(a)「0.50点」が配点される。 Also, the dynamic element analysis unit 151 of the estimation processing unit 15 places dynamic element points on each comparison target window. Specifically, for example, in the dynamic element analysis unit 151, in the calculation table 161-1, the purchase sites 31 and 32 are sibling-related windows having the same window (search site 30) as a parent. Points (b) “1.51 points” are assigned respectively. Further, for the purchase site 32, the search site 30 among the comparison target windows corresponds to the parent window, so the dynamic element point (a) “0.50 points” is assigned.
 次いで、ユーザは、図18右に示すように、購入サイト31、32を交互にスクロールしながら閲覧し、商品を比較する。この際、動的要素解析部151は、操作体移動イベントや視線移動イベントを検出し、操作体の移動や視線の移動に応じて、動的要素点(e)「1.05点」、(f)「1.06点」を配点する。 Next, as shown on the right side of FIG. 18, the user browses the purchase sites 31 and 32 while alternately scrolling and compares the products. At this time, the dynamic element analysis unit 151 detects the operating body movement event and the line-of-sight movement event, and the dynamic element point (e) “1.05 points”, ( f) “1.06 points” are assigned.
  (4-1-3.購入サイトの決定)
 続いて、ユーザは、2つの購入サイトを比較した結果、利用する購入サイトを決定し、他方の購入サイトは閉じて、決定した購入サイトで商品購入手続きを行う。以下、図19を参照して説明する。
(4-1-3. Determination of purchase site)
Subsequently, as a result of comparing the two purchase sites, the user determines a purchase site to be used, closes the other purchase site, and performs a product purchase procedure at the determined purchase site. Hereinafter, a description will be given with reference to FIG.
 図19は、利用する購入サイトを決定し、購入処理が終了するまでの画面遷移を示す図である。図19左に示すように、ユーザは、第1の購入サイト31で商品を購入することに決定すると、不要になった第2の購入サイト32のウィンドウを閉じる操作を行い、購入サイト31で商品購入処理を開始する。この際、推定処理部15は、表示終了イベントを検出し、算出表161-1において、購入サイト32の表示終了時刻を確定させる。また、購入サイト32の表示終了時刻が確定すると、購入サイト32と時間的に並列して存在していた他のウィンドウとの並列時間も確定され、算出表161-1に登録される。 FIG. 19 is a diagram showing screen transitions until the purchase site to be used is determined and the purchase process is completed. As shown on the left side of FIG. 19, when the user decides to purchase a product at the first purchase site 31, the user performs an operation to close the window of the second purchase site 32 that is no longer necessary, and the product at the purchase site 31. Start the purchase process. At this time, the estimation processing unit 15 detects the display end event, and determines the display end time of the purchase site 32 in the calculation table 161-1. When the display end time of the purchase site 32 is determined, the parallel time with other windows that existed in parallel with the purchase site 32 is also determined and registered in the calculation table 161-1.
 そして、図19右に示すように、第1の購入サイト31での購入処理が終了すると、購入サイト31のウィンドウ、検索サイト30のウィンドウが閉じられ、情報処理装置1もシャットダウンされる。この際、推定処理部15は、表示終了イベントを検出し、算出表161-1において、購入サイト31、検索サイト30の表示終了時刻を確定させる。また、購入サイト31、検索サイト30の表示終了時刻が確定すると、購入サイト31、検索サイト30と時間的に並列して存在していた他のウィンドウとの並列時間も確定され、算出表161-1に登録される。 Then, as shown in the right of FIG. 19, when the purchase process at the first purchase site 31 is completed, the window of the purchase site 31 and the window of the search site 30 are closed, and the information processing apparatus 1 is also shut down. At this time, the estimation processing unit 15 detects the display end event, and determines the display end time of the purchase site 31 and the search site 30 in the calculation table 161-1. Further, when the display end times of the purchase site 31 and the search site 30 are determined, the parallel time with other windows that existed in parallel with the purchase site 31 and the search site 30 is also determined, and the calculation table 161- 1 is registered.
 また、動的要素解析部151は、第1のウィンドウの方が長く存在していた場合、第1のウィンドウに対しての対象ウィドウの並列時間と動的要素点(h)を用いて動的要素点を算出し、算出表161-1に記録する。また、動的要素解析部151は、第1のウィンドウの方が長く存在していた場合、対象ウィンドウに対しての第1のウィドウの並列時間と動的要素点(i)を用いて動的要素点を算出し、算出表161-1に記録する。 In addition, when the first window is longer, the dynamic element analysis unit 151 uses the parallel time of the target window with respect to the first window and the dynamic element point (h) to dynamically The element points are calculated and recorded in the calculation table 161-1. In addition, when the first window has existed longer, the dynamic element analysis unit 151 uses the first window parallel time for the target window and the dynamic element point (i) to dynamically The element points are calculated and recorded in the calculation table 161-1.
  (4-1-4.推定結果)
 推定処理部15による静的/動的要素点の配点が終了すると、競合点算出部153は、図20に示す算出表161-1を用いて、各ウィンドウと対象ウィンドウ間の競合点を算出する。ここで、複数ウィンドウ間の競合点は、例えば静的要素点および動的要素点を全て乗算することにより算出される。
(4-1-4. Estimation results)
When the estimation processing unit 15 finishes assigning the static / dynamic element points, the competition point calculation unit 153 calculates a competition point between each window and the target window using the calculation table 161-1 illustrated in FIG. . Here, the competing points between a plurality of windows are calculated by multiplying all of the static element points and the dynamic element points, for example.
 この結果、検索サイト30に対する購入サイト31、32と、購入サイト31、32に対する検索サイト30の競合点は、図20に示すようにいずれも「0.00点」と算出される。したがって、推定処理部15は、各ウィンドウ(各Webサイト)は、競合対象ではない、すなわち両者に競合関係はないと推定できる。 As a result, the purchase sites 31 and 32 for the search site 30 and the competition points of the search site 30 for the purchase sites 31 and 32 are both calculated as “0.00 points” as shown in FIG. Therefore, the estimation processing unit 15 can estimate that each window (each Web site) is not a competition target, that is, there is no competition relationship between them.
 一方、購入サイト31に対する購入サイト32の競合点は「45.72」と算出され、購入サイト32が競合対象であることが推定される。また、購入サイト32に対する購入サイト31の競合点は、図20に示すように「85.18」と算出され、購入サイト31が競合対象であることが推定される。 On the other hand, the competition point of the purchase site 32 with respect to the purchase site 31 is calculated as “45.72”, and it is estimated that the purchase site 32 is a competition target. Further, the competition point of the purchase site 31 with respect to the purchase site 32 is calculated as “85.18” as shown in FIG. 20, and it is estimated that the purchase site 31 is a competition target.
 ここで、算出された各競合点を比較すると、購入サイト31から見た購入サイト32の競合点よりも、購入サイト32から見た購入サイト31の競合点の方が高い結果となっている。これは、図19を参照して説明したように、2つの購入サイト31、32のうち、最終的には購入サイト31が利用され、購入サイト32が先に表示終了されたことが動的要素点(h)(i)として反映されたためである。 Here, when comparing the calculated competitive points, the competitive points of the purchase site 31 viewed from the purchase site 32 are higher than the competitive points of the purchase site 32 viewed from the purchase site 31. As described with reference to FIG. 19, the dynamic factor is that the purchase site 31 is finally used out of the two purchase sites 31 and 32 and the display of the purchase site 32 is terminated first. This is because the points (h) and (i) are reflected.
 このような推定結果を、例えば購入サイト32のサイト運営者が参照すると、ユーザが閲覧した多数あるWebサイトを含むビッグデータの中から、購入サイト31がより競合性が高いことが分かる。また、購入サイト32のサイト運営者は、競合性が高い購入サイト31に注目して対策を立てることが可能である。 When the operator of the purchase site 32 refers to such an estimation result, for example, it can be seen that the purchase site 31 is more competitive among big data including a large number of Web sites browsed by the user. Further, the site operator of the purchase site 32 can take measures by paying attention to the purchase site 31 having high competitiveness.
  <4-2.Webサイトと専用アプリケーションを利用した場合の推定処理>
 次に、ユーザが、関連性が高いWebサイトと専用アプリケーションを利用して交通探索をする場合の関係推定処理について、図21~図24を参照して説明する。図21~図23には、画面遷移図、図24には、算出表161-2をそれぞれ示す。
<4-2. Estimating process when using website and dedicated application>
Next, a relationship estimation process when a user searches for traffic using a highly relevant website and a dedicated application will be described with reference to FIGS. 21 to 23 show screen transition diagrams, and FIG. 24 shows a calculation table 161-2.
 なお上記実施例では、情報処理装置1が、PC(パーソンコンピュータ)で実現されている場合において、表示部でマルチウィンドウ表示されている複数のウィンドウ(Webサイト)間の関係推定を行った。これに対し、本実施例では、本開示による情報処理装置が、スマートフォン(高機能携帯電話端末)で実現されている場合において、表示部で複数表示されるウィンドウ間の関係推定を行う。 In the above embodiment, when the information processing apparatus 1 is realized by a PC (person computer), the relationship between a plurality of windows (Web sites) displayed in a multi-window on the display unit is estimated. On the other hand, in the present embodiment, when the information processing apparatus according to the present disclosure is realized by a smartphone (high function mobile phone terminal), the relationship between windows displayed on the display unit is estimated.
 通常、表示領域が比較的小さなモバイル端末(スマートフォン、携帯電話、タブレット端末等)では、1つのウィンドウが全画面で表示され、他のウィンドウを見るためには画面遷移を行う必要があった。しかし、本実施例では、複数のアプリケーションに対応する複数のウィンドウを並列して表示させることが可能なスマートフォンを新たに用いる。 Usually, in a mobile terminal (smart phone, mobile phone, tablet terminal, etc.) having a relatively small display area, one window is displayed in full screen, and it is necessary to perform screen transition in order to view other windows. However, in the present embodiment, a smartphone that can display a plurality of windows corresponding to a plurality of applications in parallel is newly used.
 かかるスマートフォン(情報処理装置100)は、例えばアスペクト比が略3:1で形成される表示部140を採用し、複数のウィンドウを、それぞれ表示領域高および表示領域幅が同じ1:1のピクセル縦横比(正方形ピクセル)で並列表示させることが可能である(図21~図23参照)。 Such a smartphone (information processing apparatus 100) employs, for example, the display unit 140 formed with an aspect ratio of approximately 3: 1, and each of the plurality of windows has a pixel area of 1: 1 with the same display area height and display area width. It is possible to display in parallel at a ratio (square pixel) (see FIGS. 21 to 23).
  (4-2-1.交通探索サイトの表示開始)
 図21は、交通探索サイトを表示させるまでの画面遷移を示す図である。図21上に示すように、ユーザは、ランチャー40から交通探索サイトを起動すると、図21下に示すように、交通探索サイト41の表示が開始される。交通探索サイト41は、Webブラウザにより表示されたWebサイトである。この際、推定処理部15は、表示開始イベントを検出し、算出表161-2において、交通探索サイト41(例えばタイトル「Hallo!路線情報」)と、交通探索サイト41の起動元(ここでは、ランチャー)の登録、および表示開始時刻の記憶を行う。
(4-2-1. Start of traffic search site display)
FIG. 21 is a diagram illustrating screen transitions until a traffic search site is displayed. As shown in the upper part of FIG. 21, when the user starts the traffic search site from the launcher 40, the display of the traffic search site 41 is started as shown in the lower part of FIG. The traffic search site 41 is a Web site displayed by a Web browser. At this time, the estimation processing unit 15 detects the display start event, and in the calculation table 161-2, the traffic search site 41 (for example, the title “Halo! Route information”) and the start source of the traffic search site 41 (here, (Launcher) registration and display start time storage.
 ユーザは、交通探索サイト41の出発駅入力欄に「A駅」、到着駅入力欄に「B駅」と入力し、検索ボタンをタップして、A駅からB駅への交通探索を開始する。しかしながら、交通探索結果の表示に時間がかかる場合、ユーザは、別の交通探索アプリケーションを新たに起動することが想定される。 The user inputs “Station A” in the departure station input field of the traffic search site 41 and “B Station” in the arrival station input field, and taps the search button to start a traffic search from the station A to the station B. . However, when it takes time to display the traffic search result, it is assumed that the user newly starts another traffic search application.
  (4-2-2.交通探索アプリケーションの表示開始)
 図22は、交通探索アプリケーションを表示させて同様に交通探索を開始するまでの画面遷移を示す図である。図22上に示すように、ユーザは、ランチャー40から交通探索の専用アプリケーションである交通探索アプリケーション42を起動する。ここで、表示部140において、ランチャー40、交通探索サイト41、交通探索アプリケーション42が、それぞれ正方形ピクセルの表示領域で並列して表示されている。
(4-2-2. Start of traffic search application display)
FIG. 22 is a diagram showing screen transitions until the traffic search application is displayed and the traffic search is similarly started. As shown in FIG. 22, the user activates a traffic search application 42 that is a dedicated application for traffic search from the launcher 40. Here, on the display unit 140, the launcher 40, the traffic search site 41, and the traffic search application 42 are displayed side by side in a display area of square pixels.
 この際、推定処理部15は、表示開始イベントを検出し、算出表161-2において、交通探索アプリケーション42(例えばタイトル「NAVI・NAVI」)と、起動元(ここでは、ランチャー)の登録、および表示開始時刻の記憶を行う。また、推定処理部15は、交通探索アプリケーション42にとって、表示されている他のウィンドウとなる交通探索サイト41を、算出表161-2において、比較対象のウィンドウとして登録する。なお算出表161-2において、交通探索サイト41の比較対象ウィンドウとして、交通探索アプリケーション42が追加される。 At this time, the estimation processing unit 15 detects the display start event, and in the calculation table 161-2, registers the traffic search application 42 (for example, the title “NAVI / NAVI”) and the activation source (here, the launcher), and Store the display start time. Further, the estimation processing unit 15 registers the traffic search site 41, which is the other displayed window, for the traffic search application 42 as a window to be compared in the calculation table 161-2. In the calculation table 161-2, a traffic search application 42 is added as a comparison target window of the traffic search site 41.
 さらに、推定処理部15の静的要素解析部152は、各比較対象のウィンドウに静的要素点を配点する。具体的には、例えば静的要素解析部152は、算出表161-2において、交通探索サイト41と、交通探索アプリケーション42の目的が一致する場合、静的要素点(d)として、「15.00点」を設定する。 Furthermore, the static element analysis unit 152 of the estimation processing unit 15 places static element points on each comparison target window. Specifically, for example, when the purpose of the traffic search site 41 and the traffic search application 42 match in the calculation table 161-2, the static element analysis unit 152 sets “15. 00 points "is set.
 また、動的要素解析部151は、2つのウィンドウ間で操作体/視線の移動が発生した場合には動的要素点(e)、(f)をそれぞれ配点する。 Also, the dynamic element analysis unit 151 assigns dynamic element points (e) and (f), respectively, when an operation body / line of sight movement occurs between two windows.
 また、図22下に示すように、ユーザが交通探索アプリケーション42の表示位置が中央に移動し、交通探索サイト41が画面端に移動された場合、ウィンドウ位置変更イベントが検出される。この場合、動的要素解析部151は、算出表161-2において、交通探索サイト41の対象ウィンドウ内の交通探索アプリケーション42に、動的要素点(c)「1.21」(図3参照)を配点する。 As shown in the lower part of FIG. 22, when the user moves the display position of the traffic search application 42 to the center and the traffic search site 41 is moved to the screen end, a window position change event is detected. In this case, the dynamic element analysis unit 151 applies the dynamic element point (c) “1.21” to the traffic search application 42 in the target window of the traffic search site 41 in the calculation table 161-2 (see FIG. 3). Scoring.
 また、ユーザは、交通探索アプリケーション42においても、出発駅入力欄に「A駅」、到着駅入力欄に「B駅」と入力し、検索ボタンをタップして、A駅からB駅への交通探索を開始する。 In the traffic search application 42, the user also inputs “A station” in the departure station input field and “B station” in the arrival station input field, taps the search button, and then travels from the A station to the B station. Start the search.
  (4-2-3.利用するアプリケーションの決定)
 次いで、交通探索サイト42よりも交通探索アプリケーション42の方が先に交通探索結果が表示された場合、ユーザは、交通探索アプリケーション42を利用することに決定し、交通探索サイト42を閉じて、決定した交通探索アプリケーション42で交通探索を続ける。以下、図23を参照して説明する。
(4-2-3. Determination of application to be used)
Next, when the traffic search result is displayed before the traffic search site 42, the user decides to use the traffic search application 42, closes the traffic search site 42, and decides The traffic search is continued by the traffic search application 42 that has been made. Hereinafter, a description will be given with reference to FIG.
 図23は、利用するアプリケーションを決定し、交通探索処理が終了するまでの画面遷移を示す図である。図23上に示すように、ユーザは、交通探索アプリケーション42を利用することに決定すると、不要になった交通探索サイト41のウィンドウを閉じ、交通探索アプリケーション42を全画面表示させる操作を行う。図23に示す各画面42a(メニュー画面)、42b(経路画面)、42c(地図画面)は、いずれも交通探索アプリケーション42の画面である。 FIG. 23 is a diagram showing screen transitions until the application to be used is determined and the traffic search process is completed. As shown in FIG. 23, when the user decides to use the traffic search application 42, the user closes the window of the traffic search site 41 that is no longer necessary, and performs an operation for displaying the traffic search application 42 on the full screen. Each of the screens 42a (menu screen), 42b (route screen), and 42c (map screen) shown in FIG. 23 is a screen of the traffic search application 42.
 この際、推定処理部15は、表示終了イベントを検出し、算出表161-2において、交通探索サイト41の表示終了時刻を確定させる。また、交通探索サイト41の表示終了時刻が確定すると、交通探索サイト41と時間的に並列して存在していた他のウィンドウ(交通探索アプリケーション42)との並列時間も確定され、算出表161-2に登録される。 At this time, the estimation processing unit 15 detects the display end event, and determines the display end time of the traffic search site 41 in the calculation table 161-2. When the display end time of the traffic search site 41 is determined, the parallel time with other windows (traffic search application 42) that existed in parallel with the traffic search site 41 is also determined, and the calculation table 161- 2 is registered.
 そして、図23下に示すように、交通探索アプリケーション42での交通探索処理が終了すると、交通探索アプリケーション42のウィンドウが閉じられ、情報処理装置100も画面ロック(スリープ)される。この際、推定処理部15は、表示終了イベントを検出し、算出表161-2において、交通探索アプリケーション42の表示終了時刻を確定させる。 23, when the traffic search process in the traffic search application 42 is completed, the window of the traffic search application 42 is closed and the information processing apparatus 100 is also locked (sleep). At this time, the estimation processing unit 15 detects the display end event, and determines the display end time of the traffic search application 42 in the calculation table 161-2.
 また、動的要素解析部151は、交通探索アプリケーション42の方が長く存在していたため、交通探索アプリケーション42に対しての対象ウィドウ(交通探索サイト41)の並列時間と動的要素点(h)を用いて動的要素点を算出し、算出表161-2に記録する。また、動的要素解析部151は、交通探索アプリケーション42の方が長く存在していた場合、対象ウィンドウ(交通探索サイト41)に対しての交通探索アプリケーション42の並列時間と動的要素点(i)を用いて動的要素点を算出し、算出表161-2に記録する。 In addition, since the traffic search application 42 has existed for a longer time, the dynamic element analysis unit 151 has a parallel time of the target window (traffic search site 41) with respect to the traffic search application 42 and a dynamic element point (h). The dynamic element point is calculated using and is recorded in the calculation table 161-2. In addition, when the traffic search application 42 has existed for a longer time, the dynamic element analysis unit 151 determines the parallel time of the traffic search application 42 for the target window (traffic search site 41) and the dynamic element point (i ) To calculate the dynamic element point and record it in the calculation table 161-2.
  (4-2-4.推定結果)
 推定処理部15による静的/動的要素点の配点が終了すると、競合点算出部153は、図24に示す算出表161-2を用いて、各ウィンドウと対象ウィンドウ間の競合点を算出する。ここで、複数ウィンドウ間の競合点は、例えば静的要素点および動的要素点を全て乗算することにより算出される。
(4-2-4. Estimation results)
When the estimation processing unit 15 finishes assigning the static / dynamic element points, the competition point calculation unit 153 calculates a competition point between each window and the target window using the calculation table 161-2 shown in FIG. . Here, the competing points between a plurality of windows are calculated by multiplying all of the static element points and the dynamic element points, for example.
 この結果、交通探索サイト41に対する交通探索アプリケーション42の競合点は、図24に示すように「86.59」と算出され、交通探索アプリケーション42が競合対象であることが推定される。また、交通探索アプリケーション42に対する交通探索サイト41の競合点は、図24に示すように「18.15」と算出され、交通探索サイト41が競合対象であることが推定される。 As a result, the competition point of the traffic search application 42 with respect to the traffic search site 41 is calculated as “86.59” as shown in FIG. 24, and it is estimated that the traffic search application 42 is a competition target. Further, the competition point of the traffic search site 41 with respect to the traffic search application 42 is calculated as “18.15” as shown in FIG. 24, and it is estimated that the traffic search site 41 is a competition target.
 ここで、算出された各競合点を比較すると、交通探索サイト41から見た交通探索アプリケーション42の競合点が、交通探索アプリケーション42から見た交通探索サイト41の競合点よりも高い結果となっている。これは、図22、図23を参照して説明したように、2つのアプリケーションのうち、最終的には交通探索アプリケーション42が利用され、交通探索サイト41が先に表示終了されたことが動的要素点(h)(i)として反映されたためである。 Here, when the calculated competition points are compared, the competition point of the traffic search application 42 viewed from the traffic search site 41 is higher than the competition point of the traffic search site 41 viewed from the traffic search application 42. Yes. As described with reference to FIG. 22 and FIG. 23, this is because the traffic search application 42 is finally used out of the two applications, and the traffic search site 41 is displayed first. This is because the element points (h) and (i) are reflected.
 このように、本実施例では、スマートフォン上で並列表示される複数のアプリケーション間の関係を推定することができる。特に、本実施例では、Webブラウザにより外部から取得して表示するWebサイトと、スマートフォン内部から取得して実行する専用アプリケーションとの関係を推定することが可能である。 Thus, in this embodiment, it is possible to estimate the relationship between a plurality of applications displayed in parallel on the smartphone. In particular, in this embodiment, it is possible to estimate the relationship between a Web site acquired and displayed from the outside by a Web browser and a dedicated application acquired and executed from inside the smartphone.
  (4-2-5.関連性の低いWebサイトと専用アプリケーションを利用した場合)
 上記実施例では、交通探索という目的が一致するWebサイトと専用アプリケーションを利用した場合の関係推定について説明した。ここで、関連性の低いWebサイトと専用アプリケーションを利用した場合の関係推定についても、図25を参照して説明する。本実施例においても、複数のアプリケーションを並列して表示部140に表示できる情報処理装置100が用いられる。
(4-2-5. When using less relevant websites and dedicated applications)
In the above-described embodiment, the relationship estimation in the case of using a website and a dedicated application that coincide with the purpose of traffic search has been described. Here, the relationship estimation in the case of using a low-relevance Web site and a dedicated application will also be described with reference to FIG. Also in this embodiment, the information processing apparatus 100 that can display a plurality of applications on the display unit 140 in parallel is used.
 図25は、関連性の低いWebサイトと専用アプリケーションを利用した場合について説明するための図である。図25上に示すように、ユーザは、音楽プレイヤーアプリケーション44を起動して音楽を聴きながら、図25下に示すように、ニュースサイト45を起動してニュースを閲覧している。 FIG. 25 is a diagram for explaining a case where a less relevant web site and a dedicated application are used. As shown in the upper part of FIG. 25, the user starts the news site 45 and browses the news as shown in the lower part of FIG. 25 while activating the music player application 44 and listening to music.
 この際、音楽プレイヤーアプリケーション44とニュースサイト45の目的が一致しないので、静的要素点(e)「5.00」が配点される。目的が一致する場合の静的要素点(d)「15.00」と比較して、低い点数とされる。これにより、長時間にわたって時間的に並列して両ウィンドウが表示され、動的要素点が高くなっても、算出される競合点はそれほど高くならない。推定処理部15は、音楽プレイヤーアプリケーション44とニュースサイト45の競合関係について、両ウィンドウの目的が一致する場合に比べて低い競合点を算出する。 At this time, since the purposes of the music player application 44 and the news site 45 do not match, the static element point (e) “5.00” is assigned. The score is lower than the static element point (d) “15.00” when the purposes match. As a result, both windows are displayed in parallel in time over a long period of time, and even if the dynamic element point is high, the calculated competitive point is not so high. The estimation processing unit 15 calculates a lower competitive point for the competitive relationship between the music player application 44 and the news site 45 than when both windows have the same purpose.
 かかる推定結果を参照し、例えばニュースサイト45の運営者は、音楽プレイヤーアプリケーションとの競合点算出を望まない場合、音楽プレイヤーアプリケーションをホワイトリストに追加することで、競合点を0.00にすることが可能である。また、競合性は低いが、「音楽を聴きながらニュースサイトが閲覧されることが多い」というユーザ行動から潜在ニーズを汲み取り、ニュースサイト45にもBGMや音楽再生機能を追加して集客力を向上させる等の対策を立てることが可能である。 By referring to the estimation result, for example, when the operator of the news site 45 does not want to calculate the competition point with the music player application, the competition point is set to 0.00 by adding the music player application to the white list. Is possible. Also, although the competitiveness is low, the potential needs are taken from the user behavior that “news sites are often viewed while listening to music”, and BGM and music playback functions are also added to the news site 45 to improve the ability to attract customers It is possible to take measures such as
  <4-3.同じアプリケーションを分割表示した場合の推定処理>
 上記実施例で用いた情報処理装置100は、複数のアプリケーションに対応する複数のウィンドウを並列して表示する他、単一のアプリケーションを複数に分割して表示することも可能である。この場合の複数ウィンドウ間の関係推定について、以下図26を参照して説明する。
<4-3. Estimation process when the same application is divided and displayed>
The information processing apparatus 100 used in the above embodiment can display a plurality of windows corresponding to a plurality of applications in parallel, and can also divide a single application into a plurality of displays. The relationship estimation between a plurality of windows in this case will be described below with reference to FIG.
 図26は、同じアプリケーションを分割表示した場合について説明するための画面遷移図である。ユーザは、図26左に示すように、情報処理装置100の表示部140において、ニュースサイト46を表示させてニュースを閲覧する。ニュースサイト46は、Webブラウザにより外部から取得されて表示されたWebサイトである。 FIG. 26 is a screen transition diagram for explaining a case where the same application is divided and displayed. The user browses the news by displaying the news site 46 on the display unit 140 of the information processing apparatus 100 as shown on the left in FIG. The news site 46 is a Web site acquired and displayed from the outside by a Web browser.
 ユーザは、ニュースサイトをスクロールしながらニュースを閲覧することができる。ここで、記事内に動画を発見した場合、ユーザは、動画を別画面で再生しながら、記事のスクロールを続けることが可能である。具体的には、図26中央に示すように、ユーザは、同じニュースサイトを複数ウィンドウで表示するよう操作し、ニュースサイト46bのウィンドウでは、動画が表示されている部分までスクロールして動画再生を開始する。 Users can browse news while scrolling through news sites. Here, when a moving image is found in the article, the user can continue scrolling the article while reproducing the moving image on another screen. Specifically, as shown in the center of FIG. 26, the user operates to display the same news site in a plurality of windows, and in the window of the news site 46b, scrolls to the portion where the video is displayed and plays the video. Start.
 一方、ニュースサイト46aのウィンドウでは、図26下に示すように、スクロールを継続させて記事を読み進めることができる。 On the other hand, in the window of the news site 46a, as shown in the lower part of FIG.
 このように、同じニュースサイト46を複数のウィンドウ(ニュースサイト46a、46b)で表示して閲覧できることで、情報処理装置100の利便性がさらに向上する。 Thus, the convenience of the information processing apparatus 100 is further improved by displaying and browsing the same news site 46 in a plurality of windows ( news sites 46a and 46b).
 この際、推定処理部15の静的要素解析部152は、両ウィンドウで表示されているWebサイトのドメインに基づいて、同一のウィンドウとみなす。同一のウィンドウであると判断された場合、図4に示すように、静的要素点(a)として「0.00」若しくはそれに近い値が配点されるので、同一のウィンドウ同士の競合性が高く算出されることを防ぐことができる。 At this time, the static element analysis unit 152 of the estimation processing unit 15 considers the same window based on the domain of the Web site displayed in both windows. When it is determined that they are the same window, as shown in FIG. 4, since “0.00” or a value close thereto is assigned as the static element point (a), the competition between the same windows is high. It can prevent being calculated.
  <4-4.推定処理の安定化>
 続いて、本実施形態による複数アプリケーション間の推定処理をより安定化させるための手法について以下図27~図29を参照して説明する。なお本実施例では、複数のアプリケーションに対応する複数のウィンドウを表示部140に並列して表示することが可能な情報処理装置100を用いて説明する。
<4-4. Stabilization of estimation process>
Subsequently, a method for further stabilizing the estimation process between a plurality of applications according to the present embodiment will be described with reference to FIGS. 27 to 29. FIG. In the present embodiment, a description will be given using the information processing apparatus 100 that can display a plurality of windows corresponding to a plurality of applications in parallel on the display unit 140.
  (4-4-1.ニュースサイトの静的要素解析)
 図27は、複数のニュースサイトを並べて閲覧している場合について説明するための図である。かかるニュースサイトが目的表やホワイト/ブラックリストに記載されていない場合、静的要素解析部152は、テキストマイニングを行って2つのウィンドウの近似程度を算出する。
(4-4-1. Static element analysis of news sites)
FIG. 27 is a diagram for explaining a case where a plurality of news sites are browsed side by side. If the news site is not listed in the purpose table or the white / black list, the static element analysis unit 152 performs text mining to calculate the approximate degree of the two windows.
 ここで、各ニュースサイトの内容は、日々のニュースにより変化する文字列により構成されるので、テキストマイニングによる静的要素解析の結果も日々変化するという特長がある。例えば図27上に示すように、ある日のニュースサイト47A、48Aでは、両者とも災害関連のニュースの見出しが主であるので、テキストマイニングにより算出される一致単語数は多くなり、静的要素点(f)による配点も高くなる。しかしながら、図27下に示すように、別の日のニュースサイト47B、48Bでは、一方で災害関連のニュース、他方で五輪関連のニュースの見出しが主であるため、テキストマイニングにより算出される一致単語数は少なくなり、静的要素点(f)による配点も低くなる。 Here, since the contents of each news site are composed of character strings that change according to daily news, the result of static element analysis by text mining also changes daily. For example, as shown in FIG. 27, in news sites 47A and 48A on a certain day, both of them are mainly disaster-related news headlines, so the number of matching words calculated by text mining increases, and static element points The score according to (f) also increases. However, as shown in the lower part of FIG. 27, the news sites 47B and 48B on different days mainly have headlines for disaster-related news on the one hand and Olympic-related news on the other hand, and therefore match words calculated by text mining. The number is reduced, and the score by the static element point (f) is also lowered.
 したがって、日々のニュースにより構成される文字列が変化するニュースサイトに対してテキストマイニング処理を行うと、ニュースサイトがピックアップするニュースによって静的要素点が変化する。このため、ニュースサイトに対してテキストマイニングによる静的要素解析を行った場合、その日のニュースサイトを構成するニュースに対して競合性が高い競合Webサイトが抽出される。 Therefore, when text mining processing is performed on a news site in which a character string composed of daily news changes, the static element point changes depending on the news picked up by the news site. For this reason, when static element analysis is performed on a news site by text mining, competing websites that are highly competitive with the news constituting the news site of the day are extracted.
 そこで、特定のWebサイトが、自社の競合サイトであることが明らかで、ニュースのピックアップ内容に依存せずに必ず競合対象として扱いたい場合、対象のアプリケーションをブラックリストに登録する。これにより、静的要素点として比較的高い配点を固定点として与えることが可能である(図4に示す静的要素点(c)参照)。 Therefore, if it is clear that a specific Web site is a competing site of the company, and the user wants to treat it as a competing target without depending on the content of news pickup, the target application is registered in the black list. This makes it possible to give a relatively high score as a static element point as a fixed point (see the static element point (c) shown in FIG. 4).
 このように、本実施例では、ブラックリストを用いることで日々変化するニュースサイトの静的要素点を安定化することができる。 In this way, in this embodiment, the static element points of news sites that change daily can be stabilized by using the black list.
  (4-4-2.目的が異なるWebサイトの静的要素解析)
 図28は、目的が異なる複数のWebサイトを並べて閲覧している場合について説明するための図である。図28に示すように、表示部140では、ECサイト49とオークションアプリケーション50が並べて表示されている。
(4-4-2. Static element analysis of websites with different purposes)
FIG. 28 is a diagram for explaining a case where a plurality of websites with different purposes are browsed side by side. As shown in FIG. 28, on the display unit 140, the EC site 49 and the auction application 50 are displayed side by side.
 この際、静的要素解析部152が目的表(図6参照)にしたがって各ウィンドウの静的要素を解析した場合、ECサイト49の目的は「購買」、オークションアプリケーション50の目的は「オークション」であって、両者の目的は一致しないため、競合性が低いと解析される。しかしながら、実際は同じ商品をECサイト49とオークションアプリケーション50で見比べてどちらで購入するかが検討される競合関係にあっても、目的が異なることで競合性が低いと推定されてしまうと、他のWebサイトや専用アプリケーションに埋もれてしまう恐れがある。 At this time, when the static element analysis unit 152 analyzes the static element of each window according to the purpose table (see FIG. 6), the purpose of the EC site 49 is “purchase” and the purpose of the auction application 50 is “auction”. Because the purpose of both does not match, it is analyzed that the competitiveness is low. However, in reality, even if there is a competitive relationship in which the same product is compared with the EC site 49 and the auction application 50 and is considered to be purchased, if the purpose is different and it is estimated that the competitiveness is low, There is a risk of being buried in a Web site or a dedicated application.
 そこで、特定のWebサイトまたは専用アプリケーションが、自社の競合サイトであることが明らかで、目的が一致するか否かに関わらず競合対象として扱いたい場合、対象のアプリケーションをブラックリストに登録する。これにより、静的要素点として比較的高い配点を固定点として与えることが可能である(図4に示す静的要素点(c)参照)。 Therefore, when it is clear that a specific website or dedicated application is a competitor site of the company and it is desired to treat it as a competing target regardless of whether or not the purpose matches, the target application is registered in the black list. This makes it possible to give a relatively high score as a static element point as a fixed point (see the static element point (c) shown in FIG. 4).
 このように、本実施例では、ブラックリストを用いることで、目的が異なる他のWebサイトや専用アプリケーションの静的要素点を安定化することができる。 Thus, in this embodiment, by using the black list, it is possible to stabilize the static element points of other websites and dedicated applications with different purposes.
  (4-4-3.自社系列サイトの静的要素解析)
 図29は、同じグループ会社の2つのWebサイトを並べて閲覧している場合について説明するための図である。図29に示すように、表示部140では、ECサイト51とECサイト52が並べて表示されている。
(4-4-3. Static element analysis of company affiliated sites)
FIG. 29 is a diagram for explaining a case where two websites of the same group company are browsed side by side. As shown in FIG. 29, on the display unit 140, the EC site 51 and the EC site 52 are displayed side by side.
 ここで、ECサイト51とECサイト52は、両者とも「専用アプリケーションの購買」を目的とするウィンドウであって、競合性が高いと推定される。この場合、推定結果を参照したECサイト51の運営者は、競合サイトとしてピックアップされたECサイト52が、自社のグループ会社のものである場合、Webサイトの重複を無くして一本化する等の効率化対策を採ることができる。 Here, it is estimated that the EC site 51 and the EC site 52 are both windows for the purpose of “purchasing a dedicated application” and have high competitiveness. In this case, the operator of the EC site 51 that refers to the estimation result, for example, if the EC site 52 picked up as a competing site belongs to its own group company, eliminates duplication of websites, etc. Efficiency measures can be taken.
 また、ECサイト51とECサイト52が同時に閲覧されることが想定通りであって、競合関係の推定が不要である場合、ECサイト51の運営者は、ECサイト52をホワイトリストに登録する。これにより、静的要素点として「0.00」を固定点として与えることが可能である(図4に示す静的要素点(b)参照)。 In addition, when it is assumed that the EC site 51 and the EC site 52 are browsed at the same time and it is not necessary to estimate the competitive relationship, the operator of the EC site 51 registers the EC site 52 in the white list. Thereby, “0.00” can be given as a static element point as a fixed point (see the static element point (b) shown in FIG. 4).
  <<5.まとめ>>
 上述したように、本開示の実施形態による関係推定システムは、ユーザがどのようなアプリケーションを同時に利用しているかを分析し、利用されている複数アプリケーション間の関係を推定することができる。各アプリケーションの製作者、運営者は、推定結果を参照することで、消費者の潜在的なニーズを把握することができる。
<< 5. Summary >>
As described above, the relationship estimation system according to the embodiment of the present disclosure can analyze what applications the user is using at the same time, and can estimate the relationship among a plurality of applications being used. The creator and operator of each application can grasp the potential needs of consumers by referring to the estimation results.
 また、本実施形態では、時間的に並列に表示されていた時間(同時に利用されていた時間)という要素(図3に示す動的要素点(h)(i))だけではなく、ユーザによるウィンドウ操作(図3に示す動的要素点(c)~(g))も考慮して、より正確に関係推定を行うことができる。 In the present embodiment, not only the element (the dynamic element point (h) (i) shown in FIG. 3) of the time displayed in parallel in time (the time used simultaneously) but also the window by the user Considering the operation (dynamic element points (c) to (g) shown in FIG. 3), the relationship can be estimated more accurately.
 また、本実施形態では、静的要素解析時に利用されるブラック/ホワイトリスト、目的表、静的要素配点表や、動的要素解析時に利用される動的要素配点表を、適宜Webサイト運営者側の意図や必要に応じて更新していくことで、目的に合わせた関係推定結果を得ることができる。 In this embodiment, a black / white list, a purpose table, a static element score table used for static element analysis, and a dynamic element score table used for dynamic element analysis are appropriately stored on the website operator. By updating it according to the intention and necessity of the side, it is possible to obtain a relationship estimation result tailored to the purpose.
 また、本実施形態では、近年増え続けるWebサイトや専用アプリケーションといったビッグデータの中から、競合性が高いアプリケーションを抽出することができるので、Webサイトや専用アプリケーションの運営者は、競合他社に対する対策を効率的に行うことができる。 Also, in this embodiment, since highly competitive applications can be extracted from big data such as Web sites and dedicated applications that have been increasing in recent years, operators of Web sites and dedicated applications can take measures against competitors. Can be done efficiently.
 また、本実施形態では、外部から取得したデータに基づいてWebサイトを再生するWebブラウザと、内部または外部に記憶されているプログラムに基づいて実行される専用アプリケーションとの関係も推定することが可能である。 In this embodiment, it is also possible to estimate the relationship between a Web browser that reproduces a Web site based on data acquired from the outside and a dedicated application that is executed based on a program stored inside or outside. It is.
 以上、添付図面を参照しながら本開示の好適な実施形態について詳細に説明したが、本技術はかかる例に限定されない。本開示の技術分野における通常の知識を有する者であれば、特許請求の範囲に記載された技術的思想の範疇内において、各種の変更例または修正例に想到し得ることは明らかであり、これらについても、当然に本開示の技術的範囲に属するものと了解される。 The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present technology is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.
 例えば、上記実施形態および上記各実施例では、複数アプリケーションの競合関係を推定(競合点を算出)しているが、本実施形態はこれに限定されず、複数アプリケーションの共存関係や、親和性の高低を推定することも可能である。 For example, in the above embodiment and each of the above examples, the competitive relationship of multiple applications is estimated (competitive points are calculated), but this embodiment is not limited to this, and the coexistence relationship of multiple applications and the affinity It is also possible to estimate the height.
 また、本実施形態による情報処理装置1、100は、図1に示すノートPCや、図21に示すスマートフォンに限定されず、デスクトップ型PC、モバイル端末、またはウェアラブル装置(例えばメガネ型HMD、時計型デバイス)等であってもよい。 Further, the information processing apparatuses 1 and 100 according to the present embodiment are not limited to the notebook PC illustrated in FIG. 1 or the smartphone illustrated in FIG. 21, but are a desktop PC, a mobile terminal, or a wearable device (for example, glasses-type HMD, watch-type Device).
 また、情報処理装置1、100、サーバ2に内蔵されるCPU、ROM、およびRAM等のハードウェアに、情報処理装置1、100、サーバ2の機能を発揮させるためのコンピュータプログラムも作成可能である。また、当該コンピュータプログラムを記憶させたコンピュータ読み取り可能な記憶媒体も提供される。 It is also possible to create a computer program for causing hardware such as the CPU, ROM and RAM incorporated in the information processing apparatuses 1 and 100 and the server 2 to exhibit the functions of the information processing apparatuses 1 and 100 and the server 2. . A computer-readable storage medium storing the computer program is also provided.
 また、本明細書に記載された効果は、あくまで説明的または例示的なものであって限定的ではない。つまり、本開示に係る技術は、上記の効果とともに、または上記の効果に代えて、本明細書の記載から当業者には明らかな他の効果を奏しうる。 In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.
 なお、本技術は以下のような構成も取ることができる。
(1)
 外部からの操作入力を受け付ける入力部と、
 前記入力部により受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するシステム処理部と、
 前記システム処理部から出力されたイベントに応じて、複数のアプリケーションの処理を実行するアプリケーション処理部と、
 前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定する推定部と、
を備える、情報処理装置。
(2)
 前記推定部は、複数のアプリケーションに対するウィンドウ操作に応じて、前記複数のアプリケーション同士の互いの関係を推定する、前記(1)に記載の情報処理装置。
(3)
 前記情報処理装置は、視線検出部をさらに備え、
 前記推定部は、前記システム処理部を介して入力された、前記視線検出部により検出された視線情報に応じて、前記複数のアプリケーション同士の互いの関係を推定する、前記(1)または(2)に記載の情報処理装置。
(4)
 前記複数のアプリケーションのうち、第1のアプリケーションは、ローカルに記録されたコンテンツを処理し、第2のアプリケーションは、外部から所得したコンテンツを処理する、前記(1)~(3)のいずれか1項に記載の情報処理装置。
(5)
 前記情報処理装置は、
 前記推定部により推定された関係を、アプリケーション毎にログとして蓄積する蓄積部をさらに備える、前記(1)~(4)のいずれか1項に記載の情報処理装置。
(6)
 前記推定部は、前記複数のアプリケーション同士が互いに競合関係または共存関係にあることを推定する、前記(1)~(5)のいずれか1項に記載の情報処理装置。
(7)
 前記推定部は、前記イベントに応じて、前記複数のアプリケーションに対応する複数のウィンドウの静的要素および動的要素の少なくともいずれかを解析し、前記複数のアプリケーション同士の互いの関係を推定する、前記(1)~(6)のいずれか1項に記載の情報処理装置。
(8)
 前記静的要素は、ユーザ操作によっては変化し得ない要素である、前記(7)に記載の情報処理装置。
(9)
 前記動的要素は、ユーザによるウィンドウ操作によって変化し得る要素である、前記(7)に記載の情報処理装置。
(10)
 前記ウィンドウ操作によって変化し得る要素には、ウィンドウの表示位置、表示面積の変化、操作対象/注目対象の変更、およびウィンドウの操作時間、注目時間、表示時間の少なくともいずれかを含む、前記(9)に記載の情報処理装置。
(11)
 コンピュータを、
 外部からの操作入力を受け付ける入力部と、
 前記入力部により受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するシステム処理部と、
 前記システム処理部から出力されたイベントに応じて、複数のアプリケーションの処理を実行するアプリケーション処理部と、
 前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定する推定部と、
として機能させるプログラムが記憶された、記憶媒体。
(12)
 外部からの操作入力を受け付けるステップと、
 受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するステップと、
 前記出力されたイベントに応じて、複数のアプリケーションの処理を実行するステップと、
 前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定するステップと、
を含む、制御方法。
In addition, this technique can also take the following structures.
(1)
An input unit that accepts external operation inputs;
A system processing unit for outputting an event to a plurality of specific applications in accordance with an input signal received by the input unit;
In response to an event output from the system processing unit, an application processing unit that executes processing of a plurality of applications,
In response to the event, an estimation unit that estimates a mutual relationship between the plurality of applications,
An information processing apparatus comprising:
(2)
The information processing apparatus according to (1), wherein the estimation unit estimates a mutual relationship between the plurality of applications according to a window operation with respect to the plurality of applications.
(3)
The information processing apparatus further includes a line-of-sight detection unit,
The estimation unit estimates a mutual relationship between the plurality of applications according to the line-of-sight information detected by the line-of-sight detection unit input via the system processing unit. ).
(4)
Of the plurality of applications, the first application processes locally recorded content, and the second application processes content acquired from the outside, any one of (1) to (3) The information processing apparatus according to item.
(5)
The information processing apparatus includes:
The information processing apparatus according to any one of (1) to (4), further including an accumulation unit that accumulates the relationship estimated by the estimation unit as a log for each application.
(6)
The information processing apparatus according to any one of (1) to (5), wherein the estimation unit estimates that the plurality of applications have a competition relationship or a coexistence relationship with each other.
(7)
The estimation unit analyzes at least one of a static element and a dynamic element of a plurality of windows corresponding to the plurality of applications according to the event, and estimates a mutual relationship between the plurality of applications. The information processing apparatus according to any one of (1) to (6).
(8)
The information processing apparatus according to (7), wherein the static element is an element that cannot be changed by a user operation.
(9)
The information processing apparatus according to (7), wherein the dynamic element is an element that can be changed by a window operation by a user.
(10)
The elements that can be changed by the window operation include at least one of a window display position, a display area change, an operation target / attention target change, and a window operation time, attention time, and display time. ).
(11)
Computer
An input unit that accepts external operation inputs;
A system processing unit for outputting an event to a plurality of specific applications in accordance with an input signal received by the input unit;
In response to an event output from the system processing unit, an application processing unit that executes processing of a plurality of applications,
In response to the event, an estimation unit that estimates a mutual relationship between the plurality of applications,
A storage medium storing a program that functions as a computer.
(12)
A step of accepting an operation input from the outside;
Outputting an event to a plurality of specific applications according to the received input signal;
Executing a plurality of application processes in response to the output event;
In response to the event, estimating a mutual relationship between the plurality of applications;
Including a control method.
 1、100  情報処理装置
 3  ネットワーク
 2  サーバ
 11  入力部
 12  システム処理部
 13  アプリケーション処理部
 14  出力部
 140  表示部
 15  推定処理部
 151  動的要素解析部
 152  静的要素解析部
 153  競合点算出部
 16  推定結果記憶部
 17  配点表記憶部
 18  通信部
 21  通信部
 22  目的表記憶部
 23  ホワイト/ブラックリスト記憶部
DESCRIPTION OF SYMBOLS 1,100 Information processing apparatus 3 Network 2 Server 11 Input part 12 System processing part 13 Application processing part 14 Output part 140 Display part 15 Estimation processing part 151 Dynamic element analysis part 152 Static element analysis part 153 Competitive point calculation part 16 Estimation Result storage unit 17 Scoring table storage unit 18 Communication unit 21 Communication unit 22 Objective table storage unit 23 White / black list storage unit

Claims (12)

  1.  外部からの操作入力を受け付ける入力部と、
     前記入力部により受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するシステム処理部と、
     前記システム処理部から出力されたイベントに応じて、複数のアプリケーションの処理を実行するアプリケーション処理部と、
     前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定する推定部と、
    を備える、情報処理装置。
    An input unit that accepts external operation inputs;
    A system processing unit for outputting an event to a plurality of specific applications in accordance with an input signal received by the input unit;
    In response to an event output from the system processing unit, an application processing unit that executes processing of a plurality of applications,
    In response to the event, an estimation unit that estimates a mutual relationship between the plurality of applications,
    An information processing apparatus comprising:
  2.  前記推定部は、複数のアプリケーションに対するウィンドウ操作に応じて、前記複数のアプリケーション同士の互いの関係を推定する、請求項1に記載の情報処理装置。 The information processing apparatus according to claim 1, wherein the estimation unit estimates a mutual relationship between the plurality of applications in accordance with a window operation with respect to the plurality of applications.
  3.  前記情報処理装置は、視線検出部をさらに備え、
     前記推定部は、前記システム処理部を介して入力された、前記視線検出部により検出された視線情報に応じて、前記複数のアプリケーション同士の互いの関係を推定する、請求項1に記載の情報処理装置。
    The information processing apparatus further includes a line-of-sight detection unit,
    The information according to claim 1, wherein the estimation unit estimates a mutual relationship between the plurality of applications according to line-of-sight information detected by the line-of-sight detection unit input via the system processing unit. Processing equipment.
  4.  前記複数のアプリケーションのうち、第1のアプリケーションは、ローカルに記録されたコンテンツを処理し、第2のアプリケーションは、外部から所得したコンテンツを処理する、請求項1に記載の情報処理装置。 The information processing apparatus according to claim 1, wherein among the plurality of applications, a first application processes content recorded locally, and a second application processes content obtained from outside.
  5.  前記情報処理装置は、
     前記推定部により推定された関係を、アプリケーション毎にログとして蓄積する蓄積部をさらに備える、請求項1に記載の情報処理装置。
    The information processing apparatus includes:
    The information processing apparatus according to claim 1, further comprising an accumulation unit that accumulates the relationship estimated by the estimation unit as a log for each application.
  6.  前記推定部は、前記複数のアプリケーション同士が互いに競合関係または共存関係にあることを推定する、請求項1に記載の情報処理装置。 The information processing apparatus according to claim 1, wherein the estimation unit estimates that the plurality of applications are in a competition relationship or a coexistence relationship with each other.
  7.  前記推定部は、前記イベントに応じて、前記複数のアプリケーションに対応する複数のウィンドウの静的要素および動的要素の少なくともいずれかを解析し、前記複数のアプリケーション同士の互いの関係を推定する、請求項1に記載の情報処理装置。 The estimation unit analyzes at least one of a static element and a dynamic element of a plurality of windows corresponding to the plurality of applications according to the event, and estimates a mutual relationship between the plurality of applications. The information processing apparatus according to claim 1.
  8.  前記静的要素は、ユーザ操作によっては変化し得ない要素である、請求項7に記載の情報処理装置。 The information processing apparatus according to claim 7, wherein the static element is an element that cannot be changed by a user operation.
  9.  前記動的要素は、ユーザによるウィンドウ操作によって変化し得る要素である、請求項7に記載の情報処理装置。 The information processing apparatus according to claim 7, wherein the dynamic element is an element that can be changed by a window operation by a user.
  10.  前記ウィンドウ操作によって変化し得る要素には、ウィンドウの表示位置、表示面積の変化、操作対象/注目対象の変更、およびウィンドウの操作時間、注目時間、表示時間の少なくともいずれかを含む、請求項9に記載の情報処理装置。 The element that can be changed by the window operation includes at least one of a window display position, a display area change, an operation target / attention target change, and a window operation time, attention time, and display time. The information processing apparatus described in 1.
  11.  コンピュータを、
     外部からの操作入力を受け付ける入力部と、
     前記入力部により受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するシステム処理部と、
     前記システム処理部から出力されたイベントに応じて、複数のアプリケーションの処理を実行するアプリケーション処理部と、
     前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定する推定部と、
    として機能させるプログラムが記憶された、記憶媒体。
    Computer
    An input unit that accepts external operation inputs;
    A system processing unit for outputting an event to a plurality of specific applications in accordance with an input signal received by the input unit;
    In response to an event output from the system processing unit, an application processing unit that executes processing of a plurality of applications,
    In response to the event, an estimation unit that estimates a mutual relationship between the plurality of applications,
    A storage medium storing a program that functions as a computer.
  12.  外部からの操作入力を受け付けるステップと、
     受け付けた入力信号に応じて特定の複数のアプリケーションにイベントを出力するステップと、
     前記出力されたイベントに応じて、複数のアプリケーションの処理を実行するステップと、
     前記イベントに応じて、前記複数のアプリケーション同士の互いの関係を推定するステップと、
    を含む、制御方法。
    A step of accepting an operation input from the outside;
    Outputting an event to a plurality of specific applications according to the received input signal;
    Executing a plurality of application processes in response to the output event;
    In response to the event, estimating a mutual relationship between the plurality of applications;
    Including a control method.
PCT/JP2014/071242 2013-10-15 2014-08-11 Information processing device, storage medium, and control method WO2015056482A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013-214613 2013-10-15
JP2013214613 2013-10-15

Publications (1)

Publication Number Publication Date
WO2015056482A1 true WO2015056482A1 (en) 2015-04-23

Family

ID=52827935

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/071242 WO2015056482A1 (en) 2013-10-15 2014-08-11 Information processing device, storage medium, and control method

Country Status (1)

Country Link
WO (1) WO2015056482A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10260810A (en) * 1997-03-17 1998-09-29 Toshiba Corp Window display controller, and method for controlling display of window
JP2007213527A (en) * 2006-02-13 2007-08-23 Internatl Business Mach Corp <Ibm> System for controlling display of window and method therefor
JP2009157537A (en) * 2007-12-25 2009-07-16 Fuji Xerox Co Ltd Information processor, information processing system, and information processing program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10260810A (en) * 1997-03-17 1998-09-29 Toshiba Corp Window display controller, and method for controlling display of window
JP2007213527A (en) * 2006-02-13 2007-08-23 Internatl Business Mach Corp <Ibm> System for controlling display of window and method therefor
JP2009157537A (en) * 2007-12-25 2009-07-16 Fuji Xerox Co Ltd Information processor, information processing system, and information processing program

Similar Documents

Publication Publication Date Title
US9760541B2 (en) Systems and methods for delivery techniques of contextualized services on mobile devices
US11112867B2 (en) Surfacing related content based on user interaction with currently presented content
US8943440B2 (en) Method and system for organizing applications
US9020845B2 (en) System and method for enhanced shopping, preference, profile and survey data input and gathering
US9285958B1 (en) Browser interface for accessing predictive content
US20140195890A1 (en) Browser interface for accessing supplemental content associated with content pages
CA2861616C (en) Method and system to provide a scroll map
CN104272306B (en) Turn over forward
US9830388B2 (en) Modular search object framework
CN105283834A (en) Temporal element restoration in augmented reality systems
US20120290974A1 (en) Systems and methods for providing a discover prompt to augmented content of a web page
US20170139548A1 (en) Systems and methods for a rotating three-dimensional menu
US9704180B2 (en) Distribution device, terminal device, distribution method, and non-transitory computer readable storage medium
US9679081B2 (en) Navigation control for network clients
US20150317319A1 (en) Enhanced search results associated with a modular search object framework
JP2015191551A (en) Electronic device
US11874893B2 (en) Modularizing and embedding supplemental textual and visual content in different environments
RU2683482C2 (en) Method of displaying relevant contextual information
JP5568195B1 (en) SEARCH SYSTEM, SEARCH CONDITION SETTING DEVICE, SEARCH CONDITION SETTING DEVICE CONTROL METHOD, PROGRAM, AND INFORMATION STORAGE MEDIUM
JP6224682B2 (en) Information display program, information display device, information display method, and distribution device
JP6158903B2 (en) Information display program, information display device, information display method, and distribution device
WO2015056482A1 (en) Information processing device, storage medium, and control method
US20170153905A1 (en) User quest-anchored active digital memory assistant
US10628848B2 (en) Entity sponsorship within a modular search object framework
US20120179544A1 (en) System and Method for Computer-Implemented Advertising Based on Search Query

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14854553

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 14854553

Country of ref document: EP

Kind code of ref document: A1