KR20170078103A - Personal Secretary Information System - Google Patents

Abstract

The personal assistant module can be scanned up to the personal secretary module, and the personal secretary module can be reproduced with the 3D printer. Therefore, the 3D image sensor is required to express the secret information at the time of the realistic scan.

Description

Personal secretary information system {.

It is about personal secretary information system.

Korean Patent Publication No. 20140093462

Korea Patent Publication No. 20130020018

Korea Patent Publication No. 20110059178

Korean Patent Publication No. 20040088975

Korean Patent Publication No. 20010102771

Korean Patent Publication No. 20140126485

Korea Patent Publication No. 20130018105

Korea Patent Publication No. 20110062394

Korea Patent Publication No. 20070077185

Korea Patent Publication No. 20070096260

Korean Patent Publication No. 20000030872

Korean Patent Publication 20060030788

Korea Patent Publication No. 20020069987

Korean Patent Publication No. 20130095333

It is about personal secretary information system.

It solves the problem of personal secretary information system.

The personal assistant information system can be easily provided.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first remote secretarial component may be termed a second remote secretarial component, and similarly, a second remote secretarial component may also be termed a first remote secretarial component . And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

When an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements It should be understood that it may exist. On the other hand, when a component of a remote secretary is referred to as being "directly connected" or "directly connected" to another component, it should be understood that no other component is intervening.

The personal assistant module used in the present application is used only to describe a specific embodiment and is not intended to limit the present invention. The singular phrase "personal assistant module " includes plural expressions," personal assistant modules ", unless the context clearly indicates otherwise.

Accordingly, the distance or time separated personal secretary modules are related to each other and can display a plurality of secretaries by receiving the customer's preference in advance. A distance secretor module that displays distant personal assistant modules; a time secretor module that displays the distance secretor module in a time-separated and disjointed display through a control unit in an off or pre-set schedule; An association secretary module for transmitting association secretaries so as to keep the associativeness of the secretaries, a customer preference module for receiving a preference of the customer among the secretaries displayed in the distance secretarial module and the time secretary module, and the like.

In this application, the term "comprising" or "having ", etc. in the context of an individual secretary module means that information generated from features, numbers, steps, operations, components, parts, And does not preclude the presence or addition of one or more other features, numbers, steps, operations, components, components, or combinations thereof.

That is, a new module may be included so that information generated from the features, numbers, steps, operations, components, parts, or combinations thereof of the electrical device (DB) including the personal secretary module naturally flows out and is displayed. For example, the personal secretary module related to the step may display each step with a difference of time or distance.

Unless otherwise defined, all remote secretarial terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the relevant art and are to be interpreted in an ideal or overly formal sense unless explicitly defined in the present application Do not.

The personal secretary module can express the secretary information at the time.

A 3D image sensor is required for this.

The present invention is a device for inputting, storing, and outputting all information or generated information of a human-created constructor, for example, dimensions of an object, secretarial information, a personal secretary module, time information and the like.

For example, this information can be used to scan personal assistant modules (such as mobile robots and cleaning robots) and reproduce personal secretary modules with a 3D printer, so that they can express the secret information at the time of the real-time scanning.

A 3D image sensor is required for this.

To do this, we analyze the personal secretary module input secretary event pattern to expand realistic personal secretary module area, and expand the personal secretary module area based on analyzed personal secretary module input secretary event pattern.

The personal assistant module input secretary event pattern is data pattern information that includes the personal secretary module used at that time in the product at that time. Here, you can refer to the secretarial information, secretarial information, secretarial request information (TOC) of the collaborator request information that can be communicated through the SNS conversation or the various databases or the Internet for the personal secretary module used at the time of the product at that time I will.

This personal secretary module input secretary event pattern can deduce various information to be connected on-line by using an ontology method or can be stored in a database in advance.

All information or generated information of human-created constructs, such as dimensions of objects, secretarial information, personal secretary modules, and time information, may be technical ideas using natural laws. Of these, the personal secretary module may be a characteristic of technical thought.

Hereinafter, all the apparatuses involved in the step of referring to data relating to one or more secretarial information, secretarial information, and secretarial request information associated therewith will be dealt with.

Hereinafter, a data processing system or method that is particularly suited for management, commercial, secretarial information, management, supervision or prediction involving special data processing is described.

 The secretarial information, the secretarial information, and the secretarial request information based on the specific calculation model can be used in various electronic devices such as electronic devices, various secretarial devices, navigation devices, global positioning system receivers, automobile infotainment devices, : Marine navigation device and gyro compass, etc.), avionics, or security devices.

An electronic device that exposes all information or generated information of a human-created structure, such as dimensions of objects, secretarial information, personal secretary modules, time information, etc., (E.g., water, electricity, gas, or radio waves, etc.), an electronic board, an electronic signature receiving device, a projector, have.

An electronic device that receives all the information of a human-created construct according to various embodiments of the present invention may be one or more of the various devices described above. For example, a secretary device and an electronic sign input device.

Another important secretary information, secretarial information, and secretarial request information that are leaked from the secretarial device are patient information.

It should also be apparent to those skilled in the art that the electronic device according to various embodiments of the present invention is not limited to the above-described devices.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user employed in various embodiments may be referred to as including a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

The secretarial information, the secretarial providing information, and the secretarial request information processing process are operated by the following classification processing.

1. Class - Defines attributes and behaviors belonging to the same class (or for problem solving), and is a basic user defined data type of an object-oriented program. have. The class is not a programmer, but it can be used by anyone who is working in the area where the problem is to be solved, and should be designed independently of other classes or external elements

2. Object - An instance of the class (actually, secretary information, secretarial information, and secretary request information mapping allocated to the storage body). An object has its own attribute and can perform the behavior defined in the class. The behavior of the object economically uses secretarial information, secretarial information, secretary request information mapping storage by sharing the definition of the behavior defined in the class.

3. Method, Message - A method of using an object created from a class to send an instruction to an object. A method is used to manipulate the properties of an object in the form of subroutines of an object. Communication between objects is done through messages.

<The following is an industry related field where remote secretarial consultation data can be applied>

 Main server / Big data DB system (Analog secretary information, Secretarial information, Assistant secret information main server / Big data DB G06G7 / 60)

. {Biomolecule secretarial information, secretarial information, secretarial request information Main server / Big data DB, ie. Using biomolecules, proteins, cells (using DNA G06N3 / 123; using neurons G06N3 / 061)

. {Artificial life, that is. Secretary information, secretarial information, secretary request information Main server / big data DB simulating life}

Based on simulating virtual personal or group life forms, eg. Single "Avatar", social simulation, virtual world

(Secretarial information, secretarial information, secretary request information main server / big data DB game A63F13 / 00;

Secretary simulation G06F19 / 00;

Information retrieval G06F17 / 30873;

Image processing G06T;

Telecommunications Protocol H04L29 / 06034)}

Based on physical entities controlled by simulated intelligence for intelligent lifestyle simulations, eg. A robot that simulates the appearance or behavior of a pet or person

Toys or dolls A63H3 / 00;

Industrial robot control

Artificial neural network

Rule - based artificial intelligence G06N5 / 00)}

. Using neural network models (for adaptive control G05B13 / 00; for image pattern matching G06K9 / 00; for image data processing G06T1 / 20; for voice pattern matching G10L15 / 16)

.. architecture, eg. Interconnect network topology

... {Adaptive Resonance Theory (ART) Network]: Integrates new knowledge automatically and consistently into the whole knowledge base so that what was learned in the past is not erased by new learning.

... {using chaos or fractal principles}

... {in combination with specialized systems}

... {in combination with fuzzy logic}; It consists of a fuzzifier, a rule base, a fuzzy inference engine, and a defuzzifier. A fuzzy controller can achieve better performance than a conventional nonlinear controller by dividing a fuzzy set into a complex nonlinear system and constructing a rule base for each region.

... {Feedback network, yes. Hop field network, associative network}; In the field of network data compression,

It is one of the traditional and effective ways to reduce traffic. The data of the sensor network has a temporal / spatial relation, and there are data compression techniques using these characteristics. A sensor node can communicate within a limited range and utilize only data within its own communication radius.

... {using a combination with multiple neural networks}

As used herein, the term " personal secretary module collaborative document " in connection with a remote secretary is used herein to refer to any machine-readable machine-storable work product, Should be interpreted broadly as including.

A private secretary module collaborator may include, for example, an email, a web page or site, a business listing, a file, a combination of files, one or more files embedded with links to other files, Blogs, and unidirectional delivery of personal assistant modules (e.g., online secretary). Personal assistant modules Collaborators often include textual information and may include embedded information (meta information, images, hyperlinks, etc.) and / or embedded instructions (such as JavaScript).

If the term "link" is used here, any reference to any private secretary module collaborator from another private secretary module collaborator or any other part of the same private secretary module collaborator, It should be broadly interpreted to include any references to other private secretary module co-operatives from the secretarial module co-operative or to other parts of the same private secretarial module co-operative.

The personal payment assistant application returns a comparison of these ratios and other valuation metrics for companies A and B. The personal secretary module and the main server / big data DB system receive the query from the user through the valuation metrics module. In addition, the personal secretary module, the main server / big data DB system, receives the context for one or more applications that are passed during the current search session. Using one or more ontologies, the personal assistant module, the main server / Big Data DB system, understands the query and the context to generate a semantic representation of the context and query of the application that the user forms the query. The concepts, examples, characteristics and relationships of the remote secretary are included in the semantic representation of the query based on the classification, template or definition contained in the ontology. In one embodiment, a semantic representation is a graph of a query using extracted concepts, examples, characteristics, and relationships. As a result, the remote secretary-related semantic representation can be automatically converted to a data source specific query by the data source command generator to retrieve the relevant information and answers to the query.

Query Example for Personal Secretary Module

The term "contextual query" is a query that demonstrates that it meets quality, origin, method of production, or other characteristics. It is a query that accesses the data source and uses the terms contained in the structure and query of the information contained in the data source. Represents a data command used to retrieve information from a data source based on semantics. As used herein, the term "component" refers to any combination of hardware, firmware, and software.

Embodiments of the present invention provide a contextual query that allows a user to receive answers to user queries. Answers are collected from a number of content with structured data, semi-structured data, and unstructured data. The contextual query is generated by the personal assistant module, the main server / big data DB system based on the ontology associated with the query and the terms included in the application that are utilized during the current search session. Contextual queries on personal assistant module data retrieve a combination of structured, unstructured, and semi-structured data to answer queries. For example, an answer to a user's secretarial information query is generated by using an ontology-based understanding of secretarial information query (secretarial module for secretarial information is defined as secretarial cost (amount) or source) related to the personal secretarial module, It is returned by the main server / big data DB system. The personal secretary module, the main server / big data DB system, is a secretary who allows the user to obtain answers to natural language queries such as "Companies with similar PE ratio as Company A", "Company A operatingincome" and "Company A and B valuation" A secretary application for the service can be provided. The ontology is used to understand a number of key ratios that must be computed using the current data in response to a query by the personal secretary module, the main server / big data DB system. The key ratios may include "PE Ratio,""Price-to-Salesratio," and so on. Natural language queries and corresponding ontologies are used to generate semantic representations. The secretarial application can translate the semantic representation into a SPARQL query that is made to the data source, which contains the records passed to return the answer.

In other words, when the remote secretary-related data is stored as a relational database, the data is retrieved through a query language called SQL (Structured Query Language).

Data constructed with Linked Open Data uses a query language called SPARQL. This language is designed to query data expressed in RDF, and acts like SQL.

Data can be obtained by inputting a query of a desired format into the interface of the present invention. This function is called a SPARQL Endpoint, and all data can be accessed by knowing only the endpoint address.

Eventually, the secretary application returns a comparison of these ratios and other valuation metrics for companies A and B. The personal secretary module, the main server / big data DB system receives the query from the user. In addition, the personal secretary module, the main server / big data DB system, receives the context for one or more applications that are passed during the current search session. Using one or more ontologies, the personal assistant module, the main server / Big Data DB system, understands the query and the context to generate a semantic representation of the context and query of the application that the user forms the query. Concepts, examples, characteristics, and relationships are included in the semantic representation of the query based on the classification, template, or definition contained in the ontology. In one embodiment, a semantic representation is a graph of a query using extracted concepts, examples, characteristics, and relationships. As a result, the semantic expression can be automatically converted into a data source specific query by the data source command generator to retrieve the relevant information and the answer to the query.

Personal Assistant Module Input Secretary Event Pattern

Personal assistant module, data pattern information coupled to main server / big data DB, personal assistant module input secretary event pattern, time when scanned 3D human body information for realistically, secret information information as it is at that time The instruction set and subroutines of the secretary event process that may include data pattern information that may be stored on the device include one or more personal secretaries, one or more processors included in the main server / Module mapping storage architecture.

Personal secretary module, or personal secretary module capable of collecting via various databases or the Internet, or a storage and control device for storing information about a TOC of a collaborative company to retrieve or deduce an individual secretary module.

Personal secretary module that can be collected via the Internet. Storage device for TOC

A network that receives the TOC of a private secretary module collaborative vendor that can be SNS chatted with or interacted with via a variety of databases or the Internet can be connected to one or more secondary networks (e.g., Examples of networks include, but are not limited to, a LAN, a wide area network (WAN), an intranet, and the like.

Examples of client-side applications for entering a personal assistant module input secretary event pattern include a web browser; A game console user interface, a television user interface, or special applications (e.g., applications running on a mobile platform). The instruction sets and subroutines for obtaining a personal assistant module of client-side applications, which may be stored in storage devices coupled to client electronic devices, include one or more processors integrated into the client electronics and one or more personal assistants Module mapping storage architecture.

The instruction sets and subroutines associated with the personal assistant module data may include one or more processors &lt; RTI ID = 0.0 &gt;

Examples of the client electronic devices that receive the expressions of the secretary information at that time when the personal secretary module is scanned realistically include a personal personal secretary module, a main server / big data DB, a laptop personal secretary module, a main server / A personal secretary module of a mobile terminal recruiting a personal secretary module via a network or a cloud, and a main server / big data DB. The client electronic devices may each execute an operating system.

Users can access the secretary event process either directly over the network or via the auxiliary network. Further, the secretary event process can be accessed through the auxiliary network through a link line.

Personal secretary module resonance and induction

Resonance or coupling: the phenomenon of the concentration of remote secretary data in a specific DB, the time period of incoming remote secretary and the unique nature of the DB

Judo: When a personal secretary module data is changed in real time in a personal secretary module DB, a big data phenomenon that can be noticed in each data occurs

Direct coupling

Various client electronic devices (e.g., client electronic devices associated with information about the personal secretary module may be coupled directly or indirectly to the network (or network, e.g., personal personal assistant module, main server / DB is a ring directly coupled to the network. in addition, the laptop personal assistant module, a wireless communication channel established between the main server / big data DB is a laptop personal assistant module, the main server / big data DB with WAP (wireless access point) To the network wirelessly.

Personal personal assistant module, main server / big data DB personal secretary module scanning device

In addition, the personal personal assistant module, the main server / Big Data DB, is coupled directly to the network communicating the representation of the secretary information at that time, when it was scanned realistically via a hardwired network connection.

Generally, as discussed above, a secretarial event process may be coupled to group messaging systems to generally allow secretary events to be generated, scheduled, and / or managed. For example, in one embodiment, the secretarial event process may receive an ID of a conversation that includes a plurality of conversation participants in the group messaging system. The group messaging system may generally allow messaging of conversations between two or more people.

Group messaging system related to personal secretary module data

The group messaging system for the private secretary module may utilize a communication channel that may include participant-based message threads. As such, the conversations in the group messaging system may include a common group of participants (i.e., a plurality of conversation participants) regardless of the topic or topic of the message. In some embodiments, the group messaging system may use interruptive messaging, for example, where a new message's interruptive notification may be used. As such, exchanges within a conversation can generally be performed in a synchronous manner. Examples of group messaging systems may include, but are not limited to, an SMS messaging system, an instant messaging system, a social network-based messaging system, and the like.

A client-side application and / or a secretary event process associated with personal secretary module data

In accordance with an exemplary embodiment, a secretarial event process that includes data pattern information including, for example, a personal secretary module input secretary event pattern, etc., may include, for example, a user interface associated with personal secretary module input information , A user interface (e.g., a user interface that may be at least partially provided by one or more of a client-side application and / or a secretary event process run by a main server / big data DB) The personal secretary module in the system can receive the conversational ID.

The user interface allows a user to create messages (e.g., via a text entry field) for conversation and / or to receive messages that have been received in connection with the conversation (e.g., the time at which they were scanned realistically, A user interface that is capable of reading messages that may have been generated by the user and / or messages from other participants of the conversation associated with the presentation. In some embodiments, The steps may include receiving a plurality of conversation participants associated with the conversation (e.g., user, user, user, user identity in the embodiment). Various additional / alternative mechanisms may be used to select conversations within the group messaging system Can be similarly used for user interfaces. Furthermore, It should be understood that the examples are intended for illustrative purposes only and that various other user interfaces may be equally used and should not be described as limiting the scope of the present disclosure. Lt; RTI ID = 0.0 &gt; ID &lt; / RTI &gt; of the conversation.

Data pattern information related to personal assistant module data

The secretary event process that includes the private secretary module scan data pattern information may also receive a request to schedule a secretary event related to a dialog between the doctor and the patient. For example, and the user may select a secretary event creation button (e.g., via a touch screen input device or other suitable input device) from within the user interface. In response to the user selecting the create secretary event button, the secretary event process may receive a request to schedule a secretary event associated with the conversation. In response to receiving a request to schedule a secretary event associated with the conversation, the secretary event process may generate a secretary event having a plurality of secretary event participants based, at least in part, on the plurality of conversation participants.

Pre-populating related to personal secretary module data

The present invention uses a populating method using metadata (such as information on a row, a data type, a key, and a constraint), an RDMBS data source, and the like.

The present invention can use the Open Directory Project (ODP).

For example, the secretary event process may generate a secretary event with a pre-populated guest list as members of the personal secretary module dialog. In an exemplary embodiment, as part of generating a secretary event, the secretarial event process (either alone and / or in conjunction with one or more additional applications, such as a client-side application and / or a separate scheduling application) And may provide an event details user interface.

Private secretary module for pulling out personal secretary modules The scheduler for scheduling conversations balances the load on traffic using priority scheduling so that the transmission bandwidth is fully utilized

Secret data

The data stream of the remote secretary is made up of different data types, such as secret data, shared data, and control data. If the secret data for the remote secretary is for a single user and the shared data is to broadcast to groups of client devices as previously described. Control data is passed to a single or group of client devices, which carry bookkeeping and configuration information.

The location of the scheduling function of the arrangement information of each information for expressing the information of the secretary at the time when the biometric information of the medical field is scanned in real time is the handler for the shared data, the secret message service, and the content table (TOC) manager Lt; / RTI &gt; The scheduler allocates packets to slots based on the next frame transmission based on a priority algorithm.

Handlers related to personal secretary module data

The remote secretary shared data and secret data service handlers are registered with the remote secretary manager which is sequentially registered with the scheduler. Before assembling the private secretary module frame (the most basic information), the scheduler forwards the request to the remote secretary manager to generate a slot (configuration information that constitutes basic secretary information) (slot creation). The remote assistant manager will update the information to reflect the final transmission sequence (slot review). The review of slot assignment is described in more detail below.

Slot allocation is maintained for a number of secretarial information sequences such that the client device can follow specified slot locations for specific information. The frame reservation field of the slot descriptor specifies the number of secretary information sequences for which the slot assignment is to be continued. The remote secretary manager will reduce the frame reservation field of each slot descriptor after the secretarial information sequence is completed. However, the persistent slot assignment may be overridden by a confidentiality message that is preset by the user or the like, as described in more detail below.

Shared data service handler associated with personal secretary module data

To add functionality to the computer, the slot assignment is reviewed and after the available slots are played, the remote secretary manager requests the registered shared data service handlers to update the slots (slot update request). The shared data service handler of the private secretary module processes the request so that the locator field for the assigned slot descriptor is updated (locator update). The Remote Secretary Information Slot Descriptor field associated with the assigned slot is updated to reflect the change in the Locator field and returned to the Remote Secretary Manager.

In an exemplary embodiment, the secretary event detail user interface may allow a user to provide one or more remote secretary secretary event attributes via corresponding fields. For example, a user may provide a title for a secretary event in a title entry field, a suggested time for a secretary event in a time entry field, and a suggested location for a secretary event via a location entry field. The secretary event attributes may be entered using, for example, an input device provided by the client-side application and / or other applications. In some embodiments, it may only be necessary for the user (e.g., the creator of the secretary event) to provide a title for the secretary event. In this embodiment, other secretary event attributes may be provided later, and / or may not be provided for a secretary event. Consistent with the foregoing example, the secretary event process can cause secretary events to be generated relatively quickly and easily, including ad hoc secretary events.

In another embodiment, in addition to / in place of generating a new secretary event, the user can share the conversation with existing secretary events (i.e., share existing secretary events with the conversation participants). In accordance with this embodiment, the secretarial event process may receive a request to schedule a secretary event comprising receiving an indication of an existing secretary event. For example, rather than selecting the secretary event creation button, the user can select the share button. In response to receiving the selection of the sharing button, the client-side application may provide a sharing user interface (alone and / or in combination with a secretary event process and / or other application). The shared user interface may include various options of content and / or objects to be shared with the conversation (i.e., to be shared with the conversation participants via the group messaging system). For example, the shared user interface may include a photo sharing option, a video sharing option, and a secretary event sharing option. The shared user interface may include various additional and / or alternative options of content and / or objects to be shared with the conversation.

Secretary event sharing options related to personal secretary module data

In response to a user selecting the secretary event sharing option according to the personal secretary module, the client-side application may send the upcoming secretary events (i. E., In association with the secretary event process and / or other applications) , The secretary events the user was invited to). The user can select secretary events to be shared with the conversation from within the list of upcoming secretary events. In response to a user selecting a secretary event from within the list of upcoming secretary events, the secretary event process may receive an indication of an existing secretary event. In accordance with this embodiment, in response to receiving an indication of an existing secretary event, the secretary event process associated with the personal secretary module updates the existing secretary event to include a plurality of conversation participants as secretary event participants, Based on, at least in part, a secretary event having a plurality of secretary event participants. That is, the secretarial event process may include a list of participants (i. E., To participate in a secretarial event) to include the talk participants (alone and / or in combination with other applications such as a scheduling application and / or a scheduling module in a group messaging system, The list of invited individuals) can be updated.

Reminder of secretary event

The secretary event process may send a notification of a secretary event to a plurality of secretary event participants. In an exemplary embodiment, sending a notification of a secretary event to a plurality of secretary event participants may include sending a notification of the secretary event to the conversation (i.e., to the conversation participants via the group messaging system) . For example, in one embodiment, the secretarial event process may send a notification of a secretary event in the form of a new message (e.g., a new secretary event message associated with the personal secretary module "new secretary event: As shown in Fig. In some embodiments, where the group messaging system may utilize interrupt messaging, a notification (e.g., sending a new secretary event message may also invoke an interrupt notification in each client application associated with the conversation participants.

The remote secretary of the dinner menu is then stored in the secretary event according to the invention.

Secretary event process related to personal secretary module data

In an exemplary embodiment, the secretarial event process may further receive one or more secretary event attributes from one or more of a plurality of secretary event participants. For example, and as described above, in some embodiments, the user generating the secretary event (e.g., the user of the previous example may provide one or more secretary event attributes during the generation of the secretary event.) In some embodiments , The secretary event process may enable the secretary event attributes to be provided as a function of the group dynamics of the conversation. For example, the secretary event process may, in some embodiments, enable various secretary event participants the number of assistant event participant will be) the e. g., typically a democratic way (democratic manner) as can be allowed to add and / or replace the secretary event property, for example, other users (e.g., an object of For example, a dialog user interface (e.g., In response to selecting a secretary event from within the conversation user interface, the client-side application (either alone and / or in a secretarial event, The secretary event time field, the secretary event time field, the secretary event time field, the secretary event time field, the secretary event time field, the secretary event time field, and the secretary event time field) Secretary event location fields, etc. A variety of additional / alternative secretary event attribute fields may similarly be included. Through the secretary event user interface, the user can access the personal secretary module (e.g., personal private secretary module, main server / Like the keyboard associated with The secretary event process may receive one or more secretary event attributes in response to a user entering one or more secretary event attributes via the secretary event user interface. May include one or more of time and place. Various additional / alternative secretary event attributes may be equally used.

In an embodiment, the secretary event process may determine a secretary event attribute based on one or more status characteristics of a plurality of secretary event participants. In an exemplary embodiment, the one or more status characteristics of the plurality of secretary event participants may include one or more of the locations of the plurality of secretary event participants and the availability of one or more secretary event participants. For example, the secretarial event process may be performed in conjunction with one or more additional applications, such as alone and / or client-side applications, discrete scheduling applications associated with one or more secretary event processors, scheduling modules associated with group messaging systems, The available time associated with a plurality of secretary event participants can be determined. For example, based at least in part on other scheduled secretary events for each of the secretary event participants, the secretary event process may determine that each of the secretary event participants has an article made at 7:00 PM. In response to each of the secretarial event participants determining that there is a product of a personal secretary module at 7:00 PM, the secretary event process may set the personal secretary module associated with the secretary event, the time attribute to be 7:00 PM.

In a further embodiment, one or more secretary event participants may provide them with available times (e.g., in response to a request for availability from a secretary event process).

In another exemplary embodiment, the secretarial event process may be based on, at least in part, the determined location of one or more secretarial event participants and / or the anticipated location of one or more secretarial event participants, The event location attribute can be determined. For example, in one embodiment, the secretary event process may determine a location associated with one or more of the secretary event participants based on a request for a location sent to one or more of the secretary event participants. In a further embodiment, one or more of the client electronic devices associated with one or more of the secretarial event participants are located at a location (e.g., a GPS determined location, a hardwired determined location, a cell tower triangulation, / RTI &gt; and / or other mechanisms based on other mechanisms by which the location of the client electronic device can be determined) to the secretary event process. In an exemplary embodiment, based on the received locations associated with one or more of the secretary event participants (e.g., inferences based on the location of the client electronics associated with one or more of the direct and / , The secretary event process may determine the secretary event location attribute based, for example, on a location that may be generally centered on at least a half of one or more secretary event participants. The secretary event process can generally determine various additional / alternative secretary event attributes associated with secretary events in a similar manner.

In one embodiment, the secretarial event process may send one or more secretary event attributes to the conversation. For example, if one or more secretary event attributes have been defined by one or more of the secretary event participants, a notification of a secretary event containing received and / or determined secretary event attributes may be sent to the conversation (i. E., The group messaging system To the participants of the conversation). For example, suppose a secretarial event participant (e.g., a user is provided with a secretarial event venue (e.g., restaurant) for a "supper" secretarial event. Module, and time (e.g., 7:00 PM) of the secretary event event, the secretary event process may send one or more secretary event attributes to the conversation, for example, as a notification containing secretary event details. , And in one embodiment the secretarial event process may send one or more secretary event attributes to the conversation as a secretary event message that may be received by one or more chat participants via a group messaging interface .

According to an exemplary embodiment, the secretary event process may enable the creation and modification of secretary events based on group dynamics among the talk participants. In this exemplary embodiment, the secretarial event process may receive modified secretary event attributes from one or more secretary event participants and may update one or more secretary event attributes based, at least in part, on the changed secretary event attributes . For example, and as is generally discussed, one or more of the secretarial event participants may enter a secretary event attribute associated with the secretary event (e.g., through a suitable user interface). In some embodiments, once an attribute has been entered, other secretary event participants may change and / or modify the secretary event attribute that was received by the secretary event process. In response to receiving the modified secretary event attribute (e.g., as a result of a secretary event participant changing an already established secretary event attribute and / or providing a secretary event attribute that was not previously defined), the secretary event process is newly received The updated secretary event attributes may be updated to include the changed information. In some embodiments, the secretary event process

As discussed with reference, an announcement of the updated secretary event attribute may be further communicated to the conversation, for example, in a manner similar to sending one or more secretary event attributes to the conversation. In some embodiments, access controls may include, for example, secretary event attributes

And / or to define which secretary event participants can have privileges to modify secretary event attributes.

In some embodiments, the secretarial event process may further send the metadata associated with the secretarial event to the conversation. In accordance with various embodiments, the metadata associated with the secretary event may include, for example, RSVP for a secretary event, check-in (e.g., acknowledging that the secretary event participant has arrived at the location of the secretary event), and / / May contain alternate metadata. The secretary event process may send the metadata associated with the secretary event to a conversation (e.g., via a group messaging system to secretary event participants), for example, as a message in the conversation and / or via another suitable mechanism.

In some embodiments, the secretary event process may send a secretary event update to the conversation based, at least in part, on the changed secretary event participant status. The secretarial event participant status can include, but is not limited to, for example, the location of the secretarial event participant, the arrival of the secretarial event participant in the secretarial event, and the estimated arrival time of the secretarial event participant in the secretarial event and the like. In an exemplary embodiment, the secretary event process may send secretary event updates to a conversation that can be accessed by the conversation partner via the group messaging interface. For example, and the user may receive update messages (e.g., secretary event updates sent by the updater message) within the group messaging user interface. Various additional and / or alternative updates may similarly be sent using other suitable mechanisms And / or received.

For example, the secretary event process may replace any personal secretary module, main server / big data DB, personal assistant module, main server / big data DB, which may be executed as a whole or part, But are not limited to, client electronic devices.

As will be appreciated by one of ordinary skill in the art, the present disclosure encompasses methods (e.g., personal assistant modules, wholly or partially executed on a main server / big data DB), systems (e.g., A main server / big data DB, or a personal secretary module, a main server / big data DB program product (e.g., encoded in a storage device) Firmware, resident software, microcode, etc.) or software, and hardware aspects that may be generally referred to herein as "circuitry", "module" or "system".

The main server / big data DB program code is an object-oriented programming language, such as, for example, Java, Smalltalk, C ++, or the like, which is a personal secretary module that performs operations to process the ontology method, data pattern information, Can be written. However, the personal secretary module, the main server / big data DB program code, performing the operations herein may also be written in a conventional procedural programming language, such as, for example, a "C" programming language or a similar programming language. The program code may be stored on the user's personal assistant module, on the main server / big data DB completely, on the user's personal assistant module, on the main server / big data DB , / Partially on the Big Data DB and partially on the Doctor's Personal Assistant module, on the Main Server / Big Data DB, or on the Personal Secretary Module, Main Server / Big Data DB, or Server. In the last scenario, the personal secretary module, main server / big data DB can be connected to the user's personal assistant module, main server / big data DB via LAN / WAN / Internet (e.g.

The present disclosure is described with reference to flowcharts and / or block diagrams of a method, apparatus and personal assistant module, a main server / big data DB program product secretarial treatment according to embodiments of the present disclosure.

Each block of the secretarial treatment flow diagram and / or block diagram, and combinations of each block (e.g., each of the separate secretarial performance agencies) in the flowchart and / or block diagram, may include a personal assistant module, main server / Lt; / RTI &gt; The personal secretary module and the main server / big data DB program commands may include a general purpose personal assistant module, a main server / big data DB / special purpose personal assistant module, a main server / big data DB / other programmable data processing device Module and a processor (e.g., processor) of a main server / big data DB so that instructions executing through a processor of a personal secretary module, main server / big data DB, or other programmable data processing apparatus, Or means for implementing the functions specified in the block diagram or blocks.

This personal secretary module, the main server / big data DB program commands, can also be used to process the personal secretary module, main server / big data DB (e.g., personal secretary module, main server / big data DB, or other programmable data processing A personal secretary module capable of indicating the device, a main server / big data DB-readable personal assistant module mapping storage (e.g., stored in a storage device, The instructions stored in the possible private secretary module mapping storage produce an article of manufacture comprising instruction means implementing the function / action specified in the flowchart and / or block diagram or blocks.

The personal secretary module and the main server / big data DB program command also include a series of operation steps for producing a process implemented as a personal secretary module, main server / big data DB, personal assistant module, main server / Enabled device, a personal secretary module, a main server / big data DB, or other programmable data processing device

And so instructions executing on the personal secretary module, main server / big data DB, or other programmable device provide steps for implementing the functions / operations specified in the flowchart and / or block diagram or blocks .

The flowcharts and block diagrams in accordance with the present invention describe the architecture, functionality, and system of possible implementations of operations, methods, and personal assistant modules, main server / big data DB program products, in accordance with various embodiments herein. In this regard, each block in the flowchart or block diagram may represent a portion of a module, segment, or code that includes one or more executable instructions that implement the specified logical function. It should also be noted that, in some alternative implementations, the functions recorded in the block may deviate from the order recorded in the drawing. For example, two consecutively constructed blocks may in fact be performed substantially concurrently, or depending on the function the blocks are contained in,

In order. It should also be noted that each block and block diagram of the block diagram and / or flowchart illustrations and / or combinations of blocks within the flowchart illustrate a particular-purpose hardware-based system that performs particular functions or operations, A personal secretary module, and a combination of main server / big data DB commands .

The secretarial terminology used herein is for the purpose of describing particular embodiments only and is not intended to be a limitation of the present disclosure. As used herein, unless the context clearly indicates otherwise, the singular forms "a," "one," and "its" are intended to include plural forms (secretaries, do.

The term " comprising "and / or" comprising ", when used in this specification, specify the presence of stated features, integers, steps, operations, elements and / , Does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or a collection thereof.

The functional elements in the following claims, as well as equivalents of corresponding secretarial treatment structures, materials necessary for secretarial acts, and all means or steps, are to be construed broadly such that, in particular, Material, &lt; / RTI &gt; The description herein has been presented for purposes of illustration and description, and is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of this disclosure. To best illustrate the principles and practice of the present disclosure and to enable those of ordinary skill in the art to understand the disclosure of various embodiments having various modifications as are suited to the particular use contemplated, Selected and explained.

It will thus be apparent that modifications and variations are possible without departing from the scope of the disclosure as defined in the appended claims, by describing the specification of the present application and by referring to the embodiments thereof.

If the personal secretary module, the configuration method in the main server / big data DB, the data pattern information in violation of the input method, the time of the real-time scan, the representation information as secretary information at that time, Is not entered in accordance with the prescribed format within the specified period, the input procedure is invalidated and invalid information that was not cured by the original stored in accordance with the invalid procedure of the input procedure is invalidated.

Example Personal Secretary Module Scan DB; Ontology method

The foregoing description of embodiments of the present invention has been presented for purposes of illustration and is not intended to be exhaustive or to limit the invention to the precise forms disclosed.

For example, when the ontology method can not be carried out, the calculation function may assume specific object with the features from the locations still being those skilled in the art to the invention for taking into account the application for technical common sense, to specify the object as set forth in claim The process of collecting information ceases until the reason for its disappearance.

It will be appreciated by those skilled in the art that various modifications and variations can be made in the present invention.

Some portions of the disclosure describe embodiments of the present invention in terms of algorithms or symbolic representations of operations on information. These algorithmic descriptions or representations are commonly used by those of ordinary skill in the data processing arts to convey the substance of their work effectively to those of ordinary skill in the art. These operations, which are functionally, computationally, or logically described, are understood to be implemented by a personal assistant module, a main server / big data DB program or equivalent electrical circuit, microcode, and the like. Also, it is often found that the arrangement of such operations can be referred to as modules without loss of generality. The described operations and their associated modules may be implemented in software, firmware, hardware, or any combination thereof.

Any of the steps, operations, or processes described herein may be performed or implemented by one or more hardware or software modules, or by a combination of these and other devices. In one embodiment, a software module includes a personal secretary module, a personal secretary module that can be executed by the main server / big data DB processor, a main secret key module that is used to perform some or all of the described steps, operations or processes, Personal secretary module including DB program code, personal secretary module including main server / big data DB readable medium, and main server / big data DB program product.

Embodiments of the invention may also be associated with apparatus for performing the operations herein. This device may be specifically configured for the requested purpose and / or may include a personal secretary module, a personal secretary module stored in the main server / big data DB, a general personal secretary activated or reconfigured selectively by the main server / Module, and main server / big data DB. Such a personal secretary module, a main server / big data DB program, can be coupled to a non-transitory type personal assistant module, a main server / big data DB readable storage medium or a personal assistant module, a main server / And may be stored in any type of media suitable for storing electronic instructions. In addition, any computing system referred to herein may include a single processor, or it may be a structure employing a multiprocessor design for increased computing power.

Embodiments of the systems and methods of the present invention may also be directed to products made with the computing processes described herein. Such products may include information generated as a result of the computing process, where the information is non-

Personal assistant module of the type, main server / big data DB readable storage medium, and may include any embodiment of the personal assistant module, main server / big data DB program product, or other data combination described herein have.

Finally, the language used herein has in principle been selected for easy-to-read guidance purposes and may not be selected to delineate or limit the gist of the invention. Accordingly, the technical scope of the system and method of the present invention is intended to be defined not by this specification, but by any claims that are filed on the basis of this specification.

Thus, the description of embodiments of the system and method of the present invention is intended to be illustrative, but not limiting, of the scope of the invention as set forth in the following claims.

Examples related to personal secretary module data: Analyze personal secretary module input secretary event pattern

Embodiments of the present invention and the operations described herein may be implemented in a digital network including the structures disclosed herein and their structural equivalents, or in a personal secretary module, main server / Big Data DB software, firmware or hardware , &Lt; / RTI &gt; or combinations of one or more thereof. Embodiments of the present invention described herein may be used, for example, to analyze a personal assistant module input secretary event pattern to extend a realistic personal assistant module area, Analyzing or analyzing the individual secretary module to reproduce the personal secretary module with a 3D printer, as well as the form including the dimensions of the object, as well as one or more modules of the main server / , The modules are encoded on a personal secretary module, a main server / big data DB storage medium for execution, and the execution is performed by a data processing device or by a data processing device, such as for controlling the operation of the data processing device A personal secretary module, and main server / big data DB programs.

Encoding information for transmission to an appropriate receiver device for execution by a data processing device associated with personal secretary module data

Alternatively or additionally, the program instructions may be, for example, electrically, optically, or otherwise generated by a machine generated to encode information for transmission to a suitable receiver device for execution by a data processing device of a personal secretary module It can be encoded on an artificially generated propagation signal such as an electromagnetic signal. Personal secretary module, main server / big data DB storage medium includes a personal secretary module, a storage device readable by the main server / big data DB, a personal secretary module, a storage substrate readable by the main server / Or a serial access personal assistant module mapping storage array or device, or a combination of one or more thereof. Furthermore, while the personal secretary module and the main server / big data DB storage medium are not radio signals, the personal secretary module and the main server / big data DB storage medium may be personal secretary modules encoded in an artificially- Server / Big Data The number of source or destination of DB program instructions

have. The personal secretary module, main server / big data DB storage medium may also be one or more separate and physical components or media, such as, for example, multiple CDs, disks, or other storage devices Can be included in these.

The operations described herein may be implemented as operations performed on data by a data processing device and the data may be stored in one or more personal assistant modules, storage devices readable by the main server / And is received from other sources.

The term "data processing device" is intended to encompass all types of devices for processing data, including remote secretary-related data pattern information, an SNS conversation, or a TOC (Personal Assistant Module) A personal secretary module, a main server / big data DB, a system on chip, a personal personal assistant module, a main server / big data DB system, a desktop personal assistant Module, main server / big data DB, laptop, notebook, netbook personal secretary module, main server / big data DB, mainframe personal secretary module, main server / big data DB system, handheld personal secretary module, main server / DB (handheld computer), workstation, network personal secretary module, main server / big data DB, application server, A consumer device such as a storage device or camera, a camcorder, a set-top box, a mobile device, a video game console, a handheld video game device or peripheral devices such as switches, modems, routers or any other type of computing or electronic device, Multiple, or combinations thereof. The device may be a personal assistant module input secretary for extending a realistic personal assistant module area, such as, for example, a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC) And may include a special purpose logic network capable of analyzing event patterns. The device may also be implemented in hardware, such as, for example, processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of these A personal secretary module in question, and a code for creating an execution environment for the main server / big data DB program. The device and execution environment may implement a variety of different computing model infrastructures such as web services, distributed computing and grid computing infrastructure to provide a variety of models including the dimensions of objects, And the personal secretary module can be reproduced by the 3D printer.

A personal assistant module, a main server / big data DB program (also known as a program, software, software application, script, or code) is a language that is compiled or interpreted for ontology processing, Personal secretary module, main server / big data DB program may be stored in a stand-alone program or in a module, component, subroutine, object, or other suitable for use in a computing environment May be arranged in any form including those used as a unit. The personal secretary module, and the main server / big data DB program can correspond to the file of the file system, but it is not necessarily corresponded to the file. The program may be stored in a single file that is dedicated to the program in question or in multiple coordinate files (e.g., one or more modules, sub-programs, or portions of code) (E.g., one or more scripts stored in the markup language personal assistant module markup language document) that is associated with the markup language. The personal secretary module and the main server / big data DB program can be arranged to be executed on one personal secretary module, main server / big data DB or a plurality of personal secretary modules, main server / big data DB, The main server / big data DBs are located in one place or distributed across multiple locations and interconnected via a communication network.

A special purpose logic network

The processes and logic flows associated with the personal assistant module described herein may be executed on one or more personal secretary modules, main server / big data DB programs to perform actions by operating on input data and generating an output One or more programmable

May be performed by the processing units. The processes and logic flows may also be performed by a special purpose logic network , such as, for example, a field programmable gate array or an application specific integrated circuit,

The device may be implemented as a special purpose logic network.

The processing units suitable for execution of the personal secretary module, the main server / big data DB program are, by way of example, both microprocessors associated with general purpose microprocessors and special purpose personal assistant modules, A digital personal assistant module, a main server / big data DB, any one or more of

Processing units. Generally, the processing unit receives commands and data from a read-only personal assistant module mapping storage or a random access personal assistant module mapping storage or both. Essential elements of the personal secretary module, main server / big data DB, perform actions in accordance with the instructions

A processing unit and one or more personal secretary module mapping storage devices for storing instructions and data. Also, in general, the personal secretary module, the main server / big data DB, may include one or more mass storage devices for storing data, such as magnetic, magneto-optical disks, or optical disks, devices, or to the mass storage devices as well as to the form that includes the dimensions of the object, as well as to scan the personal secretary module and transfer the personal secretary module representation data to the 3D printer, or both Lt; / RTI &gt;

 In order to provide for interaction with a user, embodiments of the invention described herein may be implemented in a computer-readable medium having a user and a keyboard and a user, such as, for example, a mouse or trackball, A person having a display device, such as, for example, a cathode ray tube (CRT) or liquid crystal display (LCD) monitor, for displaying information on a pointing device capable of providing to a DB A secretary module, and a main server / big data DB. Other types of devices may be used to provide not only a form that includes the dimensions of an object with the user, but also an interaction involving a hand gesture for scanning the personal assistant module and reproducing the personal assistant module with the 3D printer;

Sensory feedback related to personal secretary module data

For example, the feedback provided to the user may be some form of sensory feedback, such as, for example, visual feedback, auditory feedback, or tactile feedback; And the input from the user may be received in any form, including acoustic, speech, or tactile input. In addition, the personal secretary module, the main server / big data DB can interact with the user by sending personal secretary module collaborators to the device used by the user and receiving private secretary module collaborators from the device; For example, by sending web pages to a web browser on the user's client device in response to requests received from the web browser.

Embodiments of the present invention described herein can be applied to an ontology data server in which not only a form including dimensions of an object but also a form of data for reproducing a personal secretary module in a 3D printer by scanning up to a personal secretary module, A back-end component associated with the personal assistant module, or it may include a middleware component, such as, for example, an application server, or may include, for example, A front-end component, such as a client personal assistant module with a graphical user interface or web browser capable of interacting through an implementation of the present invention, a main server / big data DB, . The components of the system may be interconnected by any form or medium of digital data communication, for example, a communication network. Examples of communication networks include, but are not limited to, a local area network ("LAN") and a wide area network ("WAN"), peer-to-peer networks (e. g., ad hoc peer-to-peer networks).

The computing system may include clients and servers. Clients and servers are typically remote from each other and typically interact through a communications network. The relationship between the client and the server is generated by the personal secretary module, main server / big data DB programs executed on the personal secretary module, main server / big data DBs and having a client-server relationship with each other. In some embodiments, a server may send data (e.g., a document page) to a client device (e.g., for purposes of displaying data to a user interacting with the client device and receiving user input from the user) . Data generated at the client device may be received from the client device at the server (e.g., as a result of user interaction).

The system of one or more personal secretary modules, main server / big data DBs may be configured to perform certain actions by software, firmware, hardware, or a combination thereof installed on the system, . One or more personal secretary modules, main server / big data DB programs, when executed by the data processing device, are configured to perform certain actions by including instructions that cause the device to perform the actions.

An electronic personal assistant module collaborator (for example, simply referred to as a private secretary module collaborator for brevity) can respond to a file but does not necessarily correspond to the file. A private secretary module collaborator can be stored in a file that contains other private secretary module collaborators, a single file dedicated to the problem private secretary module collaborators, or multiple coordinate files.

Appropriate sub-combinations related to personal assistant module data

While the specification concludes with a number of specific implementation details, they should not be construed as limitations on the scope of what the inventions or what may be claimed, but rather on the specific embodiments of the specific inventions . Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in a number of embodiments , either individually or in a suitable subcombination involving any personal assistant module . Moreover, the features may be described as acting in any combination, even so from the beginning, and one or more features from the claimed combination may, in some cases, be deleted from the combination, May be about a sub-combination or a variant of a sub-combination.

 Similarly, while operations may be listed in a particular order, it should be understood that these operations are performed in a particular order or sequential order, or that all operations are performed, in order to achieve the desired results. do. In some environments, multitasking and parallel processing may be advantageous. Moreover, the separation of the various system components in the embodiments described above should not be understood as requiring such a separation in all embodiments, since the desired program components and systems are generally integrated together in a single software product Or may be packaged into a number of software products.

Therefore, specific embodiments of the invention have been described. Other embodiments are within the scope of the following claims. In some cases, the actions described in the claims may be performed in a different order and still achieve the desired results.

Additionally, processes in accordance with the present invention do not necessarily require a specific order, or sequential order, to achieve desired results. In certain implementations, multitasking and parallel processing may be advantageous. Accordingly, other embodiments are within the scope of the following claims.

Personal secretary module mapping related to personal secretary module data Embodiment based on storage object: Personal secretary module input information

The personal assistant module mapping storage may store a program for processing and controlling the processor, and may temporarily store the input / output information. A personal secretary module mapping storage body that includes individual secretary module reproduction data as a 3D printer can be utilized as a buffer as well as a form including a dimension of an object as well as a personal secretary module. A processor typically controls the overall operation of the various modules within a transmitting or receiving device. In particular, the processor may perform various control functions to perform the present invention. A processor may also be referred to as a controller, a microcontroller, a microprocessor, a micro personal assistant module, a main server / big data DB,

The processor may be implemented by hardware or firmware, software, or a combination thereof. When implementing the present invention using hardware, application specific integrated circuits (ASICs) or digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs field programmable gate arrays, etc., may be included in the processor that scans up to the personal secretary module and reproduces the personal secretary module with the 3D printer as well as the form including the dimensions of the object. Meanwhile, when the present invention is implemented using firmware or software, firmware or software may be configured to include a module, a procedure, or a function for performing the functions or operations of the present invention. The firmware or software may be contained within the processor or may be stored in a personal secretary module mapping storage and driven by the processor.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may include, but are not limited to, a processor, a controller, an ALU (personal digital assistant arithmetic logic unit, a digital signal processor, a micro personal assistant module, a main server / big data DB, a field programmable array (FPA), a programmable logic unit (PLU), a microprocessor, Such as one or more general purpose personal assistant modules, main server / big data DB or special purpose personal assistant modules, main server / big data DB, as with any other device that can be used. As well as the form that includes the dimensions of the object, the personal assistant module representation device can scan the personal assistant module to a 3D printer and perform one or more software applications performed on the operating system and the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a personal assistant module, a main server / big data DB program, a code, an instruction, or a combination of one or more of these, and may be configured to configure the processing device to operate as desired, Device can be commanded. The software and / or data may be stored on any type of machine, component, physical device, virtual equipment, personal secretary module, main server / A data DB storage medium or device, or a signal wave to be transmitted. The software may be distributed on a networked personal secretary module, main server / big data DB system , and stored or executed in a distributed manner. The software and data may be stored in one or more personal secretary modules, main server / big data DB readable recording medium.

The method according to an embodiment of the present invention includes not only a form including dimensions of objects that can be performed through various personal secretary modules, main server / big data DB means, but also program commands to reproduce personal assistant modules And can be recorded in the personal secretary module and the main server / big data DB readable medium. The personal secretary module and the main server / big data DB readable medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiment, or may be available to those skilled in the art of personal assistant modules, main server / big data DB software.

Examples of a series of program commands that scan up to the personal secretary module and reproduce the personal secretary module with a 3D printer as well as the form that includes the dimensions of the object include the use of an interpreter or the like as well as machine code, , And a high-level language code that can be executed by the main server / big data DB. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, if the described techniques are different from the described method

It will be appreciated by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims. To be achieved

.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Personal Secretary Module Input Secretary Event Peripherals

Hereinafter, an exemplary person who can collect data pattern information related to a personal assistant module that may be used in some implementations of the present invention, a TOC (personalized assistant module) collaborative company's TOC that can be collected via various databases or the Internet A secretary module, and a main server / big data DB system. It is understood that the search system of the present invention and the associated techniques described herein may be implemented in any suitable software, hardware, or both. The search system may be implemented on a single personal assistant module, on a main server / big data DB, or across multiple personal assistant modules, main server / big data DB or other hardware platform, for example.

Using this search system, we propose a system that can improve both recall and precision by adding an additional semantic layer called semantic matching engine related to personal secretary module.

The present invention proposes a technique for enhancing user satisfaction by retrieving a web service composition using an easy and simple algorithm using a relational database and an ontology.

Also, the present invention proposes a grid-based similarity matching method for feature points to improve response time. The grid-based similarity matching method divides the points into grids and narrows the search range to reduce the number of matches. The points used as minutiae points were extracted from the image line by MPP (Minimum Perimeter Polygons) algorithm and the sum of the distance values between the feature points was calculated as the similarity.

In addition, the present invention proposes a workload analysis tool for analyzing the types and the number of participating tables in the workload by deriving the association between the tables of the operating system and applying it to a large CRM analysis system, Analyze the workload of the system.

In addition, the present invention uses Case Based Reasoning that includes remote secretary related information and uses ontologies based on Resource Description Framework (RDF) or Web Ontology Language (OWL) The adaptation knowledge is expressed as OWL or SWRL (Semantic Web Rule Language) based on Description Logic and the case is modified through inference.

Also, matchmaking is a process for connecting a service provider that meets the requirements of the service requester, and is determined by the correspondence between the web service request and the web service secretary. Whether or not these requests are consistent with the secretary depends on the consistency of the service input / output among the functional contents. The matchmaking system also supports input and output through the repository

You must be able to browse, modify, and revoke the service.

In order to obtain the similarity between service name and description information, the present invention calculates similarity using TF-IDF (Term Frequency-Inverse Document Frequency Weighting) through service name similarity and service description similarity.

An exemplary personal assistant module that may be used to implement some or all of the features of a search system that retrieves data analyzing a personal assistant module input assistant event pattern to extend realistic personal assistant module areas in accordance with some implementations of the present invention, Server / big data DB system. In some implementations, the system includes one or more user devices.

In some implementations, a user device that scans up to a personal secretary module and reproduces the personal assistant module into a 3D printer associated with the personal secretary module, as well as the form that includes the dimensions of the object, may be connected via a direct connection, via a wireless repeater, By any other suitable method, or by any combination thereof. In some implementations, the network includes the Internet, distributed personal assistant modules, main server / big data DB and server networks, local networks, public intranets, private intranets, other connected computing systems, or any combination thereof.

In some implementations, the user device is connected to the network by a wired connection. In some implementations, the connection includes Ethernet hardware, coaxial cable hardware, DSL hardware, T-1 hardware, fiber optic hardware, analog telephone line hardware, any other suitable wired hardware capable of communicating, or any combination thereof. The connection includes a transmission technique including TCP / IP transmission technology, IEEE 802 transmission technology, Ethernet transmission technology, DSL transmission technology, optical fiber transmission technology, ITU-T transmission technology, any other suitable transmission technology or any combination thereof can do.

Receiving information transmitted from a user device associated with personal secretary module data and communicating with the network by connection

In some implementations, the user device is wirelessly connected to the network by a wireless connection. In some implementations, a wireless repeater receives information transmitted from a user device by a wireless connection and communicates with the network by connection . In some implementations, the wireless repeater receives information from the network by way of a connection and communicates with the user device by way of a wireless connection. In some implementations, the wireless connection may be implemented in a wireless communication system such as a cellular telephone transmission technology, a code division multiple access transmission technology, a global mobile communication system transmission technology, a general packet radio service (GPRS) transmission technology, a satellite transmission technology, an infrared transmission technology, Fi transmission technology, WiMax transmission technology, any other suitable transmission technology, or any combination thereof.

In some implementations, the connection includes Ethernet hardware, coaxial cable hardware, DSL hardware, T-1 hardware, fiber optic hardware, analog telephone line hardware, wireless hardware, any other suitable hardware capable of communicating, or any combination thereof. In some implementations, the connection may include a TCP / IP transmission technique, an IEEE 802 transmission technique, an Ethernet transmission technique, a DSL transmission technique, a fiber transmission technique, an ITU-T transmission technique, any other suitable transmission technique, Wired transmission technology. In some implementations, the connections may be implemented in a wireless communication system such as a cellular phone transmission technology, a code division multiple access transmission technology, a global mobile communication system transmission technology, a general packet radio service (GPRS) transmission technology, a satellite transmission technology, an infrared transmission technology, Transmission techniques, WiMax transmission techniques, any other suitable transmission techniques, or any combination thereof.

Other devices communicating to the network associated with the personal assistant module data, or any combination thereof

In some implementations, the wireless repeater includes any number of cellular phone transceivers, network routers, network switches, communication satellites, other devices that communicate information over a network from a user device, or any combination thereof. It is understood that the particular arrangement of connections, wireless connections and connections included in the system is exemplary only and that the system may include any suitable number of any suitable devices for connecting the user device to the network. Any user device may be communicatively coupled with any user device, remote server, local server, any other suitable processing equipment, or any combination thereof, and may be connected using any suitable technique, as described above. .

In some implementations, any suitable number of remote servers are connected to the network. The remote server may be a general purpose, special purpose, or any combination thereof. In some implementations, one or more search engine servers are connected to the network. In some implementations, one or more database servers are connected to the network. In some implementations, the system is understood to employ any suitable number of general purpose, special purpose, storage, processing, retrieval, any other suitable server, or any combination thereof.

In some implementations, the user device includes input / output equipment and processing equipment. In some implementations, the input / output device includes audio equipment including a display, a touch screen, a button, an accelerometer, a global position system (GPS) receiver, a camera, a keyboard, a mouse and speakers and a microphone. In some implementations, it is understood that the equipment included in the smartphone user device may depend on the type of user device, the particular equipment included in the exemplary personal assistant module, main server / Big Data DB system. For example, the input / output devices of the desktop personal secretary module, the main server / Big Data DB may include a keyboard and a mouse, and may omit the accelerometer and the GPS receiver. The user device may omit any relevant elements to process any suitable personal assistant module data and may be any suitable device such as a media drive, a data storage medium, a communication device, a display device, a processing device, any other suitable equipment, It will be appreciated that equipment such as a combination may be included. Any other suitable equipment, or any combination thereof.

In some implementations, the display may be any other suitable type capable of displaying content related to a liquid crystal display, a light emitting diode display, an organic light emitting diode display, an amorphous organic light emitting diode display, a plasma display, a cathode ray tube display, a projector display, Or any combination thereof.

In some implementations, the display is controlled by the display controller or by a processor in the processing equipment, by processing equipment within the display, by other control equipment, or by any combination thereof.

In some implementations, the touch screen includes a sensor capable of sensing a pressure input, a capacitance input, a resistance input, a piezo electric input, an optical input, an acoustic input, any other suitable input, or any combination thereof. In some implementations,

A touch screen for input associated with the personal secretary module may receive a touch-based gesture. In some implementations, the received gesture may include one or more locations on the surface of the touch screen, the pressure of the gesture, the speed of the gesture, the duration of the gesture, the path direction traced on the surface by the gesture, Other appropriate information about the gesture, or any combination thereof. In some implementations, the touch screen is optically transparent and positioned above or below the display. In some implementations, the touch screen is connected to and controlled by a display controller, a sensor controller, a processor, any other suitable controller, or any combination thereof.

In some embodiments, the corresponding display element by the gesture received by the touch screen, which scans up to the personal secretary module and inputs information for reproducing the personal secretary module to the 3D printer, as well as the form including the dimensions of the object , Immediately after, or after a short delay). For example, if the gesture is a movement of a finger or stylus along the surface of the touch screen, the search system displays on the display any visible thickness, color, or pattern of lines that represents the path of the gesture. In some implementations, for example, the functions of a desktop personal assistant module, a main server / big data DB, and a touch screen using a mouse may be wholly or partially replaced using a mouse pointer displayed on the display screen.

In some implementations, the button that scans up to the personal secretary module as well as the form that includes the dimensions of the object and reproduces the personal assistant module with the 3D printer may include one or more electromechanical push-button mechanisms, slide mechanisms, switch mechanisms, rocker mechanisms, toggle mechanisms , Other suitable mechanisms, or any combination thereof.

In some implementations, the button is included in the touch screen with a predefined area of the touch screen (e.g., a soft key). In some implementations, the button is included in the touch screen as a region of the touch screen defined by the display and indicated by the search system. In some implementations, when the button is activated, the signal is transmitted to the sensor controller, processor, display controller, any other suitable processing equipment, or any combination thereof. In some implementations, the actuation of a button may cause a push gesture, a sliding gesture, a touch gesture, a pressing gesture , a time-based gesture (e.g., based on the duration of the push), any other suitable gesture, Lt; / RTI &gt;

In some implementations, an accelerometer for detecting a personal assistant module may receive information about motion characteristics, acceleration characteristics, orientation characteristics, tilt characteristics, and other suitable characteristics of the user device, or any combination thereof. In some implementations,

In some implementations, a global positioning system (GPS) receiver for a location in which a personal assistant module area is included to analyze a personal assistant module input secretary event pattern to extend a realistic personal assistant module area may receive a signal from a GPS satellite have. In some implementations, a GPS receiver receives a personal assistant module from one or more satellites orbiting the earth orbit, and this information includes time, orbits, and other information associated with the satellite. Some implementations use this information to calculate the position of the user device on the surface of the earth. In some implementations, the GPS receiver includes a barometer that improves positional accuracy. In some implementations, the GPS receiver receives information from other wired and wireless communication sources relating to the location of the user device. For example, the location and location of a nearby cellular phone tower may be used in place of or in addition to GPS data to determine the location of the user device.

The complementary metal oxide semiconductor associated with personal secretary module data

In some implementations, the camera includes one or more sensors that detect light. In some implementations, the camera receives a video image, a still image, or both. In some implementations, the camera may be a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor, a photovoltaic sensor, an IR sensor, any other suitable sensor, . In some implementations, the camera includes a device that can generate light to illuminate an object, e.g., LED light. In some implementations, a camera communicates information captured by one or more sensors to a sensor controller, a processor, any other suitable equipment, or any combination thereof. In some implementations, the camera includes lenses, filters, and other suitable optical equipment. The user device is understood to include any suitable number of cameras.

In some implementations, the audio equipment includes sensors and processing equipment that receive and transmit information using acoustic or pressure waves, one of the personal assistant modules. In some implementations, the loudspeaker includes equipment that generates an acoustic wave in response to the signal. In some implementations, the loudspeaker includes an electroacoustic transducer that connects the electromagnet to the diaphragm to generate an acoustic wave in response to the electrical signal. In some implementations, the microphone includes an electroacoustic device that converts acoustic signals to electrical signals. In some implementations, a condenser-type microphone uses a diaphragm as part of a capacitor to induce an acoustic wave to change the capacitance of the device and use it as an input signal to the user device.

In some implementations, the speaker and microphone are contained within the user device, and are remote devices connected to the user device by any suitable wired or wireless connection, or any combination thereof.

 In some implementations, the loudspeakers and microphones of the audio equipment for scanning to the personal assistant module, as well as the form including the dimensions of the object, to reproduce the voice waveforms with the 3D printer are connected to the audio controller in the processing equipment. In some implementations, the controller performs pre-processing and filtering steps prior to transmitting and receiving signals from the audio equipment and transmitting signals associated with the input signals to the processor. In some implementations, the speaker and microphone are connected directly to the processor. In some implementations, the connection from the audio equipment to the processing equipment is a wired, wireless, any other suitable arrangement for communicating information, or any combination thereof.

In some implementations, the processing device of the user device includes a display controller, a sensor controller, an audio controller, a processor, a personal assistant module mapping storage, a communications controller, and a power source.

In some implementations, the processor includes circuitry for interpreting signal inputs from the touch screen and microphone to the user device, for example. In some implementations, the processor includes circuitry that controls the output to the display and the speaker. In some implementations, the processor includes a circuit for performing instructions of a personal secretary module, a main server / big data DB program. In some implementations, the processor is an integrated electronic circuit capable of executing instructions of a personal assistant module, a main server / big data DB program, and includes a plurality of inputs and outputs.

In some implementations, the processor is coupled to a personal assistant module mapping storage.

In some implementations, as described above, the functions of the display controller, sensor controller, and audio controller may be wholly or partially implemented as discrete components in the user device, and may be wholly or partially integrated within the processor, Or a combination thereof, or

And are implemented in any combination.

In some implementations, the communication interface is coupled to the processor of the user device. In some implementations, the communications controller uses antennas to communicate radio frequency signals. In some implementations, the communications controller uses a wired connection to communicate signals. In some implementations, the wired and wireless communications communicated by the communications interface may be implemented using any of a variety of communication technologies, including but not limited to Ethernet, amplitude modulation, frequency modulation, bit stream, code division multiple access, global mobile communication system, general packet radio service (GPRS) Wi-Fi, WiMax, any other suitable communications configuration, or any combination thereof. In some implementations, the functionality of the communications controller is implemented wholly or partially with discrete components in the user device, wholly or partially within the processor, or in any combination thereof.

Any other suitable power source associated with the personal assistant module data

In some implementations, the power source is coupled to the processor and to other components of the user device (the device associated with the personal secretary module data ). In some implementations, the power source includes a lithium-polymer battery, a lithium-ion battery, a NiMH battery, an alkaline battery, a lead acid battery, a fuel cell, a solar panel, a thermoelectric generator, any other suitable power source or any combination thereof . In some implementations, the power source includes a hard wired connection (such as a power line communication) to an electrical power source, and suitable electrical equipment (power line communication equipment) for converting the voltage, frequency and phase of the electrical power source input to power for the user device. .

In some implementations, the power source may be wholly or partially integrated into the user device, function as a standalone device, or any combination thereof. In some implementations, the power source may supply power to the user device by directly powering the user device, by charging the battery, by providing power by any other suitable technique, or by any combination thereof .

And provides a docking host configured to dock the token in a docking environment managed by the docking host. Wherein the docking host comprises at least one processor, a memory communicatively coupled to the at least one processor, a wireless charging circuitry communicatively coupled to the at least one processor to wirelessly charge the keyboard, and a Bluetooth Low Energy ) Protocol or a Wi-Fi protocol to communicate with the at least one processor. The at least one processor receives the request from the Toki to initiate an authentication / association operation with the Toki, sends the credential information to the Toki in response to the Toki landing on the wireless charger, To the docking environment.

A method for performing a docking service using a Wi-Fi in a wireless dockey (WD), the method including a docking information element 1 for discovering a wireless docking center (WDC) supporting a docking service Transmitting a probe request (Probe Request); Receiving a probe response including a docking information element 2 from a docking center receiving the probe request; And performing a docking connection with the docking center based on the received probe response, wherein the docking information element (1) comprises a docking role parameter indicating a role to perform as a token, a device name parameter indicating a name of the device, A docking information request parameter indicating a command of docking service discovery, and a docking information request parameter indicating a docking service discovery command.

 In another aspect, the disclosure provides a diagram configured to dock into a docking environment managed by a docking host. Here, the Toki includes at least one processor, a memory communicatively coupled to the at least one processor, a wireless charging circuitry communicatively coupled to the at least one processor to wirelessly charge the keyboard, and a Bluetooth Low Energy (BTLE) And a communication interface communicatively coupled to the at least one processor for communicating with the docking host using one of a protocol or a Wi-Fi protocol. The at least one processor receives the credential information from the docking host in response to landing on the wireless charger, sends a request to initiate an authentication / association operation with the docking host, Environment.

 In another aspect, the disclosure provides a docking host configured to dock a diagram in a docking environment managed by a docking host. Wherein the docking host comprises at least one processor, a memory communicatively coupled to the at least one processor, a wireless charging circuitry communicatively coupled to the at least one processor to wirelessly charge the keyboard, and a Bluetooth Low Energy ) Protocol or a Wi-Fi protocol to communicate with the at least one processor. At least one processor is configured to couple the wireless charging circuitry to the keypad when the keypad is landing on the docking host and to determine the docking intent of the keyboard in response to coupling the wireless charging circuitry to the keypad, To dock the token in a docking environment.

 In another aspect, the disclosure provides a diagram configured to dock into a docking environment managed by a docking host. Here, the Toki includes at least one processor, a memory communicatively coupled to the at least one processor, a wireless charging circuitry communicatively coupled to the at least one processor to wirelessly charge the keyboard, and a Bluetooth Low Energy (BTLE) And a communication interface communicatively coupled to the at least one processor for communicating with the docking host using one of a protocol or a Wi-Fi protocol. Wherein at least one processor is landed on a docking host, the docking host comprising a wireless charging circuitry, and depending on the docking intent of the keyboard

And docking intent is signaled to the docking host by landing on the docking host.

 In another aspect, the disclosure provides a diagram configured to dock with a docking environment managed by a docking host. Here, the Toki includes at least one processor, a memory communicatively coupled to the at least one processor, a wireless charging circuitry communicatively coupled to the at least one processor to wirelessly charge the keyboard, and a Bluetooth Low Energy (BTLE) And a communication interface communicatively coupled to the at least one processor for communicating with the docking host using one of a protocol or a Wi-Fi protocol. Wherein the at least one processor is configured to land on a wireless charger to establish a connection with the wireless charger using the wireless charging interface of the Toki and to receive, via the wireless docking host interface of the Toki, Transmitting the name information to the docking host, and docking the docking environment according to the credential information, wherein the docking environment includes a wireless charger as a peripheral.

 In another aspect, the disclosure provides a docking host configured to allow a peripheral device including a wireless charger to wirelessly charge a key. Here, the docking host may include at least one processor, at least one processor communicatively coupled to the at least one processor, and at least one processor to communicate with the wireless charger using either Bluetooth low energy (BTLE) protocol or Wi-Fi protocol Lt; RTI ID = 0.0 &gt; communicatively &lt; / RTI &gt; The at least one processor is configured to establish a docking session with the Toki, receive information from the wireless charger indicating that the Toki has landed on the wireless charger, and send an authentication to the wireless charger indicating that the wireless charging function is authorized.

Example: Personal secretary module for personal assistant module scan, main server / big data DB

Personal secretary module, main server / big data DB may typically include various personal assistant modules, main server / big data DB readable media. The personal secretary module, the main server / big data DB readable medium can be accessed by the personal assistant module, the main server / big data DB, and can be any volatile and nonvolatile media, any available Lt; / RTI &gt; By way of example, but not limitation, the personal assistant module, main server / big data DB readable medium may include a personal assistant module, a main server / big data DB storage medium, and a communication medium.

Personal secretary module, main server / big data DB storage medium are implemented in any method or technology for storing information such as personal assistant modules, main server / big data DB readable instructions, data structures, program modules or other data.

Communication media includes wired media such as a wired network or directly wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Any combination of the above should also be included within the scope of the personal secretary module, main server / big data DB readable medium.

The drives and their associated personal secretary modules of the present invention and the main server / big data DB storage medium include a personal secretary module, a personal secretary module in main server / big data DB, a main server / big data DB readable instruction, Modules and other data.

For example, a hard disk drive stores an operating system, application programs, other program modules, and program data. It should be noted that these components may be the same or different from the operating system, application programs, other program modules, and program data. The operating system, application programs, other program modules, and program data are given different codes here at least to illustrate that they are different copies. The user can input commands and information to the personal secretary module, main server / big data DB through input devices such as a keyboard and a mouse, a pointing device such as a trackball or a touch pad. Other input devices may include joysticks, game pads, satellite dishes, scanners, and the like. These and other input devices are often connected to the processing device through a user input interface connected to the system bus, but may also be connected by other interface and bus structures such as a parallel port, game port or universal serial bus (USB). A video display or other type of display device is also connected to the system bus via an interface, such as a video interface. In addition to the monitor, personal assistant modules, main server / big data DBs may also include other peripheral output devices such as speakers and printers that may be connected via the output peripheral interface. The personal secretary module and the main server / big data DB operate in a networking environment using a logical connection to the main server / big data DB, one or more personal secretary modules such as personal secretary module, main server / big data DB. Personal secretary module, main server / big data DB may be a personal personal assistant module, a main server / big data DB, a handheld device, a server, a router, a network PC, a peer device or other common network node, , And many or all of the elements described above with respect to the main server / big data DB. The logical connections of the present invention include a local area network (LAN) and a wide area network (WAN), but may also include other networks. Such networking environments are commonplace in offices, private secretary modules across the enterprise, main server / big data DB networks, intranets and the Internet. When used in a LAN networking environment, the personal secretary module, main server / big data DB, is connected to the LAN via a network interface or adapter. When used in a WAN networking environment, the personal assistant module, the main server / Big Data DB typically includes a modem or other means for establishing communications over the WAN, such as the Internet. A modem, which may be internal or external, may be connected to the system bus through a user input interface or other appropriate mechanism . In a networking environment, program modules, or portions thereof, with respect to a personal assistant module, main server / big data DB, may be stored in a personal assistant module mapping storage device. However, without limitation, the remote application program of the present invention is depicted as resident on the personal secretary module, main server / big data DB. It will be appreciated that the network connection associated with the personal secretary module data is exemplary and that other means of establishing a communication link between the personal secretary module and the main server / big data DBs may also be used.

EXAMPLES: Personal Assistant Module Scan Details (Dimensions, Type, etc.)

As used herein, a personal secretary module can be scanned up to the personal secretary module as well as the form including the dimensions of the object, and can be communicated to the 3D printer through the SNS conversation related to the reproduction of the personal secretary module, &Quot; Personal electronic device "that collects content, TOC, etc. may be a mobile phone, a personal digital assistant, a handheld entertainment device, a pad or tablet personal assistant module, a main server / TV or cable converter box) (APPLE TV is a registered trademark of Apple Inc.). As used herein, the term "service" refers to a utility, function, or program code module that performs some work for the calling process, which does not have a user interface, Lt; / RTI &gt;

 Has access to current system resources (e.g., the central processing unit and the graphics processing unit of the platform) for scanning up to the personal assistant module and reproducing the personal assistant module with the 3D printer, as well as the form including the dimensions of the object, Quot; means a process of presenting a user interface or a graphical user interface to a user. On the other hand, a "background process" for analyzing a personal assistant module input secretary event pattern to extend a realistic personal assistant module area is a process that can be scheduled to access system resources but does not currently present a UI / GUI to the user. As used herein, the term "process " associated with a personal assistant module refers to information collected through a user application. The user application is eventually an executable code module capable of presenting a UI / GUI.

An exemplary list of information gathering operation limitations related to personal assistant modules in accordance with the present invention may be implemented to predict and limit adverse affects that may be experienced for multiple processes to the ontology DB in advance.

Personal assistant module scan processor scheduling.

The individual secretary module scan processes may be assigned different processor scheduling "priorities " in a manner that does not interfere with each other. Those skilled in the art will recognize that in operating environments such as UNIX and Mach, processes are not scheduled and threads are scheduled. In addition to the form including the dimensions of the object, It will further be appreciated that a thread is a part of a program, application, or process that can execute independently of, and concurrently with, other portions of a program, application, or process. In one embodiment, multiple threads may be assigned priorities from bands of priorities partially overlapping with corresponding priority levels assigned to foreground threads. The overlap priority bands increase the probability that multiple processes / threads will progress (i.e., execute) even if there is foreground process / thread execution. In this embodiment, it has been found advantageous to demote the corresponding threads using the entire quantum (i.e., lower their scheduling priority) without blocking for input / output operations, in order to improve thread responsiveness. In one embodiment, the priority of a thread is reduced by a single count each time it uses the entire quantum allocated without blocking (it will be appreciated that the process use of the entire quantum is the indicator that the process is using the central processing unit) . In another embodiment, the priority of a thread may be reduced by more than one count if this occurs.

Disk scheduling for personal secretary module scan data storage :

In one embodiment, one thread is given priority over other threads when accessing system storage units (e.g., magnetic hard drives and solid state hard disk units).

In one embodiment, the incoming network traffic may be adjusted by dropping all packets destined for the application at the background or non-executing state (e.g., stopped). In addition, artificially small buffer sizes may be reported to remote network sites to throttle incoming TCP (Transmission Control Protocol) traffic. Those skilled in the art will recognize that TCP has an existing set of traffic flow control mechanisms associated with buffer sizes and thus traffic is not transmitted over the network sooner than the recipient can handle it. As noted previously, in one embodiment, the sender may be reported to slow or stop the flow of incoming traffic.

Creating outgoing network activities related to personal secretary module data. In one embodiment, network access is coordinated through the use of two queues: one for jobs associated with foreground processes, and one for jobs associated with background processes. It has been found advantageous to provide foreground queue priorities on a single queue.

Graphic actions for personal assistant module scans.

For example, in one embodiment, such as the iPhone operating system, there are at least two mechanisms by which an application can write or draw on a display screen (IPHONE is a registered trademark of Apple Inc.). The first mechanism is through the use of specialized hardware, such as a graphics processing unit. The second mechanism is through the use of one or more of the central processors of the platform. According to one embodiment, in the iPhone operating environment, processes for scan backgrounds are not allowed to access specialized graphics hardware, for example, any background process attempting to access the GPU may be terminated. Any attempt to execute commands related to using the CPU to write to the drawing buffer / personal assistant module mapping storage is ignored. In some embodiments, the drawing personal assistant module mapping storage associated with the process / application placed in the background state may be marked as "removable &quot;. Thus, if the foreground process requires more personal assistant module mapping storage, it will display the display personal assistant module mapping storage (via standard personal assistant module mapping storage allocation techniques) originally approved for the process in the current background state, Can be used. 6. Notifications. When a process transitions from a background state to a foreground state, it may be acceptable to receive one notification for each type of notification . More specifically, in one embodiment, a plurality of notification secretary events may be integrated. For example, when a user rotates his or her personal electronic device (e.g., iPhone) from a portrait presentation to a landscape presentation, to a portrait presentation, and then back to a landscape presentation, the resulting three orientations The notification secretary events can be merged into a landscape that is a single notification-last state. This can improve the response of the application since it does not need to respond to multiple secretary events. Exemplary notification types include, but are not limited to, orientation change notifications (e.g., from an accelerometer or gyroscope sensor input), address book database notifications (occurring when address book entries are modified), and camera roll notifications Occurs).

Private secretary module scan share locks.

In one embodiment, any process that has a lock on a shared resource that goes to a paused state may be terminated (rather than stopped). Exemplary shared resources include special graphics hardware and file descriptors. In another embodiment, the shared resource is "removed" from the user application if it proceeds to a background state. For example, if an application has a lock on camera hardware, this lock is removed when the user application is placed in the background state. As used herein, a "paused state" is a condition in which a process is not allowed to schedule threads for execution, but that state is maintained in the primary secretary module mapping storage.

Personal assistant module scan hardware limitations. In one embodiment, background processes are prevented from obtaining access to specific system hardware resources. Exemplary hardware that is not available for background processes includes but is not limited to cameras, GPUs, accelerometers, gyroscopes, proximity sensors, and microphones.

Personal Secretary Module Scan Data Personal Secretary Module Mapping Storage Management. As the core personal secretary module mapping storage of the personal electronic device approaches a specified "critical" point, to keep sufficient personal secretary module mapping storage to accommodate execution processes, processes are removed from the personal secretary module mapping storage . In one embodiment, the process so removed may be dormant. In yet another embodiment, the process so removed may be terminated. As used herein, the phrase "core personal assistant module mapping storage" or "primary personal assistant module mapping storage" refers to a primary random access personal assistant module mapping storage of personal electronic devices Meaning; A "dormant process" is a process in which its operational state is recorded in a non-volatile private secretary module mapping storage and thus it can not schedule threads for execution and its primary private secretary module mapping storage "trace"; A "terminated process" is a process that can not be executed until its operating state is removed and therefore restarted . In one embodiment, a personal secretary module mapping storage that can be regenerated or reloaded (cleaned) on demand during a dormant operation processes only the modified personal secretary module mapping storage and can not be reconfigured otherwise. The non-volatile private secretary module Is recorded in the mapping storage. In another embodiment, the specified area of the non-volatile personal assistant module mapping storage is set except for boot time for use as a "sleeping" personal assistant module mapping storage. If the dormant process revives, its data in the non-volatile private secretary module mapping storage is returned to the primary private secretary module mapping storage, thereby freeing space in the non-volatile storage. In one embodiment, applications that are not accessed for longer than a specified time may be "dormant &quot;. Private Secretary Module of the Personal Secretary Module Scan Application Any desired way of choosing which applications to remove from the primary personal secretary module mapping storage may be created. For example, the least recently used application can be removed first. Alternatively, the largest current non-executing application may be removed. In one embodiment, applications selected for removal greater than a specified size (e.g., 8 MB, 16 MB, or 32 MB) may be terminated, while applications smaller than a specified size may be dormant. In yet another embodiment, the audio user applications may only be terminated after the paused user applications have terminated, but before the foreground user applications. Similarly, a "critical" point may be any value that the designer desires. Exemplary critical points may include 50%, 75% and 90%. By using 75% as an example threshold, applications can be configured so that when the primary private secretary module mapping storage reaches 75% of its capacity - for example, a 256 MB primary private secretary module mapping storage reaches 192 MB pool - will be selected for removal from the primary personal assistant module mapping storage.

Operating states: Identify and describe five operating states for a user process executing on a personal electronic device, as an aid in understanding how the above restrictions apply to the various services described below. Network services. The network service allows a suspended network application to maintain (e. G., Keep live) a communication socket for communication with its personal assistant module. As used herein, a network application is a user application that uses network communication sockets. An exemplary network application is a user VOIP application. In the prior art, when a user's network application / process is stopped, it loses its ability to maintain its own communication socket and consequently can not continue to receive communication data (e.g., incoming VOIP phone calls). An exemplary network service operation is demonstrated by a VOIP service operation in which the user's VOIP application begins to transition to a paused state. In one embodiment, as the VOIP process transitions to the paused state, it specifies to the operating system (e.g., via a network daemon) which time interval is required for transmission of the "personal secretary module" messages. This personal secretary module virtual information is responsible for reviving the process when the data is received at the process-related socket or at the expiration of a specified time - personal secretary module, heart rate for heart rate maintenance, heart rate, etc. For more information on this aspect, see U.S. Patent Publication No. 20090305732 entitled Managing Notification Service Connections and Displaying Icon Badges. Which applications are incorporated herein in their entirety. At a later time, the network private secretary module virtual information receives the message. The target application is then identified, revived into a background state, and delivers the message. The background VOIP application may respond to subsequent messages (e.g., incoming VOIP calls or "heartbeat request" messages). If the requested operation is to issue a heartbeat, the VOIP application may go back to a paused state. If the requested action is to respond to an incoming VOIP call, the VOIP application may request the operating system to issue a UI to select whether to accept or reject the call. If the call is ignored, the VOIP application can go back to the paused state. If the call is answered, the VOIP application may come to the foreground (e.g., by the user selecting the appropriate element in the UI represented by the operating system). (E.g., VOIP and WiFi or WiFi) sockets for paused processes in personal electronic devices of the type described herein, although it will be understood that the operating system personal secretary module virtual information is known in the art. Remuneration is new.

Personal Assistant module location of pan for scanning and geo-fencing service.

The location and geo-fencing service allows the background and paused processes to receive notifications (e.g., messages from the operating system personal secretary module virtual information) when a specified location secretary event occurs. Exemplary position secretary events may include, but are not limited to, reaching a specified location, departing a specified location, entering a specified area, leaving a specified area, or " May be specified). In one embodiment, the process / application must programmatically declare (for example via a p-list parameter) that it wants to assist the location and geo-fencing operation service. In another embodiment, geo-fencing operations do not require the use of p-list entries - all geo-fencing applications can help the geo-fencing service itself. In location operations, as long as the location tracking operation is in progress, the application may still be in the background - receiving processing time in accordance with the system scheduling mechanism (see discussion above). In one embodiment, if the tracing operation is terminated or otherwise aborted, the process may be suspended (i.e., placed in a suspended state; the process may also be terminated or dormant). When a process responds to a message, it can reject (pause) or block it in the background state waiting for the next message. In one embodiment, the number of user applications using location services in the background state is related to the use of other system resources, for example, when the system personal secretary module mapping storage is run low, The application may be terminated.

Personal Electronic Device Architecture: In one embodiment, the personal electronic device may be configured to use one or more of the aforementioned constraints to allow multitasking operations (e.g., opportunistic multitasking) Lt; / RTI &gt; may be implemented. As illustrated, user applications interact with standard operating system calls and an application initiator (e.g., "Springboard" in the iPhone operating system) to a multitasking service library to access and use the services described above do.

A real-time communication session involving transmission of a captured video image associated with personal secretary module data; For personal assistant module scan

An individual secretary module for a captured video image is a personal secretary module of a virtual or real item visible in the image. An example of a real-time communication session involving this is a video conference. In some embodiments, the mobile device may only transmit the captured video image of one camera at any given time during the video conference. However, in other embodiments, the mobile device may simultaneously transmit the captured video image from both its camera during a video conference or other real-time communication session. And generates a composite display that includes simultaneous display of a plurality of captured videos.

Background related to personal secretary module data Main display

The exemplary composite PIP display illustrated and discussed with this personal assistant module collaboration vendor shows the entire foreground insert display area within the background main display area.

Background to Personal Assistant Modules Other composite displays are possible that have a foreground insert display area that is not completely contained within the main display area and overlaps with it.

In addition to transmitting video content during a video conference with another device, the mobile device in some embodiments may transmit other types of content along with the video content of the personal assistant module related conference.

Example (personal secretary module search)

The system converts the personal assistant module voice search query into a text search query, wherein the text search query includes a word sequence based on a corresponding adjusted probability value in the customized language model. The system may provide one or more search results of a text search query as a response to a voice search query for display on a display device. Embodiments of the present invention and the operations described herein may be implemented within a computer- Structures, and structural equivalents thereof, or in a personal assistant module, main server / big data DB software, firmware or hardware, or combinations of one or more of these.

The data processing device associated with the personal assistant module data

Embodiments of the present invention described herein may include, for example, one or more modules of a personal secretary module, main server / big data DB program instructions, and the modules include a personal secretary module, a main server / Big Data DB storage medium, the execution being implemented by one or more personal assistant modules, main server / big data DB programs, such as by a data processing device or for controlling the operation of the data processing device . Alternatively, or in addition, the program instructions may be, for example, electrically, optically, or otherwise generated by a machine generated to encode information for transmission to a suitable receiver device for execution by a data processing device associated with the personal secretary module It can be encoded on an artificially generated propagation signal such as an electromagnetic signal. Personal secretary module, main server / big data DB storage medium includes a personal secretary module, a storage device readable by the main server / big data DB, a personal secretary module, a storage substrate readable by the main server / Or a serial access personal assistant module mapping storage array or device, or a combination of one or more thereof. Furthermore, while the personal secretary module and the main server / big data DB storage medium are not radio signals, the personal secretary module and the main server / big data DB storage medium may be personal secretary modules encoded in an artificially- Server / big data DB program instructions.

Markup language related to personal secretary module data Personal secretary module Collaborators, files in coordinates

( E.g., a markup language, a personal secretary module collaboration , etc.) in files with multiple coordinates (e.g., one or more modules, sub-programs, And one or more scripts stored in a markup language document). The personal secretary module and the main server / big data DB program can be arranged to be executed on one personal secretary module, main server / big data DB or a plurality of personal secretary modules, main server / big data DB, The main server / big data DBs are located in one place or distributed across multiple locations and interconnected via a communication network. The processes and logic flows described herein may be implemented as one or more personal assistant modules, one or more programs that execute main server / big data DB programs to perform actions by operating on input data and generating output And may be performed by possible processing units.

Multitasking and parallel processing

Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in a number of embodiments, either individually or in any suitable subcombination. Moreover, the features may be described as acting in any combination, even so from the beginning, and one or more features from the claimed combination may, in some cases, be deleted from the combination, May relate to a sub-combination or a variant of a sub-combination. Similarly, while operations may be in a particular order, this is not to be understood as requiring that such operations are performed in a particular order or sequential order, or that all operations are performed in order to achieve the desired results do. In some circumstances, multitasking and parallel processing of data associated with a personal assistant module may be advantageous. Moreover, the separation of the various system components in the embodiments described above should not be understood as requiring such a separation in all embodiments, since the desired program components and systems are generally integrated together in a single software product Or may be packaged into a number of software products.

Multi-Touch Clarification System for Specifying Personal Secretary Module

A personal secretary module, and a main server / big data DB system according to an embodiment of the present invention. The personal secretary module and the main server / big data DB system may include, for example, a desktop or laptop personal secretary module, a main server / big data DB, a tablet personal secretary module, a main server / big data DB, , A personal data assistant (PDA), or any other type of computing device that is not limited to any particular form factor.

The personal secretary module, the main server / big data DB system may include a processing unit, a storage subsystem, input devices, a display, a network interface and a bus. The processing unit may be a single processor or multiple Processors. In some embodiments, the processing unit may include one or more special purpose coprocessors, such as a graphics processor, a digital signal processor, etc., as well as a general purpose main processor. In some embodiments, some or all of the processing units may be implemented using customized circuits such as application specific integrated circuits or field programmable gate arrays. In some embodiments, such integrated circuits execute instructions stored in the circuit itself.

 A sequence of instructions defining a specific machine implementation

Personal assistant modules, main server / big data DB readable storage media include carrier and transient electronic signals transmitted wirelessly or via wired connections. In some embodiments, the storage subsystem may store one or more software programs, e.g., bodily applications, to be executed by the processing unit.

"Software" generally refers to a program that, when executed by a processing unit, causes a personal secretary module, a main server / big data DB system, to perform various operations and thus define one or more specific machine implementations Quot; refers to sequences of instructions . The instructions may be stored as firmware and / or applications stored in a magnetic storage device readable by a personal assistant module mapping storage for processing by a processor resident in a read only private secretary module mapping storage.

The software may be embodied as a single program, or as a collection of discrete programs or program modules that interact as desired. The programs and / or data may be stored in non-volatile storage and copied to the volatile operational personal assistant module mapping storage, wholly or in part, during program execution. From the storage subsystem, the processing unit may retrieve program instructions and data to be processed to be executed to perform the various operations described herein. The user interface may include one or more user input devices, a display device, and / May be provided by a user output device.

The input devices may include any device from which a user may provide signals to the computing system; The computing system may interpret the signals as indicating specific user requests or information.

In various embodiments, the input devices may include any or all of a keyboard, a touchpad, a touch screen, a mouse or other pointing device, a scroll wheel, a click wheel, a dial, a button, a switch, a keypad, . In an embodiment involving gesture recognition, the at least one input device may provide a touch sensitive surface capable of detecting the position and movement of a plurality of distinct contact areas.

Various image creation techniques related to personal secretary module

Illustrative examples are described in U.S. Patent No. 6,326,846 and U.S. Patent No. 7,479,949; It will be appreciated that the implementation of a particular touch sensitive surface with respect to a personal assistant module is not required.

The "mapped" area associated with the personal assistant module data

For example, the processing unit may execute an imaged information mapping application (e.g., a body). An imaged information mapping application can provide a variety of functionality, such as the ability to image information in a particular area and display it in a visually good manner.

That is, the displayed area may be all or some of the "mapped" areas where body data is available.

The body data may be stored locally, for example, in a storage subsystem or stored remotely and acquired, for example, via a network interface as needed.

Refer to specific blocks

Also, while the personal assistant module, the main server / big data DB system, is described with reference to particular blocks, it will be understood that these blocks are defined for ease of explanation and are not intended to imply a particular physical arrangement of component parts. Also, the blocks need not correspond to physically distinct components.

The blocks may be configured to perform various operations, for example, by programming a processor or providing appropriate control circuitry, and the various blocks may not be reconfigurable or reconfigurable depending on how the initial configuration is obtained. Embodiments of the present invention may be implemented with input or output of personal assistant module data in various devices including electronic devices implemented using any combination of circuitry and software. A personal assistant module that executes the body application, and a body that can be displayed on the main server / big data DB system. The body represents a scaled area to fit the display.

<2D and 3D mode body creation module including personal secretary module related data>

In this example, the body may be a 3D body viewable at various angles, without being limited to vertical up and down to input personal assistant module related data, and the user may perform gestures to manipulate the display. In some embodiments, the body may be switched to 2D and 3D mode. The displayed map may be manipulated by the user. In some embodiments, the displayed body is rendered based on parameters defining the position and orientation of the virtual camera in 3D space. In response to the gesture input from the user, the command to change the parameters is executed so that the camera can be relocated (i.e., change position and / or orientation) and the body can be rendered again with new camera parameters. For example, the body may be panned by moving the virtual camera in a plane parallel to the body's groundplane so that other areas are visible. The body is zoomed in by moving the virtual camera closer or farther away from the reference plane along the optical axis of the virtual camera (or by changing the focal length or magnification constant associated with the virtual camera without moving) so that the visible area is enlarged or reduced can do. The body can be rotated by changing the orientation of the optical axis and / or "up" vector of the virtual camera. The body can be tilted by rearranging the virtual camera and changing the "tilt" angle between the optical axis and the reference plane of the body.

Map displayed relative to personal secretary module data

Examples of gestures that can be used to perform such an operation are described below. In some embodiments, the displayed map may also act as an interface that allows a user to access additional information. For example, a user may be provided with information on a location displayed on the body (e.g., by tapping a restaurant or a museum to obtain more information about the location (e.g., facility phone number, operating time, product and service provided, Other available location information may also be available, such as current or anticipated weather conditions, scheduled appointment events, sequential direction instructions to guide to the location, parking availability, and the like.

According to an embodiment, the body image may be, for example, a scene including a personal secretary module, a model of an object created by the main server / big data DB utilization design program, a real and / or personal secretary module, a main server / Or any other image of a real or imaginary 3D region. II. Examples of gestures that may be used to manipulate a map (or other image) being displayed in a single control mode will now be described. In these examples, a gesture is defined based on the number of contacts on the touch sensitive surface and the movement of the contacts. In some embodiments, the number of contacts is treated as a minimum number, and any excess contacts are ignored. The personal assistant, who causes the electronic device to move or move the display portion of the body in a direction selected by the user with respect to the display area It is a "fan" gesture for module data. In some embodiments, panning can be implemented by moving the virtual camera in a plane parallel to the reference plane of the body without changing the orientation of the virtual camera. When the body is displayed on the touch screen display, In some embodiments, the body may be moved along with the contact movement, for example, a finger, and the contact may be moved in any direction as indicated by the arrow. So that almost the same position is continuously under contact on the body, and both the contact and the body are moved relative to the edge of the display area. For example, in the body, the museum is under the contact, and in the body, the same museum remains almost under contact.

&Quot; Dragging "the body associated with the personal assistant module data,

Thus, the user can control the speed and direction of the body movement, and the pan gesture can provide an experience of "dragging" the body . Dragging the body may refer to changing the body part being displayed in the display area and / or changing parameters that define the boundary of the display part. In some embodiments, the user may change the direction. For example, a user may touch (e.g., a finger) on the screen, move the contact in any direction as indicated by the arrow, and then move in another direction (e.g., right, left, As shown in FIG. Correspondingly, the electronic device can move the body with the movement of the contact while the contact is being moved. Fan gestures that implicitly separate information about personal assistant modules (such as class) by motion are not limited to linear motion. In some embodiments, a user may define a curved motion path to the body. For example, the movement of the contact may be a curved path instead of a straight line indicated by. The movement of the contact may include any combination of linear and non-linear movement. In some embodiments, the fan may be regarded as a gesture comprising a linear movement of two or more contacts in one contact or parallel direction. Panning with two (or more) contacts can be distinguished from other gestures based on various combinations of motion characteristics, including linearity, direction, and speed of motion . The relative positions of the contacts can also be used to distinguish gestures. In some embodiments, the zoom (in or out) is directed along the optical axis of the virtual camera towards the reference plane. &Lt; Desc / Clms Page number 12 &gt; Moving the virtual camera and zooming in or moving away from the reference plane to zoom out. In some embodiments, zooming may be implemented by changing the magnification constant or focal length associated with the virtual camera. When displayed on the display, the user can move the contacts away from each other, as indicated by the arrows, with a touch (e.g., one finger and a thumb, or two fingers) touching the touch screen. Correspondingly, The electronic device can enlarge the body. This movement is often referred to as an outward pinch or "differential pinch. &Quot;

In some embodiments, the diphinch (or pinch) motion can be identified by an angle formed by the arrow. For example, a zoom in / out operation may be identified if it is within a critical angle of 0. In some embodiments, the body is magnified with the contact movement such that approximately the same position on the body remains below each contact.

Near the same intersection on the body related to the personal assistant module data

For example, both contacts are near the same intersection on the body , and the contact is near the same position on the body. That is, even after the movement causes a change in the display of the body to the body, the contact may have a similar arrangement with respect to the body object. Thus, the user can control the speed, angle and center position for the zooming operation.

In some embodiments, when the contact is moving slowly, the zoom in is adjusted according to the contact movement. In some embodiments, a quick de-pinch gesture (with two fingers) allows the body to be magnified by a predetermined step size, e.g., from the current magnification constant to the next "step ". There may be any number of predetermined steps, e.g., 10, 16, 20, etc., ranging from a minimum magnification to a maximum magnification for receiving a personal assistant module.

The associated "zoom out" gesture may also be defined to reduce the size of the rendered body. The zoom-out gesture can be defined as reversing the movement of the contact so that the pinch-in, for example, does not move away but moves closer to each other. The same concept as described above for de-pinching and zoom in, including adjustment of body magnification for fast or slow de-pinch and de-pinch move contact, can be applied to the inward-facing pinch operation for zoom out. In some embodiments, the zoom in and zoom out may be performed corresponding to a single gesture. A single gesture can be defined as being sustained or occurring from the time of the initial gesture to the gesture end secretary event (e.g., picking one or more contacts from the touch sensitive surface). For example, the user can start zooming out, determining that it is too much, and then returning the motion back to zoom in. In this example, the two fingers (or other contacts) of the user continue to contact the touch sensitive surface when zooming out and again zooming in. In some embodiments, Can be regarded as a single gesture that can be characterized by two or more contacts moving almost linearly in a modifying (increasing or decreasing) manner. For example, the contact is a first distance apart. After the movement, the contact is a second distance apart. In the de-pinch operation, the first distance is smaller than the second distance. In a pinch operation, the first distance may be greater than the second distance. The electronic device includes a "turn" gesture that causes the user to rotate the body with respect to the display such that the user views the body at different angles.

"Rotate" gestures related to personal secretary module data

In some embodiments, rotation may be implemented with rotation of the virtual camera about the optical axis of the virtual camera 20, and reorient the camera "up" However, for users viewing secretarial 3D images, this will not produce the desired effect, especially if the optical axis is not oriented perpendicular to the reference plane of the body. Instead, rather than showing the region side-to-side or upside-down, the user may prefer to rotate the view of the same region in the other direction. Thus, in some embodiments, the rotational motion can be defined as moving the virtual camera into a circle that is parallel to the reference plane of the body. The center of the circle is the "target point" where the optical axis of the virtual camera intersects the reference plane, and the radius of the circle is determined from the current tilt angle and camera placement.

At the same time, while moving around the circumference of the body, the camera is redirected through re-directing section 40 to keep the optical axis aimed at the target point. In the particular case where the optical axis is perpendicular (right down) to the reference plane, the circular motion of the virtual camera can be a rotation around the optical axis. When the body is displayed on the touch screen display, For example, a finger and a thumb, or two fingers) may contact the touch screen and move the contact in a circular manner about the common center of contact. To the user, movement can be similar to dialing with one finger and thumb. Correspondingly, the electronic device can rotate the body. In some embodiments, rotation is performed with movement from contact to contact, and from contact to contact, as indicated by the arrows.

The size of the rotation for receiving the personal secretary module may be such that a full 360 degree rotation of the contact around the common center corresponds to a full 360 degree rotation. In such a case, almost identical positions on the body may continue to be under contact due to rotation performed using the optical axis orthogonal to the body. For example, a contact may be in the same position on the body relative to another body object as compared to the contact (e.g., a slight deviation from a certain distance, about 1/4 below the block) For example, near a museum), it may be about the same position on the body as for other body objects. For optical axes of different orientations, this is not necessarily the case. In some embodiments, the rotation is adjusted in accordance with the contact movement when the gesture is performed slowly.

In some embodiments, a fast rotation gesture for receiving a personal assistant module may cause the body to rotate to a predetermined angle. In some embodiments, the rotation gesture can be distinguished from other gestures based on the rotation (as opposed to the linear) component of the movement, in which the two contacts rotate in the same direction about a certain point between them. Quot; tilt "gesture that can be used to adjust the viewing angle of the body, and this angle is often referred to as the tilt angle or pitch. In some embodiments, the tilt angle adjustment is implemented similarly to rotation except that the virtual camera moves in a circle perpendicular to the reference plane. The center of the circle is defined as the point at which the optical axis intersects the reference plane, and the plane of the circle includes the normal to the optical axis and the reference plane. As the virtual camera moves along the vertical direction circle, the camera is redirected so that the optical axis continues to aim at the target point at the same time. The inclination angle is defined as the angle between the reference plane and the optical axis, 0 degrees corresponding to the reference plane, and 90 degrees (normal to the reference plane) corresponds to looking down. In other words, we are looking down on the body area from above. To tilt the body (or to change the tilt angle), the user may place two contacts (e.g., two fingers, or fingers and thumb) along the X-axis of the display, and a line connecting them And can move to the contact position. The tilt gesture changes the viewing angle of the body through the changing unit 30 so that the body is visible in the obliqueangle instead of directly looking down. Which can be fed back to the virtual camera 20 to create a duplicate image.

The speed and magnitude of the tilt angle change can be determined based on user movement. For example, a transformation factor may be used to transform the distance traveled by the contact into a change in the tilt angle, and the change may be applied simultaneously with the movement of the contact.

In some embodiments, any excess contact (exceeding the number of contacts defining the gesture) may be ignored. In some embodiments, the user may add a new contact during the process of creating a gesture, remove one of the original contacts (e.g., exchange fingers), and such action may include at least a number of contacts defining the gesture At least one contact in accordance with the example) can continue to be processed with the same gesture as long as it is in contact with the touch sensitive surface. Other gestures may be defined and used in addition to or instead of the preceding gestures. For example, a fast swipe can move the body a predetermined distance in the swipe direction . A gesture that strikes a particular location on the body may cause the device to obtain and display information about the location.

The tilt angle can be limited to the maximum and minimum values. Zoom (or magnification) may also be limited by the maximum and minimum scale factors. Panning can also be limited, for example, if the body region has edges.

A body area that includes the entire surface of the planet

(This is not the case for a body area that includes the entire surface personal assistant module of a planet, but may be for a body of a different type, such as a body in a fictional area with a building, a city, or a boundary.)

For example, the movement of the body over the display may appear to change acceleration, deceleration, and / or direction based on changes in movement. If this change applies a predetermined change (e.g., in response to fast zoom or fast scroll gestures, as described above), acceleration and deceleration may be applied to the change using appropriate constants, for example, Friction coefficients may be used to model acceleration and / or deceleration.

Gestures as described above may be used to manipulate any other image of the 3D spatial domain including the body or any number and / or any type of object. Figure 2 is a flow diagram of a process for manipulating an image in accordance with an embodiment of the present invention. The process may be implemented in, for example, a personal assistant module, a main server / Big Data DB system or other electronic devices. In a block, an image of the 3D area is displayed. Depending on the implementation, this image may be, for example, a model of an object created by a body (e.g., a body, a personal secretary module, a main server / Big Data DB usage design program, a real and / / Rendering of an image of a scene containing a Big Data DB creation object, or any other image of a real or virtual 3D region.

Virtual camera parameters

The image may be displayed in a default state based on virtual camera parameters such as placement, orientation (e.g., rotation angle), viewing direction (e.g., tilt angle), and magnification constant.

Or a set of the most recent parameters set by the user (e.g., returning to the recently displayed screen each time the application is executed). In a block, a process may be performed on one or more Contact can be detected. In some embodiments, the touch sensitive surface may be a display. In some embodiments, other touch sensitive surfaces, including track pads, mice, and other user input devices, may also be used. In a block, a process may detect an initial gesture movement of one or more contacts. An initial gesture motion (often referred to as a hysteresis characteristic of a gesture) may include any motion that is intentional and / or large enough to be perceived distinctly from other motions associated with other gestures, examples of gesture motions Are described above and also in U.S. Patent Nos. 6,326,846; 7,469,381; 7,479,949; And U.S. Patent Application Publication No. 2008/0036743. In the block, the process may select the mode of operation based on the number of contacts and the initial gesture movement. Examples of operating modes may include any combination of the operations described above and described above (e.g., fan, rotate, zoom and tilt) and / or other operations. In some embodiments, the mode of operation may be determined using the process described above. Based on the selected mode of operation and the initial gesture motion, the process may change the displayed image in the block. For example, if a pan operation mode is selected (e.g., based on an initial gesture movement), the pan operation may be performed on the displayed image (e.g., on the body. And / or additional operating modes may be applied and displayed in the block.

Additional movement associated with gestures related to personal assistant module data

In some embodiments, the gesture itself may extend beyond the initial gesture motion, while the initial gesture motions to acquire the personal assistant module related data are responsible for identifying gestures in the block. Thus, in a block, the process may detect additional motion associated with the gesture and may further change the displayed image based on additional motion). At block, if no additional motion is detected, the process may determine whether a gesture end secretary event has occurred. For example, a gesture end secretary event may be detected if all contacts are removed from the touch sensitive surface and / or if all contacts remain for at least a critical period. If a gesture end secretary event is not detected, the process may return to the block to detect additional motion associated with the current gesture. When a gesture end secretary event occurs, the process may return to the block and detect another contact initiating another gesture. The process may allow the user to indicate the user's intent using any combination of gestures in any order To interact with the displayed image of the 3D region without requiring any additional input for the 3D region. The user can also start the manipulation gesture, confirm its effect in real time, react accordingly, for example, continue the gesture, change the speed or direction, or end the gesture as desired. As previously mentioned, the electronic device automatically distinguishes among the various gestures that the user may create and select the mode of operation so that the subsequent gesture termination secretary event The motion is interpreted and the displayed image can be manipulated according to the selected mode. The selection of the operating mode will now be described.

In some embodiments, a gesture made by a user may be identified as representing one of a set of distinct operations or any other, e.g., any of the pan, zoom, rotate, or tilt operations described above . In this case, the corresponding operation can be selected as the operation mode. They are also referred to herein as a single control mode indicating that only one type of change at a time applies to the body view. III. Multiple Control Modes Some embodiments of the present invention allow a gesture to be identified as applying a "multiple control" mode in which more than one type of change can be accompanied or at the same time.

Multiple control modes related to personal secretary module data

<Personal secretary module related data storage module>

An example of multiple control modes according to personal assistant module related data storage is a mode that allows pan, zoom and rotating changes to be made simultaneously or simultaneously while maintaining a constant tilt angle with respect to the vertical axis of body space.

A multiple control operation for obtaining personal secretary module data according to an embodiment of the present invention will be described. &Lt; / RTI &gt; and a contact that executes multiple control gestures to acquire personal secretary module data as indicated by the body view and arrows. These gestures combine the elements of a linear motion (associated with a pan gesture), a rotary motion (associated with a rotation gesture), and an extended motion (associated with a zoom gesture). Based on these factors, the body can be moved, rotated and zoomed to create a new view, for example, a body. In a multiple control mode, the body deformations can be adjusted according to the relevant components of the motion, and the user can have the experience of freely adjusting the body with the desired placement, orientation, and magnification. In some embodiments, (E.g., rotation and pan, pan and zoom, rotation and tilt, etc.) of any combination, and any number of distinct multiple control modes can be recognized. In some embodiments, the tilt control is not included in any of the multiple control modes, but is only available in a single control mode. May be selected by the device. The device may implement various heuristics based on the nature of the gesture (e.g., the number of contacts and the nature of the initial movement of the contact, such as direction and / or speed) to determine whether a particular gesture should apply a single control mode or multiple control modes It is also possible to determine that the specified mode is applied as well as a flowchart of a process for selecting an operation mode based on gesture input according to an embodiment of the present invention.

If the pan mode is selected in the block, the subsequent motion may be processed as continuing the pan gesture until a termination secretary event occurs. In a block, the process may determine whether a criterion for recognizing the zoom gesture has been met. As described above, these criteria include whether at least two contacts are detected; Whether one or more contacts move toward or away from each other; And whether the motion is primarily linear. If the zoom criterion is satisfied, at block, the process can select the zoom mode which is the third single control mode. If the zoom mode is selected in the block, subsequent movements may be processed as a continuation of the zoom gesture until a termination secretary event occurs. In a block, the process may determine whether a criterion for recognizing the rotation gesture is satisfied. As described above, these criteria include whether at least two contacts are detected; Whether the two contacts move in a roughly circular pattern; And whether the motion rotates about the common center about.

If the rotation criterion is met, at block, the process may select the rotation mode which is the fourth single control mode. If the rotation mode is selected in the block, subsequent movements can be handled as a continuation of the rotation gesture until a termination secretary event occurs. In a block, the process can determine whether criteria for recognizing multiple control gestures have been met have. As described above, the multiple control mode can be applied to gestures that combine aspects of various single control gestures. Thus, for example, when multiple control modes allow pan, zoom and rotation, the criteria for recognizing multiple control gestures include whether two or more contacts are detected; Whether the speed of the initial movement of one or more contacts is below a threshold; And whether the initial motion combines the attributes of at least two single control gestures such as pan + zoom, rotate + zoom, or rotate + pan. If multiple control criteria are met, in a block, The control mode can be selected. If multiple control modes are selected in the block, subsequent movements can be handled as a combination of pan, rotation, and zoom based on a particular motion. The multiple control mode may continue to be applied until a gesture end secretary event occurs. In some embodiments, the device may apply functions other than recognizing the gesture input and manipulating the displayed image.

Thus, at a block, the process may determine whether criteria for recognizing some other gesture (e.g., tap, double tap, swipe, etc.) are met. Examples of gesture-recognition criteria for multiple gestures are described in U.S. Patent Nos. 6,326,846; 7,469,381; 7,479,949; And U.S. Patent Application Publication No. 2008/0036743. If a different gesture is recognized, in a block, the process may execute the action associated with the gesture, which may or may not involve changing the image. If a gesture that is not about the manipulation of the displayed image is recognized in the block, the process may return to the block after performing the appropriate action in the block. (Or can be exited according to the behavior in question). In a block, if the gesture is not recognized, the process can ignore the input (block. In this case, the process can go back to the block and wait for another gesture .

It is to be understood that the process is illustrative and that variations and modifications are possible. The steps described as being sequential may be performed in parallel, the order of the steps may vary, and the steps may be altered, combined, added, or omitted. Additionally, the described criteria associated with various gestures are exemplary and other criteria may be used. Additional descriptions of techniques for recognizing and interpreting gesture input are disclosed in U.S. Patent Nos. 6,326,846; 7,469,381; 7,479,949; And United States Patent Application Publication 2008/0036743. In some embodiments, gesture recognition may be based on a scoring model rather than meeting certain criteria. A flow chart of a process for selecting an operation mode based on gesture input according to an embodiment of the present invention implementing a scoring model. For example, a process can be used to implement a block of a process.

In the block, the touch data received from the touch sensitive surface is analyzed to determine the position and velocity (speed and direction) of each of the one or more detected contacts. In the block, scores may be calculated for each gesture in a library of predefined possible gestures. The library may include, for example, pan, zoom, rotate and tilt gestures as described above, and other gestures may also be included. The library can define a scoring function for each gesture, and the scoring is a mathematical function of the characteristics of the contacts and / or their initial motions. The score may be defined to reflect the probability that a gesture with a set of certain characteristics intends a particular gesture to be scored.

In some embodiments, the scoring function may be a pool of users attempting to make various gestures in a known environment with biomechanical constraints (e.g., range of finger motions), estimation of user behavior, and / , &Lt; / RTI &gt; Various algorithms and techniques may be used to define scores for different gestures, and a library may include many gestures.

In some embodiments, threshold-based criteria and / or environment-based criteria may be used as a filter to reduce the number of gestures for which a score is calculated. In a block, the score associated with the different gestures may be scored such that any single gesture exceeds the threshold Lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt; The threshold can be defined as an absolute score or a difference between two peaks or a difference between a peak and an average score. If exactly one gesture has a score that exceeds the threshold, then in the block, a single control mode corresponding to the gesture having a score exceeding the threshold is selected. In some embodiments, the block may also include executing a function associated with a gesture not associated with image manipulation, which is similar to the block of the process described above. In the block, if the gesture does not exceed the threshold and can not be scored, multiple gestures can be selected if the score is scored above the threshold. For example, if multiple gestures score over a threshold, multiple control modes including all such gestures can be selected. If the gesture in the block does not exceed the threshold and can not be scored, a lower threshold may be applied in the block, and the selected multiple control mode may include gestures that have scored over the lower threshold. As another example, if two (or three, or even four, etc.) peaks are close enough together, the selected multiple control mode may be manipulated in association with gestures having two (or three, or four, etc.) peaks Can be combined. In some embodiments, a single multiple control mode may be defined (e.g., including rotation, pan and zoom control), and whenever the point comparison in the block does not represent a single clear gesture , . Other techniques for defining and selecting the multiple control modes may also be used. The gestures may include other elements of motion, but they are not described herein. For example, an object is near the center of the visible region in the body, and the object is toward the top of the body. This change may be associated with fan motion based on linear movement of the contact. In addition, the orientation of the object in the visible region has changed from body to body. For example, the orientation indicator indicates a first orientation and the orientation indicator indicates a second orientation. The change in orientation may be, for example, the result of angular rotation of the contact associated with the rotational movement. The distance between the contact and the contact and the distance between and are nearly equal. Thus, in the example, there is little (or no) zoom in or zoom out and the size of the building is nearly the same.

2 mode operation mode may occur when the user determines that two (only two) operation modes are desired. The gesture may be a combination of the elements of the motion (associated with the pan gesture) and the zoom-out motion (associated with the zoom gesture) do. For example, an object (and associated textual information) associated with the Moscone Convention Center may be associated with an edge of the visible region, for example, Change the layout. This change may be related to fan motion due to the linear movement of the contact. In some embodiments, as described above, the pan movement can be adjusted. For example, the contact is in approximately the same arrangement relative to the object under the contact (e.g., the building), and the contact is in approximately the same arrangement relative to the object under the contact (e.g., another building). In addition, the scale of the object in the visible area has changed from body to body. The scale change may be the result of a zoom in / out operation. The distance between contact and contact is greater than the distance between each configuration . Additionally, the movement of the contact is substantially linear with respect to the other of the contact. In some embodiments, as described above, the zoom movement can be adjusted. For example, the contact may be in approximately the same arrangement relative to the object underneath the contact (e.g., the end of the building), and the contact may be in the same position relative to the object beneath the contact (e.g., . In the example, there is little (or no) of each rotation (e.g., as happens when the user is making a dial turn), and thus the orientation of the body is almost the same. This orientation can be reflected by the orientation indicator as well as displaying the body object in almost the same orientation.

The mode selection process related to personal assistant module data

It will be appreciated that the mode selection process described herein is illustrative and that variations and modifications are possible. The steps described as being sequential may be performed in parallel, the order of the steps may vary, and the steps may be altered, combined, added, or omitted. Various combinations of score-based and threshold-based criteria may be used to distinguish the various gestures. The criteria may include any information of the personal assistant module that can be detected by the touch sensitive surface associated with the personal assistant module data, which includes the number of contacts; The position of each contact relative to the other contact; The location of each contact on the touch sensitive surface (also referred to as the "absolute"position); The speed of movement of each contact; The direction of movement of each contact (which may be defined relative to the touch sensitive surface and / or one or more other contacts); The pressure associated with each contact; The duration of each contact; The time between successive touches, and the like. Gesture recognition may be based on sequential (e.g., decision-making body) or specific criteria applied to the scoring model, and / or any combination thereof. The embodiments described above provide recognition of various gestures related to manipulating the displayed image of the 3D region. The gesture allows the user to change the orientation of the area (e.g., by turning and / or tilting), changing the magnification of the image (e.g., by zooming) and / (E. G., By panning). In some embodiments, the effect of the image-manipulating gesture can be implemented by rendering the image from the viewpoint of the virtual camera, and the gesture can be interpreted as changing the position and / or orientation of the virtual camera.

Single control mode associated with personal secretary module data

Through the operation of the single control mode , the user adjusts one display parameter at a time, but the operation of the multiple control mode allows multiple display parameters to be simultaneously adjusted, giving the user flexible and intuitive control over the screen. The device can automatically determine whether to operate in a single control mode or multiple control mode based on the characteristics of the gesture and the user can change the mode at any time by closing the current gesture and opening a new gesture. , Some embodiments provide one multiple control mode that allows simultaneous control of the pan, zoom, and rotation while keeping the tilt angle constant. Some applications (e.g., the body) may be helpful in that adjusting the tilt angle can make the user more confused than adjusting other parameters.

Pop-up graphic elements

In another embodiment, the pop-up graphical element may be displayed in response to a personal assistant module search query. In some embodiments, the pop-up graphical element may be "floating" over the object as if it were "air" on the object when in 3D mode, It can seem like it. In 2D mode, a pop-up graphical element may appear as if it were adjacent to the object (e.g., up, down, or next to the object). In response to the manipulation gesture, the pop-up graphic element may remain in approximately the same arrangement for the object. For example, a pop-up graphic element may "float" over an object after zooming, pan, rotating, tilting, or a combination thereof. In some embodiments, the pop-up graphic elements remain approximately the same size corresponding to the zoom in or zoom out operation, but the surrounding objects in the image are of different sizes. In some embodiments, the pop-up graphical element may be displayed as long as the object associated with the pop-up graphic element is displayed on the screen. &Lt; RTI ID = 0.0 & It continues to be displayed on the ground.

For example, the pop-up graphic element may continue to be displayed on the screen after the pan (or rotate, tilt, zoom) operation as long as the object is within the visible area, even after operation. In some embodiments, the pop-up notification disappears when the object leaves the viewing area (and / or is hidden by other objects on the display, such as a 3D building object). In some embodiments, the pop-up graphic element is not displayed again, as the object re-enters the visible area (e.g., as a result of a gesture of panning the screen so that the object is almost redrawn back to the original screen after leaving the screen) In another embodiment, the pop-up graphic element is displayed again.

Additionally, gesture interpretation techniques for acquiring data related to the personal assistant module described herein provide the ability to clarify gestures and can apply multiple control modes of operation that combine multiple gestures where gestures are also recognized individually Since such techniques have applicability to situations other than manipulating 3D images, the techniques described herein are used to distinguish related gestures in other environments, and the images of 3D regions or objects The user can allow multiple control modes for any user interaction including interactions that are not related to the gesture. The gesture can be detected using any touch sensitive surface. In some embodiments, the touch sensitive surface may be another component of a display device that provides an overlay or touch screen interface. However, a touch sensitive surface, e.g., a trackpad, that is located away from the display device may also be used. The contact may be made using a finger, stylus, or other object detectable by a particular touch sensitive surface. In some embodiments, the touch sensitive surface may be proximity sensitive, and the "contact" may be detected based on proximity to the surface without actual physical contact. Embodiments of the present invention may include dedicated components and / May be realized using any combination of processors and / or other programmable devices. The various processes described herein may be implemented in any combination on the same processor or on different processors. In the case where components are described as being configured to perform certain operations, such a configuration may be achieved by programming electronic circuits (e.g., microprocessors) that are programmable to perform an operation, for example by designing the electronic circuits to perform the operation , Or any combination thereof. In addition, while the embodiments described above may refer to particular hardware and software components, those skilled in the art will appreciate that other combinations of hardware and / or software components may also be used and that certain operations described as being implemented in hardware may also be implemented in software Or vice versa. &Lt; RTI ID = 0.0 &gt; The main server / big data DB readable medium may be packaged with a compatible electronic device, or the program code may be stored in a memory such as a personal secretary module packaged separately via an Internet download or a main server / Although the present invention has been described with respect to specific embodiments, it will be apparent to those skilled in the art that the present invention covers all modifications and equivalents within the scope of the following claims As will be understood by those skilled in the art.

An exemplary environment (personal secretary module, main server / big data DB); Personal assistant module Various configurations for input or control devices

And illustrates the environment of an exemplary implementation that may operate using the techniques described herein. The environment shown includes a computing device including a personal secretary module, a main server / big data DB readable storage medium, represented as a processing system and a personal assistant module mapping storage, but other configurations are contemplated, as further described below The personal secretary module, the main server / big data DB, and so on, can be configured in various ways. Thus, the personal secretary module, the main server / big data DB is a real personal secretary module mapping storage and a full resource device (E.g., a conventional set-top box, a hand-held device having a processing resource) and / or a personal assistant module mapping storage and / A personal secretary module, a main server / big data DB, and a personal secretary module, a main server / big data DB May represent a plurality of different devices, such as a plurality of servers used by a business (e.g., a web service) to perform an operation, a remote control and set-top box combination, an image capture device configured to capture a gesture, In addition, the personal secretary module and the main server / big data DB include the operating system.

Personal assistant modules in various ways related to personal secretary module data, main server / big data DB

A personal secretary module capable of communicating via a network, a main server / a big data DB

A plurality of servers used by a business entity (e.g., a web service)

The operating system for controlling the personal secretary module data is configured to abstract the basic functions of the personal secretary module, the personal secretary module, and the main server / big data DB to the executable application in the main server / big data DB. For example, the operating system abstracts the display device functions of a processing system, personal assistant module mapping storage, network and / or personal assistant modules, main server / big data DB, Can be created.

Abstract of operating system and display device functions related to personal secretary module data

The application may provide data to the operating system to be rendered and displayed by the display device described, for example, without understanding how rendering of such personal assistant module data is performed. The operating system also includes various other modules, such as a personal assistant module, a file system that can be navigated by a user of the main server / big data DB, and a user interface to manage user logins to provide access to resources specific to the user Function. The application includes an image module that represents functions related to the management of the image. Although included as part of the application, the functionality of the image module may be implemented in a variety of ways (e.g., as part of an operating system, as a standalone application, distributed throughout the environment, used as part of a network service, etc.) An example of a function related to the management of an image by an image module includes image curation.

This includes the creation of criteria that can potentially be used to find "interesting" images related to the personal assistant module, and can be performed automatically by the image module associated with the personal assistant module, without user intervention. Examples of criteria include, but are not limited to, time based criteria (e.g., eight months), person based criteria (e.g., user, user's child, user's friend), location based criteria ), Etc. The image module may also be configured to access images from a variety of different sources. The image module may also include an image source accessible via the network. An example of this may be a network (e.g., a network) that includes an image, And is one of a plurality of other service providers configured to support the service.

Thus, it may include a social network related to personal assistant modules, an image sharing service, an image storage service, and the like. Thus, the image module can be configured to support interaction with images from a variety of different sources, and can be automatically supported without user intervention, examples of which are described in connection with the following drawings. &Lt; / RTI &gt; shows a system of an exemplary implementation configured to access an image from a source. As described above, an image module for acquiring data related to a personal assistant module can access images from various other image sources. One such example includes a personal assistant module, a main server / big data DB (e.g., a personal assistant module running an image module, a local store of a main server / big data DB) The local repository of the data DB may include, for example, one or more folders in which images are archived. In another example, the image source may include other personal assistant modules associated with the user, main server / big data DB.

Thus, the image module may be configured to access images from such other devices, for example, through a login procedure using credentials accessible to the image module. In a further example, the image source includes a remote repository associated with the user. This may include a repository made accessible to the user to serve as a repository accessible over the network, one example of which is SkyDrive (SkyDrive is a trademark of Microsoft Corporation in Redmond, Washington). In yet another additional example, the image source may include a photo sharing service that is remotely accessible via the network.

Application

Image source

The personal assistant module related photo sharing service can be configured to support uploading of images that can be made accessible to the user (e.g., as a backup) and can be shared with other users. For example, another user may be granted permission to access the image through the receipt of an email containing the link, identification of an email address, etc. In addition, the image source may include a user's social network account . For example, an image may be uploaded by a user for sharing with another user (e.g., a user's " friend & quot ;, a personal secretary module of such an abstract noun could be expressed in terms of human relationship, intimacy, etc.) and / And can be shared with one of the other users via a social network. Thus, a "friend" or other specified relationship may be used by the user to grant access to the image to other users (and vice versa). In a further example, an image with a tag identifying the user (e.g., an image or other image that may be placed based on a tag stored as part of the metadata of the image) may be used as the image source. Thus, an image module can be used to access images from a wide variety of different sources, and other examples of these can also be considered. Regardless of the image source, the image module can provide an image Lt; / RTI &gt; can be used. For example, the image module may use a reference generation module that represents a function that generates criteria that can be used to identify a collection of images that may be of potential interest. Such generation can be performed automatically without user intervention in response to launching of an application, selection of an image viewing mode supported by the operating system, etc. A variety of different criteria can be generated by the reference generation module. This may include time based criteria and may include images from specific time frames over several years, such as weeks, holidays, months, seasons, years, and so on. As another example, the criteria may include "recent" images that were taken, edited and / or accessible within a predetermined time, recent comments received, Thus, the time-based criteria may be compared to metadata associated with the image to identify the image as further described below. As another example, the criteria may be based on the person included in the image. For example, the image may include metadata (e.g., a tag) describing the person included in the image. Other techniques may also be considered, such as using image analysis to identify similar users in a plurality of images. In a further example, the criteria may be location based. For example, the image may be geographically tagged so that the coordinates describing where the image was captured are included in the metadata associated with the image . Thus, in this example, the metadata may affect defining the criteria to be used to identify the image of interest. Other examples are also contemplated in which other criteria not defined in the metadata are used. For example, the pixel itself of the image may be used to define a reference (e.g., based on color, a particular user's ID, location, landmark, etc.). In addition, the quality of the image (e.g., whether the image is blurry, the video is stable, and other visual aesthetics) can also be used as a reference. The reference generation module also identifies The rule can be used when creating the criteria to be used. The rule may be, for example, to specify a criterion such that the same criterion is not used for continuous output, and a heuristic to change the criterion based on the monitored user interaction, etc. For example, So that the generation of the criterion is based at least in part on the criteria not used in the previous output so that the previous criterion is not repeated. Thus, the baseline generation module can use various other techniques to automatically generate baselines without user intervention. By the image identification module of the image module, a criterion can be used to identify an image that meets the generated criterion. This identification can be performed automatically by the module in various ways without user intervention.

For example, an image identification module can be configured to diagnose metadata of an image source remotely deployed over a network without downloading the actual image, thereby reducing network bandwidth and improving efficiency. Other examples in which downloading is performed are also contemplated. In this way, the image identification module can identify the image corresponding to the criterion generated by the reference generation module.

If a collection of interest (e.g., January Moments) is identified by the image identification module, an analysis of the collection by the subset selection module is automatically performed without user intervention to identify a subset of the images to be displayed . For example, the subset selection module can ensure that an even distribution is made across the collection using an algorithm with a particular probability curve for the collection. Images with a "data taken" field are used so that " far enough" images can be selected to prevent clustering (e.g., display of three photos that are variations of the same group shot) . Also, an image with a desired mix of landscape versus portrait orientation directed to a multi-up layout may be selected by the subset selection module. In a further example, the subset selection module may ensure that different image sources are used, for example, so that each of the images is not obtained from a single source. At this point, the image module is a cued subset Lt; / RTI &gt; The image module can then populate the image in a layout for display using an image layout module. The layout can take many different forms, such as a slide show, and supports a concurrent view of multiple images And so on. The layout of such personal assistant module data may be stored, for example, and may be shared with other users. Also, as further described with respect to the following figures, the layout may involve, for example, resizing, cropping, and other modifications of the image for inclusion in the layout, The image module may rotate the display of the image. An exemplary implementation is shown in which the image module populates the multi-up layout using the image layout module. The exemplary implementation uses the first and second stages.

Photo sharing service related to personal secretary module data

Remotely deployed over the network without downloading the actual image

In the first step, the populated layout is configured to include a plurality of images obtained from the subset for display by the personal assistant module, the main server / big data DB display device. As described, the layout may have different sizes and orientations for the images to be included in the layout. In a second step, the image layout module populates the layout. This includes the application of rules to determine the position within the layout for a given image. These rules may include matching the landscape image to the landscape layout location, matching the portrait image to the portrait layout location, arranging the images so that similar images are within the layout, and so on.

When viewing the layout, the image is included so that the pre-configured border is not visible to the user. For example, pixels of an image may be displayed proximal to each other such that pixels from other sources are not displayed between pixels of adjacent images. Of course, other implementations may be contemplated, including implementations in which the borders are displayed as described in the first step. Also, in the illustrated example, the layout is displayed in an immersive or modern shell that does not include a display of a "chrome (operating system) &quot;, such as a window, menu, slider, etc., but other examples are also contemplated. Once filled, a new image from the culled subset may be used by the image replacement module to replace the current image (e.g., one at a time, a subset, all at the same time, etc.) using the same or different layout matching as described above . In the illustrated example, the layout also includes at least one criterion used to identify the image (e.g., in the illustrated example, a description of the eight month (personal secretary module is warm, humidity, etc.) Once the display of the subset is complete, the additional curated subset is selected and displayed with the new description, if applicable. In this way, for example, one at a time, in the subset, As the user continues to view the layout, the user is presented with a sequential curated set of his or her record recorded by the image .

As described above, the image module may use the rules in the selection of the next cured set of images so that the same set is not included in succession. The rules can also be used to re-analyze the collection and select different subsets of the photograph when the specified set is saved.

Populating the layout related to personal secretary module data

Curated set

Further discussion of these may be found in the following sections, if various other examples are considered. EXEMPLARY PROCEDURES The following discussion describes image curing techniques that may be implemented using the systems and apparatus described above. Various aspects of each procedure may be implemented in hardware, firmware, or software, or a combination thereof. Procedures are shown as a set of blocks specifying operations performed by one or more devices, but need not be limited to the order in which the individual blocks are performed to perform an operation. Shows an exemplary implementation procedure in which an image is automatically displayed without user intervention based on automatically generated criteria. One or more modules are launched for execution in the personal secretary module, main server / big data DB (block. For example, the image module may be included as part of an application, operating system, etc. In response to launching, A criterion is automatically generated without user intervention through the execution of one or more modules by the main server / Big Data DB (block, for example, where a criterion identifies a potential interest image comprising a still and / or video image The criteria can be selected using rules to determine if the image should be used to do the following: The image is automatically cul- tured without user intervention through the execution of one or more modules using the generated criteria. For example, an image module may be used to cue an image The image may be identified, obtained, and organized. The cul- lated image may be automatically generated by the execution of one or more modules, without any user intervention, Main data is displayed by the display device of the main server / big data DB. Continuing to refer to the previous example, the curled image may be displayed at the time of launching the application such that the image is displayed without user input in addition to launching the application. In this way, an automated display of a collection of images of potential interest is provided to the user. Various other examples are also contemplated.

A subset of the identified images is matched to the image layout and is arranged in a time sequential fashion as part of the display of the layout. For example, by executing the reference generation module, the reference is automatically generated without user intervention. Using the generated criteria, images associated with the user are identified from a plurality of different image sources. With continued reference to the previous example, the image identification module may identify which image from the image source is compatible with the criteria generated by the reference generation module. A subset of the identified images is selected for display. Such a subset may be selected by the subset selection module based on the various considerations discussed previously. At least one of the images of the selected subset is matched to the position of the image layout. At least one of the images of the subset selected in the image layout is replaced with another one of the images of the selected subset. For example, the image layout module may assign an image to a specific location in the image layout . Such an image may then be time-sequentially placed at other locations in the layout to provide an active viewing experience. In addition, various other examples can be considered. Figure 2 illustrates the procedure of an exemplary implementation for curling an image using automatically generated criteria without user intervention. Images are culled using criteria automatically generated without user intervention, and the cured images are identified from a plurality of different image sources associated with the user. For example, an image can be cul- tured through the execution of an image module that identifies and organizes images for display in a user interface. This image can be obtained from a variety of different image sources. The cured image is automatically displayed by the display device without user intervention, and the cured image is displayed such that at least one image from the first image source is displayed on the second image Is displayed according to the layout to be displayed simultaneously with the second image from the source. For example, the image may include a personal assistant module, a local store of the main server / big data DB, other personal assistant modules associated with the user, a main server / big data DB (e.g., remote device such as a user's phone) A store, a photo sharing service, a user's social network account, an image containing a tag identifying the user, and the like.

An image of a subset related to personal assistant module data

Curation

Also, other images may be obtained, and such images may be obtained from a different source than the initial image. This image may then be displayed simultaneously, for example in a multi-up "layout, and further, various other layout examples may be considered. EXEMPLARY SYSTEMS AND DEVICES One or more An exemplary personal secretary module representing a computing system and / or device, and an exemplary system including a main server / Big Data DB, which inserts an image module as part of an exemplary computing device. The secretary module, the main server / big data DB may be a server of the service provider, a client (e.g., a client device), an on-chip system and / or any suitable personal secretary module, a main server / .

The exemplary personal assistant module, main server / big data DB, includes a processing system, one or more personal assistant modules, a main server / big data DB readable medium, and one or more I / O interfaces communicatively coupled to one another. Personal assistant module, main server / big data DB may further include a system bus or other data and command delivery system interconnecting the various components. The system bus may be any of other bus structures, such as a personal assistant module mapping storage bus or a personal assistant module mapping storage controller, a peripheral bus, a universal serial bus, and / or a processor using any of a variety of bus architectures, Or a combination thereof. Also, various other examples (e.g., control and data lines) are contemplated. A processing system represents the ability to perform one or more operations using hardware. Accordingly, a processing system includes hardware components that can be configured as a processor, a functional block, and so on. Which may include implementations in hardware as application specific integrated circuits or other logic devices formed using one or more semiconductors. The hardware components are not limited to the materials constituting it or the processing mechanisms used herein. For example, the processor may be a semiconductor and / or a transistor (e.g., an electronic integrated circuit). In that context, the processor execution instruction may be an electronically executable instruction. The personal assistant module mapping storage / repository comprises one or more personal assistant modules, a personal assistant module mapping storage / association module associated with the main server / big data DB readable medium, (E.g., a ROM, a flash personal assistant module mapping storage, an optical disk, a magnetic disk, etc.), and / or a non-volatile storage medium The personal assistant module mapping storage / storage components can be stored on a fixed medium (eg, RAM, ROM, fixed hard drive, etc.) and removable media A flash personal assistant module mapping storage, a removable hard drive, an optical disk, etc. The personal secretary module, main server / big data DB readable medium may be configured in various other ways The input / output interface allows the user to input commands and information into the personal secretary module, the main server / big data DB, and also allows the user to input information and / or other components or devices using various input / output devices It shows the function to be presented.

Examples of personal assistant module input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, a touch function (e.g., a capacitive sensor or other sensor configured to detect a physical touch), a camera Gestures that do not contain visible or visible wavelengths (eg, infrared frequencies) that recognize motion).

Examples of output devices for personal assistant module related information include display devices (e.g., monitors or projectors), speakers, printers, network cards, tactile-response devices, and the like. Thus, the personal assistant module, the main server / Big Data DB, can be configured in a variety of ways that are further described below to support user interaction. Various techniques are described herein for general, Can be described in context. Generally, such modules include routines, programs, objects, components, data structures, etc., and perform particular tasks or implement particular abstract data types.

The terms "module," " function, "and" component ", as used herein, refer generally to software, firmware, hardware, or a combination thereof. The features of the techniques described herein are platform dependent, which means that the techniques can be implemented on a variety of commercial computing platforms with various processors. Implementations of the described modules and techniques are stored, or transmitted via some form of personal secretary module, main server / big data DB readable medium. Personal secretary module, main server / big data DB readable medium may include various media that can be accessed by the personal secretary module, main server / big data DB. As an example, a personal secretary module, a main server / big data DB readable medium may be referred to as a "personal secretary module, main server / big data DB readable storage medium" But is not limited thereto. "Personal Assistant Module, Main Server / Big Data DB Storage Medium" may simply refer to a medium and / or device that enables continuous and / or non-transient storage of information relative to signal transmission, carrier or signal itself. Thus, the personal secretary module, the main server / big data DB readable storage medium, does not include the medium containing the signal. Thus, the personal secretary module, the main server / big data DB readable storage medium can be volatile and nonvolatile, removable and non-removable media, and / or personal secretary modules, main server / big data DB readable instructions, , Storage devices implemented in any method or technique suitable for storing information, such as logic devices / circuits or other data. "Personal Assistant Module, Main Server / Big Data DB Readable Signal Medium" may represent a signal bearing medium configured to send commands to the hardware of a personal secretary module, main server / Big Data DB, for example over a network . The signal medium may generally comprise data in a modulated data signal such as a personal secretary module, a main server / big data DB readable instruction, a data structure, a program module, a carrier wave, a data signal or other transport mechanism.

On-chip system associated with personal secretary module data and / or any suitable personal secretary module, main server /

Various commercial computing platforms with various processors

 The signal medium also includes any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a way as to encode information in the signal. For example, communication media includes, but is not limited to, wired media such as a wireless network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. As described above, the hardware components and the personal secretary module, the main server / big data DB readable medium may be implemented as modules, programmable device logic and / or fixed device logic (e.g., Which is implemented in hardware form that may be used in some embodiments to implement at least some of the features of the techniques described in FIG.

The hardware components that control the information associated with the personal secretary module may be implemented within the integrated circuit or components of the on-chip system, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a complex programmable logic device (CPLD) , And other hardware components. In this context, the hardware may operate as logic implemented by a processing unit and / or hardware that performs the program tasks defined by the instructions and may include, for example, the personal secretary module described above, the main server / Or as hardware used to store instructions for execution of the medium. The various techniques and modules described herein may also be implemented using a combination of the foregoing. Accordingly, the software, hardware, or executable modules and other program modules may be implemented in one or more instructions embodied in the form of a personal assistant module, a main server / big data DB readable storage medium, and / / / &Lt; / RTI &gt; logic. Personal secretary module, main server / big data DB may be configured to implement specific instructions and / or functions corresponding to software and / or hardware modules. Thus, implementations of modules executable as software by the personal secretary module, the main server / Big Data DB may be implemented, at least in part, in hardware, for example, in a personal secretary module, a main server / big data DB readable storage medium and / Can be achieved through hardware components of the system. The instructions and / or functions may be executable / operable by one or more manufactures (e.g., one or more personal assistant modules, main server / big data DB, and / or processing system) The exemplary system enables a ubiquitous environment for seamless user experience when applications are executed on a personal personal assistant module, a main server / big data DB, a television device, and / or a mobile device. Services and applications are executed in all three substantially similar environments for a common user experience when moving from one device to another while watching a video while playing a video game. In an exemplary system, A secretary module, and a main server / big data DB. The personal secretary module, the main server / big data DB, may be located at the same location or remotely from a plurality of devices. In one embodiment, the central personal secretary module, the main server / , One or more server personal assistant modules connected to a plurality of devices via the Internet or other communication link, and a cloud of main server / big data DB.

Modulated data signals associated with personal assistant module data

Ubiquitous environment

In one embodiment, such an interconnection architecture allows functionality to be delivered through a plurality of devices, thereby providing a common, seamless experience for users of a plurality of devices. Each of the plurality of devices may have different physical requirements and capabilities, and the central private secretary module, the main server / Big Data DB, may be customized for any device and at the same time provide experience sharing of devices common to all devices Use the platform to enable it. In one embodiment, a class of the target device is created and experiences are customized for the generic class of devices. The class of a device may be defined by physical characteristics, the type of use, and common characteristics of other devices.

In various embodiments, the personal assistant module, main server / big data DB may assume various configurations such as personal assistant module, main server / big data DB, mobile, and television applications. Each of these configurations may have overall different configurations and capabilities so that the personal secretary module, main server / big data DB may be configured according to one or more different devices, smart devices. For example, a personal secretary module, a main server / big data DB, a personal personal secretary module, a main server / big data DB, a desktop personal secretary module, a main server / big data DB, a multi- A data DB, a laptop personal assistant module, a main server / big data DB, a netbook, and the like. The personal secretary module and the main server / big data DB can also be used as mobile phones, portable music players, portable game devices, tablet personal assistant modules, main server / big data DB, multi-screen personal assistant module, main server / Or as a mobile class of an apparatus that includes a mobile device. The personal assistant module, the main server / big data DB, may be implemented as a television class of devices, including devices that are typically connected to a large screen or have a large screen in a normal viewing environment. These devices include televisions, set-top boxes, game consoles, and the like. The techniques described herein are supported by various configurations of personal assistant modules, main server / big data DB, and are not limited to the specific examples described herein. For example, the functions may be implemented in whole or in part using a distributed system across a "cloud" The cloud can include or represent a platform for resources. The platform extracts the basic functions of the hardware (eg, server) and the software resources of the cloud. The resources may include personal assistant modules, data and / or applications that may be utilized while the main server / big data DB processing is performed on a server remote from the main server / big data DB. The resource may also include services that are provided through a subscriber network, such as a cellular or Wi-Fi network, or over the Internet. The platform extracts resources and capabilities to provide a personal secretary module, a main server / Module, and main server / big data DB. The platform extracts the scaling of the resources and provides a scale level corresponding to the demand for resources implemented through the platform. Thus, in embodiments of interconnected devices, implementations of the functions described herein may be distributed throughout the system. For example, the functionality may be partially implemented on the personal secretary module, on the main server / Big Data DB, or on a platform that abstracts the capabilities of the cloud. Consequently, while the present invention has been described using expressions specific to structural features and / or methodological acts, it is to be understood that the invention defined in the following claims is not limited to the specific features or acts described. Rather, the specific features or acts described are set forth in the illustrative forms for implementing the claimed invention.

Ontology related to personal secretary module data

The constituent elements of an ontology can be classified into classes, instances, relations, and properties.

Class of Personal Assistant Module

A class can usually be described as saying the name we attach to things or concepts. "Keyboard personal secretary module", "monitor personal secretary module" and "love feeling" are all class.

Instance

An instance is itself a manifestation of a substance or event, or an actual form, such as an event. In other words, individual secretary modules such as "LG ST-500 Ultra Slim Keyboard", "Samsung Sync Master Wide LCD Monitor" and "Love of Romeo and Juliet" are generally referred to as instances. The distinction between classes and instances can vary greatly depending on the application and purpose of use. That is, an object of the same expression can be a class in some cases, or an instance in other cases.

Property

An attribute associates a class or instance with a particular value to indicate a specific nature, orientation, etc. of the class or instance. For example, you can define attributes such as hasSize to indicate that "Samsung Sync Master Wide LCD monitor is XX inches."

Here, Wide LCD monitor, XX inch, etc. may be personal assistant modules.

Relation

Relationships refer to relationships between classes and instances of personal assistant modules that exist between instances, and can generally be divided into taxonomic and non-taxonomic relations.

Taxonomic Relation is a hierarchical representation of classes and instances that are separated into broader concepts and concrete concepts for conceptual classification. For example, the "isA" relationship is used to express the conceptual relationship between concepts such as "man is an animal".

A non-taxonomic relation is a relationship that is not a taxonomic relationship. For example, "being healthy by exercise" is expressed using the "cause" relationship (causal relationship).

Concepts, Cases, Characteristics, and Relationships

template

It can analyze information analysis risk quickly or easily by automatically providing the new concept of risk analysis evaluation result using the past most similar failure analysis cases for personal secretary module.

Personal secretary module, main server / big data DB includes a bus, a personal assistant module mapping storage, a processor, a presentation component, an input / output port, an input / output component, and a power supply. The personal assistant module, the main server / Big Data DB is merely an example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. The computing device should not be construed as having any dependency or requirement relating to any one or combination of components. Personal secretary module, main server / big data DB typically includes various personal secretary modules, main server / big data DB readable medium. By way of example, and not limitation, the personal assistant module, the main server / big data DB readable medium may comprise a random access personal assistant module mapping storage; A read only private secretary module mapping storage; An electrically erasable programmable read only private secretary module mapping storage; Flash personal assistant module mapping storage or other personal assistant module mapping storage technology; CDROMs, digital versatile disks or other optical or holographic media; Magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to encode the desired information and which can be accessed by a personal secretary module, main server / big data DB. Embodiments of the present invention include personal assistant modules such as personal digital assistant or other handheld devices, personal assistant modules such as program modules executed by main server / big data DB, main server / big data DB executable instructions A personal secretary module, a main server / big data DB code, or machine-usable instructions. Generally, program modules, including routines, programs, objects, modules, data structures, etc., represent code that performs particular tasks or implements certain abstract data types. Embodiments of the invention may be practiced in a variety of system configurations including distributed computing environments where tasks are performed by remote processing devices that are connected through a communications network. Personal assistant module mapping storage, one or more processors, one or more presentation components, an input / output port, an I / O component, and an exemplary power supply Or directly or indirectly . A bus may represent one or more buses (such as an address bus, a data bus, or a combination thereof).

For example, a presentation component, such as a display device, may be considered an I / O component. The processor also has a personal assistant module mapping storage. There is no distinction between "workstations", "servers", "laptops", "handheld devices", etc., because everything is considered within a certain range.

Personal secretary module related personal secretary module mapping storage comprises a personal secretary module in the form of a volatile and / or non-volatile personal secretary module mapping storage (e.g. memory), a main server / big data DB readable medium and a personal secretary module, Server / big data DB storage medium. The personal assistant module mapping storage may be mobile, non-mobile, or a combination thereof. Exemplary hardware devices include personal assistant module mapping storage, hard drives, optical disk drives, and the like. Personal secretary module, main server / big data DB includes one or more processors for reading data from various entities such as personal assistant module mapping storage or I / O components. The presentation component presents the data representation to the user or other device. Exemplary presentation components include a display device that shows the appearance of the personal assistant module, a speaker that changes the characteristics of the personal assistant module to a characteristic frequency and outputs it, a printer (e.g., 3D) that depicts the characteristics of the personal assistant module as closely as possible, Modules and the like. The I / O port allows the personal assistant module, the main server / Big Data DB, to be physically and logically coupled to other devices including I / O components, some of which may be embedded. Exemplary I / O components A joystick, a game pad, a satellite antenna, a scanner, a printer, a wireless device, and the like. A personal secretary module for generating a contextual query, a main server / big data DB system includes a search engine, a query understanding component, and a data source instruction generator. The contextual query is generated based on the ontology associated with the query provided by the client device, and the ontology corresponding to the application formulating the query. The search engine receives the query from the client device and the context from the application. As a result, the search engine sends a contextual query containing the content corresponding to the query to the client device and the answer to the result. The client device displays the result with the answer. A personal assistant module configured to generate a contextual query in accordance with embodiments of the present invention, an example component of a main server / big data DB system is a network diagram. A personal secretary module, a main server / big data DB system has a client device, a network, a search engine, a data source command generator, and a query understanding component. The client device is connected to the search engine via the network. In some embodiments, the client device may be any personal assistant module, main server / big data DB, which is web accessible. As such, the client device may include a personal personal assistant module, a main server / big data DB, a laptop personal assistant module, a main server / big data DB, a mobile phone, a personal digital assistant, a server, An MP3 player, a video player, a handheld communication device, a workstation, any combination of these described devices, or any other device capable of web accessibility. The client device allows the user to enter a query. The client device sends the query to the search engine. In some embodiments, the client device also sends a context associated with the application used to formulate the query by the user.

The context associated with the application related to the personal secretary module data

In other embodiments, the search engine may provide the context. As a result, the client device receives results that include answers. The client device may also display the answers to the contextual query and the results of the query to the user. The network links client devices, search engines, data source command generators, and query understanding components. The network may be wired, wireless, or both. The network may include multiple networks, or a network of one of the networks. For example, the network may include one or more wide area networks, one or more local area networks, one or more public networks such as the Internet, or one or more private networks. In a wireless network, base stations, communication towers, and even access points and components (as well as other components) may provide wireless connectivity in some embodiments. While a single component is represented for clarity, those skilled in the art will appreciate that a network may enable communication between many client devices. The search engine is a server personal secretary module, a main server / big data DB, that provides answers to queries received from client devices and responses to contextual queries dynamically generated by a data source command generator.

Results for received queries related to personal secretary module data

The search engine is configured to receive user queries and application contexts. The search engine returns the results of the user query and the answers to the contextual query. In some embodiments, the search engine returns only the answer to the contextual query. The data source instruction generator is communicatively coupled to the query understanding component. In one embodiment, the data source instruction generator includes filter and lexical information. The data source instruction generator is configured to convert the semantic expression provided by the query understanding component into a contextual query, which can be implemented using a data source instruction selected based on lexical information associated with each data source, It is applied across data sources. In one embodiment, the data source includes an unstructured, structured, or semi-structured data source that is queried using one of Structured Query Language (SQL) or SPARQL (SPARQL Protocol and RDF Query Language) or textual keyword queries.

Query using structured query language (QL) or SPARQL (SPARQLProtocol and RDF Query Language) or text keyword query

The filter is configured to refine the semantic representation provided by the query comprehension component. The filter refines the semantic expression by enhancing the semantic expression based on the information associated with the current query session.

In one embodiment, the filter includes domain, collaboration, geographic, temporal, task, and user. The domain filter may be identified based on the application context. For example, a user searching for shares interested in personal secretary module data may be interested in the secretarial information domain or the cooking domain. The data source instruction generator may select one of these domains based on another filter. For example, the collaboration or community filter may indicate that the user is connected to a cooking group or a secretarial information group. Based on the group associated with the user, the data source command generator selects the relevant domain filter. For example, a user in the secretarial information community may be interested in company stock. Thus, the domain filter may be set to secretarial information.

The domain filter associated with the personal assistant module data includes secretarial information, geographic filters

For example, a user in the United Kingdom (British subject in England) may make a query and the geographic filter may be stored in a personal secretary module, a main server / big data DB system, . The temporal filter may include a time frame for the query. If the date or time is not included in the query, the temporal filter may be set to the current 24 hour period. The task filter may be selected based on the application used by the user, or it may be inferred by the personal secretary module, the main server / big data DB system . Tasks filters can include checking emails, searching for content, and editing private secretary module collaborators. The user filter may include profile attributes that override the value selected for the other filter. For example, an English user may be specific to a profile of interest including US stocks. Thus, geographic information about stock queries can be changed from the UK to the United States. These values for the filter are included in the semantic expression that is transformed into a contextual query by the data source command generator. The lexical information component is part of the data source command generator. The lexical information component is used to select the data source that receives the contextual query. A data source with lexical information similar to that of a contextual query is selected to receive contextual queries. In one embodiment, the lexical information component stores lexical information associated with the ontology and a data source that stores content passed by the search engine. In some embodiments, text mining is performed at each data source by a personal secretary module, a main server / big data DB system, to select lexical information associated with each data source stored in the lexical information component. As a result, the data source instruction generator generates a contextual query performed on the selected data source. The semantic representation of the query can be further processed to select the appropriate command for the selected data source. The lexical information components, ontologies, and rules are accessed to identify methods for each data source that access or compute related information from a data source based on concepts, properties, and semantic descriptions of the relationships contained in the semantic representation. The query comprehension component is configured to store an ontology that identifies the query type and the context type. Query comprehension The component also extends the semantic expression to define rules related to the items in the ontology that identify how to access or compute related information from the data source based on the semantics description of the concepts, to provide.

Semantic description of concepts, characteristics and relationships related to personal secretary module data

For example, a query type may identify one or more input types and one or more output types, where the input and output types correspond to concepts, examples, properties, or relationships of query ontologies or context ontologies. The query comprehension component is configured to generate a semantic representation of the query and context. The query ontology and context ontology can be used by the query comprehension component to generate a graph of semantic expressions based on URIs (Uniform Resource Identifiers) associated with each concept, instance, etc. included in the ontology. The semantic expression has the condition that it is a proper context rule of the user query and application context.

URIs (Uniform Resource Identifiers) associated with personal secretary module data

In one embodiment, the graph is a semantic query expression that is formatted in an extensibility markup language. A node query that has information about a private secretary module can include the following nodes: query type, context, and display template. For example, a natural language query for Company A may have a node query that has information related to various personal assistant modules. Depending on the data source, semantic query expressions are translated into data source specific queries to retrieve relevant answers and information from these data sources. In a semantic expression, a node query that has information related to a private secretary module is a formal representation of a different type of hierarchy of queries that an application can expect from its users. A node query with information about each individual secretary module is qualified by a set of input and output parameters that facilitate expansion to other parts of the ontology. A node question with information about a personal assistant module is a formal representation of a hierarchy of different types of context in which a user query can be captured and interpreted. A node query with information about a private secretary module can be explicitly derived from the query text, either implicitly identified by the interacting application to enable the user to query. A node query with information about each individual secretary module identifies the conditions and criteria for interpreting concepts, examples, etc. in a given query. A node question with information about a personal secretary module may expand or clarify the concepts, examples, etc. included in the semantic query expression.

Semantic graph related to personal secretary module data

The semantic graph is structured according to the query type of the query type ontology, the context type of the ontology, the node question template with information about the individual secretary module, and the lexical information associated with each data source. The ontology includes a word or phrase corresponding to the content of the data source. Each ontology includes a classification of the domain and the relationship between words or phrases in the domain. The domain may include medical, art, personal assistant modules, main server / big data DB, and the like. In one embodiment, the ontology also stores query types and context types. The query type associated with the personal assistant module identifies the type and structure of the text user query. For example, the query type may include natural language, structuring, in-line command, and the like. Context types identify and organize different types of contexts in which queries can be expressed. For example, the context may include a search engine, an email application, a secretarial application, and the like. Ontologies are related to rules. Rules can be referenced in semantic query expressions using URIs corresponding to appropriate rules. Rules identify concepts, examples, characteristics and relationships across multiple domains. In some embodiments, the rules may define a method or function used to calculate results from data contained in the data source.

Comparator, mathematical function, statistical function

For example, the rule may include a comparator, a mathematical function, a statistical function, or other heuristic. In other embodiments, the rule may also be associated with a function identified in a command available to the data source. In an embodiment, the answer is sent to the client device based on a contextual query dynamically generated from the query received from the user of the client device. A personal secretary module, a main server / big data DB system, a personal secretary module for dynamically generating a contextual query based on a query passed by a user and an ontology corresponding to an application when formulating a query, a main server / Implementation methods can be implemented.

When the personal secretary module, the main server / big data DB system, is connected to the network of the client device, the method starts at the step. In the step, the personal secretary module, the main server / big data DB system receives the user query and the application context. The context is provided by the application that the user runs during the current query session. In the step, the personal secretary module, the main server / big data DB system generates a semantic expression of the query using the domain ontology. The personal secretary module, main server / big data DB system determines the query and the context type using query and context ontology. The structure for semantic representation is derived from the query type included in the query ontology or from the template related to the context type contained in the context ontology. In the step, the semantic representation is refined using a filter associated with each domain that is passed in the current query session. The filter enforces semantic expressions on the basis of one or more applications that the user operates during the current query session request. In the step, the personal secretary module, the main server / big data DB system selects one or more data source commands to be submitted to the data source having content related to the term of the query. In some embodiments, the data source includes a structured data source, an unstructured data source, and a semi-structured data source. Structured data sources are queried using either Structured Query Language (SQL) or SPARQL (SPARQL Protocol and RDF Query Language). An unstructured or semi-structured data source is queried using a text keyword query. The method ends at step. In summary, the contextual query allows the user to pass through multiple data sources using the ontology associated with the query provided by the user, and the information embedded in the ontology associated with the application used to generate the query. For example, a user may send a query to a search engine that returns multiple results. In addition, search engines can also provide answers related to contextual queries formulated in user queries. For example, an answer to a user's secretarial information query is returned by the personal secretary module and the main server / big data DB system using an ontology-based understanding of the secretarial information query. The personal secretary module and the main server / big data DB system allow users to obtain answers to natural language queries such as "Companies with similar PE ratio as Company A", "Company Aoperating income", and "Company A and B valuation" The secretary information application (where the personal secretary module can provide the amount, allowable limit). The latter query process can use an ontology to understand that the evaluation includes a number of key ratios that must be computed using the current data. The key ratios may include "PE Ratio", "Price-to-Sales ratio", and so on. As a result, the secretarial application returns a comparison of these ratios and another evaluation metric for companies A and B. Natural language queries and corresponding ontologies are used to generate semantic representations.

Secretary application related to personal secretary module data

The secretarial application can convert the semantic representation to a node (sub-bank) query that has information about the personal secretary module that is made to the data source that contains the record passed to return the answer.

Location-based dialog interpretation is provided. For example, a voice-to-text conversion system may be provided that correlates information from a plurality of users to improve the accuracy of the query results contained in the converted and transformed statements. According to an embodiment of the present invention, a personal assistant program may receive voice-based queries from users at a plurality of locations.

Voice-based queries related to personal assistant module data

Acoustic and / or environmental characteristics are analyzed for each personal assistant module related search query, and these characteristics are stored and associated with the location where the query was received. For example, a query received from a user at a subway station can detect the presence of background sounds and / or acoustic echoes on the tile wall by crowd or subway. And that the properties are filtered out from future queries received at that location, allowing greater accuracy in the translation of those queries. In accordance with embodiments of the present invention, for example, a location of a user's Global Positioning System (GPS), an area code associated with a user, a zip code associated with a user, and / or a user's landmark (e.g., a train station, a gym, a museum, Etc.), and the like. Processing the query may involve adjusting the query according to an acoustic model.

Acoustic model related to personal secretary module data

For example, the acoustic model may include a background sound that is known to exist at a particular location. Applying the acoustic model allows the query to be converted more precisely by ignoring irrelevant sounds. The acoustic model can also allow the display of any results associated with the query to be altered. For example, in certain noisy environments, the results can be displayed on the screen rather than on the audio. The environmental context can also be associated with analytical models to aid in voice-to-text conversion. For example, the analytical model may include a HMM (Hidden Markov Model). The environmental context can be further associated with a semantic model to help execute the query. For example, the semantic model may include the disclosure of the patent document 10-2014-0025361.

Future queries related to personal secretary module data

Also, the subject of the query can be used to improve the results for future queries. For example, if users in a subway station give the query "What's next?", The assistive program can determine when the next train arrives, what the user wants, while going through some queries. This can be accomplished by asking for further explanation of the query from the first user and storing the description for future use. As another example, if a user gives a query "What's next?" And another user queries "When is the next train?", The program associates these queries and both users request the same information Can be assumed.

&Lt; / RTI &gt; is a block diagram of an operating environment that provides location-based dialog interpretation. The operating environment may include a spoken dialog system (SDS) that includes personal assistant programs, voice-to-text converters, and a context database. The personal assistance program may receive queries over the network from a first plurality of users at a first location and / or from a second plurality of users at a second location. The context database may store contextual data associated with queries received from users, such as a first plurality of users and / or a second plurality of users. The context data may include acoustic and / or environmental characteristics and query context information such as query subject, time / date of the query, user details, and / or where the query was made. According to embodiments of the present invention, the network may include a public network, such as, for example, a private data network (e.g., intranet), a cellular data network, and / or the Internet. The agent may be associated with a voice conversation system. These systems allow people to interact with their personal secretary modules, main server / big data DBs in their voices. The main components that operate the SDS may include a dialog manager, which manages dialog-based conversations with the user. The dialog manager may be configured to perform a combination of a plurality of input sources, such as speech recognition or natural language analysis component outputs, context in a previous conversation, user context, and / or results returned from a knowledge base (e.g., a search engine) The user's intention can be determined.

Combinations from a plurality of input sources associated with personal secretary module data

After determining the intent, the dialog manager may take actions such as displaying final results to the user and / or continuing the dialog with the user to satisfy their intent. The speech dialog system may include a plurality of dialog analytic models, such as an acoustic model associated with a speech language analysis model for processing location and / or voice-based inputs.

Multiple dialogue interpretation models

/ RTI &gt; is a flow diagram of general steps associated with a method according to an embodiment of the present invention for providing location-based dialog interpretation. The method may be implemented using a personal assistant module, the main server / Big Data DB, which will be described in more detail below. Methods of implementing the steps of the method will be described in more detail below. The method begins at the start block and proceeds to the step where the personal assistant module, main server / Big Data DB, can receive a voice-based query from a user in one location.

Voice-based queries related to personal assistant module data

For example, a user may send a query to the SDS via a device such as a cellular telephone. The method proceeds from step to step to allow the personal secretary module and the main server / big data DB to determine whether the environmental context associated with the location is present in the personal assistant module mapping storage device. For example, the SDS can determine where the query was received (e.g., identify the first location and determine if the context associated with the location is in the context database.) If the context associated with that location does not exist If not, the method proceeds to step to allow the personal secretary module, the main server / Big Data DB, to identify at least one acoustic interference in the voice-based query. For example, And may identify background noise such as that associated with a large number of crowds around the user and / or trains passing by. The method then proceeds to a step where the individual secretary module, the main server / big data DB, For example, if the query includes the question " When does the next personal secretary module-related object arrive? ", The train schedule can then be identified as the subject of the query when it is in the highway. The method then proceeds to the step where the personal secretary module, the main server / big data DB, For example, the SDS can store the identified acoustic interference and query subject in a context database as being associated with the user's location.

Context database related to personal secretary module data

If there is a context associated with the location, the method proceeds to step so that the personal assistant module, the main server / Big Data DB, loads the environmental context associated with that location. For example, the SDS can load an environmental context from the context database as described above. After creating the context or loading the context in the step, the method proceeds to step to convert the voice-based query into a text-based query in accordance with the environmental context of the personal assistant module, the main server / .

A filter that removes acoustic interference associated with personal secretary module data

For example, a query having information related to a personal assistant module may convert a noise-based query into a text-based query by applying a filter that removes at least one noise information interference associated with the environmental context. The method then proceeds to a step where the personal secretary module, the main server / Big Data DB, executes the text-based query according to the environmental context. For example, a query with information related to a personal assistant module may include a query (e.g., "When is the next arrival?") Within the search area (eg, a train timetable) in connection with at least one topic associated with the environmental context Can be executed. The method then proceeds to step to provide the user with at least one result of the text-based query in which the personal assistant module, main server / Big Data DB, is executed. For example, the SDS may send results to a device associated with the user (e.g., a cellular telephone) for display. The method then ends at the step. One embodiment in accordance with the present invention may include a system for providing location-based dialog interpretation. The system may include a processing unit coupled to the personal assistant module mapping storage device and the personal assistant module mapping storage device. The processing unit receives the query from the user, generates an environmental context associated with the query, interprets the query according to the environmental context, executes the interpreted query, and provides at least one result of the query to the user . The query may include, for example, a voice query that the processing unit converts it to a personal secretary module, main server / big data DB-readable text.

Semantic concept associated with semantic model related to personal secretary module data

In accordance with embodiments of the present invention, speech-to-text conversion may utilize a Hidden Markov model algorithm that includes providing statistical weights for various possible terms associated with the analytical model and / or the semantic concepts associated with the semantic model. The processing unit may, for example, increase the statistical weight for at least one predicted word according to at least one previous query received from the location, or store the statistical weight as part of an environmental context. The environmental context may include an acoustic model associated with the location at which the query was received. The processing unit may adjust the query according to at least one background sound of the voice-based query according to the acoustic model. For example, it can be known that there are background sounds (e.g., train miracles) in voice queries received from a given location (e.g., train station) . The background sounds are detected and the sound height, Can be measured.

Future queries related to personal secretary module data

The query can be adjusted to ignore such sounds and the sound can be computed and stored to be applied to future queries from that location. The processing unit may also receive a second voice-based query from a second user and adjust the query to remove the same background sound according to the updated acoustic model. The processing unit may also aggregate environmental contexts associated with a plurality of queries from a plurality of users and store them as aggregated environmental contexts associated with the locations. Another embodiment according to the present invention may include a system for providing location-based dialog interpretation. The system may include a processing unit coupled to the personal assistant module mapping storage device and the personal assistant module mapping storage device. The processing unit receives the voice-based query from the user at one location, loads the environmental context associated with the location, converts the voice-based query into text according to the environmental context, Execute the query, and provide the user with at least one result associated with the executed query. The environmental context includes, for example, the time of at least one previous query, the date of at least one previous query, the subject of at least one previous query, the semantic model including the ontology, the analytical model, can do. The processing unit may also adjust the query according to known acoustic interference associated with its location.

The processing unit associated with personal secretary module data

The processing unit may also store a plurality of environmental contexts associated with the plurality of positions synthesized according to the plurality of queries received from the plurality of users. The processing unit may also receive a calibration for the translated text from the user and update the environmental context according to the calibration. The processing unit also receives a second voice-based query from a user in the second location, loads a second contextual context associated with the second location, and loads the second voice-based query into text Translate the translated query into a second environmental context, and provide the user with at least one second result associated with the executed query.

Context-aware environment related to personal secretary module data

Yet another embodiment of the present invention includes a system for providing a context-understanding environment. The system may include a processing unit coupled to the personal assistant module mapping storage device and the personal assistant module mapping storage device. The processing unit receives the voice-based query from the user at one location and determines whether the environmental context associated with the location is present in the private secretary module mapping storage store. In response to determining that no environmental context exists, the processing unit identifies at least one acoustic interference in the voice-based query, identifies at least one subject associated with the voice-based query, And creates a new environmental context associated with that location to be stored in the storage device. In response to determining that an environmental context exists, the process unit loads its environmental context. The processing unit then converts the speech-based query into a text-based query according to the environmental context (converting the speech-based query into a text-based query according to the environmental context, Executing a text-based query according to an environmental context (implementing a text-based query according to an environmental context may include at least one acoustic interference associated with the acoustic model) Wherein the at least one identified subject includes executing a query associated with a semantic model associated with an environmental context) to provide the user with at least one result of the executed text-based query.

Any suitable combination of firmware associated with personal assistant module data

According to an embodiment of the present invention, the personal secretary module mapping storage device and the processing unit may be implemented in a personal secretary module, a personal secretary module such as a main server / big data DB, and a main server / big data DB. Any suitable combination of hardware, software, or firmware may be used to implement the personal secretary module mapping storage storage and processing unit. For example, the personal secretary module mapping storage storage and processing unit may be a personal secretary module, It can be implemented with main server / big data DB, or it can be implemented with personal assistant module, any other personal assistant module combined with main server / big data DB, main server / big data DB. The above-described systems, devices, and processors are illustrative and other systems, devices, and processors may include the personal assistant module mapping storage device and processing unit described above in accordance with embodiments of the present invention. In addition, the personal assistant module, main server / big data DB may include an operating environment for the system as described above. The system may operate in different environments and is not limited to this personal assistant module, main server / big data DB device.

One or more program modules associated with personal secretary module data

The system according to an embodiment of the present invention includes a personal secretary module, a personal secretary module such as a main server / big data DB, and a main server / big data DB. In a basic configuration, the personal secretary module, main server / big data DB may include at least one processing unit and a system personal secretary module mapping storage. Depending on the type of configuration and personal secretary module, main server / , The system personal secretary module mapping storage may include volatile (e.g., random access personal assistant module mapping storage, non-volatile (e.g., read-only personal assistant module mapping storage, flash personal assistant module mapping storage, The system personal secretary module mapping storage may include an operating system, one or more program modules , and may include personal assistance programs. The operating system may include, for example, a personal assistant module, And may be suitable for controlling the operation of the main server / big data DB. Furthermore, embodiments of the present invention may include a graphics library, The main server / big data DB may have additional features or functions, such as a personal assistant module, a main server / The secretary module, main server / Big Data DB may also include additional (removable and / or fixed) data storage devices such as magnetic disks, optical disks, or tapes. Such additional storage devices may be removable storage devices, The personal secretary module, the main server / big data DB storage medium may be any method for storing information such as personal assistant modules, main server / big data DB readable instructions, data structures, program modules, Volatile, removable and stationary media on which the techniques of the present invention may be implemented. The personal assistant module mapping storage, removable storage, and fixed storage are examples of personal assistant modules, main server / big data DB storage media (i.e., personal assistant module mapping storage storage) The main server / big data DB may also include input devices such as a keyboard, a mouse, a pen, a voice input device, a touch input device, and the like. Output devices such as displays, speakers, printers, etc. The above-described devices are exemplary and others may be used.

Modulated data signals associated with personal assistant module data

The personal secretary module, the main server / big data DB also provides a communication interface that allows the device to communicate with other personal secretary modules, main server / big data DB, such as through a network of distributed computing environments, such as the Internet or an intranet . A communication connection that can be spread over the air by a network is an example of a communication medium. The communication medium is typically implemented by a personal secretary module, a main server / big data DB readable instruction, a data structure, a program module, or other data in a modulated data signal such as a carrier wave or other transport mechanism, . The term "modulated data signal" may describe a signal that has changed in a manner such as having one or more sets of characteristics or encrypting information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, wireless media such as acoustic, radio frequency, infrared, or other wireless media. The term personal secretary module, main server / big data DB readable medium, as used herein includes both storage media and communication media. As described above, some program modules and data files may be stored in the system personal secretary module mapping storage, including the operating system. While running on the processing unit, a programming module (e.g., a personal assistance program, for example, may perform a process including one or more of the steps of the method as described above.) The process described above is exemplary and the processing unit Other programming modules that may be used in accordance with embodiments of the present invention may be electronic mail and contact applications, word processing applications, spreadsheet applications, database applications, slide presentation applications , A drawing or personal assistant module, a main server / big data DB-assisted application program, etc. Generally, in accordance with embodiments of the present invention, program modules include routines, programs, components, data structures, Do the assignment Or it includes other types of structures that may implement particular abstract data types.

Programmable consumer electronics related to personal secretary module data

In addition, embodiments of the present invention may be implemented in a portable device, a multiprocessor system, a microprocessor-based or programmable consumer electronics, a mini personal assistant module, a main server / big data DB, a mainframe personal assistant module, Other Personal Secretary Module, Main Server / Big Data DB System Configurations. Embodiments of the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communications network. In a distributed computing environment, program modules may be located in both local and personal secretary module mapping storage storage devices.

Discrete electronic device

In addition, embodiments of the present invention include electrical circuits including discrete electronic elements, packaged or integrated electrical chips including logic gates, circuits utilizing microprocessors, or electronic devices or microprocessors On a single chip. Embodiments of the invention also mechanical, optical, does not, however, limited to including the fluid or both techniques, for example, using different technologies that can perform logical operations such as AND, OR, and NOT conducted . In addition, embodiments of the present invention may be implemented within a general purpose personal assistant module, a main server / big data DB, or some other circuit or system. Embodiments of the present invention may be implemented in a computer system, such as a personal secretary module, a main server / big data DB program product or a personal secretary module, a main server / big data DB readable medium, Process, computing system, or article of manufacture. A personal secretary module, a main server / big data DB program product readable by a personal secretary module, a main server / big data DB system, a personal secretary module, a personal secretary module of commands for executing a main server / A personal secretary module encoding the main server / big data DB program, and a main server / big data DB storage medium. The personal secretary module, the main server / big data DB program product is also a radio signal or carrier readable by the computing system and includes a personal secretary module, a personal secretary module of instructions for executing the main server / It may be that the data DB program is encoded. Thus, the present invention may be implemented in hardware and / or software (including firmware, resident applications, micro-code, etc.). In other words, embodiments of the present invention may include a personal secretary module, a main server / big data DB-enabled or personal secretary module, a main server / big data DB-readable program implemented in the medium used by or connected to the command execution system, A personal secretary module with a code, a personal secretary module available on the main server / big data DB, a personal secretary module on the main server / big data DB-readable storage medium , a main server / big data DB program product have. A personal secretary module, a main server / big data DB-enabled or personal secretary module, and a main server / big data DB-readable medium may include, store and store a program used by or connected to an instruction execution program, , Communicate, propagate, or transmit data. A personal secretary module, a main server / big data DB-enabled or personal secretary module, a main server / big data DB-readable medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, Device, or propagation medium. Examples of more specific personal secretary modules, main server / big data DB-readable media include (but are not limited to) an electrical connection including one or more wires, a portable personal assistant module, a main server / big data DB diskette, (EPROM or flash personal assistant module mapping storage), a fiber-optic, and a portable compact disc read-only personal assistant There is a module mapping storage. It should be noted that the personal secretary module, the main server / big data DB-enabled or personal secretary module, the main server / big data DB readable medium may be a printed species or other suitable medium, May be electronically captured, e.g., by optical scanning of the medium, and then compiled, interpreted, or otherwise processed in an appropriate manner, and stored in a personal secretary module, main server / big data DB personal secretary module mapping storage Because. Embodiments of the present invention have been described above with reference to block diagrams and / or operations of, for example, methods, systems, and personal assistant modules, main server / big data DB program products, according to embodiments of the present invention. The functions / operations recorded in the blocks may be performed in a different order in the flowchart. For example, two blocks that appear consecutively according to their associated functions / operations may actually be executed concurrently, or the blocks may be executed in reverse order as well. While several embodiments of the invention have been described, other embodiments may exist. In addition, the steps of the methods disclosed herein may be modified in any manner including rearranging steps and / or inserting or deleting steps without departing from the invention.

Automatic speech recognition related to personal assistant module data

Spot Input: Inputs the desired language for automatic speech recognition.

Receiving a touch input from a user at a computing device comprising one or more personal assistant module related data processing processors, the touch input including a spot input indicative of a request to provide a voice input to a computing device, and a slide input indicative of a desired language for automatic speech recognition of a subsequent speech input; Receiving a speech input from a user at a computing device; Obtaining one or more recognized characters from an automatic speech recognition result of a speech input using a desired language at a computing device; And outputting one or more recognized characters in the computing device. The personal assistant module is implemented as a main server / big data DB.

A personal secretary module, and a main server / big data DB. The technique may include receiving a touch input from a user at a computing device that includes one or more processors, the touch input including a spot input indicative of a request to provide a voice input to the computing device and a slide input indicative of a desired language for automatic speech recognition of a subsequent speech input. The technique may include receiving, at a computing device, a speech input from a user. The technique may include obtaining at the computing device one or more recognized characters from an automatic speech recognition result of a speech input using a desired language. The technique may also include outputting one or more recognized characters at a computing device. In some embodiments, the techniques may include determining a direction of a slide input from a spot input at a computing device, and determining a direction of a slide input based on the desired In other embodiments, each of the one or more languages is associated with a predetermined range of directions, and the step of determining the desired language comprises determining the direction of the slide input from the spot input And selecting one of the one or more languages having a predetermined range of related directions, In some embodiments, the desired language is determined after the slide input is away from the spot input by a predetermined distance. In other embodiments, the technique includes determining the predetermined orientations at a computing device by receiving a first input from a user indicating a particular direction for each of one or more languages for a user's selection at a computing device Receiving a second input from a user representing one or more languages for a user's selection at a computing device and receiving at least one of a plurality of languages for a user's selection based on a user's past computing activity at a computing device Further comprising automatically determining. In some embodiments, the method further comprises outputting a user interface in response to receiving a spot input at a computing device, wherein the user interface provides one or more languages for user selection. In other embodiments, the user interface is output after a predetermined delay period after receiving the spot input, wherein the predetermined delay period allows the user to provide a slide input in one of the predetermined directions . In some embodiments, a slide input received from a user is provided with respect to a user interface, which is a pop-up window containing one or more languages. In other embodiments, the technique further comprises outputting a user interface in response to receiving a spot input at a computing device, wherein the user interface provides one or more languages for user selection. In some embodiments, the method further comprises receiving from an user an input indicative of one or more languages to be provided by a user interface at a computing device, wherein the slide input received from the user is provided Wherein the user interface is output in response to receiving a spot input, the user interface being a pop-up window comprising one or more languages. Computing devices are also presented. The computing device may include a touch display, a microphone, and one or more processors. The touch display may be configured to receive a touch input from a user, the touch input comprising a spot input indicative of a request to provide a speech input to a computing device, and a language desired for automatic speech recognition of a subsequent speech input Lt; / RTI &gt; The microphone may be configured to receive a remote assistant related information voice input from a user. The one or more processors may be configured to obtain one or more recognized characters from an automatic speech recognition result of a speech input using a desired language. The touch display may also be configured to output one or more recognized characters. In some embodiments, the one or more processors are further configured to determine the orientation of the slide input from the spot input and to determine the desired language based on the orientation and predetermined orientations associated with the one or more languages for user selection do. In other embodiments, each of the one or more languages is associated with a predetermined range of orientations, and the one or more processors are configured to display one of the one or more languages having a predetermined range of related directions, In some embodiments, the desired language is determined after the slide input is further than a predetermined distance from the spot input. In other embodiments, the touch display determines predetermined directions by receiving a first input from a user indicating a particular direction for each of one or more languages for a user's selection, And to automatically determine one or more languages for the user's selection based on the user's past computing activity. In some embodiments, the touch display is further configured to output a user interface in response to receiving the spot input, wherein the user interface provides one or more languages for user selection. In other embodiments, the user interface is output after a predetermined delay period after receiving the spot input, and the predetermined delay period is configured such that the user can provide the slide input in one of the predetermined directions . In some embodiments, a slide input received from a user is provided with respect to a user interface, the user interface being a pop-up window containing one or more languages.

Activate rental in database aggregate related to personal secretary module data

The present invention provides a number of advantages over traditional database aggregation hardware and software designed to manage physical media collections and ebook rental systems for information about personal assistant modules associated with current remote secretaries or questions having it to provide. For example, the present invention allows users or customers interested in visiting a database aggregate to be asked to initially activate the content prior to accessing a question with personal assistant module related information, Or the convenience of electronic books that can be accessed anywhere from the customer's device. The present invention also increases database aggregate visits, which can provide an important metric for database aggregates to receive funds. The present invention provides a method for promoting other types of content to be encountered while customers are physically present in a database aggregation, where initially lending electronic content to a question having information related to a personal assistant module. The present invention helps to ensure that customers lending electronic materials are members of the community by requiring a database aggregation visit for content activation. The present invention additionally allows customers to participate in database aggregation activities by engaging in database aggregation events, by borrowing database aggregate data, by donating to a database aggregate, and by granting access to premium or &quot; thereby increasing library engagement. In one embodiment, the present invention includes an e-book borrowing system for requiring at-library book activation in a database aggregate. The rental system includes a central system for managing and hosting e-books, the central system including a storage device, and a processor for controlling the user interface, wherein the user interface allows a user to interact with the central system. The lending system additionally includes an access device for activating e-books in the database aggregate. A user may reserve an e-book via a user interface accessed by a remote user device or a database aggregate device. In such an embodiment, the contents of the e-book can not be accessed by the user until the e-book is activated, where the user can activate the e-book by providing the user identification information to the access device, In another embodiment, the present invention provides a central system for managing and hosting eBooks, including a processor for controlling storage devices, 8 - and user interfaces. And a user interface allowing the user to interact with the central system. The system includes an e-book rental system for requesting book downloads in a database aggregate. The rental system additionally includes a download device for accepting e-book downloads in the database collection, wherein the user can reserve the e-book via the user interface accessed by the remote user device or the database aggregation device . In such an embodiment, the e-book can not be downloaded by the user until the e-book is activated, and the user can activate the e-book by providing the user identification information to the download device, In another embodiment, the present invention includes an e-book rental system for requesting book activation in a database aggregate. The rental system includes a central system for managing and hosting e-books, the central system including a storage device, and a processor for controlling the user interface, wherein the user interface allows the user to interact with the central system. A user may reserve an e-book via a user interface accessed by a remote user device or a database aggregate device. In such an embodiment, the content of the e-book is not accessible by the user until the e-book is activated, and the central system activates the e-book when receiving confirmation of the user's presence in the database collection. In another embodiment, the invention includes an e-book rental system for encouraging users to visit a database aggregation. The e-book rental system is a central system for managing and hosting e-books, And a processor for controlling the user interface, wherein the user interface allows a user to interact with the central system. The rental system additionally includes an incentive device in the database collection for identifying the user and tracking user actions. In such an embodiment, when the user performs a credible action and provides identification information to the incentive device, the central system associates the activation credits with the user's database aggregate account, User access is associated with the activation credits of the user.

Integration of automatic control device systems related to personal secretary module data

Mobile computing devices, such as smartphones and / or tablets, that process remote secretarist data are influenced as a platform for supporting and controlling automatic control device systems. The rapid growth of such devices between consumers has made the assumption that a sufficient number of such devices are available for use by consumers in connection with the automatic control system, making them feasible and realistic.

Also, such devices typically have rich user interfaces, notable personal assistant modules, main server / big data DB capabilities, and built-in wireless connections, thus allowing devices to be automatically controlled as described herein Making them ideal for use as an automatic control device control system for device systems. In various embodiments as described herein, under the control of a user or users, the physical configurations, or agents, of individual components of the system in physical space are replicated in representation in virtual space. Some real-time equivalence can be maintained between physical and virtual spaces to implement a virtual environment that reflects the physical environment. In this way, the present invention supports a system in which secretary events occurring in one environment can affect the outcome of the progress of secretary events occurring in another environment and cause the results. By doing so, the elements of virtual space can be precisely interdependent and unified with respect to the peers that relate to the elements of physical space. The integration of virtual and physical was the so-called tenants of the augmented reality; Up to now, augmented reality applications have produced many examples of single-directional action (one that affects virtually, or vice versa), but these have not come close to configuring an automatic control device bi-directional system. In at least one embodiment of the present invention, an exactly symbiotic system is implemented in which the virtual environment affects the physical environment in a coherent manner, and vice versa. In at least one embodiment, Lt; RTI ID = 0.0 &gt; of the &lt; / RTI &gt; Games and entertainment are an interesting use of the present invention for its inclusion of interaction among multiple users. In at least one embodiment, the system of the present invention provides an environment in which users may control one or more agents of the system, while one or more other agents may be controlled by artificial intelligence.

System control related to personal secretary module data

A first aspect of remote secretary data control provides a method of controlling system critical changes implementable by a user of an operating system, the method comprising: receiving a request to make a system critical change from a user; Evaluating whether or not the user has appropriate rights to make a significant change; and, if the user has the appropriate rights, notifying the at least one other user with the right to make a system critical change, , And waiting for approval from at least one other user before implementing the requested system critical change. Because physical access to server rooms is typically severely limited, computing systems hosted by coexisting servers in a data center, for example, are generally well protected. Remote access to the operating system and applications running on that operating system is also typically controlled, for example, by a secure shell or a remote desktop session. There is a way to prevent end users who are human or software services, with the ability to make changes that potentially interfere with the computing system. 4 - Typically, there are special users with unlimited capabilities to change the system virtually. The user is typically referred to as a "super user" in many operating systems. In Unix and Unix-like systems, the superuser is operable to change the permissions of each user. The user "root" has unrestricted access to files and commands.

Thus, any malicious user or malware that gains superuser access may be operable to perform any action within the system, such as deleting critical data, a virtual machine shutdown, or an overall system shutdown. It will be appreciated that the actual superuser may be able to perform such actions unintentionally or unintentionally, but also to perform the same set of actions including the previously proposed dangerous actions. Such a scenario may also occur in other operating systems, such as Microsoft Windows. The operating system typically functions according to the "least privilege" principle, where each user (other than the super user) It is possible to configure user accounts to manage only some available services. For example, the right to be able to change and restart the configuration of the web server is assigned to the user, but sufficient authority can not be given or assigned to shut down the other service or the entire service to the user. A user may inadvertently make a mistake when configuring a service or misjudge a service for personal purposes. An access-control model of a typical operating system may be used by a user to control the access control system So that the response returned from the access control system is returned in the form of a binary response. The user is neither authorized nor permitted to manage the service. Administrative actions performed by authorized users are granted without requiring their actions to be checked. One aspect and embodiment described herein recognize that there may be advantages associated with a change to a typical operating system access control model such that before a change is applied by the system, It is an advantage that an action performed by an authorized user, for example, an important action, may require approval by one or more other users having the appropriate authority. Such a configuration may be that a misconfiguration of the server due to a mistake by the system administrator violates the security level agreement with the customer

In a typical modern operating system, an access control list (ACL) is used to authorize the user to perform the requested operation. For example, a user who has been provided with the ability to read and / or write and / or execute a particular file will typically be defined in the ACL associated with that particular file. The file system can support Portable Operating System Interface (POSIX) ACLs, depending on how many access rules for each individual user and group can be specified for each file in the system. In a known ACL implementation, The superuser has unlimited permissions on the entire system so that it can take any action, for example, to add, edit, or delete any file, or to start, stop, or restart any application running on the system. Often, the superuser is trained and skilled, and the superuser is typically also referred to as the system administrator. Such a system manager is typically responsible for supporting and maintaining the personal secretary module, the main server / big data DB system. System administrators typically have training and experience to support failures and low data loss maintenance. However, human errors may still occur or malicious users or software may still operate to cause disruption to the system. To overcome human error, the system or application may issue a " critical " It can be operated to check automatically. The system or application may be operable to deliver a warning message suitable for the superuser. The final decision on an important command can be made by a super user who can intentionally or unintentionally ignore any such warning message and the critical command can be committed. For example, it will be appreciated that the activity of malicious users or malicious software that obtained superuser access to the system by an elevation technology is not controllable. Some recertification measures can be applied, but this often happens too late. A workflow-based interaction model is sometimes available in individual applications or services where configuration changes must be approved by other users before being committed. For example, various content-management systems that support web page publishing on the Internet have such a capability that is often available in the form of a web-based editing system, whereby the user can prepare for some changes to the web site, It is not certain until some other user approves the change. However, as suggested by the embodiments and aspects described herein, no workflow is typically available at the innermost functional level of the operating system. The first aspect refers to an operating system and / Or multi-authentication or multi-authorization management of the services provided by such operating systems.

Thus, one aspect can provide a means to prevent potentially disruptive changes on a real or virtual computing system. One aspect and embodiment extends the operating system to provide an access-control model that executes such that more than one administrator is required to agree on a " critical "action regarding personal secretary module processing before the change is committed. Critical actions may be configured according to an implementation, but generally involve making changes that potentially interfere with the configuration of one or more services provided by the operating system or its operating system. According to one embodiment, One other user has system administrator privileges. Administrator privileges are substantially synonymous with superuser privileges. In an embodiment, the user and at least one other user have the same authority. Thus, peer approval may occur. According to one embodiment, both the user and at least one other user have system administrator rights. Accordingly, a multi-acknowledged peer acknowledgment may be required to commit system critical changes. If the proposed or requested change is particularly important, a majority of peer users may be required to approve the change. According to one embodiment, acknowledgment and implementation occur asynchronously with the receipt of the request. Thus, in some embodiments, the requested action or change may be deferred for later approval by at least one other user, and the user may double-check the proposed system-level change before the authorization is implemented. Thus, the synchronous operation of both the requesting user and at least one other user is not required to authenticate or acknowledge the requested change. According to some embodiments, an acknowledgment process should occur for each significant change requested, and a cross review will occur whenever a system critical change is requested by the user. Thus, a single user can not implement a system critical change, regardless of whether the user has been cross-reviewed with respect to previously requested system critical changes. The embodiment may provide an asynchronous mode of operation whereby the user may perform or request a management action or a system critical action and the application of that action until another user with the appropriate authority can review and approve such action Is delayed. Each user can log in individually using their own certificate to perform system critical changes and / or to approve and apply the changes requested by other users waiting for approval. According to one embodiment, reception, evaluation, and notification are implemented in kernel space. Embodiments and embodiments may be implemented in kernel space, for example, as an extension of an access control list or in an user space, for example, an implementation with unchanging private secretary module virtual information that runs constantly. According to one embodiment, reception, evaluation, and notification are implemented in user space. According to one embodiment, the receiving, evaluating and notifying are implemented by the personal secretary module virtual information driven by the operating system, and the private secretary module virtual information has the appropriate authority.

In one embodiment, the private secretary module virtual information has superuser rights. According to one embodiment, the private secretary module virtual information is unchangeable by any single user of the operating system. For example, a change in the personal secretary module virtual information itself that upgrades, fixes, adds or removes system critical actions for a predetermined system critical change set may include system critical changes and may change operational parameters of the personal secretary module virtual information A multi-user authorization system may be required.

According to one embodiment, a system critical change includes critical operating system level operations. According to one embodiment, the method comprises configuring which changes implementable by the operating system are considered system critical changes. Examples of critical operations or processes that may be subject to a multi-authorization process by the operating system include, for example, rebooting or shutting down a virtual or physical machine, modifying file or process permissions, applying changes to security settings (e.g., firewall policy) , Applying changes to network settings, and accessing other important data belonging to other users and other similar actions. Certain aspects and embodiments may be implemented within an operating system that protects critical operating system level operations, such as reconfiguring network adapters, networking services and routing tables, creating or deleting users, modifying user rights, performing shutdown or reboot operations, Consider multi-approval workflow. According to one embodiment, the method includes assigning a security level to each system critical change that can be implemented by the operating system, and associating notification and authorization parameters with the system critical change based on the assigned security level. Thus, a change determined by a higher security level may require more than one other user to approve before the change is committed. If the change has a high security level, the selected notification method may include a more direct form of notification, such as the start of a text message, rather than a notification to another user or users at the next login. The notification and authorization parameters may be configured to tailor various types of critical level system changes. According to one embodiment, the step of notifying at least one other user comprises: initiating a procedure for delivering email to at least one other user; , Initiating a procedure for delivering an SMS message to at least one other user, initiating a procedure for delivering an instant message to at least one other user, initiating a procedure for making a telephone contact with at least one other user, And a procedure for displaying a pop-up message to another user of the terminal. Thus, the notification can occur in one or more of a variety of ways. The kernel itself is not operable to deliver email, but when implemented in kernel space, the embodiment may be configured to allow the kernel to operate to hand over pending change requests that require acknowledgment of the appropriate user space private secretary module virtual information And the personal secretary module virtual information itself is operable to notify the appropriate user of the change request.

The second aspect provides a personal secretary module, a main server / big data DB program product operable to perform the method of the first aspect when executed on a personal secretary module, main server / big data DB.

The third aspect provides an operating system operative to control system critical changes that may be implemented by a user, the operating system further comprising: request receiving logic operable to receive a request to make a system critical change from a user; A privilege evaluation logic operable to assess whether the user has the appropriate rights to make the change; and if the user is judged to have the right to make a system critical change, A notification logic that is operable to notify other users of the request for the received request and an implementation logic operable to wait for acknowledgment from at least one other user prior to implementing the requested system critical change.

A personal assistant module related to the personal secretary module data, a computer-implemented method implemented in the main server / big data DB,

A personal secretary module, a main server / big data DB, wherein the at least one personal secretary module comprises instructions executable by a processor, by a search system, and a main server / big data DB readable storage medium. Wherein the processor configures the processor. A system for providing networked applications in a client-server environment, the system comprising: a set of application functions on a server, the application functions including a type definition; and a set of client functions defining a script environment, And a type matching each of the application functions in the set. The touch I / O device is described in the following U.S. patents: 6,323,846 (Westerman et al), 6,570,557 (Westerman et al.), And / or 6,677,932, and / or US Patent Application Publication No. 2002/0015024A1 Multi-touch sensing surface, each of which is incorporated herein by reference. A logic flow diagram may represent an operation performed by one or more embodiments described herein. The logic flow diagram may receive a provisioning request by a provisioning server in a block. The logic flow diagram may receive the device configuration information of the packet telephony device at the block. The logic flow diagram may determine to provide software updates of the packet telephony device based on the device configuration information at the block. The previous description has been presented to enable those skilled in the art to practice the various aspects described herein. The foregoing description provides various examples of the present invention, and the present invention is not limited to these examples. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects. Expressions such as "side" are intended to indicate that such aspects are essential to the invention, But it does not mean that the present invention is applied to all the settings of The term " when used &quot;, as used herein, can be interpreted to mean "when" or "at the same time" or "in response to a determination"

A method of controlling a system critical change that can be implemented by a user of an operating system, the method comprising: receiving a request for making a system critical change from a user; The method comprising: evaluating whether the user has appropriate rights; notifying the received request to at least one other user having appropriate rights to make the system critical change if the user has appropriate rights; Waiting for approval from at least one other user before implementing the system critical change.

Those skilled in the art will readily recognize that the various method steps described above can be performed by a personal assistant module, main server / big data DB, programmed. Herein, some embodiments also include a machine or personal secretary module, a main server / big data DB readable program storage device, e.g., a digital data storage medium, and may include a machine executable or personal secretary module of the instruction, It is intended to encode a data DB executable program. The program storage device may be, for example, a digital personal assistant module mapping storage device, a magnetic storage medium such as a magnetic disk and magnetic tape, a hard drive, or an optionally readable digital data storage medium. The embodiment is also intended to cover a personal secretary module, the main server / big data DB, programmed to carry out the steps of the above-described method. [0034] The various elements, including any functional blocks labeled as " The functionality may be provided through use of dedicated hardware as well as hardware capable of executing the software in connection with the appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor by a single shared processor, or by a plurality of individual processors, some of which may be shared. Also, the explicit use of the term "processor" or " controller "or" logic "should not be construed to refer exclusively to hardware capable of executing software, , ROM for storing software, RAM, and non-volatile storage devices. Other conventional and / or customized hardware may also be included. Similarly, any switch is just a concept. These functions can be performed through the operation of the program logic, through the dedicated logic, the interaction of the program control with the dedicated logic, or even manually, and the particular technique is selectable as being more specifically understood by the implementer from the context Do. Skilled artisans appreciate that any block diagram herein depicts a conceptual view of an exemplary circuit that implements the principles of the invention. Similarly, any flow chart, flow diagram, state transformation diagram, pseudo code, etc. may be substantially represented by the personal secretary module, the main server / big data DB readable medium and the personal secretary module, main server / Whether or not marked as such, represent various processes that may be performed by such a personal assistant module, main server / big data DB, or processor.

Each description merely illustrates the principles of the invention. Therefore, those skilled in the art will appreciate that, although not explicitly described or illustrated herein, it is contemplated that various aspects may be invented that implement the principles of the invention and fall within the spirit and scope of the invention. Furthermore, all examples mentioned herein are expressly intended to be solely for secretarial purposes, to aid the reader in understanding the concepts invented by the inventors, in addition to the principles and techniques of the present invention, and such specially mentioned examples and conditions And should be construed as not being limited. Furthermore, all statements herein reciting principles, aspects and embodiments of the invention, as well as the specific examples, are intended to include equivalents.

In a typical modern operating system, an access control list (ACL) is used to authorize the user to perform the requested operation. For example, a user who has been provided with the ability to read and / or write and / or execute a particular file will typically be defined in the ACL associated with that particular file. The file system can support Portable Operating System Interface (POSIX) ACLs, depending on how many access rules for each individual user and group can be specified for each file in the system. In a known ACL implementation, The superuser has unlimited permissions on the entire system so that it can take any action, for example, to add, edit, or delete any file, or to start, stop, or restart any application running on the system. Often, the superuser is trained and skilled, and the superuser is typically also referred to as the system administrator. Such a system manager is typically responsible for supporting and maintaining the personal secretary module, the main server / big data DB system. System administrators typically have training and experience to support failures and low data loss maintenance. However, human errors may still occur or malicious users or software may still operate to cause disruption to the system. To overcome human error, the system or application may issue a " critical " It can be operated to check automatically. The system or application may be operable to deliver a warning message suitable for the superuser.

The final decision on the critical command for the remote secretary may be made by the super user who may intentionally or unintentionally ignore any such warning message and the critical command may be committed. For example, it will be appreciated that the activity of malicious users or malicious software that obtained superuser access to the system by an elevation technology is not controllable. Some recertification measures can be applied, but this often happens too late. The workflow-based interaction model is sometimes available in individual applications or services where configuration changes must be approved by other users before they are committed. For example, various content-management systems that support web page publishing on the Internet have such a capability that is often available in the form of a web-based editing system, whereby the user can prepare for some changes to the web site, It is not clear when some other user approves the change. However, as suggested by the embodiments and aspects described herein, no workflow is typically available at the innermost functional level of the operating system. The first aspect refers to an operating system and / Or multi-authentication or multi-authorization management of the services provided by such operating systems. Thus, one aspect can provide a means to prevent potentially disruptive changes on a real or virtual computing system. One aspect and embodiment extends the operating system to provide an access-control model that executes such that more than one administrator is required to agree on a "critical" action before the change is committed. Critical actions can be configured according to an implementation, but generally involve making changes that potentially interfere with the configuration of one or more services provided by the operating system or its operating system. According to one embodiment, the user and at least one other user have system administrator rights. Administrator privileges are substantially synonymous with superuser privileges. In an embodiment, the user and at least one other user have the same authority. Thus, peer approval may occur. According to one embodiment, both the user and at least one other user have system administrator rights. Accordingly, a multi-acknowledged peer acknowledgment may be required to commit system critical changes. If the proposed or requested change is particularly important, a majority of peer users may be required to approve the change. According to one embodiment, acknowledgment and implementation occur asynchronously with the receipt of the request. Thus, in some embodiments, the requested action or change may be deferred for later approval by at least one other user, and the user may double-check the proposed system-level change before the authorization is implemented. Thus, the synchronous operation of both the requesting user and at least one other user is not required to authenticate or acknowledge the requested change. According to some embodiments, an acknowledgment process should occur for each significant change requested, and a cross review will occur whenever a system critical change is requested by the user. Thus, a single user can not implement a system critical change, regardless of whether the user has been cross-reviewed with respect to previously requested system critical changes. The embodiment may provide an asynchronous mode of operation whereby the user may perform or request a management action or a system critical action and the application of that action until another user with the appropriate authority can review and approve such action Is delayed. Each user can individually log in using their own certificates to perform system critical changes and / or to approve and apply the changes requested by other users waiting for approval. According to one embodiment, And notifications are implemented in the kernel space. Embodiments and embodiments may be implemented in kernel space, for example, as an extension of an access control list or in an user space, for example, an implementation with unchanging private secretary module virtual information that runs constantly. According to one embodiment, reception, evaluation, and notification are implemented in user space. According to one embodiment, the receiving, evaluating and notifying are implemented by the personal secretary module virtual information driven by the operating system, and the personal secretary module virtual information has the appropriate authority. In one embodiment, the private secretary module virtual information has superuser rights. According to one embodiment, the private secretary module virtual information is unchangeable by any single user of the operating system. For example, a change in the personal secretary module virtual information itself that upgrades, fixes, adds or removes system critical actions for a predetermined system critical change set may include system critical changes and may change operational parameters of the personal secretary module virtual information A multi-user authorization system may be required. According to one embodiment, system critical changes include critical operating system level operations. According to one embodiment, the method includes configuring what changes that can be implemented by the operating system are considered system critical changes. Examples of critical operations or processes that may be subject to a multi-authorization process by the operating system include, for example, rebooting or shutting down a virtual or physical machine, modifying file or process permissions, applying changes to security settings (e.g., firewall policy) , Applying changes to network settings, and accessing other important data belonging to other users and other similar actions. Certain aspects and embodiments may be implemented within an operating system that protects critical operating system level operations, such as reconfiguring network adapters, networking services and routing tables, creating or deleting users, modifying user rights, performing shutdown or reboot operations, Consider multi-approval workflow. According to one embodiment, the method includes assigning a security level to each system critical change that can be implemented by the operating system, and associating notification and authorization parameters with the system critical change based on the assigned security level. Thus, a change determined by a higher security level may require more than one other user to approve before the change is committed. If the change has a high security level, the selected notification method may include a more direct form of notification, such as the start of a text message, rather than a notification to another user or users at the next login. According to one embodiment, the step of notifying at least one other user comprises initiating a procedure for delivering an e-mail to at least one other user, Initiating a procedure for delivering an SMS message to at least one other user, initiating a procedure for delivering an instant message to at least one other user, initiating a procedure for making a telephone contact with at least one other user, And a procedure for displaying a pop-up message to another user. Thus, the notification can occur in one or more of a variety of ways. The kernel itself is not operable to deliver email, but when implemented in kernel space, the embodiment may be configured to allow the kernel to operate to hand over pending change requests that require acknowledgment of the appropriate user space private secretary module virtual information And the personal secretary module virtual information itself is operable to notify the appropriate user of the change request. The second aspect, when executed on the personal secretary module, the main server / big data DB, The third aspect provides an operating system operative to control system critical changes that can be implemented by a user, wherein the operating system is operable to provide a user with a system Request receiving logic operable to receive a request to make a critical change; A privilege evaluation logic operable to assess whether a user has appropriate rights to make system critical changes; and a privilege evaluation logic that is operable to determine whether the user is entitled to make system critical changes The notification logic being operable to notify a request received to at least one other user having at least one other user having the requested system change, and an implementation logic operable to wait for acknowledgment from the at least one other user prior to implementing the requested system critical change. According to one embodiment, according to one embodiment, both the user and at least one other user have system administrator privileges. According to one embodiment, the implementation logic &lt; RTI ID = 0.0 &gt; At least one &lt; / RTI &gt; &lt; RTI ID = 0.0 &gt; The receive, evaluate, and notify logic operate in kernel space. According to one embodiment, the receive, evaluate, and notify logic operate in user space According to one embodiment, the receiving, evaluating and notifying logic operates as the personal secretary module virtual information driven by the operating system, and the personal secretary module virtual information has the appropriate authority. According to one embodiment, the critical change includes critical operating system level operations. According to one embodiment, any change that can be implemented by the operating system is provided to the system &lt; RTI ID = 0.0 &gt; And configuration logic that is operable to configure what is considered to be a significant change. According to one embodiment, Assigns a security level to each system critical change that can be implemented by the security level and associates notification and authorization parameters with the system critical change based on the assigned security level. Initiating a procedure for delivering an SMS message to at least one other user, initiating a procedure for delivering an instant message to at least one other user, And notifying at least one other user by at least one of initiation of a procedure for contacting a user by telephone and initiating a procedure for displaying a pop-up message to at least one other user. Other specific and preferred aspects are described in the appended independent claims And dependent claims. The features of the independent claims may be combined with other features of the dependent claims as appropriate, or in other combinations not explicitly set forth in the claims. Device Features Where an apparatus is described as being operable to provide additional functionality, The device features that are configured to provide the device capabilities.

Multiple sensors

The plurality of sensors receiving the personal secretary module obtains the biometric information through at least one sensor of a body temperature sensor, a blood pressure sensor, an ECG sensor, and an oxygen saturation sensor, and detects at least one of a GPS sensor, an acceleration sensor, Further comprising: a microphone for acquiring the environment information through a sensor of the sensor, a microphone for acquiring voice information of the user, and a speaker for outputting an acoustic signal, wherein the information of each of the plurality of sensors is transmitted through a wireless body area network The collected information is transmitted to the collecting apparatus, and the collected information is transmitted to the control server through a network in a multi-hop environment. To support emergency medical scenarios for medical applications.

Classifies the user state into facial expressions such as laughter, sadness, surprise, disappointment, and automatically checks the user state change according to the classified user facial expressions.

Sensor input related to personal secretary module data

The sensor input may be a charge coupled device, a black silicon sensor, an IR sensor, an acoustic sensor, an induction sensor, a motion sensor, an optical sensor, an opacity sensor, a proximity sensor, an inductive sensor, , Passive infrared proximity sensor, radar, capacitive displacement sensor, Hall effect sensor, magnetic sensor, GPS sensor, thermal imaging sensor, thermocouple, thermistor, photoelectric sensor, ultrasonic sensor, infrared laser sensor, Motion sensors, MEMS internal motion sensors, ultrasonic 3D motion sensors, accelerometers, inclinometers, force sensors, piezoelectric sensors, rotary encoders, linearencoders, chemical sensors, ozone sensors, smoke sensors, A sensor, a magnetometer, a carbon dioxide detector, a carbon monoxide detector, an oxygen sensor, a glucose sensor, a smoke detector, a metal detector, a rain sensor, an altimeter, an activity sensor ) Is derived from at least one of an object detector, a marker detector, a laser range finder, a sonar, a capacitive sensor, a heart rate sensor, and an RF / MIR (micropower impulse radio) sensor .

 In the present specification, the semantic personal assistant module refers to a corresponding expression expressed by a graphic, a picture, an icon, an emoticon, or a photogram having a meaning of a word, phrase, or sentence in a specific language.

Video monitoring related to personal secretary module data

The input image through the network camera is extracted by the input image edge extraction function, the edge direction grouping function and the interest area fence automatic function for setting the intelligent ROI (Region of Interest), which is a new object extraction algorithm, through the Sobel Operator By combining the setting function and Min-Max background modeling and GMM, the background separation algorithm function, movement area extraction function, movement area noise control function, moving object extraction function and Histogram of Oriented Gradient (HOG) Even if a lot of movements occur due to small objects or lighting changes in a special internal environment, accurate and intelligent analysis can be done.

3D augmented reality (AR) content display and interaction with eyepiece

A 3D augmented reality (AR) content display showing information about the remote secretary, and an internal software application running on an integrated multimedia computing facility configured to interact with the eyepiece. 3D AR software applications can be developed with mobile applications and can be provided as stand-alone applications aimed at the eyepiece through an application store or specifically as an end-use platform and through a dedicated 3D AR eyepiece store. The internal software application may be accessed via equipment inside and outside the eyepiece (such as those initiated from sensing devices, user motion capture devices, internal processing equipment, internal multimedia processing equipment, other internal applications, cameras, sensors, Via the transceiver, through the tactile interface, with the input and output facilities provided by the eyepiece, from external computing facilities, external applications, secretary events and / or data feeds, external devices, third parties, Commands and control modes that operate in relation to the eyepiece will be initiated by sensing inputs through the input device, user actions, external device interaction, reception of secretary events and / or data feeds, execution of internal applications, execution of external applications, . In embodiments, at least secretary events and / or data feeds, sensing inputs and / or sensing devices, user motion capture inputs and / or outputs, user motions and / or actions to control and / or initiate commands, An application on the platform on which the command can be used to respond to the input, a communication and / or connection from the on-platform interface to the external system and / or device, an external device, an external application, , Feedback to the user (such as an external device, an external application, etc.), or any combination of the other, as well as a set of steps that are included in the execution control provided through the internal software application.

Integrated secretary module data for integrated video light source content

An integrated image light source for introducing the content into the optical assembly, the processor configured to modify the content, the modification being made in response to the sensor input. The content may be a video image. These modifications include adjusting the brightness, adjusting the color saturation, adjusting the color balance, adjusting the color hue, adjusting the video resolution, transparency Adjusting the compression ratio, adjusting the frame rate per second, isolating a portion of the video, stopping playback of the video, pausing the video, or restarting the video It can be one.

Type of sensor that acquires data related to personal secretary module

The sensor input may be a charge-coupled device, a black silicon sensor, an IR sensor, an acoustic sensor, an induction sensor, a motion sensor, an optical sensor, an opacity sensor, a capacitive sensor, a capacitive displacement sensor, a Hall effect sensor, a magnetic sensor, a GPS sensor, a thermal image sensor, a thermocouple, a thermistor, a photoelectric sensor, Ultrasonic 3D motion sensor, accelerometer, inclinometer, force sensor, piezoelectric sensor, rotary encoder, linear encoder, chemical sensor, ozone sensor, smoke sensor, heat sensor, ultrasonic sensor, infrared laser sensor, inertial motion sensor, MEMS internal motion sensor, A magnetometer, a carbon dioxide detector, a carbon monoxide detector, an oxygen sensor, a glucose sensor, a smoke detector, a metal detector, a rain sensor, an altimeter, (E.g., a geographical position indicator for unidirectional transmission), a laser rangefinder, a sonar, a capacitance, an optical response, a heart rate sensor, or an RF / MIR micropowerimpulse radio sensors. The playback of the content may be interrupted in response to an indication from the accelerometer input that the user's head is moving. Audio sensor input can be generated by at least one participant in the videoconference talking. The visual sensor input may be a video image of at least one participant of the videoconference or a video image of a visual presentation. This modification may be at least one of making the video image more transparent or less transparent in response to an indication from the sensor that the user is moving.

Collective identification of electronic devices related to personal secretary module data

Provides a holistic identification process that can facilitate reliable interworking between accessories and host devices (including portable devices) when the accessory includes multiple components and / or multiple communication interfaces. This process can be performed as part of initiating communication when the accessory is connected to the host via the first communication channel via the first interface. The accessory may then provide identification information, including information about all communication interfaces (e.g., USB, Wi-Fi, Bluetooth, UART, and any other interfaces) that can be used to communicate with the host. The accessory can then establish a second (or third, other) connection to the host via what is in its interfaces, and the host can recognize that the second connection is for the same accessory. Based on this, the host can use the initial identification information when communicating with the accessory via the second connection. When an accessory establishes multiple connections to a host, the host can choose the optimal routing for a particular communication.

The host can continue to communicate with the accessory. The routing and rerouting of communication to the various interfaces may be transparent to the user. In some embodiments, the identification information provided by the accessory may also be used by the various components that are available for use by the accessory to interact with the host device Lt; / RTI &gt; For example, the accessory may provide information about its display device, speakers, and / or user manipulatable input devices (e.g., keyboard, keypad, buttons, dials, touchscreens, trackpads, etc.) can do. The accessory may also define a "bundle" or group of components based on a common purpose or common physical location. The host device may be configured to communicate with the accessory by, for example, routing specific information to specific accessory components, or by responding differently to input signals from the accessory depending on which component was the source of the input signal Achieving complete identification of all available communication interfaces and / or components from an accessory at the beginning of the interaction may be accomplished by the host device in a coordinated manner with the accessory Specific aspects of the invention relate to methods for identifying an accessory device to a host device. The accessory may establish a communication channel with the host device using the first communication interface and transmit the identification information to the host via the communication channel. The identification information may include an interface descriptor of at least one other communication interface that the accessory can use to communicate with the host. The identification information may also include other information such as, for example, a component descriptor of each of the plurality of components of the accessory, including an audio output component, a video output component, and / or a user input component. In some cases, the component descriptor may include a purpose indicator that identifies the particular function that should be associated with the component. The identification information may also include a bundled descriptor that associates some (or all) of the components with the bundle, for example, based on having a common location and / or a common associated function or purpose. Certain aspects of the invention relate to a host device that communicates with an accessory. The host device may detect a connection to the accessory via the first communication channel using the first communication interface. Through this channel, the host can receive the identification information from the accessory. The identification information may include an interface descriptor that provides information about the second communication interface that the accessory may also use to communicate with the host, as well as other interface descriptors that provide information about the first communication interface. When the host receives the identification information, the host can communicate with the accessory using the first communication interface and the second communication interface. For example, the host device may determine that particular data should be transmitted to the accessory, and may select one of the first communication interface and the second communication interface and transmit data therefrom. As another example, the host device may receive an input signal from an accessory via one of the communication interfaces. Certain aspects of the invention relate to a host device that communicates with one or more accessory devices. The host device may communicate with one or more accessory devices. The host may detect a connection to the first accessory via the first communication channel using the first communication interface. Through the channel, the host can receive identification information from the first accessory. This information may include descriptors of a number of communication interfaces that the first accessory may use to communicate with the host. While the first accessory remains connected, the host device can detect the connection request via the second communication interface and can determine if a connection request has been issued by the first accessory. When a connection request is issued by the first accessory, the host can communicate with the first accessory using both the first communication interface and the second communication interface. Otherwise, the host may use the second communication interface to communicate with the second accessory that may provide its own identification information. In certain cases, there may be a limit on the number of accessories that can be connected to the host at any given time. Certain aspects of the present invention may include, for example, audio components, video components, and / Lt; RTI ID = 0.0 &gt; components. &Lt; / RTI &gt; The accessory device may also have a plurality of communication interfaces operable to communicate with the host device. The identification logic within the accessory device may provide identification information to the host device via one of the communication interfaces. The identification information may include a descriptor of each of the components and a descriptor of each of the communication interfaces. The descriptors may provide information (e.g., applicable signal formats, sizes, intended uses, etc.) about the configuration and / or capabilities of particular components. And may include a bundle descriptor that defines the bundle thereby; The bundle descriptor may also associate at least one of the communication interfaces of the accessory with the bundle. Certain aspects of the present invention include a plurality of communication interfaces &lt; RTI ID = 0.0 &gt;Lt; / RTI &gt; The control and routing logic may be coupled between the execution logic and the communication interfaces and the control and routing logic may be configured to selectively route information from the execution logic to one or the other of the host communication interfaces. The identification logic within the host device may be configured to receive an identification message including identification information from the accessory device via one of the host communication interfaces. This information may include descriptors of the components and / or communication interfaces of the accessory. A selected path to specific information from one of the execution logic to one of the host communication interfaces may be determined based in part on the identification information and actions to be taken by the host device in response to the input signals received from the accessory, May be determined based in part on which of the input signals is transmitted.

If the proposed identification of personal secretary module data is rejected

Capture students' actions (personal secretary module data, behaviors, etc.) performed in response to questions / assignments related to the personal assistant module and store them in pre-defined answers / responses.

If the proposed identification is rejected, the accessory information added to the private secretary module to be retried does not need to resend all of its parameters (unless the accessory has canceled or disconnected the process). The accessory may need to retransmit any other parameters that the accessory determines that it should be changed, as well as the complete message list, rather than modifications to the previous listings. It is necessary for the accessory to present a single complete personal secretary module message list (or two separate lists-one for all messages sent and one for all received messages) May be easier to consider the modified proposal and may be simpler than implementing a series of commands to remove individual messages from a previously presented list and / or to add individual messages thereto. In some embodiments, while the identification is in progress, the accessory may be blocked from sending any messages unrelated to the identification. For example, the host may ignore any such messages that may be received. In other embodiments, the host may temporarily allow the messages during the identification process (e.g., by receiving at least some irrelevant messages and acting accordingly), and if the process ends in failure, In some embodiments, the accessory may choose to ignore or dispose of messages that are not relevant to the identification that may be received during the identification process. In addition, while the above description refers to the accessory disclosing itself to the host device, those skilled in the art will recognize that the roles can be reversed when viewing this disclosure. Similar messages and processes can be implemented to allow the host to reveal itself to the accessory collectively. Bidirectional identification can also be implemented, for example, one device presents information about itself and the other device responds with its own information. In certain specific implementations, the negotiation of a set of valid messages to be exchanged may be performed in either direction (or as suggested by the host and / or determined by the accessory) In the opposite direction).

Personal secretary module, main server / big data DB implementation method using voice recognition for personal secretary module data

A personal secretary module, a main server / big data DB implementation method for verifying whether a conversation or a call recipient related to a personal assistant module is an actual person or an answering machine, Receiving an audible response from a call recipient and processing the audible response using a speech recognizer to provide an output indicative of the audible response; And processing the output representing the recognized speech with a classifier to provide an output indicating whether the call recipient is a real person or an answering machine, Based on statistical analysis - a main server / big data DB implementation method.

Predict user intent and future interactions from personal assistant module data application tasks

According to some embodiments, a user agent, also referred to as an adaptive user experience manager, may be configured to configure various performance knobs versus efficiency knobs of the device such that the user can set them up if the knobs are exposed to the user . Because performance and efficiency are typically conflicting goals, new metrics are needed to optimize various knobs. It contains something that is best for the user. Sometimes, this can be a higher performance. In another embodiment, it may be a long battery life (power efficiency). According to one embodiment, the user agent intuitively knows the user goal, using a set of contending heuristics, to determine the performance and efficiency of the various blocks of the device Determine the best way to manage and achieve your goals.

Social networking systems related to personal secretary module data

The social graph includes nodes connected by edges (I, I, D, H, E) stored in the social networking system. A node includes a user and an object of a social networking system, such as a web page including, for example, a concept and an entity, and the edge again connects the nodes in a radial fashion.

The custom graph object type and graph behavior type can be defined by the manager of the social networking system as well as the third developer to define attributes of the graph object and graph behavior.

In this way, social graphs can be "open", allowing third-party developers to create and use custom graph objects and behaviors from external websites. The third developer can enable users of the social networking system to express interest in web pages hosted on external web sites of the social networking system. Such a web page can be represented as a page object in a social networking system as a result of inserting widgets, social plugins, programmable logic or code snippets into a web page such as an iFrame. Any concept that can be embedded in a web page can be a node in a social graph on a social networking system in this way.

By allowing the unidirectional personal secretary module forwarder to target their unidirectional delivery method based on user interaction with an object related to the keyword, the unidirectional delivery method can be further simplified because the user has already performed an action associated with, for example, It is possible to reach acceptable viewers.

Using the computing system, the personal secretary module is divided into two-dimensional information of the internal personnel and the three-dimensional information of the external personnel (third persons) excluding the internal personnel to determine the authenticity of the personal secretary module. If it is judged to be in the state, the personal secretary module is immediately transmitted and controlled to be solved, and the location information of the personal secretary module creator is notified to the central center or the manager terminal.

Unidirectional Personal Secretary Module Because the messenger can provide different unidirectional delivery methods based on topic associations to better target the secretary, the one-way personal secretary module messenger can be used as a one-way personal secretary module messenger's product, brand, Benefits from identifying users participating in secretary events based on topic associations with other concepts of the networking system and objects. As a result, because the social networking system can modify the bid for the user based on the topic association, the social networking system allows the one-way personal assistant module messenger to target users based on the topic association on the object, Gain profits.

In one embodiment, the social networking system may receive targeting criteria for a unidirectional delivery method that includes a particular selected topic from a unidirectional personal assistant module messager.

In order to judge the authenticity of the personal secretary module by dividing the personal secretary module into three dimensional information of the external persons (third parties) excluding the two-dimensional information and the internal persons,

In one embodiment, the truth criterion may be defined to include users who express particular interest in a topic. In another embodiment, the topic may be specified by a one-way personal assistant module messenger in the targeting criteria. As a result, the social networking system may distribute topic related unidirectional topical ads to the user based on the determination of the topic extracted from the content item associated with the selected topic included in the targeting criteria. The user may select one or more of the following: a sponsored news that is associated with a topic selected with respect to a personal assistant module, a unidirectional delivery method to the selected topic, a social unidirectional delivery method to the selected topic, and a conventional unidirectional delivery method using the selected topic It is possible to receive a topic-related unidirectional delivery method in the form of a topic.

In another embodiment, the social networking system may infer interests of users and / or pages of the social networking system based on extracted topics of content items that interact with or are generated by users and / or pages. As noted, the nodes of the social networking system may include entities that are represented as pages, as well as users, in social networking systems.

Scripts in Web browsers related to personal secretary module data

Personal secretary module data may be replaced with terms such as "question", "answer", "answer", "instruction", "assignment", "scoring", "measurement" In addition, terms may have alternate spellings that may or may not be explicitly mentioned, and those skilled in the art will recognize that all such variations of the terms are intended to be included.

A document related to the "question", "answer", or "response" of the document. A method of preparing scripts included in a cooperative work of a personal assistant module, comprising: step; Sending the plurality of scripts to a script engine to be prepared for execution; Parsing the document personal secretary module collaborator while the script engine prepares the plurality of scripts for execution; Identifying a next script to be executed from the plurality of scripts; Transmitting information corresponding to the identified next executed script to the script engine; Discontinuing the parsing of the document private secretary module collaborator; Receiving a notification indicating that the identified next script to be executed has been executed; And restarting the parsing of the document personal secretary module collaborator in response to receiving the notification. &Lt; RTI ID = 0.0 &gt; [0002] &lt; / RTI &gt;

Various aspects include methods of preparing scripts included in a document personal assistant module collaborator, the steps of scanning a document private secretary module collaborator to discover a plurality of scripts, Parsing the document personal secretary module collaborator while preparing the plurality of scripts for execution, identifying the next script to be executed from the plurality of scripts, identifying the next executed script Sending the information corresponding to the script to the script engine, discontinuing parsing of the document personal secretary module collaborative vendor, receiving a notification indicating that the next script to be executed has been executed, and receiving a notification In response to the document Personal Assistant Module A may include the step of restarting. In one aspect, transmitting the information corresponding to the next identified script to be executed to the script engine may include sending the next script to be executed to the script engine. In an aspect, the method may comprise generating an identifier for each of the plurality of scripts. In a further aspect, transmitting the plurality of scripts to the script engine may include transmitting the plurality of scripts and identifiers to the script engine, and transmitting information corresponding to the next identified script to be executed to the script engine May include transmitting an identifier of the next script to be executed to the script engine. In a further aspect, generating an identifier for each of the plurality of scripts may comprise associating at least one script with a uniform resource identifier (URI). In a further aspect, generating an identifier for each of the plurality of scripts may comprise generating a signature for the at least one script. In a further aspect, generating an identifier for each of the plurality of scripts may include generating at least one identifier that may include text of the at least one script. In a further aspect, the step of scanning the document personal secretary module collaborator to discover the plurality of scripts may include scanning the document personal secretary module collaborator in the first processor, Parsing the document personal secretary module collaborator while preparing the plurality of scripts for the document may include parsing the document personal secretary module collaborator in the second processor. In a further aspect, scanning the document personal secretary module collaborator to discover a plurality of scripts may comprise scanning the document personal secretary module collaborator by a first process running on the processor, Parsing the document personal secretary module collaborator while the script engine prepares a plurality of scripts for execution may include parsing the document personal secretary module collaborator by a second process running on the processor . In a further aspect, parsing the document personal secretary module collaborator while the script engine prepares a plurality of scripts for execution includes parsing, parsing and compiling the second script, And parsing the document personal secretary module collaborator while the engine parses, parses, and compiles the first script. In a further aspect, the step of parsing the document personal secretary module collaborative vendor while the script engine prepares a plurality of scripts for execution includes the steps of the script engine executing a plurality of scripts, And parsing the document private assistant module collaborator while preparing the scripts of the document. In a further aspect, identifying the next script to be executed from the plurality of scripts may comprise identifying the next script to be executed based on the defined execution order. Additional aspects include: means for scanning a document personal secretary module collaborator to discover a plurality of scripts, means for transmitting a plurality of scripts to a script engine, means for sending a plurality of scripts to the document engine Means for parsing the secretarial module collaborator, means for identifying the next script to be executed from the plurality of scripts, means for transmitting information corresponding to the next script to be executed to the script engine, Means for stopping parsing, means for receiving a notification indicating that the next identified script to be executed has been executed, and means for restarting parsing of the document personal secretary module collaborator in response to receiving the notification. Computing devices. In an aspect, the means for sending information corresponding to the next identified script to be executed to the script engine may include means for sending the next script to be executed to the script engine. In a further aspect, the computing device may comprise means for generating an identifier for each of the plurality of scripts. In a further aspect, the means for sending the plurality of scripts to the script engine may comprise means for sending a plurality of scripts and identifiers to the script engine, and sending information corresponding to the next identified script to be executed to the script engine And transmitting the identifier of the script to be executed next to the script engine to the script engine. In a further aspect, the means for generating an identifier for each of the plurality of scripts may comprise means for associating at least one script with a uniform resource identifier (URI). In a further aspect, the means for generating an identifier for each of the plurality of scripts may comprise means for generating a signature for at least one script. In a further aspect, the means for generating an identifier for each of the plurality of scripts may comprise means for generating at least one identifier comprising text of the at least one script. In a further aspect, the means for scanning the document personal secretary module collaborator to discover the plurality of scripts may include means for scanning the document personal secretary module collaborator at the first processor, The means for parsing the document personal secretary module collaborator while preparing the plurality of scripts for the document may include means for parsing the document personal secretary module collaborator in the second processor. In a further aspect, the means for scanning the document personal secretary module collaborator to discover a plurality of scripts may comprise means for scanning the document personal secretary module collaborator by a first process running on the processor, The means for parsing the document personal assistant module collaborator while the script engine prepares multiple scripts for execution may include means for parsing the document personal secretary module collaborator by a second process running on the processor . In a further aspect, the means for the script engine to parse a document private secretary module collaborator while preparing a plurality of scripts for execution includes a means for the script engine to parse, analyze, and compile the second script in parallel The script engine parses, parses, and compiles the first script While there may be a means to parse the document the personal assistant module co smaller companies. In a further aspect, the means for parsing the document personal secretary module collaborative vendor while the script engine prepares a plurality of scripts for execution may include a means for the script engine to execute a plurality of scripts, May include means for parsing the document private assistant module collaborator while preparing the scripts of the document. In a further aspect, the means for identifying a next script to be executed from a plurality of scripts may comprise means for identifying a next script to be executed based on the defined execution order. Additional aspects include a computing device that may include a processor configured with processor executable instructions for performing operations, the operations comprising: generating a document private secretary module collaboration to discover a plurality of scripts to be prepared for execution Scanning the vendor, sending multiple scripts to the script engine, parsing the document private secretary module collaborator while the script engine prepares multiple scripts for execution, executing the next execution from multiple scripts Identifying the script, sending information corresponding to the next identified script to be executed to the script engine, stopping parsing of the document private secretary module collaborator, notifying that the next script to be executed is executed , And in response to receiving the notification In one aspect, the processor may cause the next script to be executed to be identified as a script to be sent to the script engine, wherein the sending of the information corresponding to the next identified script to be executed to a script engine, To an engine, including transmitting to an engine. In a further aspect, the processor may be comprised of processor executable instructions for performing operations further comprising generating an identifier for each of the plurality of scripts, wherein the processor is operable to send the plurality of scripts to a script engine May include sending a plurality of scripts and identifiers to the script engine, and sending information corresponding to the next identified script to be executed to the script engine may include sending an identifier of the next script to be executed to the script engine And may also be comprised of processor executable instructions for performing operations that may also include instructions that may be included. In a further aspect, the processor may include processor executable instructions for performing operations that may include associating at least one script with a uniform resource identifier (URI) to generate an identifier for each of the plurality of scripts . In a further aspect, the processor may comprise processor executable instructions for performing operations that may include generating an identifier for each of the plurality of scripts, the signature generating for at least one script have. In a further aspect, a processor is operable to perform operations that, by generating an identifier for each of a plurality of scripts, may include generating at least one identifier comprising text of at least one script Commands.

Gamer rate of personal secretary module related data

In one embodiment, the user starts playing the game associated with the personal assistant module on the server. As mentioned, although the game is described as playing on the server, the image may be sent from the server to the client device on which it is displayed. Likewise, control and game inputs can be uploaded from the client to the server where they are used to manipulate the game and render video game images to tailor the personal assistant module. At some point, a triggering secretary event can occur that causes the start of the migration process. For example, the user may choose to purchase a full version of the game being played. At this point, the user can continue playing the game on the server, while the game service decides how much bandwidth is available to download the block of game code to the client device.

For example, a user can reach a point in a personal secretary module game where the user has not stored the game file on the client.

An overview of embodiments of the present invention has been briefly described, and an exemplary operating environment suitable for implementing embodiments of the present invention is described below.

An exemplary personal assistant module related quiz or gaming operating environment that implements embodiments of the present invention is included and is generally represented by a personal assistant module and a main server / big data DB. The personal assistant module, the main server / Big Data DB are only one example of a suitable computing environment and do not limit the scope of use or functionality of the present invention. Personal secretary module, main server / Big Data DB should not be understood to have any dependencies or requirements relating to any one or combination of components.

The present invention may be practiced with other applications, including personal assistant modules such as personal assistants or other handheld devices, personal assistant modules such as program components executed by main server / big data DB or other machines, main server / Personal assistant module, main server / big data DB code, or machine-accessible instructions. Generally, program components, including routines, programs, objects, components, data structures, etc., refer to code that performs a particular task or implements a particular abstract data type. Embodiments of the present invention provide various systems including a handheld device for collecting remote secretary related information, a consumer electronic device, a general personal secretary module, a main server / big data DB, a dedicated personal secretary module, a main server / Configuration. &Lt; / RTI &gt; Embodiments of the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.

A personal secretary module, a main server / big data DB, a personal assistant module mapping storage, one or more processors, one or more presentation components, an input / output port, an I / O component, and a bus that directly or indirectly connects the I / . A bus may represent one or more buses (e.g., an address bus, a data bus, or a combination thereof). It is not clear that the various blocks actually distinguish the various components with the lines for clarity, and the lines may be more precisely gray and blurred. For example, a presentation component such as a display device may be considered an I / O component. The processor may also include a personal assistant module mapping storage. The present inventors have recognized that this is natural in the art and once again emphasizes that the diagram represents an exemplary personal secretary module, the main server / big data DB, that can only be used in conjunction with one or more embodiments of the present invention . There is no clear distinction between categories such as "Workstation", "Server", "Laptop", "Handheld Device", etc. because all of these are considered within the allowed categories, / Big data DB "or" personal secretary module, main server / big data DB ". Personal secretary module, main server / big data DB typically includes various personal secretary modules, main server / big data DB readable medium. Personal assistant module, main server / big data DB readable medium may be accessed by a personal assistant module, main server / big data DB, and may be any available media including volatile and nonvolatile media, removable and non- have. By way of example, and not limitation, a personal secretary module, a main server / big data DB readable medium may include a personal assistant module, a main server / big data DB storage medium, and a communication medium. Personal secretary module, main server / big data DB storage medium may be any method or technology for storage of information such as personal assistant modules, main server / big data DB readable instructions, data structures, program modules or other data Removable and non-volatile, removable and stationary media. A personal secretary module, a main server / big data DB storage medium may be a RAM, a ROM, an EEPROM, a flash personal assistant module mapping storage or other personal assistant module mapping storage technology, a CD-ROM, a DVD or other optical disk storage, Magnetic tape, magnetic disk storage or other magnetic storage devices. The personal secretary module and the storage medium for the main server / big data DB also include data signals to be transmitted. Communication media in accordance with the propagated data signal typically includes a personal assistant module, main server / big data DB readable instructions, a data structure, a program module or other data in a modulated data signal such as a carrier wave or other transport mechanism The term "modulated data signal" means a signal in which one or more of its characteristics are set or changed to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.

Any combination of the foregoing (personal assistant module, etc.) may also be included within the scope of the personal assistant module, main server / big data DB readable medium. The personal assistant module mapping storage stores the personal assistant module mapping storage A personal secretary module in the form of a main server / big data DB storage medium having a form of one block information, one block information, one block information, and two block information having block information such as two block information in block form) do. The personal assistant module mapping reservoir can be mobile, stationary, or a combination thereof.

Exemplary personal secretary module mapping storage includes a solid state solid body, or a moving body in which a personal assistant module including time and location changes in real time, and the like. Personal secretary module, main server / big data DB includes one or more processors for receiving and reading data from various objects such as personal assistant module mapping storage or I / O components.

The presentation component presents the data representation to the user or other device. Exemplary presentation components include a display device, a speaker, a printing component, a vibration component, and the like. The I / O port allows the personal assistant module, the main server / Big Data DB, to logically connect to other devices, including I / O components (some of which are internal). Exemplary I / O components include a microphone, joystick, game pad, satellite dish, scanner, printer, wireless device, and the like.

An online game environment according to an embodiment of the present invention is included. The online game environment includes a variety of game clients connected to a game service (a service including a personal secretary module such as graphic, music, story, sentence, information technology information) through a network. An exemplary game client includes a game console, a tablet and a personal personal assistant module, and a main server / big data DB. Other game clients such as smart phones may also be used. The game console may have one or more game controllers communicatively coupled thereto.

In one embodiment, the tablet capable of displaying the personal assistant module may be operable to automatically display a logical pattern as an input device to a game console or personal personal assistant module, main server / big data DB. In yet another embodiment, the tablet is a stand-alone game client. The network may be a wide area network such as the Internet. The game service includes a plurality of personal secretary modules, main server / big data DB communicably connected to each other. In one embodiment, the game service is implemented using one or more server farms. Server farms can spread across many geographical regions, including cities across the globe. In this case, the game client can be connected to the nearest server farm. The embodiment of the present invention is not limited to this configuration. The game service enables the game to be executed in the personal secretary module, main server / big data DB provided by the game service. The communication session between the game service and the game client delivers the input traffic to the game service and returns the rendered game image. In this embodiment, a personal secretary module, a main server / big data DB, which is part of a game service (a service that includes personal secretary modules such as graphics, music, stories, statements, information technology information) And executes the video game code using the control stream generated by the control stream. A video game rendered around a personal secretary module is delivered to the game client, and the game rendered on the game client is output for display.

In the social networking system related to the personal secretary module,

Social networking systems allow users to communicate with and interact with other users of the social networking system by subscribing to social networking systems and adding connections with many other users they wish to be connected to. Users of social networking systems can provide information describing those stored as user profiles. For example, users can provide their age, gender, geographic location, education, career, and the like. The information provided by the users may be used by a social networking system to inform the user of the information. For example, a social networking system may recommend users to social groups, secretary events, and potential friends. In addition, social networking systems can allow users to express their interest in concepts, such as celebrities, hobbies, sports teams, books, music, and the like, explicitly. This concern can be used in a number of ways, including unidirectional delivery of targeting and personalization of user experiences on social networking systems by showing relevant news to other users of the social networking system based on shared interests. And nodes connected by edges stored in the social networking system. A node includes a user and an object of a social networking system, such as a web page including, for example, a concept and an entity, and the edge connects the node. The edge represents a particular interaction between two nodes, such as when a user expresses interest in a news article shared by another user with respect to the "America's Cup. &Quot; The social graph stores information in the nodes and the edges that represent the interaction, so as to record the interaction between users and objects of the social networking system as well as the interaction between users of the social networking system. The custom graph object type and graph behavior type can be defined by the manager of the social networking system as well as the third developer to define attributes of the graph object and graph behavior. For example, a graph object for a movie may have some defined object properties, such as title, actor, director, producer, year, and so on. A graph behavior type such as "Purchase " (a series of special personal assistant modules) can be used by a third developer on an external website of the social networking system to report custom actions performed by users of the social networking system. In this way, social graphs can be "open", allowing third-party developers to create and use custom graph objects and behaviors from external websites.

The third developer can enable users of the social networking system to express interest in web pages hosted on external web sites of the social networking system.

Any concept that can be embedded in a web page can be a node in a social graph on a social networking system in this way. As a result, the user may be able to find out what is happening outside the social networking system related to keywords or keyword phrases, such as the origin of the personal secretary module, the quality secretary, the secretary, the efficacy, the quantity or the celebrity "Justin Bieber" You can interact with many objects. Each interaction with an object can be recorded by the social networking system as an edge object. By allowing a one-way personal assistant module forwarder to target their unidirectional delivery method based on user interaction with an object related to the keyword, the unidirectional delivery method can be further accommodated because the user has already performed an action associated with the unidirectional delivery method It is possible to reach as many viewers as possible.

U.S. Patent Application No. 13 / 239,340, entitled " Structured Objects and Actions on a Social Networking System ", filed on September 21, 2011, which is incorporated herein by reference and which is entitled &quot; Structured Objects and Actions on a Social Networking System & It is further described in the issue. Unidirectional Personal Secretary Module Forwarders are direct unidirectional delivery methods such as banner unidirectional delivery; Includes indirect non-directional delivery such as sponsorship news; Create a fan base for the page in a social networking system; Users can associate with users of social networking systems through different communication channels that develop applications that users can install in social networking systems. Unidirectional Personal Secretary Module Because a messenger can provide different unidirectional delivery methods based on topic associations, it is possible to more effectively target unidirectional delivery methods, so a one-way Private Secretary Module Forwarder can only be used for products, brands, applications But also benefits from identifying users participating in secretary events based on topic associations with other concepts and objects of the social networking system. Finally, because the social networking system can modify the bid for the user based on the topic association, the social networking system allows the one-way personal assistant module messenger to target users based on the topic association on the object, Profit from profits.

In one embodiment, the social networking system may receive targeting criteria for a secretary that includes a particular selected topic from a unidirectional personal secretary module messager. For example, a one-way personal secretary module forwarder may send information to a particular celebrity, such as Britney Spears from Ted's recent film release, or information that may be interested in targeting users interested in a play-off game for the 2012 Major League Baseball World Series, It can be used as a module.

In one embodiment, the targeting criteria may be defined to include users who express particular interest in the topic. In another embodiment, the topic may be specified by a one-way personal assistant module messenger in the targeting criteria. As a result, the social networking system may distribute topic related unidirectional topical ads to the user based on the determination of the topic extracted from the content item associated with the selected topic included in the targeting criteria. The user may select one or more topics related to the topic in the form of a sponsored news broadcasted by being associated with the selected topic, a unidirectional delivery method attachment to the selected topic, a social unidirectional delivery method for the selected topic, and a conventional unidirectional delivery method using the selected topic In another embodiment, the social networking system may be configured to receive a user and / or page of a social networking system based on an extracted topic of a content item that interacts with or is generated by a user and / As noted above, a node of a social networking system may include an entity represented as a page in a social networking system as well as a user.

A method for extracting a topic from a content item in a social networking system related to personal secretary module data is disclosed in U.S. Patent Application Serial No. 10 / System, " which is a continuation-in-part of U.S. Patent Application No. 13 / 167,701, entitled " System. &Quot; The sentiment filter module can be used to ensure that topics extracted from the content object are representing positive emotions as opposed to negative emotions (specialized private secretary module data). For example, a status update saying "Magic Mike wasawesome!" Has a positive feel for the movie "Magic Mike" that can show the user's interest in the topic. However, the emotion filter module may identify negative emotions by, for example, filtered content objects that include blacklist keywords, profanity, and content generated by blacklisted users.

The emotional filter module creates a topic object that has been identified by satisfying a positive emotional requirement determined by a one-way personal assistant module messenger and / or manager of the social networking system. In one embodiment, the emotion filter module separates the topic objects from the associated content objects based on the topic extraction engine, wherein the separate topic objects are included in the content object with negative emotions. In addition, the topic generalization module associated with the remote secretary can be used to create additional topics that can be extracted from the content object. For example, using a category tree associated with a remote secretary, the extracted topic may be generalized to generate additional topics. Other data structures, such as dictionaries, databases and quick lookup tables, may also be used to generalize topics based on the extracted topics. The topics may be represented in the social networking system as topic objects. A topic extracted from a content object is represented as a topic object. The extracted topic represented by the topic object is associated with a content object representing the content item from which the topic was extracted. Likewise, a generalized topic based on the extracted topic may be represented by a topic object and associated with the content object based on the extracted topic. The topic related unidirectional distribution scheme distribution module may include a topic extraction engine, an emotion filter, and / A topic object that has been extracted from the content object through the topic generalization module.

Unidirectional delivery of personal assistant modules (eg secretary)

A targeting module that focuses only remote secretaries other than the other features may access the topic object received from the topic related unidirectional delivery method distribution module to target a unidirectional delivery method associated with the content object for the extracted topic object. In one embodiment, the topic-related unidirectional forwarding distribution module may provide a topic-related unidirectional forwarding method for display to users of the social networking system. In one embodiment, the topic-related unidirectional delivery scheme may be attached directly to the content item or news for the targeted topic. In another embodiment, a remote assistant-related topic unidirectional delivery scheme may be displayed on the same page or application that displays the communication channel of a social networking system, such as a news feed, messaging platform, mobile application, and the like. In another embodiment, the topic-related unidirectional delivery scheme may be distributed by the topic-relevant distribution module as a sponsoring event so that the user-generated content item for the targeting topic is boosted in the communication channel of the social networking system. In another embodiment, a social unidirectional delivery method for aggregating content items for a targeted topic may be distributed by a topic-related unidirectional delivery method distribution module. Is received by the module. The unidirectional forwarding targeting module receives information about the user from the user profile object, the content object, and the page object. The user profile object includes declarative profile information for a user of the social networking system.

A content object including a personal assistant module may include objects in a social networking system representing status updates, messages, comments, video, photos, applications and custom graph objects defined by a third developer. The page object includes information about the page in the social networking system, such as the nature of the page, the list of users currently browsing the page, and the content object. The topic reasoning module analyzes the topic object extracted from the content object by the topic extraction engine along with the user profile object and the page object. In one embodiment, the topic reasoning module may determine that a particular topic object should be associated with a user or page based on the number and frequency of comments and status updates that refer to the topic represented by the topic object. The topic reasoning module may also identify pages that may be associated with a topic object based on comments and posts by users of the social networking system associated with the page. In one embodiment, the topic object may be selected and inferred by the topic reasoning module based on an analysis of the user profile object and the page object.

Artificial neural network

One of the typical tasks of machine learning is the classification problem, which further includes a machine learning classification module that classifies incoming input vectors into specific classes.

Deep learning based learning algorithms including artificial neural networks 'decision tree', 'beige anem', 'support vector machine', 'artificial neural network' (Professor Jeffrey Hinton) RBM;

Just as humans can identify objects in a multitude of data patterns, computers can distinguish objects;

Supervised learning and unsupervised learning.

Dropout algorithm

A service server and a terminal for providing a personal assistant module related data service based on the prediction of user behavior

A hierarchical temporal memory (HTM) model can be used to calculate a common behavior pattern of a plurality of users or to calculate a behavior pattern unique to an individual user. The HTM model is based on machine learning techniques.

The service server according to an embodiment of the present invention can select a common pattern frequently observed from a plurality of sensor data in a training step using the HTM model and generate a plurality of spatial patterns based on the common pattern . In addition, the service server according to an embodiment of the present invention can determine whether the sensor data transmitted from the terminal is the same as any one of the generated plurality of spatial patterns, and if it is not the same, The received sensor data can be regarded as the very similar spatial pattern.

Next, the service server according to an embodiment of the present invention may generate a temporal sequence of spatial patters according to the order in which the generated plurality of spatial patterns are transmitted. The term &quot; computer &quot; is used herein to refer to any device that has a processing capability capable of executing instructions. &Lt; RTI ID = 0.0 &gt; .

The query creation system can be used to create objects that can encapsulate queries. The created object can also be used to perform searches to find information stored on a computer system. As used herein, a term object refers to a computing object in an object-oriented computing environment as well as other appropriate data structures, A data structure found in a C or C ++ programming language from a different computing paradigm or a combination of such structures may be written in executable code. The tree structure includes a plurality of nodes.

Terms may include search terms and operators, such as selecting, projecting, or combining, among other things, in accordance with a particular implementation. Nodes, one of the nodes, can be connected together to express the logical connection between the query terms. The tree structure can represent an entire query or simply a portion of a query. In this case, the tree structure can be used as part of a more complex query by joining the tree structure to other tree structures. The tree structure can be encapsulated in a search object for use as a search function. And may be encapsulated in an object such as an object (not shown). The presentation object may be encapsulated by a searcher object such as a repository browser object disclosed and described in connection with FIG. Expression objects can be constructed when a query is created. Similarly, the expression object can be processed when the query is executed. In addition to or as an alternative to the query string, a representation object representing the query can be passed to the searcher constructor, creating a new searcher object that encapsulates the query represented by the representation object. Many possible methods can be created to execute functions similar or similar to functions executed in the query language by various commands. A filter method may be provided to filter objects based on the values of these objects' properties. Type filters can filter objects based on their type. It can be converted to a searcher that searches for a supertype in a searcher that searches for a subtype by treating it as a type method of a searcher object. The sort method can sort objects based on one or more attribute values. A project method may plan for each one or more attributes of one or more objects. Group methods can group objects according to one or more values. An integration method can create an aggregation of two sets of objects. In addition, query methods can apply complex queries in a single step. Methods can be implemented so that the invocation of a method can be used as an easy way to invoke a query method. Encapsulated queries and subqueries can be used as a chain of queries to isolate each step of the query execution from each other phase have. When doing this, each successive step in the query execution can only affect the data generated by the previous step. This approach, however, can potentially result in an instruction to be taken at a later stage that may result from a previous step, such as ordering or grouping an operation, or canceling or destroying at least a portion of a calculation or result. Methods that alleviate this anxiety can be implemented in a way that ensures that ordering is maintained by operations performed by that method. Additionally or alternatively, methods may be specified to be called in order to maintain ordering or grouping. In addition, certain types of methods, such as ordering or grouping methods, may be prevented from being executed at a given step, or if the operations performed by these methods are likely to be canceled or destroyed by a later invocation of a method, To perform a query and get search results, a search object or search class can support a number of methods. For example, the get enumerator method can enumerate the results of all the queries. The execution of the process starts at the start block and proceeds to the processing block. In the processing block, a query (or a portion thereof) is defined. In a processing block, an official query (or portion thereof) is written in a predetermined query language, such as an application space query language described in connection with another drawing. The process proceeds, and in the processing block, the created query is passed to the repository browser object. In the processing block, a query tree is constructed from the created query. In the processing block, the query is executed. The result of the query executed in the processing block is obtained. Processing terminates at the end block.

Object Personal Assistant Module

Embodiments describe a method and / or system for providing a general repository of information about the "real" world. Such a personal assistant module may contain detailed information about a particular entity or region of interest. The user may, for example, request a personal secretary module for the university campus (special characteristics information about the university - ranking, major series information, etc.). A bird's-eye view of the campus can be displayed along with specific information about each building, structure, office, etc. associated with the campus. The information displayed may include building name, faculty, department, classroom number, telephone number, and so on. Such personal assistant modules may also be provided for a variety of other structures or areas (e.g., shopping malls, office buildings, government buildings, apartment buildings, etc.). The information may be submitted from the owner, occupant and / or other authorized persons associated with the structure, and / or may be obtained from a public resource. The real world information may further include a detailed three-dimensional model of the locations on the earth, satellite photographs, real-time web cams, user annotations, maps, points of interest, geological information, real-time traffic, real estate sales,

According to the features provided herein, it is possible to include any and all personal secretary modules for a platform, a set of experiences, and the physical world, and wherein such personal secretary modules are accessed by a user in a " on demand & (E.g., live video, continuous motion) is provided.

Such a personal assistant module may be further updated over time to allow projection of current observations, historical observations, and / or how the area will look in the future. The features of the personal assistant module provided herein are not limited to the earth, and may include a virtual world as provided by a user, as well as an entity of the universe. There is also provided an active community for capturing, connecting, sharing and visualizing information based on location. Embodiments provide schemas, repositories, indexes, and application program interfaces to any information, place, entity, attribute, service or person that can be referenced geographically. The disclosed embodiments are based on the premise that the positions are otherwise associated with different information sources, that values exist in the "tail" information sources, and that the tail information is (in many cases) inherently local. Together these concepts enable an independent, informed ecosystem. A data model is a set of layers that can encode anything in the real world and are estimated in many ways based on a generic core schema. The virtual world is assembled from a global model, a plurality of terrain attitude maps, a plurality of sky and non-sky raster images, vector objects, cultural objects, dynamic objects, temporal information (including temporal objects), and interactive objects. An artificial intelligence based system (e.g., an explicitly and / or implicitly trained classifier) may be used in connection with performing inference and / or stochastic and / or statistical based decisions. The term " inferences " as used herein generally refers to the process of determining or inferring the state of a system, environment, and / or user from a set of observations as captured through secretarial events and / or data. Inference may be used to identify a particular context or action, or may generate a probability distribution for, for example, states. The inference can be probabilistic, that is, the computation of a probability distribution over states of interest based on consideration of data and secretary events. The inference may refer to a technique used to construct a higher level secretary event from a set of secretary events and / or data. This inference results in a new secretary event or action being constructed from a set of observing secretary events and / or stored secretary event data, regardless of whether the secretary events are closely correlated in terms of time, Regardless of whether they originate from one or several secretary events and data sources. (E.g., support vector machines, neural networks, expert systems, Bayesian trust networks, fuzzy logic, data fusion, etc.) in connection with performing automatic and / or inferential actions in connection with the present embodiments. Engine, etc.) can be used. Community searches can be scaled up or down according to user requirements. The widest range is the entire community, the middle range is your own community (often acquaintances), and the narrowest range is associated with a particular user or a saved bookmark of that user. The user can navigate between the narrowest search and the broadest search, and also search for an arbitrary range between the narrowest and widest ranges. Further, the user may request a search based on the user's acquaintance, the acquaintance's acquaintance, or the acquaintance of the acquaintance in the continuously expanding and / or remote range of acquaintances remote from the user.

Such personal assistant module retrieval can be performed based on inference, or artificial intelligence provided by a stitching component of the system or a machine learning component that interfaces with other components. For example, a first user may have preferences for a particular restaurant, and a second user does not need to be the same, but has a similar preference. If the first user is unfamiliar with an area and / or does not know a similar restaurant he can enjoy, the search may be performed based on reasoning using the preferences of the second user. The retrieval can be performed using user defined criteria or system defined criteria based on the user's known preferences and non-preferences as previously entered by the user. The inference or machine learning component and / To search for additional users with similar preferences. The system can recommend an appropriate restaurant based on the inference that the preferences and dislikings of the two users are similar if each user pre-agrees that their information can be used in such a way even if the users do not know each other have. Some of these inferences can be based on social networks, such as using instant messaging systems as social networks. A heuristic search can be based on inferences about what another person would prefer. For example, a husband might want to take his wife to a special event, and he decided to do it because it was special, not what he wanted to do. In this example, the husband can search based on his wife's preference and his wife's community preference, without any relationship to the husband's preferences and / or a combination of husband's preferences. This is basically a search (personal assistant module search) that determines what a person likes without actually asking another person, which provides an element of incredible and / or good judgment. Another type of heuristic search may be based on a combination of preferences of two or more people. By combining a plurality of preferences, the reasoning can come closer to being able to enjoy both, or both, together. The inference engine may provide geographic reasoning based on time-based information and / or social network-based information. The training mode may be initiated with the seed model and as the data is captured or pushed into the system, the user's preferences may be learned. The system or architecture captures data about places where the user has previously viewed, viewed or displayed preferences in a certain way, and based on this data, the user is interested in certain activities such as sports activities, social activities, business activities, The user's preferences are placed in large types or groups of activities, and the system deduces what the person can be interested in by applying the filter and analyzes the specific activity. Once the system learns its user's preferences, the system acquires intelligence and applies the user's preferences to the relationship with the community to enable faster and more accurate searches and recommendations.

The system includes a receiver component that receives data, images, and other information from a plurality of users. Data, images, and / or information are communicated to the stitching component, which maintains the data in a logical format, allowing data and images to be used for a plurality of users through interaction with the rendering component. The rendering component may include map information and / or map information via an interface between an acquisition module, a content display module, an automatic refresh module, an observation module, and an update module that verifies whether the update information is available, And to display related data. It should be understood that fewer or more modules than shown and described may be used with or separately from the rendering components. The acquisition module is configured to receive map information to be displayed, which includes receiving a user request to observe an area or location on the map. For example, a user may request observation of a geographic area (e.g., city, street, building, address, etc.) associated with a particular personal assistant module via the user interface. The map focus may be based on the center of the screen, but the user may also see certain entities or locations, such as restaurants, and / or certain facilities associated with such types of entities. For example, search can be performed on all Mexican restaurants with five stars, great views, live music performances, alcoholic beverage service and more. The search results may be associated with additional data including images, text, and / or audio data. The content display module is configured to render a subset of map information in a display space or viewing area (e.g., monitor, display, etc.). The content display module is also configured to render user interface controls to overlay the map information within the display space. Controls are rendered to be semitransparent, so map information located under control can be seen. In this manner, a user can manipulate user interface controls and view map content and related information at substantially the same time. As a limited example, if a user wants to find all the Starbucks in Seattle as well as different places to park in that area, the user can view both results together on the map. The user will enter a search term such as "Starbucks in Seattle" and / or "Seattle ". Searches based on user input criteria are performed by the system, and when both criteria are entered, both criteria are shown on the observation page, e.g., distinguished by different colors. The user can selectively turn on or off each search criterion individually for ease of classification and distinction. Thus, if the user who performed the search only wants to see where to park, the user will select the "off" function and the indicator for Starbucks will be removed from the observation. The user can return these functions to "on" and they will reappear on the observation screen. In another example, if the user who performed the search additionally or alternatively wants to find an Italian restaurant and ATM machine associated with the personal assistant module, the user may enter a search criteria such as " Italian food in Seattle & Can be input. The system performs the search, layering the search results with the search results, and allowing observation of all search criteria at approximately similar times. This layering function makes it possible for different search functions to be displayed together using different marking indications such as, for example, different colors or flags, geometry, and the like. Further information regarding the display overlay or layering function will be described below. << E-commerce >> Consumer profiles are data that consumers use (or use) in connection with transactions with physical merchant entities or virtual merchant entities, Request, and / or information about the consumer. As such, certain information in the consumer profile can be received directly from a consumer, such as a consumer. For example, a consumer may enter data into a mobile communication device or may supply data to a merchant entity at a physical retail store (e.g., by completing an investigation at a retail store or by using a membership card). Other information in the consumer profile may be collected based on e-commerce activity or other behavior of the consumer. For example, certain communication session information (described in further detail below) may be included in the consumer profile. The consumer profile can be used for any purpose within the virtual retail system and is particularly useful for customizing the operation of the virtual retail system for special consumers. To deal with the secret (special private secretary module), the consumer can control whether information is collected and included in the consumer profile and / or what information is collected and included in the consumer profile, and how this information is used or accessed Or to control who uses or accesses this information. The consumer profile is described in more detail below with respect to various aspects of the method sequence chart of FIG. 3. First, consumer profiling is described. Consumer profiling represents an action associated with a personal assistant module in association with creating, updating, or using a consumer profile. Examples of consumer profiling include, but are not limited to, actions, pattern purchases, personal information (e.g., name, address, genre, age) associated with collecting or using consumer actions, (E. G., Opt-in condition), service profile, retail store alliance, device and network dense location information, device and network dense communication session information, and Internet activity, email activity , And other behavior related data such as general mobility patterns, but are not limited to these examples.

Consumer profiling (consumer personal secretary module analysis) can be used to confirm other situations that affect proximity. For example, the predetermined logical relationship between a consumer and a physical retail store may be created and stored in a consumer profile, used alone, or may be used as a filter in connection with a given physical distance, Can be determined when it is close to a particular retail outlet.

Input text related to personal assistant module;

A device such as a desktop computer, laptop, or handheld device may be configured to receive input text using an input device. In one example, a user of the desktop computer may use the keyboard to enter text into a word processing program or other software application. In devices with a touch screen, such as a cellular telephone and a tablet computer, a user may enter text, for example, by tapping on-screen keys. The device may be configured to receive a portion of the text (e.g., a word or phrase) and may be configured to provide the user with candidate text that predicts the remainder of the text based on the received portion of the text. , One key or button of the input device may represent more than one character, such as in mobile phones. Each keystroke can cause prediction, rather than repetitive sequencing through the same group of "characters" that the keystroke can represent. In the examples, the device may be configured to enable the entire word to be entered by a single key press. In this way, the device can be configured to efficiently use fewer device keys to enter text, such as text messages, e-mail, address book, calendar, etc. In some instances, Or when the user is distracted. As a result, the user input text may contain errors. When the user enters a character sequence that does not correspond to a known word, the device can be configured to predict and correct the character sequence. In some instances, a misspelled word may be replaced with a corresponding correct word. In other examples, the device may be configured to provide the user with a list of possible alternatives in which to select the correct word. Errors, however, can reduce the accuracy with which a device can accurately predict text or provide a list containing correct words. As used herein, the term &quot; character &quot; refers to a symbol or &quot; It is intended to include other numbers. Examples of characters include, for example, alphabetic characters, such as those derived from the Latin, Cyrillic, Arabic, Hebrew, or Greek alphabets. In addition, the characters may be one of various symbols used in Asian languages such as Chinese, Japanese, and Korean. The text may include words or groups of various characters forming units of word type. By way of example, the text may be a Chinese character that may be represented by one or more Pinyin characters. Thus, text can refer to morphemes (the smallest unit of semantic meaning), words, phrases, and so on. In the example, a portion of the text may be, for example, one or more letters forming part of a word. In another example, a portion of the text may include Pinyin initials of the words forming the phrase. These examples are for illustration only, and other examples are possible.

In one example, the computing device may be configured to use the speech input to determine candidate text based on a portion of text, and to identify or discard a subset of candidate text. In another example, the computing device may be configured to determine candidate text based on speech input and to use a portion of the text to identify or discard a subset of candidate text. In another example, the computing device determines a first set of candidate texts based on a portion of the text; And to determine a second set of candidate texts based on the speech input at substantially the same time. The computing device may also compare the first set of candidate texts with the second set of candidate texts, for example, to determine candidate texts that are common between the first set and the second set. As another example, May provide programmable devices with access to software for computing, graphics, audio, video, World Wide Web (WWW) / Intranet usage, and / or other functions. Many other examples of server devices are of course possible.

The server devices may be program logic, and / or cloud-based devices that store data of cloud-based applications and / or services. In some instances, the server devices may be a single computing device resident in a single computing center. In another example, server devices may include multiple computing devices in a single computing center, or multiple computing devices located in multiple computing centers at various geographic locations. For example, server devices resident at different physical locations. In some instances, data and services at server devices may be stored in non-transitory types of computer-readable media (or computer-readable storage media) and readable by programmable devices and / or other computing devices Data may be stored on a single disk drive or other type of storage medium, or may be stored on multiple disk drives or other types of storage media located in one or more various geographic locations. &Lt; RTI ID = 0.0 &gt;Lt; / RTI &gt;

A block diagram of an exemplary computing device (e.g., system) in accordance with one embodiment. In particular, a computing device may be configured to perform one or more functions of server devices, a network, and / or one or more programmable devices. The computing device may include a user interface module, a network communication interface module, one or more processes, and a data storage, all of which may be linked together via a system bus, a network, or other connection mechanism. May be operable to transmit and / or receive data to / from user input / output devices. For example, the user interface module may transmit and / or receive data to and / or from a user input devices, e.g., a keyboard, a keypad, a touch screen, a computer mouse, a trackball, a joystick, a camera, Or receive data therefrom. The user interface module may also include user display devices such as one or more cathode ray tube (CRT), liquid crystal display (LCD), light emitting diode (LED), displays using digital light processing (DLP) , Incandescent lamps, and / or other similar devices that are currently being developed or later developed. The user interface module may also be configured to generate an audible output, such as a speaker, a speaker jack, an audio output port, an audio output device, an earphone, and / or other similar devices. One or more wireless interfaces and / or one or more wired interfaces that are configurable to communicate over a wireless network. The wireless interfaces may be implemented within one or more wireless transmitters, receivers, and / or transceivers, such as a Bluetooth transceiver, a Zigbee transceiver, a Wi-Fi transceiver, an LTE transceiver, and / A wireless transceiver. The wired interfaces may include one or more wired transmitters, receivers, and / or transceivers, for example, an Ethernet transceiver, a Universal Serial Bus (USB) transceiver, or a twisted pair wire, coaxial cable, fiber optic link, A similar network communication interface module may be configured to provide reliable, secure, and / or authenticated communication. In some instances, the network communication interface module may be configured to provide reliable, secure, and / or authenticated communication. In each communication described herein, the information for assuring reliable communication (i.e., guaranteed message delivery) may be stored in the message header and / or as part thereof (e.g., packet / message sequencing information, encapsulation header and / , Size / time information, and transmission verification information such as CRC and / or parity check values). The communication may be secured (e.g., encoded or encrypted) using one or more encryption protocols and / or algorithms, such as, but not limited to, DES, AES, RSA, Diffie-Hellman and / or DSA / RTI &gt; and / or decrypted / decoded. Other encryption protocols and / or algorithms may be used or may be used in addition to those listed herein to secure (and also decrypt / decode) communications.

Processors may include one or more general purpose processes and / or one or more special purpose processes (e.g., digital signal processors, custom semiconductors, etc.).

Processes may be configured to execute computer readable program instructions contained in a data storage and / or as described above (e.g., method other instructions). Data storage may be read and / or accessed by at least one of the processors One or more computer-readable storage media, which may be in whole or in part integrated with at least one of volatile and / or non-volatile storage components, e.g., processes. Data storage may comprise a single physical device (e.g., one optical, magnetic, organic or other memory, or disk storage unit). , While in another example Data storage may be implemented using two or more physical devices. Data storage may include computer readable program instructions, and possibly additional data, such as, but not limited to, one or more processors and / or threads of a software application Data storage may include at least some of the methods described herein (e.g., at least some of the methods and techniques, and / or at least some of the functions of the devices and networks described herein) And may further include the storage required to perform.

The functions of the server device may be distributed among the three computing clusters.

Computing cluster

A logic cluster associated with a private secretary module may include one or more computing devices (e.g., computing devices, cluster storage arrays, and cluster routers) connected by a local cluster network. Similarly, a computing cluster may be coupled to a local cluster network Cluster storage arrays, and cluster routers. Similarly, a computing cluster may include one or more computing devices connected by a local cluster network, cluster storage arrays, and cluster routers In some instances, each of the computing clusters may have the same number of computing devices, the same number of cluster storage arrays, the same number of cluster routers. However, in another example Each computing cluster may have a different number of computing devices, a different number of cluster storage arrays, and a different number of cluster routers. In each computing cluster, computing devices, cluster storage arrays, and cluster routers May vary depending on the computing task or tasks assigned to each computing cluster.

For example, in a computing cluster, computing devices may be configured to perform various computing tasks of a server device. In one example, the various functions of the server device may be distributed among one or more computing devices.

Computing devices in computing clusters may be configured similar to computing devices in a computing cluster. On the other hand, in some instances, computing devices may be configured to perform different functions.

In some examples, the computing tasks and stored data associated with the server devices may include the processing requirements of the server devices, the processing capabilities of the computing devices, the latency of network links between computing devices in each computing cluster and between the computing clusters themselves, And / or other factors that may contribute to cost, speed, fault tolerance, elasticity, efficiency, and / or other design goals of the overall system architecture. The storage arrays may be data storage arrays that include a disk array controller configured to manage read and write accesses to groups of hard disk drives. The disk array controllers may also be coupled either alone or in combination with their respective computing devices to protect against disk failures and / or other cluster storage array failures and / or network failures that prevent one or more computing devices from accessing one or more cluster storage arrays And manage backups or redundant copies of data stored in the cluster storage arrays. Similar to the manner in which the functions of the server devices may be distributed across computing devices of computing clusters, various active portions of these components And / or backup portions may be distributed across the cluster storage arrays. For example, some cluster storage arrays may be configured to store data of a server device, while other cluster storage arrays may store data of a server device. In addition, some cluster storage arrays may be configured to store backup versions of data stored in other cluster storage arrays.

Clusters in computing clusters may include networking facilities configured to provide internal and external communication for computing clusters. For example, a cluster router in a computing cluster may provide local area network communication between a computing device and a cluster array over a local cluster network, and remote communication network communication between a computing cluster and computing clusters over a remote network connection to the network Lt; RTI ID = 0.0 &gt; and / or &lt; / RTI &gt; The cluster routers may include network facilities similar to the cluster routers and the cluster routers may perform similar networking functions for the computing clusters that the cluster routers perform for the computing cluster. In some instances, The configuration may include data communication requirements of computing devices and cluster storage arrays, data communication capabilities of network facilities at cluster routers, latency and throughput of a local area network, latency, throughput and cost of a wide area network link, and / May be based, at least in part, on other factors that may contribute to failure tolerance, elasticity, efficiency, and / or other design goals of a suitable system architecture. In some instances, the disclosed methods (e.g., Non-transitory Computer program instructions for executing computer processes on a computing device arranged in accordance with at least some embodiments disclosed herein may be embodied as computer program instructions embodied in computer-readable storage media or in other non- The signal bearing medium may be embodied by one or more processors and may be embodied in the form of a computer program product, In some instances, the signal bearing medium may be a hard disk drive, a CD (Compact Disc), a DVD (Digital Video Disk), a digital Computer board such as tape, memory, etc. In some embodiments, the signal bearing medium may encompass a computer-writable medium such as memory, R / W CD, R / W DVD, etc., but these may include, but are not limited to, In some embodiments, the signal bearing media includes communication media such as digital and / or analog communication media (e.g., fiber optic cables, waveguides, wired communication links, wireless communication links, etc.) But are not limited to these. Thus, for example, the signal bearing medium may be carried by a wireless communication medium (e.g., a wireless communication medium conforming to the IEEE 802.11 standard or other transmission protocol).

Programming instructions

The one or more programming instructions may be, for example, computer-executable and / or logic-implemented instructions.

In some instances, a computing device, such as programmable devices or computing devices, is communicated to one or more programmable devices or computing devices by one or more of one or more computer-readable media, computer-recordable media, and / Functions or actions in response to programming instructions. It will be appreciated that the arrangements described herein are for illustrative purposes only. Accordingly, it will be appreciated by those of ordinary skill in the art that other configurations and other elements (e.g., machines, interfaces, functions, sequences, and groups of functions) Can be omitted altogether according to. Moreover, many of the elements described are functional entities that may be implemented as separate or distributed components, or in combination with other components in any suitable combination and location.

While various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those of ordinary skill in the art. The various aspects and embodiments disclosed herein are for the purpose of illustration, are not intended to be limiting, and the true scope is indicated by the claims below, and the full scope of equivalents to which such claims are entitled. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.

Grid computing environment

Grid computing environment, which deals with personal secretary module related information, is an extended concept of existing distributed computing technology. Grid is used in various fields to obtain high performance computing performance at low cost. However, in the absence of a commonly available information system, the current grid is used in the same sense as a conventional cluster computer, not a grid as a single large-scale environment. Therefore, in order to include the distributed computing environment that is constituted as a part of the grid environment, information about the computing environment should be shared by the users of the grid, and information services should be disclosed and shared.

As a part of distributed parallel computing related to the personal secretary module, a plurality of networked computing resources are grouped together to form a virtual high-capacity, high-performance computing environment for computing intensive jobs or data intensive jobs ).

Bayesian belief network

A Bayesian network or a belief network or a directed acyclic graphical model,

Bayesian belief networks are extended to represent user needs and catalog documents in a concept (or category) network extracted from a web directory. By using the concept network, it is possible to calculate the concept matching degree between the user's request related to the individual secretary module and the catalog document. That is, even if the query terms of the user and the index words of the catalog document do not match, it is possible to retrieve conceptually relevant documents. Also, by calculating the conceptual similarity between users, it is possible to recommend collaborative filtering based on semantic.

Thread

In the present invention, as described above, the connection with the client is managed by the thread thread method. However, if the number of threads increases, it is burdensome to manage the connection. MariaDB maintains threads as pools, keeping threads from growing every time a connection grows.

Ontology

A personal secretary module data category module for categorizing and classifying the personal secretary module by ranking the ontology and similarity search result for remote secretary based search, Personal secretary module data category module that displays the content corresponding to the category received from the module; Personal secretary module data Personal secretary module classified by category module and thematic category module Personal secretary module shared by personalized category and subject matter contents by recommending ontology and ranking and personal secretary module Recommended content / problem search module recommended.

Private Secretary Module Filtering

An executor by neural network means;

A filtering saver for blocking a personal secretary module flowing in a personal secretary module cooperative business system connected to a launcher by a neural network means and a semantic expression;

And a microprocessor formed by pre-populating the filtering protector, receiving the personal secretary module, converting the received personal secretary module into a digital semantic representation signal, and controlling the personal secretary module to block the personal secretary module below a certain level.

Personal Secretary Module Learning

Learning is done in the brain, which consists of many learning units or modules. These units of learning are already genetically determined, and they are pre-programmed according to the type of learning, so that each has its own unique anatomically connected synapse. Brain is an organ that develops continuously after birth. As it grows older, it must form this unique synapse in order to acquire various neurological functions.

The contents learned by the remote secretary are formatted in the computer's diskette so that the cortex is also formatted with a predetermined address so that the cortex is stored at a predetermined address when the information is stored. It is categorized and stored in the form of memory in the cerebral cortex.

Functional anatomy of the brain The cerebral cortex can be divided into sensory areas, motor areas, and association areas that connect them. Primary motor & sensory areas, which are the first to develop in the double developmental stage, account for 5% of the brain and consist of primary visual area, primary auditory area, primary body sensory area, and primary motor area. The connection of the brain to other parts of the brain has been determined from the time of birth (primary hard-wired areas), the motor area is the vertebral circuit, the visual area is the optic tract, the auditory area is the auditory system, Areas are linked to the awards, and information from learning or training is not stored here. The area occupying the remaining 95% of the brain is the union region,

It can be divided into unimodal association areas and multimodal association areas. The single union region is located next to the primary kinesthetic sensation region in the brain. It functions to recognize and interpret information received from each region. The visual association zone, the auditory association zone, the Broca zone, and the somatosensory association zone correspond to the same position of the opposite hemisphere through the corpus callosum, and connect the motion zone to the sensory zone. . The most multi-associative area of cortical development in school-age is the prefrontal lobe of the frontal lobe of the frontal lobe and the angular gyrus and supramarginal gyrus of the temporo-parietal area . Here, the information is received in a single federation domain, linked to another single federated domain, or sent to a kinetic domain or limbic system.

The sensory information that comes into our body is firstly analyzed in the body body sensory area, the primary visual area, and the primary auditory area, and then compared with the past experience in each sensory association area, And the resulting multi-sensory association area (MA) where each stimulus is synthesized. The front of the lower part of the temporal lobe is thought to be the area with multiple sensory association areas. When the sensory information finally reaches this part, the perception of the object becomes complete, and the perceived information is added to the prefrontal cortex for prediction and behavior of the action, and the supplementary motor area and the pre- After a detailed plan of motion is made in the premotor area, it is converted into a reaction through the primary motor area. If this is the case, new stimuli that were not experienced in the past will enter the new memory circuit through the limbic Papez circuit, and the stimuli that were important in the past experience will enter the amygdala nuclear complex And then they become specific behavioral responses through prefrontal cortex and motor area. What is also important in the newly memorized mechanism is the addition of emotions to the Papeč circuit through the tonsillitis complex, which leads to consolidation of memory. Thus, the information that has passed through the memory circuit is stored in the association area.

Most desperately, you should be careful to prepare a countermeasure for the withdrawal of your personal secretary module.

The ontology is a tool that can semantically connect the concept of the personal secretary module as a tool to implement the semantic web. Web information retrieval for the personal secretary module enables searching all electronic resources accessible via the web.

Due to the rapid development of the web, enlargement of the scope of the search has necessitated more sophisticated searching and facilitated the development of an intelligent personal secretary module search system.

The ontology according to the present invention is utilized in the field of machine translation and artificial intelligence of the natural language related to the personal secretary module. Recently, the semantic web using the ontology describing the internet resources of the specific field and the relation between the semantic web and the semantic web Service and so on.

In other words, each individual secretary module finds a common point, and to express it as a set or category, it means to clearly and detailly store meaning, use of personal secretary module, and so on.

Claims (1)

Personal secretary information system that can scan the individual secretary module and reproduce the personal secretary module with 3D printer, and can display the secret information at the time when it is scanned realistically and need a 3D image sensor for it.