WO2018108174A1

WO2018108174A1 - Interface interactive assembly control method and apparatus, and wearable device

Info

Publication number: WO2018108174A1
Application number: PCT/CN2017/116672
Authority: WO
Inventors: 唐惠忠
Original assignee: 北京奇虎科技有限公司
Priority date: 2016-12-16
Filing date: 2017-12-15
Publication date: 2018-06-21
Also published as: CN106775721A

Abstract

Disclosed in the present invention are n interface interactive assembly control method and apparatus. The method comprises: structuring and displaying an interface interactive assembly according to at least one piece of attribute information; collecting sensing data of at least one sensor of this machine and uploading the sensing data to a server, so as to obtain an attribute modification instruction that is made by the server according to the sensing data and that is used for changing the interactive state of the interface interactive assembly; and changing the attribute information of the interface interactive assembly according to the attribute modification instruction, so as to change the interactive state of the interface interactive assembly. In addition, the present invention also provides a wearable device for executing the interface interactive assembly control method. In the present invention, by fully using sensing data collected by a sensor carried by a wearable device, a server parses the sensing data and generates and changes the interactive state of the interface interactive assembly, and a user of the wearable device is stimulated by means of the interactive state of the interface interactive assembly.

Description

Interface interactive component control method, device and wearable device

Technical field

The present invention relates to the field of interactive interface control technologies, and in particular, to an interface interaction component control method, apparatus, and wearable device.

Background technique

At present, all wearable devices or mobile terminals can provide a human-computer interaction interface. The human-machine interface is a medium for interaction and information exchange between the system and the user, and it realizes the conversion between the internal form of information and the human acceptable form. There are human-machine interfaces in all fields of human-computer information exchange. Users and systems typically interact with a problem-oriented, restricted natural language. Generally, when designing a graphical interface, the elements on the interface are components. By setting the properties of the component, the overall appearance of the component can be set, including parameters such as shape, color, size, etc., and changing the properties of multiple components at a certain frequency can reflect The animation state of the component. A plurality of components can be combined to form a whole, for example, combined into an electronic pet, an electronic robot, an electronic plant, or the like.

Generally, the interface interaction components are dynamically changed through preset property setting items. Generally speaking, the preset interface interaction components have few actions, and it is difficult for the user to interact with them, or only in some schemes. For the user to touch or swing the body to get the trigger operation, in general, these control methods are only limited to adult use, more complicated text and difficult operation instructions for younger children, not only operate It's difficult, and it will hurt its self-confidence, leading to a loss of interest in the interactive components of the interface, and some of the beneficial features designed specifically for the growth of children can't play its role. A child participation system and a method of child participation have revealed a solution for children to use wearable devices, which has improved color and scene patterns to a certain extent, thereby enabling children to have fun when interacting with them.

However, the current interface interaction component only provides an update scheme for color and scene mode, and lacks some practical interaction schemes, especially when the user is a child, and it cannot balance the child's behavior when instilling the training program.

Summary of the invention

In view of the above problems, the present invention provides a method and corresponding device for controlling interface interaction components, which utilizes sensors installed in the wearable device to learn the behavior of the child, and characterize the behavior state of the user by updating the state of the interface interaction component. Affirmation, it provides a more effective incentive strategy.

In a first aspect, the present invention provides an interface interaction component control method, comprising the steps of: constructing and displaying an interface interaction component according to at least one attribute information; and determining a shape, a color, a size, and the like of the interface interaction component according to the attribute information. Collecting sensing data of at least one sensor of the local machine and uploading the data to the server to obtain an attribute modification instruction that is determined by the server according to the sensing data for changing an interaction state of the interface interaction component; by uploading the sensing data to the server To determine the behavior of the user, the server has a higher processing level and faster processing speed. And changing attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component.

In a second aspect, the present invention also provides an interface interaction component control device having the function of implementing the behavior of the interface interaction component method in the above first aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. The interface interaction component control apparatus includes: at least one processor; and at least one memory communicatively coupled to the at least one processor; the at least one memory including processor executable instructions when the processor The executable instructions are executed by the at least one processor, causing the apparatus to perform at least the following operations: constructing and displaying an interface interaction component according to the at least one attribute information; determining, according to the attribute information, the shape, color, size, etc. of the interface interaction component . Collecting sensing data of at least one sensor of the local machine and uploading the data to the server to obtain an attribute modification instruction that is determined by the server according to the sensing data for changing an interaction state of the interface interaction component; by uploading the sensing data to the server To determine the behavior of the user, the server has a higher processing level and faster processing speed. And changing attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component.

In a third aspect, the present invention provides an interface interaction component control method, which specifically includes the steps of: receiving sensing data of at least one sensor sent by the wearable device; and parsing the sensing data according to the sensing data Developing an interface interaction group for changing the wearable device An attribute modification instruction of the interactive state of the piece to change the attribute information of the interface interaction component according to the attribute modification instruction to change the interaction state of the interface interaction component.

In a fourth aspect, the present invention further provides an interface interaction component control device having a function of implementing the behavior of the interface interaction component method in the above first aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. The interface interaction component specifically includes: at least one processor; and at least one memory communicatively coupled to the at least one processor; the at least one memory including processor-executable instructions when the processor is Executing, by the at least one processor, the instructions to cause the apparatus to perform at least: receiving sensing data of at least one sensor thereof transmitted by the wearable device; parsing the sensing data according to the sensing data An attribute modification instruction for changing an interaction state of the interface interaction component of the wearable device is defined to change attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component.

In a fifth aspect, the present invention further provides a wearable device, comprising: a touch-sensitive display for sensing an operation instruction and displaying a corresponding interface according to the instruction; and a memory for storing the support transceiver to perform the interface interaction component control a program of the apparatus; one or more processors for executing a program stored in the memory; a communication interface for communicating with the other device or communication network by the interface interaction component control device; one or more application programs, One or more programs are configured to perform the functions of implementing the interface interactive component control device described above.

In a sixth aspect, the invention also provides a computer program comprising computer readable code, when the wearable device runs the computer readable code, causing the method of the first aspect to be performed.

In a seventh aspect, the present invention also provides a computer program comprising computer readable code, when the server runs the computer readable code, causing the method of the third aspect to be performed.

In an eighth aspect, the invention provides a computer readable medium, wherein the computer program according to the sixth aspect or the seventh aspect is stored.

Compared with the prior art, the solution provided by the present invention can trigger the wearable device to construct and display the interface interaction component, and the operation is simple; the wearable device can collect and transmit the sensor data of the sensor carried by itself. Ways to learn about the behavior of their users; Uploading the sensing data to the server, the server can parse the sensing data, analyze the behavior of the user, and formulate an attribute modification instruction for changing the interactive state of the interface interaction component, and the wearable device changes the interface interaction according to the attribute modification instruction. The interactive state of the component. The invention fully utilizes the sensor carried by the wearable device itself, utilizes the server to parse the sensor data and generate an interactive state that changes the interaction component of the interface. On the one hand, the server has a fast calculation speed and can obtain a more accurate judgment result; on the other hand, the server The user's dynamics of the wearable device can be grasped at any time, and the safety of the child and the elderly can be ensured when the user is a child or an elderly person. In addition, the present invention uses the sensor of the wearable device to know the behavior of the user, and the cloud makes an attribute modification instruction corresponding to the user behavior according to the sensing data. On the one hand, the sensor data can be used to obtain more accurate user behavior, This can determine a better attribute modification scheme; on the other hand, due to the fast computing speed of the server, the response speed of the interface interaction component is also accelerated, thereby improving the user experience. In addition, the invention also has the characteristics of good system robust performance, diversified operation modes, and simple operation methods.

These and other aspects of the invention will be more apparent from the following description of the embodiments.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings can also be obtained from those skilled in the art based on these drawings without paying any creative effort.

1 shows a system architecture diagram of a wearable device and a server in accordance with one embodiment of the present invention.

2 is a flow chart showing a method of controlling an interface interaction component according to an embodiment of the present invention.

3 shows a flow chart of a method for constructing and displaying an interface interaction component in accordance with one embodiment of the present invention.

4 is a block diagram of an interface interaction component control device in accordance with one embodiment of the present invention.

FIG. 5 shows a block diagram of an interface interaction component construction module in accordance with one embodiment of the present invention.

FIG. 6 shows a flow chart of a method for controlling an interface interaction component according to an embodiment of the present invention.

FIG. 7 illustrates a method for formulating an interactive state of an interface interaction component according to an embodiment of the present invention. Law flow chart.

Figure 8 shows a block diagram of an interface interaction component control device in accordance with one embodiment of the present invention.

Figure 9 shows a block diagram of a parsing module in accordance with one embodiment of the present invention.

Figure 10 shows a block diagram of a wearable device in accordance with one embodiment of the present invention.

Figure 11 shows a block diagram of a wearable device or server for performing the method according to the invention.

Figure 12 shows a schematic diagram of a memory unit for holding or carrying program code implementing a method in accordance with the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention.

In the flow of the description of the invention and the claims and the above-described figures, a plurality of operations in a particular order are included, but it should be clearly understood that these operations may not follow the order in which they appear in this document. Execution or parallel execution, the serial number of the operation such as 101, 102, etc., is only used to distinguish different operations, and the serial number itself does not represent any execution order. Additionally, these processes may include more or fewer operations, and these operations may be performed sequentially or in parallel. It should be noted that the descriptions of “first” and “second” in this document are used to distinguish different messages, devices, modules, etc., and do not represent the order, nor the “first” and “second”. It is a different type.

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The "attribute information" described in the present invention includes attribute parameters for configuring interface interaction component attributes, specifically, a component color parameter, a shape parameter, a size parameter, etc., but not only this, but also includes when to display and display How long does it take, whether it is repeated, etc. Based on the above description, it is believed that those skilled in the art can understand the "attribute information" of the present invention.

The "interface interaction component" in the present invention refers to a view component or a combination of a plurality of view components that can be visually displayed, such as a progress bar composed of a single view component, anthropomorphic robot composed of a plurality of view components, Electronic plants or electronic pets, etc., given that each view component has Its specific property configuration options, through the call of related functions, can complete the changes to the interface interactive component properties.

In the embodiment of the present invention, the system architecture controlled by the interface interaction component is as shown in FIG. 1 , and includes a server and a wearable device, such as an electronic product such as a smart watch, a smart bracelet, and smart glasses. Taking a wearable device as a smart watch as an example, after the server establishes a communication link with the smart watch, the smart watch sends the collected sensor data to the server by wireless transmission, and the server processes the sensor data and parses the data. The user's behavior is analyzed, and an attribute modification instruction for changing the interaction state of the interface interaction component is formulated based on the sensor data. It will be understood by those skilled in the art that the server can also send back the analyzed behavior of the user to the smart watch at any time, and display it on the human-machine interface on the smart watch; those skilled in the art can understand that In the invention, the smart watch end and the server cooperate with each other to complete the control of the interface interactive component, and the smart watch uploads the sensing data to the server for processing, and can utilize the powerful processing capability of the server to obtain a more accurate judgment result.

In a first aspect, the present invention provides an interface interaction component control method, which includes the following steps:

S101. Construct and display an interface interaction component according to the at least one attribute information. The attribute information includes attributes such as a shape, a color, and a size, and the shape, color, and size of the interface interaction component may be determined according to the attribute information. Preferably, the interface interaction component is a set of view components for displaying an electronic pet. In other embodiments, the interface interaction component is an electronic plant, a progress bar, a control, a puzzle, or the like. In one embodiment, the interface interaction component is a progress bar, and changing the proportion of darkness in a view component to the total component can display a progress bar state; and in another embodiment, the interface is The interactive component is an electronic pet, and the properties of multiple view components need to be changed to change the state of an electronic pet. In another embodiment, the interface interaction component can be constructed and displayed by triggering controls, while in other embodiments, the interface interaction component can be constructed and displayed by triggering buttons, voice prompts, and the like.

Specifically, the constructing and displaying the interface interaction component according to the at least one attribute information specifically includes the following steps:

S201: Acquire the attribute information; the local machine obtains the attribute information. In an embodiment, the attribute information is preset by a system, and in another embodiment, the attribute information is determined by a server. Obtained based on the data of the sensor. The attribute information is used in the table The interactive state of the interface interaction component. In addition, the attribute information also includes view component information that needs to be changed, so that the local calling related function changes the attribute of the component.

S202: Determine, according to the attribute information, a view component to be operated; the attribute information includes a view component name that needs to be changed, and a related attribute that needs to be changed, and the local device determines the view component that needs to be changed according to the attribute information.

S203, calling a corresponding interaction function to construct and display the view component. Take the Android system as an example. Since the view components described in Android are all inherited from the View class, calling the view class can change the view components. After displaying an image view component, you can set the zoom property of the displayed image by android:scaleType, where fitXY is used to scale the image horizontally and vertically, and fitStart is used to maintain the aspect ratio zoom. The image is fixed at the upper left corner of the interface. While displaying a progress bar, you can use ProgressBar, which is used to display the progress of a relatively time-consuming operation to the user. Commonly used attributes include the maximum value of the android:max setting progress bar, and the android:progress setting progress bar has been The progress of the completion.

Specifically, in one embodiment, the sensing data of the at least one sensor of the local device includes acquiring sound change data of the local audio sensor for characterizing the user as the sensing data. In this embodiment, the user's intention is identified by recognizing the sound. In this embodiment, when the user issues a voice, the audio sensor identifies the voice of the user, and extracts the feature information in the voice by uploading it to the server to analyze the behavior of the user, and correspondingly A modification instruction for modifying the interactive component of the interface is generated, thereby affirming or negating the behavior of the user according to the state of the interactive component of the interface.

In another embodiment, the sensing data of the at least one sensor of the local machine includes acquiring touch screen operation data of the local touch screen sensor for characterizing the user as the sensing data. In an embodiment of the present invention, when the user triggers a different control of the screen, the system sends the trigger operation of the user to the server to analyze the trigger operation of the user, and analyzes the user by uploading the server. The behavior, and correspondingly generating a modification instruction for modifying the interactive component of the interface, thereby affirming or negating the behavior of the user according to the state of the interactive component of the interface. In another embodiment, the sensing data of the at least one sensor of the local device includes acquiring attitude change data of the local attitude sensor for characterizing the user as the sensing data; Sensors include accelerometers, gyroscopes, and magnetometers Any number of items. Through the sensor, the user's action can be known, thereby obtaining more specific behavior of the user. The sensing data of the attitude sensor is used to represent the posture change data of the user. One embodiment of the present invention is that the accelerometer sensor is mounted on the glove of the user's hand, and when the finger is moved with each other, the accelerometer transmits When the sensed data changes, the acceleration value of the sensor changes, the local machine collects the sensor data, and uploads it to the server. The feedback data of the server is “the user is talking about the piano”; in another embodiment, the server The feedback data is a change to the state of the electronic pet generated in accordance with a correspondence preset to the behavior of playing the piano. In this embodiment, the state of the corresponding electronic pet is a beat following the finger motion; in other embodiments The status of the corresponding electronic pet also includes shaking his head, dancing, playing the piano, singing, and the like.

In one embodiment, it is also disclosed that the sensor is integrated on one chip, and the data of the chip can determine the behavior of the user; and in another embodiment, the different sensors are also worn for use. In this embodiment, an invisible image sensor is mounted on the button, an audio sensor is mounted on the collar, and an acceleration sensor is mounted on the shoe.

The sensor includes an accelerometer, a gyroscope, a magnetometer, and the like. An accelerometer for sensing an acceleration change value during movement of the user as the posture change data; and a gyroscope for sensing an angular rate change value during movement of the user as the posture change data; The meter is used to determine the absolute direction of the user during the movement as the posture change data.

S102: Collect sensing data of at least one sensor of the local device and upload the data to the server, so as to obtain an attribute modification instruction that is used by the server according to the sensing data to change an interaction state of the interface interaction component; The sensory data is uploaded to the server to determine the user's behavior. The server has a stronger processing level and faster processing speed. On the other hand, by launching different sensors to obtain different behaviors of the user, it is targeted and can improve transmission and determination. Speed, achieving immediate and effective technical results.

Specifically, the collecting the sensing data of the at least one sensor of the local device and uploading the data to the server specifically includes the following steps:

Collecting sensing data of at least one sensor of the local machine and uploading a server to extract behavior characteristics of the user in the sensing data to determine behavior of the user according to the behavior characteristic, The attribute modification instruction is formulated according to the matching relationship between the behavior and the preset task schedule. The server parses the sensor data, extracts behavioral characteristics in the sensor data, for example, extracts an acceleration value related to determining a running characteristic, and extracts a geomagnetic value for determining a traveling direction characteristic.

When determining the behavior of the user according to the behavioral characteristics, for example, by analyzing an accelerometer worn on the user's finger, the sleep state of the user can be determined. Specifically, when the value of the accelerometer does not change within a certain time range. When the user is sleeping, and the acceleration value measured vertically and downwardly by the three-axis accelerometer frequently changes, it is determined that the user is playing the piano, and the acceleration change direction measured by the accelerometer constantly changes. And the acquired data is periodic, indicating that the user is running or walking. Specifically, when the period is short, it is determined to be running, and when the period is long, it is determined to be walking.

Preferably, the task schedule is set by a user associated with the local machine, and the interface interaction component is used to characterize the execution progress of the task schedule. In one embodiment of the present invention, the user of the wearable device is a child, the user associated with the wearable device is a parent's mobile phone, and the parent sets a task schedule on the mobile phone and uploads to the server and the wearable device. The task schedule includes both the task to be executed and the task time period to be executed. When the user completes the task in the task schedule, the server generates an instruction to change the interface interaction component to change the interface interaction component. To characterize the execution progress of the task schedule, the method has more intuitive features, is easy for children to understand, and enhance user interest.

Specifically, in an embodiment, the changing the attribute information of the interface interaction component includes changing attribute information of the progress bar component to represent the execution progress of the task schedule according to the progress bar. Changing the progress bar has a more intuitive feature.

In another embodiment, the changing the attribute information of the interface interaction component further comprises changing the permissions of the plurality of subcomponents in the puzzle component to characterize the execution progress of the task schedule according to the opening of the permission. The user's interest is enhanced by the jigsaw that can attract the user, and the execution plan is felt while the user performs the task plan. The puzzle component includes a plurality of sub-components, for example, including 9 sub-components. When 9 sub-components are granted the permission to open, the interface displays an attractive effect. For example, in one embodiment, when 9 sub-components obtain the permission. When these nine sub-components automatically become jigsaw puzzles, and open the permissions of the game; in another embodiment, when the nine sub-components are open, the dynamic display will be beautifully moved. Painting, or an animated story.

In another embodiment, the changing the attribute information of the interface interaction component comprises changing a growth state of the electronic pet component to characterize an execution progress of the task schedule according to a growth state of the electronic pet. In this embodiment, the completion schedule of the task schedule corresponds to the state of the electronic pet. When the user completes the task in a schedule, the properties of the electronic pet change, for example, the originally small electronic pet puppy gradually Growing up, like an unpopulated electronic pet flower, opens a flower every time a user completes a task, but it is not limited to this form of expression, but can have more forms of expression, and those skilled in the art. Can understand. The invention provides a growing state of the electronic pet, which is beneficial to improving the fun of the child to execute the plan.

In an embodiment of the present invention, the interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the electronic pet is configured according to the attribute to map the local device. User behavior. In one embodiment of the present invention, an attribute of an electronic pet, such as its health value, sleep value, power value, knowledge value, and the like, is used to configure an electronic pet, and the user's behavior is mapped by data changes of these values.

Further, the sleep state of the user corresponds to the sleep value of the electronic pet; in an embodiment of the invention, the sleep value of the electronic pet corresponds to the sleep state of the user, and the sleep value is used for Reflects the user's sleep quality, the sleep value is 10 stars, when the user sleeps 6 hours, the sleep value is 7 stars, and when sleeping for 8 hours, the sleep value is 10 stars. The learning state of the user corresponds to the knowledge value of the electronic pet; the learning state of the user corresponds to the knowledge value of the electronic pet, for example, when the user learns for 3 hours, the electronic The knowledge value of the pet is 3, and the knowledge value of the electronic pet is 4 when the user continuously learns for 4 hours.

The motion state of the user corresponds to the power value of the electronic pet; in this embodiment, the motion state corresponds to Li Liangzhi of the electronic pet, for example, when the user insists on exercising for half an hour, the strength value is 3. When the user insists on exercising for 1 hour, the power value is 5.

The integrated state of the user corresponds to the growth value of the electronic pet. The growth value is a reflection of the integrated state of the user, and the integrated state is a cumulative state, a progressive state, etc., for example, in one embodiment, the user has a high sleep value on the first day and a sleep value on the second day. If the value is high, the growth value will increase accordingly; in another embodiment, when the user learns 3 days on the first day Hours, four hours of study the next day, the corresponding growth value increases.

S103. Change attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component. In this embodiment, the local device changes the attribute information of the interface interaction component according to the attribute modification instruction. For example, when the server generates an attribute modification instruction for the electronic pet power value, the local device changes the power value accordingly; for example, when the server generates the pair When the attribute modification instruction of the electronic pet singing expression is changed, the local device will call the corresponding function to change the component specified in the attribute modification instruction, and the change of the electronic pet expression is changed, and the expression form of the electronic pet is not limited thereto. In other embodiments, the electronic pet will gradually grow up, gain weight, grow taller, or gradually develop certain special talents such as dancing.

In a second aspect, the present invention also provides an interface interaction component control device having the function of implementing the behavior of the interface interaction component method in the above first aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. The interface interactive component control device includes the following modules:

The constructing module 101 is configured to construct and display an interface interaction component according to the at least one attribute information; and according to the attribute information, the shape, color, size, and the like of the interface interaction component can be determined. The attribute information includes attributes such as shape, color, and size, and the shape, color, size, and the like of the interface interaction component can be determined according to the attribute information. Preferably, the interface interaction component is a set of view components for displaying an electronic pet. In other embodiments, the interface interaction component is an electronic plant, a progress bar, a control, a puzzle, or the like. In one embodiment, the interface interaction component is a progress bar, and changing the proportion of darkness in a view component to the total component can display a progress bar state; and in another embodiment, the interface is The interactive component is an electronic pet, and the properties of multiple view components need to be changed to change the state of an electronic pet. In another embodiment, the interface interaction component can be constructed and displayed by triggering controls, while in other embodiments, the interface interaction component can be constructed and displayed by triggering buttons, voice prompts, and the like.

The sound change data for characterizing the user of the local audio sensor is collected as the sensing data. In this embodiment, the user's intention is identified by recognizing the sound. In this embodiment, when the user issues a voice, the audio sensor identifies the voice of the user, and extracts the feature information in the voice by uploading it to the server to analyze The user's behavior, and correspondingly generate and modify the modification instruction of the interface interaction component, thereby affirming or negating the user's behavior according to the state of the interface interaction component.

In another embodiment, the sensing data of the at least one sensor of the local machine includes acquiring touch screen operation data of the local touch screen sensor for characterizing the user as the sensing data. In an embodiment of the present invention, when the user triggers a different control of the screen, the system sends the trigger operation of the user to the server to analyze the trigger operation of the user, and analyzes the user by uploading the server. The behavior, and correspondingly generating a modification instruction for modifying the interactive component of the interface, thereby affirming or negating the behavior of the user according to the state of the interactive component of the interface.

In another embodiment, the sensing data of the at least one sensor of the local device includes acquiring attitude change data of the local attitude sensor for characterizing the user as the sensing data; The sensor includes any number of accelerometers, gyroscopes, and magnetometers. Through the sensor, the user's action can be known, thereby obtaining more specific behavior of the user. The sensing data of the attitude sensor is used to represent the posture change data of the user. One embodiment of the present invention is that the accelerometer sensor is mounted on the glove of the user's hand, and when the finger is moved with each other, the accelerometer transmits When the sensed data changes, the acceleration value of the sensor changes, the local machine collects the sensor data, and uploads it to the server. The feedback data of the server is “the user is talking about the piano”; in another embodiment, the server The feedback data is a change to the state of the electronic pet generated in accordance with a correspondence preset to the behavior of playing the piano. In this embodiment, the state of the corresponding electronic pet is a beat following the finger motion; in other embodiments The status of the corresponding electronic pet also includes shaking his head, dancing, playing the piano, singing, and the like.

The sensor includes an accelerometer, a gyroscope, a magnetometer, and the like. An accelerometer for sensing an acceleration change value during movement of the user as the posture change data; and a gyroscope for sensing an angular rate change value during movement of the user as the posture change number And a magnetometer for determining an absolute direction of the user during the movement as the posture change data.

Specifically, the construction module 101 specifically includes the following units:

The acquiring unit 201 is configured to acquire the attribute information, and the local device obtains the attribute information. In an embodiment, the attribute information is preset by a system, and in another embodiment, the attribute is The information is obtained by the server based on the data of the sensor. The attribute information is used to characterize the interaction state of the interface interaction component. In addition, the attribute information also includes view component information that needs to be changed, so that the local calling related function changes the attribute of the component.

The determining unit 202 is configured to determine, according to the attribute information, a view component to be operated; the attribute information includes a view component name that needs to be changed, and a related attribute that needs to be changed, and the local device can determine the view that needs to be changed according to the attribute information. Component.

The display unit 203 is configured to call a corresponding interaction function to construct and display the view component. Take the Android system as an example. Since the view components described in Android are all inherited from the View class, calling the view class can change the view components. After displaying an image view component, you can set the zoom property of the displayed image by android:scaleType, where fitXY is used to scale the image horizontally and vertically, and fitStart is used to maintain the aspect ratio zoom. The image is fixed at the upper left corner of the interface. While displaying a progress bar, you can use ProgressBar, which is used to display the progress of a relatively time-consuming operation to the user. Commonly used attributes include the maximum value of the android:max setting progress bar, and the android:progress setting progress bar has been The progress of the completion.

The collecting module 102 is configured to collect sensing data of the at least one sensor of the local device and upload the data to the server, to obtain an attribute modification instruction that is determined by the server according to the sensing data for changing an interaction state of the interface interaction component; Sensor data is uploaded to the server to determine the user's behavior, and the server has a higher processing level and faster processing speed. On the one hand, by uploading sensor data to the server to determine the user's behavior, the server has a stronger processing level and faster processing speed; on the other hand, by launching different sensors to obtain different behaviors of the user, targeted It can improve the transmission and judgment speed and achieve immediate and effective technical effects.

Further, in an embodiment, the collecting module is further configured to:

Collecting sensing data of at least one sensor of the local machine and uploading a server to extract behavior characteristics of the user in the sensing data to determine behavior of the user according to the behavior characteristic, The attribute modification instruction is formulated according to the matching relationship between the behavior and the preset task schedule. The server determines the behavior of the user through the sensor data of multiple sensors, and the determined result is more accurate. The server parses the sensor data, extracts behavioral characteristics in the sensor data, for example, extracts an acceleration value related to determining a running characteristic, and extracts a geomagnetic value for determining a traveling direction characteristic.

Preferably, the task schedule is set by a user associated with the local machine, and the interface interaction component is used to characterize the execution progress of the task schedule. The interface interaction component is used to characterize the execution progress of the task schedule, which is more intuitive and enhances user interest. In one embodiment of the present invention, the user of the wearable device is a child, the user associated with the wearable device is a parent's mobile phone, and the parent sets a task schedule on the mobile phone and uploads to the server and the wearable device. The task schedule includes both the task to be executed and the task time period to be executed. When the user completes the task in the task schedule, the server generates an instruction to change the interface interaction component to change the interface interaction component. To characterize the execution progress of the task schedule, the method has more intuitive features, is easy for children to understand, and enhance user interest.

In another embodiment, the changing the attribute information of the interface interaction component comprises changing the rights of the plurality of subcomponents in the puzzle component to characterize the execution progress of the task schedule according to the opening of the permission. The user's interest is enhanced by the jigsaw that can attract the user, and the execution plan is felt while the user performs the task plan. The puzzle component includes a plurality of sub-components, for example, including 9 sub-components. When 9 sub-components are granted the permission to open, the interface displays an attractive effect. For example, in one embodiment, when 9 sub-components obtain the permission. Time, These nine sub-components automatically become jigsaw puzzles and open the permissions of the game; in yet another embodiment, when the nine sub-components are open, they will dynamically display beautiful animations or an animated story. .

In another embodiment, the changing the attribute information of the interface interaction component comprises changing a growth state of the electronic pet component to characterize an execution progress of the task schedule according to a growth state of the electronic pet. The invention provides a growing state of the electronic pet, which is beneficial to improving the fun of the child to execute the plan. In this embodiment, the completion schedule of the task schedule corresponds to the state of the electronic pet. When the user completes the task in a schedule, the properties of the electronic pet change, for example, the originally small electronic pet puppy gradually Growing up, like an unpopulated electronic pet flower, opens a flower every time a user completes a task, but it is not limited to this form of expression, but can have more forms of expression, and those skilled in the art. Can understand. The invention provides a growing state of the electronic pet, which is beneficial to improving the fun of the child to execute the plan.

The integrated state of the user corresponds to the growth value of the electronic pet. Said growth The value reflects the integrated state of the user, and the integrated state is a cumulative state, a progressive state, etc., for example, in one embodiment, the user has a high sleep value on the first day and a high sleep value on the second day, and then grows. The value will increase accordingly; in another embodiment, when the user learns 3 hours on the first day and four hours on the next day, the corresponding growth value increases.

The update module 103 is configured to change attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component. In this embodiment, the local device changes the attribute information of the interface interaction component according to the attribute modification instruction. For example, when the server generates an attribute modification instruction for the electronic pet power value, the local device changes the power value accordingly; for example, when the server generates the pair When the attribute modification instruction of the electronic pet singing expression is changed, the local device will call the corresponding function to change the component specified in the attribute modification instruction, and the change of the electronic pet expression is changed, and the expression form of the electronic pet is not limited thereto. In other embodiments, the electronic pet will gradually grow up, gain weight, grow taller, or gradually develop certain special talents such as dancing.

Specifically, in one embodiment, the sensing data of at least one sensor of the local device is collected.

In an embodiment, the structure of the interface interaction component control device further includes a processor and a memory for storing a program supporting the transceiver device to execute the above method, the processor being configured to execute the memory Stored in the program. The interface interaction component control device may further include a communication interface for the interface interaction component control device to communicate with other devices or communication networks.

In a third aspect, the present invention provides an interface interaction component control method, which specifically includes the following steps:

S301. Receive sensing data of at least one sensor sent by the wearable device. In one embodiment, it is further disclosed that the sensor is integrated on one chip, and data of the chip can determine the behavior of the user; In another embodiment, it is also disclosed that different sensors are worn on different body parts of the user. In this embodiment, a contact image sensor is mounted on the button, an audio sensor is mounted on the collar, and the shoe is mounted on the shoe. Acceleration sensor.

Specifically, in one embodiment, the sensing data of the at least one sensor sent by the receiving wearable device includes receiving, according to the audio sensor sent by the wearable device, sound change data for characterizing the user, as the Sensing data. In this embodiment, the user's intention is identified by recognizing the sound, and the acquisition method is more direct. The wearable device collects sound change data of the audio sensor for characterizing the user as the sensor data. In this embodiment, when the user issues a voice, the audio sensor identifies the voice of the user, and extracts the feature information in the voice by uploading it to the server to analyze the behavior intention of the user.

In another embodiment, the receiving the sensing data of the at least one sensor sent by the wearable device comprises receiving the touch screen operation data of the touch screen sensor of the wearable device for characterizing the user as a Sensing data. The server receives touch screen operation data from the touch screen sensor of the wearable device as the sensing data. In an embodiment of the present invention, when the user triggers a different control of the screen, the wearable device sends the trigger operation of the user to the server to analyze the trigger operation of the user, and analyzes the use by the server. The behavior of the person, and generate a state control instruction for the pet according to the preset correspondence.

In another embodiment, the receiving the sensing data of the at least one sensor sent by the wearable device comprises receiving the posture change data of the posture sensor of the wearable device for characterizing the user, as a Sensing data; the attitude sensor includes any one of an accelerometer, a gyroscope, and a magnetometer. The attitude change data of the local attitude sensor for characterizing the user is acquired as the sensing data. The sensing data of the attitude sensor is used to represent the posture change data of the user. One embodiment of the present invention is that the accelerometer sensor is mounted on the glove of the user's hand, and when the finger is moved with each other, the accelerometer transmits The sensory data changes and the acceleration value of the sensor changes. The wearable device collects the sensor data and uploads it to the server. The feedback data of the server is “the user is talking about the piano”; in another embodiment The feedback data of the server is a change of the state of the electronic pet generated according to the correspondence relationship preset to the behavior of playing the piano. In this embodiment, the state of the corresponding electronic pet is a beat following the finger movement; In one embodiment, the status of the corresponding electronic pet It also includes shaking your head, dancing, playing the piano, singing, and more.

S302. Parse the sensing data, and formulate, according to the sensing data, an attribute modification instruction for changing an interaction state of an interface interaction component of the wearable device, to change the interface interaction component according to the property modification instruction. Attribute information to change the interactive state of the interactive components of the interface. Specifically, the attribute modification instruction for determining an interaction state of the interface interaction component of the wearable device according to the sensing data specifically includes the following steps:

S401: Extract behavior characteristics of the user in the sensing data; extracting, for example, a sound feature, a gesture feature, and the like in the sensor may determine a specific behavior of the user. The server analyzes the sensor data, extracts behavior characteristics in the sensor data, for example, extracts an acceleration value related to determining a running characteristic, and extracts a geomagnetic value for determining a traveling direction characteristic.

S402. Determine the behavior of the user according to the behavior characteristic. When determining the behavior of the user according to the behavior characteristic, for example, by analyzing an accelerometer worn on the user's finger, the sleep state of the user may be determined, specifically, When the value of the accelerometer does not change within a certain time range, it is considered that the user is sleeping, and when the acceleration value of the vertical downward direction measured by the three-axis accelerometer frequently changes, it is determined that the user is playing the piano, when The direction of acceleration change measured by the accelerometer keeps changing, and the acquired data is periodic, indicating that the user is running or walking. Specifically, when the period is short, it is determined to be running, and when the period is long, It is judged to be walking.

S403. The attribute modification instruction is formulated according to a matching relationship between the behavior and a preset task schedule.

Preferably, the task schedule is set by an associated user with the wearable device, and the interface interaction component is used to characterize the execution progress of the task schedule. When the user is a child, developing a workable task schedule can help build a better child development program. In one embodiment of the present invention, the user of the wearable device is a child, the user associated with the wearable device is a parent's mobile phone, and the parent sets a task schedule on the mobile phone and uploads to the server and the wearable device. The task schedule includes both the task to be executed and the task time period to be executed. When the user completes the task in the task schedule, the server generates an instruction to change the interface interaction component to change the interface interaction. The component is used to characterize the execution progress of the task schedule. This method has more intuitive features, which is easy for children to understand and enhance user interest.

Specifically, in an embodiment, the changing the attribute information of the interface interaction component includes changing attribute information of the progress bar component to represent the execution progress of the task schedule according to the progress bar. This embodiment uses a progress bar to have more intuitive features.

In another embodiment, the changing the attribute information of the interface interaction component comprises changing the rights of the plurality of subcomponents in the puzzle component to characterize the execution progress of the task schedule according to the opening of the permission. This embodiment enhances the user's interest by being able to attract the user's puzzle, and feels the fun of executing the plan while the user performs the mission plan. The puzzle component includes a plurality of sub-components, for example, including 9 sub-components. When 9 sub-components are granted the permission to open, the interface displays an attractive effect. For example, in one embodiment, when 9 sub-components obtain the permission. When these nine sub-components automatically become jigsaw puzzles, and the game permissions are open; in yet another embodiment, when the nine sub-components are open, they will dynamically display beautiful animations, even an episode of animation. story.

In another embodiment, the changing the attribute information of the interface interaction component comprises changing a growth state of the electronic pet component to characterize an execution progress of the task schedule according to a growth state of the electronic pet. The present invention provides a growth state of the electronic pet to characterize the progress of the child's execution plan, which is beneficial to improving the child's fun to execute the plan. In this embodiment, the completion schedule of the task schedule corresponds to the state of the electronic pet. When the user completes the task in a schedule, the properties of the electronic pet change, for example, the originally small electronic pet puppy gradually Growing up, like an unpopulated electronic pet flower, opens a flower every time a user completes a task, but it is not limited to this form of expression, but can have more forms of expression, and those skilled in the art. Can understand. The invention provides a growing state of the electronic pet, which is beneficial to improving the fun of the child to execute the plan.

In an embodiment of the present invention, the interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the electronic pet is configured according to the attribute to map the local device. User behavior. In one embodiment of the present invention, an attribute of an electronic pet, such as its health value, sleep value, power value, knowledge value, and the like, is used to configure an electronic pet to map the user's behavior by data changes of these values.

Further, the sleep state of the user corresponds to the sleep value of the electronic pet; in an embodiment of the invention, the sleep value of the electronic pet corresponds to the sleep state of the user, and the sleep value is used for Reflects the user's sleep quality, the maximum value of sleep is 10 stars, when used When sleeping for 6 hours, the sleep value is 7 stars, and when sleeping for 8 hours, the sleep value is 10 stars. The learning state of the user corresponds to the knowledge value of the electronic pet; the learning state of the user corresponds to the knowledge value of the electronic pet, for example, when the user learns for 3 hours, the electronic The knowledge value of the pet is 3, and the knowledge value of the electronic pet is 4 when the user continuously learns for 4 hours.

The integrated state of the user corresponds to the growth value of the electronic pet. The growth value is a reflection of the integrated state of the user, and the integrated state is a cumulative state, a progressive state, etc., for example, in one embodiment, the user has a high sleep value on the first day and a sleep value on the second day. If the value is high, the growth value will increase accordingly; in another embodiment, when the user learns for 3 hours on the first day and four hours on the next day, the corresponding growth value increases.

In a fourth aspect, the present invention further provides an interface interaction component control device having a function of implementing the behavior of the interface interaction component method in the above first aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. The interface interaction component specifically includes the following modules:

The receiving module 301 is configured to receive sensing data of at least one sensor sent by the wearable device;

Specifically, in one embodiment, the sensing data of the at least one sensor sent by the receiving wearable device includes receiving, according to the audio sensor sent by the wearable device, sound change data for characterizing the user, as the Sensing data. In this embodiment, the user's intention is identified by recognizing the sound, and the acquisition method is more direct. In this embodiment, the user's intention is identified by recognizing the sound, and the acquisition method is more direct. The wearable device collects sound change data of the audio sensor for characterizing the user as the sensor data. In this embodiment, when the user issues a voice, the audio sensor identifies the voice of the user, and extracts the feature information in the voice by uploading it to the server to analyze the behavior intention of the user.

In another embodiment, the receiving the sensing data of the at least one sensor sent by the wearable device comprises receiving the posture change data of the posture sensor of the wearable device for characterizing the user, as a Sensing data; the attitude sensor includes any one of an accelerometer, a gyroscope, and a magnetometer. The attitude change data of the local attitude sensor for characterizing the user is acquired as the sensing data. The sensing data of the attitude sensor is used to represent the posture change data of the user. One embodiment of the present invention is that the accelerometer sensor is mounted on the glove of the user's hand, and when the finger is moved with each other, the accelerometer transmits The sensory data changes and the acceleration value of the sensor changes. The wearable device collects the sensor data and uploads it to the server. The feedback data of the server is “the user is talking about the piano”; in another embodiment The feedback data of the server is a change of the state of the electronic pet generated according to the correspondence relationship preset to the behavior of playing the piano. In this embodiment, the state of the corresponding electronic pet is a beat following the finger movement; In one embodiment, the state of the corresponding electronic pet further includes shaking the head, dancing, playing the piano, singing, and the like.

The parsing module 302 is configured to parse the sensing data, and formulate, according to the sensing data, an attribute modification instruction for changing an interaction state of an interface interaction component of the wearable device, to change the instruction according to the attribute modification instruction. The attribute information of the interface interaction component is to change the interaction state of the interface interaction component.

Specifically, the parsing module includes the following units:

The extracting unit 401 is configured to extract a behavior characteristic of the user in the sensing data; extracting a sensor, such as a sound feature, a gesture feature, and the like, may determine a specific behavior of the user. The server analyzes the sensor data, extracts behavior characteristics in the sensor data, for example, extracts an acceleration value related to determining a running characteristic, and extracts a geomagnetic value for determining a traveling direction characteristic.

The determining unit 402 is configured to determine the behavior of the user according to the behavior characteristic; when determining the behavior of the user according to the behavior characteristic, for example, by analyzing an accelerometer worn on the user's finger, the sleep state of the user can be determined. Specifically, when the value of the accelerometer does not change within a certain time range, it is considered that the user is sleeping, and when the acceleration value of the vertical downward direction measured by the three-axis accelerometer frequently changes, it is determined that the user is Playing the piano, when the acceleration change direction measured by the accelerometer changes continuously, and the acquired data is periodic, it means that the user is running or walking, specifically, when the period is short, it is determined to be running. When the period is long, it is judged to be walking.

The formulating unit 403 is configured to formulate the attribute modification instruction according to the matching relationship between the behavior and the preset task schedule. In one embodiment of the present invention, the user of the wearable device is a child, the user associated with the wearable device is a parent's mobile phone, and the parent sets a task schedule on the mobile phone and uploads to the server and the wearable device. The task schedule includes both the task to be executed and the task time period to be executed. When the user completes the task in the task schedule, the server generates an instruction to change the interface interaction component to change the interface interaction. The component is used to characterize the execution progress of the task schedule. This method has more intuitive features, which is easy for children to understand and enhance user interest.

Preferably, the task schedule is set by an associated user with the wearable device, and the interface interaction component is used to characterize the execution progress of the task schedule. When the user is a child, developing a workable task schedule can help build a better child development program. In one embodiment of the present invention, the user of the wearable device is a child, and the user associated with the wearable device is a parent's mobile phone, and the parent sets a task schedule on the mobile phone and uploads to the server and the wearable device. The task schedule includes both the task to be executed and the task time period to be executed. When the user completes the task in the task schedule, the server generates an instruction to change the interface interaction component to change the interface interaction. The component is used to characterize the execution progress of the task schedule. This method has more intuitive features, which is easy for children to understand and enhance user interest.

In another embodiment, the changing attribute information of the interface interaction component includes The permissions of the plurality of subcomponents in the jigsaw component are changed to characterize the execution progress of the task schedule according to the openness of the permissions. This embodiment enhances the user's interest by being able to attract the user's puzzle, and feels the fun of executing the plan while the user performs the mission plan. The puzzle component includes a plurality of sub-components, for example, including 9 sub-components. When 9 sub-components are granted the permission to open, the interface displays an attractive effect. For example, in one embodiment, when 9 sub-components obtain the permission. When these nine sub-components automatically become jigsaw puzzles, and the game permissions are open; in another embodiment, when the nine sub-components are open, a dynamic display will be displayed from the server. Animated control commands, even an animated story.

In another embodiment, the changing the attribute information of the interface interaction component comprises changing a growth state of the electronic pet component to characterize an execution progress of the task schedule according to a growth state of the electronic pet. The invention provides that the growth state of the electronic pet reflects that the progress of the child's execution plan is beneficial to improving the child's fun to execute the plan. In this embodiment, the completion schedule of the task schedule corresponds to the state of the electronic pet. When the user completes the task in a schedule, the properties of the electronic pet change, for example, the originally small electronic pet puppy gradually Growing up, like an unpopulated electronic pet flower, opens a flower every time a user completes a task, but it is not limited to this form of expression, but can have more forms of expression, and those skilled in the art. Can understand.

In an embodiment of the present invention, the interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the electronic pet is configured according to the attribute to map the local device. User behavior. In an embodiment of the present invention, an attribute of an electronic pet, such as its health value, sleep value, power value, knowledge value, and the like, is used to configure an electronic pet, and the user's behavior is mapped by data changes of these values. Achieve the effect on the user's motivation while increasing interest in pet culture while improving itself.

Further, the sleep state of the user corresponds to the sleep value of the electronic pet; in an embodiment of the invention, the sleep value of the electronic pet corresponds to the sleep state of the user, and the sleep value is used for Reflects the user's sleep quality, the sleep value is 10 stars, when the user sleeps 6 hours, the sleep value is 7 stars, and when sleeping for 8 hours, the sleep value is 10 stars. The learning state of the user corresponds to the knowledge value of the electronic pet; the learning state of the user corresponds to the knowledge value of the electronic pet, for example, when the user learns 3 small At the same time, the electronic pet has a knowledge value of 3, and when the user continuously learns for 4 hours, the electronic pet has a knowledge value of 4.

The motion state of the user corresponds to the strength value of the electronic pet; in the embodiment, the motion state corresponds to the power value of the electronic pet, for example, when the user insists on exercising the strength value for half an hour. For 3, when the user insists on exercising for 1 hour, the power value is 5.

The embodiment of the present invention further provides a wearable device. As shown in FIG. 10, for the convenience of description, only parts related to the embodiment of the present invention are shown. If the specific technical details are not disclosed, please refer to the method part of the embodiment of the present invention. The wearable device can be any device such as a smart watch, a smart wristband, or smart glasses. It can be understood by those skilled in the art that the wearable device can also be in the form of other smart devices as long as it has a human-machine display interface and the like. The corresponding hardware facilities can be used, for example, the terminal is a smart watch:

FIG. 10 is a block diagram showing a partial structure of a smart watch related to a terminal provided by an embodiment of the present invention. Referring to FIG. 10, the smart watch includes: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, and a processor. 1080, and power supply 1090 and other components. Those skilled in the art will appreciate that the smart watch structure illustrated in FIG. 10 does not constitute a limitation to a smart watch, may include more or fewer components than illustrated, or combine some components, or different component arrangements.

The specific components of the smart watch will be specifically described below with reference to FIG. 10:

The RF circuit 1010 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 1080. In addition, the uplink data is designed to be sent to the base station. Generally, RF circuit 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuit 1010 can also communicate with the network and other devices via wireless communication. The above wireless communication may use any communication standard or protocol, including but not limited to the Global System of Mobile (Global System of Mobile communication, GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (WCDMA) Long Term Evolution (LTE), e-mail, Short Messaging Service (SMS), etc.

The memory 1020 can be used to store software programs and modules, and the processor 1080 executes various functional applications and data processing of the smart watch by running software programs and modules stored in the memory 1020. The memory 1020 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of smart watches (such as audio data, phone books, etc.). Moreover, memory 1020 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1030 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the smart watch. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 1031 or near the touch panel 1031. Operation), and drive the corresponding connecting device according to a preset program. Optionally, the touch panel 1031 may include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 1080 is provided and can receive commands from the processor 1080 and execute them. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1031, the input unit 1030 may also include other input devices 1032. Specifically, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

The display unit 1040 can be used to display information input by the user or information provided to the user as well as various menus of the smart watch. The display unit 1040 may include a display panel 1041. Alternatively, the display panel 1041 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch surface The board 1031 may cover the display panel 1041, and when the touch panel 1031 detects a touch operation thereon or nearby, it is transmitted to the processor 1080 to determine the type of the touch event, and then the processor 1080 is on the display panel 1041 according to the type of the touch event. Provide corresponding visual output on it. Although in FIG. 10, the touch panel 1031 and the display panel 1041 are two independent components to implement the input and input functions of the smart watch, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated. The input and output functions of the smart watch are realized.

The smart watch may also include at least one type of sensor 1050, such as a light sensor, an audio sensor, an accelerometer, a gyroscope, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1041 when the smart watch moves to the ear / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the posture of smart watches (such as horizontal and vertical screen switching, Related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for smart watches, gyro, barometer, hygrometer, thermometer, infrared sensor and other sensors can be configured. No longer.

An audio circuit 1060, a speaker 1061, and a microphone 1062 can provide an audio interface between the user and the smart watch. The audio circuit 1060 can transmit the converted electrical data of the received audio data to the speaker 1061, and convert it into a sound signal output by the speaker 1061; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, by the audio circuit 1060. After receiving, it is converted into audio data, and then processed by the audio data output processor 1080, sent to the mobile phone 1010 via the RF circuit 1010, or outputted to the memory 1020 for further processing.

WiFi is a short-range wireless transmission technology. The smart watch can help users to send and receive emails, browse web pages and access streaming media through the WiFi module 1070. It provides users with wireless broadband Internet access. Although FIG. 10 shows the WiFi module 1070, it can be understood that it does not belong to the essential configuration of the smart watch, and can be omitted as needed within the scope of not changing the essence of the invention.

The processor 1080 is a control center for a smart watch that connects various portions of the entire smart watch with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1020, and recalling data stored in the memory 1020. The smart watch is fully monitored by performing various functions and processing data of the smart watch. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, where The processor mainly processes the operating system, user interface, application, etc., and the modem processor mainly handles wireless communication. It will be appreciated that the above described modem processor may also not be integrated into the processor 1080.

The smart watch also includes a power source 1090 (such as a battery) that supplies power to various components. Preferably, the power source can be logically coupled to the processor 1080 through a power management system to manage functions such as charging, discharging, and power management through the power management system.

Although not shown, the smart watch may further include a camera, a Bluetooth module, etc., and will not be described herein.

In the embodiment of the present invention, the processor 1080 included in the terminal further has the following functions:

Constructing and displaying an interface interaction component according to at least one attribute information;

Collecting sensing data of at least one sensor of the local machine and uploading the data to the server to obtain an attribute modification instruction that is determined by the server according to the sensing data for changing an interaction state of the interface interaction component;

And changing attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component.

Figure 11 illustrates a wearable device or server (collectively referred to as a wearable device and server as a device) that can implement interface interaction component control in accordance with the present invention. The device conventionally includes a processor 1010 and a computer program product or computer readable medium in the form of a memory 1020. The memory 1020 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. The memory 1020 has a memory space 1030 for executing program code 1031 of any of the above method steps. For example, storage space 1030 for program code may include various program code 1031 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have a storage section or a storage space or the like arranged similarly to the storage 1020 in FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit comprises program code 1031' for performing the steps of the method according to the invention, ie code that can be read by, for example, a processor such as 1010, which when executed by the device causes the device to perform the above Each step in the described method.

It will be apparent to those skilled in the art that the above description is convenient and concise for the description. For the specific working process of the system, the device and the unit, reference may be made to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Read Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be performed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, the above mentioned storage. The medium can be a read only memory, a magnetic disk or an optical disk or the like.

The above describes a wearable device provided by the present invention. For those skilled in the art, according to the idea of the embodiment of the present invention, there are changes in the specific implementation manner and application scope. The description is not to be construed as limiting the invention.

Claims

An interface interaction component control method includes the following steps:

Constructing and displaying an interface interaction component according to at least one attribute information;

Collecting sensing data of at least one sensor of the local machine and uploading the data to the server to obtain an attribute modification instruction that is determined by the server according to the sensing data for changing an interaction state of the interface interaction component;

And changing attribute information of the interface interaction component according to the attribute modification instruction to change an interaction state of the interface interaction component.
The control method according to claim 1, wherein the constructing and displaying the interface interaction component according to the at least one attribute information comprises the following steps:

Obtaining the attribute information;

Determining a view component to be operated according to the attribute information;

Call the appropriate interaction function to construct and display the view component.
The control method according to claim 1, wherein the collecting the sensing data of the at least one sensor of the local machine and uploading the data to the server comprises the following steps:

Collecting sensing data of at least one sensor of the local machine and uploading a server to extract behavior characteristics of the user in the sensing data, to determine behavior of the user according to the behavior characteristic, according to the behavior and the preset task plan The matching relationship of the table formulates the attribute modification instruction.
The control method according to claim 3, wherein the task schedule is set by a user associated with the local machine, and the interface interaction component is used to characterize execution progress of the task schedule.
The control method according to claim 4, wherein said changing attribute information of said interface interaction component comprises changing attribute information of said progress bar component to characterize execution progress of said task schedule table according to said progress bar.
The control method according to claim 4, wherein said changing attribute information of said interface interaction component comprises changing permissions of a plurality of subcomponents in the puzzle component to characterize execution of said task schedule table according to openness of authority schedule.
The control method according to claim 4, wherein said changing the attribute information of said interface interaction component comprises changing a growth state of the electronic pet component to be based on the electronic pet The growth state of the object characterizes the execution progress of the task schedule.
The control method according to claim 1, wherein the interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the configuration is configured according to the attribute. Electronic pets to map the behavior of local users.
The control method according to claim 8, wherein:

The sleep state of the user corresponds to a sleep value of the electronic pet;

The learning state of the user corresponds to the knowledge value of the electronic pet;

The motion state of the user corresponds to a power value of the electronic pet;

The integrated state of the user corresponds to the growth value of the electronic pet.
The control method according to claim 1, wherein the sensing data of the at least one sensor of the local machine comprises collecting sound change data of the local audio sensor for characterizing the user as the sensing. data.
The control method according to claim 1, wherein the sensing data of the at least one sensor of the local machine comprises: collecting touch panel operation data of the local touch panel sensor for characterizing the user, as Sensing data.
The control method according to claim 1, wherein the sensing data of the at least one sensor of the local machine comprises acquiring attitude change data of the local attitude sensor for characterizing the user, as Sensing data; the attitude sensor includes any one of an accelerometer, a gyroscope, and a magnetometer.
An interface interaction component control device includes:

At least one processor;

And at least one memory communicatively coupled to the at least one processor; the at least one memory comprising processor-executable instructions when the processor-executable instructions are executed by the at least one processor Causing the device to perform at least the following operations:

Constructing and displaying an interface interaction component according to at least one attribute information;

Collecting sensing data of at least one sensor of the local machine and uploading the data to the server to obtain an attribute modification instruction that is determined by the server according to the sensing data for changing an interaction state of the interface interaction component;

Changing the attribute information of the interface interaction component according to the attribute modification instruction to change the location The interactive state of the interface interaction component.
The control device according to claim 13, wherein the operation of constructing and displaying the interface interaction component according to the at least one attribute information comprises:

Obtaining the attribute information;

Determining a view component to be operated according to the attribute information;

Call the appropriate interaction function to construct and display the view component.
The control device according to claim 13, wherein the operation of collecting the sensing data of the at least one sensor of the local device and uploading the data to the server comprises:

Collecting sensing data of at least one sensor of the local machine and uploading a server to extract behavior characteristics of the user in the sensing data, to determine behavior of the user according to the behavior characteristic, according to the behavior and the preset task plan The matching relationship of the table formulates the attribute modification instruction.
The control apparatus according to claim 15, wherein said task schedule is set by a user associated with the local machine, and said interface interaction component is configured to characterize execution progress of said task schedule.
The control apparatus according to claim 16, wherein said changing attribute information of said interface interaction component comprises changing attribute information of said progress bar component to characterize execution progress of said task schedule table according to said progress bar.
The control device according to claim 16, wherein said changing attribute information of said interface interaction component comprises changing permissions of a plurality of subcomponents in the puzzle component to characterize execution of said task schedule table according to openness of authority schedule.
The control device according to claim 16, wherein said changing attribute information of said interface interaction component comprises changing a growth state of said electronic pet component to characterize execution of said task schedule according to a growth state of said electronic pet schedule.
The control device according to claim 13, wherein the interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the configuration is configured according to the attribute. Electronic pets to map the behavior of local users.
The control device according to claim 20, wherein:

The sleep state of the user corresponds to a sleep value of the electronic pet;

The learning state of the user corresponds to the knowledge value of the electronic pet;

The motion state of the user corresponds to a power value of the electronic pet;

The integrated state of the user corresponds to the growth value of the electronic pet.
The control device according to claim 13, wherein the sensing data of the at least one sensor of the local machine comprises collecting sound change data of the local audio sensor for characterizing the user as the sensing data.
The control device according to claim 13, wherein said sensing data of said at least one sensor of said local device comprises: capturing touch panel operation data of said local touch panel sensor for characterizing said user as said Sensing data.
The control device according to claim 13, wherein said sensing data of said at least one sensor of said local machine comprises: collecting attitude change data of said local attitude sensor for characterizing said user, as said Sensing data; the attitude sensor includes any one of an accelerometer, a gyroscope, and a magnetometer.
An interface interaction component control method includes the following steps:

Receiving sensing data of at least one sensor sent by the wearable device;

Parsing the sensing data, and formulating, according to the sensing data, an attribute modification instruction for changing an interaction state of an interface interaction component of the wearable device, to change attribute information of the interface interaction component according to the attribute modification instruction To change the interactive state of the interactive components of the interface.
The control method according to claim 25, wherein the attribute modification instruction for changing an interaction state of the interface interaction component of the wearable device according to the sensing data comprises the following steps:

Extracting behavior characteristics of the user in the sensor data;

Determining the behavior of the user based on the behavioral characteristics;

The attribute modification instruction is formulated according to the matching relationship between the behavior and the preset task schedule.
The control method according to claim 26, wherein said task schedule is set by an associated user with said wearable device, said interface interaction component for characterizing execution progress of said task schedule .
The control method according to claim 27, wherein said changing attribute information of said interface interaction component comprises changing attribute information of said progress bar component to characterize execution progress of said task schedule table according to said progress bar.
The control method according to claim 27, wherein said changing attribute information of said interface interaction component comprises changing permissions of a plurality of subcomponents in the puzzle component to characterize execution of said task schedule table according to openness of authority schedule.
The control method according to claim 27, wherein said changing attribute information of said interface interaction component comprises changing a growth state of said electronic pet component to characterize execution of said task schedule according to a growth state of said electronic pet schedule.
The control method according to claim 25, wherein the interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the configuration is configured according to the attribute. Electronic pets to map the behavior of local users.
The control method according to claim 31, wherein:

The sleep state of the user corresponds to a sleep value of the electronic pet;

The learning state of the user corresponds to the knowledge value of the electronic pet;

The motion state of the user corresponds to a power value of the electronic pet;

The integrated state of the user corresponds to the growth value of the electronic pet.
The control method according to claim 25, wherein the sensing data of the at least one sensor transmitted by the receiving wearable device comprises receiving the sound change data of the audio sensor sent by the wearable device for characterizing the user. As the sensor data.
The control method according to claim 25, wherein said sensing data of said at least one sensor transmitted by said receiving wearable device comprises receiving a touch screen sensor of said wearable device for characterizing a user's touch The screen operates on the data as the sensing data.
The control method according to claim 25, wherein said sensing data of said at least one sensor transmitted by said receiving wearable device comprises receiving said posture sensor of said wearable device for characterizing said user The attitude change data is used as the sensing data; the attitude sensor includes any one of an accelerometer, a gyroscope, and a magnetometer.
An interface interaction component control device includes:

At least one processor;

And at least one memory communicatively coupled to the at least one processor; the at least one memory comprising processor-executable instructions when the processor-executable instructions are executed by the at least one processor Causing the device to perform at least the following operations:

Receiving sensing data of at least one sensor sent by the wearable device;

Parsing the sensing data, and formulating, according to the sensing data, an attribute modification instruction for changing an interaction state of an interface interaction component of the wearable device, to change attribute information of the interface interaction component according to the attribute modification instruction To change the interactive state of the interactive components of the interface.
The control device according to claim 36, wherein the operation of the attribute modification instruction for changing the interaction state of the interface interaction component of the wearable device according to the sensing data comprises:

Extracting behavior characteristics of the user in the sensor data;

Determining the behavior of the user based on the behavioral characteristics;

The attribute modification instruction is formulated according to the matching relationship between the behavior and the preset task schedule.
The control device according to claim 37, wherein said task schedule is set by an associated user with said wearable device, said interface interaction component for characterizing execution progress of said task schedule .
The control apparatus according to claim 38, wherein said changing attribute information of said interface interaction component comprises changing attribute information of said progress bar component to characterize execution progress of said task schedule table according to said progress bar.
The control device according to claim 38, wherein said changing attribute information of said interface interaction component comprises changing permissions of a plurality of subcomponents in the puzzle component to characterize execution of said task schedule table according to openness of rights schedule.
The control device according to claim 38, wherein:

The changing the attribute information of the interface interaction component includes changing a growth state of the electronic pet component to characterize an execution progress of the task schedule according to a growth state of the electronic pet.
The control device according to claim 36, wherein:

The interface interaction component is an electronic pet, and the attributes of the electronic pet include a sleep value, a knowledge value, a power value, and a growth value, and the electronic pet is configured according to the attribute to map the behavior of the local user.
The control device according to claim 42, wherein:

The sleep state of the user corresponds to a sleep value of the electronic pet;

The learning state of the user corresponds to the knowledge value of the electronic pet;

The motion state of the user corresponds to a power value of the electronic pet;

The integrated state of the user corresponds to the growth value of the electronic pet.
The control device according to claim 36, wherein said sensing data of said at least one sensor transmitted by said receiving wearable device comprises receiving sound change data of said audio sensor sent by said wearable device for characterizing a user As the sensor data.
The control device according to claim 36, wherein said sensing data of said at least one sensor transmitted by said receiving device comprises receiving a touch screen sensor of said wearable device for characterizing a user's touch The screen operates on the data as the sensing data.
The control device according to claim 36, wherein said sensing data of said at least one sensor transmitted by said receiving wearable device comprises receiving said posture sensor of said wearable device for characterizing said user The attitude change data is used as the sensing data; the attitude sensor includes any one of an accelerometer, a gyroscope, and a magnetometer.
A wearable device comprising:

a touch sensitive display for sensing an operation instruction and displaying a corresponding interface according to the instruction;

a memory for storing a program supporting the transceiver device to execute the interface interactive component control device;

One or more processors for executing a program stored in the memory;

a communication interface for communicating with the other device or communication network by the interface interaction component control device;

One or more applications, the one or more programs being configured to perform the functions of implementing the interface interaction component control device of any of the preceding claims 13-24.
A computer program comprising computer readable code, when the wearable device runs the computer readable code, causing the method of any of claims 1-12 to be performed.
A computer program comprising computer readable code, when the server runs the computer readable code, causing the method of any one of claims 25-35 to be performed.
A computer readable medium storing the computer program of claim 48 or 49.