TWI678094B - Portable electronic device and communication interface dispalying method - Google Patents

Abstract

A portable electronic device establishes a call connection with other electronic devices. The portable electronic device displays a call interface. The portable electronic device includes a voice recognition module and a motion sensor. The voice recognition module The group detects keywords in a call, the motion sensor detects a motion trajectory of the portable electronic device, and when the motion sensor detects a motion trajectory of the portable electronic device conforms to a preset Motion track, the speech recognition module analyzes the semantic attributes of the keywords, and displays the smart scene interface corresponding to the semantic attributes in the call interface. A call interface display method of a portable electronic device is also provided.

Description

Portable electronic device and call interface display method

The present invention relates to a portable electronic device, and in particular, to a portable electronic device that intelligently displays a call interface and a method for displaying a call interface.

The portable electronic device displays a call interface during a call. Generally, the call interface includes fixed function icons, such as a mute icon, a dial pad icon, a hands-free icon, a call icon, a pause icon, and an address book. Icon, etc. However, these function icons are fixed. When users need to use other applications during a call, they need to exit the current call interface and jump to the desktop to start other applications, which brings inconvenience to the user.

In view of this, it is necessary to provide a portable electronic device that intelligently displays a call interface and a method for displaying the call interface.

A portable electronic device establishes a call connection with other electronic devices. The portable electronic device displays a call interface. The portable electronic device includes a voice recognition module and a motion sensor. The voice recognition module The group detects keywords in a call, the motion sensor detects a motion trajectory of the portable electronic device, and when the motion sensor detects a motion trajectory of the portable electronic device conforms to a preset Motion track, the speech recognition module analyzes the semantic attributes of the keywords, and displays the smart scene interface corresponding to the semantic attributes in the call interface.

A method for displaying a call interface of a portable electronic device includes: Establish a call connection with other electronic devices; display a call interface; detect keywords during a call; detect the motion trajectory of the portable electronic device; when it is determined that the motion trajectory of the portable electronic device conforms to a preset motion During the trajectory, the semantic attributes of the keywords are analyzed; and the smart scene interface corresponding to the semantic attributes is displayed in the call interface.

The portable electronic device of the present invention detects a keyword in a call state and analyzes the semantic attributes of the keyword. When it is detected that the movement trajectory of the portable electronic device conforms to a preset movement trajectory, it is based on the keyword's The semantic attribute switches the smart scene interface in the call interface, and displays related information of the keyword through the smart scene interface. Therefore, the call interface is flexible, intelligently detects the information that the user needs to refer to during the semantic judgment of the call, and directly displays this information for the user to view, improving the intelligence, diversity and efficiency of the call interface. , While bringing a better user experience.

100‧‧‧ Portable electronic device

10‧‧‧Memory

102‧‧‧Call Module

104‧‧‧Speech recognition module

20‧‧‧ Display

30‧‧‧ Motion Sensor

40‧‧‧ processor

21‧‧‧Call interface

212‧‧‧Current call information

214‧‧‧Additional ribbon

216‧‧‧End call icon

218‧‧‧Smart Scene Interface

2182‧‧‧Recording icon

2184‧‧‧Stop recording icon

2186‧‧‧Recording Strip

FIG. 1 is a functional module diagram of a portable electronic device according to a preferred embodiment of the present invention.

2 is a flowchart of a method for displaying a call interface of a portable electronic device according to a preferred embodiment of the present invention.

FIG. 3 is a schematic diagram of a call interface according to the first embodiment of the present invention.

4A-4C are schematic diagrams of a call interface according to a second embodiment of the present invention.

5A-5B are schematic diagrams of a call interface according to a third embodiment of the present invention.

FIG. 6 is a schematic diagram of a call interface according to a fourth embodiment of the present invention.

Please refer to FIG. 1, a preferred embodiment of the present invention provides a portable electronic device 100. The portable electronic device 100 may be a mobile phone, a tablet computer, or the like.

The portable electronic device 100 includes a memory 10, a display 20, a motion sensor 30 and a processor 40. The memory 10 stores a call module 102 and a voice recognition module 104. The call module 102 and the voice recognition module 104 are composed of instruction codes and data, and are executed by the processor 40.

The display 20 displays a user interface, and the user interface is a call interface, a desktop, or an application program interface. The call interface, desktop and application program interfaces are different interfaces, wherein the call interface is an interface displayed when the portable electronic device 100 is in a call state; the desktop is the portable electronic device 100 The operating system of is in a normal use state for displaying an application icon for a user to select and launch an application interface; the application interface is an interface displayed after the application is launched. In this embodiment, the display 20 is a touch display.

The call module 102 is configured to provide the call connection and provide the call interface to the display 20 for display. The voice recognition module 104 is used to detect keywords during a call. In this embodiment, the keywords may be, but are not limited to, names of contacts in a contact list, place names, special keywords, and the like.

The memory 10 is used for storing data. In this embodiment, the memory 10 stores an address book, a keyword database, and the like. The address book includes the names of the contacts and related information. The keyword database includes contact names, place names, special keywords, and the like. The special keywords may be, but are not limited to, "record", "write", "news", and brand name.

The motion sensor 30 is configured to detect a motion track of the portable electronic device 100. In this embodiment, the motion sensor 30 may be a gravity sensor, an acceleration sensor, A gyroscope sensor, an electronic compass, or a combination of the plurality of sensors is used to detect the movement and / or rotation of the portable electronic device 100 to detect its movement track. In this embodiment, the memory 10 stores a preset motion trajectory of the portable electronic device 100, and the preset motion trajectory is that the portable electronic device 100 moves from the user's ear to The trajectory in front of the user's eyes. It can be understood that the preset motion trajectory may include a preset movement and / or a preset flip, which are respectively detected by corresponding sensors.

Referring to FIG. 2, a method for displaying a call interface of a portable electronic device 100 according to a preferred embodiment of the present invention includes the following steps:

In step 01, the call module 102 establishes a call connection with other electronic devices, and provides a call interface 21 (see FIG. 3) to the display 20 for display. In this embodiment, the call interface 21 includes current call information 212, an additional function area 214, and an end call icon 216. The current call information 212 includes a caller name, a caller picture, and a call duration. The additional function area 214 includes a plurality of additional function icons, and each additional function icon is used to trigger a corresponding function. The multiple additional function icons include, but are not limited to, mute, keyboard, hands-free, add call, pause, and record. The call end icon 216 is used to end the current call. The additional function icon and the call end icon 216 receive touch operations through the display 20 to trigger corresponding functions.

In step 02, the voice recognition module 104 detects keywords during a call, and the processor 40 determines whether a keyword database exists in the identified keywords. In this embodiment, the memory 10 stores an address book, a keyword database, and the like. The speech recognition module 104 detects keywords in a call, such as contact names, place names, and special keywords. The processor 40 compares the detected keywords with the keyword database, and determines whether the detected keywords exist in the keyword database. If it is determined that the detected keyword exists in the keyword database, then this keyword is called a matching keyword, and step 03 is performed; if it is determined that the detected keyword does not exist, If it is in the keyword database, then return to continue to perform this step.

In step 03, the processor 40 stores the determined matching keywords in a temporary storage area of the memory 10. In this embodiment, the memory 10 includes a temporary storage area for storing matching keywords detected and determined to exist in the keyword database.

In step 04, the motion sensor 30 detects the motion trajectory of the portable electronic device 100, and the processor 40 determines whether the detected motion trajectory conforms to a preset motion trajectory. The motion sensor 30 may be a gravity sensor, an acceleration sensor, a gyroscope sensor, an electronic compass, or a combination of the plurality of sensors for detecting the portable electronic device 100 Move and / or rotate to detect its trajectory. The preset motion trajectory is a trajectory of the portable electronic device 100 moving from the user's ear to the front of the user's eye during a call. The preset motion trajectory may include a preset movement and / or a preset flip. The motion sensor 30 detects whether the portable electronic device 100 moves from the user's ear to the front of the user's eye, and the processor 40 determines whether the detected motion track conforms to a preset motion track. When it is determined that the detected motion trajectory conforms to the preset motion trajectory, step 05 is performed; when it is determined that the detected trajectory does not conform to the preset motion trajectory, step 07 is performed.

In step 05, the speech recognition module 104 analyzes the semantic attributes of the most recent matching keyword in the temporary storage area. The temporary storage area is stored in the chronological order of the matching keywords determined by the processor 40, and the latest matching keyword is the most recent matching keyword in time. The processor 40 determines the semantic attribute of the matching keyword. For example, when the matching keyword is the name of a contact person, it is classified as a contact person attribute, and the corresponding function is to display the information of the contact person and / or The latest release on the social platform of the contact; when the matching keyword is a place name, restaurant name, company name, etc., it is classified as a place attribute, and the corresponding function is to display a map search and / or search the web Location information; when the matching keyword is "record" or "write", it is classified as a record attribute, and the corresponding function is to display a note-taking application or a recording application. Using a program; when the matching keyword is a brand name, it is classified as a brand attribute, and the corresponding function is to display information about searching the brand online.

In step 06, the processor 40 switches the additional function area 214 of the call interface 21 to a smart scene interface 218 (see FIG. 4) that displays a function corresponding to the semantic attribute of the matching keyword. It can be understood that in the call interface 21, only the additional function area 214 is switched to display the smart scene interface 218, and the current call information 212 and the call end icon 216 remain unchanged, and the smart scene is swiped by the user The interface 218 can be switched to the original additional function area 214.

Referring to FIG. 4A, the smart scene interface 218 is a functional interface corresponding to a recording attribute and is used to receive a user's touch text input. The smart scene interface 218 further includes a recording icon 2182 for receiving a user's touch. Control to start the recording function. Referring to FIG. 4B, after the recording function is activated, the smart scene interface 218 further includes a stop recording icon 2184 for receiving a user's touch to stop the recording function. Referring to FIG. 4C, after stopping the recording function, the smart scene interface 218 further includes a recording bar 2186. The recording bar 2186 can be used to display the playback progress of the recording. The number "05:38" below the recording bar 2186 indicates the duration of the recording, and the "X" symbol on the right is used to delete the recording. Therefore, the current smart scene interface 218 includes a text recording function and a voice recording function. It can be understood that the smart scene interface 218 shown in FIGS. 4A-4C can be switched to the additional function area 214 by sliding, for example, left and right, that is, to the call interface 21 shown in FIG. 3.

Please refer to FIGS. 5A and 5B. The smart scene interface 218 is a functional interface corresponding to the attributes of a place, and is used to display map search and web search information of the place name. The smart scene interface 218 shown in FIG. 5A displays geographic information of the place searched by a map, and is used for receiving user operations to further display navigation route and other information. In this embodiment, the smart scene interface 218 is an interface of a map application. The smart scene interface 218 shown in FIG. 5B displays the network information of the place searched by the network, and further detailed information can be displayed by receiving user operations. this In an embodiment, the smart scene interface 218 is an interface of a web search engine. It can be understood that the smart scene interface 218 shown in FIGS. 5A and 5B can be switched with the original additional function area 214 by sliding, for example, left and right, that is, the call interface 21 in FIGS. 5A, 5B, and 3 can be switched with each other.

Referring to FIG. 6, the smart scene interface 218 is a functional interface corresponding to the attributes of a contact, and is used to display the information of the contact and / or the latest release on the social platform of the contact. It can be understood that the smart scene interface 218 shown in FIG. 6 can be switched with the original additional function area 214 by sliding, for example, sliding left and right.

It can be understood that the display content of the smart scene interface 218 shown in FIG. 4-6 is slidable, such as sliding up and down to scroll the screen to view more content. The multiple smart scene interfaces 218 shown in FIG. 4-6 can be switched between each other by sliding, for example, sliding left and right. In one embodiment, when the semantic attributes of the matching keywords correspond to multiple functions, each function may correspond to a smart scene interface 218. For example, the location attribute may correspond to two functions of map search and web search. These two functions respectively correspond to the smart scene interface 218 of FIG. 5A and FIG. 5B. 5A, FIG. 5B, and FIG. 3, the call interface 21 can be switched to each other by sliding operation. The switching operation mode between the multiple smart scene interfaces 218 is not limited to sliding left and right, and may also be other predetermined operation modes, such as double-clicking or long-pressing the smart scene interface 218.

In one embodiment, when the smart scene interface 218 receives a preset operation, such as double-clicking or long-pressing, the user interface displayed on the display 20 may be switched from the call interface 21 to providing the smart scene interface 218 application's full screen interface to provide more features and information. For example, in the smart scene interface 218 for map search shown in FIG. 5A, when the preset operation is performed on the smart scene interface 218, the corresponding map application interface is switched to provide a more updated map application interface. Versatility and information.

In step 07, the processor 40 determines whether a preset physical key is activated. Authentic In an embodiment, the preset physical button may be activated but not limited to long pressing the volume button. It can be understood that the volume key can be activated when the volume key is pressed for a predetermined time, and the function of adjusting the volume is performed if the volume key is not pressed for the predetermined time. If it is determined that the preset physical key is activated, step 08 is performed; if it is determined that the preset physical key is not activated, step 10 is performed.

In step 08, the speech recognition module 104 analyzes the semantic attributes of the most recent matching keyword in the temporary storage area. In step 08, the processor 40 analyzes the semantic attributes of the matching keywords similarly to step 05, and will not be described again.

In step 09, the processor 40 activates the voice function according to the semantic attributes of the analyzed matching keywords. Corresponding to different semantic attributes, different voice functions are activated, such as playing the information of the matching keywords by voice, recording or voice prompt. For example, the voice function corresponding to the recording attribute is to start and stop recording. In this embodiment, when the recording function is activated, a voice prompt "Start automatic recording" is issued through the call module 102. For example, the voice function corresponding to the attribute of the place is to play related information of the place, and if the keyword is a name of a restaurant, then play the related information such as the address of the restaurant and the contact phone. For example, the voice function corresponding to the attributes of the contact person is to play related information of the contact person, such as the contact phone number of the contact person.

Step 10: Display the original call interface 21, such as the call interface 21 of FIG.

The portable electronic device 100 of the present invention detects a keyword in a call state and analyzes the semantic attributes of the keyword. When it is detected that the movement trajectory of the portable electronic device conforms to a preset movement trajectory, it is based on the keyword. The semantic attributes of the smart scene interface 218 are switched in the call interface 21, and the related information of the keyword is displayed through the smart scene interface 218. Therefore, the call interface 21 is flexible and intelligently detects the information that the user needs to refer to during the semantic judgment of the call, and directly displays these information for the user to view, improving the intelligence and diversity of the call interface 21 And efficiency, while bringing a better user experience.

In summary, although the preferred embodiments of the present invention have been disclosed for illustrative purposes, However, the present invention is not limited to the embodiments described above, and those skilled in the related industries can make various modifications and applications to it within the scope not exceeding the basic technical idea of the present invention.

Claims (14)

A portable electronic device establishes a call connection with other electronic devices. The improvement is that the portable electronic device displays a call interface, and the portable electronic device includes a voice recognition module, a motion sensor, and a memory. The voice recognition module detects keywords in a call, the memory stores a keyword database and a temporary storage area is set, and the portable electronic device judges the keywords detected by the voice recognition module Whether the keyword exists in the keyword database, and when it is determined that the keyword exists in the keyword database, the keywords are stored in the temporary storage area in the detected chronological order Wherein the motion sensor detects a motion trajectory of the portable electronic device, and when the motion sensor detects that the motion trajectory of the portable electronic device conforms to a preset motion trajectory, the voice recognition The module analyzes the semantic attribute of a keyword that is closest in time in the temporary storage area. The semantic attribute classification includes contact attribute, location attribute, record attribute, and brand attribute. When the keyword is Contact names are classified as contact attributes. When the keywords are place names, restaurant names, or company names, they are classified as place attributes. When the keywords are "record" or "write", they are classified as Record attribute. When the keyword is a brand name, it is classified as a brand attribute. Each semantic attribute category corresponds to a smart scene interface. The voice recognition module displays the wisdom corresponding to the semantic attribute category in the call interface. Scene interface. The portable electronic device according to item 1 of the scope of patent application, wherein the call interface includes current call information, additional function areas, and call end icons, and the smart scene interface replaces the additional function areas and is displayed in all In the call interface, the smart scene interface and the additional function area are switched with each other through a predetermined operation. The portable electronic device according to item 2 of the scope of patent application, wherein the call interface receives a touch operation to trigger a corresponding function, and the additional function area includes multiple additional function icons, each additional function icon Used to trigger the corresponding function. The portable electronic device according to item 1 of the scope of patent application, wherein the motion sensor is a gravity sensor, an acceleration sensor, a gyroscope sensor, an electronic compass, or a multi-sensor Combination for detecting the movement and / or rotation of the portable electronic device to detect the movement trajectory of the portable electronic device; the preset movement trajectory is that the portable electronic device is in a call Track from the user's ear to the front of the user's eye, and when the motion sensor detects that the portable electronic device moves from the user's ear to the front of the user's eye, the detected motion track is determined Meet the preset motion trajectory. The portable electronic device according to item 4 of the scope of patent application, wherein the portable electronic device further determines whether a preset physical button is activated, and when it is determined that the preset physical button is activated, according to the semantics The attribute enables the voice function, and the portable electronic device activates different voice functions corresponding to different semantic attributes. The portable electronic device according to item 2 of the scope of patent application, wherein when the semantic attribute of the keyword corresponds to multiple functions, each function corresponds to a smart scene interface, and these smart scene interfaces pass through the additional function area. The predetermined operations are switched with each other. The portable electronic device according to item 1 of the scope of patent application, wherein when the smart scene interface receives a preset operation, the portable electronic device switches from the call interface to providing the smart scene interface Full screen interface for your app. A method for displaying a call interface of a portable electronic device. The method for displaying a call interface includes: establishing a call connection with another electronic device; displaying a call interface; detecting keywords during a call; storing a keyword database and setting a temporary Storage area; judging whether the keyword exists in the keyword database; when judging that the keyword exists in the keyword database, storing the keyword to all the keywords in the detected chronological order In the temporary storage area; detecting the movement trajectory of the portable electronic device; when determining that the movement trajectory of the portable electronic device conforms to a preset movement trajectory, analyzing the most recent time in the temporary storage area The semantic attributes of a keyword. The semantic attribute classification includes contact attributes, location attributes, record attributes, and brand attributes. When the keyword is the name of a contact, the keyword is classified as a contact attribute. When the keyword is The place name, restaurant name, or company name is classified as a place attribute. When the keyword is "record" or "write", it is classified as a record attribute. Word brand name, brand classified attributes, each corresponding to a semantic attribute classification wisdom scene interface; and a display attribute categories corresponding to the semantic interface to the scene wisdom call interface. The method for displaying a call interface according to item 8 of the scope of patent application, wherein the call interface includes current call information, an additional function area, and an end call icon, and the smart scene interface replaces the additional function area and is displayed in the In the call interface, the call interface display method further includes: switching the smart scene interface and the additional function area in the call interface through a predetermined operation. The method for displaying a call interface according to item 9 of the scope of patent application, wherein the call interface receives a touch operation to trigger a corresponding function, and the additional function area includes a plurality of additional function icons, each of which is To trigger the corresponding function. The method for displaying a call interface according to item 8 of the scope of patent application, wherein the method for displaying a call interface further comprises: storing the preset motion trajectory, and the preset motion trajectory is that the portable electronic device is in a call The trajectory from the user's ear to the front of the user's eye; a motion sensor is used to detect the motion trajectory of the portable electronic device, and the motion sensor is a gravity sensor, an acceleration sensor, A gyroscope sensor, an electronic compass, or a combination of the plurality of sensors, for detecting movement and / or rotation of the portable electronic device to detect a movement track of the portable electronic device; And when the motion sensor detects that the portable electronic device moves from the user's ear to the front of the user's eye, it is determined that the detected motion track conforms to the preset motion track. The method for displaying a call interface according to item 11 of the scope of patent application, wherein the method for displaying a call interface further comprises: determining whether a preset physical button is activated; when determining that the preset physical button is activated, according to the semantics The attribute enables the voice function; and the different voice function is activated according to different semantic attributes. The method for displaying a call interface according to item 9 of the scope of patent application, wherein the method for displaying a call interface further includes: when the semantic attribute of the keyword corresponds to multiple functions, each function corresponds to a smart scene interface, and The predetermined operation mutually switches these smart scene interfaces and the additional function area. The method for displaying a call interface according to item 8 of the scope of patent application, wherein the method for displaying a call interface further comprises: when the smart scene interface receives a preset operation, the portable electronic device receives a call from the call interface Switch to the full screen interface of the app that provides this smart scene interface.