CN110198262B

CN110198262B - Cross-application interface element providing method

Info

Publication number: CN110198262B
Application number: CN201910322122.5A
Authority: CN
Inventors: 张小林
Original assignee: Shanghai Youbi Consulting Planning Co ltd
Current assignee: Shanghai Youbi Consulting Planning Co ltd
Priority date: 2018-09-06
Filing date: 2019-04-19
Publication date: 2024-01-05
Anticipated expiration: 2039-04-19
Also published as: CN110198262A

Abstract

The invention belongs to the field of communication interaction, and provides an interface element providing method for a communication device, which comprises the steps of displaying a first interaction interface on electronic equipment; integrating and outputting a plurality of communication information corresponding to at least one communication network through a first interactive interface; and responding to the switching operation, and switching and displaying the second interactive interface on the electronic equipment. Based on the interface element providing method, operability of the electronic equipment is improved.

Description

Cross-application interface element providing method

Technical Field

The invention relates to the technical field of interface interaction, in particular to a cross-application interface element providing method of electronic equipment.

Background

The development of science and technology enables communication modes of people to be greatly changed, intelligent terminal products such as smart phones and the like are continuously appeared, and various application programs (Apps) are continuously introduced, so that people can establish communication with families, colleagues and friends at any time and any place without being limited by distance.

However, in real life, some users, including but not limited to old people and children, have difficulty adapting to technological development of daily and new technology due to lack of capability, are difficult to adapt to upgrading and updating of various communication means, and cannot proficiently use intelligent terminals and various communication apps, so that they may not be able to well establish communication with families and friends.

This situation is more pronounced in the following circumstances: young children work in metropolitan areas, while parents and young children may remain in distant hometown. Even though a child buys a smart phone for the elderly and installs various communication apps and other apps, the elderly often cannot normally operate the smart phone and various apps inside, and thus cannot effectively establish communication with family members and friends.

On the other hand, the technical routes of the related communication technologies and the related communication application software technologies also take place for many generations of complex evolution processes.

The communication system may provide a fixed line connection or a wireless connection for subscribers to communicate, such as voice or data communications. An example of a fixed line system is the Public Switched Telephone Network (PSTN). One example of a wireless communication system is a Public Land Mobile Network (PLMN), and another example is a satellite-based mobile communication system. Wireless communication typically occurs via a radio frequency connection between a subscriber's mobile station and at least one network element of the communication system. Communications within a network are typically, but not necessarily, handled using fixed line connections between different network elements. Communications may also be transmitted within a system that includes one or more data networks. One example of such communication is a voice over IP (internet protocol) scheme that implements a voice call over a packet switched data network.

The communication network is a cellular radio network consisting of access entities, commonly referred to as cells. In most cases, a cell is defined as a certain area covered by one or more Base Transceiver Stations (BTSs) that serve User Equipment (UEs), such as Mobile Stations (MSs), via a radio interface that may be connected to a Base Station Subsystem (BSS). Several cells cover a larger area and typically form a radio coverage area called a Location Area (LA) or in some standards a Routing Area (RA). It should be appreciated that the size of the location area or routing area depends on the system and environment and may be equal to one cell or less, such as a portion of the coverage area of a base station. One feature of a cellular system is that it provides mobility for a mobile station, i.e. enables the mobile station to move from one location area to another, even from one network to another that is compatible with the standard for which the mobile station is adapted.

The wireless communication is a communication system using only electromagnetic waves and not through a cable, and mainly includes microwave communication and satellite communication. Microwaves are radio waves that travel distances of typically only tens of kilometers. But the frequency band of the microwave is wide and the communication capacity is large. A microwave relay station is built every tens of kilometers for microwave communication. Satellite communication is the establishment of microwave communication links between two or more earth stations or between mobile bodies on the ground using communication satellites as relay stations.

The wireless communication (Wireless Communication) is a communication system for exchanging information by utilizing the characteristic that electromagnetic wave signals can propagate in free space, and in the field of information communication in recent years, the most widely-developed wireless communication technology is the fastest-growing one. Wireless communication implemented in mobile is also known as mobile communication, and both are commonly referred to as wireless mobile communication.

In the network system of wireless mobile communication, the network system of mobile phones for mobile users mainly comprises four types of GSM, CDMA, 3G and 4G, and the mobile phones have undergone the first generation of analog mobile phones (1G), the second generation of digital mobile phones (2G) such as GSM, TDMA and the like, the 2.5 th generation of mobile communication technology CDMA, the third generation of mobile communication technology 3G and the fourth generation of mobile communication technology 4G from the prior art.

Wherein the full digitization starts from GSM (Global System for Mobile Communications global system for mobile communications), which developed on the basis of cellular systems, belongs to the second generation digital mobile communications system. The method is characterized by the most mature and advanced technology, and has the advantages of multiple types of openable mobile communication service, high mobile phone connection speed, good conversation quality, strong security and confidentiality, strong anti-interference capability and wide network coverage. In the topology structure, the public mobile communication network generally adopts a cellular topology, which is based on the consideration of improving the frequency spectrum utilization rate, reducing the mutual interference and increasing the system capacity.

In order to realize the support from the traditional voice service to the data service, the GPRS superimposes the network supporting the high-speed packet data on the basis of the original GSM network, provides the functions of WAP browsing (browsing Internet pages), E-mail and the like for users, promotes the initial leap development of the mobile data service, and realizes the perfect combination of the mobile communication technology and the data communication technology (especially Internet technology).

From the second generation GSM, most mobile communications are digital, and besides voice communications, they can also send and receive short messages (short messages, SMS), MMS (technical) MMS (multimedia messaging), wireless Application Protocol (WAP), etc.

The short message (short message service, SMS) is a part of a "converged communication" service plan, and the number of characters that a user can receive and send a short message each time is 160 english, digital characters or 70 chinese characters by directly sending or receiving text or digital information through a mobile phone or other telecommunication terminals.

In general, the term "mobile data traffic" refers to data traffic generated by surfing the internet through mobile communication technologies such as GPRS, EDGE, TD-SCDMA, HSDPA, WCDMA, LTE or using related data value added services, and does not include traffic generated by surfing the internet through other means such as WLAN and CSD.

A mobile communication network between mobile subscribers or between mobile subscribers and fixed subscribers, the public mobile communication network and the private mobile communication network being classified according to service objects; a distinction can be made between mobile telephone networks and mobile data networks by service nature. The mobile telephone network supports communication in the form of short messages and voice. Correspondingly, the terminal equipment is provided with an SMS short message interface and a voice interface, so as to access a mobile telephone network, send and receive short messages and dial/answer a telephone from the voice network.

In addition, the mobile terminal may be connected to the internet through the mobile data traffic based on the public mobile data network, or may be connected to the internet through a WLAN access point based on a conventional home or enterprise broadband derivative, so that real-time communication is one of various network services and programs.

The above-mentioned WLANs are all referred to as: wireless Local Area Networks, chinese name: the wireless local area network is a system for transmitting data by utilizing Radio Frequency (RF) technology, and the technology is used for overcoming the defects of a wired local area network so as to achieve the aim of network extension and realize a clear network without network wires and distance limitation. The protocol standards currently included in WLANs are: IEEE802.11b protocol, IEEE802.11a protocol, IEEE802.11g protocol, IEEE802.11e protocol, IEEE802.11i protocol, wireless Application Protocol (WAP), etc., and WIFI (wireless fidelity) technology is a wireless network communication technology based on the IEEE802.11 series of standards.

And for both mobile data networks and WLAN communication networks, are known in the industry as wireless data transmission networks.

The real-time communication (Instant Messaging, abbreviated as IM) derived by the above communication technology is a real-time communication system (generally including service and user side software), which allows two or more people to communicate text messages, files, data, voice and video using the network in real time, including ICQ, skype, MSN, etc. before the mobile data network is not popularized, and a great deal of mobile instant messaging services and software, such as micro-messaging, wechat, etc. have been developed with the popularization of wireless data transmission technologies such as mobile data network, WLAN, etc. and smart phone operation systems.

There is an urgent need to provide a communication method and related apparatus based on the above communication technology and application software technology to satisfy the potential demands of users including, but not limited to, elderly people, children, etc.

Disclosure of Invention

It would be beneficial if the operability (operationality) of software applications through an interactive interface of an electronic device could be improved.

To this end, in an embodiment of the present invention, there is provided an interface element providing method for an electronic device, including: displaying a first interactive interface on the electronic device; integrating and outputting a plurality of communication information corresponding to at least one communication network through a first interactive interface; responding to the switching operation, and switching and displaying a second interactive interface on the electronic equipment; wherein a first user interface element and a second user interface element are provided on the first interactive interface and the second interactive interface, respectively, and for the first interactive interface, the first user interface element is associated with at least one communication network.

Optionally, the interface element providing method may further include the steps of: the first user interface element and the second user interface element are functionally configured by one or more programs in the electronic device to correspond to an application of the first interactive interface and an application of the second interactive interface, respectively. Thus, the first user interface element and the second user interface element functionally correspond to an application of the first interactive interface and an application of the second interactive interface, respectively. In other words, the second user interface element and the first user interface element may interact with applications provided by the second interactive interface and the first interactive interface, respectively, through configuration of functionality of the second user interface element and the first user interface element by one or more programs to support user manipulation of the second user interface element and the first user interface element, respectively.

Optionally, the interface element providing method may further include the steps of: the first user interface element and the second user interface element are formally configured by one or more programs in the electronic device such that the correspondence between the first user interface element and the second user interface element is formally maintained.

Optionally, the first user interface element and the second user interface element may be formally configured by one or more programs in the electronic device such that there is a correspondence and/or correspondence between the two for at least one of: number, layout, morphology, look, orientation, color system, color, shape, pattern.

In another embodiment of the present invention, there is provided an electronic apparatus including: a display; a processor unit; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit to: displaying a first interactive interface on the electronic device; integrating and outputting a plurality of communication information corresponding to at least one communication network through a first interactive interface; responding to the switching operation, and switching and displaying a second interactive interface on the electronic equipment; providing user interface elements on the first interactive interface and the second interactive interface respectively; wherein the user interface element on the first interactive interface is associated with at least one communication network.

Optionally, the electronic device may further comprise a connector interface through which the processor unit in the electronic device is detachably coupled to a physical operation part. One or more programs in the electronic device may be functionally separately configured to support operation of the same or different application programs provided in the first and second interactive interfaces, respectively, through the physical operator or user interface element. In other words, the functions of the entity operation part or the user interface element can be dynamically configured along with the switching of the first interactive interface and the second interactive interface so as to correspond to the functions of the application programs provided on the first interactive interface and the second interactive interface, thereby supporting that a user can respectively operate the entity operation part or the user interface element to interact with the application programs provided by the first interactive interface and the second interactive interface. The functionality of both the physical operations or the user interface elements is substantially peer-to-peer, except that the implementation is differentiated: physical and virtual, as well as the two may differ slightly in terms of their form maintaining substantial consistency.

Preferably, the physical operation part may be configured on a base, and the base may be used for accommodating the electronic device. Alternatively, the user interface element may be configured by one or more programs in the electronic device to maintain formal consistency with the physical operator, and the user interface element may be configured by one or more programs in the electronic device to maintain formal consistency across interfaces.

Optionally, the user interface elements distributed over the first and second interactive interfaces may be configured by one or more programs in the electronic device to have consistency and/or correspondence with the entity operator for at least one of: number, layout, morphology, look, orientation, color system, color, shape, pattern.

In still another embodiment of the present invention, there is also provided an electronic apparatus including: a display; a processor unit; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs including instructions for performing any of the sub-methods or steps of the various interface element providing methods of the present application.

In still another embodiment of the present invention, there is also provided an information processing apparatus for use in an electronic device having a display, including: means for performing any one of the plurality of interface element providing methods in the present application.

In yet another embodiment of the invention, an electronic device includes a display, a touch-sensitive surface, optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface, a processor unit, a memory, and one or more programs; one or more programs are stored in the memory and configured to be executed by the processor unit, and the one or more programs include instructions for performing or causing performance of the operations of any of the methods herein.

According to some embodiments of the present invention, a computer-readable storage medium has instructions stored therein, which when executed by an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface, cause the device to perform or cause to perform the operations of any of the methods herein.

According to some embodiments of the present invention, a computer-readable storage medium has instructions stored therein, which when executed by an electronic device with one or more processors, cause the device to perform the instructions of any of the methods of the present application.

In the interface element providing method, in the switching process of the user interface of the electronic device, corresponding interface elements such as the user interface and the like are provided for a user in a cross-interface manner, and can be respectively adapted to the functions of individual application programs on each interface in a plurality of interfaces, and the consistency of operation can be maintained to a certain extent among the interfaces where the plurality of application programs with different functions are located, so that the consistency of user experience is followed to a certain extent, and the operability of the application programs through the interactive interface is enhanced.

In some embodiments of the resource providing method, a plurality of communication enabling units/user interface elements, such as a plurality of virtual keys, are provided on the first contact communication interface collectively, and the keys are respectively associated with different multiple communication networks, such as a mobile phone network, a mobile data network/WLAN, etc., so that different communication paths, different communication tools and different communication tools are integrated on the same user interface, which is centered on contacts, and is guided by simplification of interaction operations in the process of establishing communication with the contacts by a user, so as to perform integrated configuration on communication resources, and make significant progress in operability and accessibility of communication resources or communication information of electronic devices or communication apparatuses.

Specifically, in some embodiments, the communication resources associated with the plurality of communication networks of different nature are integrated on the communication interface for the first contact, centered on the first contact and its communication interface, in other words, different communication resources in the electronic devices are directed towards the accessibility (communicative accessibility) of the communication to the first contact, integrated with or assigned to the first contact interface. This is different from the case where a communication tool such as a different communication program is used as a center and a contact is attached to one module of the communication tool (for example, an address book, a telephone directory, or the like for the contact) as one communication object to which the communication tool is applied. This shields the user from different communication tools/programs run by the electronic device during communication with the first contact, from different communication networks accessed, and in some embodiments also shields the user from the operating system of the electronic device, which improves accessibility/accessibility of communications to the first contact at the electronic device, operability of communication resources between the user and the first contact, and related user experiences. It can be understood that: in some embodiments, different contact communication interfaces are configured with different contacts as distinction, e.g., the first contact interface and the second contact interface are two different independent interfaces, associated with two different communication objects, a first contact and a second contact, respectively. The first contact interface may be a unique communication interface for the first contact in the electronic device, in other words, communication resources related to the first contact are integrated on the first contact interface, rather than being distributed on different communication interfaces.

The improvement in the embodiments of the present invention reconstructs the functional architecture of the technical elements including the interactive interface elements in the mobile communication device, mutually coordinates the technical elements, redefines the functions of some technical features, has a certain development in the aspect of communication interaction, and has outstanding substantial characteristics compared with the mobile phones with functions as guiding in the prior art. The method or apparatus of these embodiments overcomes, to some extent, the technical bias of those skilled in the art of mobile communication devices, particularly smartphones, that is inherited by desktop and "platform/operating system + functionality" based logic architecture in electronic devices, particularly smartphones, and the corresponding manner of providing software resources guided by the differentiation of the functionality or groups of functionalities of the application.

In some embodiments, the user interface element may be several keys arranged in an array. The keys of the key array, when pressed, trigger the electronic device to generate a signal to operate a particular behavior of the application program to implement a certain function of the application. The inventors have studied to find that for common applications, the number of functions that are important or commonly used by the user is typically not more than 5, e.g. 3-4. For example, an instant messaging program may include several primary communication functions: "send voice message", "listen to voice message", "on-line video/audio call", etc., while for album applications several main image processing functions may be included: "take a picture/video", "view a photograph", etc. Thus, a corresponding number of keys, 3 or 4, may be provided in the electronic device, operating the application program to run these functions, respectively. Of course, preferably, these 3 or 4 keys may be centrally disposed on the same level of interface of the application to facilitate direct user access to them without the need to open further levels of interfaces, sub-interfaces or floating layers.

Optionally, two or more keys functionally corresponding to each other may be disposed in association with each other on the current interface or on the entity of the electronic device, for example, disposed in close proximity in space, so as to facilitate the cognition and operation of the user. For example, "send voice message" and "listen to voice message" in the instant messaging program, "send short message" and "access short message" in the mobile phone application program, "play photos" and "pause play" in the album application program. Whereas functionally relatively independent keys, or more frequently used keys, such as the "on-line video/audio call" key for instant messaging programs, may be provided separately from the other keys in the key array. In some embodiments, the "online video/audio call" key may be spaced apart a distance from the pairing (key pair) of the keys of "send voice message" and "listen to voice message".

In some embodiments, the user interface element preferably includes 2-5 (e.g., 3-4) buttons that can operate on the above-described primary behavior or functions of the application to correspond to 3-4 primary functions of the application on the current interface. Wherein, various software capabilities of the application program on the current interface are integrated into 3-4 main functions for the user to operate the application program through the 3-4 keys. The design of 3 or 4 keys balances two factors: 1) Corresponding to the main capabilities of the software on the current interface, 2) meets the memory capabilities of the user, especially the elderly. Specifically, if the number of keys is excessive, difficulty may be brought to the user in learning the functions of the respective keys; if the number of keys is too small, such as 1, the primary resources provided by a piece of software may not be fully utilized, wasting, to some extent, the provided utility or Feature of the software. The design of 3 or 4 keys enables the application program to be fully utilized while the interactivity of the application program is maintained, and the cognition and operation of the application program by a user through the electronic equipment are relatively simplified. In the following description, it will be explained by way of example a communication application and an album application how the 3 keys of the electronic device support the user to operate both applications to use their main software features.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of internal components of an electronic device according to an embodiment of the present invention;

FIG. 2 is an interface interaction diagram of a communication process according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of interface interactions of another communication process according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of interface interactions of yet another communication process according to an embodiment of the present invention;

FIG. 5a is a schematic diagram of a physical keyboard according to an embodiment of the present invention;

FIG. 5b is a schematic diagram of an operation procedure corresponding to the physical keyboard provided in the embodiment shown in FIG. 5 a;

FIG. 6a is a schematic diagram of another physical keyboard according to an embodiment of the present invention;

FIG. 6b is a schematic diagram of an operation procedure corresponding to the physical keyboard provided in the embodiment shown in FIG. 6 a;

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of another electronic device according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of still another electronic device according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of still another electronic device according to an embodiment of the present invention;

FIG. 11 is a diagram of a prior art system architecture for establishing communication with contacts via a mobile terminal;

FIG. 12 is a flow chart of a resource providing method according to an embodiment of the invention;

FIG. 13A is a block diagram showing a program of a portion stored in a resource providing apparatus according to another embodiment of the present invention;

fig. 13B is a schematic structural diagram of an electronic device according to another embodiment of the present invention;

FIG. 14 is a schematic diagram of an electronic device and its interactive interface according to another embodiment of the present invention;

FIG. 15 is a schematic diagram of an interactive interface in a resource provisioning method according to another embodiment of the present invention;

FIG. 16 is a schematic diagram of an interactive interface for displaying the latest message or messages in a resource providing method according to another embodiment of the present invention;

FIG. 17 is a schematic diagram of an interactive interface of a provide button in a resource providing method according to another embodiment of the present invention;

FIG. 18 is a flowchart of a resource providing method according to another embodiment of the present invention;

FIG. 19 is a schematic diagram of an interactive interface in a resource provisioning method according to another embodiment of the present invention;

FIG. 20 is a flow chart of an interface element providing method according to another embodiment of the invention;

FIG. 21 is a schematic layout of physical operation parts and virtual user interface elements of an electronic device according to an embodiment of the present invention;

FIG. 22 is a schematic diagram of an operation of an electronic device in accordance with an embodiment of the present invention;

fig. 23 is a schematic structural diagram of another terminal electronic device according to an embodiment of the present invention;

fig. 24 is a schematic view of an interactive interface in a terminal electronic device according to another embodiment of the present invention.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, the "plurality" generally includes at least two.

It should be understood that the term "and/or" as used herein is merely one relationship describing the association of the associated objects, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a product or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such product or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of additional identical elements in a commodity or system comprising such elements.

In addition, the sequence of steps in the method embodiments described below is only an example and is not strictly limited.

The several titles of the present application, such as "integrating the interactive interface", "some embodiments of the first resource providing method", "some embodiments of the second resource providing method", "high operability electronic device", "communication device/electronic device with entity key array", "button and host separable design", "key/button layout and its form and function", "graphic element providing method and device across interface", etc., respectively, describe relatively independent aspects of some embodiments of the present invention or relatively independent modules, and these modules may be combined together to form further modified examples, and only some of the modified examples are schematically described in this application, but do not prevent the combination of the above modules or the more diversified combinations between the aspects. For example, all embodiments under the heading "integrate interactive interface", "some embodiments of the first resource providing method", and the like, and variations of the modules and modules involved therein, are correspondingly applicable to other embodiments in the present application. The combination possibility between these embodiments and between the modules of the embodiments will not be described in detail elsewhere.

The inventor finds that the instant messaging schemes in the prior art all require a user to perform complex hierarchical interactive operation on a communication device and application software therein, but lack of schemes for implementing instant messaging through simple hardware operation, and such missing schemes can allow the user to operate a physical keyboard to trigger a corresponding software program to be executed so as to establish instant messaging. Such a missing scheme will be schematically illustrated by the following examples.

Fig. 1 is a schematic diagram of internal components of a communication device according to an embodiment of the present invention, as shown in fig. 1, where the communication device includes: an operation part, a housing (not shown), a processor unit accommodated in the housing, and a media collection unit 13 and a media play unit 14 and a wireless data transmission unit 15 accommodated in the housing and coupled with the processor unit, such as the processor 12, respectively. The operating part may be embodied in the form of a physical operating element, such as a button, a lever, a handgrip, a (reduced) keyboard or the like. Here, a physical keyboard 11 of a simplified structure is schematically illustrated, and the physical keyboard 11 is provided on a housing and connected to a processor 12.

Wherein the physical keyboard 11 may issue a first trigger signal to the processor 12 in response to a first operation by a user, and may issue a second trigger signal to the processor 12 in response to a second operation by the user.

The communication device further includes a memory 16 storing at least one machine readable instruction coupled to the processor 12 and one or more programs executable by the processor 12 to: in response to the first trigger signal, acquiring the first media signal by the media acquisition unit 13 and transmitting the first media signal by the wireless data transmission unit 15 via the wireless data transmission network; in response to the second trigger signal, a second media signal received by the wireless data transmission unit 15 via the wireless data transmission network is output by the media playing unit 14.

It should be appreciated that the above-described processor units may alternatively comprise one or more processors 12, and that the processor or processor units may operate as a centralized, unique Central Processing Unit (CPU), or may operate in the form of several sub-processing units, processors, which are respectively connected to the media acquisition unit 13 and the media playback unit 14, etc., as their respective dedicated processors. Various variations of the processor 12 or processor unit described herein may be adapted for use in the methods and apparatus of all embodiments described above or below, and other parts of this document are not repeated here.

The communication device includes, but is not limited to, a handheld electronic device, such as a mobile phone, a tablet computer, a digital assistant, etc.

Here, it should be noted that the communication process in which the processor 12 sends the first media signal and receives the second media signal through the wireless data transmission unit 15 via the wireless data transmission network is an instant communication, and the instant communication is typically duplex (duplex) communication. In other words, one or more programs may be executed by processor 12 to: the first media signal is acquired by the media acquisition unit 13 in response to the first trigger signal and the acquired first media signal is transmitted instantaneously by the wireless data transmission unit 15 via the wireless data transmission network, and the instantaneous second media signal from the other communication device is output by the media play unit 14 in response to the second trigger signal.

Optionally, the first media signal and the second media signal are instant messages (instant messages) such as voice messages (voice messages), video/image messages (video messages), and the like, respectively. Of course, the instant message may also include a text type message. Alternatively, both the voice message and the video message may have a preset maximum value over the duration, for example 60 seconds; and the text message may also have a preset maximum value, e.g. 1000 words, over the text length.

In addition, it should be noted that: the wireless data transmission network includes at least a data network with which the communication device can establish a data link and a Wireless Local Area Network (WLAN) or a data network typified by an access method of WIFI, not a voice network such as a mobile phone network. The communication device may include a processor unit 12 therein. In practice, the communication device may further include a communication interface or the like. In addition, physical keys such as a power key, a volume adjustment key, etc. may also be provided on the communication device on the side or elsewhere.

In some embodiments, the processor 12 may operate as a centralized, unique Central Processing Unit (CPU), or may operate in a distributed manner as several sub-processing units (not shown) that are respectively coupled to the media acquisition unit 13 and the media playback unit 14, and the wireless data transmission unit 15, etc., as their respective dedicated processors.

The physical keyboard 11 is arranged on the communication device, and based on the arrangement of the physical keyboard 11, the user can more quickly and conveniently conduct instant communication with the contact person.

The physical keyboard 11 is accommodated in the housing, that is, accommodated as a whole in the housing, but the physical keyboard 11 may be exposed to the outside through the through hole so as to be partially protruded outside the housing.

In practice, the physical keyboard 11 may comprise one or more independently arranged physical keys with a triggering communication function. The user can operate one or more physical keys through a single action (single action) to directly trigger instant messaging, real-time communication, etc. with the contact, unlike the conventional keyboard used for inputting information such as text.

In an embodiment of the present invention, optionally, a certain communication application program, such as an instant messaging application program, may be installed in the communication device, and in the prior art, for example, when a user needs to send a voice message to a certain contact person, the user may need to start the communication application program first, select the contact person, then display a chat window with the contact person, and further find a function button for sending the voice message in one or more layers of function menus included in the chat window, and operate the function button to complete sending the voice message. For another example, in the prior art, when a user receives one or more voice messages from a contact, the user also needs to enter a chat window with the contact, and then click on the received voice messages one by one to listen to each voice message. In this way, in the prior art, a complex interface operation is required in the process of establishing communication between the user and the contact through the communication application. When a user such as the elderly cannot be proficient in performing these operations, it takes longer to send out a message that needs to be sent out, or it takes longer to actually receive a message sent from a contact, or it may not be possible to actually complete communication with the contact.

In addition, through research on the communication behavior habits of users, it is found that: the specific gravity of sending media type messages, such as voice, video type messages, is significantly increasing. Because the way in which the message to be transmitted is directly spoken is more direct and convenient than in the case in which a text-to-text message is composed. Meanwhile, the messages received by the user are more heavily weighted and are also media type messages.

Based on the above, the embodiment of the invention provides the communication device, so that when a user uses the communication device, the user can more conveniently, quickly, timely and reliably realize the receiving and transmitting of the communication message between the user and the contact person through simple operation of one or more physical keys, and particularly, the receiving and transmitting of the message of the media type is realized.

In fact, the physical key of the physical keyboard 11 may be implemented in various manners, for example, may be a key, may be a toggle key, and when the physical key is implemented in different manners, the manner in which the user can operate the physical key will be different. For example, for a key, the operation that can be performed may be one or more continuous pressing operations, for example, may be a pressing operation that lasts for a certain period of time (simply referred to as a long pressing operation). For example, for a toggle key, the operation that can be performed may be a toggle operation in different directions.

However, regardless of the specific implementation manner of the physical key, the operation performed on the physical key in the embodiment of the present invention may preferably be a single action operation, such as the single-press, multiple-press (possibly quick, continuous), long-press, toggle, or the like, which is exemplified above. In this sense, a conventional numeric dialing pad is different from the physical pad, the numeric dialing pad representing only digits and requiring multiple keys to be pressed one after the other before a communication can be initiated via the call key.

In addition, in practical applications, the physical keyboard 11 may be connected to the processor 12 through a direct connection wire or a key signal circuit, which may be a switch circuit, a logic processing circuit, or the like. It should be noted that, the triggering in the above-mentioned "the physical keyboard is operable to trigger" refers to hardware triggering. For example, alternatively, when at least one key is included in the physical keyboard 11, each key may operate in the form of a switching circuit, wherein one end of the switch is connected to the processor 12 and the other end is connected to the key. The key may be connected to the processor 12 by a key signal circuit such as a "direct connect" circuit, or an adjustment circuit, an adaptation circuit, a logic determination circuit, etc. Thus, when a key is pressed, the switch circuit is turned on, and a specific trigger signal is output to the processor 12, which may trigger the processor 12 to perform a corresponding operation or no operation, and when the key is released, the switch circuit is turned off, and at this time, the trigger signal is turned over, which may trigger the processor 12 to perform a corresponding operation or no operation. The processor 12 may also determine whether the press operation is a short press operation or a long press operation based on the length of time the trigger signal is sustained.

Alternatively, the key signal circuit may be composed of a general purpose input output (General Purpose Input Output, GPIO) chip, also referred to as a bus expander, and peripheral circuits. The GPIO chip includes a plurality of input/output ports, simply a plurality of ports, and the peripheral circuit may be, for example, a resistor and a switch circuit connected in series with each port. Thus, when a plurality of keys are included in the physical communication keyboard 11, each key may be connected to one port through a switch circuit, and at this time, each port has two level states corresponding to the key being pressed and the key not being pressed, respectively.

Optionally, when there are multiple physical keys that all need to be connected to the GIPO chip, but the number of ports of the GPIO chip is limited, one physical key may also be connected to multiple ports, so that multiplexing of multiple physical keys to multiple ports of the GPIO chip is achieved, for example, multiplexing of 16 physical keys may be achieved by 4 ports, where when different physical keys are triggered, the 4 ports will present different level states. At this time, the ports are no longer connected in one-to-one correspondence with the physical keys.

It will be appreciated that the GPIO chip may include, in addition to a plurality of ports connected to physical keys, interfaces for connection to the processor 12, as well as power interfaces, ground interfaces, and the like. Thus, the processor 12 can determine which physical key is operated according to the trigger signals received from the ports of the GPIO chip, that is, the identification of the operation behavior of the physical key by the user is realized.

In one aspect, in the present embodiment, after the user applies the first operation to the physical keyboard 11, the physical keyboard 11 sends the first trigger signal to the processor 12. For example, when the physical keyboard 11 includes a physical key, the user performs a first operation on the physical key, the physical key is connected to a port of the GPIO, and based on the first operation, a circuit between the physical key and the port is turned on, and a first trigger signal is sent to the processor 12. In response to the first trigger signal, the processor 12 may control the media capturing unit 13 to start capturing the first media signal of the user, and further send the captured first media signal through the wireless data transmission unit 15 via the wireless data transmission network. Based on this, in practical application, when a certain communication application program is installed in the communication device, the user only needs to select a contact person that wants to communicate currently from the communication device, after a certain contact person is selected, the first operation is applied to the physical keyboard 11, and the processor 12 can control the media collection unit 13 to start collecting the first media signal of the user, so that the collected first media signal is sent to the communication application program of the contact person through the wireless data transmission unit 15 via the wireless data transmission network. In an alternative embodiment, the media capturing element 13 may be a microphone, whereby the first media signal may be a voice message captured by the microphone. In another alternative embodiment, the media capturing element 13 may be a camera, such that the first media signal may be a video/image message captured by the camera. In another alternative embodiment, the media capturing element 13 may be a microphone and a camera, so that the first media signal may be an audio/video signal that is obtained by merging a voice message captured by the microphone and a video/image message captured by the camera after the processor 12 receives the voice message.

The process of sending the collected first media signal through the wireless data transmission network may be simply: and carrying out compression coding on the acquired first media signal according to a certain coding standard such as H.264 and the like, further, packaging the first media signal after compression coding into a data packet according to a network communication protocol, and transmitting the packaged data packet to an opposite terminal user through a wireless data transmission network.

On the other hand, in the present embodiment, after the user applies the second operation to the physical keyboard 11, the physical keyboard 11 sends the second trigger signal to the processor 12. For example, when the physical keyboard 11 includes a physical key, the user performs a second operation on the physical key, the physical key is connected to a port of the GPIO, and based on the second operation, a circuit between the physical key and the port is turned on, and a second trigger signal is sent to the processor 12. In response to the second trigger signal, the processor 12 may control the media playing unit 14 to start playing the second media signal that the wireless data transmission unit 15 has received over the wireless data transmission network. In practical applications, when the user receives the second media signal sent by a certain contact through the communication application, the second operation can be triggered on a certain physical key in the physical keyboard 11, and the processor 12 controls the media playing unit 14 to play the received second media signal based on the operation, so that the user can realize one-key listening to the communication data sent by the contact.

In some embodiments, the media playback unit 14 may be a second speaker, such that the second media signal may be a voice message. In another alternative embodiment, the media playback unit 14 may be a display and a second speaker, such that the second media signal may be a video/image message. But also text, pictures, etc. In another alternative embodiment, the media playing unit 14 may be a display, whereby the second media signal may be text, pictures, etc.

Moreover, it should be noted that, in the method, the communication apparatus, and the electronic device according to some embodiments of the present invention, the mentioned display screen (display screen) generally refers to a screen portion of a display (display) to which the communication apparatus/the electronic device is coupled (built-in or external), preferably a touch display, a touch display screen, or also simply referred to as a display, which may be a separate display unit independent of the electronic device, such as a television, or may be a touch display integrally assembled with the electronic device, and will not be described herein.

Wherein, optionally, the display is disposed on a first surface side of the housing, such as above the first surface; the physical keyboard 11 is disposed on the other side of the first surface, such as the lower side, or the second surface of the housing, wherein the first surface may be the front surface of the housing and the second surface may be the side surface of the housing.

In the process of playing the second media signal received through the wireless data transmission network, for example, in the case that the second media signal is an audio/video signal, the audio/video signal may be compressed and encoded in the transmission process, so that during playing, decoding processing is required according to a corresponding encoding standard, and then the decoded audio/video signal is played.

In summary, a physical keyboard for establishing communication for a user is provided on the communication device provided in this embodiment, and when the user wants to send a message to a contact, a first operation may be performed on the physical keyboard to trigger the media collection unit to collect a first media signal of the user, and the first media signal is sent to the contact through the wireless data transmission network. When the communication device receives a second media signal sent by the contact person through the wireless data transmission network, the user can trigger the media playing unit to output the second media signal to the user by performing a second operation on the physical keyboard. Therefore, based on the communication device, a user can realize instant communication with a contact through a wireless data transmission network instead of a mobile telephone network such as GSM and the like through the physical keyboard, compared with the traditional mode that the user needs to perform multiple interface interaction operations on a communication application program, the man-machine interaction level is greatly reduced, so that the success rate of communication between the user and other people can be improved, and the communication instantaneity can be improved.

In some alternative embodiments, such as when a user wants to send a voice message to someone, and such as when a user wants to initiate an online audio-video call to someone, the user needs to select an opposite user with whom to communicate first, and then perform some operation on the physical key according to the communication requirement. While the user selection of the opposite user's operation involves an operation on a communication application installed in the communication device. At this time, in order to further improve operability (operability) of the communication device in the process of the user communicating with the contacts through the interactive operation, the processor 12 may run a communication application program serving as a desktop interactive program in the communication device, where the communication application program includes a plurality of contact information, so that the user may select a contact as a peer user from the plurality of contact information included in the communication application program.

Thus, the at least one machine readable instruction comprises a communication application that can provide a plurality of contact information, and the at least one machine readable instruction is further executable by the processor 12 to: in response to the first trigger signal, obtaining a first media signal through a microphone and/or a camera, and sending the first media signal through the wireless data transmission unit 15 to a first contact selected by the user from a plurality of contact information through the communication application via a wireless data transmission network; outputting, by the second speaker and/or display, a second media signal from the first contact or the second contact received by the wireless data transmission unit 15 via the wireless data transmission network in response to the second trigger signal; and the communication application is executable by the processor 12 to record the first media signal and the second media signal on the display in an identified manner, wherein the first media signal and the second media signal are voice messages and/or video/image messages, respectively.

Wherein the signifi-cant recording refers to the presentation of the transmitted first media signal, the received second media signal in some identification pattern, which will be schematically presented in the following embodiments.

Wherein the communication application may alternatively be executed by the processor 12 as a desktop interactive program during start-up of the communication device for loading on the display screen.

Alternatively, in some Android operating systems, the communication application may be set to a start-up (Launcher) level application under the ROOT authority of the operating system, that is, the communication application is set as a desktop interactive program, so that, with the start-up of the operating system, the processor 12 may load the communication application without the presence of a conventional desktop or any other application on the display screen.

In some of the embodiments described above, the communication application may be specifically executed by the processor 12 to display a plurality of contact information on the display.

In practical application, when the operating system is started or is regarded as the communication device is awakened, the touch screen displays a plurality of contact information. The communication device is awakened from a power-off state to a power-on state, or from a state that the screen is changed into a bright state after being dark for a period of time, and the like.

It should be noted that, in the embodiment of the present invention, the display of "touch screen" may also be referred to as "touch screen" or "touch front screen" display. The communication application program provided by the embodiment of the invention is exclusively displayed on the screen in the communication device, and the plurality of contact information can be always displayed or can be displayed based on a specific gesture operation of a user during the running of the communication application program and the whole running process. In general, communication applications are more difficult for a user to access (almost have no access to) other programs via a display while they are displayed by a display. By adopting the exclusive setting mode, communication contacts are used as centers or are used as guidance, and communication resources such as a plurality of communication information or user interfaces aiming at communication networks are integrated and configured in priority at the upper layer of the interaction level, so that accessibility of contact related information and communication entrance is greatly facilitated.

In addition, in the process of displaying the plurality of contact information on the touch screen, the interface bearing the plurality of contact information is the interface of the highest level of the communication application program, which is equivalent to the top layer in the interface interaction level, and is displayed first along with the starting of the communication application program.

Among these, setting the communication application as a desktop interactive program can be considered as a means for realizing display of a plurality of contact information on a screen.

The plurality of contact information may be configured by the user himself or may be configured remotely by another person. The contact information in the following embodiments, which is also referred to as contact profile information (profile), may include basic user information such as a name, an avatar, a phone number, etc. of the corresponding contact.

Alternatively, in the embodiment of the present invention, the communication application may not be set as a desktop interactive program, but may be one of many applications on the desktop of the user terminal device, and the user may start the communication application by clicking an icon of the communication application. At this time, after the communication application is started, the plurality of contact information may be displayed first.

Whether displaying the plurality of contact information on the touch screen or after the user manually initiates the communication application, in an alternative embodiment, the displaying of the plurality of contact information may be implemented as: the processor 12 executes a communication application to display a contact interface on the display, the contact interface displaying a first set of contact information of the plurality of contact information; a second set of contact information or application portal of the plurality of contact information is displayed in the contact interface in response to a user-applied switching operation.

In this embodiment, as shown in fig. 2, when a communication device of a user is started, the processor 12 may load a communication application program and display a contact interface of the communication application program on a screen, where the plurality of contact information may be located in the contact interface, and the contact interface may be a home page of the communication application program.

In practical applications, for a user, the total number of contacts may be less or more, but if all the contact information is displayed in the same screen, on one hand, the interface is too messy, on the other hand, the area occupied by the information of each contact may be too small, so that the user cannot find the required target contact conveniently, therefore, alternatively, when the total number of contacts is more, such as greater than a certain value, the contacts may be displayed in groups, and each group contains a small number of contacts, such as two and three contacts. An upper limit on the number of contacts that can be accommodated within a contact group may be set such that the number of contacts contained within each contact group does not exceed the upper limit.

Based on this, as shown in fig. 2, alternatively, the processor 12 may display a plurality of contact information on a screen, which may be implemented as:

Displaying a first contact group in a contact interface;

and responding to the switching operation of the user, and switching and displaying a second contact group or an application program entry in the contact interface.

The first contact group and the second contact group are short for the first contact information group and the second contact information group.

One or more application icons, namely application portals, can be further included in the contact interface, so that a user can click on a certain application icon to use a corresponding application program when needed. At this time, optionally, the display priority of the application icon may be set lower than the display priority of the contact, and therefore, in response to the switching operation of the user, the second contact group or the application icon may also be displayed in a switching manner in the contact interface.

In particular, each contact group may comprise a single contact information or 2 to 4 contact information, i.e. related information of one contact or related information of 2 to 4 contacts. In general, it is not preferable to include too much contact information in each contact group to avoid including too much contact information such that the display size of each contact information is too small for the user to view.

Based on the display of the contact interface, during execution of the communication application, the processor 12 may also display a first contact interaction interface corresponding to the first contact information on the display in response to a user selection of the first contact information in the contact interface, and record the voice message and/or the video/image message on the first contact interaction interface in an identified manner. Wherein the first contact information is located in the first contact information group or the second contact information group.

In fig. 2, it is illustrated that, after the user terminal device is turned on, a first contact group including contacts 1 and 2 is displayed in a contact interface, if no contact required by a user is in the first contact group, the user may apply a switching operation such as sliding on the interface, and at this time, based on the switching operation, an icon of the application 1 and a second contact group including contact 3 are displayed in the contact interface in a switching manner. If contact 2 in the first contact group is the contact for which the user desires to communicate, the user selects contact 2 as the peer user. At this time, an interactive interface corresponding to the opposite terminal user may be further displayed, and the interactive interface may include historical communication information and some function buttons of the opposite terminal user.

Of course, if the user selects the icon of the application 1, the user responds to the selection operation of the user on the application icon, and then a corresponding application interface is displayed, and the user can finish the use of the application in the application interface.

As shown in fig. 2, in the interactive interface corresponding to the contact 2, profile information such as a head portrait, a name, etc. of the contact 2, and some function buttons such as a "back" button illustrated in the figure are displayed in an upper area of the interactive interface. The remaining area is a history communication information display area in which various communication messages that the user has transmitted to the contact 2 and various communication messages that the contact 2 has received to transmit can be displayed.

Taking a voice message as an example, as shown in fig. 2, the voice message sent by the user to the contact 2 and the voice message sent by the contact 2 to the user may be represented by bars in different styles, and the differences in styles may be represented by differences in color, shape, and the like, for example. In addition, each bar may be associated with identification information such as a length of time, whether the bar has been read, etc.

For video/image messages and picture messages, they may be presented in the form of thumbnails. For a text message, if the number of text words is too long, only a certain number of partial text words may be displayed.

In the embodiment shown in fig. 2, the processor 12 optionally highlights second contact information or an application entry adjacent to the first contact information in the contact interface in response to a preset gesture operation by the user on the interactive interface of the first contact during operation of the communication application. At this time, if not the contact interface but an interactive interface with a certain counterpart user or an application program interface is displayed on the screen of the current communication device, the user may also directly return to the contact interface through a certain gesture operation, and may switch to displaying the effect of the next contact of the current contact, so that the user may reselect another counterpart user, and thus may trigger communication to another counterpart user, for example, a multi-finger pinch operation, a sideslip operation, or the like.

In another alternative embodiment, the display of the plurality of contact information may be implemented as: the processor 12 executes a communication application to display a first area and a second area on the display, to display at least a portion of the plurality of contact information in the first area, to maintain the first area in a set-top display state, and to be displayed always at a top-most level of the visual interaction level such that the plurality of contact information is always within the field of view of the user. By adopting the exclusive setting mode, communication contacts are used as centers or are used as guidance, and communication resources such as a plurality of communication information or user interfaces aiming at communication networks are integrated and configured in priority at the upper layer of the interaction level, so that accessibility of contact related information and communication entrance is greatly facilitated.

In these embodiments, the user selection process for the plurality of contact information may be: displaying the selected first contact information in the second area according to the selection operation of the user on the plurality of contact information; responsive to a confirmation operation of the user for the first contact information in the second area or the first area, displaying a first contact interaction interface corresponding to the first contact information in the second area, and recording voice messages and/or video/image messages on the first contact interaction interface in an identifying manner; wherein the second region has a size greater than the size of the first region. At this time, the first contact is the opposite end user of the communication of the user.

The user may perform, for example, a clicking operation on the first contact information displayed in the second area, so as to consider that the user performs a confirmation operation on the first contact information, and determine that the first contact is a peer user. The user may perform, for example, a click operation on the first contact information in the first area, so that the user is considered to trigger a confirmation operation for the first contact information, and the first contact is determined to be the opposite-end user.

Additionally, optionally, during execution of the communication application, the processor 12 may also highlight second contact information adjacent to the first contact information in the first area and display the second contact information in the second area in response to a preset gesture operation applied by the user with respect to the interface displayed in the second area. Based on the above, whether a certain interactive interface is displayed on the current display, a certain functional interface under the interactive interface or a certain application program interface, the user can quickly switch to display the effect of the next contact of the current contact through a certain gesture operation, so that the user can reselect another opposite-end user.

In this embodiment, as shown in fig. 3, when a communication device of a user is started, the processor 12 loads the communication application and then displays a user interface of the communication application on a screen, and the user interface may be divided into two areas, which are called a first area and a second area. As shown in fig. 3, the first region may alternatively be located below the second region. And displaying a plurality of contact information in the first area. Optionally, in addition to the plurality of contact information, an identifier of a plurality of applications, such as icons, may be displayed in the first area, that is, access to other applications used by the user is also provided to the communication application.

The plurality of contact information and the plurality of application identifications may be displayed in a line in the first area. It will be appreciated that, limited to the screen size of the user terminal device, when the number of contacts and applications is large, the number of contact information and application identifications that can be displayed simultaneously at most in the first area may be set, for example, to 3, so that, assuming that there are a total of 5 contact information and application identifications, in the case where the first three have been displayed, the user can slide the display of the remaining two by a sliding operation, for example, to traverse one time to the left, the first one that has been displayed on the left side removes the display field of the first area and the fourth one moves in.

In this embodiment, the first area is kept in the set-top display state, which means that the first area is displayed as a top interface of the communication application program, and the first area is not limited to be displayed on the top of the screen, and thus, the first area is set-top display and may also be referred to as set-front display. The first area is displayed by the top setting, so that a user can conveniently select a current required contact in the first area when communication with another contact is required to be established in the process of communication with the certain contact or in the process of using the certain application program. And the second area is used for displaying interface contents such as an interactive interface with the contact person, interfaces of other application programs and the like.

In this embodiment, it is still assumed that the first area is capable of displaying related information of 2 contacts at the same time. Assuming that the above-mentioned related information of the example contact 1 and contact 2 is displayed in the first area at the beginning, the first contact information displayed by default is placed in the selected state, then the contact 1 may be placed in the selected state at this time, so that profile information (profile), such as enlarged head portrait, phone number, etc., of the contact 1 in the selected state is displayed in the second area, after which the user may switch the contact currently in the selected state by a sliding operation in the first area or the second area, such as the user performs a sliding operation from right to left once, and the profile information (profile), such as enlarged head portrait, phone number, etc., of the contact 2 is displayed in the second area when the contact 2 is placed in the selected state. Then, when the user performs a sliding operation from right to left once again, since the first contact group has been switched to display, icons showing the second contact group and the application 1 are switched at this time, and at this time, the contacts 3 within the second contact group are placed in a selected state, profile information (profile) of the contacts 3, such as enlarged head portraits, telephone numbers, and the like, is displayed in the second area. If contact 2 is the desired end user of the user, the user may click on the avatar of contact 2 in the second area to complete the confirmation operation for contact 2.

When the user selects the contact 2 as the opposite user, optionally, as shown in fig. 3, an interactive interface corresponding to the opposite user, that is, an interactive interface corresponding to the contact 2, may be displayed in the second area. The interactive interface may include a history of communications with the peer user and a number of function buttons. Alternatively, in response to a user selection operation of the application icon displayed in the first area, an application interface may also be displayed in the second area.

As shown in fig. 3, the interactive interface corresponding to contact 2 occupies a second area in the screen, the first area still remaining displayed. The interactive interface displays profile information such as the head portrait, name, etc. of the contact 2 and some function buttons, such as a "back" button illustrated in the figure. The remaining area is a history communication information display area in which various communication messages that the user has transmitted to the contact 2 and various communication messages that the contact 2 has received to transmit, such as voice messages illustrated in fig. 3 in different styles of bars, can be displayed.

In the embodiments shown in fig. 2 and 3, optionally, among the plurality of contact information, a differential display effect may be set for a part of contact information, where the contact corresponding to the part of contact information may be a main contact of the user, so that the user may more conveniently find the main contact through the differential display effect. The differential presentation effect may be, for example, rendering the contact information in a certain highlighting color, or displaying the primary contact's avatar in a larger avatar size than the other contacts, etc.

In another alternative embodiment, the display of the plurality of contact information may be implemented as: the processor 12 executes a communication application to display a first contact interaction interface corresponding to a first contact on a display. If the user triggers the first operation or the second operation under the display condition of the first contact interaction interface, the first contact is used as the opposite user, and at this time, in response to the first trigger signal, the processor 12 acquires the voice message and/or the video/image message through the microphone and/or the camera, and sends the voice message and/or the video/image message to the first contact through the wireless data transmission network by the wireless data transmission unit 15; in response to the second trigger signal, voice messages and/or video/image messages received by the wireless data transmission unit 15 via the wireless data transmission network from the first contact or the second contact are output via the second speaker and/or the display and the voice messages and/or video/image messages are recorded on the first contact interactive interface in an identifying manner.

Wherein the second contact may not be user-selected, but rather the second contact is automatically treated as an opposite user upon receipt of a second media signal, i.e. a voice message and/or a video/image message, sent by the second contact. It can be appreciated that when receiving the second media signal sent by the plurality of contacts and not output, the corresponding opposite-end user when the user triggers the second operation can be determined according to the preset priority of the contacts.

In this embodiment, as shown in FIG. 4, during operation of the communication application, processor 12 may display a second contact interactive interface corresponding to the second contact on the display; and responding to the switching operation of the user, and switching and displaying the first contact interaction interface on the display. At this time, if the first contact interaction interface is displayed on the screen when the user triggers the first operation on the physical keyboard, it is determined that the first contact is the opposite user.

The second contact interaction interface may be a previous interface of the first contact interaction interface.

In this embodiment, each contact interaction interface may include related information of the corresponding contact, historical communication record information between the user and the contact, and some function buttons. The relevant information of the contact includes, for example, information such as an avatar, a telephone number, a name, and the like of the contact.

Alternatively, the switching display sequence of each contact interaction interface may be set in advance according to the importance degree and the creation sequence of each contact of the user.

The user can perform switching operation on the contact interaction interface, such as sliding operation of horizontal drawing to the left, and when the next contact interaction interface is switched and displayed on the screen every time the switching operation is performed, until the contact corresponding to the contact interaction interface to be switched and displayed is the contact which the user currently wants to communicate, the user stops performing the switching operation, and then triggers a certain operation on the physical key according to the communication requirement.

It will be appreciated that the above-mentioned selection procedure of several optional peer users is often required to be performed when the user needs to send data to a specific contact, and if, for example, the user receives data sent by a specific contact and immediately triggers playing of the received data, it may be considered that the selection procedure of the peer user is not required at this time, that is, it is not required to select which contact to play the data sent by.

Thus, in the case that the user needs to select the opposite-end user according to the communication requirement of the user, taking fig. 2 or fig. 3 as an example, in the embodiment of the present invention, if the user wants to establish communication with the opposite-end user, the operations that need to be performed sequentially include only: waking up the communication device (such as powering on or lighting up a screen) to directly display a plurality of contact information; selecting a peer user from the plurality of contact information; and triggering corresponding operation on the physical keyboard according to actual communication requirements. The operation process is greatly simplified.

The above operation is simplified, and as can be seen from the cases illustrated in fig. 2 to 4, the interface layers in the communication application provided by the embodiment of the present invention are less, and only two or three layers are provided. Such as in the embodiment shown in fig. 2 and 3: the first layer is an interface carrying a plurality of contact information, the second layer is an interactive interface or an application program interface of the contact, and the third layer is a functional interface which is entered by triggering a functional button in the interactive interface or the application program interface. In the embodiment shown in fig. 4: the first layer is an interactive interface or an application program interface of the contact person, and the second layer is a functional interface which is entered by triggering a functional button in the interactive interface or the application program interface.

In other words, in the embodiment of the invention, the interface level of the communication application program is simplified, that is, the interface level of the communication application program is flattened more, so that the flattened interface level reduces the interface interaction times required for establishing communication with a certain contact person, and on the other hand, the size of the installation package of the communication application program is effectively compressed, and the occupation of storage resources and processing resources of the user terminal device is reduced.

The foregoing describes the process of selecting a contact by the user through the interface operation, and after selecting a desired contact, the user may operate the physical keyboard 11 according to the communication requirement, thereby triggering communication with the selected contact.

However, it should be noted that the selection of the contact may be implemented not only by means of interface operations, but also by means of physical keys.

The following description will be given by way of example only, and not by way of limitation, of several alternative embodiments of the physical keyboard 11 and the process of establishing communication via the physical keyboard; the contact is selected by the physical key, and the physical keyboard 11 is operated to trigger the communication process with the selected contact.

Key/button layout and its form and function

Fig. 5a is a schematic structural diagram of a physical keyboard according to an embodiment of the present invention, as shown in fig. 5a, where the physical keyboard includes a first key 21 and a second key 22, and optionally, the first key 21 and the second key 22 are detachable with respect to a main body of a communication device, such as a mobile phone, and may be disposed on a separate base (not shown in the figure) and connected to a processor in a terminal communication device through a physical interface (not shown in the figure) of a connector between the main body of the communication device and the base.

The first key 21 and the second key 22 may be provided on the first face (front face) or the second face (side face) of the housing, for example, in an adjacent manner. The two physical keys can be square or round or other shaped outline structures. Of course, the first key 21 and the second key 22 may be disposed in a dispersed manner, for example, one disposed on the first surface of the housing and one disposed on the second surface of the housing; alternatively, the first key 21 and the second key 22 are provided on the same surface of the housing in a dispersed manner. In other alternative modifications, the first key 21 and the second key 22 may be connected together or integrally provided, and the key arrangement mentioned herein may be applied to the above or the following other embodiments of the present invention, and other parts will not be described herein.

Wherein the first key 21 may issue a first trigger signal to the processor 12 in response to a first single action by the user. At this time, the processor 12 collects a first media signal shorter than a preset time period through the media collection unit 13 in response to the first trigger signal, and transmits the first media signal through the wireless data transmission network through the wireless data transmission unit 15. Wherein the second key 22 may issue a second trigger signal to the processor 12 in response to a second single action by the user. The processor 12 outputs a second media signal received by the wireless data transmission unit 15 via the wireless data transmission network through the media playing unit 14 in response to the second trigger signal.

Wherein the first media signal and the second media signal may comprise a voice message and/or a video/image message, respectively, having a duration shorter than a preset duration.

As illustrated in fig. 5a, the first key 21 and the second key 22 may be keys, may be coupled to the processor directly or through a physical interface (not shown) and may be detachable with respect to the handset through the physical interface. Thus, in the present embodiment, the first single action may be a long press operation (one press but the duration of the press is long, such as at least 2 seconds), and the second single action may be a simple operation such as a single press operation (one press and the duration of the press is short, such as not more than 1 second), a rapid multiple continuous press operation, or the like.

In this embodiment, the two physical keys are set so that the user can implement different communication requirements, such as sending a first media signal and playing a received second media signal, by operating the two physical keys respectively.

It should be noted that, in this embodiment, the user can realize the communication requirement for the voice message or the audio-video message of the contact person through the one-key operation by the collection and the sending of the first media signal, and at this time, the processor 12 can respond to the first trigger signal to collect the first media signal not exceeding the preset duration through the media collection unit 13.

Specifically, the processor 12 may control the longest collection duration (i.e. the above-mentioned preset duration) for which the media collection unit 13 works once, for example, 1 minute, so that the user can only send the first media data to the contact for at most 1 minute at a time, and when the user still needs to continue to send, the first key 21 may be triggered again to perform the first operation once again. In practical applications, taking the first single action as an example of a long press operation, the user may perform a long press operation on the first key 21 to trigger the collection of the first media data (for example, voice), after the user presses the first key 21, the user may start speaking, at this time, the media collection unit 13 starts to collect the voice of the user under the control of the processor 12, if the pressing duration has not reached the above-mentioned longest collection duration, the user releases the key, and the media collection unit 13 stops collecting under the control of the processor 12 and sends the collected voice to the processor 12. Conversely, if the user has not released the key when the duration of the pressing has reached the above-described maximum acquisition duration, the media acquisition unit 13 may also stop the acquisition under the control of the processor 12 and send the voice that has been acquired to the processor 12.

In this example, after the user performs the first single action on the first key 21, the media capturing unit 13 may be caused to record the first media signal for a certain period of time, and then the recorded first media signal is sent out by the processor 12, that is, the user may be able to implement the voice message to the contact.

In practical applications, during the process of sending the first media signal, the processor 12 may first perform compression encoding processing on the first media signal by using a certain encoding standard, for example, h.264, and then encapsulate the compressed and encoded first media signal according to a certain network transmission protocol, for example, TCP, UDP, etc., and send the encapsulated data packet to the opposite terminal contact.

In this embodiment, the first key 21 and the second key 22 may be separately operated to trigger the acquisition and transmission of the first media signal and the playing of the second media signal, respectively, and alternatively, the first key 21 and the second key 22 may send a third trigger signal to the processor 12 in response to the third operation, and the processor 12 initiates an audio-video call through the wireless data transmission network via the wireless data transmission unit 15 in response to the third trigger signal. The third operation may be a pressing operation applied to the first key 21 and the second key 22 at the same time.

Specifically, the user may apply a third operation to the first key 21 and the second key 22, i.e., simultaneously pressing the first key 21 and the second key 22, after selecting a certain contact in the communication application. At this time, the first key 21 and the second key 22 respectively send the third trigger signal to the processor 12, and the processor 12 receives the third trigger signals sent by the first key 21 and the second key 22 respectively at the same time or in a shorter time interval, so as to initiate an online audio/video call to the corresponding contact.

It will be appreciated that if the contact answers the audio/video call, the processor 12 may control the media capturing unit 13 to start capturing the media signal of the user (referred to as a third media signal), and send the real-time captured third media signal to the contact side, where the third media signal may be an audio/video signal captured through a microphone and a camera.

To more clearly illustrate that different operations on the first key 21 and the second key 22 correspond to different communication procedures, e.g.

Fig. 5b illustrates a correspondence between different operations performed on the first key 21 and the second key 22 and different communication procedures: a long-press operation is carried out on the first key 21, a first media signal shorter than a certain time length is triggered to be recorded, and the first media signal is sent after the first media signal is released; a short pressing operation, i.e. a single pressing operation, is performed on the second key 22, triggering playing of the received second media signal; simultaneously pressing the first key 21 and the second key 22 initiates an audio-video call.

Of course, optionally, the physical keyboard may further include another key disposed adjacent to the first key 21 and the second key 22, where the aforementioned initiation of the audio/video call may be implemented by performing a short-press operation on the other key.

In summary, through the two physical keys (the first key and the second key) provided in the embodiment, the user can realize the communication requirements of voice message, message receiving playing and online audio/video call through simple operation of the two physical keys.

Fig. 6a is a schematic structural diagram of another physical keyboard according to an embodiment of the present invention, as shown in fig. 6a, the physical keyboard includes a third key 31.

In this embodiment, the third key 31 may send the first trigger signal and the second trigger signal to the processor 12 directly or through a physical interface in response to the first single action and the second single action, respectively.

The processor 12 collects a first media signal shorter than a preset time period through the media collection unit 13 in response to the first trigger signal, and transmits the first media signal through the wireless data transmission network through the wireless data transmission unit 15. The processor 12 outputs a second media signal received by the wireless data transmission unit 15 via the wireless data transmission network through the media playing unit 14 in response to the second trigger signal.

Optionally, a third key 31 may also issue a third trigger signal to the processor 13 in response to a third single action. In response to this third trigger signal, the processor 12 initiates an audio-video call via the wireless data transmission network through the wireless data transmission unit 15.

In this embodiment, through a single action operation on one physical key, the user can realize the communication requirements of sending a section of media signal, playing the received media signal, and initiating an online audio/video call.

Alternatively, as shown in fig. 6a, the third key 31 may be a key, so that operations that may be performed on the key include, for example: single press operation, relatively continuous multiple press operation, long press operation. Thus, alternatively, the above-described first operation, second operation, and third operation may be a long press operation, a single press operation, a multiple press operation, respectively. The response processing logic of the user to trigger different operations of the post-processor 12 may refer to the description in the foregoing embodiment, and is not repeated.

When the third key 31 is implemented as a key, in order to more clearly illustrate that the different operations performed on the third key 31 correspond to different communication processes, as shown in fig. 6b, a correspondence relationship between the different operations performed on the third key 31 and the different communication processes is illustrated: performing long-pressing operation on the third key 31, triggering recording of a first media signal shorter than a certain time length, and sending the voice message after loosening; performing short pressing operation, namely single pressing operation, on the third key 31 to trigger playing of the received second media signal; and performing short pressing operation on the third key 31 for a plurality of times to initiate an audio-video call.

In summary, through the physical keyboard 11 provided on the communication device according to the embodiment of the present invention, a user can realize different communication requirements only by performing simple operations on at least one physical key included in the physical keyboard 11, so that the operation is convenient, and the timeliness and reliability of sending a communication message to a contact by the user and the timeliness of receiving a communication message sent by the contact are also ensured.

The foregoing describes several implementations of the physical keyboard 11 on a communication device, which may have different implementations in practical applications. For example, the communication apparatus may be implemented as a communication terminal such as a smart phone, a tablet computer, or the like, may be implemented as a portable terminal device, may be implemented as a remote controller, or the like. In the following, several specific implementations are described in connection with the following embodiments.

Button and hostSeparable design

In an alternative embodiment, as shown in fig. 7, the communication device is embodied as a communication terminal such as a smart phone, tablet computer, or the like. The physical keyboard illustrated in fig. 7 includes the third key and the fourth key mentioned in the foregoing embodiments, wherein the third key is illustrated as a key with an L/T letter and the fourth key is illustrated as a key with an E letter. At this time, the front side of the communication device further includes a display with a larger size, and the display supports the triggering operation, so that the display may also be a touch screen, and may be used to display interface elements such as the contact interaction interface illustrated in fig. 7. The physical keyboard is shown in fig. 7 in a position below the display, but the physical keyboard may be located on the left or right side of the display, for example, without limitation.

Additionally, in some alternative embodiments, a housing of the communication device may be further provided with a warning light that reflects the operating state of the communication device, such as a warning light that reflects whether the power is sufficient (e.g., the power warning light illustrated in fig. 7), and blinks or lights up when the power is low to prompt the user to charge the communication device; such as a warning light reflecting the status of network connection (e.g., a network warning light as illustrated in fig. 7), blinks or lights up when the network quality is abnormal to warn the user that the network is poor.

In addition, as shown in fig. 7, a power key, a volume adjustment key may be provided on the side of the communication device.

In an alternative embodiment, as shown in fig. 8, the communication device is embodied as a remote control for use with some kind of intelligent terminal. Communication between the remote controller and the intelligent terminal can be established in a wireless or wired mode, such as Bluetooth, infrared and other communication modes.

The physical keyboard described in the foregoing embodiments may be provided in the remote controller. Alternatively, however, a physical keyboard may be provided in the smart terminal, and in addition, the instant messaging application program mentioned in the foregoing embodiment may be installed in the smart terminal.

The physical keyboard in the remote controller illustrated in fig. 8 includes a first key, a second key, and a fourth key, wherein the first key is illustrated as a key with an L-letter shape, the second key is illustrated as a key with a T-letter shape, and the fourth key is illustrated as a key with an E-letter shape.

In a further alternative embodiment, as shown in fig. 9, the communication device is embodied as a portable terminal device, in which a physical keyboard as described in the previous embodiments and one or several digital displays may be provided.

The physical keyboard located in the terminal device illustrated in fig. 9 includes a first key, a second key and a fourth key, wherein the first key is illustrated as a key with an L-shape, the second key is illustrated as a key with a T-shape, and the fourth key is illustrated as a key with an E-shape.

The terminal device illustrated in fig. 9 is provided with two digital displays, each associated with two switching buttons. The first digital display is used for switching and displaying contact information, and the second digital display can display the number of unread messages corresponding to the contacts displayed on the first digital display and display the unread messages in a switching way.

It should be noted that "recording voice messages and/or video/image messages with identification" mentioned in the foregoing embodiment is mainly embodied in this embodiment by displaying the contact information, the number of unread messages of a part type and the unread messages through a digital display, where the part type may be a voice message or a text message.

In yet another alternative embodiment, as shown in fig. 10, the communication device is embodied as a terminal device having a detachable controller. The physical keyboard described in the foregoing embodiments may be provided in the controller, which is connected to the terminal device main body through the connection interface. That is, the physical keyboard is a separate physical component that is detachably disposed on the housing of the communication device and communicatively coupled to the processor 12 via a wired and/or wireless interface.

The physical keyboard located in the controller illustrated in fig. 10 includes a first key, a second key, and a fourth key, wherein the first key is illustrated as a key with an L-letter shape, the second key is illustrated as a key with a T-letter shape, and the fourth key is illustrated as a key with an E-letter shape.

Integrated interactive interface

It should be appreciated that: in' Integrated interactive interfaceAny of the methods or apparatus according to embodiments of the invention mentioned hereinafter may be used in conjunction with the foregoing methods including, but not limited to "Key/button layout and its form and function”“Button and host computer separable equipment Meter with a meter body"etc. in accordance with the description of the method or apparatus of the embodiment of the present invention, or seek to implement means, etc.

In the process of researching the electronic equipment, such as mobile terminal devices like mobile phones, the inventor finds that in the software system and the communication system in the prior art, different application programs independently receive and present data and utilize communication resources; the applications also each design independent interoperation, and there is no possibility of integrating data and resources of each application for use by users, and there is an unaware need in the prior art, and accordingly, the related solutions are also lacking. Under the existing architecture of operating system software and application software, users need to perform independent interaction with respect to different application programs respectively in the process of accessing required data through an interaction interface of the electronic device, which reduces the efficiency of accessing data or information stored in different application programs by the users.

The method or apparatus according to the embodiments of the present invention will be described below with reference to an electronic device or a communication apparatus having a communication function, such as a mobile phone. FIG. 11 is a schematic diagram of a prior art system architecture for establishing communication with contacts via a mobile terminal, and the following will describe the system architecture in conjunction with FIG. 11 to reduce the inefficiency of a user to obtain data from multiple applications via human-computer interaction. As shown in fig. 11, the existing man-machine interaction, the access relationship between the person and the program can be clearly expressed. The prior art is to configure communication resources with multiple communication applications in an operating system as a guide, which makes it necessary for a user to access different application programs 1101 and application programs 1102 respectively, even if multiple communication information, such as Short Messages (SMS) and voice messages, are directed to the same contact person, where the different information corresponds to different services respectively, and may come from different communication networks, or occur (ocur) respectively through different communication networks or corresponding network interfaces. Such as from the mobile phone network 1108 and the WLAN (Wireless Local Area Networks, wireless local area network) network 1107, respectively, this configuration of the decentralized communication resources for the same contact 1103 is due on the one hand to the diversification development in the evolution of the communication network and on the other hand to the diversification development of the application development ecology in the development of the software technology, but of course there may be other reasons, but in any event this results in that the information of this contact 1103 is stored decentralized in different applications and that the various communication information similar to the one mentioned above for this contact is also required to be handled and stored decentralized in different applications, respectively. In addition, this situation also results in the user 1104 having to access to different applications, the application 1101, the application 1102, etc., respectively, and perform different or somewhat repetitive, large number of, multi-level interactions with respect to each application, respectively, to obtain the corresponding information. And each application program has independent interaction interfaces and information presentation modes, and the possibility of integrating the application programs by taking user interaction as a guide does not exist.

Some users also desire that some applications in the electronic device be easily accessible, e.g. that portals for these applications be intuitively available at the first layer of the interaction hierarchy of the software system of the electronic device. For electronic devices for communication, users may also want to provide more consistency or correspondence between their user interface for communication functions and interfaces for applications providing other functions such as photographing or photo album, to enhance the operability across interfaces, and even provide user interfaces that are consistent across software and hardware, during use of the electronic device.

Cross-interface graphic element providing method and device

Based on the inventors' findings of these deficiencies of the prior art and the corresponding studies of potential needs; in one embodiment of the present invention, a resource providing method for an electronic device is provided, optionally, the method may be run at an electronic device having a processor unit, a memory, and a display, fig. 20 is a flow chart of an interface element providing method according to the embodiment of the present invention, as shown in fig. 20, the interface element providing method includes:

In step 2001, a first interactive interface is displayed on the electronic device.

In step 2002, a plurality of communication information corresponding to at least one communication network is integrated and output through a first interactive interface.

Wherein the plurality of communication information is generated by communication via at least one communication network, such as a voice message, a video message transmitted by the at least one communication network, or an incoming/outgoing phone call record via the at least one communication network, etc.

In step 2003, the second interactive interface is displayed on the electronic device in a switching manner in response to the switching operation.

Wherein first and second user interface elements corresponding in form or function are provided on the first and second interactive interfaces, and the first user interface element is associated with at least one communication network for the first interactive interface.

Correspondingly, in another embodiment of the present invention, there is also provided an electronic device, including: a display; a processor unit; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit to: i) Displaying a first interactive interface on the electronic device; ii) integrating, via the first interactive interface, a plurality of communication information corresponding to the at least one communication network; iii) And responding to the switching operation, and switching and displaying the second interactive interface on the electronic equipment. Providing user interface elements on the first interactive interface and the second interactive interface respectively; wherein the user interface element on the first interactive interface is associated with at least one communication network. As an interface element, the user interface element is operable by the processor to establish a plurality of communications information via a plurality of communications networks available to the electronic device in response to a user operation.

In addition, for users, old people and some general users desiring to simplify man-machine interaction, they pay more attention to a certain communication object in an electronic device such as a mobile phone, and the content of communication information itself generated between the communication object and the communication object can be conveniently accessed, rather than what application program or communication channel the communication information is provided by, for example, in a use scene of the mobile phone, some users pay more attention to communication with contacts in the mobile phone, such as short messages sent and received through a mobile phone network, dialing/answering a phone, or voice messages sent or received through a wireless data transmission network, incoming and outgoing web phones, etc.; however, these contact information and the communication information of the related contacts are stored in different application programs in a decentralized manner, for example, in the existing smart phone, the contacts need to be stored in a phone address book, and the contacts need to be stored in an internet communication tool, although in many cases, the two corresponding contacts are the same contact, which causes redundancy of information. This is determined by the software architecture of the multi-application plus operating system described above, and is not described in detail herein.

As described above, this potential problem arises in part because the existing multiple application software developed by different vendors and running on an operating system is a technical problem that a technician cannot predict as necessary and cannot be solved under the prior art architecture.

The potential need in the above-described scenario has not been identified in the prior art, but based on the above-described research effort and the discovery of solutions to the deficiencies of the prior art, the inventors have recognized that it would be beneficial if the accessibility (accessibility) of the communication information or the user interface for communication by the user during interaction with the electronic device could be improved. This means that it is necessary to propose a way to redesign the interactive interface or man-machine interface of the electronic device, which is guided by the user interaction, rather than by the architecture of "operating system + multi-application" in the prior art.

Some embodiments of the first resource providing method

Based on the inventors' findings of these deficiencies of the prior art and the corresponding studies of potential needs; in an embodiment of the present invention, a resource providing method for an electronic device is provided, optionally, the method may be run at an electronic device having a processor unit, a memory, and a display, fig. 12 is a flow chart of the resource providing method according to the embodiment of the present invention, as shown in fig. 12, the resource providing method includes:

In step 1201, communication is established with a first communication object over at least one communication network available to the electronic device to generate a plurality of communication information.

In step 1202, a plurality of communications are provided to a user of an electronic device through at least one interactive interface of the electronic device.

From the viewpoint of user interaction, the above step 1202 may be understood as taking the first communication object as a guide to configure the communication resources and the communication information on the interactive interface in the communication process of the user and the first communication object through the electronic device, or taking the first communication object as a center (center) to reconfigure the communication resources on the interactive interface in the communication process of the user and the first communication object through the electronic device, which also improves the accessibility of a plurality of communication information for the user. This is quite different from the configuration of communication resources in the prior art, which is often conducted by taking communication resources such as communication functions, communication applications, communication channels, and the like as directions.

Meanwhile, it should be noted that: the first communication object mentioned in the above step may be a company or a person as a communication object, or a virtual object such as a robot, chat application software, or the like. And in particular to establish communication with the first communication object, it may be that the communication with the first object is actually performed by means of a communication tool associated with the first communication object, which communication tool has access to the at least one communication network.

The communication means associated with the first communication object may be understood as a communication device in a hardware form used by the first communication object or a communication means in a software form running on an entity communication device, for example, the former may be a mobile device for communication with an operating system or without an operating system, the latter may be instant messaging software running on an entity electronic device, or the like.

Optionally, in some embodiments of the present invention including embodiments under the heading "cross-interface graphic element providing method and apparatus", the at least one communication network may include a plurality of wireless communication networks, or may further include one or more wired communication networks, and in some embodiments below, the resource providing method in the embodiments of the present invention may be described taking a scenario in which a user establishes communication with a certain (indirect) contact using a mobile terminal connected to the plurality of wireless communication networks as an example. For example, if the first contact uses two electronic devices, i.e. a mobile phone and a tablet computer connected to the internet, one of the communication tools corresponding to the first contact in at least one communication network is: the mobile telephone corresponding to the first contact in the mobile telephone network is provided with a telephone number, for example 1376118xx52, in the mobile telephone network through which the communication is addressed in the network. The tablet personal computer is provided with Instant Messaging (IM) software, and another communication tool corresponding to the first contact in at least one communication network is the Instant Messaging (IM) software; the tablet computer is allocated with address information such as an IP address and a port number on the internet, and the instant messaging software can be addressed to communicate through the address information. Of course, the user may change the communication tool, for example, log in the instant messaging software in another computer, smart phone, tablet, etc., and at this time, the communication network and network address (IP, network segment) where the user is located may also change, so that the electronic device of the user may communicate with the first contact person through the communication network based on the changed address information.

Here, those skilled in the art will understand that: the user communicates with the contact via the mobile terminal, in effect via an electronic, optoelectronic or photonic medium/channel or network, with the communication device or means associated with the communication object or contact, and the communication address used is also typically the destination address assigned to the communication device on a network or network information similar to the communication means that enables the user to be identified and located on the communication network. Hereinafter, details of such communication will not be described again. While in some embodiments of the invention described above or below, it may be simplified to describe: the user establishes communication with the communication object or contact via the mobile terminal, etc.

In the resource providing method of some embodiments of the present invention including the embodiment under the heading "cross-interface graphic element providing method and apparatus", the plurality of communication information may have a plurality of different attributes, for example, a plurality of different media types, services belonging to different properties, communication networks from different service properties, etc., and the above-mentioned first communication object may be a first contact, as a communication object, stored in the mobile terminal by a user (not shown in the drawing), and the step 1201 of integrally providing may further include the steps of: the plurality of communication information is integrated and output to at least one interactive interface for the first contact. Wherein the number of at least one interactive interface is smaller than the number of "a plurality of different properties". The at least one interactive interface, if comprising a plurality of interactive interfaces, for example a plurality of interactive interfaces for the first contact, may appear continuously in the sequence of interactive interfaces of the communication device or may appear independently at different positions in the sequence of interactive interfaces of the communication device due to a plurality of unassociated operations of the user.

Alternatively, on the same interaction interface level (hierarchy), only one interaction interface may be set for the same contact, for which case, the first contact interaction interface is hereinafter referred to as a first contact interaction interface, for communication interaction with the first contact. Of course, a plurality of interaction interfaces may also be provided, for example, two communication interaction interfaces are configured in the mobile terminal of the user, in the first communication interaction interface, or may also be referred to as a first communication recording interface, a voice message between the two communication interaction interfaces and the first contact person is provided in an integrated manner, a recording of a video/voice call through a wireless local area network/mobile data network, a short message sent and received through a mobile phone network is provided in an integrated manner, a video message between the two communication interaction interfaces and the first contact person through a wireless data transmission network, GPS position information, a call record of dialing/answering through the mobile phone network/voice network is provided in an integrated manner in the second communication recording interface, and so on. Of course, the examples herein merely illustrate that communication interfaces including communication information via different communication networks may be presented for viewing by a user in response to a user switching operation between a first communication interface and a second communication interface. Likewise, the first communication interaction interface and the second communication interaction interface may also include communication information that is transmitted and received and processed by different communication application software through a plurality of communication networks, which are different or the same, and these similar embodiments are not described herein again.

Meanwhile, it should be noted that: in the step 1201, the mobile terminal of the user may establish communication with the first contact through only one communication network, or may establish communication with the first contact through a plurality of communication networks, but may generate a plurality of different attribute or different types of communication information. Referring to the above examples of receiving and transmitting short messages and making/receiving calls through a mobile phone network, in the resource providing method of some embodiments including the embodiments under the heading "cross-interface graphic element providing method and apparatus", a user may communicate with a first contact only through the mobile phone network to which the mobile terminal is connected, thereby obtaining two types of communication information, such as a call making/receiving record and a short message. This case also falls within the scope of the method of the present embodiment, and a description of this case of obtaining multiple communication information through a single network will not be given in the following embodiments.

The communication information, communication content or communication data displayed in the communication interactive interface is not limited to the content with various properties/types, and the different properties of the communication information also include different network sources, such as networks with different service properties, for example, a mobile communication network, a fixed communication network, a wireless data transmission network, a WLAN represented by WIFI, a mobile telephone network, a mobile data network, and the like. In other words, the plurality of communication information is generated (ocur) based on the plurality of communication networks or the corresponding communication interfaces, respectively. Furthermore, the electronic device may connect to a plurality of communication networks with different service properties, and the generated communication information is generated based on interfaces of the plurality of communication networks corresponding to the different service properties, respectively, where the interfaces are communication interfaces conforming to communication protocols of the plurality of communication networks, or simply referred to as a plurality of communication network interfaces. Taking as an example a wireless data transmission network interface based on the open system interconnection communication reference model (OSI, open System Interconnection Reference Model), the wireless data transmission network interface may be divided into a plurality of parts, for example, may include an interface belonging to a physical layer; an interface belonging to the data link layer, or a data link interface, can also be included; the system also can comprise interfaces belonging to a network layer, and particularly can comprise communication addresses, port numbers, hardware chips, corresponding drivers and other software and/or hardware resources; interfaces corresponding to traffic carried by the network, or simply traffic interfaces, may also be included. As an integral part of the wireless data transfer network interface, the communication interfaces, e.g., data link interfaces, in the various layers may be implemented at least in part in the electronic device or distributed across multiple network devices including switches, servers, while providing calling interfaces, e.g., system calling interfaces or network calling interfaces, to applications running in the electronic device. As another part of the overall wireless data transport network interface, some of the higher layer interfaces in OSI may be implemented in the operating system of the electronic device or in an application running therein. In the same way, in the electronic device of the embodiment, the voice interface and the short message interface for the mobile phone network may be managed by the operating system such as Android or the underlying software and then indirectly provided to the application program of the instant messaging class after being encapsulated, and the wireless data transmission interface may also be directly or indirectly provided to the application program of the same instant messaging class. The configuration and deployment manners of the multiple communication network interfaces are also applicable to the methods or apparatuses of the other embodiments described above or below, and will not be described in detail hereinafter.

Those skilled in the art will appreciate that the specific embodiments of these communication network interfaces are varied and that the specific embodiments do not limit the invention. For example, the sms interface and the voice interface managed by the os for the mobile phone network may be integrated with the data link interface of the wireless data transmission network supporting the instant messaging function through redevelopment of the os interface, and encapsulated into the same application. Further, it should be noted that the interface resources of the plurality of communication networks of the electronic device of the present embodiment are integrated and provided to the same instant messaging application in a direct or indirect manner, in other words, the instant messaging application in the electronic device of the present embodiment may call up interfaces of a plurality of different communication networks, such as a voice interface of a mobile phone network, a short message interface, and a wireless data transmission network interface, etc., so as to transmit and receive data through the plurality of different communication network interfaces, which is different from the case where the interfaces of the communication networks of the related art are utilized by a plurality of independent applications, respectively.

Based on this, optionally, in the resource providing method of some embodiments, the communication establishing step 1201 further includes establishing communication with the network address corresponding to the first contact through the mobile phone network and the wireless data transmission network to generate a plurality of communication information having different service properties. In some embodiments, including embodiments under the heading "cross-interface graphical element providing method and apparatus", the integration outputting step 1202 further includes an arrangement displaying step of displaying a plurality of communication information arrangements with different business properties for the first contact via the mobile phone network and the wireless data transmission network on the first contact interaction interface.

Alternatively, in some embodiments including embodiments under the heading "cross-interface graphical element providing method and apparatus", the plurality of communications information described above corresponds to different traffic properties, and may be generated by corresponding network protocol interfaces among the interfaces of the plurality of communications networks described above, respectively. Correspondingly, the communication establishing step 1201 may further include that the user establishes communication with the first contact via a plurality of communication network interfaces to generate a plurality of communication information of different traffic properties. The foregoing arrangement display step may further include integrating and outputting, on the first contact interaction interface, a plurality of communication information for different service properties of the first contact through the plurality of communication networks.

Optionally, in some embodiments including embodiments under the heading "cross-interface graphical element providing method and apparatus", the plurality of communication information of different traffic properties includes, for example, i) voice traffic information, ii) short message traffic information; iii) Data traffic information including one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files, data. Here, by integrating and displaying the plurality of communication information from one or more communication networks carrying different communication services, accessibility of the plurality of communication information corresponding to various service properties is enhanced, and interaction complexity of a user in accessing the information is reduced, for example, the user does not need to access different application programs such as a call management program, a short message management program and the like in a mobile phone respectively to obtain two different communication information respectively; similarly, two kinds of communication information with different service properties, such as a short message and a voice message, are respectively acquired without respectively accessing different application programs, such as a short message management program and an instant communication program, in the mobile phone.

The arrangement display step further comprises: at least two of the voice service information and the short message service information of the first contact are displayed in the first message area according to the occurrence time sequence.

Optionally, in the above first message area, only the latest 1 or 2-3 records in at least two of the voice service information and the short message service information for the first contact person and the data service information may be displayed, so that if the first message area is only used for displaying 1-3 communication records, the fonts of each communication record may be relatively large, and the visual presentation effect for the user is relatively good.

In some embodiments, the plurality of communication information may further include a plurality of different attributes, which may be derived from a plurality of communication function modules, or called a plurality of communication protocol interfaces, that is, the plurality of communication information is processed by or transmitted through a plurality of communication function modules, which are configured in the electronic device, and may respectively follow different communication protocols to be compatible with different communication networks. Correspondingly, the resource providing method in the embodiment according to the present invention may further include the step of providing the communication function module: a plurality of communication function modules are provided in the electronic device compatible with at least one communication network that can establish communication with a communication tool of the at least one communication network associated with the first contact. And, the communication establishing step 1201 may further include the sub-steps of: communication is established with the first contact via at least one communication network through a plurality of communication function modules to generate a plurality of communication information.

FIG. 14 is a schematic diagram of an electronic device and its interactive interface according to another embodiment of the present invention; the first contact interaction interface and the communication information available therein are further explained in connection with fig. 14. In this embodiment of the invention, the at least one interaction interface for a single first contact described above may comprise, in an interface hierarchy, a single layer of interaction interfaces for the first contact, i.e. a first contact interaction interface for providing the user with a plurality of types of communication records as described above, or an interface layer of communication records with the first contact. Of course, it is not excluded that the first contact interaction interface comprises, in addition to the interface layer of the communication record, other interaction interface layers, such as a first contact profile interface layer, located at a level above the interface layer of the communication record.

The integration output step 1202 of the resource providing method of this embodiment may further include the steps of: integrating and outputting the communication information aiming at the first contact through the communication network on the first contact interaction interface. For example, in the above embodiment, the different types of communication data that are distributed and integrated in the first communication interaction interface and the second communication interaction interface may be alternatively displayed only on the first contact interaction interface in the resource providing method of the present embodiment, instead of being displayed on the first communication interaction interface and the second communication interaction interface respectively. In other words, in the resource providing method of the present embodiment, in response to the switching operation of the user, a plurality of different attribute or type of communication data of different groups may be switched on the first communication interactive interface to be provided to the user. Of course, in another alternative embodiment, instead of the user switching the display of the grouped communication information of different media types/service types in the first contact interaction interface, the communication information or the communication data of multiple different attributes or types may be all integrally displayed in the first contact interaction interface, as shown in the first contact interaction interface in fig. 14.

The method further uses the contact person as a guide, configures communication resources and communication information, and improves accessibility of the communication information to users. This reduces interaction complexity for some users who are relatively concerned about the communication information with the communication contacts and who desire to have access to such information in a simple operation. The resource providing method reconfigures the communication information at the interaction layer by taking the contact person as the center so as to integrate and output, thereby prejudging (anti) the demands which do not exist in the prior art and solving the corresponding technical problems.

In some embodiments of the present invention including embodiments under the heading "cross-interface graphical element providing method and apparatus", the at least one communication network described above comprises a wireless communication network, and the wireless communication network further comprises two networks: mobile telephone network, wireless data transmission network. Correspondingly, the plurality of communication function modules include a mobile phone network communication function module, a wireless data transmission network communication function module, and the step 1201 of communicating through at least one communication network further includes: the communication function module is connected to the mobile telephone network and the wireless data transmission network respectively through the mobile telephone network communication function module and the wireless data transmission network communication function module, and communication is established between the mobile telephone network and the wireless data transmission network through communication tools associated with the first contact person through the two networks so as to generate a plurality of communication information; and, the integrating outputting step 1202 further includes: arranging and displaying a plurality of communication information aiming at a first contact through a mobile telephone network and a wireless data transmission network on a first contact interaction interface; the arrangement order can be longitudinal or transverse, such as a mobile phone operated on a transverse screen, etc.

Fig. 15 is a schematic diagram of an interactive interface in a resource providing method according to another embodiment of the present invention, and the resource providing method in this embodiment is further described below with reference to fig. 15. In this embodiment of the present invention and the resource providing method of the embodiment under the heading "cross-interface graphic element providing method and apparatus", the first contact interaction interface includes a first message area 1502, and the mobile phone network communication function module includes a voice interface and a short message interface configured in the mobile terminal 1500, and the plurality of communication information respectively used for transmission/processing includes, but is not limited to: i) Voice call recording, ii) short message text; the plurality of communication information correspondingly processed or transmitted by the wireless data transmission network communication function module may include one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files, data. The arrangement display step further includes: at least two of the three types of i) voice call records, ii) short message text, iii) data service information for the first contact are integrated and displayed in the first message area 1502 according to the occurrence time sequence, as shown in fig. 15. Here, by integrating and displaying the plurality of communication information from one or more communication networks carrying different communication services, accessibility of the plurality of communication information corresponding to various service properties is enhanced, and interaction complexity of a user in accessing the information is reduced, for example, the user does not need to access different application programs such as a call management program, a short message management program and the like in a mobile phone respectively to obtain two different communication information respectively; similarly, two kinds of communication information with different service properties, such as a short message and a voice message, are respectively acquired without respectively accessing different application programs, such as a short message management program and an instant communication program, in the mobile phone.

In the method of the above embodiment, the method may further include the step of: in response to a selection operation by the user, the above-mentioned various audio/video type messages presented in the first message area 1502 are output to the user through a display or a speaker in a visual or audible (audio) manner, and optionally, when the network to which the mobile terminal is connected is a mobile data network, in this case, the above-mentioned various audio/video type messages may be downloaded through the mobile data network when the user selects to play. Of course, additional text information such as short messages may be automatically downloaded by the mobile terminal over the network and presented in the first message area 1502 of the display.

FIG. 16 is a schematic diagram showing switching of an interactive interface for displaying the latest message or messages in a resource providing method according to another embodiment of the present invention, where in the embodiment, the time-sequence arrangement displaying step further includes: in the message queues of at least two of the three types of communication information, i) voice call records, ii) short message text, iii) data service information for the first contact, only the latest record or records, or information such as a timestamp of the displayed message can be selected and displayed in the first message areas 1602-a and 1602-B. Because less information is displayed, the display space in the first contact interaction interfaces 1603-a, 1603-B can be fully utilized, facilitating easy visualization of the information by the user. Wherein the data traffic information includes one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files, data.

Optionally, in the resource providing method of all embodiments of the present invention including the embodiment under the heading "cross-interface graphic element providing method and apparatus", the first contact interaction interface belongs to a single application program, which means that the plurality of communication information are integrally displayed in the same application or associated plurality of application programs, without including the following cases: the first application program displays the first communication information or the interactive content on the display screen of the electronic device, and the second application program independent of the first application program temporarily pops up the second communication information or the interactive content such as the notification on the screen, so that the space of the display screen of the whole electronic device is shared with the first application program. In this connection, the embodiments described hereinabove and hereinafter are applicable and will not be described in detail hereinafter. Additionally, here, optionally, before the step of establishing communication through the communication network, further includes: the single program is loaded as a desktop interactive program at the start-up stage of the electronic device. In some Android operating systems, the communication application may be set to a start-up (Launcher) level application under the ROOT authority of the operating system, that is, the communication application is set to be a desktop interactive program, so that, with the starting of the operating system, the processor unit 12 may load the communication application to which the first contact interactive interface belongs, without any conventional desktop or other application program. In this manner of activation, the communication application may be specifically executed by the processor 12 to occupy the display resources in an exclusive manner on the display, i.e., the display screen, so that the first contact interaction interface and the content therein, such as the contact profile interface, the contact interaction interface, etc., may be presented "on the display screen. By means of the exclusive resource integration providing mode, communication contacts are used as centers or are used as guidance, communication resources such as a plurality of pieces of communication information or user interfaces aiming at communication networks are integrated and configured in a priority mode at the upper layer of the interaction level, and accessibility of contact related information and communication inlets is greatly facilitated.

The resource providing method according to the above embodiment of the present invention may further include the steps of: a user interface element is provided on the first contact interaction interface, the user interface element(s) being associated with the communication network to form a communicable coupling relationship to establish or terminate a corresponding communication, such that a user may initiate/accept a communication request through the corresponding communication network by manipulating the user interface element(s) on the first contact interaction interface. On the one hand, the user interface elements are each associated with a plurality of communication networks, and on the other hand, the functional operation (functional operation) of the user interfaces is also triggered by a plurality of different operations from the user, respectively. Correspondingly, the step of establishing communication over the communication network further comprises: in response to a user operation of the user interface element, communication is established with the first contact over the communication network to generate a plurality of communication data.

It should be noted that: the user operation on the user interface element mentioned herein generally refers to a single action operation, where a single action has been explained above, where the user can establish the communication only on a single interface through a single action operation, and no independent operation is generally required for two or more times, or even switching of the interactive interface for two or more times. In addition, on the one hand, one or more user interface elements may be responsive to a plurality of operations by a user, and on the other hand, one or more user interface elements may be associated with one or more communication networks, respectively, by a processor, such that communication via this/these communication networks may be established for the communication device by the processor, e.g. a first user interface element may trigger the processor to establish communication with a wireless data transmission network of a contact for the mobile terminal in response to a first operation by the user, while a second user interface element may trigger the processor to establish communication with a mobile telephone network of the contact for the mobile terminal in response to a second operation by the user. The association between one or more user interface elements, one or more communication networks, and one or more user operations described herein may be applied to the methods, apparatuses, and devices of the previous and subsequent embodiments, and will not be described in detail in other embodiments.

Fig. 17 is a schematic view of an interactive interface of a providing button in a resource providing method according to another embodiment of the present invention, and user interface elements in the resource providing method according to this embodiment include a first button 1706 and a second button 1707. The first button 1706 and the second button 1707 or still other buttons comprised by the user interface element may be responsive to different operations of the user, such as a single press of the first button 1706, a double press of the first button 1706, or a single long-time press of the second button 1707, etc., respectively, to establish communications over different 2 or 3 communication networks, such as a wireless data transmission network or a mobile telephone network, respectively, to transmit communication data or information of various different media types conforming to the communication protocols of these networks, online or offline, including online video, online voice, text information, audio information, video information, data information, etc., through the communications of these networks; the data information may also include GPS address location, files, data, etc., as well as calls, short messages, etc. from the mobile telephone network.

Correspondingly, the step of establishing a communication over the communication network further comprises: responsive to independent operation of the first button 1706 and the second button 1707, respectively, the enabled mobile terminal may be enabled to send audio messages and/or video/image messages and/or text messages over a wireless data transmission network and output audio messages and/or video/image messages and/or text messages received over the wireless data transmission network on the first contact interaction interface 1703.

Optionally, the first button and the second button may be disposed in relatively close proximity (not shown in the figure), and the step of establishing communication over the communication network further comprises: in response to an associated operation such as a synchronous press of the first button and the second button, the mobile terminal may be enabled to initiate an audio-video call over the wireless data transmission network.

Optionally, the step of establishing communication over the communication network further comprises: in response to a plurality of user operations on the user interface element, respectively, a plurality of communications are conducted with the first contact over the communication network to generate a plurality of communication data. In other words, the user may enable the mobile terminal to perform various communications with the first contact through one or more mobile communication networks by applying different operations and gestures to a certain interface element to generate a plurality of communication data.

Optionally, user interface elements on the first contact interaction interface, e.g. a first button, a second button, may switch the functions of these buttons in response to a switching operation by the user. In some embodiments, when the mobile terminal is connected to a different communication network, the first button and the second button may automatically redefine their functions, or redefine the functions of the first button and the second button in response to a switching operation of the user. For example, when the mobile terminal is connected to the mobile phone network, the first button and the second button can make a voice call and send a short message to the first contact through the mobile phone network in response to a single press. And when the mobile terminal is connected to the WLAN in the room, the first button and the second button can respond to a single pressing to send voice leave words to the first contact person and listen to voice messages from the first contact person.

Fig. 19 is a schematic diagram of an interactive interface in a resource providing method according to another embodiment of the present invention. The user interface elements in the resource providing method according to this embodiment include a first key 1902, a second key 1903, a third key 1904, and a fourth key 1905. As another modification of the user interface element of this embodiment, the four keys may be associated with communication functions of the mobile phone network and the wireless data transmission network, respectively. For example, the first key 1902 and the second key 1903 may respectively make voice calls and send short messages to the first contact via the mobile phone network in response to a single press. While the third key 1904 may collect a user's voice message and send the voice message to the first contact in response to a long press operation, the fourth key 1905 may listen to the voice message from the first contact in response to a short single press operation. All the above-described records of the transmitted and received voice messages, the transmitted and received short messages, the incoming/outgoing calls, and the like are displayed in the first message area 1906. The mobile phone can provide the sending and receiving of a plurality of communication information such as short messages of short message service and audio messages of data service on the same interface, thereby further improving the accessibility of the communication information and interface elements and reducing the complexity of user interaction.

Of course, it should be understood that: the specific implementation of sending a short message or short message to the first contact via the mobile phone network in response to a single press is various, for example, a soft keyboard may be provided on the display of the mobile terminal in response to a single press by the user for the user to edit the short message, and in response to a sending operation by the user, the edited short message is sent out via the mobile phone network via the SMS short message interface in the mobile terminal. Alternatively, the audio signal of the user may be collected through the microphone in response to a single press of the user and converted into the short message content by using the software conversion module of "voice→text" in the mobile terminal, and then the converted short message content is sent out through the SMS short message interface in the mobile terminal via the mobile phone network in response to the sending operation of the user, where specific implementation forms are not enumerated any more.

Optionally, the user interface element may further include another third button (not shown in the figure); and establishing communication over the wireless communication network further comprises: in response to operation of the third button, an online audio group call or video group call is alternatively initiated via the mobile telephone network or the wireless data transmission network. In other words, when the user operates the third button, if the network environment of one of the mobile phone network, the mobile data network, or the wireless lan is not good enough, which may affect the call quality or even fail to call out, the resource providing method of the present embodiment may support the mobile terminal to automatically switch the network connection to the network with better network signals, so as to ensure the call quality.

Preferably, in all of the foregoing or following embodiments, these user interface elements, similar to the first, second and third buttons 1706, 1707 of the present embodiment, that correspond to a variety of communication means, such as sending voice messages to contacts, making phone calls, etc., may each be provided in a persistent manner on a directly viewable portion of a single-level interactive interface, such as the first contact interactive interface 1703 shown in FIG. 17. On the one hand, these user interface elements are continuously and stably present in the same (idetical) partial area on the interface, which avoids the need for the user to reproduce the user interface elements on the interface by additional operations when the user interface elements are automatically hidden; on the other hand, through this configuration of the user interface elements, in the communication process of the user with the first contact through the electronic device 1700, the interface resources used by the user through the interactive interface, such as the first button 1706, the second button 1707, and the third button (not shown in the figure), are integrated in the directly visible portion of the single interactive interface and are collectively provided to the user, so that the user can access all the user interface elements without crossing different levels of interactive interfaces or additional operations, in other words, the configuration manner of the user interface elements does not need to click certain entry buttons to enter the interface of the next level or the sub-interface of the current level after the user accesses the first communication means/user interface element through the interface of the current level, which further improves the accessibility of multiple communication resources in the same communication network or multiple communication resources in different multiple communication networks to the user, or the efficiency of the user in the communication process with the first contact.

The resource providing method according to other embodiments of the present invention further includes: in response to a user's switching operation, a second contact interaction interface or application portal is displayed from the first contact interaction interface, which supports the user to switch contacts or to other functional interfaces through a single action, reducing interaction complexity, as shown in fig. 4, while at the same time displaying the title'Key/button layout and its form and functionThe embodiments relating to the various user interface elements, such as the buttons, referred to herein may be combined or reversed with the embodiments described herein and above. Of course, the switching operation may also include a set of simple interactive operations, that is, switching the contact through a plurality of actions or switching to other functional interfaces, for example, switching back from the first contact interactive interface to the previous interactive level through the first gesture to display the first contact profile interface, switching to display the second contact profile interface through the second gesture, and then entering the next interactive level through the third gesture to display the second contact interactive interface or the application program, which may refer to the interface interaction schematic shown in fig. 3. As for the above The functions of the user profile interface of (a) have been described previously and are not repeated.

In addition, the application program portal may be a first functional interface corresponding to an application other than communication interaction, where the first contact interaction interface, the second contact interaction interface, and the first functional interface all belong to or are associated with a single program or multiple applications, and the first contact interaction interface, the second contact interaction interface, and the first functional interface are all located at a top layer of interaction of the single application, so that the interaction interfaces may be switched to each other at a first level of interaction of the application in response to a switching operation of a user. Also, in some embodiments described above or below, a single program or associated plurality of applications may be loaded as desktop interactive programs during a startup phase of an electronic device, such as a communication device, such that the first contact interactive interface, the second contact interactive interface, and the first functional interface are located at the top level of interaction of the entire software system, including the operating system, after system startup of the communication device. As previously described, the user may access the contact interaction interface and other functional interfaces through a first level of operation of the interaction of the software system of the communication device. The first contact interaction interface may comprise a single level interaction interface, i.e. a communication content interface or a communication record interface between the user and the contact. Of course, the first contact interaction interface may also comprise two levels of interaction interfaces, such as a user profile interface and a communication content interface between the user and the contact, in which case, typically, after system start-up of the communication device, the user profile interface in the first contact interaction interface will be loaded on top of interactions of the whole software system for direct access by the user after start-up of the communication device. In summary, this is a resource allocation that is directed to communication with contacts, or is centered on contact related information, which greatly increases the accessibility of communication resources to users, such as contact related information, and various available communication functions around contacts. This is quite different from the prior art resource allocation which is guided by the differentiation of application programs, software functions/functional groups (functionalities).

Notably, are: the first functional interface may belong to or be associated with a single program of the communication device, but the first functional interface or the content provided by the first functional interface, such as an application program, may be developed by a third party, for example, a plug-in developed by the third party, or an application program of a separate third party running outside the system of the communication device or outside an operation platform of the communication device. These plug-ins or shortcuts to third party applications are provided to the user at the communication device through the first functional interface. If the third party application is launched, then interaction of the third party application may be presented at the communication device, but if the third party application exits, then a first interaction level of the software system of the communication device, such as a first contact interaction interface, the second contact interaction interface, and the first functional interface, will still be presented on the desktop of the communication device.

Alternatively, the profile interface may include an avatar image of the first contact and a display area for displaying a single piece or a few pieces of latest information including weather, stock market, health information, latest instant message, or reminder information (reminder), etc.

Some embodiments of the second resource providing method

In another embodiment of the present invention, a resource providing method for an electronic device is provided, optionally, the method may be run at an electronic device having a processor unit, a memory, and a display, fig. 18 is a flow chart of a resource providing method according to yet another embodiment of the present invention, and in step 1801 of the resource providing method, as shown in fig. 18, a plurality of communication resources capable of establishing communication with a first contact, respectively, are provided for the electronic device, the plurality of communication resources being operable to generate a plurality of communication information through at least one communication network, wherein the at least one communication network is associated with the plurality of communication resources, for example, in a communication coupling (communication coupled) manner. Here, the plurality of communication information has different service properties, or may also be referred to as service properties, for example, the plurality of communication information may be respectively classified into two or more service properties, including a voice service and a short message service carried by a mobile phone network, a data service carried by a WLAN, and the like; in step 1802, user interfaces corresponding to the plurality of communication resources are integrated and configured on the interactive interface corresponding to the first contact. Step 1801 and step 1802 have no chronological precedence.

From the user's interactive operation perspective, the above step 1802 may be understood as "configuring the communication resource with the first contact as a direction", in other words, reconfiguring the user interface of the communication resource with the first communication object as a center (center), so that the user may establish that the user accesses the corresponding communication resource with the first contact through fewer interactive operations, which improves accessibility of multiple communication resources.

Optionally, the plurality of types of communication information include, but are not limited to: communication information for online connection, such as online video, online voice, etc.; or call information generated by communication through a mobile phone network, short Message Service (SMS), or text information, audio information, video information, picture information, and other types of data information generated by communication through a wireless data transmission network, which may further include address location information, files, data, etc.

Optionally, the first contact interaction interface belongs to a single application or associated multiple applications configured in the electronic device, the multiple communication resources include multiple interfaces corresponding to at least one communication network, and the multiple communication resource providing step 1801 further includes: multiple interfaces corresponding to at least one communication network are provided integrally to a single program or associated multiple applications.

Wherein, the at least one communication network and the at least one communication network respectively correspond to a plurality of interfaces, and each of the interfaces conforms to different communication protocols. Any one of a plurality of communication network interfaces may be operable to communicate over a communication network corresponding to the interface to generate at least one of a plurality of communication information of different traffic properties.

Optionally, the at least one communication network comprises a plurality of wireless communication networks having different traffic properties corresponding to the plurality of communication information, for example comprising a mobile telephone network and a wireless data transmission network, the electronic device being a mobile communication terminal. It should be noted that: a single communication network may correspond to multiple traffic properties, for example, here a mobile telephone network may correspond to two different traffic properties: short message service and voice telephony service. Thus, it can be appreciated that: two different communication messages, i.e. a short message and voice telephony information such as an incoming/outgoing call record, can be generated by means of a single communication of the mobile telephone network. The correspondence between a single communication network and a plurality of communication information of a plurality of service properties or a plurality of communication information of different service properties, which are described herein by taking a mobile phone network as an example, can be applied to the method, the apparatus and the device of all embodiments of the present invention, including the related embodiments under the heading "cross-interface graphic element providing method and apparatus", and will not be described in detail in other embodiments. In addition, the wireless data transmission network includes WLAN and mobile data network, and the plurality of communication resources include mobile phone network interface, which may further include a cellular module, a voice interface, a short message interface, a corresponding hardware chip, a driver thereof, and the like. The plurality of communication resources may also include a mobile data network interface, a communication interface of a WLAN, and the like.

Optionally, the first contact interaction interface preferably comprises only a single interface, but may also comprise a plurality of interfaces. The single interface or multiple interfaces belong to a single program or associated multiple applications. In general, the associated multiple applications mentioned heretofore or hereafter may be developed and packaged for release by the same company or by multiple associated companies.

Optionally, the plurality of user interfaces in the resource providing method of the above embodiment includes a plurality of input interfaces, which are respectively responsive to a plurality of different operations of the user to enable communication through the plurality of communication networks. In the resource providing method of some embodiments, the plurality of user interfaces further includes a first message area, the plurality of communication networks having different traffic properties corresponding to the plurality of communication information; the resource providing method further comprises the steps of: in response to a plurality of operations applied to the plurality of input interfaces, communicating with the first contact over a plurality of wireless communication networks to generate a plurality of communication information of different traffic properties, respectively; and integrating and providing a plurality of communication information for different business properties of the first contact in the first message area. By the resource providing method of the embodiment, the user interfaces and the input interfaces of the communication networks with different service properties are integrated on the interactive interface, so that the accessibility of the communication networks and the communication information for the user is further improved.

Optionally, the communication network is a wireless communication network, and correspondingly the electronic device is a mobile terminal, and the communication resources are compatible with the wireless communication network so as to be communicably accessible to the wireless communication network. The plurality of input interfaces includes a first button and a second button.

The step of establishing communication over a plurality of wireless communication networks may include: the data traffic information is transmitted through the wireless data transmission network in response to an operation of the first button, and the data traffic information received through the wireless data transmission network is output in response to an operation of the second button. Or establishing communication over a plurality of wireless communication networks may further comprise: in response to an operation of the first button, a telephone call is initiated or an incoming call is received to or from the first contact via the mobile telephone network, and in response to an operation of the second button, a short message service is established with or a short message from the first contact is output via the mobile telephone network.

In the following embodiments, a resource providing method in the embodiments will be described taking a wireless communication network including a mobile phone network and a wireless data transmission network as an example.

Alternatively, the input interfaces are virtual interfaces implemented in software, which are associated with a plurality of communication networks, respectively, on the one hand, and correspond to a plurality of different operations from a user, on the other hand, in other words, the input interfaces may be responsive to a plurality of different operations applied by the user to establish communications through the mobile telephone network interface, the wireless data transmission network interface, respectively, to connect the mobile telephone network and the wireless data transmission network, thereby generating a plurality of communication information of different service properties, respectively,

the operation of the plurality of communication resources may be controlled in response to a plurality of operations to enable communication of the plurality of communication resources over respective ones of the plurality of communication networks. Such an input interface is not limited to a particular implementation and may be, for example, one or more software buttons or the like. The variants of the input interface can be referred to by the heading'Key/button layout and its form and function"the description below, and the interface elements of the user interface in the embodiments of fig. 19 and 17, are not repeated here.

In the resource providing method of another embodiment, the plurality of user interfaces further includes a first message area, which is an interface for outputting or presenting the communication information externally, and may also be understood as: the single program or an associated plurality of application programs described above may be executed by the processor unit to embody (email) part of the user interface on the display in the form of a first message area. Correspondingly, the resource providing method according to some embodiments of the present invention may further include: in response to a plurality of operations applied to the plurality of input interfaces, respectively communicating with the first contact via the mobile telephone network and the wireless data transmission network through the mobile telephone network interface, the wireless data transmission network interface to respectively generate a plurality of communication information of different traffic properties, comprising: i) Voice service information, ii) short message service information; iii) Data traffic information including one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files, data; and, the integration providing step further includes: and displaying at least two of the voice service information and the short message service information which are generated by the mobile telephone network and the wireless data transmission network and are aimed at the first contact person, and displaying the at least two of the data service information in the first message area according to the occurrence time sequence. By the above steps in the resource providing method of this embodiment, communication information with the first contact via a plurality of communication interfaces, such as i) and ii) or ii) and iii) or i) and iii) or all three, i.e. i), ii) and iii), respectively, transmitted via one or more communication networks of a mobile phone network, a mobile data network, a WLAN or the like, is further presented in the first message area in an integrated manner, centering on the first contact. Here, by integrating and displaying a plurality of communications from one or more communications networks carrying different communications services, the requirements on the interaction layer and the number of the user in the process of operating the mobile terminal to access related communications are reduced, for example, the user does not need to access different application programs such as a call management program and a short message management program in the mobile phone respectively to acquire two different communications; similarly, two kinds of communication information with different service properties, such as a short message and a voice message, are respectively acquired without respectively accessing different application programs, such as a short message management program and an instant communication program, in the mobile phone. Further improving accessibility of related communication resources/communication information in user interaction

Alternatively, in the above arrangement display step, only the latest record or records among the plurality of communication information of the mobile phone communication and the wireless data transmission communication may be displayed in the first message area.

Optionally, in the resource providing method according to some embodiments of the present invention, the first contact interaction interface belongs to a single program or a plurality of associated applications, and the resource providing method may further include the steps of: the single program or a plurality of related applications are loaded as desktop interactive programs in the starting stage of the electronic equipment, such as a communication device, so that the first contact interactive interface is automatically loaded as the desktop application program after the mobile terminal is started and is displayed in front on a display, related communication resources, communication information and the like are automatically provided for a user through the first contact interactive interface, and accessibility of the communication resources and the communication information in user interaction is improved. Of course, the single program or the associated plurality of applications may be executed as a conventional application in response to a user's selection, instead of being automatically loaded as a desktop application during the start-up of the mobile terminal. By adopting the exclusive setting mode, communication contacts are used as centers or are used as guidance, and communication resources such as a plurality of communication information or user interfaces aiming at communication networks are integrated and configured in priority in the upper layer of the interaction level, so that accessibility of contact related information and communication entrance is facilitated.

Optionally, in response to the switching operation of the user, switching and displaying a second contact interaction interface or a first function interface from the first contact interaction interface; wherein the first contact interaction interface, the second contact interaction interface, the first functional interface all belong to or are associated with a single program, and are located at the top level of interaction of the single application.

The first functional interface may be a portal corresponding to an application other than the communication-interactive application. The first contact interaction interface, the second contact interaction interface and the first function interface all belong to or are associated with a single program or a plurality of associated applications, and the first contact interaction interface, the second contact interaction interface and the first function interface are all located on top of interaction of the single application, so that the interaction interfaces can be mutually switched on a first level of interaction of the applications in response to switching operation of a user. Also, in some embodiments described above or below, a single program or associated plurality of applications may be loaded as desktop interactive programs during a startup phase of an electronic device, such as a communication device, such that the first contact interactive interface, the second contact interactive interface, and the first functional interface are located at the top level of interaction of the entire software system, including the operating system, after system startup of the communication device. By means of the exclusive setting mode, communication contacts are used as centers or are used as guidance, communication resources such as a plurality of pieces of communication information or user interfaces aiming at communication networks are integrated and configured in a priority mode at the upper layer of the interaction level, and accessibility of contact related information and communication inlets is improved.

As previously described, the user may access the contact interaction interface and other functional interfaces through a first level of operation of the interaction of the software system of the communication device. The first contact interaction interface may comprise a single level interaction interface, i.e. a communication content interface or a communication record interface between the user and the contact. Of course, the first contact interaction interface may also comprise two levels of interaction interfaces, such as a user profile interface and a communication content interface between the user and the contact, in which case, typically, after system start-up of the communication device, the user profile interface in the first contact interaction interface will be loaded on top of interactions of the whole software system for direct access by the user after start-up of the communication device. In summary, this is a resource allocation that is directed to communication with contacts, or is centered on contact related information, which greatly increases the accessibility of communication resources to users, such as contact related information, and various available communication functions around contacts. This is quite different from prior art resource configurations that are oriented with the division of application, software functions/groups of functions (functions groups).

In the above embodiment, the communication resource enabling provision step may further include: providing a plurality of communication resources in a single program or in a plurality of associated applications, the plurality of communication resources having a plurality of different attributes, the plurality of communication resources being capable of establishing communication with a first contact; and integrating and configuring the user interfaces respectively corresponding to the communication resources in the first contact interaction interface.

Alternatively, the profile interface in some embodiments of the invention may include an avatar of the first contact and a display area for rotating to display a single piece of information.

According to some embodiments of the invention, an electronic device includes a display, an optional processor unit, a memory, and one or more programs; one or more programs are stored in the memory and configured to be executed by the processor unit, and the one or more programs include instructions for performing or causing the performance of any of the methods and operations of the steps therein in the embodiments described herein above or below.

Optionally, the electronic device of the above embodiment further comprises a touch sensitive surface and one or more sensors for detecting a contact strength with the touch sensitive surface.

According to some embodiments of the present invention, a computer-readable storage medium has instructions stored therein, which when executed by an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface, cause the device to perform or cause to perform operations of any of the methods described herein above or below.

High operability electronic device

In addition, according to other embodiments of the present invention, further electronic devices are proposed, which include some different functions or structural units in addition to the same/similar units as those of the electronic devices of the above embodiments, and detailed descriptions will be focused on the differences from the electronic devices of the above embodiments, and the same/similar parts will not be repeated.

Fig. 13A is a schematic view of a portion of a module of one or more programs stored in a resource providing apparatus according to another embodiment of the present invention, and fig. 13B is a schematic view of an electronic device according to another embodiment of the present invention, where the electronic device includes two electronic device having different interface states, and the first contact interaction interface may include a profile interface 1310 of a first contact in addition to a first contact communication record interface 1310'. 13B shows a first contact profile interface 1310 and a first contact communication record interface 1310', respectively. After a user's selection/confirmation operation of the first contact, for example, the user clicks on an avatar image of the first contact on the first contact's profile interface 1310, the electronic device 1300 may switch to display two different levels of interfaces on the display in response to the user's operation, i.e., from the first contact profile interface 1310 to the first contact communication record interface 1310', during which the processor executes the program module 1301. The first contact communication record interface 1310' displays detailed communication records including messages, pictures, files, etc. from networks of different business attributes, as shown, for example, voice messages, pictures, videos, etc. coming and going through a mobile data network or a WIFI network, and short messages coming and going through a mobile phone network, incoming/outgoing phone records, etc. This embodiment is explained below with reference to fig. 13A and 13B.

In some embodiments of the electronic device including the embodiment shown in fig. 13 and the embodiment under the heading "cross-interface graphic element providing method and device", in addition to the function/structural element (element) or unit in the electronic device of each of the above embodiments, it may further include: the virtual at least one user interface element provided on the first contact interaction interface, and the physical connector interface, wherein the connector interface can be a pinhole interface of a pogo pin connector arranged in the electronic equipment, and the connector interface is externally used for being detachably connected with a probe interface of the pogo pin connector for being coupled with at least one physical operation part on the base.

The at least one physical operation portion is disposed on a base 1320 and can be coupled to a processor unit (not shown) through a physical connector interface 1340, and the at least one user interface element is disposed on the first contact profile interface 1310 or the first contact communication record interface 1310', or on both, respectively. Preferably, the physical manipulation section 1330A may be configured on the base 1320, and the base 1320 is physically independent and may be used to house the mobile terminal 1350. And the processor unit in the electronic device is connected to a connector interface 1340, which connector interface 1340 is for detachably coupling the physical manipulation section 1330A. It should be noted that: for simplicity of description, in other embodiments of the invention, the connector interface is also simply referred to as a connector.

The at least one entity operation section 1330A and the at least one user interface element 1330B substantially correspond in number and are respectively associated with a plurality of communication networks, and may be independently operated by a user to establish communication through the plurality of communication networks. When the user operates at least one entity operation portion 1330A or at least one user interface element 1330B, in response to the user operation, the processor executes the program module 1201-1 to cause the electronic device to establish communications with a contact, or first contact, on the current interface through a plurality of communication networks, respectively, to generate a plurality of communication information. This corresponding configuration between the at least one entity operation section 1330A and the at least one user interface element 1330B is equally applicable to other embodiments of the present invention and will not be described here again.

Alternatively, in some embodiments including the embodiment shown in fig. 13 and the embodiment under the heading "cross-interface graphic element providing method and apparatus", the at least one entity operation section 1330A may include a first button and a 1330a_1 second button 1330a_2; on the first contact interaction interface, at least one user interface element 1330B may include a first button 1330b_1 and a second button 1330b_2, respectively; and in response to a user operation of the at least one entity operation portion 1330a_1, 1330a_2 or the at least one user interface element 1330b_1, 1330b_2 corresponding to the first contact interaction interface while the electronic device is currently displaying the first contact interaction interface, the processor executes the program module 1202-1 to cause the electronic device in fig. 13B to display a plurality of communication information arrangements for the first contact through the mobile phone network and the wireless data transmission network on the first contact interaction interface, such as the first contact communication record interface 1310'. Likewise, upon user operation of at least one user interface element 1330b_1, 1330b_2 corresponding to the first contact interaction interface, the processor may also execute program modules 1202-1 to cause the electronic device of fig. 13B to direct the first contact to display a plurality of communication information arrangements for the first contact over a mobile telephone network and a wireless data transmission network on the first contact interaction interface in response to the user operation. The entity manipulation parts 1330a_1, 1330a_2 and at least one user interface element 1330b_1, 1330b_2 have a certain correspondence in form and function. This applies to other embodiments of the invention and will not be described in detail elsewhere.

Specifically, the electronic device in fig. 13B transmits some data traffic information on the first contact communication recording interface 1310 'as shown in fig. 13B through the wireless data transmission network in response to the operation of the first button 1330b_1 or 1330a_1, and outputs data traffic information received through the wireless data transmission network through the message region 1312 on the first contact communication recording interface 1310' in response to the operation of the second button 1330a_2 or 1330b_2. Or, in response to an operation of the first button 1330b_1 or 1330a_1, a phone call is initiated or an incoming phone call is received to or from the first contact through the mobile phone network, and in response to an operation of the second button 1330a_2 or 1330b_2, a short message service is established with or a short message from the first contact received through the mobile phone network is output through the mobile phone network. And thereafter, in response to a user's switching operation, the processor executes the program module 1201-1 to cause the electronic device to switch display a second contact interaction interface or application portal (not shown) from the first contact interaction interface in response to the user's switching operation.

Alternatively, as shown: the first button 1330a_1 and the second button 1330a_2, or the first button 1330b_1 and the second button 1330b_2 are disposed adjacently. The program module 1201-1 is also executable by the processor to initiate an audio or video call over a plurality of wireless communication networks, such as a mobile telephone network, a mobile data network, or a WLAN, in response to an associated operation of the first button 1330a_1 and the second button 1330a_2.

Optionally, the program module 1201-1 is further executable by the processor to communicate with the first contact over a plurality of communication networks to generate a plurality of communication information, respectively, in response to a different plurality of operations by the user on one of the at least one physical operation portion or one of the at least one user interface element. It should be noted that, in the electronic device of this embodiment, the program module 1201-1 may be executed by the processor to perform different communications in response to different operations of the same physical operation portion by the user, and of course, the program module 1201-1 may also be executed by the processor to perform different communications in response to different operations of the same user interface element by the user. Optionally, the operation of the first button, the second button, or other user interface element or the physical operation portion includes, but is not limited to: single click, double click, short time single press, short time double press, long time press, toggle, touch slide, single contact, single continuous contact, synchronous press of two or more buttons, successive press. This modification of the physical manipulation section or user interface element, user input interface manipulation action is equally applicable to the method or electronic device of all embodiments hereinbefore and hereinafter. In addition, it should also be noted that: the same physical operator or user interface element, user input interface may be responsive to different operational actions to trigger the processor to perform different functions, while different physical operators or user interface elements, user input interface may be responsive to the same operational actions to trigger the processor to perform different functions, as is applicable to the methods or electronic devices of all embodiments heretofore and hereafter.

Optionally, the at least one entity operation section 1330A further includes an entity third button, and the at least one user interface element 1330A further includes a virtual third button (not shown in the figure); program module 1201-1 may also be executable by the processor to initiate an online audio group call or video group call over a mobile telephone network or a wireless data transmission network in response to an operation of a physical third button or a virtual third button, for example in an alternative (alternative) manner.

Preferably, in embodiments herein and in all other similar embodiments, at least one user interface element 1330A may comprise two or more input interfaces, each provided on a single level of a first contact interaction interface, such as the first contact communication record interface 1310' shown in fig. 13B. On the one hand, these input interfaces are continuously and stably provided on the interface, which avoids the need for the user to use the input interfaces to reproduce on the interface through additional operations when the input interfaces are automatically hidden; on the other hand, through this configuration of the user interface elements, in the communication process of the user with the first contact through the electronic device 1300, the interface resources used by the user through the interactive interface, such as the input interface, are integrated and collectively (collectively) provided in a persistent manner on the direct visual portion of the single interactive interface, so that the user does not need to cross different levels of interactive interfaces or additional operations to access all the input interfaces, in other words, the configuration mode of one or more user interface elements does not need to click certain entry buttons after the user accesses the first communication means/user interface element through the current level of interface to enter the next level of interface or the sub-interface of the current level of interface to access the second communication means/user interface element, which further improves the accessibility of multiple communication resources in the same communication network or multiple communication resources in different communication networks to the user, or the interactive efficiency of the user in the communication process with the first contact. For simplicity, in the methods or apparatuses according to other embodiments of the present invention, an implementation of an interaction interface in which a plurality of or all communication input interfaces are collectively provided at the same level will not be described, where the plurality of or all communication input interfaces may be associated with the same communication network, or may correspond to different multiple communication networks. For simplicity, in the methods or apparatuses according to other embodiments of the present invention, an implementation of an interaction interface in which a plurality of or all communication input interfaces are collectively provided at the same level will not be described, where the plurality of or all communication input interfaces may be associated with the same communication network, or may correspond to different multiple communication networks.

Optionally, in some embodiments described above, the at least one physical manipulation portion and the at least one user interface element have correspondence and/or consistency in at least one of number, layout, morphology, feel, orientation, color family, color, shape, pattern.

Optionally, the one or more programs are further configured to be executed by the processor unit to display a profile interface 1310 for the first contact; the first contact communication record interface 1310 'may be displayed on the display in response to a confirmation operation for the profile interface 1310, or the interactive interface or other application portal interface for the second contact may be displayed from the interactive interface for the first contact in response to a user's switching operation. Of course, in the process of switching from the interactive interface of the first contact to the interactive interface of the second contact or other application program entry interface, one or more operations from the user may be performed, and one or more interfaces of different levels may be spanned.

In the heading'High operability electronic deviceThe steps of some methods performed by the processor unit in the electronic device of the embodiments below may be referred to correspondingly " Some embodiments of the first resource providing method"OR"Second kind of resource Some embodiments of the method are provided"some of the steps illustrated in" are not described in detail herein.

Optionally, in some embodiments including embodiments under the heading "cross-interface graphical element providing method and apparatus", the first user interface element and the second user interface element functionally correspond to an application of the first interactive interface and an application of the second interactive interface, respectively. In other words, the first user interface element may be configured by one or more programs in the electronic device to be a first application program for providing the first interactive interface to correspond to the user interface of the first application program, and as the interactive interface switches to the second interactive interface, the first user interface element may be configured to be a second application program for providing the second interactive interface to correspond to the second application program user interface, so that the first user interface element remains substantially consistent in form during the presence across the interface, but functionally varies from one application program to another. Also, this cross-interface maintenance of form consistency and function correspondence with the current interface is applicable to the second user interface element, and will not be described again.

Fig. 22 is a schematic diagram of an operation process of an electronic device according to an embodiment of the present invention. The operation procedure of switching the user from the first interactive interface of the communication interactive function to the second interactive interface of the album function will be described with reference to fig. 22. In this embodiment, the first interactive interface provides a communication application, a communication interactive program, and the second interactive interface provides an application of an album, correspondingly, the 3 buttons 2202 included in the first user interface element may be "send voice message" and "listen to voice message", "make/receive phone call", and the 3 buttons 2201 included in the second user interface element of the second interactive interface may be "take a picture/record video", "play a picture/video", and "pause play".

Optionally, in some embodiments including embodiments under the heading "cross-interface graphical element providing method and apparatus", the first user interface element and the second user interface element remain corresponding in form. In some of the above embodiments, the plurality of buttons included in the first user interface element and the plurality of buttons included in the second user interface element each have a certain overall similarity, such as consistency and/or correspondence for at least one of: number, layout, morphology, look, orientation, color system, color, shape, pattern. There may of course be some local differences to identify their different functionalities for different interaction interfaces, e.g. in the above embodiment, on 3 buttons provided on the second interaction interface for an album application, a play cue may be set on one of the buttons, e.g. a simple triangle: These buttons may have consistency, correspondence in the properties described above when displayed across the interface, such as two sets of user interface elements 2201, 2202 in FIG. 22, each 3 in number and each placed on the right side of the interactive interface in layout, with two buttons being positioned adjacent to the middle of the right side of the interactive interface and a third button being positioned on the upper right side of the interactive interface. Based on the similarity of interface elements such as buttons, software keys and the like of the software across interfaces, unified operation senses, use habits and the like can be established for the interface operation of a user, so that the efficiency of the interactive operation of the user is improved. />

Optionally, in some embodiments including embodiments under the heading "cross-interface graphical element providing method and apparatus", the first interactive interface, the second interactive interface are each of or associated with a single program, and are located at a top level of interaction of a single application.

Optionally, in some embodiments including embodiments under the heading "cross-interface graphical element providing method and apparatus", the first interactive interface is a first contact interactive interface, and the second interactive interface is a second contact interactive interface or a first functional interface; a single application or an associated plurality of applications is loaded as a desktop interactive program during a startup phase of an electronic device, such as a communication device.

Graphic element providing method and apparatus including the above-mentioned heading "Cross-interface", "One of the first resource providing methods Examples of embodiments"He"Some embodiments of the second resource providing methodThe first functional interface mentioned in the method or apparatus of all embodiments including the related embodiments may be one, for example, corresponding to a portal of another application program other than the communication interactive application. The first contact interaction interface, the second contact interaction interface and the first functional interface all belong to or are associated with a single application or a plurality of associated applications, and the first contact interaction interface, the second contact interaction interface and the first functional interface are all located at the interaction of the single applicationAt the top level, these interactive interfaces may thus be switched to each other at the first level of interaction of the application in response to a switching operation by the user. Also, in some embodiments described above or below, a single application or an associated plurality of applications may be configured as a launch (Launcher) level application program, i.e., loaded as a desktop interactive program during a launch phase of the communication device, such that the first contact interactive interface, the second contact interactive interface, and the first functional interface are located at a top level of interaction of the entire software system, including the operating system, after system launch of the communication device. As previously described, the user may access the contact interaction interface and other functional interfaces through a first level of operation of the interaction of the software system of the communication device. The first contact interaction interface may comprise a single level interaction interface, i.e. a communication content interface or a communication record interface between the user and the contact. Of course, the first contact interaction interface may also comprise two levels of interaction interfaces, such as a user profile interface and a communication content interface between the user and the contact, in which case, typically, after system start-up of the communication device, the user profile interface in the first contact interaction interface will be loaded on top of interactions of the whole software system for direct access by the user after start-up of the communication device. In summary, this is a resource allocation that is directed to communication with contacts, or is centered on contact related information, which greatly increases the accessibility of communication resources to users, such as contact related information, and various available communication functions around contacts. This is quite different from prior art resource configurations that are oriented with the division of application, software functions/groups of functions (functions groups).

After the electronic device is started, some contact-related communication resources and other applications can be easily accessed without any user operation for multiple interaction levels of the applications, e.g. the portals of these applications can be intuitively acquired at the first layer of the interaction level of the software system of the electronic device. For electronic devices for communication, users may also want to provide more consistency or correspondence between their user interface for communication functions and interfaces for applications providing other functions such as photographing or photo album, to enhance the operability across interfaces, and even provide user interfaces that are consistent across software and hardware, during use of the electronic device. This enables integration of a plurality of different application resources, including communication interaction applications, to be provided integrally at a first interaction level of the electronic device.

Notably, are: the first functional interface may belong to or be associated with a single application of the communication device, but the first functional interface or the content provided by the first functional interface, such as an application program, may be developed by a third party, for example, a plug-in developed by the third party, or an application program of a separate third party running outside the system of the communication device or outside an operation platform of the communication device. These plug-ins or shortcuts to third party applications are provided to the user at the communication device through the first functional interface. If the third party application is launched, then interaction of the third party application may be presented at the communication device, but if the third party application exits, then a first interaction level of the software system of the communication device, such as a first contact interaction interface, a second contact interaction interface, and a first function interface, will still be presented on the desktop of the communication device.

Optionally, the method and apparatus are provided in a graphical element comprising the heading "cross-interface", "First resource providing method Some embodiments of (a)"He"Some embodiments of the second resource providing methodIn some embodiments, including the embodiments below, "the second interactive interface comprises an album application, and the user interface elements comprise user interface elements for taking a picture, taking an image, playing, and pausing.

Graphic element providing method and apparatus including the heading "Cross-interface", "Some implementations of the first resource provisioning method Examples"He"Some embodiments of the second resource providing methodThe electronic device of some embodiments, including the embodiments below, further includes a first interface of the connector, in other embodimentsOr also simply referred to as a connector, the processor in the electronic device is coupled to the first interface of the connector, and the first interface of the connector is used for detachably coupling the entity operation part. Specifically, the interface of the second end of the connector is configured on a base, and the physical operation part is configured on the base and is coupled with the interface of the second end of the connector. Thus, the corresponding two connector interfaces of the base and the electronic device, respectively, may preferably constitute a spring probe connector, which is preferably a pogo pin connector. The connector and its corresponding configuration on the operating part and the electronic device are also applicable in methods and apparatuses according to other embodiments of the present invention, and will not be described in detail hereinafter.

Optionally, the entity operation part or the user interface element of the electronic device of this embodiment may be functionally configured as a user interface of the application program provided in the first interactive interface and the second interactive interface through one or more programs. In other words, the physical operator or user interface element may enable the user to interact with the application programs provided by each of the first and second interactive interfaces by operating the physical operator or user interface element, respectively, through the configuration of the functionality of the two by one or more programs. It should be noted that the physical operation section or the user interface element mentioned in the present embodiment is equivalent in terms of operability of the mobile terminal, that is, the interactive operation with the mobile terminal by the user through the virtual user interface element can be realized by means of the physical operation section. The entity operation part and the virtual user interface keep basic consistency in function and form, so that the operability of mobile terminals such as mobile phones and electronic equipment is improved. The correspondence in form and function between the physical operation parts or virtual user interface elements shown in the present embodiment is also applicable to the method and apparatus according to other embodiments of the present invention, and will not be described again.

Method and apparatus for providing graphic element including title "cross interface", "Some of the first resource providing methods Examples"He"Some embodiments of the second resource providing methodIn the electronic device of the embodiments below, at least one communication network includes a wireless lan and a mobile communication network, and the mobile phone or the mobile terminal can be separated from the base to operate independently as an electronic device having a communication function by connecting or disconnecting the pogo pin connector. One or more programs stored in the mobile terminal may be executable by the processor unit to: according to at least one of i) an active handover operation of the communication network from the user, ii) a communication network condition surrounding the mobile terminal, in particular a signal strength of the WLAN, iii) connection or disconnection of the connector, the mobile terminal is connected to or disconnected from the wireless local area network, of course, in that the electronic device may automatically selectively connect to the mobile data network to continue supporting data traffic services to the user after the disconnection of the wireless local area network.

Fig. 23 is a schematic structural view of a terminal communication device according to another embodiment of the present invention. The following describes in detail the relevant operation of the communication device of the embodiment in which network connection switching and the like occur during connector connection/disconnection, with reference to fig. 23. The terminal communication device of this embodiment further includes a connector interface 2340, wherein the connector interface 2340 is connected to the processor unit in a pair, and the connector interface 2340 is externally used to detachably couple the entity operation part, for example, through a connector second interface 2340' provided on the base 2320. The base 2320 is physically independent of the handset 2310. The operation part is embodied as a physical keyboard 2330, the physical keyboard 2330 is disposed on the housing of the base 2320, and both ends of the connector interface 2340 are correspondingly disposed on the housing of the mobile phone 2310 and the base 2320, so that the physical keyboard 2330 can be connected to a processor disposed inside the communication device through the connector interface 2340.

Alternatively, for the embodiment shown in fig. 23 that includes the connector interface 2340 and the communication device of the base 2320, and for the communication device of all other embodiments, one or more programs may be executed by the processor to: the communication device is connected to or disconnected from the wireless local area network according to one or more of the following three: i) Active network switching operation from the user, ii) ambient communication network conditions, iii) connection or disconnection of the connector interface 2340, and simultaneously, the handset 2310 is also coupled to or decoupled from the base 2320 through the connector interface 2340. Further, one or more programs in a terminal communication device, such as a cell phone, may be executed by the processor unit to associate the user interface element and the communication key array of the entity with the wireless local area network each independently in response to connection of the terminal communication device with the wireless local area network, thereby entering an internet mode. One or more programs are also executable by the processor unit to associate the user interface element and the communication key array of the entity each independently with the mobile telephone network in response to disconnection of the terminal communication device from the wireless local area network, thereby entering a handset mode. Wherein in the internet mode, the user interface element on the first contact communication interface of the electronic device or the communication apparatus is associated with a WLAN or a mobile data network, and in the handset mode, the user interface element is associated with a mobile telephone network. Meanwhile, the resource allocation differences of the use and the forbidden of the functional modules such as the camera in the terminal communication device are also provided. Reference may be made to the following description of the embodiment shown in fig. 24 and other related embodiments, which are not repeated here.

In particular, in one aspect, in some exemplary application scenarios, a WLAN wireless data transmission network signal is generally available to a mobile phone of a user in a residence such as a user's room, while a mobile communication network is also available for access, and in this scenario, one or more programs in the mobile phone 2310 may be executed by the processor to enable the mobile phone 2310 to access the WLAN in the room, and as the geographic location of the user changes, for example, the user shifts from indoor to outdoor, the change in the geographic location may cause a communication network condition around the mobile phone 2310 carried by the user, such as a signal strength of the wireless communication network, to change. Generally, during the movement of the user, the WLAN signal will be weaker and the mobile communication network will be stronger, and when the WLAN communication network signal is below a predetermined threshold, one or more programs within the handset 2310 may be executed by the processor to cause the handset 2310 to access the mobile communication network. If the user returns to the indoor or resident surrounding area, one or more programs within the handset 2310 may be executed by the processor to re-access the handset 2310 to the WLAN based on a comparison of the signal strengths of the available multiple networks.

Meanwhile, it is noted that: the mobile phone 2310 may be used in combination with the base 2320 or may be used as a mobile terminal independently. When the user is indoors, the mobile phone 2310 may be disposed on the base 2320, and the mobile phone 2310 is operated by the physical keyboard 2330 disposed on the base, while when the user is outdoors, the user typically operates the mobile phone by virtual keys/buttons provided on the screen of the mobile phone 2310, and the virtual keys/buttons and the keyboard 2330 have a correspondence and/or consistency in at least one of number, layout, form, feel, azimuth, color system, color, shape and pattern, which is detailed in the embodiment of the communication device/electronic device under the heading "highly operable electronic device" herein.

In summary, one or more programs within the handset 2310 may be executed by the processor to make a comprehensive decision to access the handset 2310 to a WLAN or mobile communications network based on the connection or disconnection of the connector, or based on the connection or disconnection of the connector in combination with the communications conditions or communications environment of the network. Wherein, the communication conditions of the network include: signal strength, network connectivity/stability, etc., or network status, etc.

Further, optionally, the media capturing element in the above-mentioned communication device may include at least one of a microphone and a camera, and the media playing element may include at least one of a speaker and a display. Moreover, it should be noted that, in the method, the communication apparatus, and the electronic device according to some embodiments of the present invention, the mentioned display screen (display screen) generally refers to a screen portion of a display (display) to which the communication apparatus/the electronic device is coupled, preferably a touch display, a touch display screen, or also simply referred to as a display, which may be a separate display unit independent of the electronic device, such as a television, or may be a touch display integrally assembled with the electronic device, and may not be repeated elsewhere.

When the mobile phone 2310 can be used in combination with the base 2320, that is, the connector interface 2340 is communicated with the connector opposite interface 2340' provided on the base, the user is generally located indoors, so that the WLAN signal is strong, and correspondingly, the mobile phone 2310 may also automatically access the WLAN. When the user removes the mobile phone 2310 from the base 2320, the connector interface 2340 is separated from the connector opposite interface 2340' provided on the base, and at this time, generally, the user may move to the outside and away from the WLAN, so the mobile phone 2310 may automatically access the mobile communication network, or comprehensively determine that the mobile phone 2310 should be accessed to the mobile communication network or maintain the access state of the WLAN according to the disconnection state of the connector and the signal strength of a plurality of communication networks available in the environment and whether the network switching operation of the user occurs. In other words, as a result of switching the communication device between different communication networks such as the wireless lan and the mobile communication network, it is possible to still maintain the connection with the current communication network or to switch from the current communication network to another available communication network, which maintains the quality and stability of the communication connection, and to obtain the optimal communication effect as a whole.

In one or more programs in the mobile phone 2310, when the communication device such as the mobile phone is combined with the home base, a signal identifying connection with the base is sent to the operating system or the processor of the mobile phone through the data interface in the connector interface 2340, and after the one or more programs acquire the signal/event notification through the software system, the corresponding program module can switch the WLAN in the connection room and switch the software mode of the mobile phone to the "home mode". On the contrary, when the communication equipment such as the mobile phone and the household base are disconnected, a signal for identifying disconnection with the base is sent to an operating system or a processor of the mobile phone through a data interface, after one or more programs acquire the signal/event notification through a software system, the corresponding program modules can be switched to be connected to the mobile communication networks such as 3G, 4G, 5G and the like, and correspondingly, the software mode of the system is also switched to the "mobile phone mode". The "mobile phone mode" and the "home mode" herein generally relate to a scenario of outdoor mobile and home scenarios, and in particular, relate to different ways of calling and running software and hardware resources or ways of providing interactive resources provided by a user and different interaction styles generated thereby. For example, in the "mobile phone mode" mode, communication resources such as voice telephone service carried by the mobile telephone network, short message service, or data service carried by the mobile data network are mainly used or used by default. And is mainly used in the above-mentioned "home mode", or by default, uses instant communication resources such as video phones, voice messages, etc. carried through WLAN, internet. In addition, in the "home mode", resources such as a camera in the mobile phone can be automatically activated to start a monitoring function, and in the "mobile phone mode", resources and functions related to the camera are closed and a speaker is enabled. In "handset mode", the processor may be configured to automatically activate resources such as GPS in the handset to enable outdoor location/navigation services for the user; while in "home mode" this function and related resources are turned off.

Furthermore, if the above-mentioned connection switching between WLAN and mobile communication network performed automatically by the mobile phone 2310 does not meet the needs of the user, the user may also manually operate an interaction portal provided on the mobile phone, such as a button for switching connection of a communication network presented on a display screen, according to an actual usage scenario, so as to switch connection of the mobile phone 2310 to the communication network selected by the user. In other words, one or more programs within the handset 2310 may be executed by the processor to switch the handset 2310 between a wireless local area network and a mobile data network in response to a network switch operation from a user.

In some of the communication devices described above or below, the media playing unit comprises a display screen, preferably a touch display screen, or also simply a display screen; one or more programs are executable by the processor unit to: providing, via the display screen, a first array of user interfaces corresponding to the wireless data transmission network and a second array of user interfaces corresponding to the mobile telephone network in response to any one of: i) A handoff operation from a user, such as closing a connection with a WLAN, ii) a change in a surrounding communication network condition, such as a signal strength of the WLAN, iii) a connection or disconnection of a connector between the base and the handset. Wherein the second user interface array and the first user interface array respectively comprise one or more interface elements such as buttons presented on the display screen, and the user can establish communication through a wireless data transmission network or a mobile telephone network by operating the buttons.

Notably: all the connectors between the base and the mobile phone in the communication device according to the embodiments of the present invention described above and below may include a spring probe connector, for example, a pogpin connector, which has a probe interface and a pinhole interface at two ends, and is not easily damaged even if the connector is repeatedly plugged. Preferably, the probe interface of the pogo pin connector is configured on the base, and the pinhole interface of the pogo pin connector is correspondingly configured on the mobile phone.

Optionally, when the electronic device performs connection handover between wireless local area networks or mobile communication networks, one or more programs stored in the electronic device may be executed by the processor unit to: the user interface element on the first interactive interface is functionally and formally reconfigured to be associated with the wireless local area network in response to the electronic device switching connection to the wireless local area network. Or one or more programs stored in the electronic device may be executable by the processor unit to: the user interface element on said first interactive interface is functionally and formally reconfigured to be associated with a mobile communication network, in particular a mobile telephone network, in response to the electronic device switching connection to the mobile communication network.

Fig. 24 is a schematic view of an interactive interface in a terminal communication device according to another embodiment of the present invention. Taking the terminal communication device of the embodiment shown in fig. 24 as an example, the above-mentioned user interface elements, such as the second user interface array and the first user interface array shown in the figure, may be reconfigured after the communication device performs a network connection handover, such as disconnecting the WLAN connection and accessing the mobile data network, for example.

As shown in fig. 24, the first user interface array 2430A provided on the first contact interaction interface on the left side includes three interface elements, or referred to as three buttons, on the touch display screen, corresponding to "short message", "short message" and "online talk" communications with the current contact on the display screen, respectively. The second array of user interfaces 2430B provided on the first contact interactive interface on the right also includes three buttons corresponding to communications for "send voice message", "listen to voice message", "video call" respectively for the current contact on the display screen. One or more programs stored in the memory in the terminal communication device of this embodiment may be executed by the processor unit (not shown in the figure) to collect a first media signal, such as a voice message, a video message, through the microphone, the camera, etc., and transmit the first media signal, such as the voice message or the video message, etc., through the wireless data transmission network in response to a fifth operation, such as a single long-time press, a double-click touch, etc., of a middle button among three buttons of the second user interface array 2430B by the user. In general, the wireless data transmission network may include a WLAN and a mobile data network belonging to a mobile communication network. In addition, one or more programs may also be executable by the processor unit to output, through a media playing unit such as a speaker, a display screen, etc., a second media signal received via the wireless data transmission network in response to a sixth operation, e.g., a single press/touch, by the user on a lower button of the three buttons of the second user interface array 2430B. Alternatively, the second media signal, the first media signal are not limited to the above-mentioned voice message, but may be a video message, a text message, etc. belonging to data service information. By integrating and displaying a plurality of communication information from one or a plurality of communication networks carrying different communication services in the same contact interaction interface, the network connection can be switched according to comprehensive judgment of various conditions, the behavior of a user and the network environment to be in can be predicted to a certain extent according to the on-off state of the connector, and correspondingly, the electronic equipment can synchronously provide corresponding user interfaces for networks with different service properties. The interaction layer and the number requirements in the process of the user operating the mobile terminal to access the related communication information are reduced, for example, the user does not need to access different application programs such as a call management program and a short message management program in a mobile phone respectively to acquire two different communication information respectively; similarly, two kinds of communication information with different service properties, such as a short message and a voice message, are respectively acquired without respectively accessing different application programs, such as a short message management program and an instant communication program, in the mobile phone. The accessibility of the relevant communication resources/communication information in the user interaction is further improved.

Preferably, the display screen may be a touch display screen, the mobile communication network includes a mobile telephone network, and the one or more programs are further executable by the processor unit to: i) In response to a seventh operation of a user on a middle button included in the first user interface array 2430A, for example, single pressing/touching or the like, collecting a short message edited by the user through a touch display screen or collecting a third media signal such as voice of the user through a media collection unit such as a microphone and transmitting the third media signal through a mobile phone network; ii) outputting said fourth media signal, e.g. a short message, received via the mobile telephone network by means of a media playing unit, e.g. a display screen, a speaker, etc. in response to an eighth operation of the lower button in the first user interface array 2430A by the user, e.g. a single press/touch, etc., i.e. one or more programs are executable by the processor to convert text of the short message into speech by means of a "text-to-speech" function, which is output in the speaker. It should be understood that the third media signal and the fourth media signal are not limited to the short message service information, but may be voice service related information such as voice call records and voice calls.

It should be noted that: the voice service information, the short message service information and the data service related information transmitted by the wireless data transmission network can be displayed on the first contact interaction interface on the display screen in a collective or centralized way, or can be divided into a plurality of groups, and each group is independently displayed on the first contact interaction interface in different time periods. In other words, one or more programs in the communication device are executable by the processor unit to: alternatively, the one or more programs may be further executed by the processor unit to integrate and display the first media signal, the second media signal, the third media signal, and the fourth media signal on the display screen. The user can browse the voice service information, the short message service information, the voice message, the video message, the text message and the like belonging to the data service information on the same first contact interaction interface. This integrated display promotes the accessibility (accessibility) of the information generated by the various communication services to the user.

In addition, it should be understood that: in a state where the communication device is connected to the mobile communication network but not to the WLAN, such as the "handset mode" or the "outdoor mode" of the embodiment shown in fig. 24 described below, the operation interface of the data service or the user interface element of the communication network supporting the data service may still be provided on the display screen of the communication device by one or more programs in the communication device, so that the user may perform data service based communication with the current contact through these interfaces, where the communication of the data service may be established through the mobile data network in the mobile communication network, such as sending a voice message, receiving a picture message, a video message, etc. Conversely, when the electronic device is in the "home mode" state of connecting to the WLAN, the electronic device may still provide an operation interface of the mobile voice service and the short message service or a user interface element supporting operation of the mobile communication network on the display screen of the communication device through one or more programs in the communication device, so as to allow the user to send a short message, answer a call, and so on. The same applies to the methods or devices, apparatuses in other embodiments described above or below. And will not be described in detail elsewhere.

In the schematic diagram of the interactive interface in the resource providing method in the embodiment shown in fig. 24, the above-mentioned multiple media signals, or called communication information, may be divided into two groups, and displayed on the first contact interactive interface sequentially in time for two setting modes of the communication device. For example, the communication device may switch the connection between the WLAN and the mobile data network in response to a user clicking a mode switch button, such as "cell phone mode"/"internet mode" or "outdoor mode"/"home mode" for ease of understanding. Whereas communication traffic corresponding to WLAN is mainly data traffic, e.g. sending or receiving one or more of the following information: audio messages, video messages, picture messages, geographic locations, text messages, files, data, and so forth. The communication service corresponding to the mobile communication network is mainly a voice service and a short message service. The data service related information such as voice message sending and receiving may be displayed on a first contact interaction interface (not shown in the figure) in the internet mode, and the information related to voice call and short message may be displayed on a first contact interaction interface in the mobile phone mode, as shown in a first message area 2403 in the left diagram in fig. 24. Of course, it should be understood that: voice messages, video messages, text messages, etc. belonging to the data traffic information may also be displayed independently on the first contact interactive interface in the internet mode, for example a first message area (not shown in the figure). Furthermore, the above-mentioned plurality of communication information is not limited to the case where the plurality of communication information are displayed in the same space at different times, that is, the first contact interaction interface, and the plurality of communication information may be collectively displayed on the first contact interaction interface, as shown in the first message area 2403 in the right diagram in fig. 24, the communication records of the "voice call incoming record" and the "short message" are all from communication through the mobile phone network, and the "internet voice message", "geographic location information" and the "picture" are all from the wireless data transmission network such as the mobile data network or the WLAN. Here, by integrating and displaying the plurality of communication information from one or more communication networks carrying different communication services, accessibility of the plurality of communication information corresponding to various service properties is enhanced, and interaction complexity of a user in accessing the information is reduced, for example, the user does not need to access different application programs such as a call management program, a short message management program and the like in a mobile phone respectively to obtain two different communication information respectively; similarly, two kinds of communication information with different service properties, such as a short message and a voice message, are respectively acquired without respectively accessing different application programs, such as a short message management program and an instant communication program, in the mobile phone.

Of course, the user interface elements available to the user for operation and use of the communication capabilities of the mobile data network, mobile telephone network, WLAN, etc. network may be provided collectively on the first contact interface or displayed in time sequence on the first contact interface, e.g. in a group, without being limited by the communication network available or actually accessed by the communication device. Reference may also be made herein to various variations of the manner in which multiple communications of different service properties are displayed on the first contact interaction interface in the embodiment shown in fig. 24, and various variations of the user interface elements and multiple communications of corresponding different service properties referred to herein are applicable to the interface, or to the methods or apparatuses, devices of the other embodiments described above or described below. And will not be described in detail elsewhere.

Optionally, the physical operation part and the virtual user interface element are functionally redefined for the application of the first interactive interface and the application of the second interactive interface, respectively. In other words, the entity operation part may be functionally configured as user interfaces corresponding to similar or different application programs provided in the first interactive interface and the second interactive interface through one or more programs in the cellular phone. The virtual user interface element may also be functionally configured by one or more programs in the handset as user interfaces corresponding to similar or different application programs provided in the first and second interactive interfaces. Thus, the user can operate the software functions on different interactive interfaces by using the same entity operation part, or can operate the software functions on different interactive interfaces by using the same or similar virtual user interface elements on different interactive interfaces. The usability of the terminal devices or the electronic equipment such as the mobile phone is improved by following the use habit of the user. For example, when the interactive interface is switched, the user interface element is correspondingly provided on the switched user interface and the function associated with the user interface element is redefined according to the function of the switched user interface. For example, the first interactive interface provides a communication application program, a communication interactive program, and the second interactive interface provides an application program of an album, correspondingly, when the electronic device displays the first interactive interface, a plurality of entity buttons/keys provided on the base, or a plurality of virtual buttons/keys provided on the first interactive interface, respectively, the associated functions may be "send voice message" and "listen to voice message", or "make/answer phone call" and "edit/send short message", etc., while when the electronic device displays the second interactive interface, a plurality of entity buttons/keys provided on the base, or a plurality of virtual buttons/keys provided on the second interactive interface, respectively, the associated functions may be "take a picture/record video", or "browse a picture/video", etc.

The virtual user interface elements provided on the user interface described above may be maintained in form consistent with the physical operations provided on the base, and the processor may also be programmed to maintain form consistent across interfaces. In other words, the user interface elements are configured by one or more programs in the handset to maintain formal consistency across interfaces, and at the same time also formal consistency with the physical operator. For example, the user interface elements distributed on the first interactive interface and the second interactive interface are configured by one or more programs in the mobile phone to have consistency and/or correspondence with the entity operation part for at least one of: number, layout, morphology, look, orientation, color system, color, shape, pattern. Taking consistency of the layout as an example, fig. 21 is a schematic layout diagram of an entity operation portion and virtual user interface elements of an electronic device according to an embodiment of the present invention, where a virtual user interface element 2102 includes three virtual keys distributed on a first contact interaction interface: "listen", "talk", "telephone". The physical operation unit 2101 includes three physical keys provided on the base 2103: "listen", "talk", "telephone". The key layout of the entity operation unit 2101 and the user interface element 2102 corresponds to, or is consistent with, each other. Wherein, the "listen", "talk" two keys of the user interface element 2102 are arranged adjacently, and are located in the middle of the right side of the first contact interaction interface, while the "phone" key is located in the upper right side of the first contact interaction interface, and correspondingly, the "listen", "talk" and "phone" three entity keys of the entity operation portion 2101 on the base 2103 have the same/similar layout. The mobile phone terminal device is further compatible with the use habit of a user, and the operability of the mobile phone terminal device or the electronic equipment is improved.

In another embodiment of the present invention, there is also provided a communication apparatus including: a display; a processor unit; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing the methods or steps therein according to any of the embodiments of the present invention.

In another embodiment of the present invention, there is also provided a communication apparatus including: means for performing the method according to any of the embodiments of the invention or its main steps.

Alternative embodiments

Embodiment 1. An interface element providing method for an electronic device includes:

displaying a first interactive interface on a display for the electronic device;

integrating and outputting a plurality of communication information corresponding to at least one communication network through the first interactive interface;

responding to the switching operation, and switching and displaying a second interactive interface on the display;

wherein a first user interface element and a second user interface element are provided on the first and second interactive interfaces, respectively, and for the first interactive interface, the first user interface element is associated with the at least one communication network.

Embodiment 2. The interface element providing method according to embodiment 1, wherein:

the first and second user interface elements functionally correspond to an application of the first and second interactive interfaces, respectively.

Embodiment 3. The interface element providing method according to embodiment 1 or 2, wherein:

the first user interface element and the second user interface element maintain correspondence in form.

Embodiment 4. The interface element providing method according to embodiment 3, wherein:

the first user interface element and the second user interface element have a consistency and/or correspondence for at least one of: number, layout, morphology, look, orientation, color system, color, shape, pattern.

Embodiment 5. The interface element providing method according to any one of embodiments 1 to 4, wherein the first interactive interface is a first contact interactive interface, and the interface element providing method further comprises:

in response to a user operation of the first user interface element, communicating with a first contact over the at least one communication network to generate the plurality of communication information, the plurality of communication information having different business properties; the integrating outputting step further includes:

And integrating and outputting the communication information aiming at the first contact to the first contact interaction interface.

Embodiment 6. The interface element providing method according to embodiment 5, wherein:

the at least one communication network comprises a plurality of wireless communication networks including a mobile telephone network and a wireless data transmission network, and the first user interface element is associated with the mobile telephone network and the wireless data transmission network, respectively; the step of communicating further comprises:

in response to a user operation of the first user interface element, communicating with a first contact over the mobile telephony network or the wireless data transmission network to generate the plurality of communications; the integrating outputting step further includes:

and integrating and displaying the communication information aiming at the first contact through the mobile telephone network and the wireless data transmission network on a first contact interaction interface.

Embodiment 7. The interface element providing method according to embodiment 6, wherein: the first user interface element is a plurality of buttons, the plurality of communication information is respectively from an interface corresponding to the mobile phone network and an interface corresponding to the wireless data transmission network, and the mobile phone network interface comprises: a voice interface and a short message interface; the step of communicating further comprises:

Responding to the operation of the user on the buttons, and respectively communicating with a first contact person through the voice interface, the short message interface and the wireless data transmission network interface to generate a plurality of communication information; the plurality of communication information includes: i) Voice service information, ii) short message service information; iii) Data traffic information including one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files, data; and, the integrated display step further includes:

and arranging at least two of the voice service information and the short message service information aiming at the first contact person according to occurrence time sequence, and displaying the first contact person interaction interface on the display.

Embodiment 8. The interface element providing method according to any one of embodiments 1-7, wherein: the at least one communication network includes a wireless local area network and a mobile communication network, and the interface element providing method further includes:

the electronic device is switched between the wireless local area network and the mobile data network according to i) a network switching operation from a user or ii) surrounding communication network conditions.

Embodiment 9. The interface element providing method according to embodiment 8, wherein: the interface element providing method further includes:

the first user interface element is functionally and formally reconfigured to be associated with the wireless local area network or the mobile telephone network in response to the electronic device being connected or disconnected from the wireless local area network.

Embodiment 10. An electronic device, comprising: a processor unit; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit to:

providing user interface elements on the first interactive interface and the second interactive interface respectively; wherein the user interface element on the first interactive interface is associated with the at least one communication network.

Embodiment 11. The electronic device of embodiment 10 further comprising a connector interface to which the processor unit is connected, and the connector interface is for detachably coupling to a physical operation section; the functions of the entity operation part or the user interface element are correspondingly and dynamically configured along with the switching of the first interactive interface and the second interactive interface respectively.

Embodiment 12. The electronic device of embodiment 10 or 11, wherein:

the user interface element is configured by the one or more programs to maintain formal consistency across interfaces and formal consistency with the physical operator.

Embodiment 13. The electronic device of embodiment 12, wherein:

the user interface elements distributed over the first and second interactive interfaces are configured to have consistency and/or correspondence with the entity operation part for at least one of: number, layout, morphology, look, orientation, color system, color, shape, pattern.

Embodiment 14 the electronic device of any of embodiments 10-13, wherein the first interactive interface is a first contact interactive interface, the one or more programs further configured to be executed by the processor unit to:

in response to user operation of the user interface element or entity operation portion corresponding to the first contact interaction interface, communicating with a first contact over the at least one communication network to generate the plurality of communication information, the plurality of communication information having different business properties; and integrating, by the first functional interface, the output of the communication information corresponding to the at least one communication network further includes:

And integrating and outputting the communication information aiming at the first contact through the first contact interaction interface.

Embodiment 15. The electronic device of embodiment 14, wherein:

the at least one communication network comprises a plurality of wireless communication networks including a mobile telephone network and the wireless data transmission network, the user interface element on the first contact interaction interface being associated with the mobile telephone network and the wireless data transmission network, respectively; in response to a user operation of the user interface element or entity operation portion corresponding to the first contact interaction interface, communicating with a first contact over the at least one communication network to generate the plurality of communication information further includes:

in response to a user operation of the user interface element, communicating with a first contact over the mobile telephone network or the wireless data transmission network to generate the plurality of communications; and through the first contact interaction interface, integrating and outputting the plurality of communication information for the first contact further includes:

Embodiment 16. The electronic device of embodiment 15, wherein: the entity operation part and the user interface element respectively comprise a plurality of buttons, the plurality of communication information respectively come from an interface corresponding to the mobile phone network and an interface corresponding to the wireless data transmission network, and the mobile phone network interface comprises: a voice interface and a short message interface; and in response to a user operation of the user interface element, communicating with a first contact over the mobile telephone network or the wireless data transmission network to generate the plurality of communications information further comprises:

respectively responding to the operation of the plurality of buttons by a user, and communicating with a first contact person through the voice interface, the short message interface or the wireless data transmission network interface to generate a plurality of communication information; the plurality of communication information includes: i) Voice service information, ii) short message service information; iii) Data traffic information including one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files, data; and, the integrated display step further includes:

Embodiment 17. The electronic device of any of embodiments 11-13, wherein: the at least one communication network includes a wireless local area network and a mobile communication network, and

the one or more programs are executable by the processor unit to: connecting or disconnecting the electronic device to or from the wireless local area network according to i) ambient communication network conditions, and/or ii) connection or disconnection of the connector interface.

Embodiment 18. The electronic device of embodiment 17, wherein: the one or more programs are executable by the processor unit to: the user interface element on the first interactive interface is functionally and formally reconfigured to be associated with the wireless local area network or the mobile telephone network in response to the electronic device being connected to or disconnected from the wireless local area network.

Embodiment 19. The interface element providing method according to any one of embodiments 5-7 or the electronic device according to any one of embodiments 14-16, wherein the operations on the plurality of buttons respectively include any one of: single click, double click, short single press, short double press, long press, toggle, touch slide, single contact, single continuous contact, simultaneous pressing of two or more buttons.

Embodiment 20. The interface element providing method according to any of embodiments 1-9 or the electronic device according to any of embodiments 10-18, wherein the first interactive interface, the second interactive interface each belong to or are associated with a single program, and are located at a top level of an interaction hierarchy of the single program.

Embodiment 21. The interface element providing method or electronic device according to embodiment 20, wherein the first interactive interface is a first contact interactive interface, and the second interactive interface is a second contact interactive interface or a first functional interface; the first contact interaction interface is integrated into an operating system user interface of the communication device, the second contact interaction interface, or the first functional interface such that the first contact interaction interface is preferentially loaded on the display upon activation of the communication device.

Embodiment 22. The electronic device of any of embodiments 1-4 or any of embodiments 10-13 wherein the second interactive interface comprises an album application and the user interface elements comprise at least one of user interface elements for taking a picture, taking an image, playing, pausing.

Embodiment 23. An electronic device, comprising: a processor unit; a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing any of the methods of embodiments 1-9.

Embodiment 24. An information processing apparatus for use in an electronic device having one or more processors, comprising:

apparatus for performing any one of the methods according to embodiments 1-9.

Embodiment 25. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods of embodiments 1-9.

Embodiment 26. The electronic device or the interface element providing method according to embodiment 7 or 16, wherein the voice service information and the short message service information, and the data service information respectively have a preset maximum duration, a maximum text length, or a maximum volume.

Embodiment 27. An electronic device, comprising: a display, a processor unit, and a touch-sensitive surface unit configured to detect a contact; wherein the processor unit is coupled with the display and the touch-sensitive surface unit, the processing unit being programmed to perform the steps of any of the methods according to claims 1 to 9.

Embodiment 28. An electronic device, comprising: a processor unit, a display and a memory coupled to the processor unit, respectively; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing any of the methods of claims 1-9.

Embodiment 29. An electronic device, comprising: a display, a memory, a processor unit, one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing any of the methods of claims 1-9.

The apparatus embodiments described above are merely illustrative, wherein elements illustrated as separate elements may or may not be physically separate, and elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by adding necessary general purpose hardware platforms, or may be implemented by a combination of hardware and software. Based on such understanding, the foregoing aspects, in essence and portions contributing to the art, may be embodied in the form of a computer program product, which may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable communication device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable communication device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable communication device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable communications device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer implemented process such that the instructions which execute on the computer or other programmable device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes a processor unit (CPU), input/output interfaces, a network interface, and memory.

The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An interface element providing method for an electronic device, comprising:

displaying a first contact interaction interface on a display for the electronic device;

integrating and outputting a plurality of communication information corresponding to at least one communication network through the first contact interaction interface;

responding to the switching operation, and switching and displaying the first contact interaction interface on the display as an album application interface;

wherein a first plurality of virtual keys and a second plurality of virtual keys are provided on the first contact interaction interface and the album application interface, respectively, and for the first contact interaction interface, the first plurality of virtual keys is associated with the at least one communication network;

The first contact interaction interface and the album application interface respectively provide a communication application program and an album application program;

the first plurality of virtual keys are used for operating instant messaging applications in the first contact interaction interface; the second plurality of virtual keys for operating an album application in the album application interface; and

the first plurality of virtual keys and the second plurality of virtual keys maintain consistency in number and layout.

2. The interface element providing method according to claim 1, wherein:

the first plurality of virtual keys and the second plurality of virtual keys are perceptually identical and/or corresponding.

3. The interface element providing method according to claim 1, wherein: the first plurality of virtual keys and the first plurality of virtual keys are respectively positioned on the right side of the first contact interaction interface and the right side of the album application interface;

the electronic equipment is a communication device, and the communication device is a smart phone.

4. The interface element providing method according to claim 3, wherein:

the first plurality of virtual keys and the second plurality of virtual keys have a consistency and/or correspondence with respect to at least one of: morphology, perception, orientation, color system, color, shape, pattern.

5. The interface element providing method according to claim 1, the interface element providing method further comprising:

in response to a user operation of the first plurality of virtual keys, communicating with a first contact over the at least one communication network to generate the plurality of communication information, the plurality of communication information having different business properties; the integrating outputting step further includes:

6. The interface element providing method according to claim 5, wherein:

the at least one communication network comprises a plurality of wireless communication networks including a mobile telephone network and a wireless data transmission network, and the first plurality of virtual keys are communicatively coupled/associated with the mobile telephone network and the wireless data transmission network, respectively; the step of communicating further comprises:

in response to a user operation of the first plurality of virtual keys, communicating with a first contact over the mobile telephone network or the wireless data transmission network to generate the plurality of communications; the integrating outputting step further includes:

7. The interface element providing method according to claim 6, wherein: the first plurality of virtual buttons are a plurality of buttons, the plurality of communication information is respectively from an interface corresponding to the mobile phone network and an interface corresponding to the wireless data transmission network, and the mobile phone network interface comprises: a voice interface and a short message interface; the step of communicating further comprises:

responding to the operation of the user on the buttons, and respectively communicating with a first contact person through the voice interface, the short message interface and the wireless data transmission network interface to generate a plurality of communication information; the plurality of communication information includes: i) Voice service information, ii) short message service information; iii) Data traffic information including one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files; and, the integrated display step further includes:

8. The interface element providing method as claimed in claim 7, wherein: the at least one communication network includes a wireless local area network and a mobile communication network, and the interface element providing method further includes:

switching the electronic device between the wireless local area network and the mobile data network according to i) a network switching operation from a user or ii) surrounding communication network conditions;

the first plurality of virtual keys are functionally and formally reconfigured to communicatively couple/associate with the wireless local area network or the mobile telephone network in response to the electronic device being connected or disconnected from the wireless local area network.

9. The interface element providing method as claimed in claim 8, wherein:

the second plurality of virtual keys comprises one or more of virtual keys for taking a picture, taking an image, playing, pausing, and browsing a photo;

the first plurality of virtual keys includes one or more of virtual keys for sending voice messages, listening to voice messages, video calls, audio calls.

10. An electronic device, comprising: a processor unit; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit to:

outputting a plurality of communication information corresponding to at least one communication network through the first contact interaction interface;

responding to the switching operation, and switching and displaying the first contact interaction interface on the display as an album application interface; the first contact interaction interface and the album application interface respectively provide a communication application program and an album application program;

providing user interface elements on the first contact interaction interface and the album application interface respectively;

a user interface element on the first contact interaction interface, associated with the at least one communication network, for operating an instant messaging application in the first contact interaction interface; a user interface element on the album application interface for operating an album application in the album application interface;

wherein i) the user interface elements on the first contact interaction interface and ii) the user interface elements on the album application interface maintain consistency in number and layout.

11. The electronic device of claim 10, further comprising a connector interface to which the processor unit is connected, and for detachably coupling to a physical manipulation section; the functions of the entity operation part or the user interface element are correspondingly and dynamically configured along with the switching of the first contact interaction interface and the album application interface respectively.

12. The electronic device of claim 11, wherein:

13. The electronic device of claim 12, wherein:

the user interface elements distributed on the first contact interaction interface and the album application interface are configured to have consistency and/or correspondence with the entity operation part with respect to at least one of the following: morphology, perception, orientation, color system, color, shape, pattern.

14. The electronic device of claim 13, wherein the first contact interaction interface is a first contact interaction interface, the one or more programs further configured to be executed by the processor unit to:

Integrating and outputting the communication information aiming at the first contact through the first contact interaction interface;

the user interface element on the first contact interaction interface and the user interface element on the album application interface are respectively positioned on the right side of the first contact interaction interface and the right side of the album application interface.

15. The electronic device of claim 14, wherein:

said at least one communication network comprises a plurality of wireless communication networks including a mobile telephone network and said wireless data transmission network, said user interface element on said first contact interaction interface being communicatively coupled/associated with said mobile telephone network and said wireless data transmission network, respectively; in response to a user operation of the user interface element or entity operation portion corresponding to the first contact interaction interface, communicating with a first contact over the at least one communication network to generate the plurality of communication information further includes:

16. The electronic device of claim 15, wherein: the entity operation part and the user interface element respectively comprise a plurality of buttons, the plurality of communication information respectively come from an interface corresponding to the mobile phone network and an interface corresponding to the wireless data transmission network, and the mobile phone network interface comprises: a voice interface and a short message interface; and in response to a user operation of the user interface element, communicating with a first contact over the mobile telephone network or the wireless data transmission network to generate the plurality of communications information further comprises:

respectively responding to the operation of the plurality of buttons by a user, and communicating with a first contact person through the voice interface, the short message interface or the wireless data transmission network interface to generate a plurality of communication information; the plurality of communication information includes: i) Voice service information, ii) short message service information; iii) Data traffic information including one or more of the following: audio messages, video messages, picture messages, geographic locations, text messages, files; and, the integrated display step further includes:

17. The electronic device of claim 13, wherein: the at least one communication network includes a wireless local area network and a mobile communication network, and

18. The electronic device as recited in claim 17, wherein: the one or more programs are executable by the processor unit to: the user interface element on the first contact interaction interface is functionally and formally reconfigured to communicatively couple/associate with the wireless local area network or the mobile telephone network in response to the electronic device being connected or disconnected from the wireless local area network.

19. The electronic device of any of claims 10-13, wherein the user interface elements on the album application interface include one or more of virtual keys for taking a photograph, taking an image, playing, pausing, browsing a photograph;

The user interface element on the first contact interaction interface comprises one or more of virtual keys for sending voice messages, listening to voice messages, video calls, audio calls;

the user interface element on the first contact interaction interface is positioned on the right side of the first contact interaction interface, and the user interface element on the album application interface is positioned on the right side of the album application interface.

20. An electronic device, comprising: a processor unit; a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing any of the methods of claims 1-9.

21. An information processing apparatus for use in an electronic device having one or more processors, comprising:

apparatus for performing any of the methods of claims 1-9.

22. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods of claims 1-9.

23. An electronic device, comprising: a display, a processor unit, and a touch-sensitive surface unit configured to detect a contact; wherein the processor unit is coupled with the display and the touch-sensitive surface unit, the processing unit being programmed to perform the steps of any of the methods according to claims 1 to 9.

24. An electronic device, comprising: a processor unit, a display and a memory coupled to the processor unit, respectively; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing any of the methods of claims 1-9.

25. An electronic device, comprising: a display, a memory, a processor unit, one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor unit, the one or more programs comprising instructions for performing any of the methods of claims 1-9.