CN111078427B

CN111078427B - Message reminding method, electronic equipment and storage medium

Info

Publication number: CN111078427B
Application number: CN201911225570.XA
Authority: CN
Inventors: 封宣阳; 蔡海蛟; 冯歆鹏; 周骥
Original assignee: NextVPU Shanghai Co Ltd
Current assignee: NextVPU Shanghai Co Ltd
Priority date: 2019-12-04
Filing date: 2019-12-04
Publication date: 2024-02-06
Anticipated expiration: 2039-12-04
Also published as: CN111078427A

Abstract

The disclosure relates to a message reminding method, electronic equipment and storage medium. The message reminding method comprises the following steps: receiving a new message, and judging the priority of the new message according to a prestored priority judging rule; adding the received new message into a message queue in a text format according to the priority; and according to the ordering of the messages in the message queue, broadcasting the messages in the message queue in a voice way.

Description

Message reminding method, electronic equipment and storage medium

Technical Field

The present disclosure relates to electronic devices, and more particularly, to a message alert method for an electronic device.

Background

In general, there are various ways for an electronic device to alert a user of a message, such as displaying a list of messages through a display screen, displaying messages item by item in a pop-up menu manner, or broadcasting audio resources through a speaker. The method of displaying the message list through the display screen or the method of displaying the messages item by item in a pop-up menu mode is intuitive, but has high cost due to the need of the display screen. And are not well suited for a particular user population, such as visually impaired individuals. The audio needs to be customized separately for the different messages by way of the speaker playing the audio. Therefore, more customized audio resources are needed, more storage space is needed, and flexible management of multiple messages is difficult.

Disclosure of Invention

According to one aspect of the present disclosure, there is provided a message alert method of an electronic device, including: receiving a new message, and judging the priority of the new message according to a prestored priority judging rule; adding the received new message into a message queue in a text format according to the priority; and according to the ordering of the messages in the message queue, broadcasting the messages in the message queue in a voice way. .

According to another aspect of the present disclosure, there is provided an electronic device including: a processor; and a memory storing a program comprising instructions that when executed by the processor cause the processor to perform the methods of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing a program comprising instructions that, when executed by a processor of an electronic device, cause the electronic device to perform the method in the present disclosure.

Further features and advantages of the present disclosure will become apparent from the following description of exemplary embodiments, which is to be taken in conjunction with the accompanying drawings.

Drawings

The accompanying drawings illustrate exemplary embodiments and, together with the description, serve to explain exemplary implementations of the embodiments. The illustrated embodiments are for exemplary purposes only and do not limit the scope of the claims. Throughout the drawings, identical reference numerals designate similar, but not necessarily identical, elements.

FIG. 1 is a flowchart of a message alert method for an electronic device according to an exemplary embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a priority determination rule table according to an exemplary embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating an example of adding a new message to a message queue according to an example embodiment of the present disclosure;

fig. 4 (a) and 4 (b) are schematic diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure;

fig. 5 (a) and 5 (b) are schematic diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure;

fig. 6 (a) and 6 (b) are schematic diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure;

fig. 7 (a) and 7 (b) are schematic diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure;

fig. 8 is a flowchart of an exemplary method of voice broadcasting messages in a message queue according to an exemplary embodiment of the present disclosure;

fig. 9 is a block diagram illustrating an example of an electronic device according to an exemplary embodiment of the present disclosure.

Detailed Description

In the present disclosure, the use of the terms "first," "second," and the like to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of the elements, unless otherwise indicated, and such terms are merely used to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, and in some cases, they may also refer to different instances based on the description of the context.

The terminology used in the description of the various examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, the elements may be one or more if the number of the elements is not specifically limited. Furthermore, the term "and/or" as used in this disclosure encompasses any and all possible combinations of the listed items.

Fig. 1 is a flowchart illustrating a message alert method according to an exemplary embodiment of the present disclosure.

The message alert method shown in fig. 1 may be used with any portable electronic device, such as a smart phone, tablet, wearable device (e.g., smart watch, smart glasses, smart athletic shoes, smart wristband, smart headband, etc.). The portable electronic devices can acquire environmental information through various sensing technologies, and acquire cloud services through cloud interconnection. When the message reminding method is used for the portable electronic devices, related messages can be transmitted to users according to the importance degree of the messages in a voice broadcasting mode. For visually impaired people, the method is particularly significant in timely knowing the relevant information of the electronic equipment in a voice broadcasting mode.

The disclosure provides a message reminding method of electronic equipment, comprising the following steps: receiving a new message, and judging the priority of the new message according to a prestored priority judging rule; adding the received new message into a message queue in a text format according to the priority; and according to the ordering of the messages in the message queue, broadcasting the messages in the message queue in a voice way. Embodiments of the present disclosure are described in detail below in conjunction with fig. 1.

First, in step S101, a new message is received, and the priority of the new message is determined according to a priority determination rule stored in advance.

The message may be various information that needs to be notified to the user. According to some embodiments, the message may be information related to an operational state of the electronic device. In the operation process of the electronic device, an external instruction (for example, the operation of a user) may change the operation state of the electronic device, for example, the user may control the electronic device to be turned on or turned off through an on-off button on the electronic device, and at this time, a message of "device on" or "device off" may be broadcast by voice to remind the user that the electronic device has been turned on or turned off in response to the operation thereof; the operation of each component in the electronic device may also change the operation state of the electronic device, for example, when the power consumption of a certain component in the electronic device is too high, the temperature detection circuit of the electronic device may detect an over-temperature fault, and at this time, a message of "over-temperature fault" may be broadcast in a voice manner to remind the user that the over-temperature fault occurs in the electronic device, so that the user may perform the next operation (for example, shutdown to cool the electronic device for a period of time).

According to further embodiments, the message may be information relating to various communication connections of the electronic device. In an electronic device, the electronic device may have various types of communication connections, such as Wi-Fi, bluetooth, in order to connect the electronic device with the outside world. Therefore, when the state of the communication connection is changed, the user can be reminded. For example, when the electronic device successfully connects Wi-Fi, a "Wi-Fi connection success" may be voice broadcast; for example, when the electronic device turns on the bluetooth function, "bluetooth on" may be voice-broadcast.

According to some embodiments, the message may be information related to the battery level of the electronic device. When the user normally uses the electronic device without charging, the user can know the electric quantity of the battery so as to judge the cruising ability of the electronic device. For example, when the battery power is lower than a certain power, the "battery low power" may be broadcasted in language to remind the user to perform the charging operation or reduce the operation with higher power consumption. The user may also need to know the battery charge when charging the electronic device, in order to determine the charging progress, for example, if the percentage of the battery charge increases by a certain value (e.g., 5% or other user-set value) when charging the electronic device, the user is notified of the current charge of the battery.

According to some embodiments, the message may be information related to a navigation function of the electronic device. For example, when the electronic device is a vision-impaired assisting device or when the driver uses the electronic device for navigation while driving the vehicle, it may navigate the user based on the map data and the route planned by the user, so that the electronic device needs to remind the user of direction information in real time, for example, voice broadcast of "turn left", "turn right", "go ahead", etc., while the user walks.

According to further embodiments, the message may be information relating to an image processing function (in particular a text recognition function) of the electronic device. For example, when the electronic device is a reading aid, the user needs to obtain the positions of certain segments in the paper, and the corresponding positions may be voice-reported, e.g., "left", "right", "above", "below", etc.

According to embodiments of the present disclosure, messages from related components of an electronic device may be received to voice broadcast the messages to a user. According to some embodiments, a message from a power on/off circuit may be received. When a user starts or shuts down, the switching circuit correspondingly sends starting information or shutdown signals. According to some embodiments, a message from a temperature detection circuit may be received: and when the temperature detection circuit detects that the temperature of the electronic equipment exceeds the upper limit of the temperature value, sending an over-temperature fault message. According to other embodiments, a message from the battery management circuit may also be received. For example, when the electronic device is not in a charged state, a charge alert message may be sent if the battery management circuit detects that the current charge level is below a charge threshold. For example, when the electronic device is in a charging mode, the battery management circuit detects the battery charge and if the battery charge percentage increases by a certain value (e.g., 5% or other user-set value), the user is notified of the current battery charge.

Embodiments of the present disclosure may periodically initiate a query to a relevant component of an electronic device to receive messages from the relevant component of the electronic device. And after receiving the inquiry, the relevant parts of the electronic equipment reply to respective messages which are currently required to remind the user. For example, the temperature detection circuit and the battery management circuit may be periodically queried to obtain the reminding message related to the temperature and the electric quantity. The relevant components of the electronic device may be queried at the same period, or at different periods, for example, the battery management circuit may be queried at longer periods when the battery level is greater than a predetermined level percentage (e.g., 40%), and may be queried at shorter periods when the battery level is less than the predetermined level percentage. The interrogation period may range from, for example, 100ms to 10s. It should be noted that the scope of the above interrogation cycle is by way of example only and not a limitation of the present disclosure.

According to other embodiments, in order to timely notify a user, when an event corresponding to a message to be reminded occurs, a component of the electronic device actively sends the message to be reminded. For example, when a user turns on/off, the on/off machine immediately sends an on/off message, so that the user can know the on/off state of the electronic device in time.

According to the present disclosure, a priority determination rule may be predetermined, for example, a priority corresponding to a message sent from a related component of the electronic device is predetermined. The received message is compared to predetermined rules to determine the priority of the received message. According to some embodiments, the priority corresponding to a particular message may be specified in a priority determination rule, e.g., a message that agrees to charge a reminder to be high priority and a message that agrees to battery level a reminder to be next highest priority.

According to other embodiments, the user may modify the priority of specific messages in the priority determination rule, or delete the correspondence between some specific messages and the priority, as desired.

Preferably, for a specific message requiring priority to be agreed in advance, the priority of the message and its corresponding priority may be stored as a priority judgment rule table as shown in fig. 2, where the priorities are priority 1, priority 2, priority N in order from high to low. Under the entry corresponding to each priority in the table, all messages of that priority are recorded. When a specific message is received, looking up a table one by one according to the order of priority 1, priority 2, &..and priority N, when the specific message exists under an item of a certain priority of the table, stopping looking up the table, and determining the priority corresponding to the item as the priority of the specific message.

According to some embodiments, the priority of all messages from related components of the electronic device may be specified in a priority determination rule, e.g., all messages from a power on/off circuit (e.g., device power on, device power off) may be specified as the highest priority message.

According to other embodiments, the priority of a certain type of message may be specified in a priority determination rule, e.g., a message in which all messages for a navigation function (e.g., direction information) are the lowest priority may be specified.

It should be noted that the above embodiments of the priority determination rule are merely examples and are not limiting of the present disclosure. The priority determination rules may be determined according to a particular application and/or need, and may be combined, for example, to determine the priority of all messages in the electronic device.

In step S103, the received new message is added to the message queue in text format according to the priority.

According to some embodiments, the message queues may be implemented in various data structures, such as arrays, linked lists, and the like. Each message in the message queue may be an element in the message queue, e.g., a single element in an array, a single node in a linked list.

The message in response to the detected change in state of the electronic device or the message delivered by the associated application may be converted to a message in text format in a number of ways.

According to some embodiments, an interface module may be used to convert messages received from related components of an electronic device into messages in text format. The message received from the relevant component of the electronic device may be an encoding of the agreed event. After receiving the message, the interface module judges an event corresponding to the message according to the code, and adds a text which corresponds to the event and needs to be broadcasted into a message queue. For example, when the electronic device is powered on, the received message is a code (x 0001) corresponding to the power on, the interface module determines that a power on event occurs according to the code, and then adds a text "device power on" corresponding to the power on event and needing to be broadcasted to the message queue. The text format may be various data types representing text, such as strings (strings), among others. Those skilled in the art will appreciate that the new message may also be expressed as text formatted information using descriptive language; thus, when a signal is obtained from a corresponding message source, a message in text format corresponding to the signal is directly added to the message queue. For example, when the electronic device is detected to be powered on, a message in a text format such as "device power on" is directly added to the message queue.

According to some embodiments, messages in the message list are ordered from high to low by priority. For example, in the case where the priorities in the message list are priority 1, priority 2, priority N in order from high to low, the message list is sequentially: messages with priority 1, messages with priority 2.

According to some embodiments, the location in the message queue where the new message should be queued is determined and the new message is added at that location, according to priority. Because of the different real-time requirements for broadcasting messages of different priorities, the strategies for adding messages of different priorities to the message queue are also different.

In step S105, the messages in the message queue are voice broadcast according to the order of the messages in the message queue.

According to some embodiments, messages in a message queue are converted to voice playout on a priority by priority basis in the order in which the messages are arranged in the message queue. In the message queue, messages are ranked by priority from high to low. And, for messages of the same priority in the message queue, earlier received messages are ordered before later received messages. Thus, each time the forefront message in the message queue (i.e., the earliest message of the highest priority in the current message queue) is converted to speech, then that message is deleted from the message queue, and the remaining messages in the message queue are advanced in sequence.

According to some embodiments, any currently available TTS (Text to Speech) speech synthesis technology may be used to convert a text-formatted message in real-time to a standard smooth speech presentation. For example, speech synthesis may be performed using a generic TTS, a personalized TTS, an emotional TTS.

According to the embodiment, the text format is adopted to represent the message, so that the management of the message queues ordered according to the priority can be flexibly realized, and the power consumption caused by program operation is reduced. In addition, according to the embodiment, the most important information can be timely transmitted to the user due to the fact that the voice broadcasting of the message is carried out according to the priority, and therefore user experience is improved.

According to some embodiments, when the priority of the new message is not the lowest priority, then the new message is added before all lower priority messages in the message queue. According to some embodiments, a new message is added before all messages of the same priority in the message queue, after all higher priority messages. According to further embodiments, a new message is added to the message queue after all messages of the same priority and before all messages of lower priority.

According to some embodiments, when the priority of the new message is the highest priority, then the new message is added before all messages in the message queue.

Fig. 3 is a schematic diagram illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure. Message a is currently being broadcast. It is assumed that in fig. 3, the priorities are priority 1, priority 2, and priority 3 in order from high to low.

As shown in fig. 3, in the original message queue, messages B, C and D are sequentially from front to back, where the priority of message B is priority 1, the priority of message C is priority 2, and the priority of message D is priority 3. Since the priority of the new message E to be added is priority 1 and priority 1 is the highest priority, the new message E is added before the message B. In the updated message queue, the messages E, B, C and D are sequentially from front to back.

According to other embodiments, when the priority of the new message is the highest priority, determining whether the current message queue contains the highest priority message; if the current message queue contains the highest priority message, adding the new message to the message queue after all the highest priority messages and before all other priority messages; if the current message queue does not contain the highest priority message, then a new message is added to the message queue before all messages in the message queue.

Fig. 4 (a) and 4 (b) are schematic diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure. Message a is currently being broadcast. It is assumed that in fig. 4 (a) and 4 (b), the priority is priority 1, priority 2, priority 3 in order from high to low.

As shown in fig. 4 (a), in the original message queue, a message B, a message C, and a message D are sequentially from front to back, where the priority of the message B is a priority 1, the priority of the message C is a priority 2, and the priority of the message D is a priority 3. Since the priority of the new message E to be added is priority 1, the current message queue contains the messages with the same priority as the priority of the new message, so the new message E is added after the message B and before the message C. In the updated message queue, the messages B, E, C and D are sequentially from front to back.

As shown in fig. 4 (B), in the original message queue, messages B, C and D are sequentially sent from front to back, where the priorities of messages B and C are priority 2 and the priorities of messages D are priority 3. Since the priority of the new message E to be added is priority 1, the current message queue does not contain the messages with the same priority as the priority of the new message, so the new message E is added before the messages B, C and D. In the updated message queue, the messages E, B, C and D are sequentially from front to back.

According to some embodiments, when the priority of the new message is not the highest priority and is not the lowest priority, determining that the current message queue contains a message of the same priority as the priority of the new message; if the current message queue contains messages of the same priority as the priority of the new message, the new message is added after all higher priority messages in the message queue, before all messages of the same priority. According to some embodiments, if the current message queue does not contain messages of the same priority as the priority of the new message, the new message is added after all higher priority messages and before all lower priority messages in the message queue.

Fig. 5 (a) and 5 (b) are diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure. Message a is currently being broadcast. It is assumed that in fig. 5 (a) and 5 (b), the priority is priority 1, priority 2, priority 3 in this order from high to low.

As shown in fig. 5 (a), in the original message queue, a message B, a message C, and a message D are sequentially from front to back, where the priority of the message B is a priority 1, the priority of the message C is a priority 2, and the priority of the message D is a priority 3. Since the priority of the new message E to be added is priority 2, the current message queue contains the messages with the same priority as the priority of the new message, so the new message E is added after the message B and before the message C. In the updated message queue, the messages B, E, C and D are sequentially from front to back.

As shown in fig. 5 (B), in the original message queue, messages B, C, and D are sequentially from front to back, where the priorities of messages B and C are priority 1, and the priorities of messages D are priority 3. Since the priority of the new message E to be added is priority 2, the current message queue does not contain a message with the same priority as the priority of the new message, so the new message E is added after the message C and before the message D. In the updated message queue, the message B, the message C, the message E and the message D are sequentially arranged from front to back.

According to further embodiments, when the priority of the new message is not the highest priority and is not the lowest priority, determining that the current message queue contains a message of the same priority as the priority of the new message; if the current message queue contains messages of the same priority as the new message, the new message is added after all messages of the same priority and before all lower priority messages in the message queue. According to some embodiments, if the current message queue does not contain messages of the same priority as the priority of the new message, the new message is added after all higher priority messages and before all lower priority messages in the message queue.

Fig. 6 (a) and 6 (b) are diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure. Message a is currently being broadcast. It is assumed that in fig. 6 (a) and 6 (b), the priority is priority 1, priority 2, priority 3 in this order from high to low.

As shown in fig. 6 (a), in the original message queue, a message B, a message C, and a message D are sequentially from front to back, where the priority of the message B is a priority 1, the priority of the message C is a priority 2, and the priority of the message D is a priority 3. Since the priority of the new message E to be added is priority 2, the current message queue contains the messages with the same priority as the priority of the new message, so the new message E is added after the message C and before the message D. In the updated message queue, the message B, the message C, the message E and the message D are sequentially arranged from front to back.

As shown in fig. 6 (B), in the original message queue, messages B, C, and D are sequentially from front to back, where the priorities of messages B and C are priority 1, and the priorities of messages D are priority 3. Since the priority of the new message E to be added is priority 2, the current message queue does not contain a message with the same priority as the priority of the new message, so the new message E is added after the message C and before the message D. In the updated message queue, the message B, the message C, the message E and the message D are sequentially arranged from front to back.

According to some embodiments, when the priority of the new message is the lowest priority, determining whether the current message queue contains the lowest priority message; if the current message queue contains the lowest priority message, the lowest priority message in the message queue is overwritten with the new message. According to some embodiments, if the current message queue does not contain the lowest priority message, a new message is added after all messages in the message queue.

Fig. 7 (a) and 7 (b) are diagrams illustrating an example of adding a new message to a message queue according to an exemplary embodiment of the present disclosure. Message a is currently being broadcast. It is assumed that in fig. 7 (a) and 7 (b), the priority is priority 1, priority 2, priority 3 in this order from high to low.

As shown in fig. 7 (a), in the original message queue, a message B, a message C, and a message D are sequentially from front to back, where the priority of the message B is priority 1, the priority of the message C is priority 2, the priority of the message D is priority 3, and the lowest priority is priority 3. Since the priority of the new message E to be added is priority 3, the message D is covered with the message E, since the current message queue contains the lowest priority message. In the updated message queue, the message B, the message C and the message E are sequentially arranged from front to back.

As shown in fig. 7 (B), in the original message queue, a message B, a message C, and a message D are sequentially from front to back, where the priorities of the message B and the message C are priority 1, the priorities of the message D are priority 2, and the lowest priority is priority 3. Since the priority of the new message E to be added is priority 3 and the current message queue does not contain the lowest priority message, the new message E is added after messages B, C, D. In the updated message queue, the messages B, C, D and E are sequentially from front to back.

Because the new message with the lowest priority is adopted to cover the original message with the lowest priority in the message queue, at most only one message with the latest lowest priority exists in the message queue, so that a user is ensured to acquire the latest information in real time, the information acquisition efficiency of the user is improved, the storage space is reduced, and the system power consumption is further reduced.

According to some embodiments, the priorities include a high priority, a medium priority, a low priority, wherein the priorities include a high priority, a medium priority, a low priority, and the high priority messages include messages requiring urgent notification to the user, the low priority messages include messages requiring real-time updating, and the medium priority messages include all messages except the high priority messages and the low priority messages. For example, the high priority message includes at least one of a shutdown alert notification, an over temperature alert notification, a charge alert notification, a low battery alert notification, the medium priority message includes at least one of a bluetooth on notification, a network connection success notification, a battery alert notification, and the low priority message includes at least an azimuth alert. According to other embodiments, the priority of each message may be adjusted according to the user's needs.

The shutdown reminding notification is, for example, a reminding when a user operates a shutdown button of the electronic device, or a reminding before the electronic device is shutdown due to insufficient electric quantity. An over-temperature alert is, for example, an alert when the temperature of the electronic device exceeds an upper limit of a temperature value. The charge reminding notification is, for example, a reminding when the electric quantity is less than or equal to 10% of the electric quantity when the electric quantity is fully charged, or a reminding when the electric quantity which is set by an arbitrary user and needs to be charged. The low battery reminding is, for example, when the battery is 20% of the battery when the battery is fully charged or less than or equal to the low battery set by any user.

Fig. 8 is a flowchart of an exemplary method of voice broadcasting messages in a message queue, according to an exemplary embodiment of the present disclosure.

In some cases, the electronic device executes the playing task according to the needs of the user, and if the message list contains the message needed to remind the user at this time, the sound output circuit can only output one of the audio of the playing task and the audio of the message needed to remind the user at the same time, so that resource conflict can be generated between the original playing task and the broadcasting of the reminding message. For example, the electronic device may be playing music or reading text on paper according to previous operations by the user. At this time, the battery power is lower than the low power reminding threshold value, and the low power reminding needs to be broadcasted. Therefore, a conflict exists between the original task of playing music or reading text and the broadcasting of the low-power reminding.

The exemplary embodiment provides a method for solving conflict between executing the original playing task and broadcasting the reminding message. According to some embodiments, when performing a play task, if there is a message in the message list that needs to be played, the following steps are performed: if the message queue has the highest priority, suspending the playing task, broadcasting all the messages with the highest priority in the message queue, and then continuing to execute the playing task; and if the message with the highest priority does not exist in the message queue, waiting for the end of the playing task, and broadcasting the messages with other priorities in the message queue.

In step S801, a play task is being performed. For example, the electronic device may be playing music, or reading text on paper. In step S803, it is determined whether or not there is a message to be broadcasted in the message list. If there is a message to be broadcast in the message list (step S803, yes), step S805 is entered; if there is no message to be broadcasted in the message list (step S803, no), the process returns to step S801, and the play task is continued to be executed.

In step S805, it is determined whether or not there is a message of the highest priority in the message list. If there is a message of the highest priority in the message list (yes in step S805), then step S807 is entered; if there is no message of the highest priority in the message list (no in step S805), the flow proceeds to step S811.

In step S807, the play task is suspended, and all the highest priority messages in the message queue are broadcasted. In step S809, after all the messages with the highest priority are broadcasted, the paused playing task is continuously executed. For example, when a fault occurs due to an excessive temperature, the reading of the text on the paper is paused, a reminder of the "over-temperature fault" is played, and then the reading of the text on the paper is continued.

In step S811, the end of the play task is waited. In step S813, messages of other priorities in the message queue are broadcasted. For example, when the Wi-Fi connection is successful, waiting for the text on the paper to be read, and playing a reminder of "Wi-Fi connection is successful".

According to some embodiments, the methods of the present disclosure may be implemented in various software platforms, e.g., may be implemented based on an Android platform, iOS platform, windows platform, linux platform, etc. It should be noted that the above software platform implementing the present disclosure is by way of example only and not by way of limitation.

Fig. 9 is a block diagram illustrating an example of an electronic device according to an exemplary embodiment of the present disclosure. It is noted that the structure shown in fig. 9 is only one example, and that the electronic device of the present disclosure may include only one or more of the components shown in fig. 9, depending on the particular implementation.

The electronic device 2000 may be, for example, a general-purpose computer (e.g., a laptop computer, a tablet computer, etc., various computers), a mobile phone, a personal digital assistant, etc. According to some embodiments, electronic device 2000 may be a display-less device without a display screen. According to some embodiments, the electronic device 2000 may be a reading aid or a vision impairment aid.

The electronic device 2000 may be configured to capture an image, process the captured image, and provide audible prompts in response to processing the obtained data. For example, the electronic device 2000 may be configured to capture an image, perform text detection and/or recognition on the image to obtain text data, convert the text data to sound data, and output the sound data for listening by a user.

According to some embodiments, the electronic device 2000 may be configured to include a spectacle frame or be configured to be removably mountable to a spectacle frame (e.g., a rim of a spectacle frame, a connection connecting two rims, a temple, or any other portion) so as to be able to capture an image that approximately includes a user's field of view.

According to some implementations, the electronic device 2000 may also be mounted to or integrated with other wearable devices. The wearable device may be, for example: head-mounted devices (e.g., helmets, hats, etc.), devices that can be worn on the ears, etc. According to some embodiments, the electronic device may be implemented as an accessory attachable to the wearable device, e.g., as an accessory attachable to a helmet or hat, etc.

According to some implementations, the electronic device 2000 may also have other forms. For example, the electronic device 2000 may be a mobile phone, a general-purpose computing device (e.g., a laptop computer, a tablet computer, etc.), a personal digital assistant, and so on. The electronic device 2000 may also have a base so that it can be placed on a desktop.

According to some embodiments, the electronic device 2000 may be used as a vision-impaired aid to aid reading, in which case the electronic device 2000 is sometimes also referred to as an "electronic reader" or "reading aid". By means of the electronic device 2000, a user who cannot read autonomously (e.g., a person with vision impairment, a person with reading impairment, etc.) can take a posture similar to the reading posture to achieve "reading" of a conventional reading (e.g., a book, a magazine, etc.). In the "reading" process, the electronic device 2000 may capture an image, perform layout analysis, text detection, and text recognition (e.g., using an optical text recognition OCR method) on the captured image to obtain text data, then convert the text data into sound data, and output the sound data for listening by a user through a sound output device such as a speaker or a headset.

The electronic device 2000 may include a camera 2004 for acquiring images. Video camera 2004 may include, but is not limited to, a video camera or a still camera, etc. The electronic device 2000 may also include a text recognition circuit 2005, the text recognition circuit 2005 being configured to perform text detection and/or recognition (e.g., OCR processing) of text contained in the image to obtain text data. The word recognition circuit 2005 may be implemented by a dedicated chip, for example. The electronic device 2000 may also include a sound conversion circuit 2006, the sound conversion circuit 2006 being configured to convert text data into sound data. The sound conversion circuit 2006 may be implemented by a dedicated chip, for example. The electronic device 2000 may also include a sound output circuit 2007, the sound output circuit 2007 being configured to output sound data. The electronic device 2000 may also include a message alert circuit (electronic circuit) 2100, the message alert circuit (electronic circuit) 2100 including circuitry configured to perform steps of a message alert method as before (e.g., method steps shown in the flowcharts of fig. 1, 8). The message alert circuit 2100 may output a message to alert the user to the sound conversion circuit 2006, thereby converting the text formatted message to sound data. The message converted into sound data is output through the sound output circuit 2007, so as to achieve the purpose of reminding the user.

According to some implementations, the electronic device 2000 may also include image processing circuitry 2008, and the image processing circuitry 2008 may include circuitry configured to perform various image processing on images. The image processing circuit 2008 may include, for example, but is not limited to, one or more of the following: the image processing device may include circuitry configured to reduce noise in the image, circuitry configured to deblur the image, circuitry configured to geometrically correct the image, circuitry configured to feature extract the image, circuitry configured to object detect and/or identify objects in the image, circuitry configured to text detect text contained in the image, circuitry configured to extract text lines from the image, circuitry configured to extract text coordinates from the image, circuitry configured to extract object boxes from the image, circuitry configured to extract text boxes from the image, layout analysis (e.g., paragraph division) based on the image, and so forth.

According to some implementations, the electronic device 2000 may also include word processing circuitry 2009, and the word processing circuitry 2009 may be configured to perform various processes based on the extracted word related information (e.g., word data, text boxes, paragraph coordinates, text line coordinates, word coordinates, etc.), thereby obtaining processing results such as paragraph ordering, word semantic analysis, layout analysis results, etc.

One or more of the various circuits described above (e.g., word recognition circuit 2005, sound conversion circuit 2006, sound output circuit 2007, image processing circuit 2008, word processing circuit 2009, message alert circuit (electronic circuit) 2100) may be implemented using custom hardware, and/or may be implemented in hardware, software, firmware, middleware, microcode, hardware description language, or any combination thereof. For example, one or more of the various circuits described above may be implemented by programming hardware (e.g., programmable logic circuits including Field Programmable Gate Arrays (FPGAs) and/or Programmable Logic Arrays (PLAs)) in an assembly language or hardware programming language such as VERILOG, VHDL, c++ using logic and algorithms according to the present disclosure.

According to some embodiments, electronic device 2000 may also include communication circuitry 2010, which communication circuitry 2010 may be any type of device or system that enables communication with an external device and/or with a network and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication device, and/or a chipset, such as a bluetooth device, 1302.11 device, wi-Fi device, wiMax device, cellular communication device, and/or the like.

According to some embodiments, electronic device 2000 may also include an input device 2011, which input device 2011 may be any type of device capable of inputting information to electronic device 2000 and may include, but is not limited to, various sensors, mice, keyboards, touch screens, buttons, levers, microphones, and/or remote controls, and the like.

According to some implementations, electronic device 2000 may also include an output device 2012, which output device 2012 may be any type of device capable of presenting information, and may include, but is not limited to, a display, a visual output terminal, a vibrator, and/or a printer, among others. Although the electronic device 2000 is used in a vision-based output device for vision-based assistance according to some embodiments, the user's family or maintenance staff etc. may be facilitated to obtain output information from the electronic device 2000.

According to some embodiments, the electronic device 2000 may also include a processor 2001. Processor 2001 may be any type of processor and may include, but is not limited to, one or more general purpose processors and/or one or more special purpose processors (e.g., special processing chips). The processor 2001 may be, for example, but not limited to, a central processing unit CPU or a microprocessor MPU, or the like. The electronic device 2000 may also include a working memory 2002, which working memory 2002 may store programs (including instructions) and/or data (e.g., images, text, sound, other intermediate data, etc.) useful for the operation of the processor 2001, and may include, but is not limited to, random access memory and/or read only memory devices. The electronic device 2000 may also include a storage device 2003, which storage device 2003 may include any non-transitory storage device that may be non-transitory and that may enable data storage, and may include, but is not limited to, a magnetic disk drive, an optical storage device, a solid state memory, a floppy disk, a flexible disk, a hard disk, a magnetic tape, or any other magnetic medium, an optical disk or any other optical medium, a ROM (read only memory), a RAM (random access memory), a cache memory, and/or any other memory chip or cartridge, and/or any other medium from which a computer may read data, instructions, and/or code. Working memory 2002 and storage device 2003 may be collectively referred to as "memory" and may in some cases be used in combination with each other.

According to some embodiments, the processor 2001 may control and schedule at least one of the camera 2004, the word recognition circuit 2005, the sound conversion circuit 2006, the sound output circuit 2007, the image processing circuit 2008, the word processing circuit 2009, the communication circuit 2010, the message alert circuit (electronic circuit) 2100, and other various devices and circuits included in the electronic device 2000. According to some embodiments, at least some of the various components in fig. 9 may be interconnected and/or in communication by a bus 2013.

Software elements (programs) may reside in the working memory 2002 including, but not limited to, an operating system 2002a, one or more application programs 2002b, drivers, and/or other data and code.

According to some embodiments, instructions for performing the foregoing control and scheduling may be included in the operating system 2002a or one or more application programs 2002 b.

According to some embodiments, instructions to perform the method steps of the present disclosure (e.g., the method steps shown in the flowcharts of fig. 1, 8) may be included in one or more applications 2002b, and the various modules of the electronic device 2000 described above may be implemented by the instructions of one or more applications 2002b being read and executed by the processor 2001. In other words, the electronic device 2000 may include a processor 2001 and a memory (e.g., working memory 2002 and/or storage device 2003) storing a program comprising instructions that, when executed by the processor 2001, cause the processor 2001 to perform methods as in the various embodiments of the disclosure.

According to some embodiments, some or all of the operations performed by at least one of word recognition circuit 2005, sound conversion circuit 2006, image processing circuit 2008, word processing circuit 2009, message alert circuit (electronic circuit) 2100 may be implemented by processor 2001 reading and executing instructions of one or more application programs 2002.

Executable code or source code of instructions of software elements (programs) may be stored in a non-transitory computer readable storage medium (e.g., storage device 2003) and may be stored in working memory 2001 (possibly compiled and/or installed) when executed. Accordingly, the present disclosure provides a computer readable storage medium storing a program comprising instructions that, when executed by a processor of an electronic device (e.g., a vision impairment auxiliary device), cause the electronic device to perform a method as in various embodiments of the present disclosure. According to another embodiment, executable code or source code of instructions of the software elements (programs) may also be downloaded from a remote location.

It should also be understood that various modifications may be made according to specific requirements. For example, custom hardware may also be used, and/or individual circuits, units, modules or elements may be implemented in hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. For example, some or all of the circuits, units, modules, or elements contained in the disclosed methods and apparatus may be implemented by programming hardware (e.g., programmable logic circuits including Field Programmable Gate Arrays (FPGAs) and/or Programmable Logic Arrays (PLAs)) in an assembly language or hardware programming language such as VERILOG, VHDL, c++ using logic and algorithms according to the present disclosure.

According to some embodiments, the processor 2001 in the electronic device 2000 may be distributed over a network. For example, some processes may be performed using one processor while other processes may be performed by another processor remote from the one processor. Other modules of the electronic device 2001 may also be similarly distributed. As such, the electronic device 2001 may be interpreted as a distributed computing system that performs processing in multiple locations.

Some exemplary aspects of the disclosure are described below.

Aspect 1. A message alert method for an electronic device, comprising:

receiving a new message, and judging the priority of the new message according to a prestored priority judging rule;

adding the received new message to a message queue in a text format according to the priority;

and according to the ordering of the messages in the message queue, broadcasting the messages in the message queue through voice.

Aspect 2. The method of aspect 1, wherein the messages in the message queue are ordered from high to low by priority.

Aspect 3 the method of aspect 2, wherein adding the new message to the message queue according to the priority comprises:

When the priority of the new message is not the lowest priority, then the new message is added before all lower priority messages in the message queue.

Aspect 4. The method of aspect 2, wherein adding the new message to the message queue according to the priority comprises:

when the priority of the new message is the lowest priority, judging whether the message queue currently contains the message with the lowest priority;

and if the current message queue contains the message with the lowest priority, covering the message with the lowest priority in the message queue with the new message.

Aspect 5. The method of aspect 4, wherein adding the new message to the message queue according to the priority comprises:

if the message queue does not contain the message with the lowest priority, the new message is added to the message queue after all the messages in the message queue.

Aspect 6 the method of aspect 3, wherein adding the new message to all lower priority messages in the message queue comprises:

the new message is added before all messages of the same priority in the message queue, after all higher priority messages.

Aspect 7 the method of aspect 3, wherein adding the new message to all lower priority messages in the message queue includes:

the new message is added to the message queue after all messages of the same priority and before all messages of lower priority.

Aspect 8 the method of aspect 2, wherein the priority comprises a high priority, a medium priority, a low priority, and the high priority message comprises a message requiring emergency notification to a user, the low priority message comprises a message requiring real-time updating, and the medium priority message comprises all messages except the high priority message and the low priority message.

Aspect 9. The method of aspect 8, wherein the high priority message comprises at least one of a shutdown reminder notification, an over temperature notification, a charge reminder notification, a low battery reminder.

Aspect 10 the method of aspect 8, wherein the medium priority message includes at least one of a bluetooth on notification, a network connection success notification, a battery level alert.

Aspect 11. The method of aspect 8, wherein the low priority message includes at least a bearing notification.

Aspect 12. The method of aspect 8, wherein the priority of each message is adjustable according to user requirements.

Aspect 13. The method of aspect 2, wherein voice broadcasting the message in the message queue comprises: when executing the playing task, if the message list contains the message to be broadcasted, executing the following steps:

if the message with the highest priority exists in the message queue, suspending the playing task, broadcasting all the messages with the highest priority in the message queue, and then continuing to execute the playing task;

and if the message with the highest priority does not exist in the message queue, waiting for the end of the playing task, and then broadcasting the messages with other priorities in the message queue.

Aspect 14 the method of any one of aspects 1-13, wherein the electronic device is a display-enabled device.

Aspect 15 the method of any one of aspects 1-13, wherein the electronic device is a reading aid or a vision impairment aid.

Aspect 16. An electronic device, comprising:

a processor; and

a memory storing a program comprising instructions that when executed by the processor cause the processor to perform the method of any one of aspects 1-13.

Aspect 17. A non-transitory computer readable storage medium storing a program comprising instructions that, when executed by a processor of an electronic device, cause the electronic device to perform the method of any of aspects 1-13.

Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the foregoing methods, systems, and apparatus are merely exemplary embodiments or examples, and that the scope of the present invention is not limited by these embodiments or examples but only by the claims following the grant and their equivalents. Various elements of the embodiments or examples may be omitted or may be covered by their equivalent elements. Furthermore, the steps may be performed in a different order than described in the present disclosure. Further, various elements of the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced by equivalent elements that appear after the disclosure.

Claims

1. A message alert method for an electronic device, comprising:

Adding the received new message to a message queue in a text format according to the priority; and

according to the ordering of the messages in the message queue, the voice broadcasting of the messages in the message queue comprises the following steps:

and converting the messages in the message queue from a text format to voice in real time one by one according to the ordering of the messages in the message queue so as to carry out voice broadcasting.

2. The method of claim 1, wherein messages in the message queue are ordered from high to low by priority.

3. The method of claim 2, wherein adding the new message to the message queue according to the priority comprises:

4. The method of claim 2, wherein adding the new message to the message queue according to the priority comprises:

5. The method of claim 4, wherein adding the new message to the message queue according to the priority comprises:

6. A method as claimed in claim 3, wherein adding the new message to all lower priority messages in the message queue comprises:

7. A method as claimed in claim 3, wherein adding the new message to all lower priority messages in the message queue comprises:

8. The method of claim 2, wherein the priority comprises a high priority, a medium priority, a low priority, and the high priority message comprises a message requiring urgent notification to a user, the low priority message comprises a message requiring real-time updating, and the medium priority message comprises all messages except the high priority message and the low priority message.

9. The method of claim 8, wherein the high priority message comprises at least one of a shutdown alert notification, an over temperature notification, a charge alert notification, a low battery alert.

10. The method of claim 8, wherein the medium priority message comprises at least one of a bluetooth on notification, a network connection success notification, a battery level alert.

11. The method of claim 8, wherein the low priority message comprises at least a bearing notification.

12. The method of claim 8, wherein the priority of each message is adjustable according to user demand.

13. The method of claim 2, wherein voice broadcasting the message in the message queue comprises: when executing the playing task, if the message list contains the message to be broadcasted, executing the following steps:

14. The method of any of claims 1-13, wherein the electronic device is a display-enabled device.

15. The method of any of claims 1-13, wherein the electronic device is a reading aid or a vision impairment aid.

16. An electronic device, comprising:

a processor; and

a memory storing a program comprising instructions that when executed by the processor cause the processor to perform the method of any one of claims 1-15.

17. A non-transitory computer readable storage medium storing a program, the program comprising instructions that, when executed by a processor of an electronic device, cause the electronic device to perform the method of any of claims 1-15.