Detailed Description
Exemplary embodiments of the present application will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present application are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a convention should be interpreted in accordance with the meaning of one of skill in the art having generally understood the convention (e.g., "a system having at least one of A, B and C" would include, but not be limited to, systems having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
The embodiment of the application provides a method for prompting information, which comprises the following steps: in response to receiving a first event generated by the in-vehicle multimedia device being operated, it is determined whether the first event is a predetermined event. And under the condition that the first event is determined to be a preset event, at least acquiring current sound source information of the current playing audio data. Generating prompt information, wherein the prompt information comprises current sound source information; and outputting the prompt information by using the vehicle-mounted output device.
Fig. 1 schematically shows an application scenario of a method of prompting information according to an embodiment of the present application.
As shown in fig. 1, the method for prompting information according to the embodiment of the application can be used in a driving scene of a vehicle, for example, and can be executed by an on-board processor as a part of an on-board system. The vehicle-mounted multimedia device may refer to, for example, a vehicle-mounted multimedia key 101, where the vehicle-mounted multimedia key 101 may be disposed on a control panel or a steering wheel of a vehicle, and a user may regulate and control audio data through the vehicle-mounted multimedia key 101, for example, may regulate volume or play progress of the audio data, switch the audio data, and so on. In the embodiment of the present application, the vehicle-mounted multimedia key 101 is a physical key, and the vehicle-mounted multimedia key 101 may include a push-button operation key and a knob-type operation key.
The car audio data may come from a variety of sources, such as online music, e.g., QQ music, FM/AM radio, online radio, bluetooth music, USB music, etc. After the music starts to be played in the car for a period of time, the user may forget which sound source he has selected before, and in case of unclear sound source, an incorrect instruction may be issued or the system may not respond. For example, if the user uses the currently played audio source as the online music, the user wants to switch to the next song by pressing a button, but if the current actual audio source is the FM/AM radio broadcast, the operation of searching channels is performed, which affects the user experience. As another example, the user would have intended to press the go key long to fast forward the current audio, but the system is unresponsive and cannot implement fast forward operation, perhaps because the user has forgotten that bluetooth music is currently being played in the car and the handset providing the music does not support fast forward operation.
Therefore, the embodiment of the application provides a method for prompting information, when the user triggers the vehicle-mounted multimedia key 101, the prompting information can be sent out, for example, the prompting information can be output through the central control screen 102. The prompt information comprises sound source information corresponding to the currently played audio data, and prompts the user which sound source is currently used, so that the user can judge whether the current sound source is an object expected to be controlled by the user or not, and the user can receive feedback and correct in time, and error instruction execution is avoided.
The embodiment of the application provides a method for prompting information, and the method for prompting information according to the exemplary embodiment of the application is described below with reference to fig. 2 to 6 in combination with the application scenario of fig. 1.
Fig. 2 schematically shows a flow chart of a method of prompting for information according to an embodiment of the application.
As shown in fig. 2, the method 200 for prompting information according to the embodiment of the present application may include operations S210 to S240, for example.
In operation S210, in response to receiving a first event generated by the in-vehicle multimedia device being operated, it is determined whether the first event is a predetermined event.
In operation S220, in case that it is determined that the first event is a predetermined event, at least current sound source information of the currently played audio data is acquired.
In operation S230, a cue message is generated, the cue message including current sound source information.
In operation S240, a prompt message is output using the in-vehicle output device.
In the embodiment of the present application, the vehicle-mounted multimedia device may refer to, for example, a vehicle-mounted multimedia key, when a user operates the vehicle-mounted multimedia key, the vehicle-mounted system may generate an operation event according to a key type and a manner of operating the key by the user, specifically, a correspondence between the event and the key type and the manner of operating the key may be determined according to an actual situation, for example, if the user clicks the play key, an event for playing audio may be correspondingly generated, if the user presses the play key for a long time, an event for fast forwarding the current audio may be correspondingly generated, if the user rotates the volume knob clockwise, an event for increasing the volume may be correspondingly generated, and so on.
After a first event generated by a user operating the vehicle-mounted multimedia key is obtained at a certain moment, whether the first event is a preset event or not can be determined first, and if the first event is the preset event, current sound source information corresponding to the current played audio data is obtained. The audio source information may refer to source information of audio data that is currently played, and if the audio data that is currently played is provided by the online music software, the audio source information may be marked as a name or icon of the online music software. If the currently playing audio data is provided by a radio station, the audio source information may be labeled "FM/AM broadcast" or a corresponding icon. If the audio data currently played is provided by the USB storage media, the audio source information may be labeled "USB audio" or a corresponding icon. If the audio data currently played is provided by the mobile phone through bluetooth, the audio source information may be marked as "bluetooth music" or a corresponding icon. For example, when the online music software A1 is currently being used to play the song s1, the song s1 is the audio data currently being played, and the song source corresponding to the song s1 is the online music software A1, the name A1 of the online music software A1 or the icon of the software may be used as the current audio source information.
After the current sound source information is obtained, prompt information about the current sound source information can be generated, and the prompt information is output by the vehicle-mounted output device.
According to the embodiment of the application, when the preset event is generated due to the fact that the user triggers the vehicle-mounted multimedia key, the vehicle-mounted output device can send out the prompt information, the prompt information comprises the sound source information corresponding to the currently played audio data, and the user is prompted to use which sound source currently, so that the user can judge whether the current sound source is the object which the user expects to control or not, and the user can timely receive feedback and correct the feedback, so that the execution of an error instruction is avoided.
According to an embodiment of the present application, the predetermined event includes: an adjustment operation for audio data currently played and a switching operation for audio data in a current sound source. The adjusting operation comprises at least one of pause, play, fast forward, backward, volume up and volume down. The switching operation includes at least one of switching to the previous audio data and switching to the next audio data.
In the embodiment of the present application, the predetermined event is used for adjusting the audio data in the current audio source, including performing adjustment operations such as volume adjustment, fast forward, pause, etc. on the audio being played in the current audio source, and further includes switching the audio data being played to another audio data in the current audio source, for example, song s1 being played in online music software A1, and switching song s1 to the next song s2 in online music software A1.
According to the embodiment of the application, the event which is easy to cause misoperation or cause unresponsiveness of the system is set as a preset event, and when a user triggers the event, prompt information can be sent out.
According to an embodiment of the present application, outputting the prompt information using the in-vehicle output device includes at least one of: displaying prompt information by using a central control screen; displaying prompt information by using an instrument panel; and outputting prompt information by utilizing the voice of the vehicle-mounted sound box.
Fig. 3A schematically illustrates a user operating a vehicle-mounted multimedia key according to an embodiment of the present application.
Fig. 3B schematically illustrates a schematic diagram of displaying a prompt message using a central control screen according to an embodiment of the present application.
As shown in fig. 3A and 3B, the user turns on the navigation function during the music playing, the center control screen 302 starts displaying the navigation map 303, and the vehicle-mounted speaker continuously outputs music. If the user wants to switch to the next song through the switch key 301 at a certain moment, after the event of switching to the next audio data is obtained, the box 304 may be popped up through the center screen 302, and the current audio information A1 may be displayed in the box 304. The bullet box 304 may disappear after being displayed for several seconds (e.g., 2 s) to avoid impact on other displayed content (e.g., navigation maps).
In the embodiment of the application, after the first event is received, whether the current central control screen displays an audio playing interface or not can be judged, and under the condition that the current screen does not display the audio playing interface, the current sound source information is acquired and prompt information is sent. Or the method can directly acquire the current sound source information and send out prompt information without judging whether the current central control screen displays an audio playing interface.
In another embodiment of the present application, a display panel may be provided in an instrument panel area of the vehicle, and after receiving a predetermined event, a pop-up box may be popped up in the display panel of the instrument panel area and a prompt message may be displayed in the pop-up box. The instrument panel is positioned in front of the user, and prompt information is displayed in the area of the instrument panel, so that the user can more conveniently view the prompt information.
In another embodiment of the application, the prompt message can be output to the user through the vehicle-mounted sound box. The voice output mode can enable the user to drive the vehicle more intensively, and safety is improved.
In the embodiment of the present application, a sound source switching key may be further disposed in the vehicle, for example, may be disposed on a steering wheel or a control panel, and if the user finds that the current sound source is not the object that he wants to operate and wants to change the sound source, the user may switch to another sound source through the sound source switching key.
According to an embodiment of the present application, in a case where it is determined that the first event is a predetermined event, at least acquiring current sound source information of current playing audio data includes: if the first event is an adjustment operation for the currently played audio data, acquiring current sound source information and detail information of the currently played audio data; and if the first event is a switching operation for the audio data in the current audio source, acquiring the current audio source information and the detail information of the other audio data to be switched to. The prompt information further comprises the detail information of the audio data which is currently played or the detail information of another audio data.
Fig. 4 schematically shows a flow chart of a method of prompting for information according to another embodiment of the application.
Fig. 5 schematically shows a schematic diagram of displaying a hint according to another embodiment of the present application.
Fig. 6 schematically shows a schematic diagram of displaying a hint information according to a further embodiment of the present application.
As shown in fig. 4, 5 and 6, a first event generated by a user operating a vehicle-mounted multimedia key is received (operation S410), it is determined whether the first event is a predetermined event (operation S420), and if the first event is the predetermined event, it is further determined which type of event among the predetermined events the first event belongs to, i.e., it is determined whether the first event belongs to an adjustment operation for audio data currently being played or a switching operation for audio data in a current audio source (operation S430).
If the first event is an adjustment operation such as volume adjustment, fast forward, etc. for the currently played audio data, in addition to the current audio source information A1, the detail information of the currently played audio data may be acquired (operation S441), where the detail information may include, for example, information such as name S1 of the currently played song, singer g1, etc. Then, a cue message is generated based on the current sound source information and the detail information of the currently played audio data (operation S451), and the cue message 504 is outputted using the in-vehicle output device (operation S461).
If the first event is an operation of switching the currently played audio data to the next audio data in the current audio source, the current audio source information and the detail information of the next audio data may be obtained (operation S442), where the detail information may include, for example, information of a name S2 of the next song, a singer g2, and the like. Then, a prompt message is generated according to the current sound source information and the detailed information of the next audio data (operation S452), and the prompt message 604 is outputted using the in-vehicle output device (operation S462).
In embodiments of the present application, as each audio software begins playing audio, its source category may be sent to the system to cause the system to record which audio software is currently playing. After receiving the first event, it may be determined from the information recorded by the system which audio software is currently being played. After the System obtains the first event, the first event can be sent to the currently played audio software, so that the currently played audio software feeds back the sound source information and the detailed information of the audio to the System after receiving the first event, and specifically, the audio software can call a System UI interface of the System to feed back the sound source information and the detailed information of the audio to the System.
According to the embodiment of the application, besides the current sound source information, the detail information of the current audio or the detail information of another audio to be switched to can be output, so that a user can further clearly and specifically judge whether the track is an object which the user wants to operate.
According to an embodiment of the present application, the method for prompting information may further include: if the first event is a switching operation for the audio data in the current audio source, executing the following operations: if the first event is received again or the second event which is opposite to the first event is received within a first preset time after the prompt information is output, the prompt information is updated; and if the first event is not received again and the second event is not received within the first preset time after the prompt information is output, executing the operation corresponding to the first event. The first predetermined time period may be, for example, less than a time period of outputting the prompt information, for example, less than 3s.
For example, in response to receiving an event to switch to the next audio data, a hint information may be displayed on the screen, the hint information including details of the current sound source information and the next audio data. If the instruction of switching to the next instruction is not received again and the instruction of switching to the last instruction is not received within the first preset time period, the user is considered to play the next audio data by default, and the playing of the next audio data can be started. If the user finds that the user does not want to play the next audio data after checking the prompt information, the user can press the button switched to the next button again before the prompt information is not finished, the prompt information can be updated into the detailed information of the next audio data again until the user does not receive the instruction again within the first preset time after updating the prompt information, and the user is considered to play the audio data in the current prompt information by default.
According to the embodiment of the application, for the event of switching the audio, after the audio source and the next audio information are output, whether to execute the switching event is determined according to the feedback condition of the user, and after the user presses the first key or the last key again, the audio in the prompt information is updated accordingly. Based on the method, switching operation can be performed according to the user intention, and user experience is improved.
According to an embodiment of the present application, the method for prompting information may further include: and if the first event is an adjustment operation for the currently played audio data, responding to the received first event, and executing an operation corresponding to the first event.
For example, after receiving a volume up event, a prompt message may be displayed on the screen, and an operation of volume up the current audio is performed at the same time. For another example, after receiving the fast forward event, a prompt message may be displayed on the screen and an operation of fast forwarding the current audio may be performed at the same time.
According to an embodiment of the present application, for a volume adjustment, fast forward, etc. adjustment event of the current audio, a corresponding operation may be performed immediately upon receiving the adjustment event. Based on this approach, it can be ensured that these instructions, which are highly time-efficient, are executed quickly.
According to another embodiment of the present application, the method for prompting information may further include: in response to receiving the first event, an operation corresponding to the first event is performed.
Upon receiving the first event, an operation corresponding to the first event may be performed. For example, after receiving an event of switching to the next, a prompt message may be displayed on the screen and the next audio data is simultaneously played. For another example, after receiving the volume up event, a prompt message may be displayed on the screen, and an operation of volume up the current audio may be performed at the same time.
According to the embodiment of the application, the execution is performed immediately after the event is received, so that the timeliness of instruction response can be ensured. The instruction is executed and prompt information is output, so that the prompt effect can be achieved.
According to an embodiment of the present application, generating the hint information may further include: generating prompt information under the condition that the current sound source information is different from the sound source information included in the prompt information output last time; or generating the prompt message under the condition that the interval between the receiving time of the first event and the time of outputting the prompt message last time exceeds the second preset time length. Wherein the second predetermined time period may be, for example, between 2 and 10 minutes.
For example, in a second predetermined period after the previous output of the prompt information, the user is considered to be able to remember the current audio information, so if the predetermined event is received again in this period, the prompt is not performed any more, and the operation corresponding to the predetermined event may be directly executed.
For another example, if the user is already reminded once during the use of the current audio source, the user may not be reminded again if the predetermined event is received again during the use of the current audio source, and the operation corresponding to the predetermined event may be directly executed.
According to the embodiment of the application, the prompt is triggered once again every a preset time or after the audio source is switched, so that the prompt is prevented from being too frequent and the user is not disturbed excessively.
Another aspect of the embodiment of the application provides a device for prompting information.
Fig. 7 schematically shows a block diagram of an apparatus 700 for prompting information according to an embodiment of the application.
As shown in fig. 7, the apparatus 700 for prompting information includes an event receiving module 710, a sound source obtaining module 720, a prompting generating module 730, and a control output module 740.
The event receiving module 710 is configured to determine whether a first event is a predetermined event in response to receiving the first event generated by the in-vehicle multimedia device being operated. The event receiving module 710 may, for example, perform the operation S210 described above with reference to fig. 2 according to an embodiment of the present application, which is not described herein.
The sound source obtaining module 720 is configured to obtain at least current sound source information of the current playing audio data, if the first event is determined to be a predetermined event. According to an embodiment of the present application, the sound source obtaining module 720 may perform, for example, the operation S220 described above with reference to fig. 2, which is not described herein.
The prompt generation module 730 is configured to generate a prompt message, where the prompt message includes current audio information. According to an embodiment of the present application, the hint generating module 730 may perform, for example, the operation S230 described above with reference to fig. 2, which is not described herein.
The control output module 740 is configured to output the prompt message by using the vehicle-mounted output device. According to an embodiment of the present application, the control output module 740 may, for example, perform the operation S240 described above with reference to fig. 2, which is not described herein.
According to an embodiment of the present application, the predetermined event includes: an adjustment operation for audio data currently played and a switching operation for audio data in a current sound source. Wherein the adjusting operation comprises at least one of pause, play, fast forward, backward, volume up and volume down; the switching operation includes at least one of switching to the previous audio data and switching to the next audio data.
According to an embodiment of the present application, in a case where it is determined that the first event is a predetermined event, at least acquiring current sound source information of current playing audio data includes: if the first event is an adjustment operation for the currently played audio data, acquiring current sound source information and detail information of the currently played audio data; if the first event is a switching operation for the audio data in the current audio source, acquiring the current audio source information and the detail information of the other audio data to be switched to; the prompt information further comprises the detail information of the audio data which is currently played or the detail information of another audio data.
According to an embodiment of the present application, the apparatus for prompting information may further include a first execution module, configured to execute, if the first event is a switching operation for audio data in a current audio source, the following operations: if the first event is received again or the second event which is opposite to the first event is received within a first preset time after the prompt information is output, the prompt information is updated; and if the first event is not received again and the second event is not received within the first preset time after the prompt information is output, executing the operation corresponding to the first event.
According to an embodiment of the application, the first execution module is further configured to: and if the first event is an adjustment operation for the currently played audio data, responding to the received first event, and executing an operation corresponding to the first event.
According to an embodiment of the present application, the apparatus for prompting information may further include a second execution module for executing an operation corresponding to the first event in response to receiving the first event.
According to an embodiment of the present application, outputting the prompt information using the in-vehicle output device includes at least one of: displaying prompt information by using a central control screen; displaying prompt information by using an instrument panel; and outputting prompt information by utilizing the voice of the vehicle-mounted sound box.
According to an embodiment of the present application, generating the hint information includes: generating prompt information under the condition that the current sound source information is different from the sound source information included in the prompt information output last time; or generating the prompt message under the condition that the interval between the receiving time of the first event and the time of outputting the prompt message last time exceeds the second preset time length.
According to embodiments of the present application, the present application also provides an electronic device, a readable storage medium and a computer program product. The computer program product may comprise a computer program which, when executed by a computer, implements the training method and the object detection method of the object detection model provided according to the application.
Fig. 8 is a block diagram of an electronic device for implementing a method of prompting information in accordance with an embodiment of the present application.
As shown in fig. 8, a block diagram of an electronic device 800 for prompting for information according to an embodiment of the present application is provided. Electronic device 800 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the applications described and/or claimed herein.
As shown in fig. 8, the electronic device 800 includes: one or more processors 801, memory 802, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within electronic device 800, including instructions stored in or on memory to display graphical information of a GUI on an external input/output apparatus, such as a display device coupled to an interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices 800 may be connected, with each device providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 801 is illustrated in fig. 8.
Memory 802 is a non-transitory computer readable storage medium provided by the present application. Wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the methods provided by the present application. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the method provided by the present application.
The memory 802 is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the event receiving module 710, the sound source acquiring module 720, the cue generating module 730, and the control output module 740 shown in fig. 7) corresponding to the method according to the embodiment of the present application. The processor 801 executes various functional applications of the server and data processing, i.e., implements the methods in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 802.
Memory 802 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the electronic device 800 of the above-described method, and the like. In addition, memory 802 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 802 may optionally include memory located remotely from processor 801, which may be connected to electronic device 800 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device 800 may further include: an input device 803 and an output device 804. The processor 801, memory 802, input devices 803, and output devices 804 may be connected by a bus or other means, for example in fig. 8.
The input device 803 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device 800, such as a touch screen, keypad, mouse, trackpad, touchpad, pointer stick, one or more mouse buttons, trackball, joystick, and like input devices. The output device 804 may include a display apparatus, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibration motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASIC (application specific integrated circuit), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
These computing programs (also referred to as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present application may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed embodiments are achieved, and are not limited herein.
The above embodiments do not limit the scope of the present application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the scope of the present application.