CN109922457B - Information interaction method, device and system - Google Patents

Abstract

The invention relates to an information interaction method, a device and a system, wherein the method comprises the following steps: the mobile terminal acquires a key identification in a target area and sends the key identification to a server; the server identifies the key identification to obtain the function and the name of a target key corresponding to the key identification, and returns an identification result to the mobile terminal; the mobile terminal sends a key driving request to the controller according to the identification result; and the controller responds to the key driving request and drives the corresponding key to make a feedback prompt in a preset form. The invention can pertinently and efficiently obtain the function introduction of the key; the scenes that the user tries and guesses to use are reduced, and potential dangers brought by hasty key operation of the user are reduced; the efficiency of the user obtains the button function is improved, promote user's use and experience.

Description

Information interaction method, device and system

technical field

The present invention relates to the technical field of information interaction, and in particular, to an information interaction method, device and system.

Background technique

There are many emerging function buttons in the car, and the user may not know the corresponding related functions, and the user cannot fully understand the meaning of the button icons in a short time. In the prior art, the user can only use the car user manual. function to understand. However, the car manual is usually large and complete, which takes time and effort to find a certain function, and is inconvenient to carry around; in addition, when reading a function in the car manual, the user needs to look up the manual while looking up the corresponding function. button, the user experience is not good.

In order to solve the inconvenience of using the car manual to check key functions in the prior art, and the potential danger caused by rash operation when a key function is not understood, the present invention provides an information interaction method, device and system.

SUMMARY OF THE INVENTION

The technical problem to be solved by the present invention is to provide an information interaction method, device and system, which can obtain the introduction of key functions in a targeted and efficient manner, reduce potential dangers caused by rashly operating keys, and improve user experience.

In order to solve the above technical problems, in the first aspect, the present invention provides an information interaction method, including:

The mobile terminal acquires the key identifier in the target area, and sends the key identifier to the server;

The server identifies the button identification, obtains the function and name of the target button corresponding to the button identification, and returns the identification result to the mobile terminal;

The mobile terminal sends a button driving request to the controller according to the identification result;

In response to the key actuation request, the controller drives the corresponding key to give a feedback prompt in a preset form.

In the second aspect, the present invention provides another information interaction method, which can be applied to the mobile terminal side, and the method includes:

Acquiring the key identification in the target area, sending the key identification to the server, so that the server identifies the key identification, obtains the function and name of the target key corresponding to the key identification, and returns the identification result;

Receive the identification result returned by the server, and send a button drive request to the controller according to the identification result, so that the controller drives the corresponding button to make a feedback prompt in a preset form in response to the button drive request .

Further, according to the identification result returned by the receiving server, sending a button driving request to the controller according to the identification result includes:

In response to the user's request for viewing the identification result, the function and name of the target key are displayed to the user in a preset manner; wherein, the preset manner includes at least one of text, picture, image and voice;

According to the target button currently viewed by the user, a button driving request is sent to the controller, where the button driving request includes the identifier of the target button currently viewed by the user.

In a third aspect, the present invention provides another information interaction method, which can be applied to the controller side, and the method includes:

receiving a button driving request sent by the mobile terminal, wherein the button driving request includes the identifier of the target button currently viewed by the user;

Determine the target button to be driven according to the identifier of the target button, and generate a corresponding button driving instruction;

The key driving instruction is sent to the target key, so as to drive the target key to make a feedback prompt in a preset form.

Further, the driving of the target key to make a feedback prompt in a preset form includes:

The target key is driven to make a feedback prompt through the key indicator light.

In a fourth aspect, the present invention provides an information interaction device, the device comprising:

A key recognition module, used to obtain the key identification in the target area, and send the key identification to the server, so that the server can identify the key identification, and obtain the function and name of the target key corresponding to the key identification , and return the recognition result;

A result display module, configured to receive the identification result returned by the server, and send a button driving request to the controller according to the identification result, so that the controller drives the corresponding button to preset the button in response to the button driving request feedback in the form of prompts.

Further, the result display module includes:

The viewing module is configured to display the function and name of the target key to the user in a preset manner in response to a user's request for viewing the identification result; wherein the preset manner includes at least one of text, picture, image and voice A sort of;

The request sending module is configured to send a button driving request to the controller according to the target button currently viewed by the user, where the button driving request includes the identifier of the target button currently viewed by the user.

In a fifth aspect, the present invention provides another information interaction device, the device comprising:

a request receiving module, configured to receive a button driving request sent by the mobile terminal, wherein the button driving request includes the identifier of the target button currently viewed by the user;

an instruction generation module, configured to determine the target button to be driven according to the identifier of the target button, and generate a corresponding button driving instruction;

The driving module is configured to send the button driving instruction to the target button, so as to drive the target button to make a feedback prompt in a preset form.

Further, the drive module includes:

The feedback prompting module is used to drive the target key to make a feedback prompt through the key indicator light.

In a sixth aspect, the present invention provides an information interaction system, the system includes a processor and a memory, and the memory stores at least one instruction, at least a piece of program, code set or instruction set, the at least one instruction, at least A piece of program, code set or instruction set is loaded by the processor and executes the information interaction method described in the first aspect above.

Implementing the embodiment of the present invention has the following beneficial effects:

The present invention obtains the key identification to be identified through the mobile terminal, identifies the key identification through the server, and returns the identification result to the mobile terminal; the mobile terminal receives the identification result, displays the identification result in a preset manner, and simultaneously reports the identification result to the controller. Sending a button driving request; in response to the button driving request, the controller drives the corresponding button to give a feedback prompt in a preset form. The present invention scans and identifies the button icon through the mobile terminal, and can directly display the function introduction of the button on the mobile terminal, without having to look at the car manual; communicate with the controller through the mobile terminal, when the function of a button is checked on the mobile terminal, the Press the button to make synchronous feedback prompts. Therefore, the present invention obtains the function introduction of the keys in a targeted manner; reduces the user's trial and guess use scenarios, reduces the potential danger caused by the user rashly operating the keys; improves the user's efficiency in obtaining the key functions and improves the user experience.

Description of drawings

1 is a schematic diagram of an application scenario provided by an embodiment of the present invention;

2 is a schematic flowchart of an information interaction method provided by an embodiment of the present invention;

3 is a flowchart of an information interaction method provided by an embodiment of the present invention;

4 is a flowchart of a method for displaying a key recognition result provided by an embodiment of the present invention;

5 is a flowchart of another information interaction method provided by an embodiment of the present invention;

6 is a schematic diagram of an information interaction apparatus provided by an embodiment of the present invention;

7 is a schematic diagram of a result display module provided by an embodiment of the present invention;

FIG. 8 is a schematic diagram of another information interaction apparatus provided by an embodiment of the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present invention.

Please refer to FIG. 1, which shows a schematic diagram of an application scenario provided by an embodiment of the present invention, including a mobile terminal 110, a server 120, and a controller 130, where the mobile terminal 110 may include but is not limited to: a smart phone, a tablet computer, etc. Mobile devices with smart cameras.

In this embodiment, it is specifically applied to the application scenario of recognizing vehicle buttons. The mobile terminal 110 and the server 120 communicate through a wireless network, and the wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. Wireless networks can use a variety of communication standards, protocols, and technologies. After the mobile terminal 110 obtains the key identifier, it sends it to the server 120 , and the server identifies the key identifier and returns the identification result to the mobile terminal 110 .

The controller 130 in this embodiment may specifically be a controller for controlling vehicle buttons. The mobile terminal 110 and the controller 130 may communicate wirelessly, specifically through Bluetooth. When a certain button function is displayed on the mobile terminal 110 When the controller 130 drives the corresponding button on the vehicle, a synchronous feedback prompt can be made.

Please refer to FIG. 2, which shows an information interaction method, which may include:

S210. The mobile terminal acquires the key identifier in the target area.

S220. The mobile terminal sends the key identifier to the server.

S230. The server identifies the key identifier, and obtains the function and name of the target key corresponding to the key identifier.

S240. The server returns the identification result to the mobile terminal.

S250. The mobile terminal sends a button driving request to the controller according to the identification result.

S260. In response to the button driving request, the controller drives the corresponding button to give a feedback prompt in a preset form.

The information interaction method described in FIG. 2 shows the interaction process between the mobile terminal, the server and the controller, and the implementation details are described in detail below in the form of one side.

Please refer to FIG. 3, which shows another information interaction method, which can be applied to the mobile terminal side, and the method includes:

S310. Acquire the key ID in the target area, send the key ID to the server, so that the server can identify the key ID, obtain the function and name of the target key corresponding to the key ID, and return the identification result.

A client APP that can be used for image information collection can be installed in the mobile terminal. Specifically, in the implementation process, the user shoots the key identification information in the target area through the camera of the mobile terminal, and generates a corresponding picture. It may include one or more key identifiers to be identified, that is, the mobile terminal can collect pictures of one or more key identifiers at a time.

The mobile terminal sends the acquired key identifier to the server in the form of a picture, so that the server can identify it. The image recognition process on the server side is divided into the following steps:

Information acquisition, preprocessing, feature extraction and selection, classifier design, and classification decisions.

Among them, the acquisition of information refers to the conversion of information such as light or sound into electrical information through sensors, that is, to acquire the basic information of the research object and convert it into information that can be recognized by the machine through a certain method.

Preprocessing mainly refers to the operations of denoising, smoothing, transformation, etc. in image processing, so as to enhance the important features of the image.

Feature extraction and selection refers to the need to extract and select features in pattern recognition. Classifier design refers to obtaining a recognition rule through training, through which a feature classification can be obtained, so that the image recognition technology can obtain a high recognition rate.

Classification decision refers to classifying the identified objects in the feature space, so as to better identify which category the object under study belongs to.

The server may include an image recognition module and a storage module, the image recognition module is used to identify the received key identification picture information according to a preset image recognition algorithm; the storage module stores the key icon, key name, corresponding When the server recognizes a certain button, it can find the information related to the button from the storage module according to the button's identifier, and return it to the mobile terminal.

S320. Receive the identification result returned by the server, and send a button driving request to the controller according to the identification result, so that the controller drives the corresponding button to make a preset form in response to the button driving request feedback prompt.

When the image information sent by the mobile terminal to the server contains multiple key identifiers, the received result returned by the server will also contain relevant information about the multiple keys. Use presentation animations and effect animations, etc.

If the returned identification result includes one key information, you can directly view the key detailed information corresponding to the key; if the returned identification result includes multiple key information, you can view different key detailed information by switching the display page.

Specifically, please refer to FIG. 4, which shows a method for displaying a key recognition result, including:

S410. In response to the user's request for viewing the identification result, display the function and name of the target key to the user in a preset manner; wherein the preset manner includes at least one of text, picture, image and voice.

The user can browse the key information through the mobile terminal. When viewing the specific information of a key, the mobile terminal can display the key information to the user in one or more forms of text, picture, video and voice.

The image form here may include: a demonstration of how to use the button and a demonstration of the effect after the button is operated.

S420. Send a button driving request to the controller according to the target button currently viewed by the user, where the button driving request includes the identifier of the target button currently viewed by the user.

The identifier of the target key currently viewed by the user is sent to the vehicle key controller, so that the controller drives the corresponding key to give a feedback prompt.

For the process of information interaction processing on the controller side, reference may be made to FIG. 5, which shows yet another information processing method, including:

S510. Receive a button driving request sent by the mobile terminal, wherein the button driving request includes the identifier of the target button currently viewed by the user.

The mobile terminal communicates with the controller via Bluetooth, and the controller receives the button driving request sent by the mobile terminal.

S520. Determine the target key to be driven according to the identifier of the target key, and generate a corresponding key driving instruction.

After receiving the identifier of the target button, the controller needs to determine the target button corresponding to the identifier, that is, it needs to determine the object for sending the instruction, and then generates a driving instruction for driving the object.

S530. Send the button driving instruction to the target button, so as to drive the target button to make a feedback prompt in a preset form.

Here, the driving target button can be specifically given feedback through the button indicator light. For example, for a certain button currently being viewed, the indicator light corresponding to the button can be always on or flashing to indicate that the button displayed on the mobile terminal is the same as that on the vehicle. Correspondence of buttons. In addition, the user can be reminded of the relevant information of the key currently viewed in the form of voice broadcast. Of course, the function of voice broadcast can also be implemented by a mobile terminal, and one of the two can be selected for voice broadcast.

The key scanning query history can also be stored locally or on the server side. When the user has questions about the keys that have been identified, he can directly obtain the relevant information through the search history, without the need to scan and shoot the key identification again. .

In the present invention, the user uses the camera in the smart terminal to scan the function button icon in a certain area of the car, and performs image recognition through the server. After the recognition is successful, the function explanation broadcast and demonstration of the button are displayed on the mobile terminal, and the corresponding buttons in the car are synchronized. A corresponding feedback prompt is made, and the present invention quickly acquires detailed information of in-vehicle buttons through the image recognition technology, thereby improving the efficiency and user experience of the user in acquiring the function of using the buttons.

In addition, the present invention can also involve such an application scenario, that is, enter the demo mode through the APP installed in the mobile terminal, directly display the relevant button information in sequence on the mobile terminal interface, and give corresponding feedback prompts to the corresponding in-vehicle buttons . In this embodiment, the user does not need to obtain the key identification through the camera, but only needs to watch through the mobile terminal. Since the corresponding button identifications are not necessarily the same for different models of vehicles, when selecting the demo mode, more accurate button information can be obtained by selecting the model of the vehicle.

It should be noted that, the keys in this embodiment may be in the form of mechanical physical keys, virtual keys, or knobs and other key forms.

Please refer to FIG. 6, which shows an information interaction apparatus, the apparatus includes:

The key identification module 610 is used to obtain the key identification in the target area, and send the key identification to the server, so that the server can identify the key identification, and obtain the function and function of the target key corresponding to the key identification. name and return the recognition result.

The result display module 620 is configured to receive the identification result returned by the server, and send a button driving request to the controller according to the identification result, so that the controller drives the corresponding button to pre-empt the button in response to the button driving request. Provide feedback in the form of designations.

Wherein, please refer to FIG. 7 , the result display module 620 includes:

The viewing module 710 is configured to display the function and name of the target key to the user in a preset manner in response to a user's request for viewing the identification result; wherein the preset manner includes text, pictures, images and voices. at least one.

The request sending module 720 is configured to send a button driving request to the controller according to the target button currently viewed by the user, where the button driving request includes the identifier of the target button currently viewed by the user.

Please refer to FIG. 8 , which shows another information interaction apparatus, and the apparatus includes:

The request receiving module 810 is configured to receive a button driving request sent by the mobile terminal, wherein the button driving request includes the identifier of the target button currently viewed by the user.

The instruction generation module 820 is configured to determine the target button to be driven according to the identifier of the target button, and generate a corresponding button driving instruction.

The driving module 830 is configured to send the button driving instruction to the target button, so as to drive the target button to give a feedback prompt in a preset form.

Wherein, the driving module 830 further includes:

The feedback prompting module 910 is used to drive the target key to make a feedback prompt through the key indicator light.

The apparatuses provided in the above embodiments can execute the methods provided in any of the embodiments of the present invention, and have corresponding functional modules and beneficial effects for executing the methods. For technical details not described in detail in the above embodiments, reference may be made to the method provided by any embodiment of the present invention.

This embodiment also provides an information interaction system, the system includes a processor and a memory, the memory stores at least one instruction, at least one piece of program, code set or instruction set, the at least one instruction, at least one piece of program , a code set or an instruction set is loaded by the processor and executes the information interaction method described above in this embodiment.

This embodiment also provides a computer-readable storage medium, where computer-executable instructions are stored in the storage medium, and the computer-executable instructions are loaded by a processor to execute any of the above-mentioned methods in this embodiment.

In the present invention, through the image recognition technology, the user can use the mobile terminal to scan and identify the button icon, and directly display the function introduction on the mobile terminal, without having to look at the car manual; connect the mobile terminal through Bluetooth, when viewing a button on the mobile terminal When the function is activated, the button on the car will give a synchronous feedback prompt. The invention obtains the function introduction of the keys in a targeted manner; reduces the user's trial and guess use scenarios, and reduces the potential danger caused by the user's rash operation of the keys; improves the efficiency of the user's acquisition of the key function, and improves the user experience; reduces paper The manufacture and use of the manual is environmentally friendly and energy-saving.

The present specification provides method operation steps as described in the embodiments or flow charts, but more or less operation steps may be included based on routine or non-creative work. The steps and sequences listed in the embodiments are only one way of execution sequence of many steps, and do not represent the only execution sequence. When an actual system or interrupt product is executed, the methods shown in the embodiments or the accompanying drawings may be executed sequentially or in parallel (for example, a parallel processor or a multi-threaded processing environment).

The structure shown in this embodiment is only a part of the structure related to the solution of the present application, and does not constitute a limitation on the equipment to which the solution of the present application is applied. The specific device may include more or more than shown. Fewer components, or combining some components, or having a different arrangement of components. It should be understood that the methods, apparatuses, etc. disclosed in this embodiment may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the modules is only a division of a logical function. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection of devices or unit modules through some interfaces.

Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, removable hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes.

Those skilled in the art may further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this specification can be implemented in electronic hardware, computer software, or a combination of the two. Interchangeability, the above description has generally described the components and steps of each example in terms of function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions described in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. an information interaction method, is characterized in that, comprises: The mobile terminal acquires the key identifier in the target area, and sends the key identifier to the server; The server identifies the button identification, obtains the function and name of the target button corresponding to the button identification, and returns the identification result to the mobile terminal; The mobile terminal displays the function and name of the target button in a preset manner in response to the user's request for viewing the identification result, and sends a button driving request to the controller according to the identification result, wherein the preset The method includes at least one of text, picture, video and voice; In response to the key actuation request, the controller drives the corresponding key to give a feedback prompt in a preset form. 2. an information interaction method, is characterized in that, comprises: Acquiring the key identification in the target area, sending the key identification to the server, so that the server identifies the key identification, obtains the function and name of the target key corresponding to the key identification, and returns the identification result; Receive the identification result returned by the server, display the function and name of the target button in a preset manner in response to the user's identification result viewing request, and send a button drive request to the controller according to the identification result, wherein, The preset manner includes at least one of text, picture, image and voice, so that the controller, in response to the button driving request, drives the corresponding button to give a feedback prompt in a preset form. 3. An information interaction method according to claim 2, wherein the receiving the identification result returned by the server, in response to a user's identification result viewing request, displays the target key in a preset manner. function and name, and according to the identification result, sending a button drive request to the controller includes: In response to the user's request for viewing the identification result, displaying the function and name of the target key to the user in a preset manner; According to the target button currently viewed by the user, a button driving request is sent to the controller, where the button driving request includes the identifier of the target button currently viewed by the user. 4. An information interaction method, characterized in that, comprising: receiving a button driving request sent by the mobile terminal, wherein the button driving request includes the identifier of the target button currently viewed by the user; Determine the target button to be driven according to the identifier of the target button, and generate a corresponding button driving instruction; Send the button driving instruction to the target button, so as to drive the target button to make a feedback prompt in a preset form; Wherein, the mobile terminal is used to obtain the key ID in the target area, and send the key ID to the server, so that the server can identify the key ID and obtain the function of the target key corresponding to the key ID. and name, and return the identification result; receive the identification result returned by the server, in response to the user's identification result viewing request, display the function and name of the target key in a preset manner, and according to the identification result, report to the control The controller sends a button driving request, wherein the preset mode includes at least one of text, picture, video and voice, so that the controller drives the corresponding button in a preset manner in response to the button driving request form feedback. 5. An information interaction method according to claim 4, wherein the driving the target key to make a feedback prompt in a preset form comprises: The target key is driven to make a feedback prompt through the key indicator light. 6. An information interaction device, comprising: A key identification module, used to obtain the key identification in the target area, and send the key identification to the server, so that the server can identify the key identification, and obtain the function and name of the target key corresponding to the key identification , and return the recognition result; The result display module is used for receiving the recognition result returned by the server, in response to the user's request for checking the recognition result, displaying the function and name of the target key in a preset manner, and sending a message to the controller according to the recognition result A button driving request, wherein the preset mode includes at least one of text, picture, video and voice, so that the controller drives the corresponding button in a preset form in response to the button driving request Give feedback. 7. An information interaction device according to claim 6, wherein the result display module comprises: The viewing module is configured to display the function and name of the target key to the user in a preset manner in response to a user's request for viewing the identification result; wherein the preset manner includes at least one of text, picture, image and voice A sort of; The request sending module is configured to send a button driving request to the controller according to the target button currently viewed by the user, where the button driving request includes the identifier of the target button currently viewed by the user. 8. An information interaction device, comprising: a request receiving module, configured to receive a button driving request sent by the mobile terminal, wherein the button driving request includes the identifier of the target button currently viewed by the user; an instruction generation module, configured to determine the target button to be driven according to the identifier of the target button, and generate a corresponding button driving instruction; a driving module, configured to send the button driving instruction to the target button, so as to drive the target button to make a feedback prompt in a preset form; Wherein, the mobile terminal is used to obtain the key ID in the target area, and send the key ID to the server, so that the server can identify the key ID and obtain the function of the target key corresponding to the key ID. and name, and return the identification result; receive the identification result returned by the server, in response to the user's identification result viewing request, display the function and name of the target key in a preset manner, and according to the identification result, report to the control The controller sends a button driving request, wherein the preset mode includes at least one of text, picture, video and voice, so that the controller drives the corresponding button in a preset manner in response to the button driving request form feedback. 9. An information interaction device according to claim 8, wherein the driving module comprises: The feedback prompting module is used to drive the target key to make a feedback prompt through the key indicator light. 10. An information interaction system, characterized in that the system comprises a processor and a memory, and the memory stores at least one instruction, at least a program, a code set or an instruction set, the at least one instruction, at least a program , a code set or an instruction set is loaded by the processor and executes the information interaction method according to claim 1 .

Images