CN117648049A

CN117648049A - Navigation map zooming method and device, electronic equipment and storage medium

Info

Publication number: CN117648049A
Application number: CN202311677942.9A
Authority: CN
Inventors: 彭泳铭
Original assignee: Zhejiang Geely Holding Group Co Ltd; Geely Automobile Research Institute Ningbo Co Ltd
Current assignee: Zhejiang Geely Holding Group Co Ltd; Geely Automobile Research Institute Ningbo Co Ltd
Priority date: 2023-12-07
Filing date: 2023-12-07
Publication date: 2024-03-05

Abstract

The application discloses a navigation map scaling method, a device, electronic equipment and a storage medium, wherein the navigation map scaling method is applied to a vehicle, a first sensor is arranged on a steering wheel of the vehicle, and the navigation map scaling method comprises the following steps: acquiring first gesture touch information of a first gesture to be identified interacted between a user and a steering wheel through the first sensor; and generating a navigation map zoom instruction under the condition that the first gesture to be recognized is determined to be matched with a preset navigation map zoom gesture based on the first gesture touch information. The technical problem that the safety of navigation map zoom control in the driving process is low in the related art is solved.

Description

Navigation map zooming method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of vehicle technologies, and in particular, to a navigation map scaling method, a navigation map scaling device, an electronic device, and a storage medium.

Background

Navigation is more and more common in life of the public, and the occurrence of navigation greatly reduces the pressure of people for identifying roads when going out and greatly improves the efficiency of going out. However, in the field of vehicle navigation, improving the safety and the operation convenience of the driver has been an important technical challenge.

In the related art, if a user wants to enlarge or reduce a display area of navigation during driving navigation, the user needs to move his/her hand away from the steering wheel and onto the navigation device to perform operations, and in this process, the user needs to move his/her line of sight away from the road to confirm whether the hand is moved to a designated position, which all results in distraction, thus increasing driving risk and even causing a safety accident.

Disclosure of Invention

The main purpose of the application is to provide a navigation map scaling method, a device, electronic equipment and a storage medium, which aim to solve the technical problem of low safety of navigation map scaling control in the driving process in the related technology.

In order to achieve the above object, the present application provides a navigation map scaling method applied to a vehicle, a steering wheel of the vehicle is provided with a first sensor, the navigation map scaling method includes the following steps:

acquiring first gesture touch information of a first gesture to be identified interacted between a user and a steering wheel through the first sensor;

and generating a navigation map zoom instruction under the condition that the first gesture to be recognized is determined to be matched with a preset navigation map zoom gesture based on the first gesture touch information.

The application also provides a navigation map scaling device, the navigation map scaling device is applied to the vehicle, be provided with first sensor on the steering wheel of vehicle, the navigation map scaling device includes:

the acquisition module is used for acquiring first gesture touch information of a first gesture to be identified, which is interacted with the steering wheel by a user, through the first sensor;

the instruction generation module is used for generating a navigation map zooming instruction under the condition that the first gesture to be recognized is determined to be matched with a preset navigation map zooming gesture based on the first gesture touch information.

The application also provides an electronic device, which is an entity device, and includes: the navigation map scaling system comprises a memory, a processor and a program of the navigation map scaling method stored in the memory and capable of running on the processor, wherein the program of the navigation map scaling method can realize the steps of the navigation map scaling method when being executed by the processor.

The present application also provides a storage medium, where the storage medium is a computer readable storage medium, and a program for implementing a navigation map scaling method is stored on the computer readable storage medium, where the program for implementing the navigation map scaling method implements the steps of the navigation map scaling method described above when executed by a processor.

The application provides a navigation map scaling method, a device, electronic equipment and a storage medium, wherein the navigation map scaling method is applied to a vehicle, a first sensor is arranged on a steering wheel of the vehicle, first gesture touch information of a first gesture to be identified, which is interacted with the steering wheel by a user, is acquired through the first sensor, and the detection of the scaling intention of a navigation map of the user through the steering wheel is realized, so that the scaling intention of the navigation map of the user can be expressed through the interaction with the steering wheel under the condition that both hands do not need to leave the steering wheel; and further, under the condition that the first gesture to be recognized is determined to be matched with the preset navigation map scaling gesture based on the first gesture touch information, a navigation map scaling instruction is generated, so that navigation map scaling control based on the detected navigation map scaling intention is realized, namely, the navigation map scaling intention expressed by the user through interaction with a steering wheel can be converted into the navigation map scaling instruction, and scaling control of the navigation map is realized. Because the user should put the steering wheel on the steering wheel in the vehicle driving process with both hands, when needing to zoom the navigation map, gather first gesture touch information through the first sensor that sets up on the steering wheel, can make the driver need not to move the position of hand and can realize zooming the navigation map's purpose, because need not to move the position of hand, just need not to distraction just to pay attention to whether the operation of hand zoom navigation map is accurate. Therefore, a driver can control the navigation map by using gestures through interaction between the hands and the steering wheel with less vision under the condition that the steering wheel is held by both hands, so that the control convenience of zooming the navigation map is improved, and the safety risk caused by zooming the navigation map in the driving process is reduced. The technical defects that if a user wants to enlarge or reduce a navigation display area in the driving navigation process, the driver is required to leave the steering wheel and move the hand to the navigation device to operate, in the process, the user also needs to move the sight from the road to confirm whether the hand moves to a designated position or not, and the operations can lead to distraction, so that driving risk is increased and safety accidents are even caused are overcome.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a flow chart of a first embodiment of a navigation map scaling method of the present application;

FIG. 2 is a schematic diagram of a scene of a zoom-in map gesture according to an embodiment of the present application;

FIG. 3 is a schematic view of a scene of a zoom-out gesture according to an embodiment of the present application;

FIG. 4 is a flow chart of a second embodiment of a navigation map scaling method of the present application;

FIG. 5 is a schematic structural diagram of an embodiment of a device for zooming a navigation map according to the present application;

fig. 6 is a schematic device structure diagram of a hardware operating environment related to a navigation map scaling method in an embodiment of the present application.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed Description

In order to make the above objects, features and advantages of the present invention more comprehensible, the following description of the embodiments accompanied with the accompanying drawings will be given in detail. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments of the present invention without making any inventive effort, are intended to be within the scope of the present invention.

Navigation is more and more common in life of the public, and the occurrence of navigation greatly reduces the pressure of people for identifying roads when going out and greatly improves the efficiency of going out. However, in the field of vehicle navigation, improving the safety and the operation convenience of the driver has been an important technical challenge. The navigation map scaling method of the related art center includes the following:

(1) Gesture recognition system based on camera: some vehicle manufacturers and technological companies have begun to attempt to use cameras and gesture recognition algorithms for vehicle navigation map zoom devices. These systems may capture a driver's gesture, such as a hand swing or finger movement, and then translate it into navigation control commands. However, these systems also require the driver to move his hand into the field of view of the camera and to perform a large gesture operation in order to be ready for recognition, and the driver still needs to be distracted to find the position where the gesture can be made and to move his hand away from the steering wheel, thus still presenting a high safety risk.

(2) The voice-controlled navigation map scaling device comprises: some vehicles are equipped with voice-controlled navigation map zoom devices that allow the driver to operate navigation functions through voice commands. Although these systems can reduce manual operations, the environmental requirements for voice recognition are high, the vehicle is not necessarily quite quiet during running, the vehicle running itself can generate certain noise, talking sounds of passengers in the vehicle, sounds of playing music on the vehicle or the vehicle itself is in a noisy environment, under these conditions, the difficulty of controlling instructions through voice recognition is high, the understanding of certain instructions by voice recognition is still challenging, other scenes with low requirements on timeliness can be accurately identified through a plurality of repeated modes, but in the vehicle navigation field, a great deal of time is consumed by a plurality of repeated modes, during the period of time, the vehicle still is in a running state, possibly caused by traveling error, or the speed reduction affects the running of the vehicle at the rear, or the user is distracted to the operations of accurately sounding, closing background music, closing windows and the like, and also high safety risks are caused.

(3) Touch-sensitive steering wheel: some automobile manufacturers have begun to use touch sensing technology to integrate control functions on the driving control area. However, these touch pads are generally planar and therefore require a separate setting, and the driver still needs to be distracted to find the position of the touch pad and thus make a corresponding gesture, which also presents a high safety risk.

(4) Virtual reality gesture control techniques: some gesture control schemes already exist in the field of virtual reality, allowing users to interact using gestures in a virtual environment. While these techniques perform well in virtual environments, applications in vehicle navigation need to take into account more safety and utility factors.

In summary, the navigation map zooming method with practicability in the related art still needs the driver to move the hand away from the steering wheel to the designated position, in the process, the user also needs to move the sight away from the road to confirm whether the hand moves to the designated position, if the user moves the sight away from the road to confirm whether the hand moves to the designated position, the navigation control operation can be better ensured to be accurately identified, but the distraction of the attention caused by the fact that the hand is away from the steering wheel and the sight away from the road increases driving risk, and even safety accidents are caused; if the user does not move the line of sight from the road to confirm whether the hand moves to the designated position, the situation that the navigation control operation of the user may not be accurately identified may occur, for example, the user cannot accurately find the touch pad by the hand alone, cannot adjust the hand to the angle and the position that the camera can accurately identify, and the navigation control operation cannot be accurately identified in the image collected by the camera, which may result in that the navigation control cannot be timely realized, but the vehicle is continuously running forward in the running process, thus possibly causing the vehicle to walk wrong, causing inconvenience, wasting resources and time, and bringing bad experience to the user.

Based on the above, the application provides a more convenient and safe navigation map scaling method, which is applied to a vehicle, wherein a first sensor is arranged on a steering wheel of the vehicle, first gesture touch information of a first gesture to be identified, which is interacted with the steering wheel by a user, is acquired through the first sensor, and the detection of the navigation map scaling intention of the user through the steering wheel is realized, so that the user can express the navigation map scaling intention of the user through the interaction with the steering wheel under the condition that the hands do not need to leave the steering wheel; and further, under the condition that the first gesture to be recognized is determined to be matched with the preset navigation map scaling gesture based on the first gesture touch information, a navigation map scaling instruction is generated, so that navigation map scaling control based on the detected navigation map scaling intention is realized, namely, the navigation map scaling intention expressed by the user through interaction with a steering wheel can be converted into the navigation map scaling instruction, and scaling control of the navigation map is realized. Because the user should put the steering wheel on the steering wheel in the vehicle driving process with both hands, when needing to zoom the navigation map, gather first gesture touch information through the first sensor that sets up on the steering wheel, can make the driver need not to move the position of hand and can realize zooming the navigation map's purpose, because need not to move the position of hand, just need not to distraction just to pay attention to whether the operation of hand zoom navigation map is accurate. Therefore, a driver can control the navigation map by using gestures through interaction between the hands and the steering wheel with less vision under the condition that the steering wheel is held by both hands, so that the control convenience of zooming the navigation map is improved, and the safety risk caused by zooming the navigation map in the driving process is reduced. The technical defects that if a user wants to enlarge or reduce a navigation display area in the driving navigation process, the driver is required to leave the steering wheel and move the hand to the navigation device to operate, in the process, the user also needs to move the sight from the road to confirm whether the hand moves to a designated position or not, and the operations all lead to distraction, so that driving risk is increased, safety accidents are even caused, the control convenience of zooming the navigation map in the driving process of the driver is improved, and the driving risk caused by distraction is reduced are overcome.

Example 1

In a first embodiment of the navigation map scaling method, referring to fig. 1, the navigation map scaling method is applied to a vehicle, and a first sensor is disposed on a steering wheel of the vehicle, and the navigation map scaling method includes the following steps:

step S10, acquiring first gesture touch information of a first gesture to be identified interacted between a user and a steering wheel through the first sensor;

the execution subject of the method of the embodiment may be a navigation map scaling device, or may be a terminal device or a server of the navigation map scaling method, and the embodiment uses the navigation map scaling device as an example, where the navigation map scaling device may be integrated on a terminal device such as a vehicle, a vehicle-mounted terminal, a vehicle controller, a smart phone, a tablet computer, etc. with a data processing function.

In this embodiment, it should be noted that, if the user wants to zoom in or out of the display area of the navigation during driving navigation, the driver needs to leave the hand from the steering wheel and move the hand to the navigation device to perform an operation, and in this process, the user also needs to move the line of sight from the road to confirm whether the hand moves to the designated position, and these operations all cause distraction, so that driving risk is increased and even safety accidents are caused. According to the embodiment, the function of amplifying the navigation map can be rapidly and accurately realized through simple gestures without separating from a steering wheel, and the actual requirement of amplifying the navigation map by a user at any time in the driving process can be met under the condition of ensuring the driving safety. For example, when a driver approaches an intersection or needs to quickly preview a critical intersection on a route, the map can be quickly zoomed in using gestures to clearly see intersection signs and navigation indications; for another example, under complex road conditions, such as urban roads or highway intersections, the driver may use gestures to quickly zoom out on the map to view more extensive road condition information, including nearby exits or roads, etc.; for another example, if the driver needs to find a particular location or service while driving, the gestures may be used to quickly zoom out on the map to view surrounding areas and quickly zoom in on at any time to obtain more detailed information.

The navigation map scaling method is applied to a vehicle, and the navigation can be vehicle-mounted navigation or an external navigation device in communication connection with the vehicle, and the external navigation device allows the navigation map scaling device to control the navigation map scaling device. The steering wheel of the vehicle is provided with a first sensor, and the first sensor is used for collecting gesture touch information generated by touch interaction operation between a user and the steering wheel and can comprise at least one of a pressure sensor, a photoelectric sensor, an image sensor and the like.

In an embodiment, the first sensor is a sensor array, where the sensor array includes a plurality of sensor units distributed at different positions on the surface of the steering wheel, and when any one or more of the sensor units collect sensor data, the gesture that the user interacts with the steering wheel currently may be determined based on the sensor data and the position of the sensor unit itself, or the relative positional relationship between the sensor unit and other sensor units, or the positional relationship between the sensor units in the sensor array. Different navigation control instructions can be matched for different gestures in advance, after a user learns various gestures and the navigation control instructions corresponding to the various gestures, in the actual driving process, when the user wants to perform navigation control, the corresponding gestures are made, and further after gesture touch information generated by the gesture made by the user is detected, the navigation control instruction which the user wants to perform can be identified, and the navigation execution of the navigation control instruction which the user wants to perform is controlled.

The gesture touch information may include at least one of pressure information, operation time, operation position information, etc., and the gesture touch information may be extracted from information such as sensor data, deployment position of the sensor unit, etc. Wherein the operation type of the user operation, such as touch, tap, press, slide, etc., can be discriminated based on the pressure information, the operation time, etc.; since the portion where the operation is performed can be recognized based on the operation position information, recognition of a micro gesture including a gesture made by a portion of the hand, such as an action of one finger, an action of a plurality of fingers, an action of the palm, or the like can be realized. Thus, the parts of the hand and the operation types can form more combination modes, so that more navigation control is matched, and more navigation control operations are realized. In this way, on one hand, in the process of driving the vehicle, the hand should be originally placed on the steering wheel to control the steering wheel, in the navigation map zooming method of the embodiment, the hand does not need to be separated from the steering wheel in the process of interaction between the finger or the palm and the steering wheel, and compared with the traditional gesture recognition system, the hand of the driver cannot be separated from the steering wheel, so that the driving safety is greatly improved; on the other hand, the miniature gestures are very tiny and accurate, and only little vision and motion are needed to complete navigation control, so that compared with a traditional gesture control system which needs large gestures or complex motion, the risk of distraction is reduced, and the driver is helped to keep the attention of the driver focused on the road.

As an example, the step S10 includes: after the vehicle is powered on and operated and navigation is started, first gesture touch information of a first gesture to be identified, which is interacted with the steering wheel by the hand of the user, can be collected continuously or after preset gesture control conditions are met through the first sensor.

In an embodiment, when the navigation is started, a prompt box for starting gesture control may be output, under the condition that the user selects to start gesture control, a preset gesture control condition is judged to be met currently, the navigation enters a gesture control state, and the first sensor is started, so that the first sensor may collect the gesture touch information until the navigation exits the gesture control state, and the mode of the navigation exiting the gesture control state may be navigation closing, user operation exiting, vehicle powering-down, etc., which may be specifically determined according to the actual situation. When a user starts navigation initially, the vehicle is usually in a parking state, and at the moment, safety risks cannot be generated when the user interacts with the navigation device, and whether the user needs to perform navigation control through gestures in the navigation process can be accurately confirmed.

In another embodiment, the gesture control wake gesture may be preset, and the gesture control close gesture may also be preset. After navigation is started, a first sensor is started, and then when a gesture control wake-up gesture is detected through the first sensor, the current condition of meeting a preset gesture control condition is judged, the navigation map scaling method is started to be executed, and sensor data acquired by the first sensor are analyzed; and stopping executing the navigation map zooming method when the gesture control closing gesture is detected, so as to avoid false touch. The user may generate the navigation control requirement of zooming the map in the navigation process after the vehicle runs, but the vehicle is already running on the road at this time, the convenience of operation by stopping the vehicle by the side is low, but if hands leave the steering wheel to interact with the navigation device, the attention of the driver needs to be dispersed, and the safety risk is high, so that the navigation map zooming method can be controlled to be started through the gesture control wake-up gesture, and after the navigation control, the navigation map zooming method can be controlled to stop executing through the gesture control close gesture in order to avoid the false touch, so that the flexible switching of the navigation map zooming method is realized.

In an implementation manner, the step of collecting, by the first sensor, gesture touch information of a gesture to be recognized, where the gesture is interacted with by a user with a steering wheel, includes: and acquiring first gesture touch information of a first gesture to be recognized, which is interacted by a user finger and a steering wheel, by the first sensor, wherein the gesture touch information comprises at least one of tapping gesture information of at least one target finger, touch gesture information of at least one target finger, non-touch gesture information of at least one target finger and sliding gesture information of at least one target finger.

In this embodiment, it should be noted that, by detecting the micro gesture that the finger interacts with the steering wheel and performing navigation control based on the micro gesture, on one hand, the number of fingers is large, and the fingers can be combined, and further can be combined with the operation type to form more combination modes, so as to match more navigation control and realize more navigation control operations; on the other hand, the flexibility of the finger is higher, the operation difficulty of interacting with the steering wheel is smaller, the implementation is easy, the control of the steering wheel is not interfered, and therefore the safety risk is smaller. Thus, the gesture touch information may include a combination of one or more of tap gesture information of at least one target finger, touch gesture information of at least one target finger, non-touch gesture information of at least one target finger, and swipe gesture information of at least one target finger, wherein the target finger may be determined from the position information in the sensor data.

As an example, after the vehicle is powered on and navigation is started, first gesture touch information of a first gesture to be identified, which is interacted by a user finger with the steering wheel, may be collected continuously or after a preset gesture control condition is met through the first sensor.

Optionally, the map-magnifying gesture includes a gesture of holding the steering wheel with both hands and simultaneously striking an outer area of the steering wheel with both index fingers for a first preset number of times within a preset first interval time;

and/or the map zooming gesture comprises a gesture that the two hands hold the steering wheel and simultaneously the two thumbs strike the inner side area of the steering wheel for a second preset times within a preset second interval time.

In this embodiment, referring to fig. 2, the preset first gesture includes a gesture of holding the steering wheel with both hands, and striking the outer area of the steering wheel with both index fingers for a preset first number of times within a preset first interval time. This gesture is simple, easy understanding, and study cost is lower, and can reduce the false detection probability through predetermineeing first interval time and predetermineeing first number, and when holding the steering wheel, the interactive position of forefinger is located the end side in the steering wheel outside, and it is simpler to confirm the position of forefinger, detects the degree of difficulty less, and is difficult to the false detection.

Referring to fig. 3, the preset second gesture includes a gesture of holding the steering wheel with both hands while knocking the inner region of the steering wheel with both thumbs. The gesture is simple, easy to understand, low in learning cost, capable of reducing false detection probability through the preset second interval time and the preset second times, and capable of determining that the position of the thumb is simpler and the detection difficulty is smaller and not easy to be detected by false when the hand is held by the steering wheel.

Optionally, the step of collecting, by the first sensor, first gesture touch information of a first gesture to be recognized, where the user interacts with the steering wheel, includes:

step S11, acquiring second gesture touch information of a second gesture to be recognized, which is interacted with the steering wheel by a user, through the first sensor;

step S12, when it is determined that the second gesture to be recognized matches the preset wake gesture based on the second gesture touch information, the first gesture touch information of the first gesture to be recognized, which is interacted by the user with the steering wheel, is acquired through the first sensor.

In this embodiment, it should be noted that, during driving, a large amount of interaction operations may be generated between the hands of the driver and the steering wheel, and the situations that navigation needs to be controlled are small, so the gesture control function may be started only when there is a gesture control requirement by setting a wake-up gesture, and the gesture control sleep state may be entered when the user does not wake up the gesture control function, and most of the sub-functions in the gesture control function may be closed, for example, only a part of sensors may be started, and a relatively simple gesture recognition manner such as information matching may be used, so that a wake-up gesture may be detected, and after the wake-up gesture is detected, the gesture control sleep state may be exited, the gesture control function may be started, and all modules of the navigation map zoom apparatus may be started, so that the implementation of the navigation map zoom method may be ensured.

As an example, the steps S11 to S12 include: after the vehicle is powered on and operated and navigation is started, second gesture touch information of a second gesture to be recognized, which is interacted by a user and the steering wheel, can be continuously acquired through the first sensor, the second gesture touch information is analyzed, whether the second gesture to be recognized is matched with a preset awakening gesture is judged, a gesture control function is started under the condition that the second gesture to be recognized is determined to be matched with the preset awakening gesture, and then, first gesture touch information of a first gesture to be recognized, which is interacted by the user and the steering wheel and acquired by the first sensor after the gesture control function is started, is acquired.

In one embodiment, the navigation map scaling method may further include the steps of: and under the condition that the preset dormancy condition is met, entering a gesture control dormancy state. Avoiding influencing the normal driving operation of the driver and saving resources.

Step S20, generating a navigation map zoom command when it is determined that the first gesture to be recognized matches with a preset navigation map zoom gesture based on the first gesture touch information.

In this embodiment, the navigation map zoom instruction refers to an instruction for controlling zoom-out or zoom-in of a navigation map, and illustratively, during driving, a user makes a navigation map zoom gesture, the navigation map zoom apparatus generates a navigation map zoom instruction, and sends the navigation map zoom instruction to navigation, and navigation performs zoom adjustment on the navigation map in response to the navigation map zoom instruction.

As an example, the step S20 includes: after the first gesture touch information is collected, the first gesture touch information can be analyzed, whether the first gesture to be identified is matched with a preset navigation map zoom gesture or not is judged, and a navigation map zoom instruction is generated under the condition that the first gesture to be identified is determined to be matched with the preset navigation map zoom gesture.

In an implementation manner, the analyzing the first gesture touch information and determining whether the first gesture to be recognized is matched with a preset navigation map zoom gesture may be: matching the first gesture touch information with a preset navigation map zoom gesture, and judging whether the first gesture to be recognized is a navigation map zoom gesture or not; or, inputting the first gesture touch information into a preset first gesture recognition model, analyzing the first gesture touch information through the first gesture recognition model, determining a target gesture corresponding to the first gesture to be recognized, and judging whether the target gesture is the zoom gesture of the navigation map, wherein the gesture recognition model is similar to the prior art, and is not repeated herein.

Optionally, the preset navigation map zoom gesture includes a preset zoom-in map gesture and a preset zoom-out map gesture; the navigation map scaling instruction comprises an enlarged map control instruction and a reduced map control instruction;

the step of generating a navigation map zoom command when the first gesture to be recognized is determined to be matched with a preset navigation map zoom gesture based on the first gesture touch information comprises the following steps:

step A10, generating an enlarged map control instruction under the condition that the first gesture to be recognized is determined to be matched with a preset enlarged map gesture based on the first gesture touch information;

and step A20, generating a zoom-out map control instruction under the condition that the first gesture to be recognized is determined to be matched with a preset zoom-out map gesture based on the first gesture touch information.

As an example, the steps a10 to a20 include: after the first gesture touch information is collected, the first gesture touch information can be analyzed to judge whether the first gesture to be recognized is matched with a preset zoom-in map gesture or a preset zoom-out map gesture. Generating an enlarged map control instruction under the condition that the first gesture to be recognized is matched with a preset enlarged map gesture; and generating a zoom-out map control instruction under the condition that the first gesture to be recognized is matched with a preset zoom-out map gesture.

Optionally, after the step of generating the navigation map zoom instruction, when the first gesture to be recognized is determined to match with the preset navigation map zoom gesture based on the first gesture touch information, the method further includes:

and under the condition that the preset map scaling canceling condition is met, restoring the navigation map to the preset standard specification.

In this embodiment, it should be noted that, if the navigation map is excessively enlarged, the displayed area is too small, the driver is difficult to perform macroscopic and global control, if the navigation map is excessively reduced, the displayed area is excessively large, detailed information is easily lost, and the accuracy of the driver in controlling the surrounding road conditions is reduced, which may lead to an increase in driving safety risk, so in driving, the user usually needs to enlarge or reduce the map due to sudden demands, and after enlarging or reducing the map confirmation information, the map is usually restored to the preset standard specification. According to the embodiment, the display specification of the navigation map is automatically restored by setting the mode of canceling the map scaling condition, so that the operation of restoring the navigation map specification by a user can be reduced, the user experience is improved, and the driving safety risk can be reduced. The preset cancel map zoom condition may be set according to actual needs, which is not limited in this embodiment, and may be, for example, a preset zoom time, that is, after a navigation map zoom instruction is generated, timing is started, and after the timing reaches the preset zoom time, a reply navigation map instruction is generated to restore the navigation map to the preset standard specification.

As an example, after the navigation map zoom instruction is generated, whether the preset cancel map zoom condition is currently satisfied may be continuously detected, and in the case that the preset cancel map zoom condition is satisfied, the navigation map may be restored to the preset standard specification.

In this embodiment, the navigation map scaling method is applied to a vehicle, and a first sensor is disposed on a steering wheel of the vehicle, and first gesture touch information of a first gesture to be identified, which is interacted by a user with the steering wheel, is collected through the first sensor, so that the detection of the navigation map scaling intention of the user through the steering wheel is realized, and thus, the user can express the navigation map scaling intention of the user through interaction with the steering wheel under the condition that both hands do not need to leave the steering wheel; and further, under the condition that the first gesture to be recognized is determined to be matched with the preset navigation map scaling gesture based on the first gesture touch information, a navigation map scaling instruction is generated, so that navigation map scaling control based on the detected navigation map scaling intention is realized, namely, the navigation map scaling intention expressed by the user through interaction with a steering wheel can be converted into the navigation map scaling instruction, and scaling control of the navigation map is realized. Because the user should put the steering wheel on the steering wheel in the vehicle driving process with both hands, when needing to zoom the navigation map, gather first gesture touch information through the first sensor that sets up on the steering wheel, can make the driver need not to move the position of hand and can realize zooming the navigation map's purpose, because need not to move the position of hand, just need not to distraction just to pay attention to whether the operation of hand zoom navigation map is accurate. Therefore, a driver can control the navigation map by using gestures through interaction between the hands and the steering wheel with less vision under the condition that the steering wheel is held by both hands, so that the control convenience of zooming the navigation map is improved, and the safety risk caused by zooming the navigation map in the driving process is reduced. The technical defects that if a user wants to enlarge or reduce a navigation display area in the driving navigation process, the driver is required to leave the steering wheel and move the hand to the navigation device to operate, in the process, the user also needs to move the sight from the road to confirm whether the hand moves to a designated position or not, and the operations can lead to distraction, so that driving risk is increased and safety accidents are even caused are overcome.

Example two

Further, referring to fig. 4, in the second embodiment of the present application, the same or similar content as the above embodiment may be referred to the above description, and will not be repeated. On this basis, the vehicle further comprises a second sensor, and the step of generating a navigation map zoom instruction when the first gesture to be recognized is determined to be matched with a preset navigation map zoom gesture based on the first gesture touch information comprises the following steps:

step B10, acquiring a gesture image through the second sensor;

in this embodiment, the higher the accuracy of detecting and identifying the user operation during the running of the vehicle, the more convenient the user operation, the less intense the user is, and the more concentrated the attention is, so the higher the driving safety is. Compared with the mutual verification of multiple sensors, the accuracy is slightly poor under the condition that the gesture detection of a single sensor is easier to be subjected to false detection.

The image data contains more information, and the accuracy of the position information contained in the image data is higher, but when the image sensor collects the image data, the problem that the object in the collected image data is incomplete due to the shielding of an obstacle, the resolution and the like is easy to cause, namely, the gesture characteristics in the collected gesture image are possibly incomplete, so that the condition that the target gesture cannot be identified easily occurs in single image identification. The gesture touch information has higher comprehensiveness for identifying the interactive operation between the hand of the user and the steering wheel, but lower accuracy for judging the position, so that the accuracy for judging which finger or which part of the hand is used for carrying out the interactive operation is lower. Therefore, the gesture touch information and the gesture image can complement each other, the gesture touch information can make up for the defect that the target object in the collected image data is not complete due to the problems of shielding, resolution and the like of the gesture image, and the gesture image can make up for the defect that the judgment accuracy of the gesture touch information on the position is low, so that the comprehensive and accurate identification of the miniature gesture of the user is realized.

In an embodiment, the second sensor may be disposed at a position corresponding to the steering wheel, for example, may be disposed at a steering column shroud, a dashboard, an a-pillar, or the like, for capturing an image of a steering wheel region, so that only a gesture image of a first gesture to be recognized, in which a user's hand interacts with the steering wheel, may be acquired, and the probability of occurrence of detection anomalies is reduced.

As an example, the step B10 includes: after the vehicle is powered on and is operated and navigation is started, gesture images of a first gesture to be identified, which is interacted with the steering wheel, of the hand of the user in the steering wheel area can be collected through the second sensor continuously or after preset gesture control conditions are met. The gesture image may be a picture or a video, and may specifically be determined according to actual needs, which is not limited in this embodiment.

Step B20, detecting whether the first gesture to be recognized is matched with a preset navigation map zooming gesture according to the first gesture touch information and the gesture image under the condition that the gesture image is matched with the first gesture touch information;

as an example, the step B20 includes: and carrying out information matching on the gesture image and the first gesture touch information, analyzing the gesture image and the first gesture touch information under the condition that the gesture image is matched with the first gesture touch information, and detecting whether the first gesture to be recognized is matched with a preset navigation map zooming gesture or not based on the gesture image and the first gesture touch information.

In an implementation manner, the method for performing information matching between the gesture image and the first gesture touch information may be: extracting first gesture features from the gesture image through a preset first feature extractor, extracting second gesture features from the first gesture touch information through a preset second feature extractor, and judging whether the first gesture features are matched with the second gesture features.

In another implementation manner, the method for performing information matching between the gesture image and the first gesture touch information may further be: and carrying out gesture recognition on the gesture image through a preset first gesture recognition model to obtain a preset first gesture, carrying out gesture recognition on the first gesture touch information through a preset second gesture recognition model to obtain a preset second gesture, and judging whether the preset first gesture is matched with the preset second gesture.

Optionally, the step of detecting whether the first gesture to be recognized matches a preset navigation map zoom gesture according to the first gesture touch information and the gesture image includes:

step B21, determining a target gesture from a preset gesture library based on the first gesture touch information and the gesture image through a preset gesture recognition algorithm;

And step B22, judging whether the target gesture is a navigation map zoom gesture.

As an example, the steps B21 to B22 include: and carrying out gesture recognition operation based on the first gesture touch information and the gesture image through a preset gesture recognition algorithm, calculating the probability that a first gesture to be recognized, which is interacted with the steering wheel currently by the hand of a user, is each gesture in a preset gesture library, determining a target gesture according to the probability, and judging whether the target gesture is a navigation route point adding gesture.

In one implementation manner, the gesture recognition algorithm includes a first feature extraction algorithm, a second feature extraction algorithm and a gesture classification algorithm, where the feature extraction algorithm may be determined according to a type of data, actually required features, and the like, which is not limited in this embodiment; the step of determining, by a preset gesture recognition algorithm, the target gesture from the preset gesture library based on the first gesture touch information and the gesture image may include: first gesture features are extracted from the first gesture touch information through a first feature extraction algorithm, second gesture features are extracted from the gesture image through a second feature extraction algorithm, the first gesture features and the second gesture features are spliced into gesture feature vectors or gesture feature matrixes, then the probability that a first gesture to be identified, which is interacted with a steering wheel currently, of a user hand is each gesture in a preset gesture library is calculated based on the gesture feature vectors or gesture feature matrixes through a preset gesture classification algorithm, a target gesture is output according to the probability as a classification result, and an exemplary gesture with highest probability can be determined to be a target gesture, a gesture with probability higher than a preset probability threshold and highest probability can be determined to be a target gesture, and the gesture can be determined according to actual conditions.

And step B30, generating a navigation map zooming instruction under the condition that the first gesture to be recognized is matched with a preset navigation map zooming gesture.

As an example, the step B30 includes: and generating a navigation map zoom instruction under the condition that the first gesture to be recognized is matched with a preset navigation map zoom gesture.

In this embodiment, the second sensor collects the gesture image, so that mutual verification and information complementation can be performed on the gesture touch information collected by the first sensor, the probability of error recognition can be reduced, the comprehensiveness of the collected gesture information can be improved, the accuracy of gesture recognition is improved, and accordingly, the target navigation control instruction meeting the actual requirements of the user can be more accurately determined, and therefore, the convenience and driving safety of user operation can be effectively improved, and the user experience sense is improved.

Example III

Further, referring to fig. 5, an embodiment of the present application further provides a navigation map scaling device, which is characterized in that the navigation map scaling device is applied to a vehicle, a first sensor is disposed on a steering wheel of the vehicle, and the navigation map scaling device includes:

The acquisition module 10 is configured to acquire, through the first sensor, first gesture touch information of a first gesture to be identified, which is interacted with the steering wheel by a user;

the instruction generating module 20 is configured to generate a navigation map zoom instruction when it is determined that the first gesture to be recognized matches a preset navigation map zoom gesture based on the first gesture touch information.

Optionally, the vehicle further comprises a second sensor, and the instruction generating module 20 is further configured to:

acquiring a gesture image through the second sensor;

detecting whether the first gesture to be recognized is matched with a preset navigation map zooming gesture according to the first gesture touch information and the gesture image under the condition that the gesture image is matched with the first gesture touch information;

and generating a navigation map zoom instruction under the condition that the first gesture to be recognized is matched with a preset navigation map zoom gesture.

Optionally, the instruction generating module 20 is further configured to:

determining a target gesture from a preset gesture library based on the first gesture touch information and the gesture image through a preset gesture recognition algorithm;

and judging whether the target gesture is a navigation map zoom gesture.

Optionally, the preset navigation map zoom gesture includes a preset zoom-in map gesture and a preset zoom-out map gesture; the navigation map scaling instruction comprises an enlarged map control instruction and a reduced map control instruction; the instruction generation module 20 is further configured to:

generating an enlarged map control instruction under the condition that the first gesture to be recognized is determined to be matched with a preset enlarged map gesture based on the first gesture touch information;

and generating a zoom-out map control instruction under the condition that the first gesture to be recognized is determined to be matched with a preset zoom-out map gesture based on the first gesture touch information.

Optionally, the acquisition module 10 is further configured to:

acquiring second gesture touch information of a second gesture to be recognized, which is interacted by a user with the steering wheel, through the first sensor;

And under the condition that the second gesture to be recognized is determined to be matched with the preset wake-up gesture based on the second gesture touch information, acquiring first gesture touch information of a first gesture to be recognized, which is interacted with the steering wheel by a user, through the first sensor.

Optionally, the navigation map scaling device further includes a restoration module, after the operation of generating the navigation map scaling instruction in the case that the first gesture to be recognized is determined to match the preset navigation map scaling gesture based on the first gesture touch information, the restoration module is configured to:

The navigation map scaling device provided by the invention solves the technical problem of lower safety of navigation map scaling control in the driving process in the related technology by adopting the navigation map scaling method in the embodiment. Compared with the prior art, the beneficial effects of the navigation map scaling device provided by the embodiment of the invention are the same as those of the navigation map scaling method provided by the embodiment, and other technical features of the navigation map scaling device are the same as those disclosed by the method of the embodiment, so that details are not repeated.

Example IV

Further, an embodiment of the present invention provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the navigation map scaling method of the above-described embodiments.

Referring now to fig. 6, a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as bluetooth headsets, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), car terminals (e.g., car navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 6 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 6, the electronic device may include a processing means (e.g., a central processing unit, a graphic processor, etc.) that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) or a program loaded from a storage means into a Random Access Memory (RAM). In the RAM, various programs and arrays required for the operation of the electronic device are also stored. The processing device, ROM and RAM are connected to each other via a bus. An input/output (I/O) interface is also connected to the bus.

In general, the following systems may be connected to the I/O interface: input devices including, for example, touch screens, touch pads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices including, for example, liquid Crystal Displays (LCDs), speakers, vibrators, etc.; storage devices including, for example, magnetic tape, hard disk, etc.; a communication device. The communication means may allow the electronic device to communicate with other devices wirelessly or by wire to exchange arrays. While electronic devices having various systems are shown in the figures, it should be understood that not all of the illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from ROM. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by a processing device.

The electronic equipment provided by the invention solves the technical problem of lower safety of navigation map zoom control in the driving process in the related technology by adopting the navigation map zoom method in the embodiment. Compared with the prior art, the electronic device provided by the embodiment of the invention has the same beneficial effects as the navigation map zooming method provided by the embodiment, and other technical features in the electronic device are the same as the features disclosed by the method of the embodiment, and are not repeated here.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Example five

Further, the present embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the navigation map scaling method in the above-described embodiment.

The computer readable storage medium according to the embodiments of the present invention may be, for example, a usb disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this embodiment, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

The above-described computer-readable storage medium may be contained in an electronic device; or may exist alone without being assembled into an electronic device.

The computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to: acquiring first gesture touch information of a first gesture to be identified interacted between a user and a steering wheel through the first sensor; and generating a navigation map zoom instruction under the condition that the first gesture to be recognized is determined to be matched with a preset navigation map zoom gesture based on the first gesture touch information.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present disclosure may be implemented in software or hardware. Wherein the name of the module does not constitute a limitation of the unit itself in some cases.

The computer readable storage medium provided by the invention stores the computer readable program instructions for executing the navigation map scaling method, and solves the technical problem of lower safety of navigation map scaling control in the driving process in the related technology. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the embodiment of the invention are the same as those of the navigation map zooming method provided by the above embodiment, and are not described herein.

Example six

Further, the present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a navigation map scaling method as described above.

The computer program product solves the technical problem of low safety in the related art of navigation map zoom control in the driving process. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the invention are the same as those of the navigation map zooming method provided by the embodiment, and are not described in detail herein.

The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims.

Claims

1. The navigation map scaling method is characterized in that the navigation map scaling method is applied to a vehicle, a first sensor is arranged on a steering wheel of the vehicle, and the navigation map scaling method comprises the following steps:

2. The navigation map zoom method of claim 1, wherein the vehicle further comprises a second sensor, and wherein the step of generating the navigation map zoom instruction if the first gesture to be recognized is determined to match a preset navigation map zoom gesture based on the first gesture touch information comprises:

acquiring a gesture image through the second sensor;

3. The navigation map zooming method of claim 2, wherein the step of detecting whether the first gesture to be recognized matches a preset navigation map zooming gesture based on the first gesture touch information and the gesture image comprises:

and judging whether the target gesture is a navigation map zoom gesture.

4. The navigation map zoom method of claim 1, wherein the preset navigation map zoom gesture comprises a preset zoom-in map gesture and a preset zoom-out map gesture; the navigation map scaling instruction comprises an enlarged map control instruction and a reduced map control instruction;

5. The navigation map zoom method of claim 4, wherein the zoom-in map gesture comprises a gesture of holding the steering wheel with both hands while tapping the outside area of the steering wheel with both index fingers a first preset number of times within a preset first interval time;

6. The navigation map scaling method of claim 1, wherein the step of collecting first gesture touch information of a first gesture to be recognized for user interaction with a steering wheel by the first sensor comprises:

7. The method of claim 1, wherein after the step of generating a navigation map zoom instruction if the first gesture to be recognized is determined to match a preset navigation map zoom gesture based on the first gesture touch information, further comprising:

8. A navigation map scaling device, characterized in that the navigation map scaling device is applied to a vehicle, a first sensor is provided on a steering wheel of the vehicle, the navigation map scaling device comprises:

9. An electronic device, the electronic device comprising:

at least one processor; the method comprises the steps of,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the navigation map scaling method of any one of claims 1 to 7.

10. A storage medium, characterized in that the storage medium is a computer-readable storage medium, on which a program implementing a navigation map scaling method is stored, the program implementing the navigation map scaling method being executed by a processor to implement the steps of the navigation map scaling method according to any one of claims 1 to 7.