WO2019161559A1

WO2019161559A1 - Image acquisition method, system, electronic device and computer program product

Info

Publication number: WO2019161559A1
Application number: PCT/CN2018/077195
Authority: WO
Inventors: 王敏; 刘兆祥; 廉士国
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2018-02-26
Filing date: 2018-02-26
Publication date: 2019-08-29
Also published as: CN108401496A

Abstract

An image acquisition method and system, an electronic device and a computer program product. The method comprises: receiving a user instruction; selecting one from among a plurality of image acquisition modules according to the user instruction, wherein each image acquisition module corresponds to a different focal distance; acquiring an image by means of the selected image acquisition module. The present application acquires images by means of acquiring a user instruction and selecting a corresponding focal distance according to the user instruction, thus intelligently achieving the acquisition of images of different scenes far and near, and having the characteristics of strong universality, flexibility and convenience, thereby facilitating the blind in identifying surroundings.

Description

Image acquisition method, system, electronic device and computer program product

Technical field

The present application relates to the field of image acquisition, and in particular, to an image acquisition method, system, electronic device, and computer program product.

Background technique

The cloud robot is an intelligent robot that puts the cognitive system in the cloud, the body, the drive and the sensor are placed on the robot body, and connects the two through mobile communication; the cloud robot is the development direction of the intelligent humanoid robot.

In today's information age, blind people's cognitive needs for surrounding information are also growing. At present, the equipment for solving blind people's information is mainly based on equipment such as eyes, helmets and blinds. However, the information provided by the blind cane is limited; the helmet can be integrated with many functions including navigation obstacle avoidance, but it is slightly cumbersome for information accessibility. Existing smart glasses devices generally only have a single function of telephoto or short focus, and the image capture module capable of fast zooming is relatively expensive, relatively large in size, and not portable enough. And in the process of far and near focus conversion, it is easy to cause the captured image to be blurred.

Application content

In view of this, the embodiments of the present application are intended to provide an image acquisition method, system, electronic device, and computer program product, so as to solve the problem that the image acquisition process existing in the prior art cannot fully adapt to the near-far scene.

To achieve the above objective, the technical solution of the embodiment of the present application is implemented as follows:

A first aspect of the embodiments of the present application provides an image collection method, where the method includes:

Receiving user instructions;

Selecting one of the plurality of image acquisition modules according to the user instruction, wherein each image acquisition module corresponds to a different focal length;

Images are acquired by the selected image acquisition module.

A second aspect of the embodiments of the present application provides an electronic device, including: a display, a memory, one or more processors; and one or more modules, the one or more modules being stored in the And in the memory, configured to be executed by the one or more processors, the one or more modules comprising instructions for performing the various steps in the image acquisition method of the first aspect of the embodiments of the present application.

A third aspect of embodiments of the present application provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions When executed by a computer, the computer is caused to perform various steps in the image acquisition method according to the first aspect of the embodiments of the present application.

A fourth aspect of the present application provides an image acquisition system, where the system includes an image acquisition device and a selection acquisition device. The image collection device is provided with a plurality of image acquisition modules, and each image acquisition module corresponds to a different image. Focal length, the selection acquisition device is used to select an image acquisition module, and collect images through the selected image acquisition module.

The application acquires the user instruction and selects the corresponding focal length according to the user instruction to collect the image, thereby intelligently realizing image collection of different scenes in the near and far, which is universal, flexible and convenient, and is beneficial to the blind person's perception of the surrounding world.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawing:

1 is a flowchart of an image collection method according to an embodiment of the present application;

2 is a schematic diagram of an image acquisition system according to an embodiment of the present application;

FIG. 3 is a flowchart of the operation of the image collection system according to the embodiment of the present application.

Detailed ways

The exemplary embodiments of the present application are further described in detail below with reference to the accompanying drawings. Not all embodiments are exhaustive. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

Example 1

As shown in FIG. 1 , this embodiment provides an image collection method, where the method includes:

S101. Receive a user instruction, and select one of the plurality of image acquisition modules according to the user instruction.

Specifically, the image collection method described in this embodiment is applicable to a background server or a cloud server, or a combination of a server and an intelligent terminal. By obtaining user instructions, the actual needs of the user for image acquisition can be known. Because the distance between the image to be collected and the distance between the people is different, the corresponding image acquisition module is selected to perform targeted image acquisition, thereby ensuring adaptation to the near and far scenes.

For ordinary people, due to the normal senses, conventional physical devices such as mobile phones, tablets, watches, etc. can be used to directly collect images from the front through the senses. For special people, such as blind people, due to their limited physical structure, they cannot directly know the scene in front, and they need to use other tools or equipment to take photos or images. This requires equipment that can help blind people find directions. The rotation of the head can be directly regarded as the direction that the blind person needs to know about the front environment. Therefore, for the blind person, a portable eye, a hat, a helmet, and the like can be used as a physical device for image acquisition. In addition, a plurality of image acquisition modules are disposed on the physical device, and each image acquisition module corresponds to a different focal length. In order to carry out targeted acquisition of images of different distances.

Further, the embodiment provides the user with a plurality of alternative instructions, including an image acquisition mode instruction and an identification object selection instruction. The conventional telephoto and short focus acquisition modes respectively receive and acquire the two instructions. Introduce:

(1) receiving an image acquisition mode instruction, the image acquisition mode instruction includes a distant view mode or a close-up mode; matching the focal length of the acquired image according to the image acquisition mode instruction, and selecting a corresponding image acquisition module according to the matched focal length.

The process described in this manner is a process of mainly interacting with the smart terminal, that is, the user may input an image acquisition mode instruction according to an APP application associated with the physical device in the smart terminal, where the image acquisition mode includes a distant view mode or a close-range mode. . The image acquisition is performed by controlling the corresponding focal length after receiving the distant mode or the close-up mode. The telephoto mode corresponds to the telephoto image acquisition module; the close-up mode corresponds to the short-focus image acquisition module. For normal users, it can be displayed to the user by comparing the display modes in the conventional existing APP application, and the user can directly select the image collection mode to be selected by hand touch. For blind users, the command can be selected by voice or other means. The significance of the near view mode and the distant view mode is not only that the targeted image acquisition can be realized, but also the cloud server can only control the telephoto image acquisition module or the short focus image acquisition module when the user selects the close view mode or the distant view mode. Perform image acquisition to reduce the power consumption of physical devices.

(2) receiving an identification object selection instruction, the identification object selection includes face recognition, character recognition, graphic recognition or identification recognition; matching the focal length of the collected image according to the identification object selection instruction, and selecting corresponding according to the matched focal length Image acquisition module.

The process described in mode (1) is mainly introduced from the selection image acquisition mode, and the process described in mode (2) is from the perspective of image acquisition function. The method (2) can be directly used as a means for specifying recognition of a specific object in an image in practical applications. The identification object selection includes one or more of face recognition, character recognition, graphic recognition, or logo recognition. The presentation of the selection of the recognition object is the same as the presentation of the image collection mode in the mode (2), and the selection process is also substantially the same. For the blind user, the selection of the identification object may be selected by voice or other means, so that the cloud server selects the focal length corresponding to the identification object to collect the image, and performs targeted recognition on the image to avoid other interference items. It can alleviate the complicated recognition process of the cloud server to some extent.

The above two methods can realize the process of selecting the image acquisition module corresponding to the focal length for acquisition, and at the same time, in order to utilize the resources more rationally and meet the actual needs of the user, the camera of the smart terminal can be used as the short-focus camera.

S102. Acquire an image by using the selected image acquisition module.

Specifically, in step S101, the corresponding focal length has been selected by the user to perform image collection, and then the entity device responsible for acquiring the image sends the collected image to the cloud server for identification.

If the blind person needs to perceive distant information such as shop name and traffic signal, the blind person will send the command of the remote mode and select the object to be identified. The cloud server will automatically assume that the user wants to collect the distant image, then it will control The telephoto image acquisition module in the physical device performs image acquisition on the distant scene, and then sends the collected image to the cloud server, and then the cloud server identifies the collected image and accurately identifies the object to be recognized by the user.

Correspondingly, if the blind person needs to collect close-up images such as menus, books, coins, etc., the blind person will send the instructions of the close-up mode and select the object to be identified, and the cloud server will automatically assume that the user wants to collect the near-image. Then, the short-focus image acquisition module in the physical device is controlled to perform image acquisition on the near scene, and then the collected image is sent to the cloud server, and then the collected image is recognized by the cloud server, and the user is identified. Object.

S103, identifying the collected image.

There is no improvement in the image acquisition process in the image acquisition method described in this embodiment. The image recognition process is set in the background server or the cloud server. When the background server or the cloud server receives the identification object selection instruction sent by the user, the collected image is identified according to the specific object to be identified by the instruction.

In addition, for a normal person, if the image information is recognized, it can be directly notified in the form of text or voice, but for the blind person, the text does not work, and the transmission of the Braille is difficult to implement. Therefore, in this embodiment, the recognized image information is converted into non-visual notification information, and then the blind person is notified, and the non-visualized notification information may be voice or bone conduction information or the like.

Example 2

The embodiment provides an electronic device, the electronic device comprising: a display, a memory, one or more processors; and one or more modules, the one or more modules being stored in the memory, and It is configured to be executed by the one or more processors, the one or more modules comprising instructions for performing the various steps in the method of embodiment 1.

Example 3

The present embodiment provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer The computer is caused to perform the various steps in the method described in embodiment 1.

Example 4

As shown in FIG. 2, the embodiment provides an image acquisition system, where the system includes an image acquisition device and a selection acquisition device, and the image acquisition device is provided with a plurality of image acquisition modules, and each image acquisition module corresponds to The different focus distances, the selection acquisition device is used to select an image acquisition module, and the image is acquired by the selected image acquisition module.

Specifically, the selection collection device described in this embodiment can obtain the actual requirement of the user for image collection by acquiring a user instruction. Because the distance between the image to be collected and the distance between the people is different, the corresponding image acquisition module is selected to perform targeted image acquisition, thereby ensuring adaptation to the near and far scenes.

Further, the image capturing device includes an image capturing device, and the image capturing device is provided with a plurality of image capturing modules, and each of the image capturing modules corresponds to a different focal length.

The selection collection device includes an application module and a cloud server disposed in the smart terminal, where the application module is configured to receive a user instruction, and send the user instruction to a cloud server, where the cloud server is implemented as the present application. The electronic device described in Example 2.

Further, as shown in FIG. 3, the embodiment provides the user with a plurality of alternative instructions, including an image acquisition mode instruction and an identification object selection instruction. The following two methods of conventional telephoto and short focus acquisition are used. The receiving and collecting of instructions are introduced separately:

The process described in this manner is a process of mainly interacting with the smart terminal, that is, the user may input an image acquisition mode instruction according to an APP application associated with the physical device in the smart terminal, where the image acquisition mode includes a distant view mode or a close-range mode. . The image acquisition is performed by controlling the corresponding focal length after receiving the distant mode or the close-up mode. The telephoto mode corresponds to the telephoto image acquisition module; the close-up mode corresponds to the short-focus image acquisition module. For normal users, it can be displayed to the user by comparing the display modes in the conventional existing APP application, and the user can directly select the image collection mode to be selected by hand touch. For blind users, the commands can be selected by voice or other means. The significance of the near view mode and the distant view mode is not only that the targeted image acquisition can be realized, but also the cloud server can only control the telephoto image acquisition module or the short focus image acquisition module when the user selects the close view mode or the distant view mode. Perform image acquisition to reduce the power consumption of physical devices.

Correspondingly, if the blind person needs to collect close-up images such as menus, books, coins, etc., the blind person will send the instructions of the close-up mode and select the object to be identified, and the cloud server automatically assumes that the user wants to collect the near-image. Then, the short-focus image acquisition module in the physical device is controlled to perform image acquisition on the near scene, and then the collected image is sent to the cloud server, and then the collected image is recognized by the cloud server, and the user is identified. Object.

In addition, for normal people, if the image information is recognized, it can be directly notified by text or voice, but for blind people, the text does not work, and the transmission of Braille is difficult to achieve. Therefore, in this embodiment, the recognized image information is converted into non-visual notification information, and then the blind person is notified, and the non-visualized notification information may be voice or bone conduction information or the like.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the present application has been described, it will be apparent that those skilled in the art can make further changes and modifications to the embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It will be apparent to those skilled in the art that various modifications and changes can be made in the present application without departing from the spirit and scope of the application. Thus, it is intended that the present invention cover the modifications and variations of the present invention.

Claims

An image collection method, the method comprising:

Receiving user instructions;

Selecting one of the plurality of image acquisition modules according to the user instruction, wherein each image acquisition module corresponds to a different focal length;

Images are acquired by the selected image acquisition module.
The method according to claim 1, wherein the receiving a user instruction to select one of the plurality of image acquisition modules according to the user instruction comprises:

Receiving an image acquisition mode instruction, the image acquisition mode instruction includes a distant view mode or a close-up mode;

And matching the focal length of the acquired image according to the image acquisition mode instruction, and selecting a corresponding image acquisition module according to the matched focal length.
The method according to claim 1 or 2, wherein the receiving a user instruction to select one of the plurality of image acquisition modules according to the user instruction comprises:

Receiving an identification object selection instruction, the identification object selection including face recognition, character recognition, graphic recognition or logo recognition;

And matching the focal length of the acquired image according to the identification object selection instruction, and selecting a corresponding image acquisition module according to the matched focal length.
The method according to any one of claims 1 to 3, wherein the image acquisition module comprises a smart device own camera.
An electronic device, comprising: a display, a memory, one or more processors; and one or more modules, the one or more modules being stored in the memory and being Configured to be executed by the one or more processors, the one or more modules comprising instructions for performing the various steps of the method of any of claims 1 to 3.
A computer program product, comprising: a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, The computer is caused to perform the various steps in the method of any one of claims 1 to 3.
An image acquisition system, comprising: an image acquisition device and a selection acquisition device, wherein the image acquisition device is provided with a plurality of image acquisition modules, and each image acquisition module corresponds to a different focal length, the selection The acquisition device is configured to select an image acquisition module and collect images through the selected image acquisition module.
The system of claim 7, wherein the image acquisition device comprises an image acquisition device, the image acquisition device is provided with a plurality of image acquisition modules, and each of the image acquisition modules corresponds to a different focal length.
The system according to claim 7, wherein the image acquisition device comprises an image acquisition device and an intelligent terminal, wherein the image acquisition device is provided with at least one image acquisition module, and the smart terminal is provided with an image acquisition And a focal length of the image acquisition module disposed on the image acquisition device is different from a focal length of the image acquisition module disposed on the smart terminal.
The system according to any one of claims 7 to 9, the selection acquisition device being the electronic device of claim 6.
The system according to claim 7, wherein the selection collection device comprises an application module and a cloud server disposed in the smart terminal, the application module is configured to receive a user instruction, and send the user instruction to a cloud server, The cloud server is the electronic device of claim 6.