CN217543876U - Electronic system with shooting function and electronic equipment - Google Patents

Abstract

The utility model relates to an electronic system and electronic equipment with shoot function relates to electronic equipment technical field, and the electronic system with shoot function includes image acquisition device and neural network image processing chip, and image acquisition device and neural network image processing chip communication connection, image acquisition device transmit image information to neural network image processing chip. The electronic system with the shooting function is provided with the neural network image processing chip, the neural network image processing chip processes image information collected by the image collecting device, and compared with a system-level processor, the neural network image processing chip consumes less energy in the operation process and can continuously operate in a low-power-consumption state, so that the low-power-consumption electronic system with the sensing function is realized.

Description

Electronic system with shooting function and electronic equipment

Technical Field

The present disclosure relates to the field of electronic devices, and particularly to an electronic system with a shooting function and an electronic device.

Background

With the rapid development of technology, electronic devices become more and more intelligent. The perception camera can keep an awakening state all the time, and plays an important role in a scene needing real-time monitoring.

In the related art, when a sensing camera is in an awake state, some high-power processors in the sensing camera are also in the awake state, such as a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and the like, if the sensing camera is to be in a working state for a long time, a large amount of power consumption and computing resources are consumed.

SUMMERY OF THE UTILITY MODEL

To overcome the problems in the related art, the present disclosure provides an electronic system and an electronic apparatus having a photographing function.

In a first aspect of the embodiments of the present disclosure, an electronic system with a shooting function is provided, where the electronic system with a shooting function includes an image acquisition device and a neural network image processing chip, where the image acquisition device is in communication connection with the neural network image processing chip;

and the image acquisition device transmits image information to the neural network image processing chip.

Optionally, the electronic system with a shooting function is a camera module, the camera module includes an image acquisition device and a first processor, the image acquisition device is in communication connection with the first processor, and the neural network image processing chip is integrated in the first processor.

Optionally, the camera module further includes a first memory, and the first memory is in communication connection with the neural network image processing chip of the first processor.

Optionally, the camera module further includes a first transmission module, and the first transmission module is in communication connection with the image acquisition device and the neural network image processing chip of the first processor, respectively.

Optionally, the electronic system with a shooting function is a first electronic device, the neural network image processing chip is independently disposed on the first electronic device, and the image acquisition device is in communication connection with the neural network image processing chip.

Optionally, a second transmission module and a second storage module are integrated in the neural network image processing chip.

Optionally, the electronic system with the shooting function is a second electronic device, the second electronic device includes a system-on-chip, the neural network image processing chip is integrated on the system-on-chip, the image acquisition device is disposed in the second electronic device, and the image acquisition device is in communication connection with the system-on-chip.

Optionally, the system on chip integrates a third transmission module and a third storage module.

In a second aspect of the embodiments of the present disclosure, an electronic device is provided, where the electronic device includes an image acquisition device and a neural network image processing chip, and the image acquisition device is in communication connection with the neural network image processing chip.

In a third aspect of the embodiments of the present disclosure, an electronic device is provided, where the electronic device includes an image capturing device and a system on chip, the system on chip is integrated with a neural network image processing chip, and the image capturing device is in communication connection with the system on chip.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the electronic system with the shooting function is provided with the neural network image processing chip, the neural network image processing chip processes image information collected by the image collecting device, and compared with a system-level processor, the neural network image processing chip consumes less energy in the operation process and can continuously operate in a low-power-consumption state, so that the low-power-consumption electronic system with the sensing function is realized.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Fig. 1 is a schematic diagram illustrating an electronic system having a photographing function according to an exemplary embodiment.

Fig. 2 is a schematic diagram illustrating an electronic system having a photographing function according to an exemplary embodiment.

Fig. 3 is a schematic diagram illustrating an electronic system having a photographing function according to an exemplary embodiment.

Fig. 4 is a schematic diagram illustrating an electronic system having a photographing function according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

With the rapid development of technology, electronic devices become more and more intelligent. The perception camera can keep an awakening state all the time, and plays an important role in a scene needing real-time monitoring.

In the related art, when a sensing camera is in an awake state, some high-power processors in the sensing camera are also in the awake state, such as a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and the like, if the sensing camera is to be in a working state for a long time, a large amount of power consumption and computing resources are consumed.

In order to solve the above problem, the present disclosure provides an electronic system with a shooting function, where the electronic system with a shooting function includes an image acquisition device and a neural network image processing chip, the image acquisition device is in communication connection with the neural network image processing chip, and the image acquisition device transmits image information to the neural network image processing chip. The electronic system with the shooting function is provided with the neural network image processing chip, the neural network image processing chip processes image information collected by the image collecting device, and compared with a system-level processor, the neural network image processing chip consumes less energy in the operation process and can continuously operate in a low-power-consumption state, so that the low-power-consumption electronic system with the sensing function is realized.

According to an exemplary embodiment, as shown in fig. 1, this embodiment shows an electronic system with a shooting function, and the electronic system with a shooting function in this embodiment may be, for example, a face recognition system set at a cell gate, or a system for realizing self-service cash collection through image recognition.

The electronic system with the shooting function comprises an image acquisition device 1 and a neural network image processing chip 2, wherein the image acquisition device 1 is in communication connection with the neural network image processing chip 2, and the image acquisition device 1 transmits image information to the neural network image processing chip 2. The image capturing device 1 is configured to capture image information, and the image capturing device 1 may be a camera, for example. The neural network image processing chip 2 is used for processing the image information, and the processing process may be, for example, performing image recognition on the acquired image information or performing photosensitive recognition.

The Neural Network image Processing chip 2 in this embodiment, that is, a Neural-Network Processing Unit, is referred to as NPU for short, the Neural Network image Processing chip processes the image information received by the Neural Network image Processing chip by using a Neural Network algorithm stored therein, and a Neural Network model in the Neural Network image Processing chip 2 is pre-established and burned therein, which is good at performing pattern recognition Processing, and multimedia data of videos and images. The model of the neural network image processing chip 2 may be, for example, SUNNY _ M1 or SM8450.

Compared with a system-level processor, the neural network image processing chip 2 consumes less energy in the operation process, can work in a low-power consumption state for a long time, and has an extremely high energy efficiency ratio.

In addition, the electronic system with the shooting function may further include a power supply unit (not shown in the figure), and the image acquisition device 1 and the neural network image processing chip 2 may be respectively connected with the power supply unit; or, the image acquisition device 1 is electrically connected with the neural network image processing chip 2, and one of the image acquisition device 1 and the neural network image processing chip 2 is connected with the power supply unit so as to supply power to the other of the image acquisition device 1 and the neural network image processing chip 2.

Here, it should be noted that, the arrangement form of the image capturing device 1 and the neural network image processing chip 2 in this embodiment is not particularly limited, and the image capturing device 1 and the neural network image processing chip 2 may be arranged on one electronic device, and connected through wired communication; or the device can be arranged on different devices and connected with the two devices through wired communication or wireless communication. For example, the image capturing device 1 is disposed on a camera module, and the neural network image processing chip 2 is disposed on a mobile phone having the camera module.

Compared with a system-level processor, the neural network image processing chip consumes less energy in the operation process and can continuously operate in a low-power-consumption state, and the low-power-consumption electronic system with the sensing function and the shooting function is realized.

In an exemplary embodiment, as shown in fig. 1, the electronic system with a shooting function includes an image capturing device 1 and a neural network image processing chip 2, the image capturing device 1 is connected to the neural network image processing chip 2 in a communication manner, and the image capturing device 1 transmits image information to the neural network image processing chip 2.

In this embodiment, the electronic system with a shooting function is a camera module, and the camera module may be, for example, a mobile phone, a tablet computer, a graphic recognition system at a cell gate, a camera module on a two-dimensional code recognition system, or the like. The image acquisition device 1 and the neural network image processing chip 2 are both arranged on the same device, and the camera module has the functions of acquiring images and processing images. The camera module comprises an image acquisition device 1 and a first processor, wherein the image acquisition device 1 is in communication connection with the first processor, a neural network image processing chip 2 is integrated in the first processor, the first processor is an independent processor belonging to the camera module, and after the neural network image processing chip is integrated in the first processor, the first processor can rapidly and independently process images. Of course, it is understood that besides the neural network image processing chip 2, other functional chips, such as a chip with a control function, may be integrated on the first processor.

In this embodiment, the electronic system with the shooting function is an independent camera module, for example, a power supply may be built in the camera module or externally connected to the camera module, so that the image capturing device 1 and the neural network image processing chip 2 can be powered on to work, thereby implementing independent image capturing and independent image processing. The neural network image processing chip 2 has a high energy efficiency ratio, and thus can realize long-time image acquisition and processing. For example, the device can be used as a motion camera, a monitoring camera, a two-dimensional code recognition camera, a face recognition device and the like, and the user experience is improved due to longer endurance time and low power consumption.

Referring to fig. 1, the camera module further includes a first Memory 31, where the first Memory 31 is in communication connection with the first processor, and the first Memory 31 may be, for example, a Random Access Memory (RAM). By arranging the first memory 31 in the camera module, and the first memory 31 is in communication connection with the first processor, when the neural network image processing chip 2 of the first processor processes the image information of the image acquisition device 1, the processed image information can be output to the first memory 31, or the processed information is compared with the information prestored in the first memory 31, so as to realize the functions of face recognition and the like. The camera module provided by the embodiment can store image information without an external storage module, and improves portability and usability.

Wherein, referring to fig. 1, the camera module further includes a first transmission module 41, the first transmission module 41 is in communication connection with the image acquisition device 1 and the first processor, the first transmission module 41 is used for transmitting image information to other devices, and the other devices are convenient for a user to edit and check the image information, such as a computer and a smart phone. In one example, the first transmission module 41 can directly transmit the image information acquired by the image acquisition apparatus 1 to other devices, so that the other devices can quickly and directly obtain the image information directly acquired by the image acquisition apparatus 1. In another example, the first transmission module 41 can transmit the image information processed by the neural network image processing chip 2 integrated on the first processor to other devices, so that the device without image processing function can obtain the processed image information. In yet another example, the first transmission module 41 can send the image information in the first memory 31 to other devices, specifically, the neural network image processing chip 2 of the first processor retrieves the image information in the first memory 31 and transmits the retrieved image information to the first transmission module 41, and then the image information is sent to other devices via the first transmission module 41.

In a specific application scenario, the camera module in this embodiment is a face recognition device at a cell entrance, a face photo of a resident living in a cell is stored in the first memory 31 of the face recognition device, each time someone passes through the face recognition device, the image acquisition device 1 acquires the face image and sends the face image to the neural network image processing chip 2, the neural network image processing chip 2 adopts a neural network model to identify the face image, and judges whether the person passing through is a resident living in the cell, if so, the access control is opened.

In another specific application scenario, the camera module in this embodiment is a two-dimensional code recognition device, the image acquisition device 1 of the two-dimensional code recognition device acquires two-dimensional code images, the neural network image processing chip 2 identifies the acquired two-dimensional code images, determines the digital amount represented by the two-dimensional code images, and then transmits the digital amount to an external computer, and the external computer communicates with a server to collect money.

In an exemplary embodiment, as shown in fig. 2 and 3, the electronic system with a shooting function includes an image capturing device 1 and a neural network image processing chip 2, the image capturing device 1 is connected to the neural network image processing chip 2 in a communication manner, and the image capturing device 1 transmits image information to the neural network image processing chip 2. The image capturing device 1 may be, for example, a camera. Referring to fig. 2, the electronic system with a shooting function is a first electronic device 5, that is, the first electronic device has a shooting function, the neural network image processing chip 2 is independently disposed on the first electronic device 5, that is, the neural network image processing chip 2 is not integrated on another processor, and is disposed on the first electronic device 5 as an independent control chip, and the image capturing device 1 is in communication connection with the neural network image processing chip 2. The first electronic device 5 may be, for example, a doorbell, a sound, an intelligent desk lamp, etc. In this embodiment, referring to fig. 2 and fig. 3, the image acquisition device 1 and the neural network image processing chip 2 are used as two relatively independent parts, and by arranging the neural network image processing chip 2 in the first electronic device 5, other functional modules inside the first electronic device 5 can be in communication connection with the neural network image processing chip 2, so that the other functional modules can make subsequent feedback according to the processed image information.

In this embodiment, the image capturing device 1 may be disposed on the first electronic device 5, the image capturing device 1 may also be disposed separately from the first electronic device 5, but the image capturing device and the first electronic device 5 are in communication connection, and the first electronic device 5 may further have other functions, such as playing music, lighting, and the like, in addition to the image capturing and image processing functions. In an example, referring to fig. 2, an example in which the image capturing device 1 is disposed on the first electronic device 5 is shown, and by disposing the image capturing device 1 inside the first electronic device 5, when the main functions of the first electronic device 5 are not used, the image capturing device 1 and the neural network image processing chip 2 can always operate in a low power consumption state, so as to implement functions such as real-time monitoring, for example, when it is monitored that a preset condition occurs, the main functions of the first electronic device 5 are started.

In a specific scenario, the first electronic device 5 in this example is a desk lamp, and when the desk lamp is in an off state, the image capturing apparatus 1 and the neural network image processing chip 2 are continuously in an operating state. When in the evening, the image acquisition device 1 acquires external environment light, the neural network image processing chip 2 analyzes the environment light acquired by the image acquisition device 1, the brightness of the external environment is insufficient, at the moment, the neural network image processing chip 2 transmits a processing result to the control chip of the first electronic device 5, and the control chip controls the desk lamp to be lighted for illumination.

In another example, referring to fig. 3, a case is shown where the first electronic device 5 and the image capturing apparatus 1 are in a separate structure, and the image capturing apparatus 1 may be communicatively connected to the first electronic device 5 through a wired or wireless communication manner. First electronic equipment 5 can be for example the voice broadcast device, and is concrete, and image acquisition device 1 obtains image information to transmit image information to first electronic equipment 5's neural network image processing chip 2, after neural network image processing chip 2 detects that preset figure (for example people's face) appears in the image information, give the vocal unit with the voice broadcast instruction transmission, and the application scene is for example the entry of a certain office building, detects the people's face after, sends voice prompt such as body temperature detection.

As shown in fig. 2 and 3, the neural network image processing chip 2 is integrated with the second transmission module 42 and the second storage module 32. In this embodiment, the second storage module 32 is integrated in the neural network image processing chip 2, so that the neural network image processing chip 2 can process and store the image information acquired by the image acquisition device 1, or compare the processed image information with the pre-stored image in the second storage module 32, for example, a face recognition function is achieved. By integrating the second transmission module 42 in the neural network image processing chip 2, transmission of image information to the first electronic device 5 or other electronic devices, such as a smart phone, an alarm device, etc., is achieved.

In an exemplary embodiment, as shown in fig. 4, the electronic system with a shooting function includes an image capturing device 1 and a neural network image processing chip 2, the image capturing device 1 is connected to the neural network image processing chip 2 in a communication manner, and the image capturing device 1 transmits image information to the neural network image processing chip 2. Referring to fig. 4, the electronic system with the shooting function is the second electronic device 6, the second electronic device 6 includes a system-on-chip 61, the neural network image processing chip 2 is integrated on the system-on-chip 61, the image capturing device 1 is disposed on the second electronic device 6, and the image capturing device 1 is in communication connection with the system-on-chip 61. The second electronic device 6 may be, for example, a computer, a smartphone, or the like. In the electronic system with the shooting function provided by this embodiment, the image information collected by the image collecting device 1 is transmitted to the neural network image processing chip 2 on the system-on-chip 61 for image processing, and the neural network image processing chip 2 can perform artificial intelligence recognition to recognize human faces, two-dimensional codes, light intensity and the like. Specifically, for example, the functions of a light sensor, a distance sensor, and the like can be realized.

In this embodiment, referring to fig. 4, the neural network image processing chip 2 is integrated in the system on chip 61, but the power consumption of the neural network image processing chip 2 is low, and only a small amount of processing processes of the system on chip are occupied. The system-on-chip 61 has high power consumption, and if the system-on-chip 61 is frequently awakened, the electric quantity of the second electronic device 6 is additionally consumed, so that the cruising ability of the system-on-chip is affected.

Referring to fig. 4, the system on chip 61 further integrates the third transmission module 43 and the third storage module 33. In this embodiment, the third storage module 33 is integrated in the system-on-chip 61, so that the image information processed by the neural network image processing chip 2 can be stored in the third storage module 33, and the processing and storage of the image information can be realized without waking up the system-on-chip 61, thereby reducing power consumption. By integrating the third transmission module 43 in the system-on-chip 61, the image information processed by the neural network image processing chip 2 can be transmitted outward quickly without waking up the system-on-chip 61, thereby reducing power consumption. In this embodiment, the third transmission module 43 may be, for example, a low power consumption network Service Provider (Internet Service Provider, ISP for short), and when the second electronic device 6 transmits the image information to the outside through the third transmission module 43, the low power consumption is maintained.

The embodiment of the disclosure further provides an electronic device, which includes an image acquisition device and a neural network image processing chip, wherein the image acquisition device is in communication connection with the neural network image processing chip. It is understood that the electronic device provided in the present embodiment is the first electronic device mentioned in the above embodiments. The first electronic device has been explained in the above embodiments, and details are not repeated here. The electronic device in the present embodiment may be, for example, a device such as a desk lamp or a sound device which does not have a system level processing chip, but may be an electronic device provided with a neural network image processing chip.

The embodiment of the disclosure further provides electronic equipment, which includes an image acquisition device and a system-on-chip, wherein the system-on-chip is integrated with the neural network image processing chip, and the image acquisition device is in communication connection with the system-on-chip and further in communication connection with the neural network image processing chip. It is understood that the electronic device provided in the present embodiment is the second electronic device mentioned in the above embodiments. The second electronic device may be, for example, a mobile phone, a tablet computer, a notebook computer, or other electronic devices with a system on chip.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims (10)

1. An electronic system with a shooting function is characterized by comprising an image acquisition device and a neural network image processing chip, wherein the image acquisition device is in communication connection with the neural network image processing chip;

and the image acquisition device transmits image information to the neural network image processing chip.

2. The electronic system with shooting function of claim 1, wherein the electronic system with shooting function is a camera module, the camera module comprises an image capturing device and a first processor, the image capturing device is connected to the first processor in communication, and the neural network image processing chip is integrated with the first processor.

3. The electronic system with shooting function of claim 2, wherein the camera module further comprises a first memory, the first memory is in communication connection with the neural network image processing chip of the first processor.

4. The electronic system with shooting function of claim 2, wherein the camera module further comprises a first transmission module, the first transmission module is respectively connected with the image acquisition device and the neural network image processing chip of the first processor in communication.

5. The electronic system with shooting function of claim 1, wherein the electronic system with shooting function is a first electronic device, the neural network image processing chip is independently disposed on the first electronic device, and the image capturing device is communicatively connected to the neural network image processing chip.

6. The electronic system with shooting function of claim 5, wherein the neural network image processing chip integrates a second transmission module and a second storage module.

7. The electronic system with shooting function of claim 1, wherein the electronic system with shooting function is a second electronic device, the second electronic device includes a system-on-chip, the system-on-chip integrates the neural network image processing chip, the image capturing device is disposed on the second electronic device, and the image capturing device is in communication connection with the system-on-chip.

8. The electronic system with photographing function of claim 7, wherein the system-on-chip integrates a third transmission module and a third storage module.

9. The electronic equipment is characterized by comprising an image acquisition device and a neural network image processing chip, wherein the image acquisition device is in communication connection with the neural network image processing chip.

10. The electronic equipment is characterized by comprising an image acquisition device and a system-on-chip, wherein a neural network image processing chip is integrated on the system-on-chip, and the image acquisition device is in communication connection with the system-on-chip.

Images