WO2020062263A1 - Box device, method, and system for use in image recognition, and storage medium - Google Patents

Box device, method, and system for use in image recognition, and storage medium Download PDF

Info

Publication number
WO2020062263A1
WO2020062263A1 PCT/CN2018/109143 CN2018109143W WO2020062263A1 WO 2020062263 A1 WO2020062263 A1 WO 2020062263A1 CN 2018109143 W CN2018109143 W CN 2018109143W WO 2020062263 A1 WO2020062263 A1 WO 2020062263A1
Authority
WO
WIPO (PCT)
Prior art keywords
processor
box device
image
ethernet
image recognition
Prior art date
Application number
PCT/CN2018/109143
Other languages
French (fr)
Chinese (zh)
Inventor
崔志良
彭浩
汪润桂
Original Assignee
北京比特大陆科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京比特大陆科技有限公司 filed Critical 北京比特大陆科技有限公司
Priority to CN201880001909.5A priority Critical patent/CN109328357A/en
Priority to PCT/CN2018/109143 priority patent/WO2020062263A1/en
Publication of WO2020062263A1 publication Critical patent/WO2020062263A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks

Definitions

  • the present application relates to the field of image recognition technology, for example, to a box device, method, system, and storage medium for image recognition.
  • the server consists of a large number of boards to form a complete machine, which is large in size, large in power consumption, high in cost, and difficult to handle.
  • Most of the servers currently used for image recognition processing use graphics processors (Graphics Processing Uni, referred to as GPU). GPU is not a special processor for image recognition. Its image recognition efficiency is low and accuracy is poor.
  • the wiring of the GPU in the server is more complicated, requiring more physical space, resulting in a large server volume.
  • the present application provides a box device, method, system, and storage medium for image recognition, which are used to reduce the size and cost of the image recognition device, while improving the efficiency and accuracy of image recognition and reducing energy consumption.
  • a first aspect of the embodiments of the present application provides a box device for image recognition, including:
  • a housing which is provided with a first Ethernet port, a processor for neural network operations, and a high-speed memory, wherein the processor includes an Ethernet data receiving circuit;
  • the high-speed memory is connected to the processor and is used to store data of the processor, the first Ethernet port is connected to an Ethernet data receiving circuit in the processor, and the first Ethernet The port directly transmits the image acquired by the image acquisition device to the processor for image recognition processing through the Ethernet data receiving circuit.
  • a second aspect of the embodiments of the present application provides an image recognition system, including: one or more image acquisition devices, a router, and the box device according to the first aspect;
  • the one or more image acquisition devices transmit the acquired images to the router, and the router transmits the received images to the box device, so that the box device can The image is subjected to image recognition processing.
  • a third aspect of the embodiments of the present application provides an image recognition method for a box device.
  • the box device includes a casing, and a first Ethernet port is provided in the casing for neural network operations.
  • a high-speed memory wherein the processor includes an Ethernet data receiving circuit, the high-speed memory is connected to the processor, and is configured to store data of the processor, and the first Ethernet port is connected to all The Ethernet data receiving circuit connection in the processor is described.
  • the method includes:
  • the first Ethernet port acquires an image acquired by an image acquisition device, and sends the image to an Ethernet data receiving circuit in the processor to transmit the image to the Ethernet through the Ethernet data receiving circuit.
  • the processor performs image recognition processing on the received image based on a preset neural network model to obtain a recognition result.
  • a fourth aspect of the embodiments of the present application provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are configured to execute the method of the third aspect.
  • An embodiment of the present application further provides a computer program product.
  • the computer program product includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions.
  • the program instructions When the program instructions are executed by a computer, The computer executes the method of the third aspect described above.
  • FIG. 1 is a schematic diagram of an image recognition scene provided by the prior art
  • FIG. 2 is a schematic structural diagram of a box device for image recognition according to an embodiment of the present application.
  • FIG. 3 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of still another box device for image recognition according to an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of still another box device for image recognition according to an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of an image recognition system according to an embodiment of the present application.
  • step 102 is a flowchart of an implementation manner of step 102 according to an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG. 1 is a schematic diagram of an image recognition scene provided by the prior art.
  • FIG. 1 includes an image acquisition device 10 and a server 11 that can be used to perform image recognition processing.
  • the server 11 includes multiple boards 111, and one or more boards may be provided in the multiple boards 111.
  • There is GPU112 for image processing (only the scene where the GPU is set on one board is shown in Figure 1), and the processors set on the other boards are used to implement other preset functions, which makes the internal design comparison of server 11 Redundant, bulky and difficult to handle.
  • the image acquisition device 10 transmits the acquired image data to the network card 113, and the network card 113 forwards the image data to the bus interface (PCIE) 114, and then the PCIE 114 forwards the image data to the GPU 112 for processing.
  • PCIE bus interface
  • GPU112 is a general-purpose processor with weak data processing capability. When performing a large number of ALU operations, GPU112 needs to access memory 115 to read and save intermediate calculation results, and it takes more energy to access memory 115.
  • the GPU 112 occupies the internal physical space of the server, which is also one of the important factors that cause the server 11 to be bulky.
  • an embodiment of the present application provides a box device for image recognition processing.
  • the box device is provided with an integrated circuit (ASIC) processor dedicated to artificial intelligence (AI) acceleration.
  • ASIC integrated circuit
  • AI artificial intelligence
  • This processor is not a general-purpose processor, but a processor dedicated to neural network operations. It can provide a large number of multiplication and addition operations for neural networks. At the same time, it has fast processing speed, high accuracy, low energy consumption, and occupied physics.
  • the space is also relatively small, and the image recognition processing is integrated on a single board through a combination of a processor dedicated to neural network operations and a high-speed memory.
  • the single board has a low cost and a small size, which makes the above box
  • the device can be miniaturized and easy to carry, and by using a mode combining a processor and a high-speed memory, the data throughput capacity of the box device can be increased, and the efficiency and accuracy of image recognition of the box device can be improved.
  • FIG. 2 is a schematic structural diagram of a box device for image recognition according to an embodiment of the present application.
  • the box device 20 includes a housing 200, and a first Ethernet is provided in the housing 200.
  • Port 210 a processor 220 for a neural network operation (such as a tensor computing processor or a matrix processor, but not limited to a tensor computing processor or a matrix processor), and a high-speed memory 230 (such as DDR, but not limited to DDR).
  • a processor 220 for a neural network operation such as a tensor computing processor or a matrix processor, but not limited to a tensor computing processor or a matrix processor
  • a high-speed memory 230 such as DDR, but not limited to DDR.
  • the processor 220 includes an Ethernet data receiving circuit 221.
  • the high-speed memory 230 is connected to the processor 220 for storing data of the processor 220.
  • the first Ethernet port 210 is connected to the Ethernet data receiving circuit 221.
  • the first Ethernet The network port 210 directly transmits the image acquired by the image acquisition device (not shown in FIG. 2) to the processor 220 through the Ethernet data receiving circuit 221 for image recognition processing.
  • the housing 200 may also include a network card, and the processor may further include a circuit having a PCIE function.
  • the first Ethernet port 210 may transmit data to the processor through the network card and the PCIE circuit. 220.
  • the box device 20 in this embodiment includes only one board (not shown in FIG. 2), and the processor 220 and the high-speed memory 230 are provided on the board.
  • the box device 20 may also include multiple boards, and each board may use the same or similar device setting mode as the above setting mode.
  • the first Ethernet port is respectively connected to a processor on each board card, so that the processors on multiple board cards cooperate to perform image recognition processing, so as to meet a higher image recognition processing rate requirement.
  • the high-speed memory 230 in this embodiment may be specifically DDR4, and in a possible implementation manner, the housing 200 may further include one or more of the following memories: SPI flash , EMMC, SD card.
  • FIG. 3 is a schematic structural diagram of another box device for image recognition provided in the embodiment of the present application. As shown in FIG. 3, based on FIG. 2, the housing 200 also includes SPI flash 231, EMMC 232, DDR4 233 and SD card 234.
  • SPI flash 231 can provide storage support for the initialization data of the box device 20
  • EMMC 232 can be used to provide storage support for driving the bottom service of the box device 20
  • DDR4 233 can be used to provide storage space for the image data that the processor 220 needs to process
  • the SD card 234 can be used to store structured data required by the user, and to upgrade and restore the system of the box device 20.
  • FIG. 4 is a schematic structural diagram of still another box device for image recognition according to an embodiment of the present application.
  • FIG. 4 further includes an MCU 240 on the basis of the embodiment in FIG. 3.
  • the MCU 240 is connected to the processor 220 and is used to control the startup or shutdown of the processor 220 and monitor the temperature of the processor 220. For example, in a possible implementation manner, the temperature of the processor 220 may be monitored in real time through the MCU 240.
  • the control processor 220 When the temperature of the matrix 220 is detected to exceed the dangerous temperature preset threshold, or the time exceeding the dangerous temperature preset threshold exceeds the preset time If the time is set, the control processor 220 is turned off to avoid danger. When the temperature of the processor falls below a preset threshold of the dangerous temperature, the control processor 220 is started.
  • the MCU 240 can also perform fault detection on the processor 220 such as overvoltage, undervoltage, overtemperature, and overcurrent, and detect An alarm is issued when a failure occurs.
  • FIG. 5 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application.
  • the radiator 250 is connected to the MCU 240.
  • the MCU 240 controls the rotation speed of the fan on the heat sink 250 according to the temperature of the processor 220.
  • the implementation manner of controlling the fan speed according to the temperature of the processor 220 can be set as required, which is not specifically limited in this embodiment.
  • FIG. 6 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application. As shown in FIG. 6, based on the embodiment of FIG.
  • the box device 20 includes a low-pressure linear The voltage regulator (LDO) circuit 260 and the DC-DC circuit 270, the input power of the box device 20 is subjected to the step-down processing of the LDO circuit 260 to be the MCU 240, the clock module of the box device 20 ( Figure 6) (Not shown), the PLL module supplies power, and the LDO circuit 260 can ensure the stability of the power supply, preventing a voltage drop in the power supply due to excessive power consumption during neural network operations, which affects power supply stability.
  • the input power of the box device 20 supplies power to the processor 220 and other devices in the box device after the voltage reduction processing of the DC-DC circuit 270.
  • the DC-DC circuit 270 provided in this embodiment includes an LC filter constructed by a large-capacity capacitor having a capacity larger than a preset threshold and a high-impedance anti-magnetic bead having an impedance higher than a preset impedance.
  • the DC-DC circuit 270 will provide the processor 220 and the high-speed memory. Power supply can alleviate undershoot and improve power supply stability.
  • an external expansion button and / or an indicator light 280 may be provided on the box device 20 to perform human-computer interaction and improve the user's interactive experience.
  • the processor 220 may also transmit the recognition result to the first Ethernet port 210, and send the recognition result to the remote via the first Ethernet port 210.
  • Terminal devices 60 such as mobile phones and other electronic devices, APPs, web pages, cloud platforms, etc.
  • the box device 20 in this embodiment can be applied to scenarios such as gate face recognition, face payment, concert effect feedback, suspect investigation, traffic accident judgment, unmanned sales, flow statistics, AI anti-theft, and attendance And realize image-based face recognition, expression recognition, age recognition, vehicle recognition, location information recognition, license plate number recognition, color recognition, product recognition and other functions. It has the advantages of small and convenient, diverse use scenarios, powerful functions and so on.
  • a processor dedicated to neural network operations is used in the box device to replace the existing GPU with poor image recognition efficiency and accuracy
  • a high-speed memory is used to replace the currently generally low throughput.
  • Memory so that the cooperation between the processor and the high-speed memory can improve the throughput of the box device to the image data, and even realize the efficient processing of the box device to the image data input from the multi-channel image acquisition device, and for image recognition
  • the processor has stronger processing efficiency and accuracy than the GPU, so that this embodiment can also improve the image recognition efficiency and accuracy of the box device.
  • the processor in the box device provided in this embodiment includes an Ethernet data receiving circuit
  • the image acquisition device outside the box can directly receive the data through the first Ethernet port and the Ethernet data receiving circuit in the processor.
  • the acquired image is passed to the processor without being forwarded by the network card, so the power consumption caused by the network card part can be reduced, the volume of the box device is reduced, and the box device is more lightweight and compact.
  • FIG. 7 is a schematic structural diagram of an image recognition system according to an embodiment of the present application.
  • the system includes one or more image acquisition devices 70, a router 71, and the box device 20 according to the foregoing embodiment.
  • one or more image acquisition devices 70 transmit the acquired images to the router 71, and the router 71 transmits the received images to the box device 20, so that the box device 20 images the images
  • the recognition process and after obtaining the recognition result, sends the recognition result to the router 71 through the first Ethernet port, and the router 71 sends the recognition result to the remote terminal device 60 in a wired or wireless manner.
  • An embodiment of the present application provides an image recognition method.
  • the method is applicable to the box device described in the foregoing embodiment.
  • the method includes:
  • Step 101 The first Ethernet port acquires an image acquired by an image acquisition device, and sends the image to an Ethernet data receiving circuit in the processor, so as to transmit the image through the Ethernet data receiving circuit. To the processor.
  • Step 102 The processor performs image recognition processing on the received image based on a preset neural network model to obtain a recognition result.
  • FIG. 8 is a flowchart of an implementation manner of step 102 provided in the embodiment of the present application.
  • step 102 may include the following steps:
  • Step 1021 The processor performs decoding processing on the received image, and performs a preset image preprocessing operation on the image obtained after the decoding processing to obtain a standard image.
  • the image pre-processing operation involved in this embodiment may be preset according to requirements. For example, in some possible embodiments, at least one of the following processing operations may be performed on the decoded image: normalization processing, geometry Correction processing, histogram equalization processing, light compensation processing, gray-scale transformation processing, filtering processing, sharpening processing.
  • Step 1022 The processor performs image recognition processing on the standard image based on a preset neural network model to obtain a recognition result.
  • the neural network model involved in this embodiment is obtained by training in advance according to a specific recognition scenario.
  • An exemplary expression is that the processor performs feature extraction processing on a standard image based on a preset neural network model to obtain feature information of the standard image; and performs image recognition processing on the standard image based on the feature information of the standard image to obtain a recognition result.
  • the processor needs to extract the facial feature information of the task in the image based on a preset neural network model. Further, the extracted facial feature information and The pre-selected stored task facial feature information is matched to determine the identity of the person in the image.
  • the explanation is only based on the face recognition scene as an example, and is not the only limitation on this application.
  • the processor may also send the recognition result to the remote terminal device through the first Ethernet port, thereby remotely monitoring the recognition result.
  • An embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are configured to execute the method performed by the foregoing embodiments.
  • An embodiment of the present application further provides a computer program product.
  • the computer program product includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions.
  • the program instructions When the program instructions are executed by a computer, The computer executes the method performed by the above embodiment.
  • the computer-readable storage medium described above may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.
  • An embodiment of the present application further provides an electronic device, whose structure is shown in FIG. 9.
  • the electronic device includes:
  • At least one processor 100, and one processor 100 is taken as an example in FIG. 10; and the memory 101 may further include a communication interface 102 and a bus 103. Among them, the processor 100, the communication interface 102, and the memory 101 can complete communication with each other through the bus 103.
  • the communication interface 102 may be used for information transmission.
  • the processor 100 may call a logic instruction in the memory 101 to execute the method performed by the foregoing embodiment.
  • logic instructions in the memory 101 can be implemented in the form of software functional units and sold or used as an independent product, and can be stored in a computer-readable storage medium.
  • the memory 101 is a computer-readable storage medium and can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of the present application.
  • the processor 100 executes functional applications and data processing by running software programs, instructions, and modules stored in the memory 101, that is, implementing the image recognition method in the foregoing method embodiment.
  • the memory 101 may include a storage program area and a storage data area, where the storage program area may store an operating system and application programs required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like.
  • the memory 101 may include a high-speed random access memory, and may further include a non-volatile memory.
  • the technical solution in the embodiment of the present application may be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes one or more instructions for making a computer device (which may be a personal computer, a server, or a network). Equipment, etc.) perform all or part of the steps of the method described in the embodiments of the present application.
  • the foregoing storage medium may be a non-transitory storage medium, including: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.
  • first, second, etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.
  • the first element may be called the second element, and likewise, the second element may be called the first element, as long as all occurrences of the "first element” are renamed consistently and all occurrences of The “second component” can be renamed consistently.
  • the first element and the second element are both elements, but may not be the same element.
  • the aspects, implementations, implementations or features in the described embodiments can be used individually or in any combination.
  • Various aspects in the described embodiments may be implemented by software, hardware, or a combination of software and hardware.
  • the described embodiments may also be embodied by a computer-readable medium storing computer-readable code, the computer-readable code including instructions executable by at least one computing device.
  • the computer-readable medium can be associated with any data storage device capable of storing data, which can be read by a computer system.
  • Computer-readable media for example may include read-only memory, random-access memory, CD-ROM, HDD, DVD, magnetic tape, and optical data storage devices.
  • the computer-readable medium may also be distributed among computer systems connected through a network, so that the computer-readable code can be stored and executed in a distributed manner.

Abstract

A box device (20), method, and system for use in image recognition, and a storage medium. The device (20) comprises a housing (200). Provided within the housing are a first Ethernet port (210), a processor (220) used for neural network operations, and a high-speed memory (230), where the processor (220) comprises an Ethernet data receiving circuit (221), the high-speed memory (230) is connected to the processor (220) and used for storing data of the processor (220), the first Ethernet port (210) is connected to the Ethernet data receiving circuit (221) of the processor (220), and the first Ethernet port (210) transmits directly to the processor (220) via the Ethernet data receiving circuit (221) an image captured by an image capturing device for image recognition processing. The box device (20) is compact in size, is convenient to carry, and has high image recognition efficiency and great accuracy.

Description

用于图像识别的盒体装置、方法、系统和存储介质Box device, method, system and storage medium for image recognition 技术领域Technical field
本申请涉及图像识别技术领域,例如涉及一种用于图像识别的盒体装置、方法、系统和存储介质。The present application relates to the field of image recognition technology, for example, to a box device, method, system, and storage medium for image recognition.
背景技术Background technique
现有的针对图像识别处理的方案多为服务器,服务器由众多板卡构成一个整机,体积庞大,功耗大,成本高,同时搬运困难。并且目前用于图像识别处理的服务器大多数是采用图形处理器(Graphics Processing Uni,简称GPU),GPU不是一种专门用于图像识别的处理器,其图像识别的效率较低,准确性较差,且GPU在服务器中的布线较复杂,需要占用较多的物理空间,导致服务器体积庞大。Most of the existing solutions for image recognition processing are servers. The server consists of a large number of boards to form a complete machine, which is large in size, large in power consumption, high in cost, and difficult to handle. And most of the servers currently used for image recognition processing use graphics processors (Graphics Processing Uni, referred to as GPU). GPU is not a special processor for image recognition. Its image recognition efficiency is low and accuracy is poor. Moreover, the wiring of the GPU in the server is more complicated, requiring more physical space, resulting in a large server volume.
上述背景技术内容仅用于帮助理解本申请,而并不代表承认或认可所提及的任何内容属于相对于本申请的公知常识的一部分。The above background art content is only used to help understand this application, and does not represent an acknowledgement or approval that any of the content mentioned is part of the common general knowledge relative to this application.
发明内容Summary of the Invention
本申请提供一种用于图像识别的盒体装置、方法、系统和存储介质,用以减小图像识别装置的体积,降低成本,同时提高图像识别的效率和准确性,降低能耗。The present application provides a box device, method, system, and storage medium for image recognition, which are used to reduce the size and cost of the image recognition device, while improving the efficiency and accuracy of image recognition and reducing energy consumption.
本申请实施例第一方面提供了一种用于图像识别的盒体装置,包括:A first aspect of the embodiments of the present application provides a box device for image recognition, including:
壳体,所述壳体内设置有第一以太网口、用于神经网络运算的处理器和高速存储器,其中,所述处理器包括以太网数据接收电路;A housing, which is provided with a first Ethernet port, a processor for neural network operations, and a high-speed memory, wherein the processor includes an Ethernet data receiving circuit;
其中,所述高速存储器与所述处理器连接,用于存储所述处理器的数据,所述第一以太网口与所述处理器中的以太网数据接收电路连接,所述第一以太网口通过所述以太网数据接收电路将图像采集设备采集获得的图像直接传输给所 述处理器进行图像识别处理。The high-speed memory is connected to the processor and is used to store data of the processor, the first Ethernet port is connected to an Ethernet data receiving circuit in the processor, and the first Ethernet The port directly transmits the image acquired by the image acquisition device to the processor for image recognition processing through the Ethernet data receiving circuit.
本申请实施例第二方面提供了一种图像识别系统,包括:一个或多个图像采集设备、路由器以及如上述第一方面所述的盒体装置;A second aspect of the embodiments of the present application provides an image recognition system, including: one or more image acquisition devices, a router, and the box device according to the first aspect;
其中,所述一个或多个图像采集设备将采集获得的图像传输给所述路由器,所述路由器将接收到的所述图像传输给所述盒体装置,以使所述盒体装置对所述图像进行图像识别处理。Wherein, the one or more image acquisition devices transmit the acquired images to the router, and the router transmits the received images to the box device, so that the box device can The image is subjected to image recognition processing.
本申请实施例第三方面提供了一种图像识别方法,用于一种盒体装置,所述盒体装置包括:壳体,所述壳体内设置有第一以太网口、用于神经网络运算的处理器和高速存储器;其中,所述处理器包括以太网数据接收电路,所述高速存储器与所述处理器连接,用于存储所述处理器的数据,所述第一以太网口与所述处理器中的太网数据接收电路连接,该方法包括:A third aspect of the embodiments of the present application provides an image recognition method for a box device. The box device includes a casing, and a first Ethernet port is provided in the casing for neural network operations. And a high-speed memory; wherein the processor includes an Ethernet data receiving circuit, the high-speed memory is connected to the processor, and is configured to store data of the processor, and the first Ethernet port is connected to all The Ethernet data receiving circuit connection in the processor is described. The method includes:
第一以太网口获取图像采集设备采集获得的图像,并将所述图像发送给所述处理器中的以太网数据接收电路,以通过所述以太网数据接收电路将所述图像传输至所述处理器;The first Ethernet port acquires an image acquired by an image acquisition device, and sends the image to an Ethernet data receiving circuit in the processor to transmit the image to the Ethernet through the Ethernet data receiving circuit. processor;
所述处理器基于预设的神经网络模型对接收到的图像进行图像识别处理,得到识别结果。The processor performs image recognition processing on the received image based on a preset neural network model to obtain a recognition result.
本申请实施例第四方面提供了一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令设置为执行上述第三方面的方法。A fourth aspect of the embodiments of the present application provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are configured to execute the method of the third aspect.
本申请实施例还提供了一种计算机程序产品,所述计算机程序产品包括存储在计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被计算机执行时,使所述计算机执行上述第三方面的方法。An embodiment of the present application further provides a computer program product. The computer program product includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, The computer executes the method of the third aspect described above.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
一个或多个实施例通过与之对应的附图进行示例性说明,这些示例性说明和附图并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,附图不构成比例限制,并且其中:One or more embodiments are exemplarily described by corresponding drawings. These exemplary descriptions and drawings do not limit the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. The drawings do not constitute a scale limitation, and among them:
图1是现有技术提供的一种图像识别的场景示意图;FIG. 1 is a schematic diagram of an image recognition scene provided by the prior art; FIG.
图2是本申请实施例提供的一种用于图像识别的盒体装置的结构示意图;2 is a schematic structural diagram of a box device for image recognition according to an embodiment of the present application;
图3是本申请实施例提供的另一种用于图像识别的盒体装置的结构示意图;3 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application;
图4是本申请实施例提供的又一种用于图像识别的盒体装置的结构示意图;4 is a schematic structural diagram of still another box device for image recognition according to an embodiment of the present application;
图5是本申请实施例提供的又一种用于图像识别的盒体装置的结构示意图;5 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application;
图6是本申请实施例提供的又一种用于图像识别的盒体装置的结构示意图;6 is a schematic structural diagram of still another box device for image recognition according to an embodiment of the present application;
图7是本申请实施例提供的一种图像识别系统的结构示意图;7 is a schematic structural diagram of an image recognition system according to an embodiment of the present application;
图8是本申请实施例提供的一种步骤102的实现方式流程图;8 is a flowchart of an implementation manner of step 102 according to an embodiment of the present application;
图9为本申请实施例提供的电子设备的结构示意图。FIG. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
具体实施方式detailed description
为了能够更加详尽地了解本申请实施例的特点与技术内容,下面结合附图对本申请实施例的实现进行详细阐述,所附附图仅供参考说明之用,并非用来限定本申请实施例。在以下的技术描述中,为方便解释起见,通过多个细节以提供对所披露实施例的充分理解。然而,在没有这些细节的情况下,一个或多个实施例仍然可以实施。在其它情况下,为简化附图,熟知的结构和装置可以简化展示。In order to understand the features and technical contents of the embodiments of the present application in more detail, the implementation of the embodiments of the present application will be described in detail with reference to the accompanying drawings. The attached drawings are for reference only and are not intended to limit the embodiments of the present application. In the following technical description, for convenience of explanation, various details are provided to provide a full understanding of the disclosed embodiments. However, without these details, one or more embodiments can still be implemented. In other cases, to simplify the drawings, well-known structures and devices may simplify the display.
图1是现有技术提供的一种图像识别的场景示意图。在图1中包括图像采集设备10和可用于执行图像识别处理的服务器11,其中,服务器11中包括多块板卡111,在这多个板卡111中可能存在一块或多块板卡上设置有用于图像处理的GPU112(图1中只示出了一块板卡上设置GPU的场景),而其余板块上设置的处理器则用于实现其他预设的功能,这使得服务器11的内部设计比较冗余,体积庞大,不易搬运。FIG. 1 is a schematic diagram of an image recognition scene provided by the prior art. FIG. 1 includes an image acquisition device 10 and a server 11 that can be used to perform image recognition processing. The server 11 includes multiple boards 111, and one or more boards may be provided in the multiple boards 111. There is GPU112 for image processing (only the scene where the GPU is set on one board is shown in Figure 1), and the processors set on the other boards are used to implement other preset functions, which makes the internal design comparison of server 11 Redundant, bulky and difficult to handle.
在执行图像识别处理操作时,图像采集设备10将采集获得的图像数据传输给网卡113,由网卡113将图像数据转发到总线接口(PCIE)114,再由PCIE114将图像数据转发给GPU112进行处理,在这个过程中由于需要网卡113和PCIE114对图像数据进行转发,数据传输路径较长,因而导致数据处理的时延较大,成本较高。并且GPU112是一种通用的处理器,其数据处理能力较弱,在进行大量的ALU运算时,GPU112都需要访问存储器115来读取和保存中间计算 结果,需要消耗更多的能量来访问存储器115,同时也因为复杂的线路布设增加了GPU112对服务器内部物理空间的占用,这也是导致服务器11体积庞大的重要因素之一。When performing the image recognition processing operation, the image acquisition device 10 transmits the acquired image data to the network card 113, and the network card 113 forwards the image data to the bus interface (PCIE) 114, and then the PCIE 114 forwards the image data to the GPU 112 for processing. In this process, since the network card 113 and PCIE 114 are required to forward the image data, the data transmission path is longer, which results in a longer data processing delay and higher cost. In addition, GPU112 is a general-purpose processor with weak data processing capability. When performing a large number of ALU operations, GPU112 needs to access memory 115 to read and save intermediate calculation results, and it takes more energy to access memory 115. At the same time, because of the complicated wiring layout, the GPU 112 occupies the internal physical space of the server, which is also one of the important factors that cause the server 11 to be bulky.
针对现有技术存在的上述缺陷,本申请实施例提供了一种用于图像识别处理的盒体装置,该盒体装置中设置了专用于人工智能(AI)加速的集成电路(ASIC)处理器,该处理器不是一种通用的处理器而是专用于神经网络运算的处理器,可以为神经网络提供大量的乘法和加法运算,同时处理速度快,准确性高,耗能小,占用的物理空间也比较小,并通过专用于神经网络运算的处理器和高速存储器相结合的模式,将图像识别处理集成在单块板卡上,单块板卡成本低,体积小,从而使得上述盒体装置能够做到小型化,且易于搬运,并且通过采用处理器和高速存储器结合的模式还可以增加盒体装置的数据吞吐能力,提高盒体装置的图像识别效率和准确性。In view of the foregoing defects in the prior art, an embodiment of the present application provides a box device for image recognition processing. The box device is provided with an integrated circuit (ASIC) processor dedicated to artificial intelligence (AI) acceleration. This processor is not a general-purpose processor, but a processor dedicated to neural network operations. It can provide a large number of multiplication and addition operations for neural networks. At the same time, it has fast processing speed, high accuracy, low energy consumption, and occupied physics. The space is also relatively small, and the image recognition processing is integrated on a single board through a combination of a processor dedicated to neural network operations and a high-speed memory. The single board has a low cost and a small size, which makes the above box The device can be miniaturized and easy to carry, and by using a mode combining a processor and a high-speed memory, the data throughput capacity of the box device can be increased, and the efficiency and accuracy of image recognition of the box device can be improved.
下面结合示例性的实施例对本申请技术方案进行详细描述。The technical solution of the present application is described in detail below with reference to exemplary embodiments.
图2是本申请实施例提供的一种用于图像识别的盒体装置的结构示意图,如图2所示,该盒体装置20包括:壳体200,壳体200中设置有第一以太网口210、用于神经网络运算的处理器220(例如张量计算处理器或矩阵处理器,但不局限于张量计算处理器或矩阵处理器)和高速存储器230(比如DDR,但不局限于DDR)。FIG. 2 is a schematic structural diagram of a box device for image recognition according to an embodiment of the present application. As shown in FIG. 2, the box device 20 includes a housing 200, and a first Ethernet is provided in the housing 200. Port 210, a processor 220 for a neural network operation (such as a tensor computing processor or a matrix processor, but not limited to a tensor computing processor or a matrix processor), and a high-speed memory 230 (such as DDR, but not limited to DDR).
其中,处理器220中包括以太网数据接收电路221,高速存储器230与处理器220连接,用于存储处理器220的数据,第一以太网口210与以太网数据接收电路221连接,第一以太网口210通过以太网数据接收电路221将图像采集设备(图2中未示出)采集获得的图像直接传输给处理器220进行图像识别处理。另外,在另一种可能的实现方式中壳体200内也可以包括网卡,处理器中还可以包括具有PCIE功能的电路,第一以太网口210可以通过网卡和PCIE电路将数据传入处理器220。The processor 220 includes an Ethernet data receiving circuit 221. The high-speed memory 230 is connected to the processor 220 for storing data of the processor 220. The first Ethernet port 210 is connected to the Ethernet data receiving circuit 221. The first Ethernet The network port 210 directly transmits the image acquired by the image acquisition device (not shown in FIG. 2) to the processor 220 through the Ethernet data receiving circuit 221 for image recognition processing. In addition, in another possible implementation manner, the housing 200 may also include a network card, and the processor may further include a circuit having a PCIE function. The first Ethernet port 210 may transmit data to the processor through the network card and the PCIE circuit. 220.
具体的,为了实现盒体装置20的最小化,本实施例中盒体装置20中只包括一块板卡(图2中未示出),处理器220和高速存储器230设置在该板卡上。但是在其他可能的场景中根据具体图像识别处理任务的需要,盒体装置20中也可以包括多个板卡,且各板卡上可以采用与上述设置方式相同或相似的器件设 置方式,此时第一以太网口分别与各板卡上的处理器连接,以使多个板卡上的处理器配合进行图像识别处理,以满足更高的图像识别处理速率要求。Specifically, in order to minimize the box device 20, the box device 20 in this embodiment includes only one board (not shown in FIG. 2), and the processor 220 and the high-speed memory 230 are provided on the board. However, in other possible scenarios, according to the needs of specific image recognition processing tasks, the box device 20 may also include multiple boards, and each board may use the same or similar device setting mode as the above setting mode. At this time, The first Ethernet port is respectively connected to a processor on each board card, so that the processors on multiple board cards cooperate to perform image recognition processing, so as to meet a higher image recognition processing rate requirement.
在一种可能的设计中,本实施例中的高速存储器230可以被具体为DDR4,并且在一种可能的实现方式中壳体200中还可以包括如下存储器中的一种或多种:SPI flash、EMMC、SD卡。示例的,图3是本申请实施例提供的另一种用于图像识别的盒体装置的结构示意图,如图3所示,在图2的基础上,壳体200中同时包括SPI flash 231、EMMC 232、DDR4 233和SD卡234。其中,SPI flash231可以盒体装置20的初始化数据提供存储支持,EMMC 232可以用于为驱动盒体装置20底层服务提供存储支持,DDR4 233可以用于为处理器220需要处理的图像数据提供存储空间,SD卡234可以用于存储用户需求的结构化数据,并对盒体装置20的系统进行升级和恢复。In a possible design, the high-speed memory 230 in this embodiment may be specifically DDR4, and in a possible implementation manner, the housing 200 may further include one or more of the following memories: SPI flash , EMMC, SD card. For example, FIG. 3 is a schematic structural diagram of another box device for image recognition provided in the embodiment of the present application. As shown in FIG. 3, based on FIG. 2, the housing 200 also includes SPI flash 231, EMMC 232, DDR4 233 and SD card 234. Among them, SPI flash 231 can provide storage support for the initialization data of the box device 20, EMMC 232 can be used to provide storage support for driving the bottom service of the box device 20, and DDR4 233 can be used to provide storage space for the image data that the processor 220 needs to process The SD card 234 can be used to store structured data required by the user, and to upgrade and restore the system of the box device 20.
在另一种可能的设计中,盒体装置20中还可以设置用于对处理器220进行监控的微控制单元(MCU),并且该MCU还以控制盒体装置20中系统电源的上下电时序。如图4所示,图4是本申请实施例提供的又一种用于图像识别的盒体装置的结构示意图。图4在图3实施例的基础上还包括MCU 240,MCU240与处理器220连接,用于控制处理器220的启动或关机,并对处理器220的温度进行监控。比如,在一种可能的实现方式中,可以通过MCU 240对处理器220的温度进行实时监控,当监测到矩阵220的温度超过危险温度预设阈值,或者超过危险温度预设阈值的时间超过预设时间,则控制处理器220关闭,以免发生危险,当处理器的温度回落低于危险温度预设阈值时,则控制处理器220启动。当然这里仅为示例说明而不是对本申请实施例的唯一限定,实际上,在一些场景中MCU240还可以对处理器220进行诸如过压、欠压、过温、过流等故障检测,并在检测到故障时发出警报。In another possible design, a micro-control unit (MCU) for monitoring the processor 220 may also be provided in the box device 20, and the MCU also controls the power-on and power-off sequence of the system power in the box device 20 . As shown in FIG. 4, FIG. 4 is a schematic structural diagram of still another box device for image recognition according to an embodiment of the present application. FIG. 4 further includes an MCU 240 on the basis of the embodiment in FIG. 3. The MCU 240 is connected to the processor 220 and is used to control the startup or shutdown of the processor 220 and monitor the temperature of the processor 220. For example, in a possible implementation manner, the temperature of the processor 220 may be monitored in real time through the MCU 240. When the temperature of the matrix 220 is detected to exceed the dangerous temperature preset threshold, or the time exceeding the dangerous temperature preset threshold exceeds the preset time If the time is set, the control processor 220 is turned off to avoid danger. When the temperature of the processor falls below a preset threshold of the dangerous temperature, the control processor 220 is started. Of course, this is only an example and not the only limitation of the embodiments of the present application. In fact, in some scenarios, the MCU 240 can also perform fault detection on the processor 220 such as overvoltage, undervoltage, overtemperature, and overcurrent, and detect An alarm is issued when a failure occurs.
在又一种可能的设计中,盒体装置20中还可以设置散热器,通过散热器上的主动散热器件(比如风扇)和/或被动散热器件(比如液冷件)为处理器220散热。具体的,图5是本申请实施例提供的又一种用于图像识别的盒体装置的结构示意图,如图5所示,在图4实施例的基础上,散热器250与MCU 240连接,MCU240根据处理器220的温度,控制散热器250上风扇的转速。其中,根据处理器220温度控制风扇转速的实现方式可以根据需要进行设定,本实施例中 不做具体限定。In yet another possible design, a heat sink may be further provided in the box device 20, and the processor 220 is radiated through an active heat sink (such as a fan) and / or a passive heat sink (such as a liquid cooling member) on the heat sink. Specifically, FIG. 5 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application. As shown in FIG. 5, based on the embodiment of FIG. 4, the radiator 250 is connected to the MCU 240. The MCU 240 controls the rotation speed of the fan on the heat sink 250 according to the temperature of the processor 220. The implementation manner of controlling the fan speed according to the temperature of the processor 220 can be set as required, which is not specifically limited in this embodiment.
在又一种可能的设计中,为了降低盒体装置20对输入电源的要求,提高盒体装置20的普适性,盒体装置20中还可以设置专门的降压或者升压电路,使得输入电源经过降压或者升压电路处理后能够为盒体装置20中的器件供电。示例的,图6是本申请实施例提供的又一种用于图像识别的盒体装置的结构示意图,如图6所示,在图5实施例的基础上,盒体装置20包括低压差线性稳压器(LDO)电路260和直流变直流(DC-DC)电路270,盒体装置20的输入电源经过LDO电路260的降压处理后为MCU 240、盒体装置20的时钟模块(图6中未示出)、PLL模块供电,LDO电路260能够保证电源的稳定性,防止在进行神经网络运算时由于功耗过大导致电源有一个压降,影响供电稳定性。盒体装置20的输入电源经过DC-DC电路270的降压处理后为处理器220以及盒体装置中的其他器件供电。其中本实施例中提供的DC-DC电路270包括由容量大于预设阈值的大容量电容搭建的LC滤波器和阻抗值高于预设阻抗值的高阻抗抗磁珠,当处理器220执行神经网络运算时功耗会很大,会导致为处理器220供电的内核电压和为高速存储器供电的电压都产生一个压降(即下冲),通过DC-DC电路270为处理器220和高速存储器供电能够缓解下冲,提高供电稳定性。In another possible design, in order to reduce the input power requirement of the box device 20 and improve the universality of the box device 20, a special step-down or boost circuit may be provided in the box device 20 so that the input After being processed by the step-down or step-up circuit, the power supply can supply power to the devices in the box device 20. For example, FIG. 6 is a schematic structural diagram of another box device for image recognition according to an embodiment of the present application. As shown in FIG. 6, based on the embodiment of FIG. 5, the box device 20 includes a low-pressure linear The voltage regulator (LDO) circuit 260 and the DC-DC circuit 270, the input power of the box device 20 is subjected to the step-down processing of the LDO circuit 260 to be the MCU 240, the clock module of the box device 20 (Figure 6) (Not shown), the PLL module supplies power, and the LDO circuit 260 can ensure the stability of the power supply, preventing a voltage drop in the power supply due to excessive power consumption during neural network operations, which affects power supply stability. The input power of the box device 20 supplies power to the processor 220 and other devices in the box device after the voltage reduction processing of the DC-DC circuit 270. The DC-DC circuit 270 provided in this embodiment includes an LC filter constructed by a large-capacity capacitor having a capacity larger than a preset threshold and a high-impedance anti-magnetic bead having an impedance higher than a preset impedance. When the processor 220 executes a nerve The power consumption during network operations will be very large, which will cause a voltage drop (ie, undershoot) in the core voltage that powers the processor 220 and the voltage that powers the high-speed memory. The DC-DC circuit 270 will provide the processor 220 and the high-speed memory. Power supply can alleviate undershoot and improve power supply stability.
另外,如图6所示,盒体装置20上还可以设置外扩按键/或指示灯280,用于进行人机交互,提高用户的交互体验。In addition, as shown in FIG. 6, an external expansion button and / or an indicator light 280 may be provided on the box device 20 to perform human-computer interaction and improve the user's interactive experience.
进一步的,为了满足远程的监控需求,本实施例中在处理器220得到识别结果后,还可以将识别结果传输给第一以太网口210,通过第一以太网口210将识别结果发送给远端的终端设备60(比如手机等电子设备、APP、网页、云平台等),以实现识别结果的远端监控。Further, in order to meet remote monitoring requirements, in this embodiment, after the processor 220 obtains the recognition result, it may also transmit the recognition result to the first Ethernet port 210, and send the recognition result to the remote via the first Ethernet port 210. Terminal devices 60 (such as mobile phones and other electronic devices, APPs, web pages, cloud platforms, etc.) to implement remote monitoring of recognition results.
本实施例中的盒体装置20可以应用于诸如闸机人脸识别、人脸支付、演唱会效果反馈、嫌疑人排查、交通事故判断、无人售货、人流统计、AI防盗、考勤等场景,并实现基于图像的人脸识别、表情识别、年龄识别、车辆识别、位置信息识别、车牌号码识别、颜色识别、商品识别等功能,具有小型便捷,使用场景多样,功能强大等优点。The box device 20 in this embodiment can be applied to scenarios such as gate face recognition, face payment, concert effect feedback, suspect investigation, traffic accident judgment, unmanned sales, flow statistics, AI anti-theft, and attendance And realize image-based face recognition, expression recognition, age recognition, vehicle recognition, location information recognition, license plate number recognition, color recognition, product recognition and other functions. It has the advantages of small and convenient, diverse use scenarios, powerful functions and so on.
本实施例提供的盒体装置,通过在盒体装置中采用专用于神经网络运算的处理器代替现有图像识别效率和准确性较差的GPU,采用高速存储器代替目前通 常采用的吞吐量较低的存储器,使得处理器和高速存储器之间的协作,能够提高盒体装置对图像数据的吞吐量,甚至能够实现盒体装置对多路图像采集设备输入的图像数据的高效处理,并且对于图像识别来说,处理器较GPU有更强的处理效率和准确性,从而本实施例也能提高盒体装置的图像识别效率和准确度。另外,由于本实施例提供的盒体装置中处理器中包括以太网数据接收电路,从而使得盒体外部的图像采集设备能够通过第一以太网口和处理器中的以太网数据接收电路将直接采集获得的图像传入处理器,而无需经过网卡的转发,因而可以减少网卡部分造成的功耗,减小盒体装置的体积,使得盒体装置更加轻便小巧。In the box device provided in this embodiment, a processor dedicated to neural network operations is used in the box device to replace the existing GPU with poor image recognition efficiency and accuracy, and a high-speed memory is used to replace the currently generally low throughput. Memory, so that the cooperation between the processor and the high-speed memory can improve the throughput of the box device to the image data, and even realize the efficient processing of the box device to the image data input from the multi-channel image acquisition device, and for image recognition In other words, the processor has stronger processing efficiency and accuracy than the GPU, so that this embodiment can also improve the image recognition efficiency and accuracy of the box device. In addition, because the processor in the box device provided in this embodiment includes an Ethernet data receiving circuit, the image acquisition device outside the box can directly receive the data through the first Ethernet port and the Ethernet data receiving circuit in the processor. The acquired image is passed to the processor without being forwarded by the network card, so the power consumption caused by the network card part can be reduced, the volume of the box device is reduced, and the box device is more lightweight and compact.
图7是本申请实施例提供的一种图像识别系统的结构示意图,如图7所示,该系统包括一个或多个图像采集设备70,路由器71以及上述实施例所述的盒体装置20,其中,一个或多个图像采集设备70将采集获得的图像传输给所述路由器71,路由器71将接收到的所述图像传输给盒体装置20,以使盒体装置20对所述图像进行图像识别处理,并在得到识别结果后,通过第一以太网口将识别结果发送给路由器71,路由器71通过有线或无线的方式将识别结果发送给远端的终端设备60。FIG. 7 is a schematic structural diagram of an image recognition system according to an embodiment of the present application. As shown in FIG. 7, the system includes one or more image acquisition devices 70, a router 71, and the box device 20 according to the foregoing embodiment. Among them, one or more image acquisition devices 70 transmit the acquired images to the router 71, and the router 71 transmits the received images to the box device 20, so that the box device 20 images the images The recognition process, and after obtaining the recognition result, sends the recognition result to the router 71 through the first Ethernet port, and the router 71 sends the recognition result to the remote terminal device 60 in a wired or wireless manner.
本实施例提供的系统其执行方式和有益效果与上述实施例类似,在这里不再赘述。The implementation manner and beneficial effects of the system provided by this embodiment are similar to those of the foregoing embodiment, and are not repeated here.
本申请实施例提供了一种图像识别方法,该方法适用于上述实施例所述的盒体装置,该方法包括:An embodiment of the present application provides an image recognition method. The method is applicable to the box device described in the foregoing embodiment. The method includes:
步骤101、第一以太网口获取图像采集设备采集获得的图像,并将所述图像发送给所述处理器中的以太网数据接收电路,以通过所述以太网数据接收电路将所述图像传输至所述处理器。Step 101: The first Ethernet port acquires an image acquired by an image acquisition device, and sends the image to an Ethernet data receiving circuit in the processor, so as to transmit the image through the Ethernet data receiving circuit. To the processor.
步骤102、所述处理器基于预设的神经网络模型对接收到的图像进行图像识别处理,得到识别结果。Step 102: The processor performs image recognition processing on the received image based on a preset neural network model to obtain a recognition result.
示例的,图8是本申请实施例提供的一种步骤102的实现方式流程图,如图8所示,在一示例性的实施例中步骤102可以包括如下步骤:For example, FIG. 8 is a flowchart of an implementation manner of step 102 provided in the embodiment of the present application. As shown in FIG. 8, in an exemplary embodiment, step 102 may include the following steps:
步骤1021、处理器对接收到的图像进行解码处理,并对解码处理后得到的图像进行预设的图像预处理操作,得到标准图像。Step 1021: The processor performs decoding processing on the received image, and performs a preset image preprocessing operation on the image obtained after the decoding processing to obtain a standard image.
其中,本实施例中涉及的图像预处理操作可以根据需要预先设定,比如,在一些可能的实施例中可能对解码后的图像进行如下处理操作中的至少一种:归一化处理、几何校正处理、直方图均衡化处理、光线补偿处理、灰度变换处理、滤波处理、锐化处理。The image pre-processing operation involved in this embodiment may be preset according to requirements. For example, in some possible embodiments, at least one of the following processing operations may be performed on the decoded image: normalization processing, geometry Correction processing, histogram equalization processing, light compensation processing, gray-scale transformation processing, filtering processing, sharpening processing.
步骤1022、所述处理器基于预设的神经网络模型对所述标准图像进行图像识别处理,得到识别结果。Step 1022: The processor performs image recognition processing on the standard image based on a preset neural network model to obtain a recognition result.
本实施例中涉及的神经网络模型根据具体识别场景预先训练获得。在对标准图像进行识别处理时,首先基于神经网络模型对标准图像进行特征提取处理获得标准图像的特征信息,进一步的,再通过特征比对或特征分析得到识别结果,也就是说,上述识别过程可示例的表述为处理器基于预设的神经网络模型对标准图像进行特征提取处理,得到所标准图像的特征信息;基于标准图像的特征信息对标准图像进行图像识别处理,得到识别结果。比如,在人脸识别场景中,处理器在得到标准图像后需要先基于预设的神经网络模型中提取获得图像中任务的脸部特征信息,进一步的,再将提取获得的脸部特征信息与预选存储的任务脸部特征信息进行匹配,从而确定图像中人物的身份。当然这里仅是以人脸识别场景为例所进行的解释说明而不是对本申请的唯一限定。The neural network model involved in this embodiment is obtained by training in advance according to a specific recognition scenario. When performing a recognition process on a standard image, first perform a feature extraction process on the standard image based on the neural network model to obtain the feature information of the standard image, and further, obtain a recognition result through feature comparison or feature analysis, that is, the above recognition process An exemplary expression is that the processor performs feature extraction processing on a standard image based on a preset neural network model to obtain feature information of the standard image; and performs image recognition processing on the standard image based on the feature information of the standard image to obtain a recognition result. For example, in a face recognition scene, after obtaining a standard image, the processor needs to extract the facial feature information of the task in the image based on a preset neural network model. Further, the extracted facial feature information and The pre-selected stored task facial feature information is matched to determine the identity of the person in the image. Of course, the explanation is only based on the face recognition scene as an example, and is not the only limitation on this application.
进一步的,为了满足远程监控的要求,本实施例中处理器在得到处理结果后,还可以通过第一以太网口将识别结果发送给远端的终端设备,从而识别结果的远程监控。Further, in order to meet the requirements of remote monitoring, after the processor obtains the processing result in this embodiment, the processor may also send the recognition result to the remote terminal device through the first Ethernet port, thereby remotely monitoring the recognition result.
本实施例的有益效果与前述实施例类似在这里不在赘述。The beneficial effects of this embodiment are similar to the foregoing embodiments, and are not repeated here.
本申请实施例还提供了一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令设置为执行上述实施例所执行的方法。An embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are configured to execute the method performed by the foregoing embodiments.
本申请实施例还提供了一种计算机程序产品,所述计算机程序产品包括存储在计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被计算机执行时,使所述计算机执行上述实施例所执行的方法。An embodiment of the present application further provides a computer program product. The computer program product includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, The computer executes the method performed by the above embodiment.
上述的计算机可读存储介质可以是暂态计算机可读存储介质,也可以是非暂态计算机可读存储介质。The computer-readable storage medium described above may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.
本申请实施例还提供了一种电子设备,其结构如图9所示,该电子设备包 括:An embodiment of the present application further provides an electronic device, whose structure is shown in FIG. 9. The electronic device includes:
至少一个处理器(processor)100,图10中以一个处理器100为例;和存储器(memory)101,还可以包括通信接口(Communication Interface)102和总线103。其中,处理器100、通信接口102、存储器101可以通过总线103完成相互间的通信。通信接口102可以用于信息传输。处理器100可以调用存储器101中的逻辑指令,以执行上述实施例所执行的方法。At least one processor 100, and one processor 100 is taken as an example in FIG. 10; and the memory 101 may further include a communication interface 102 and a bus 103. Among them, the processor 100, the communication interface 102, and the memory 101 can complete communication with each other through the bus 103. The communication interface 102 may be used for information transmission. The processor 100 may call a logic instruction in the memory 101 to execute the method performed by the foregoing embodiment.
此外,上述的存储器101中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。In addition, the logic instructions in the memory 101 can be implemented in the form of software functional units and sold or used as an independent product, and can be stored in a computer-readable storage medium.
存储器101作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序,如本申请实施例中的方法对应的程序指令/模块。处理器100通过运行存储在存储器101中的软件程序、指令以及模块,从而执行功能应用以及数据处理,即实现上述方法实施例中的图像识别方法。The memory 101 is a computer-readable storage medium and can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of the present application. The processor 100 executes functional applications and data processing by running software programs, instructions, and modules stored in the memory 101, that is, implementing the image recognition method in the foregoing method embodiment.
存储器101可包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据终端设备的使用所创建的数据等。此外,存储器101可以包括高速随机存取存储器,还可以包括非易失性存储器。The memory 101 may include a storage program area and a storage data area, where the storage program area may store an operating system and application programs required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, the memory 101 may include a high-speed random access memory, and may further include a non-volatile memory.
本申请实施例的技术方案可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括一个或多个指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请实施例所述方法的全部或部分步骤。而前述的存储介质可以是非暂态存储介质,包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等多种可以存储程序代码的介质,也可以是暂态存储介质。The technical solution in the embodiment of the present application may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions for making a computer device (which may be a personal computer, a server, or a network). Equipment, etc.) perform all or part of the steps of the method described in the embodiments of the present application. The foregoing storage medium may be a non-transitory storage medium, including: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc. A medium that can store program code, or a transient storage medium.
当用于本申请中时,虽然术语“第一”、“第二”等可能会在本申请中使用以描述各元件,但这些元件不应受到这些术语的限制。这些术语仅用于将一个元件与另一个元件区别开。比如,在不改变描述的含义的情况下,第一元件可以叫做第二元件,并且同样第,第二元件可以叫做第一元件,只要所有出现的“第一元件”一致重命名并且所有出现的“第二元件”一致重命名即可。第一元件和第二 元件都是元件,但可以不是相同的元件。When used in this application, although the terms "first", "second", etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without changing the meaning of the description, the first element may be called the second element, and likewise, the second element may be called the first element, as long as all occurrences of the "first element" are renamed consistently and all occurrences of The "second component" can be renamed consistently. The first element and the second element are both elements, but may not be the same element.
本申请中使用的用词仅用于描述实施例并且不用于限制权利要求。如在实施例以及权利要求的描述中使用的,除非上下文清楚地表明,否则单数形式的“一个”(a)、“一个”(an)和“所述”(the)旨在同样包括复数形式。类似地,如在本申请中所使用的术语“和/或”是指包含一个或一个以上相关联的列出的任何以及所有可能的组合。另外,当用于本申请中时,术语“包括”(comprise)及其变型“包括”(comprises)和/或包括(comprising)等指陈述的特征、整体、步骤、操作、元素,和/或组件的存在,但不排除一个或一个以上其它特征、整体、步骤、操作、元素、组件和/或这些的分组的存在或添加。The words used in this application are used to describe embodiments only and not to limit the claims. As used in the description of the embodiments and claims, the singular forms "a" (a), "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise . Similarly, the term "and / or" as used in this application means including any and all possible combinations of one or more associated listings. In addition, the terms "comprise" and variations thereof "comprises" and / or "comprising" when used in this application refer to stated features, wholes, steps, operations, elements, and / or The presence of a component does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or groups of these.
所描述的实施例中的各方面、实施方式、实现或特征能够单独使用或以任意组合的方式使用。所描述的实施例中的各方面可由软件、硬件或软硬件的结合实现。所描述的实施例也可以由存储有计算机可读代码的计算机可读介质体现,该计算机可读代码包括可由至少一个计算装置执行的指令。所述计算机可读介质可与任何能够存储数据的数据存储装置相关联,该数据可由计算机系统读取。用于举例的计算机可读介质可以包括只读存储器、随机存取存储器、CD-ROM、HDD、DVD、磁带以及光数据存储装置等。所述计算机可读介质还可以分布于通过网络联接的计算机系统中,这样计算机可读代码就可以分布式存储并执行。The aspects, implementations, implementations or features in the described embodiments can be used individually or in any combination. Various aspects in the described embodiments may be implemented by software, hardware, or a combination of software and hardware. The described embodiments may also be embodied by a computer-readable medium storing computer-readable code, the computer-readable code including instructions executable by at least one computing device. The computer-readable medium can be associated with any data storage device capable of storing data, which can be read by a computer system. Computer-readable media for example may include read-only memory, random-access memory, CD-ROM, HDD, DVD, magnetic tape, and optical data storage devices. The computer-readable medium may also be distributed among computer systems connected through a network, so that the computer-readable code can be stored and executed in a distributed manner.
上述技术描述可参照附图,这些附图形成了本申请的一部分,并且通过描述在附图中示出了依照所描述的实施例的实施方式。虽然这些实施例描述的足够详细以使本领域技术人员能够实现这些实施例,但这些实施例是非限制性的;这样就可以使用其它的实施例,并且在不脱离所描述的实施例的范围的情况下还可以做出变化。比如,流程图中所描述的操作顺序是非限制性的,因此在流程图中阐释并且根据流程图描述的两个或两个以上操作的顺序可以根据若干实施例进行改变。作为另一个例子,在若干实施例中,在流程图中阐释并且根据流程图描述的一个或一个以上操作是可选的,或是可删除的。另外,某些步骤或功能可以添加到所公开的实施例中,或两个以上的步骤顺序被置换。所有这些变化被认为包含在所公开的实施例以及权利要求中。The above technical description can be referred to the accompanying drawings, which form a part of the present application, and show in the drawings an implementation according to the described embodiments. Although the embodiments are described in sufficient detail to enable those skilled in the art to implement the embodiments, the embodiments are non-limiting; thus, other embodiments can be used without departing from the scope of the described embodiments. Situations can also make changes. For example, the sequence of operations described in the flowchart is non-limiting, so the sequence of two or more operations explained in the flowchart and described according to the flowchart can be changed according to several embodiments. As another example, in several embodiments, one or more operations explained in the flowchart and described in accordance with the flowchart are optional or deleteable. In addition, certain steps or functions may be added to the disclosed embodiments, or two or more steps may be sequentially replaced. All of these variations are considered to be included in the disclosed embodiments and the claims.
另外,上述技术描述中使用术语以提供所描述的实施例的透彻理解。然而,并不需要过于详细的细节以实现所描述的实施例。因此,实施例的上述描述是为 了阐释和描述而呈现的。上述描述中所呈现的实施例以及根据这些实施例所公开的例子是单独提供的,以添加上下文并有助于理解所描述的实施例。上述说明书不用于做到无遗漏或将所描述的实施例限制到本申请的精确形式。根据上述教导,若干修改、选择适用以及变化是可行的。在某些情况下,没有详细描述为人所熟知的处理步骤以避免不必要地影响所描述的实施例。In addition, terminology is used in the foregoing technical description to provide a thorough understanding of the described embodiments. However, too detailed details are not required to implement the described embodiments. Therefore, the foregoing description of the embodiments has been presented for the purposes of illustration and description. The embodiments presented in the above description and the examples disclosed based on these embodiments are provided separately to add context and help to understand the described embodiments. The above description is not intended to be exhaustive or to limit the described embodiments to the precise form of this application. Based on the above teachings, several modifications, alternatives, and variations are possible. In some cases, well-known process steps have not been described in detail to avoid unnecessarily affecting the described embodiments.

Claims (15)

  1. 一种用于图像识别的盒体装置,其特征在于,包括:A box device for image recognition is characterized in that it includes:
    壳体,所述壳体内设置有第一以太网口、用于神经网络运算的处理器和高速存储器,其中,所述处理器包括以太网数据接收电路;A housing, which is provided with a first Ethernet port, a processor for neural network operations, and a high-speed memory, wherein the processor includes an Ethernet data receiving circuit;
    其中,所述高速存储器与所述处理器连接,用于存储所述处理器的数据,所述第一以太网口与所述处理器中的以太网数据接收电路连接,所述第一以太网口通过所述以太网数据接收电路将图像采集设备采集获得的图像直接传输给所述处理器进行图像识别处理。The high-speed memory is connected to the processor and is used to store data of the processor, the first Ethernet port is connected to an Ethernet data receiving circuit in the processor, and the first Ethernet The port directly transmits the image acquired by the image acquisition device to the processor for image recognition processing through the Ethernet data receiving circuit.
  2. 根据权利要求1所述的盒体装置,其特征在于,所述盒体装置内设置有一块板卡;The box device according to claim 1, wherein a card is provided in the box device;
    所述第一以太网口,所述处理器和所述高速存储器设置在所述板卡上。The first Ethernet port, the processor, and the high-speed memory are disposed on the board card.
  3. 根据权利要求1所述的盒体装置,其特征在于,所述处理器包括张量计算处理器。The box device according to claim 1, wherein the processor comprises a tensor calculation processor.
  4. 根据权利要求1所述的盒体装置,其特征在于,所述第一以太网口还用于将所述处理器的图像识别结果发送给所述终端设备。The box device according to claim 1, wherein the first Ethernet port is further configured to send an image recognition result of the processor to the terminal device.
  5. 根据权利要求1所述的盒体装置,其特征在于,所述高速存储器包括DDR。The box device according to claim 1, wherein the high-speed memory includes DDR.
  6. 根据权利要求5所述的盒体装置,其特征在于,所述盒体装置还包括微控制单元(MCU),所述MCU与所述处理器连接;The box device according to claim 5, wherein the box device further comprises a micro control unit (MCU), and the MCU is connected to the processor;
    所述MCU用于,控制所述所述处理器启动或关闭。The MCU is configured to control the processor to be turned on or off.
  7. 根据权利要求6所述的盒体装置,其特征在于,所述盒体装置还包括散热器,所述散热器与所述MCU连接;The box device according to claim 6, wherein the box device further comprises a heat sink, and the heat sink is connected to the MCU;
    所述MCU还用于,获取所述处理器的温度信息,并基于所述温度信息控制所述散热器的风扇的转速。The MCU is further configured to obtain temperature information of the processor, and control a rotation speed of a fan of the radiator based on the temperature information.
  8. 根据权利要求7所述的盒体装置,其特征在于,所述盒体装置还包括低压差线性稳压器(LDO)电路和直流变直流(DC-DC)电路;The box device according to claim 7, wherein the box device further comprises a low-dropout linear regulator (LDO) circuit and a direct current-to-direct current (DC-DC) circuit;
    所述盒体装置的电源输入经过所述LDO电路的降压处理后为所述MCU供 电;The power input of the box device is supplied to the MCU after step-down processing of the LDO circuit;
    所述盒体装置的电源输入经过所述DC-DC电路的降压处理后为所述盒体装置中的其他器件供电。After the power input of the box device is subjected to the step-down processing of the DC-DC circuit, power is supplied to other devices in the box device.
  9. 根据权利要求8所述的盒体装置,其特征在于,所述DC-DC电路包括由容量大于预设阈值的电容搭建的LC滤波器和阻抗值大于预设阻抗值的抗磁珠,以使所述DC-DC电路能够为所述盒体装置中的器件提供稳定的电压。The box device according to claim 8, wherein the DC-DC circuit comprises an LC filter constructed by a capacitor having a capacity greater than a preset threshold and an antimagnetic bead having an impedance value greater than a preset impedance value, so that The DC-DC circuit can provide a stable voltage to the devices in the box device.
  10. 一种图像识别系统,其特征在于,包括:一个或多个图像采集设备、路由器以及如权利要求1-9中任一项所述的盒体装置;An image recognition system, comprising: one or more image acquisition devices, a router, and the box device according to any one of claims 1-9;
    其中,所述一个或多个图像采集设备将采集获得的图像传输给所述路由器,所述路由器将接收到的所述图像传输给所述盒体装置,以使所述盒体装置对所述图像进行图像识别处理。Wherein, the one or more image acquisition devices transmit the acquired images to the router, and the router transmits the received images to the box device, so that the box device can The image is subjected to image recognition processing.
  11. 一种图像识别方法,其特征在于,该方法适用于一种盒体装置,所述盒体装置包括:壳体,所述壳体内设置有第一以太网口、用于神经网络运算的处理器和高速存储器;其中,所述处理器包括以太网数据接收电路,所述高速存储器与所述处理器连接,用于存储所述处理器的数据,所述第一以太网口与所述处理器中的太网数据接收电路连接,该方法包括:An image recognition method, which is characterized in that the method is applicable to a box device, the box device includes: a casing, a first Ethernet port is provided in the casing, and a processor for neural network operations And a high-speed memory; wherein the processor includes an Ethernet data receiving circuit, the high-speed memory is connected to the processor and is used to store data of the processor, and the first Ethernet port is connected to the processor Ethernet data receiving circuit connection in the method, the method includes:
    第一以太网口获取图像采集设备采集获得的图像,并将所述图像发送给所述处理器中的以太网数据接收电路,以通过所述以太网数据接收电路将所述图像传输至所述处理器;The first Ethernet port acquires an image acquired by an image acquisition device, and sends the image to an Ethernet data receiving circuit in the processor to transmit the image to the Ethernet through the Ethernet data receiving circuit. processor;
    所述处理器基于预设的神经网络模型对接收到的图像进行图像识别处理,得到识别结果。The processor performs image recognition processing on the received image based on a preset neural network model to obtain a recognition result.
  12. 根据权利要求11所述的方法,其特征在于,所述处理器基于预设的神经网络模型对接收到的图像进行图像识别处理,得到识别结果,包括:The method according to claim 11, wherein the processor performs image recognition processing on the received image based on a preset neural network model, and obtains a recognition result, comprising:
    所述处理器对接收到的图像进行解码处理,并对解码处理后得到的图像进行预设的图像预处理操作,得到标准图像;The processor performs a decoding process on the received image, and performs a preset image preprocessing operation on the image obtained after the decoding process to obtain a standard image;
    所述处理器基于预设的神经网络模型对所述标准图像进行图像识别处理,得到识别结果。The processor performs image recognition processing on the standard image based on a preset neural network model to obtain a recognition result.
  13. 根据权利要求12所述的方法,其特征在于,所述处理器基于预设的神经网络模型对所述标准图像进行图像识别处理,得到识别结果,包括:The method according to claim 12, wherein the processor performs image recognition processing on the standard image based on a preset neural network model, and obtains a recognition result, comprising:
    所述处理器基于预设的神经网络模型对所述标准图像进行特征提取处理,得到所述标准图像的特征信息;Performing, by the processor, feature extraction processing on the standard image based on a preset neural network model to obtain feature information of the standard image;
    基于所述标准图像的特征信息对所述标准图像进行图像识别处理,得到识别结果。Image recognition processing is performed on the standard image based on the feature information of the standard image to obtain a recognition result.
  14. 根据权利要求11-13中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 11-13, wherein the method further comprises:
    在得到识别结果后,所述处理器将所述识别结果发送给所述第一以太网口,以使所述第一以太网口将所述识别结果发送给远端的终端设备。After obtaining the recognition result, the processor sends the recognition result to the first Ethernet port, so that the first Ethernet port sends the recognition result to a remote terminal device.
  15. 一种计算机可读存储介质,其特征在于,存储有计算机可执行指令,所述计算机可执行指令设置为执行权利要求11-14任一项所述的方法。A computer-readable storage medium, characterized in that computer-executable instructions are stored, and the computer-executable instructions are configured to execute the method according to any one of claims 11-14.
PCT/CN2018/109143 2018-09-30 2018-09-30 Box device, method, and system for use in image recognition, and storage medium WO2020062263A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880001909.5A CN109328357A (en) 2018-09-30 2018-09-30 For the box body device of image recognition, method, system and storage medium
PCT/CN2018/109143 WO2020062263A1 (en) 2018-09-30 2018-09-30 Box device, method, and system for use in image recognition, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/109143 WO2020062263A1 (en) 2018-09-30 2018-09-30 Box device, method, and system for use in image recognition, and storage medium

Publications (1)

Publication Number Publication Date
WO2020062263A1 true WO2020062263A1 (en) 2020-04-02

Family

ID=65256441

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/109143 WO2020062263A1 (en) 2018-09-30 2018-09-30 Box device, method, and system for use in image recognition, and storage medium

Country Status (2)

Country Link
CN (1) CN109328357A (en)
WO (1) WO2020062263A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101276218A (en) * 2008-04-29 2008-10-01 上海交通大学 Machine vision system aiming at high real time image collecting and processing
CN105933658A (en) * 2016-05-18 2016-09-07 冶金自动化研究设计院 Device for monitoring airtight state of personal protective valve based on image identification
CN106971140A (en) * 2016-12-05 2017-07-21 天津灵隆科技有限公司 A kind of face identification system and recognition methods
CN108133269A (en) * 2016-12-01 2018-06-08 上海兆芯集成电路有限公司 With the processor of memory array that cache memory or neural network cell memory can be used as to operate

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9971733B1 (en) * 2014-12-04 2018-05-15 Altera Corporation Scalable 2.5D interface circuitry
CN206149299U (en) * 2016-10-28 2017-05-03 成都思晗科技股份有限公司 Multifunctional gateway

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101276218A (en) * 2008-04-29 2008-10-01 上海交通大学 Machine vision system aiming at high real time image collecting and processing
CN105933658A (en) * 2016-05-18 2016-09-07 冶金自动化研究设计院 Device for monitoring airtight state of personal protective valve based on image identification
CN108133269A (en) * 2016-12-01 2018-06-08 上海兆芯集成电路有限公司 With the processor of memory array that cache memory or neural network cell memory can be used as to operate
CN106971140A (en) * 2016-12-05 2017-07-21 天津灵隆科技有限公司 A kind of face identification system and recognition methods

Also Published As

Publication number Publication date
CN109328357A (en) 2019-02-12

Similar Documents

Publication Publication Date Title
KR102255215B1 (en) Method of detecting object in image and image processing device
US9678560B2 (en) Methods and apparatuses to wake computer systems from sleep states
EP3049889B1 (en) Optimizing boot-time peak power consumption for server/rack systems
US8463970B2 (en) Method and system for managing sleep states of interrupt controllers in a portable computing device
CN107430424A (en) For the technology of improved mixing sleep power management
DE102013110340A1 (en) A single-chip system capable of controlling a power supply in accordance with a data transaction and method of operating the same
CN104951041A (en) Dynamic power supply unit rail switching
JP2013536965A (en) Charging port
DE112017003080T5 (en) PROCESSOR WITH SIMULTANEOUS CORE AND FABRIC OUTPUT FROM A CONDITION WITH LOW ENERGY
CN111913836B (en) Solid state disk low power consumption mode data recovery method and device, computer equipment and storage medium
CN113835515A (en) USB C-type subsystem power management
CN112612356A (en) Power supply method, system, equipment and medium
CN111192319B (en) System and method for monitoring distance of human face to smart device
WO2016180241A1 (en) Energy-conservation management method and apparatus for terminal and terminal
WO2020062263A1 (en) Box device, method, and system for use in image recognition, and storage medium
US20170018941A1 (en) System and Method for Green Battery Conditioning
CN113835517A (en) Fast dynamic capacitance, frequency, and/or voltage throttling device and method
DE102020134338A1 (en) INFERENCE BASED FAST CHARGE
US10552646B2 (en) System and method for preventing thin/zero client from unauthorized physical access
Chang et al. Cost-Efficient Adaboost-based Face Detection with FPGA Hardware Accelerator
US20120185713A1 (en) Server, storage medium, and method for controlling sleep and wakeup function of the server
CN110697517A (en) Elevator control method, system and storage medium based on cell
US20140215250A1 (en) Electronic device and power saving method for electronic device
DE102020131586A1 (en) DEVICE AND METHOD FOR SMART PROCESSOR IDLE PREDICTION
CN108549477B (en) Power adjustment method and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18935901

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/07/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18935901

Country of ref document: EP

Kind code of ref document: A1