WO2023195456A1 - Instrument électronique et procédé de commande d'instrument électronique - Google Patents

Instrument électronique et procédé de commande d'instrument électronique Download PDF

Info

Publication number
WO2023195456A1
WO2023195456A1 PCT/JP2023/013865 JP2023013865W WO2023195456A1 WO 2023195456 A1 WO2023195456 A1 WO 2023195456A1 JP 2023013865 W JP2023013865 W JP 2023013865W WO 2023195456 A1 WO2023195456 A1 WO 2023195456A1
Authority
WO
WIPO (PCT)
Prior art keywords
article
electronic device
unit
recognized
rectangle circumscribing
Prior art date
Application number
PCT/JP2023/013865
Other languages
English (en)
Japanese (ja)
Inventor
暁艶 戴
ジェチョル キム
寛樹 谷本
依珊 謝
Original Assignee
京セラ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京セラ株式会社 filed Critical 京セラ株式会社
Publication of WO2023195456A1 publication Critical patent/WO2023195456A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes

Definitions

  • the present disclosure relates to an electronic device and a method of controlling the electronic device.
  • Patent Document 1 discloses a technology that images a plurality of products arranged in a predetermined area and recognizes the products from the feature amounts of the captured images. It is expected that such technology will be increasingly introduced as a means of reducing labor costs and alleviating labor shortages by being adopted, for example, in unmanned cash registers at stores.
  • An electronic device includes: a recognition unit that recognizes the article from an image of the article; an identification section that identifies the article along with its size based on the lengths of two right-angled sides of a rectangle circumscribing the article recognized by the recognition section; Equipped with.
  • an electronic device includes: The article is identified along with its size based on the lengths of two perpendicular sides of a rectangle circumscribing the article, which are recognized from the image of the article.
  • an electronic device includes: The article is identified along with its size based on a rectangle circumscribing the article recognized from an image of the article.
  • a method for controlling an electronic device includes: a recognition step of recognizing the article from an image of the article; an identification step of identifying the article along with its size based on the lengths of two right-angled sides of a rectangle circumscribing the article recognized in the recognition step; including.
  • FIG. 1 is a block diagram showing a functional configuration of an electronic device according to a first embodiment.
  • FIG. 3 is a diagram illustrating processing by the electronic device according to the first embodiment.
  • FIG. 3 is a diagram illustrating an example of information stored in a storage unit of the electronic device according to the first embodiment.
  • 3 is a flowchart illustrating the operation of the electronic device according to the first embodiment.
  • FIG. 7 is a diagram illustrating processing by an electronic device according to a second embodiment. It is a flow chart explaining operation of an electronic device concerning a 2nd embodiment.
  • FIG. 3 is a block diagram showing a functional configuration of an electronic device according to a modification of the first embodiment.
  • FIG. 7 is a diagram illustrating processing by an electronic device according to a modification of the first embodiment.
  • An object of the present disclosure is to provide an electronic device that can identify articles of the same or similar shape but different sizes, and a method of controlling such an electronic device. According to one embodiment, it is possible to provide an electronic device that can identify articles of the same or similar shape but different sizes, and a method of controlling such an electronic device.
  • an "electronic device” may be a device driven by electric power.
  • the “system” may include equipment driven by electric power.
  • a "user” may be a person who uses an electronic device or a system according to an embodiment. A user may benefit from having items identified along with their size using an electronic device and/or system according to an embodiment.
  • the electronic device according to one embodiment may be used in a store such as a mass merchandiser, a supermarket, or a convenience store, for example. In such stores, it would be beneficial if items such as products of the same or similar shape but different sizes could be automatically identified (that is, without manual intervention). However, the scenarios in which the electronic device according to the embodiment is used are not limited to the above-mentioned stores.
  • the electronic device according to the embodiment may be used, for example, in a factory to identify items such as devices and parts. In such factories, it would be beneficial if items such as equipment or parts of the same or similar shape but different sizes could be automatically identified (that is, without manual intervention).
  • FIG. 1 is a diagram showing a schematic configuration of an electronic device according to a first embodiment, along with an example of its usage mode.
  • the electronic device 1 according to the first embodiment may include a recognition section 10 and an identification section 12. Further, the electronic device 1 according to the first embodiment may include a storage section 14, a communication section 16, an output section 18, and the like.
  • the electronic device 1 according to one embodiment may not include some of the functional units shown in FIG. 1, or may include functional units other than those shown in FIG. 1 as appropriate.
  • the electronic device 1 according to the first embodiment can be configured as various devices.
  • the electronic device 1 according to the first embodiment may be a specially designed terminal, a general-purpose computer, a notebook computer, a server, or the like.
  • the electronic device 1 according to the first embodiment may be a tablet computer, a smartphone, or the like.
  • the electronic device 1 according to the first embodiment may be configured as any device that identifies articles of the same or similar form but different sizes.
  • the imaging unit 20 shown in FIG. 1 may include an image sensor that electronically captures images, such as a digital camera.
  • the imaging unit 20 may include an imaging element that performs photoelectric conversion, such as a CCD (Charge Coupled Device Image Sensor) or a CMOS (Complementary Metal Oxide Semiconductor) sensor.
  • the electronic device 1 and the imaging unit 20 may be connected by wire, wireless, or a combination of wire and wireless.
  • the imaging unit 20 may be connected to the recognition unit 10 of the electronic device 1, for example.
  • the image capturing unit 20 is not limited to an image capturing device such as a digital camera, and may be any device as long as it captures images of articles of the same or similar form but different sizes.
  • the imaging unit 20 captures an image of an article, for example, as shown in FIG.
  • objects ⁇ 1, ⁇ 2, ⁇ 1, and ⁇ 2 placed on the board 100 are shown as objects to be imaged by the imaging unit 20.
  • the board surface 100 may extend parallel to the XY plane shown in FIG.
  • the Z axis shown in FIG. 1 may be directed upward in the vertical direction, for example.
  • the imaging unit 20 is arranged at a distance d from the board surface 100 in the positive direction of the Z-axis shown in FIG. That is, the imaging unit 20 is arranged to take images of the articles ⁇ 1, ⁇ 2, ⁇ 1, and ⁇ 2 placed on the board 100 from above.
  • FIG. 1 shows an example in which four articles ⁇ 1, ⁇ 2, ⁇ 1, and ⁇ 2 are placed on a board 100.
  • the number of items placed on board 100 may be any number greater than one.
  • FIG. 1 shows an example in which the imaging unit 20 images objects ⁇ 1, ⁇ 2, ⁇ 1, and ⁇ 2 placed on the board 100 from above.
  • the imaging unit 20 may image the objects ⁇ 1, ⁇ 2, ⁇ 1, and ⁇ 2 placed on the board 100, for example, from the side (such as in a direction parallel to the XY plane).
  • the imaging unit 20 may be installed at any position and angle at which the external shape of the item placed on the board 100 can be imaged.
  • FIG. 1 shows an example in which only one imaging unit 20 is installed. However, in one embodiment, two or more imaging units 20 may be installed. In one embodiment, by installing two or more imaging units 20, it is possible to improve the accuracy of identifying the article and the size of the article.
  • Information on the image captured by the imaging unit 20 may be supplied to the electronic device 1.
  • Information on the image captured by the imaging unit 20 may be supplied to, for example, the recognition unit 10 of the electronic device 1.
  • information on the image captured by the imaging unit 20 may be supplied to, for example, the identification unit 12, the storage unit 14, the communication unit 16, and/or the output unit 18 of the electronic device 1.
  • the recognition unit 10 recognizes the article included in the image captured by the imaging unit 20.
  • the recognition unit 10 may recognize the article included in the image captured by the image capture unit 20 using any known image recognition technology.
  • the recognition unit 10 may have a function of extracting an article included in the image captured by the image capturing unit 20 based on predetermined feature points of the article.
  • the recognition unit 10 recognizes the article from the image of the article (the image captured by the imaging unit 20).
  • Information on the article recognized by the recognition unit 10 may be supplied to, for example, the identification unit 12 of the electronic device 1.
  • the information on the article recognized by the recognition unit 10 may be supplied to, for example, the storage unit 14, the communication unit 16, and/or the output unit 18 of the electronic device 1.
  • the identification unit 12 identifies the article recognized by the recognition unit 10 along with the size of the article. Identification of articles by the identification unit 12 of the electronic device 1 according to the first embodiment will be further described later. Information on the article recognized by the identification unit 12 together with the size may be supplied to, for example, the storage unit 14, the communication unit 16, and/or the output unit 18 of the electronic device 1.
  • At least one of the recognition unit 10 and the identification unit 12 includes at least one CPU, such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor), in order to provide control and processing capabilities for performing various functions.
  • At least one of the recognition unit 10 and the identification unit 12 may be implemented by a single processor, several processors, or individual processors.
  • a processor may be implemented as a single integrated circuit (IC).
  • a processor may be implemented as a plurality of communicatively connected integrated and discrete circuits. The processor may be implemented based on various other known technologies.
  • At least one of the recognition unit 10 and the identification unit 12 may be configured as, for example, a CPU and a program executed by the CPU.
  • a program executed in at least one of the recognition unit 10 and the identification unit 12, a result of a process executed in at least one of the recognition unit 10 and the identification unit 12, etc. may be stored in the storage unit 14, for example.
  • At least one of the recognition unit 10 and the identification unit 12 may appropriately include memory necessary for operation.
  • At least one of the recognition unit 10 and the identification unit 12 may be configured as dedicated hardware, may include at least a portion of software, or may be configured entirely of software.
  • the storage unit 14 may have a function as a memory that stores various information.
  • the storage unit 14 may store, for example, a program executed in at least one of the recognition unit 10 and the identification unit 12, a result of a process executed in at least one of these, and the like.
  • the storage unit 14 may store size information of each of a plurality of articles in association with each of the plurality of articles.
  • the storage unit 14 may have a function as a database that stores various information. The size information of each of the plurality of articles stored in the storage unit 14 will be further described later.
  • the storage unit 14 may function as a work memory for at least one of the recognition unit 10 and the identification unit 12.
  • the storage unit 14 can be configured by, for example, a semiconductor memory or the like, but is not limited thereto, and can be any storage device.
  • the storage unit 14 may be a storage medium such as a memory card inserted into the electronic device 1 according to one embodiment.
  • the storage unit 14 may be an internal memory of a CPU used as at least one of the recognition unit 10 and the identification unit 12, or may be connected to at least one of the recognition unit 10 and the identification unit 12 as a separate body. Good too.
  • the communication unit 16 has an interface function for wired or wireless communication.
  • the communication method performed by the communication unit 16 in one embodiment may be a wireless communication standard.
  • wireless communication standards include cellular phone communication standards such as 2G, 3G, 4G, and 5G.
  • communication standards for cellular phones include LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), CDMA2000, PDC (Personal Digital Cellular), GSM (registered trademark) (Global System for Mobile communications), and PHS. (Personal Handy-phone System), etc.
  • wireless communication standards include WiMAX (Worldwide Interoperability for Microwave Access), IEEE802.11, WiFi, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), and the like.
  • Communication unit 16 may support one or more of the communication standards described above.
  • the communication unit 16 may include, for example, an antenna for transmitting and receiving radio waves, a suitable RF unit, and the like. Further, the communication unit 16 may be configured as an interface such as a connector for connecting to the outside by wire. Since the communication unit 16 can be configured using a known technique for performing wireless communication, a detailed description of the hardware and the like will be omitted.
  • Various types of information received by the communication unit 16 may be supplied to, for example, the storage unit 14, the recognition unit 10, and/or the identification unit 12.
  • Various types of information received by the communication unit 16 may be stored in the storage unit 14 and/or other memory, for example. Further, the communication unit 16 may transmit to the outside, for example, a processing result by at least one of the recognition unit 10 and the identification unit 12, and/or information stored in the storage unit 14.
  • the output unit 18 outputs the identification result by the identification unit 12.
  • the output unit 18 may output the article and/or size information of the article as the identification result by the identification unit 12.
  • the output unit 18 may be any functional unit that stimulates at least one of the user's auditory, visual, and tactile senses, such as sound, voice, light, text, video, and vibration, as output of the identification result by the identification unit 12.
  • the output unit 18 may be at least one of a sound output unit such as a buzzer or a speaker, a light emitting unit such as an LED, a display unit such as an LCD, and a tactile sensation presentation unit such as a vibrator.
  • the electronic device 1 shown in FIG. 1 includes an output section 18.
  • the output unit 18 may be provided outside the electronic device 1.
  • the output unit 18 may function as an interface connected to external equipment.
  • the output unit 18 and the electronic device 1 may be connected by wire, wireless, or a combination of wire and wireless.
  • the article ⁇ 1 and the article ⁇ 2 shown in FIG. 1 are articles having the same or similar shapes but different sizes. That is, it is assumed that the article ⁇ 1 and the article ⁇ 2 have the same or similar designs, and the article ⁇ 1 is small in size and the article ⁇ 2 is large in size. In this case, it has been difficult to improve the accuracy of distinguishing and recognizing the article ⁇ 1 and the article ⁇ 2 from the captured image including the article ⁇ 1 and the article ⁇ 2 shown in FIG.
  • articles of the same or similar form but different sizes are identified based on information on the size of each article and information on the distance at which the article was imaged.
  • FIG. 2 is a diagram illustrating identification processing by the electronic device 1 according to the first embodiment.
  • FIG. 2 is a diagram illustrating an example of how the imaging unit 20 captures an image of an article from above with the article placed on the board 100 as shown in FIG.
  • articles A1, A2, and B placed on the board 100 are shown as objects to be imaged by the imaging unit 20.
  • the board surface 100 shown in FIG. 2 may have an extension parallel to the XY plane shown in FIG. 1, as in FIG. Further, the Z axis shown in FIG. 2 may also be directed upward in the vertical direction, for example, similarly to FIG. 1. In this way, it is assumed that the imaging unit 20 is arranged so as to image the articles A1, A2, and B placed on the board 100 from above.
  • the concept of a rectangle (right quadrilateral) circumscribing the article recognized by the recognition unit 10 is introduced.
  • a rectangle (right-angled quadrilateral) circumscribing the article can be defined.
  • articles A1 and A2 shown in FIG. 2 each have a circular (or elliptical) shape (outer shape), a rectangle circumscribing each can be defined.
  • rectangles circumscribing each of articles A1 and A2 have sides parallel to the X-axis and Y-axis shown in the figure.
  • the rectangles circumscribing each of the articles A1 and A2 do not necessarily have sides parallel to the X-axis and the Y-axis, but may have sides based on a predetermined direction. Since all corners of a rectangle are right angles, the size of an arbitrary article can be defined by the two right-angled sides of the rectangle that circumscribe the article.
  • the lengths of two right-angled sides of a rectangle circumscribing the article recognized by the recognition unit 10 can be expressed as (x, y), for example.
  • the lengths of two right-angled sides of a rectangle circumscribing the article A1 can be expressed as (x1, y1).
  • the lengths of two right-angled sides of a rectangle circumscribing the article A2 are shown as (x2, y2).
  • the rectangle when the shape (outer shape) of the article itself is a rectangle, such as article B shown in FIG. 2, the rectangle may be a rectangle that circumscribes article B.
  • the lengths of two right-angled sides of a rectangle circumscribing article B shown in FIG. 2 may be (x3, y3).
  • size information for each of a plurality of articles may be stored in the storage unit 14, for example, in association with each of the plurality of articles, in order to identify the article together with the size of the article.
  • the size information of each of the plurality of articles may be, for example, the length of two right-angled sides of a rectangle circumscribing the article recognized by the recognition unit 10, as described above. That is, the storage unit 14 of the electronic device 1 according to the first embodiment stores the lengths of two right-angled sides of a rectangle that circumscribes each of the plurality of articles recognized by the recognition unit 10 for each of the plurality of articles. You can remember it in association.
  • FIG. 3 is a diagram showing an example of information stored in the storage unit 14 of the electronic device 1 according to the first embodiment.
  • the electronic device 1 collects information such as the lengths of two right-angled sides of a rectangle circumscribing the article recognized by the recognition unit 10, for each of the plurality of articles. For example, they may be stored in the storage unit 14 in association with each other.
  • the table shown in FIG. 3 shows how product ID, product name, size information x, size information y, price, and other items are stored in association with each product (article) from the left column. Shown conceptually.
  • the product ID may be, for example, the identification number of the product.
  • the product ID indicating article A1 may be set to "1"
  • the product ID indicating article A2 may be set to "2".
  • the product name may be the name of the article.
  • the product name indicating article A1 may be "Food A (large)”
  • the product name indicating article A2 may be "Food A (medium).”
  • the size information x and y may be the lengths (x, y) of two right-angled sides of a rectangle circumscribing the article.
  • the lengths of two right-angled sides of a rectangle circumscribing the article A1 may be 60 mm and 60 mm.
  • the lengths of two right-angled sides of the rectangle circumscribing the article A2 may be set to 45 mm and 45 mm, for example.
  • the price may be the suggested retail price of the article.
  • the price of article A1 may be set to "240 yen”
  • the price of article A2 may be set to "130 yen.”
  • other items may be any information such as information indicating the direction in which the lengths (x, y) of two right-angled sides of a rectangle circumscribing the article are measured.
  • the table shown in FIG. 3 is merely illustrative.
  • the storage unit 14 of the electronic device 1 may not store part of the information on the items shown in FIG. 3, or may store information on items other than those shown in FIG. 3 as appropriate.
  • the electronic device 1 according to the first embodiment may acquire information that may be included in the table shown in FIG. 3 and store it in the storage unit 14, for example, by the time the article identification operation is started.
  • the electronic device 1 may acquire the actual measurement value of the size information of each article by the start of the article identification operation, typically when registering the handled products.
  • the actual measurement value of the size information of each article a value actually measured by a user or the like may be input, or a specification such as a catalog value may be input.
  • the electronic device 1 may acquire size information of each article from an image captured by the imaging unit 20 of the electronic device 1 before starting the article identification operation.
  • the electronic device 1 according to the first embodiment may acquire information that may be included in the table shown in FIG. 3 in advance and store it in the storage unit 14.
  • the electronic device 1 according to the first embodiment may acquire information that may be included in the table shown in FIG. 3 from, for example, an external server via the communication unit 16 as necessary.
  • the article can be identified together with the size by referring to (verifying) information as shown in FIG. can do.
  • the imaging unit 20 is arranged a distance d from the board surface 100 in the positive direction of the Z-axis shown in FIG.
  • the imaging unit 20 is arranged a distance d from the board surface 100 in the positive direction of the Z-axis shown in FIG.
  • the imaging unit 20 is arranged a distance d from the board surface 100 in the positive direction of the Z-axis shown in FIG.
  • the imaging unit 20 is arranged a distance d from the board surface 100 in the positive direction of the Z-axis shown in FIG.
  • the imaging section 20 may be fixed.
  • the distance d shown in FIG. 1 can be set to a fixed value.
  • the length of the distance d shown in FIG. 1 can be measured in advance by actual measurement. Therefore, in the electronic device 1 according to the first embodiment, the distance d shown in FIG. 1 may be a known fixed value.
  • the electronic device 1 corrects the lengths of the two right-angled sides of the rectangle circumscribing the article recognized by the recognition unit 10 according to the distance d, which is a known fixed value.
  • the article recognized by the recognition unit 10 may be an article included in an image captured by the imaging unit 20.
  • the distance d may be, for example, as shown in FIG. 1, a distance from a position where an article is placed to a position where an imaging unit 20 that captures an image of the article is placed.
  • the distance d shown in FIG. 1 becomes longer, the lengths of two right-angled sides of a rectangle circumscribing the article recognized from the image captured by the imaging unit 20 tend to become shorter. Therefore, in accordance with the distance d (known fixed value) shown in FIG. may be determined, for example, by actual measurement. In addition, in accordance with the distance d (known fixed value) shown in FIG. may be determined, for example, from a theoretical value.
  • the corrected lengths of the two right-angled sides of the rectangle circumscribing the article recognized from the image captured by the imaging unit 20 as described above are the two right-angled sides of the rectangle circumscribing the actual article. can be equated with the length of Therefore, according to the electronic device 1, the size information in the storage unit 14 is stored based on the corrected lengths of the two right-angled sides of the rectangle circumscribing the object recognized from the image captured by the imaging unit 20. By reference, the article can be identified along with its size.
  • FIG. 4 is a flowchart explaining the operation of the electronic device 1 according to the first embodiment.
  • the operation (identification operation) of the electronic device 1 according to the first embodiment will be described.
  • the operation shown in FIG. 4 may be started, for example, as shown in FIG. 1, with an article placed on the board 100 and the imaging unit 20 capturing an image of the article.
  • the electronic device 1 identifies the item placed on the board 100 along with its size.
  • the distance d shown in FIG. 1 is assumed to be a known fixed value, as described above.
  • the ratio for correcting the lengths of the two right-angled sides of the rectangle circumscribing the article recognized from the image captured by the imaging unit 20 is known. (I have asked for it).
  • step S11 the electronic device 1 according to the first embodiment acquires an image of the article captured by the imaging unit 20.
  • step S12 the recognition unit 10 recognizes, from the image acquired by the electronic device 1, an article included in (shown in) the image.
  • the number of recognized articles may be one, or two or more.
  • Information on the article recognized by the recognition section 10 is supplied to the identification section 12 .
  • step S13 the identification unit 12 extracts a rectangle that circumscribes the article recognized by the recognition unit 10.
  • the number of rectangles to be extracted may be equal to the number of articles recognized by the recognition unit 10.
  • the rectangle circumscribing the article recognized by the recognition unit 10 does not necessarily have to be extracted as an image through image processing.
  • a rectangle circumscribing the article recognized by the recognition unit 10 may be conceptually extracted.
  • step S14 the identification unit 12 extracts the lengths (x, y) of two right-angled sides of the extracted rectangle.
  • step S15 the identification unit 12 corrects the extracted lengths of the two sides (x, y) according to the distance d to the article.
  • the length of the two sides (x, y) corrected in step S15 will also be referred to as the "corrected length of the two sides (x', y')."
  • the identification unit 12 refers to the size information in the storage unit 14 to match the corrected lengths of the two sides (x', y'). If the corrected lengths of the two sides (x', y') are matched, in step S17, the identification unit 12 identifies the product ID and/or name of the matched product as the product. It may be identified along with the size etc.
  • the thus identified article and the size of the article may be output from the output unit 18, for example, by sound, display, and/or tactile sensation. Further, the identified article and the size of the article may be transmitted to another device such as an external server via the communication unit 16. Further, the identified article and the size of the article may be stored in the storage unit 17. Additionally, the identified item and item size may be registered in a checkout machine, such as an unmanned cash register.
  • the identification unit 12 of the electronic device 1 according to the first embodiment identifies the item based on the lengths (x, y) of the two right-angled sides of the rectangle circumscribing the item recognized by the recognition unit 10. Identify the item along with the size of the item. Furthermore, the storage unit 14 of the electronic device 1 according to the first embodiment may store the lengths of two right-angled sides of a rectangle circumscribing each of the plurality of articles in association with each of the plurality of articles. In this case, the identification unit 12 of the electronic device 1 according to the first embodiment may perform the above-described identification by referring to information stored in the storage unit 14.
  • the identification unit 12 generates a rectangle circumscribing the item recognized by the recognition unit 10 according to a distance d from a position where the item is placed to a position where an imaging unit 20 that captures an image of the item is placed.
  • the lengths of two sides forming right angles may be corrected.
  • the electronic device 1 according to the first embodiment it is possible to identify articles of the same or similar form but different sizes with good accuracy. Therefore, according to the electronic device 1 according to the first embodiment, it is possible to distinguish between articles having a common design and different sizes.
  • the electronic device according to the second embodiment may have the same or similar configuration to the electronic device 1 according to the first embodiment shown in FIG. 1. Therefore, the electronic device according to the second embodiment will be hereinafter referred to as the electronic device 1 according to the second embodiment.
  • the electronic device 1 according to the second embodiment can be configured similarly to the electronic device 1 according to the first embodiment, but performs different processing from the electronic device 1 according to the first embodiment.
  • description of contents that are the same or similar to those of the electronic device 1 shown in FIGS. 1 to 4 may be simplified or omitted as appropriate.
  • the distance d shown in FIG. 1 is a known fixed value. However, depending on the actual usage, there may be situations where the distance d shown in FIG. 1 cannot be accurately known in advance. Furthermore, there may be a situation where the distance d shown in FIG. 1 is variable in the first place, for example because the imaging unit 20 is movable.
  • the electronic device 1 makes it possible to identify the article together with the size of the article even when the distance d shown in FIG. 1 is an unknown value or a variable value.
  • FIG. 5 is a diagram illustrating identification processing by the electronic device 1 according to the second embodiment.
  • a predetermined reference mark R is also imaged by the imaging unit 20, as shown in FIG.
  • This reference mark R may be imaged by the imaging unit 20 so that it fits in the same image as the article whose size is to be identified. Further, as long as the distance d shown in FIG. 1 remains unchanged, the reference mark R may be imaged by the imaging unit 20 as an image different from the image of the article whose size is to be identified.
  • the actual length of a predetermined portion of the reference mark R is a known fixed value. Further, the actual length of the predetermined portion of the reference mark R shown in FIG. 5 can be measured in advance by actual measurement. Therefore, in the electronic device 1 according to the second embodiment, the actual length of the predetermined portion of the reference mark R shown in FIG. 5 may be set to a known fixed value. For example, it is assumed that the actual measurement value of the length of the reference mark R shown in FIG. 5 in the lateral direction (direction parallel to the X-axis) is 50 mm.
  • the reference mark R may be arranged so as to be imaged by the imaging unit 20 when the imaging unit 20 images the articles A1, A2, B, etc. placed on the board 100.
  • the electronic device 1 according to the second embodiment has two sides forming right angles of a rectangle circumscribing the article recognized by the recognition unit 10, depending on the actual length of a predetermined portion of the reference mark R, which is a known fixed value. The length of may be corrected. Regarding other points, the electronic device 1 according to the second embodiment may operate in the same manner as the electronic device 1 according to the first embodiment.
  • the reference mark R can take various forms.
  • the reference mark R shown in FIG. 5 is intended to be used as a reference for the length in the lateral direction (direction parallel to the X-axis).
  • the reference mark R is made into a ribbon-shaped area, so that it can be used as a reference for the length in the horizontal direction (direction parallel to the X axis) and the vertical direction (direction parallel to the Y axis).
  • the reference mark R may have a form that is difficult to be determined as noise when recognized by the recognition unit 10 and identified by the identification unit 12.
  • the reference mark R may be a mark attached on the board 100 on which the article is placed, as shown in FIG. 5, for example. Further, in the second embodiment, the reference mark R may be a mark attached to an article (for example, the board 100) whose size is different from the article to be identified, as shown in FIG. 5, for example. Further, in the second embodiment, the reference mark R may be a mark attached to a position on the board 100 where the article is placed and imaged together with the article by the imaging unit 20.
  • FIG. 6 is a flowchart illustrating the operation of the electronic device 1 according to the second embodiment.
  • the operation (identification operation) of the electronic device 1 according to the second embodiment will be described.
  • points that differ from the operation of the electronic device 1 according to the first embodiment shown in FIG. 4 will be described.
  • the distance d shown in FIG. 1 may be unknown or variable, as described above.
  • the ratio for correcting the length is known (calculated).
  • step S15 of the operation shown in FIG. 4 the identification unit 12 corrected the lengths (x, y) of the two extracted sides according to the distance d shown in FIG.
  • the reference mark R may be imaged by the imaging section 20 before the identification section 12 executes the operation of step S25.
  • the operation shown in FIG. 6 can be performed based on the same idea as the operation shown in FIG. 4.
  • the identification unit 12 of the electronic device 1 uses the recognition unit 10 according to the actual length of the predetermined portion of the reference mark R imaged by the imaging unit 20 that captures an image of the article.
  • the lengths of two perpendicular sides of a rectangle circumscribed to the article recognized by can be corrected.
  • the reference mark R may be a mark attached to an article different from the article identified along with its size.
  • the reference mark R may be a mark attached to a position on a surface on which an article is placed (for example, the board surface 100) and is imaged together with the article by the imaging unit 20.
  • the electronic device 1 according to the second embodiment it is possible to identify articles of the same or similar form but different sizes with good accuracy. Therefore, with the electronic device 1 according to the second embodiment as well, it is possible to distinguish between items that have a common design but differ in size. Furthermore, according to the electronic device 1 according to the second embodiment, even if the distance d shown in FIG. 1 is unknown or variable, the article can be identified along with the size of the article.
  • the recognition unit 10 and the identification unit 12 have been described as separate functional units.
  • the electronic device 1 may include a processing section 11 having the functions of the recognition section 10 and the identification section 12 instead of the recognition section 10 and the identification section 12.
  • the processing unit 11 may include at least one processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor).
  • the processing unit 11 may be realized by a single processor or may be realized by several processors. In this way, the electronic device 1 may identify the article along with its size based on the lengths of the two right-angled sides of the rectangle circumscribing the article, which are recognized from the image of the article. good.
  • the two sides of the rectangle circumscribing the article are at right angles.
  • the two sides of the rectangle circumscribing the article do not have to be at right angles.
  • the two sides of the rectangle circumscribing the article may be set at angles that match the outer shape of the article.
  • the lengths of two sides of a rectangle circumscribing the article may be processed as (xm, ym), for example.
  • the storage unit 14 may store size information xm and size information ym of the article, for example, for each article (article).
  • the rectangle circumscribing the article does not have to be a parallelogram.
  • the storage unit 14 may store size information xm', xm'', ym', ym'' of the article, for example, for each article (article).
  • the article is identified based on the length of at least two sides of the rectangle circumscribing the article, along with the size of the article.
  • the article may be identified based on a rectangle circumscribing the article, as well as the size of the article. That is, in one embodiment, the article may be identified along with its size based on criteria other than at least two sides of a rectangle circumscribing the article or sides constituting the rectangle circumscribing the article. In this way, the electronic device 1 may identify the article along with the size of the article based on the rectangle circumscribing the article recognized from the image of the article.
  • the article may be identified along with its size based on one of two sides forming one corner of a rectangle circumscribing the article.
  • articles can be identified along with their size simply based on the length of one side.
  • it may be determined in advance which one of the two sides forming one corner of a rectangle circumscribing the article is used to identify the article and the size of the article.
  • one side of two sides forming one corner of a rectangle circumscribing the article may be one side of the rectangle in a specific direction (or close to the specific direction).
  • one side of two sides forming one corner of a rectangle circumscribing the article may be one of the two sides forming the rectangle and having the maximum or minimum length.
  • the electronic device 1 may identify the article along with the size of the article based on one of the two sides of the rectangle circumscribing the article. Further, when identifying the size of the article based on the circumscribed rectangle, the electronic device 1 may identify the size based on at least one side of the circumscribed rectangle.
  • the article may be identified along with its size based on the length of a diagonal line of a rectangle circumscribing the article.
  • the article and the size of the article may be identified based on one side of the two diagonals of the rectangle circumscribing the article, or the article and the size of the article may be identified based on both of the two diagonals.
  • one side of two diagonals of a rectangle circumscribing the article may be one side of the diagonal in a specific direction (or close to the specific direction).
  • one side of the two diagonals of the rectangle circumscribing the article may be the longer one or the shorter one of the two diagonals.
  • the electronic device 1 may identify the article along with the size of the article based on the diagonal of the rectangle circumscribing the article. Moreover, when identifying the size of an article based on the circumscribed rectangle, the electronic device 1 may identify the size based on the diagonal of the circumscribed rectangle.
  • Embodiments according to the present disclosure can also be realized as a method, a program, or a storage medium on which a program is recorded, which is executed by a processor included in an apparatus. It is to be understood that these are also encompassed within the scope of the present disclosure.
  • the embodiments described above may be implemented, for example, as a method of controlling the electronic device described above. Furthermore, the embodiments described above may be implemented, for example, as a system including the electronic device described above. For example, the embodiment described above may be implemented as a system including the electronic device 1 and the imaging unit 20. Furthermore, the embodiments described above may be implemented, for example, as a program executed by the electronic device or system described above. Furthermore, the embodiments described above may be implemented, for example, as a recording medium recording a program executed by the electronic device or system described above, that is, a computer-readable recording medium.
  • the electronic device 1 according to one embodiment may be configured to have only the identification section 12 or only the processing section 11 described above.
  • the electronic device 1 according to the embodiment can identify the article based on the lengths of two right-angled sides of a rectangle circumscribing the article, which is recognized from the image of the article. May be identified.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)

Abstract

Un instrument électronique comprend une unité de reconnaissance qui reconnaît un article à partir d'une image dans laquelle l'article est capturé, et une unité d'identification qui identifie l'article ainsi que la taille de l'article sur la base de la longueur de deux côtés formant un angle droit d'un rectangle entourant l'article reconnu par l'unité de reconnaissance.
PCT/JP2023/013865 2022-04-04 2023-04-03 Instrument électronique et procédé de commande d'instrument électronique WO2023195456A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022062663 2022-04-04
JP2022-062663 2022-04-04

Publications (1)

Publication Number Publication Date
WO2023195456A1 true WO2023195456A1 (fr) 2023-10-12

Family

ID=88242964

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/013865 WO2023195456A1 (fr) 2022-04-04 2023-04-03 Instrument électronique et procédé de commande d'instrument électronique

Country Status (1)

Country Link
WO (1) WO2023195456A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004212142A (ja) * 2002-12-27 2004-07-29 System House Fukuchiyama:Kk 画像寸法の測定方法
JP2013054673A (ja) * 2011-09-06 2013-03-21 Toshiba Tec Corp 情報処理装置及びプログラム
JP2015201193A (ja) * 2014-04-09 2015-11-12 英懋達光電股▲ふん▼有限公司Ｉｎｖｅｎｔｅｃ Ｅｎｅｒｇｙ Ｃｏｒｐｏｒａｔｉｏｎ 画像認識装置及び画像認識方法
JP2021152741A (ja) * 2020-03-24 2021-09-30 株式会社フジタ 発話制御装置
JP2021179721A (ja) * 2020-05-12 2021-11-18 富士通株式会社 会話情報推定装置、方法、及びプログラム
JP2021197105A (ja) * 2020-06-18 2021-12-27 京セラ株式会社 情報処理システム、情報処理装置、及び、情報処理方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004212142A (ja) * 2002-12-27 2004-07-29 System House Fukuchiyama:Kk 画像寸法の測定方法
JP2013054673A (ja) * 2011-09-06 2013-03-21 Toshiba Tec Corp 情報処理装置及びプログラム
JP2015201193A (ja) * 2014-04-09 2015-11-12 英懋達光電股▲ふん▼有限公司Ｉｎｖｅｎｔｅｃ Ｅｎｅｒｇｙ Ｃｏｒｐｏｒａｔｉｏｎ 画像認識装置及び画像認識方法
JP2021152741A (ja) * 2020-03-24 2021-09-30 株式会社フジタ 発話制御装置
JP2021179721A (ja) * 2020-05-12 2021-11-18 富士通株式会社 会話情報推定装置、方法、及びプログラム
JP2021197105A (ja) * 2020-06-18 2021-12-27 京セラ株式会社 情報処理システム、情報処理装置、及び、情報処理方法

Similar Documents

Publication Publication Date Title
US11353319B2 (en) Method for a mobile dimensioning device to use a dynamic accuracy compatible with NIST standard
US10612958B2 (en) Mobile dimensioner apparatus to mitigate unfair charging practices in commerce
US10097949B2 (en) Device, system, and method for determining the status of lanes
CN110955367B (zh) 显示装置及其控制方法
US9501163B2 (en) Apparatus and method for activating a trigger mechanism
US20170053146A1 (en) Device with camera for accelerated barcode scan reading
US10098171B2 (en) Method and apparatus for performing wireless communication between terminals
WO2016052382A1 (fr) Dispositif de traitement d'informations, système de gestion d'étiquette de gondole, procédé de commande, et programme
CN113630551A (zh) 通过利用相机的应用提供各种功能的电子装置及操作方法
JP6646208B2 (ja) 表示制御方法、表示制御プログラムおよび情報処理装置
CA2947858C (fr) Appareil et procede pour realiser un processus de capture de donnees variable
CN112488914A (zh) 图像拼接方法、装置、终端及计算机可读存储介质
US10984249B2 (en) Information processing apparatus, system, control method for information processing apparatus, and non-transitory computer readable storage medium
CN105957114B (zh) 对图像中多边形进行检测的方法及装置
WO2023195456A1 (fr) Instrument électronique et procédé de commande d'instrument électronique
JP5901680B2 (ja) 携帯端末装置および表示装置
JP6851337B2 (ja) 撮像装置、制御方法及び制御プログラム
CN109981970B (zh) 一种确定拍摄场景的方法、装置和机器人
WO2019181035A1 (fr) Système d'enregistrement, procédé d'enregistrement, et programme
JP6875061B2 (ja) 画像判定システム、画像判定方法、画像判定プログラム、画像判定プログラムを記録する記録媒体
JP2015228079A (ja) 情報処理装置、制御方法、及びプログラム
CN109472645A (zh) 广告播放的方法、装置和存储介质
JP7322945B2 (ja) 処理装置、処理方法及びプログラム
CN113645400B (en) Electronic device providing various functions by application using camera and operating method thereof
JP4591153B2 (ja) 通信機能付き携帯端末装置及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23784742

Country of ref document: EP

Kind code of ref document: A1