TWI740794B - Commodity marketing system for determining human gait type based on camera and pressure sensors - Google Patents

Abstract

A commodity marketing system baes on human gait type comprises a sensing device, a financial product database, a server, and a teller host. The server is electrically connected with the financial product database, the server, and the teller host. The sensing device is configured to capture foot information of a user in a sensing area. The financial product database stores a plurality of financial product combinations and a plurality of gait types corresponding to the financial product combinations. The server is used to determine a gait type of the user according to the foot information, to search a financial product combination corresponding to the gait type of the user from the financial product database, and to transmit the searched financial product combination to the teller host.

Description

Commodity marketing system for judging the type of human foot based on camera and pressure sensor

The present invention relates to a merchandise marketing system, in particular to a merchandise marketing system based on the type of human foot status.

In recent years, with the gradual maturity of the market, financial institutions can be seen everywhere. In today's era of information explosion, customers can obtain information on financial products provided by various financial institutions through multiple channels and compare them. Therefore, active marketing is often the key to retaining or developing customers. In addition, innovative financial products are constantly being introduced and new, and banks need to provide customers with channels to understand these financial products in order to avoid information gaps that cause both parties to miss trading opportunities.

Traditionally, when a customer wants to go to the counter window of a financial institution to handle various business, he must first draw a number plate, and then he can go to the counter window to ask the bank clerk for assistance after the number is called. However, before an unfamiliar customer comes to the counter window, the service staff cannot know the customer's demand for financial products. Therefore, the banker cannot provide the customer with appropriate financial product information.

In view of this, there is a need for a computer-assisted system that can assist bankers in marketing financial products in order to improve the above shortcomings.

One purpose of the present invention is to provide a product marketing system based on the foot type of the human body. According to the foot type of the user, the most suitable financial product information for the user is sent to the user, thereby improving the time for the system to send the financial product combination. On the correctness.

The present invention provides a product marketing system based on human foot type, including a sensing device, a financial product database, a server and a server host, and the server is electrically connected to the sensing device, financial product database and the server host . The sensing device is used to capture the user's foot information in the sensing area. The financial product database is used to store multiple financial product combinations and their corresponding multiple status types. The server is used to determine the user's foot status type based on the foot information, search for the financial product combination corresponding to the user's foot status type from the financial product database, and send the searched financial product combination to the server host.

According to the above-mentioned commodity marketing system of the present invention, the server sends the most suitable combination of financial commodities to the server host according to the user's status type. Therefore, for the same type of financial product combination, the product marketing system can send the financial product combination to the server host at a more precise time point, thereby improving the operating efficiency of the product marketing system and reducing the waste of hardware resources.

The above description of the content of the present invention and the description of the following embodiments are used to demonstrate and explain the spirit and principle of the present invention, and to provide a further explanation of the scope of the patent application of the present invention.

The detailed features and advantages of the present invention will be described in detail in the following embodiments. The content is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and according to the content disclosed in this specification, the scope of patent application and the drawings. Anyone who is familiar with relevant skills can easily understand the purpose and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention by any viewpoint.

Figure 1 shows the functional block diagram of the first embodiment of the product marketing system based on the human foot type of the present invention, and Figure 2 shows the use of the first embodiment of the product marketing system based on the human foot type of the present invention State diagram. As shown in Figures 1 and 2, the product marketing system based on the human foot status type includes a sensing device 11, a financial product database 12, a server 13, and a server host 14, and the sensing device 11, financial The commodity database 12, the server 13, and the server host 14 are respectively provided with their own communication interfaces. Each communication interface can be a wired network module or a wireless network module, such as a local area network (LAN) module, Wi -Fi module, fourth-generation mobile communication technology module (referred to as 4G), Long Term Evolution (LTE) module, fifth-generation mobile communication technology module (referred to as 5G) or a combination thereof. In this way, any two of the sensing device 11, the financial product database 12, the server 13, and the server host 14 can transmit data and signals bidirectionally.

As shown in Figures 1 and 2, the sensing device 11 is used to capture the user's foot information in the sensing area S, and the sensing area S is for example at the entrance of a business hall door, at the exit of a business hall door, or inside a business hall . In this embodiment, the sensing device 11 may include multiple cameras 111, the sensing area S is at the entrance of the business hall gate, and the cameras 111 are erected above the sensing area S. When the user enters the sensing area S of the financial institution, the cameras 111 capture multiple foot images of the user and send the foot images to the server 13. The above-mentioned users may be customers who have made deposits, withdrawals, remittances, foreign exchange transactions, fund investment transactions, insurance product purchases, financial product purchases, or loans with the financial institution, or hold a financial card or joint name of the financial institution Customers of cards or credit cards, or people who have never had any financial transactions with financial institutions. The financial product database 12 is used to store multiple financial product combinations and their corresponding multiple status types. In this embodiment, the financial product combinations include a first financial product combination 121, a second financial product combination 122, and a third financial product combination 123. The average annual return rate in descending order is the first financial product portfolio 121, the second financial product portfolio 122, and the third financial product portfolio 123, and the investment risk in descending order is the first financial product portfolio 121, The second financial product combination 122 and the third financial product combination 123. The first financial product portfolio 121 includes, for example, single country equity funds, emerging market bond funds, and private equity funds, the second financial product portfolio 122 includes, for example, regional equity funds and balanced funds, and the third financial product portfolio 123 includes, for example, global funds. Stock funds and government bond funds, but not limited to the above types.

As shown in Figures 1 and 2, the foot state types include an inner octapod state 124 (Pigeon Toe Gait), a normal foot state 125, and an outer octapod state 126 (Out Toe Gait). The state 124, the normal foot state 125, and the outer eight-foot state 126 correspond to the first financial product combination 121, the second financial product combination 122, and the third financial product combination 123, respectively. Specifically, within a predetermined time interval, randomly collect financial transaction record data and status type data of multiple customers, and use machine learning algorithms to determine whether each customer’s investment attributes are active and robust based on the financial transaction record data. Or conservative, and count the number of customers with the same type of foot status that are active, stable, and conservative, respectively. The investment attribute with the largest number means that it has the highest correlation with the foot status type. According to the investment attributes with the highest correlation degree corresponding to each foot type, the product marketing system of the present invention sets the investment risk attributes of users in the inner, normal, and outer octapods as active and robust. Type and conservative type. Generally speaking, active users can tolerate capital losses caused by market reversals and have a high willingness to purchase financial products with high returns. Robust users can accept short-term market fluctuations and have a high willingness to obtain investment returns through risk diversification. As for the conservative users, they have low risk tolerance and willingness, and have a high willingness to purchase financial products with a high degree of principal protection and stable returns.

The server 13 is provided with a storage device 131. The storage device 131 can be a non-transitory computer readable storage medium, such as memory, memory card, optical disc, video tape, computer tape or Any combination of it. The above-mentioned memory can be, for example, read-only memory (ROM), flash (Flash) memory, field-programmable gate array (FPGA), or other forms of memory cells or a combination thereof. The storage device 131 is used to store the foot state determination program 132. The server 13 executes the foot state determination program 132 based on the foot images to determine the user's foot state type, and then searches the financial commodity database 12 for the foot state of the user. The financial product combination corresponding to the state type is finally transmitted to the server host 14 with the searched financial product combination. The server host 14 is, for example, a personal computer, wearable device or mobile device operated by a banker, whereby the banker can introduce the combination of financial products received by the server host 14 to users entering the financial institution.

Fig. 3 is a flowchart of the first embodiment of the foot state judgment program executed by the commodity marketing system based on the human foot state type of the present invention. Referring to FIGS. 1 to 3 together, in step S101, the server 13 determines the user's travel reference line F1 and the foot long axis extension direction F2 of each foot image E according to the user's multiple foot images E, where the travel The reference line F1 divides the images formed by the different feet of the user among the foot images E on different sides of the travel reference line F1. For example, the foot images formed by the user's left foot are all located on the left side of the travel reference line F1, and the foot images formed by the user's right foot are all located on the right side of the travel reference line F1. In step S102, the server 13 determines the position of the intersection point P between the extension direction F2 of the long foot axis of one of the foot images E and the travel reference line F1. In step S103, the server 13 calculates the first distance d1 between the intersection point P and the front end E1 of the foot image E and the second distance d2 between the rear end E2 of the foot image E and the foot image E. The following takes the foot image formed by the user's right foot as an example to illustrate how to determine the user's foot type according to the first distance d1 and the second distance d2 through the following steps S104-S110. In step S104, the server 13 determines whether the first distance d1 is less than the second distance d2. When the server 13 determines that the first distance d1 is less than the second distance d2, step S105 is executed: the server 13 determines the first distance d1 Whether the first distance d2 is less than a threshold value, when it is confirmed that the first distance d1 and/or the second distance d2 is not less than the threshold value, step S106 is executed: the server 13 determines that the user's foot state is a normal foot state . When it is confirmed that both the first distance d1 and the second distance d2 are less than the threshold value, step S107 is executed: the server 13 determines that the user's foot position type belongs to the inner octapod state. When the server 13 confirms that the first distance d1 is greater than the second distance d2, step S108 is executed: the server 13 determines whether the first distance d1 and the second distance d2 are both smaller than the threshold. When the server 13 confirms that the first distance d1 and/or the second distance d2 is not less than the threshold value, step S109 is executed: the server 13 determines that the foot state of the user belongs to the normal foot state. When the server 13 confirms that the first distance d1 and the second distance d2 are both smaller than the threshold value, step S110 is executed: the server 13 determines that the user's foot state belongs to the outer octapod state.

4A to 4C respectively show schematic diagrams of the travel direction and the extension direction of the long axis of the foot of different human foot types. As shown in FIG. 4A, the first distance d1 between the point of intersection P and the front end of the foot E1 is smaller than the first distance d2 between the point of intersection P and the rear end of the foot E1, and the server 13 determines that the user's foot state is the inner octapod state. As shown in FIG. 4B, the travel reference line F1 is parallel to the extension direction F2 of the long axis of the foot, so the first distance d1 and the second distance d2 both approach infinity and exceed the threshold, so the server 13 determines the user's foot state type It is a normal foot state. As shown in FIG. 4C, the first distance d1 between the point of intersection P and the front end of the foot E1 is greater than the first distance d2 between the point of intersection P and the rear end of the foot E1, and the server 13 determines that the user's foot state is the outer octapod state.

In other embodiments, the sensing area S is a transparent or semi-transparent floor, the cameras 111 are erected below the sensing area S, and the transparency of the sensing area S can at least allow the cameras 111 to capture the user Complete image of the sole of the foot. Then, the foot state determination procedure of FIG. 3 is executed through multiple plantar images captured by the camera 111 in the sensing area S.

FIG. 5 is a schematic diagram of the use state of the second embodiment of the merchandise marketing system based on the human foot state type of the present invention, and FIG. 6 is a schematic diagram of the foot state judgment program executed by the merchandise marketing system based on the human foot state type of the present invention The flowchart of the second embodiment. As shown in FIG. 5, the sensing device 11 may include multiple cameras 111. The sensing area S is a transparent or translucent floor. The cameras 111 are arranged below the sensing area S in an array, for example, and the server 13 Designate different coordinate positions for these cameras 111 respectively. When the user's foot enters the sensing area S, each camera 111 captures a part of the user's foot image, and the server 13 receives the partial foot image and composes the partial foot image into a complete foot image. In this embodiment, the foot image is the sole image of the user, and the transparency of the sensing area S is at least so that the camera 111 can capture the complete sole image of the user and can clearly distinguish the sole from each sole image. The color difference between the damaged part and other parts. As shown in FIG. 6, in step S201, the server 13 receives a plurality of partial foot images of the user. In step S202, the server 13 combines the partial foot images into a complete foot image. In step S203, the server 13 divides the foot image into a plurality of foot regions along the horizontal direction. In step S203, the server 13 sets the divided foot regions to correspond to different foot position types. In step S204, the server 13 performs grayscale conversion on the foot image to obtain grayscale values of multiple pixels in each foot region. In step S205, the server 13 calculates the average gray scale value of the pixels in each foot area. In step S206, the server 13 determines the foot position type corresponding to the foot area with the smallest average gray scale value as the user's foot position type.

FIG. 7 is a schematic diagram showing an embodiment in which the foot image in FIG. 6 is divided into multiple foot regions. As shown in FIG. 7, the server 13 divides the foot image along the horizontal direction (X-axis direction) into an inner foot area R1, a middle foot area R2, and an outer foot area R3. Since the user with the inner foot position is more inclined to the medial foot region R1, the sole wear is usually concentrated in the medial foot region R1, resulting in the pixels in the medial foot region R1 having the smallest average gray scale value. Since users with normal feet tend to focus on the mid-foot area R2, sole wear is usually concentrated in the mid-foot area R2, resulting in pixels in the mid-foot area R2 having the smallest average gray scale value. Because the user in the outer octapod state, the center of gravity of walking is more inclined to the outer foot area R3, so the sole wear is usually concentrated in the outer foot area R3, resulting in the pixels in the outer foot area R3 having the smallest average gray scale value .

FIG. 8 is a schematic diagram of the use state of the third embodiment of the product marketing system based on the human foot state type of the present invention, and FIG. 9 is a diagram showing the foot state judgment program executed by the product marketing system based on the human foot state type of the present invention Flow chart of the third embodiment. As shown in FIG. 8, the sensing device 11 may include multiple cameras 111 and multiple pressure sensors 112. The sensing area S is a transparent or translucent floor. The cameras 111 and the pressure sensors 112 may For example, arranged in an array below the sensing area S, the server 13 respectively designates different coordinate positions for the cameras 111 and the pressure sensors 112, and the positions of the cameras 111 are aligned with the pressure sensors. The position of the sensor 112 is located below the pressure sensors 112. For example, the pressure sensor 112 and the camera 111 aligned up and down have the same X-axis and Y-axis coordinates, and the Z-axis coordinates of the camera are smaller than the Z-axis coordinates of the pressure sensor 112. The degree of transparency of the sensing area S at least allows the camera 111 to capture a complete image of the user's foot. When the user's foot enters the sensing area S, at least some of the pressure sensors 112 are activated to generate a plurality of pressure sensing values, and the server 13 enables the activated pressure sensors 112 There are a plurality of cameras 111 corresponding to the bottom of, so that each camera 111 captures part of the user's foot image. As shown in FIG. 9, in step S301, the server 13 receives a plurality of partial foot images and a plurality of pressure sensing values, and the pressure sensing values are respectively distributed in the partial foot images. In step S302, the server 13 composes these partial foot images into a complete foot image. In step S303, the server 13 divides the foot image into a plurality of foot regions along the horizontal direction. In step S304, the server 13 is used to set the foot regions to correspond to different foot position types. In step S305, the server 13 calculates an average pressure sensing value of a plurality of pressure sensing values distributed in each foot area. In step S306, the server 13 determines the foot position type corresponding to the foot area with the smallest average pressure sensing value as the user's foot position type.

FIG. 10 is a schematic diagram showing an embodiment in which the foot image in FIG. 9 is divided into multiple foot regions. As shown in FIG. 10, the foot image is divided into a foot medial area R4, a foot middle area R5, and a foot lateral area R6 along the horizontal direction. Since the user in the internal foot position has a walking center of gravity that is more inclined to the medial foot region R4, the medial foot region R4 should have the maximum average pressure sensing value. Since users with normal feet have a walking center of gravity that is more inclined to the mid-foot area R5, the mid-foot area R5 should have the maximum average pressure sensing value. Since the user in the outer octapod state has a walking center of gravity that is more inclined to the outer foot area R6, the outer foot area R6 should have the largest average pressure sensing value.

In summary, in the product marketing system based on the human foot type of the present invention, the server sends the most suitable combination of financial products for the user to the server host according to the user's foot type. Therefore, for the same type of financial product combination, the human foot type-based product marketing system of the present invention can send the same type of financial product combination to the server host at a more precise time point than the conventional system. In this way, the operating efficiency of the product marketing system based on the human foot type can be improved, and the waste of hardware resources can be reduced at the same time.

Although the present invention is disclosed in the foregoing embodiments, it is not intended to limit the present invention. All changes and modifications made without departing from the spirit and scope of the present invention fall within the scope of the patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the attached scope of patent application.

11 Sensing device 111 cameras 112 pressure sensor 12 Financial Commodity Database 121 First Financial Product Portfolio 122 Second Financial Product Portfolio 123 Third Financial Product Portfolio 124 Inner Octopod State 125 Normal Foot 126 Outer Octopod 13 server 131 storage device 132 Foot State Judgment Program 14 server host S sensing area F1 travel reference line E foot image F2 foot long axis extension direction P intersection E1 front end of the foot d1 first distance E2 rear end of foot d2 second distance R1, R4 medial area of the foot R2, R5 mid-foot area R3, R6 lateral area of the foot

Fig. 1 is a functional block diagram of the first embodiment of a merchandise marketing system based on human foot type according to the present invention. FIG. 2 is a schematic diagram showing the use state of the first embodiment of the product marketing system based on the human foot type of the present invention. FIG. 3 is a flow chart showing the first embodiment of the procedure for executing the foot state judgment process of the commodity marketing system based on the human foot state type of the present invention. 4A to 4C respectively show schematic diagrams of the travel direction and the extension direction of the long axis of the foot corresponding to different foot position types. FIG. 5 is a schematic diagram showing the use state of the second embodiment of the product marketing system based on the human foot type of the present invention. FIG. 6 is a flowchart showing a second embodiment of the foot state judgment program executed by the product marketing system based on the human foot state type of the present invention. FIG. 7 is a schematic diagram showing an embodiment of dividing the foot image into multiple regions in FIG. 6. FIG. 8 is a schematic diagram showing the use state of the third embodiment of the product marketing system based on the human foot type of the present invention. FIG. 9 is a flowchart of the third embodiment of the foot state judgment program executed by the product marketing system based on the human foot state type of the present invention. FIG. 10 is a schematic diagram showing an embodiment of dividing the foot image into multiple regions in FIG. 9.

11 Sensing device 111 cameras 12 Financial Commodity Database 121 First Financial Product Portfolio 122 Second Financial Product Portfolio 123 Third Financial Product Portfolio 124 Inner Octopod State 125 Normal Foot 126 Outer Octopod 13 server 131 storage device 132 Foot State Judgment Program 14 server host

Claims (3)

A product marketing system based on cameras and pressure sensors to determine the type of human foot status, including: a sensing device for capturing foot information of a user in a sensing area; a financial product database, electrical Connected to the sensing device and storing a plurality of financial product combinations and corresponding foot state types; and a server electrically connected to the sensing device and the financial product database, the server according to the foot The information determines the user's foot state type, and the server is used to search for the financial product combination corresponding to the user's foot state type from the financial product database; and a server host is electrically connected to the server The server host is a personal computer, a wearable device or a mobile device; wherein the server transmits the searched financial product combination to the server host, and the sensing device includes a plurality of cameras and a plurality of pressure Sensors, the cameras are used to sense a plurality of sole images, the pressure sensors are used to sense a plurality of pressure sensing values, the foot information includes the sole images and the pressure sensing values, the The cameras and the pressure sensors are located below the sensing area, the positions of the cameras are aligned with the pressure sensors and are located below the pressure sensors, and the server is used to determine the soles of the shoes. The image and the pressure sensing values perform a foot state determination process to determine the user's foot state type. The commodity marketing system for judging the type of human foot state based on a camera and a pressure sensor as described in claim 1, wherein the foot state judging program includes: dividing one of the foot images into multiple foot regions along a horizontal direction; Perform a grayscale conversion on the foot image to obtain the grayscale value of multiple pixels in each foot area; calculate the average grayscale value of each foot area separately; and correspond to the foot area with the smallest average grayscale value The foot state type of is judged as the user's foot state type. The product marketing system for judging the type of human foot state based on a camera and a pressure sensor as described in claim 1, wherein the foot state judging program includes: dividing one of the foot images into a plurality of foot regions along a horizontal direction ; Set these foot areas to correspond to different foot state types; calculate the average pressure sensing value of each foot area; and determine the foot state type corresponding to the foot area with the smallest average pressure sensing value to be used The foot type of the person.

Images