CN104536824A - Method for achieving Chelsio 40 G network card performance optimization - Google Patents

Abstract

The invention discloses a method for achieving Chelsio 40 G network card performance optimization. Under a LINUX system, information of a tested network card is automatically read through related commands; meanwhile, interruption binding is automatically achieved, the CPU pressure is balanced, and the network card performance optimization can be rapidly and accurately carried out. By means of the method, the allocation process can be rapidly achieved, and the efficiency can be greatly improved; in addition, errors and leakage possibly caused during manual allocation can be avoided; in addition, operation is simple, the practicability is high, and a good effect on certain problem analysis, product parameter performance optimization and the like is achieved.

Description

A kind of method realizing Chelsio 40G network interface card Performance tuning

Technical field

The present invention relates to computer technology, specifically a kind of method realizing Chelsio 40G network interface card Performance tuning.

Background technology

Along with the development of current measuring technology, various testing tool, testing software and method are more and more applied to the test of server product and various parts.

Usually carrying out Test Network snaps past in journey, and all can meet the situation that the test performance of some network interface cards and theoretical performance differ greatly, the reason that this thing happens is had nothing in common with each other.Generally speaking, bind relevant to the interruption of CPU and network interface card.The Chelsio 40G network interface card introduced, when doing compatibility test, finds that bandwidth cannot reach the test of theoretical bandwidth 90% by standard, but through attempting optimizing, can be reached through standard.And namely the present invention has done some tentative tunings for Chelsio 40G network interface card, to reaching the object of Chelsio 40G network interface card performance optimization.

Summary of the invention

For the weak point that prior art exists, we are bright provides a kind of method realizing Chelsio 40G network interface card Performance tuning.

A kind of method realizing Chelsio 40G network interface card Performance tuning of the present invention, the technical scheme solving the problems of the technologies described above employing is as follows: the method is under LINUX system, pass through related command, realize the information of automatic read test network interface card, automatically realize interrupting binding simultaneously, balanced CPU pressure, can carry out network interface card Performance tuning fast and accurately.

These concrete steps realizing the method for Chelsio 40G network interface card Performance tuning comprise:

Step one, search Chelsio 40G network interface card, and start interface;

Step 2, determine CPU core task amount and respectively interrupt, and automatically binding;

Step 3, driver module reload.

The beneficial effect that the method for a kind of Chelsio of realization 40G network interface card Performance tuning of the present invention compared with prior art has is: the method can realize the performance optimization of Chelsio 40G network interface card fast, closely may reach its theoretical bandwidth; Layoutprocedure can be realized fast by the method, greatly raise the efficiency, and the mistake that may occur when can avoid artificially configuring, leakage; And the method is simple to operate, practicality is comparatively strong, has good effect, and offer reference with other network interface cards for being applied to for some case studies, product parameters Performance tuning etc.

Embodiment

For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with specific embodiment, a kind of method realizing Chelsio 40G network interface card Performance tuning of the present invention is further described.

A kind of method realizing Chelsio 40G network interface card Performance tuning of the present invention is under LINUX system, by related command, realizes respectively interrupting binding and verification operation result realizes.

Embodiment:

A kind of method realizing Chelsio 40G network interface card Performance tuning described in the present embodiment, by related command, namely by running corresponding program, realize the information of automatic read test network interface card, automatically realize interrupting binding, balanced CPU pressure, can carry out network interface card Performance tuning fast and accurately simultaneously.The concrete steps of the method are as follows:

Step one, search Chelsio 40G network interface card, and start interface;

Step 2, determine CPU core task amount and respectively interrupt, and automatically binding;

Step 3, driver module reload.

Realize in the method for Chelsio 40G network interface card Performance tuning described in the present embodiment, step one searches Chelsio 40G network interface card, and the specific implementation content starting interface is as follows:

# Find Chelsio devices

# commands path

ETHTOOL=`which ethtool 2> /dev/null`

IFUP=/sbin/ifup

CXGBTOOL=`which cxgbtool 2> /dev/null`

KILLALL="`which killall` -q"

SYSCTL="`which sysctl` -q -w"

usage()

{

echo "Usage: $0 [options]"

echo "options:"

echo " -C Disable binding IRQs to CPUs (smp_affinity)."

echo " -D Do not disable IRQ balance daemon."

echo " -t Write tx_coal=2 to modprobe.d/conf."

echo " -T Remove tx_coal=2 from modprobe.d/conf."

echo

exit

}

# Look for cxgb4 devices

list_chelsio_dev()

{

list_dev=`/sbin/ip link show | grep mtu | cut -d':' -f2`

for dev in $list_dev

do

desc_dev=`$ETHTOOL -i $dev 2>&1 | grep cxgb4`

if [ $? -eq 0 ]; then

echo $dev

fi

done

}

bringup()

{

# Privilege ifup as it will apply the interfaces'settings.

# If it fails, presumably due to the lack of config file,

# just bring the link up. IP settings can be applied later.

$IFUP $1 2>/dev/null

if [ $? -ne 0 ];

then

/sbin/ip link set dev $1 up

fi

}.

Realize in the method for Chelsio 40G network interface card Performance tuning described in the present embodiment, step 2 determination CPU core task amount and respectively interrupting, and the specific implementation content of binding is as follows automatically:

# cpumask is used in msi_x_perftune function to evenly spread interrupts around

# all the ports/CPUs

# It is declared external to the function as we want a stateful cpumask rotor

# which spreads interrupts as evenly as possible around all the ports/CPUs

cpumask=1

# grep /proc/interrupts to figure out cxgb4's interfaces msi interrupts.

# On recent kernels, typical lines look like:

# 81: 0 0 0 0 PCI-MSI-edge eth25-Rx1

# 89: 0 0 0 0 PCI-MSI-edge 0000:08:00.4-ofld3

# 90: 0 0 0 0 PCI-MSI-edge 0000:08:00.4-rdma0

# hence the grep on $1 and 'edge'

msi_x_perftune()

{

ETH=$1

# MSI-X interrupts allocated by driver are recognised by different

# terminology by different Linux distros.

# In RHEL 5.X, RHEL 6.X and SLES 11 SP1 distros MSI-X interrupts are

# recognised as PCI-MSI-edge.

# In SLES 10 SPX distros MSI-X interrupts are recognised as

# PCI-MSI-X.

# Following switch case statements handles these cases.

irqs=($(cat /proc/interrupts | grep $ETH | \

grep "PCI-MSI-" | awk '{ split($0,a,":"); print a[1] }'))

echo "IRQ table length ${#irqs[@]}"

maxcpu=$(( $(grep processor /proc/cpuinfo|wc -l) - 1))

# The smp_affinty mask is only 32 bits long. As a result, if we have

# more than 32 cpus, we need to set the maxcpu value to 31.

if [[ ${maxcpu} -gt 31 ]]; then

$maxcpu=31

fi

for (( c=0; c < ${#irqs[@]}; c++ ));

do

echo "Writing $(printf "%x" $cpumask) in /proc/irq/${irqs[$c]}/smp_affinity"

echo $(printf "%x" $cpumask) > /proc/irq/${irqs[$c]}/smp_affinity

cpumask=`expr $cpumask \* 2`

if [[ ${cpumask} -gt $((1<<${maxcpu})) ]] ; then

cpumask=1

fi

done

}.

Realize described in the present embodiment in the method for Chelsio 40G network interface card Performance tuning, the specific implementation content that step 3 driver module reloads is as follows:

# start fresh

# If iw_cxgb4 and cxgb4 modules are not loaded then trying to

# remove them will result into FATAL error. This can lead user

# to wrong direction. Hence removing errors getting displyed to

# user evenif modules are not loaded.

if ! (( dont_disable_irqbalance )); then

$KILLALL irqbalance

fi

if [ -e /etc/modprobe.conf ]; then

modprobe_config=/etc/modprobe.conf

elif [ -e /etc/modules.conf ]; then

modprobe_config=/etc/modules.conf

elif [ -d /etc/modprobe.d/ ]; then

modprobe_config=/etc/modprobe.d

fi

# Option for ipforwarding mode.

if [ "$tx_coal" == "2" ]; then

if [ -d "$modprobe_config" ]; then

# modprobe_config is a directory, need to scan all files.

cf=$(grep -r -l 'options\s*cxgb4\s*.*tx_coal=.*' $modprobe_config/* \

2>/dev/null | awk 'BEGIN{FS=":"}{print $1}')

else

cf=$(grep -l 'options\s*cxgb4\s*.*tx_coal=.*' $modprobe_config \

2>/dev/null)

[ -n "$cf" ] && cf=$modprobe_config

fi

if [ -z "$cf" ]; then

if [ -d "$modprobe_config" ]; then

cf=/etc/modprobe.d/chelsio.conf

else

cf=$modprobe_config

fi

echo "options cxgb4 tx_coal=2" >> $cf

logger -s "cxgb4 added tx_coal=2 to $cf"

else

# The tx_coal option is already set. Dump an error to syslog and continue.

logger -s "cxgb4 tx_coal value already set. Please check your $cf file."

fi

# Back to default mode.

elif [ "$tx_coal" == "1" ]; then

if [ -d "$modprobe_config" ]; then

cf=$(grep -r -l 'options\s*cxgb4\s*.*tx_coal=.*' $modprobe_config/* \

2>/dev/null)

else

cf=$modprobe_config

fi

if [[ ! -z "$cf" ]]; then

# If tx_coal is the only option on the line, then remove the

# line, otherwise, remove just the tx_coal option.

sed -i 's/\(\s\)*/\1/g' $cf # get rid of multiple spaces

t=$(grep "^options\s*cxgb4\s*.*tx_coal=2" $cf)

t=$(echo $t | sed 's/options\s*cxgb4\s*.*tx_coal=.//')

if [ -z "$t" ]; then

logger -s "cxgb4 tx_coal=2 removed from $cf"

sed -i 's/^options\s*cxgb4\s*tx_coal=.//' $cf

else

logger -s "cxgb4 tx_coal=2 removed from $cf"

sed -i 's/^\(options\s*cxgb4\s*.*\)tx_coal=./\1/' $cf

fi

fi

fi

echo "Discovering Chelsio T4/T5 devices ..."

# Allow the dust to settle. Sometimes the OS will rename the network interfaces,

# so if we bringup an interface before it finishes renaming them

# /proc/interrupts will associate irqs with stale interface names.

sleep 2;

# Get cxgb4 devices, bring them up

chelsio_devs=`list_chelsio_dev`

for dev in $chelsio_devs

do

bringup $dev

done

echo "Configuring Chelsio T4/T5 devices ..."

# get devices again, after potential renaming

# Complete the performance tuning on interfaces now up

chelsio_devs=`list_chelsio_dev`

for dev in $chelsio_devs

do

dev_perftune $dev

echo "$dev now up and tuned"

done

# Assign CPUs for offload queues

dev_perftune ofld

# Assign CPUs for rdma queues

dev_perftune rdma

# kill netserver

# killall -v netserver 2>&1 > /dev/null

# start netserver

# taskset -c 4-7 netserver 2>&1 > /dev/null.

Realize the method for Chelsio 40G network interface card Performance tuning described in the present embodiment, its operation steps: one is Install and configure, drive; Two is run corresponding program.

Above-mentioned embodiment is only concrete case of the present invention; scope of patent protection of the present invention includes but not limited to above-mentioned embodiment; any claims according to the invention and any person of an ordinary skill in the technical field to its suitable change done or replacement, all should fall into scope of patent protection of the present invention.

Claims (3)

1. realize a method for Chelsio 40G network interface card Performance tuning, it is characterized in that, under LINUX system, by related command, the information of automatic read test network interface card, automatically realize interrupting binding, balanced CPU pressure, carries out network interface card Performance tuning simultaneously.

2. a kind of method realizing Chelsio 40G network interface card Performance tuning according to claim 1, it is characterized in that, its concrete steps comprise:

Step one, search Chelsio 40G network interface card, and start interface;

Step 2, determine CPU core task amount and respectively interrupt, and automatically binding;

Step 3, driver module reload.

3. a kind of method realizing Chelsio 40G network interface card Performance tuning according to claim 2, is characterized in that, by related command, referring to by running corresponding program.