HON95-wiki/config/server/linux-networking.md

---

title: Linux Server Networking breadcrumbs:

• title: Configuration
• title: Server --- {% include header.md %}

TODO:

• Migrate stuff from Debian page.
• Add link to Linux router page. Maybe combine.
• Add ethtool notes from VyOS.

InfiniBand

Installation

1. Install RDMA: apt install rdma-core
2. Install user-space RDMA stuff: apt install ibverbs-providers rdmacm-utils infiniband-diags ibverbs-utils
3. Install subnet manager (SM): apt install opensm
   • Only one instance should be required on the subnet.
4. Setup IPoIB:
   • Just like for Ethernet. Just specify the IB interface as the L2 device.
   • Use an appropriate MTU like 2044.
5. Make sure ping and ping-pong is working.

Usage

• Check L2 status: ibstat
• Check L3 status: ip a
• Show active subnet manager(s): sminfo

Testing

• Ping:
  • Server: ibping -S
  • Client: ibping -G <guid>
• Ping-pong:
  • Server: ibv_rc_pingpong
  • Client: ibv_rc_pingpong <ip>
• Other tools:
  • qperf
  • perftest

{% include footer.md %}