Difference between revisions of "LAN Ethernet Maximum Rates, Generation, Capturing & Monitoring"

From NST Wiki
Jump to navigationJump to search
(Maximum Gigabit Ethernet Data Rate Measurement)
(trafgen: UDP 1514 Byte Packets)
Line 103: Line 103:
  
  
[[Image:Nstbwmon_maxdata1.png|center|frame|Maximum Gigabit Ethernet Data Rate Measurement: '''117.7 MiB/s''', '''81,273 pps'''.]]
+
[[Image:Nstbwmon_maxdata1.png|center|frame|Maximum Gigabit Ethernet Data Rate Measurement (pktgen with UDP 1514 Byte Packets): '''117.7 MiB/s''', '''81,273 pps'''.]]
  
  
[[Image:Nstbwmon_maxdata2.png|center|frame|Maximum Gigabit Ethernet Data Rate Measurement: '''1,000,000 Packets Sent'''.]]
+
[[Image:Nstbwmon_maxdata2.png|center|frame|Maximum Gigabit Ethernet Data Rate Measurement (pktgen with UDP 1514 Byte Packets): '''1,000,000 Packets Sent'''.]]
  
  

Revision as of 08:39, 28 September 2011

***Note: Page Under Construction***


Overview

This article covers maximum LAN Ethernet rates values that can be achieved for both Fast Ethernet and Gigabit Ethernet using the TCP/IP or the UDP network protocols. The stepwise approach on how to generate, capture and monitor maximum Ethernet rates will be shown using various tools bundled with the Network Security Toolkit (NST). We will follow many of the methods described in RFC 2544 "Benchmarking Methodology for Network Interconnect Devices" to perform benchmark tests. Finally, a demonstration on how Linux segmentation off-loading for supported NIC adapters can produce Super Ethernet Frames which can be captured by a network protocol analyzer. The use of segmentation off-loading can result in increased network performance and less CPU overhead for network packet processing.

Ethernet Maximum Rates

Ethernet Background Information

To get started, some background information is appropriate. Communication between computer systems using TCP/IP takes place through the exchange of packets. A packet is a PDU (Protocol Data Unit) at the IP layer. The PDU at the TCP layer is called a segment while a PDU at the data-link layer (such as Ethernet) is called a frame. However the term packet is generically used to describe the data unit that is exchanged between TCP/IP layers as well as between two computers.

First, one needs to know the maximum performance of the network environment to establish a baseline value. We will be using a switched Gigabit Ethernet (IEEE 802.3ab) network configuration. We chose this configuration because it is a typical network topology used in today's enterprise inter-networking environments.

Frames per second (FPS), Packets per second (PPS) or Bits per second (bps) are a common methods of rating the throughput performance of a network device. Understanding how to calculate these rates can provide a lot of insight on how the Ethernet system function and will help assist in network architecture design.

The following sections show the theoretical maximum frames per second that can be achieved using Fast Ethernet (100 Mb/sec) and Gigabit Ethernet (1000 Mb/sec) for the TCP/IP and UDP network protocols. Today's network switches and systems configured with commodity based network NIC adapters allow these theoretical limits to be reached.

Note: Ethernet frame sizes are mostly governed by the upper application layers which use a wide range of payload sizes. Thus, it is unlikely in practice to see network segments consistently saturated at these maximum rates.

Fast Ethernet Using TCP/IP

Fast Ethernet (IEEE 802.3u) with TCP/IP maximum rate values.

Fast Ethernet Using UDP

Fast Ethernet (IEEE 802.3u) with UDP maximum rate values.

Gigabit Ethernet Using TCP/IP

Gigabit Ethernet (IEEE 802.3ab) with TCP/IP maximum rate values.

Gigabit Ethernet Using UDP

Gigabit Ethernet (IEEE 802.3ab) with UDP maximum rate values.

Ethernet Frame Rate & Data Measurements Network Configuration

Network Configuration: Ethernet Frame Rate Mesurements.

Packet Generators, Monitors & Capture Tools

Maximum Gigabit Ethernet Data Rate Measurement

trafgen: UDP 1514 Byte Packets

[root@emachine tmp]# trafgen -d p32p1 -c /etc/netsniff-ng/trafgen/nst_udp_pkt_1472.txf -n 1000000
trafgen 0.5.6.0
CFG:
n 1000000, gap 0 us, pkts 1
[0] pkt
 len 1514 cnts 0 rnds 0
 payload ff ff ff ff ff ff fe 00 00 00 00 00 08 00 45 00 05 ce 12 34 40 00 ff 11 d9 d0 c0 a8 04 64 c0 a8 04 65 07 d0 07 d1 05 ba
87 ec 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
41 41 41 41 41 41 41 41 41 41 41 41 
TX: 238.38 MB, 3814 Frames each 65536 Byte allocated
MD: FIRE RR 10us

Running! Hang up with ^C!

1000000 frames outgoing
1514000000 bytes outgoing
[root@emachine tmp]#
[root@probe ~]# 


Maximum Gigabit Ethernet Data Rate Measurement (pktgen with UDP 1514 Byte Packets): 117.7 MiB/s, 81,273 pps.


Maximum Gigabit Ethernet Data Rate Measurement (pktgen with UDP 1514 Byte Packets): 1,000,000 Packets Sent.


[root@shopper2 shm]# netsniff-ng -i p1p1 -o ./c1.pcap -s -n 1000000
netsniff-ng 0.5.6.0
RX: 238.41 MB, 122064 Frames each 2048 Byte allocated
OUI UDP TCP ETH 
PROMISC
BPF:
(000) ret      #-1
MD: RX SCATTER/GATHER

B 5 1514 1317192007.975538
B 5 1514 1317192007.975550
B 5 1514 1317192007.975556
.
.
.
B 5 1514 1317192020.280075
B 5 1514 1317192020.280076
B 5 1514 1317192020.280077
1000000 frames incoming
1000000 frames passed filter
  0 frames failed filter (out of space)
[root@shopper2 shm]#
[root@shopper2 shm]# pwd
/dev/shm
[root@shopper2 shm]#
[root@shopper2 shm]# ls -al
total 1497072
drwxrwxrwt  2 root root         60 Sep 26 06:19 .
drwxr-xr-x 22 root root       4100 Sep 26 05:55 ..
-rw-------  1 root root 1530000024 Sep 28 02:40 c1.pcap
[root@shopper2 shm]#
[root@shopper2 shm]# capinfos ./c1.pcap
File name:           ./c1.pcap
File type:           Wireshark/tcpdump/... - libpcap
File encapsulation:  Ethernet
Packet size limit:   file hdr: 65535 bytes
Number of packets:   1000000
File size:           1530000024 bytes
Data size:           1514000000 bytes
Capture duration:    12 seconds
Start time:          Wed Sep 28 02:40:07 2011
End time:            Wed Sep 28 02:40:20 2011
Data byte rate:      123044025.00 bytes/sec
Data bit rate:       984352199.97 bits/sec
Average packet size: 1514.00 bytes
Average packet rate: 81270.82 packets/sec
SHA1:                2107c313d8ac4634fd4552f3809c15c7f4d4550d
RIPEMD160:           8358815a4a5db76a1a862a1375bc413a21b4fe16
MD5:                 e8f6ae140d2905f9b313e114951158b7
Strict time order:   True
[root@shopper2 shm]#

Ethernet Framing - Segmentation & Checksum (CRC) Offloading

Ethernet Framing: Segmentation & Checksum (CRC) Offloading Disabled.


Ethernet Framing: Effects of Segmentation & Checksum (CRC) Offloading.

Ethernet Flow Control Pause Frame (IEEE 802.3x)

Ethernet Flow Control Pause Frame (IEEE 802.3x).


Ethernet Flow Control Pause Frame Decode.