wiki:WARPLab/Benchmarks/WARPLAB_7_5_0

Version 8 (modified by welsh, 9 years ago) (diff)

--

WARPLab 7.5.0: Benchmarks

NOTE: The Ethernet performance benchmarks below were done on a single buffer read_iq:

  • rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);

Hardware and Software

  • Netgear ProSafe 5-port Gigabit Desktop Switch (GS105)
  • PC Hardware
    • Dell Optiplex 790
    • Intel Core i7-2600 3.4 GHz
    • 16 GB RAM
    • Window 7 Professional SP1 64-bit
    • Intel 82579LM Gigabit Network Connection
      • Configured to support Jumbo Packets of up to 9014 Bytes
  • PC Software
    • Matlab 7.12.0 (R2011a)
    • Microsoft Visual C++ 2010 Express (compiler for MEX)
    • Microsoft Windows 7 SDK


Procedure

  • Download Reference bit stream w/ iMPACT
  • Open MATLAB
    • Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release
    • Run the following commands
      • wl_setup
        • NOTE: This allows us to configure the Transport type and the Ethernet Packet Size
      • nodes = wl_initNodes(1);
      • for i={'read_iq', 'write_iq'}
        • results = wl_benchmark(node, i{1}, 1024, 2^15)
        • results = wl_benchmark(node, i{1}, 1024, 2^16)
        • results = wl_benchmark(node, i{1}, 1024, 2^17)
        • results = wl_benchmark(node, i{1}, 512, 2^18)
        • results = wl_benchmark(node, i{1}, 256, 2^19)
        • results = wl_benchmark(node, i{1}, 128, 2^20)
        • results = wl_benchmark(node, i{1}, 64, 2^21)
        • results = wl_benchmark(node, i{1}, 32, 2^22)
        • results = wl_benchmark(node, i{1}, 16, 2^23)
        • results = wl_benchmark(node, i{1}, 10, 2^24)
        • results = wl_benchmark(node, i{1}, 10, 2^25)

NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average.


Results

WARP v3 Hardware

No image "WARP_v3_Ethernet_Performance.png" attached to WARPLab/Benchmarks/WARPLAB_7_5_0

MEX Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | Pkt Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       32768 |            0.82 |       1024 |                   2.33 |                    450.28 |                   1.86 |                    564.20 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       65536 |            1.64 |       1024 |                   3.89 |                    539.55 |                   2.95 |                    710.59 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      131072 |            3.28 |       1024 |                   6.38 |                    657.33 |                   5.05 |                    830.45 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      262144 |            6.55 |       1024 |                  11.92 |                    703.65 |                   9.41 |                    891.63 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      524288 |           13.11 |       1024 |                  23.26 |                    721.23 |                  18.17 |                    923.57 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     1048576 |           26.21 |       1024 |                  45.66 |                    734.87 |                  35.44 |                    946.78 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     2097152 |           52.43 |        512 |                  89.98 |                    745.78 |                  69.67 |                    963.22 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     4194304 |          104.86 |        256 |                 179.23 |                    748.88 |                 138.51 |                    969.03 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     8388608 |          209.72 |        128 |                 355.85 |                    754.35 |                 275.90 |                    972.94 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |    16777216 |          419.43 |         64 |                 711.47 |                    754.59 |                 550.54 |                    975.18 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |    33554432 |          838.86 |         32 |                1429.02 |                    751.38 |                1099.62 |                    976.47 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Java Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | Pkt Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       32768 |            0.82 |       1024 |                  13.37 |                     78.44 |                  13.28 |                     78.96 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       65536 |            1.64 |       1024 |                  25.87 |                     81.06 |                  25.15 |                     83.37 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      131072 |            3.28 |       1024 |                  48.68 |                     86.17 |                  48.46 |                     86.56 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      262144 |            6.55 |        512 |                  96.66 |                     86.79 |                  95.46 |                     87.88 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      524288 |           13.11 |        256 |                 192.56 |                     87.13 |                 188.75 |                     88.89 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     1048576 |           26.21 |        128 |                 384.84 |                     87.19 |                 384.77 |                     87.21 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     2097152 |           52.43 |         64 |                 775.91 |                     86.49 |                 789.60 |                     84.99 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     4194304 |          104.86 |         32 |                1549.37 |                     86.63 |                1668.52 |                     80.44 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     8388608 |          209.72 |         16 |                3102.08 |                     86.53 |                3686.46 |                     72.82 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |    16777216 |          419.43 |         10 |                6167.20 |                     87.05 |                8693.87 |                     61.75 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |    33554432 |          838.86 |         10 |               12395.46 |                     86.62 |               22799.77 |                     47.09 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Attachments (1)

Download all attachments as: .zip