wiki:WARPLab/Benchmarks/WARPLAB_7_5_0

Version 4 (modified by welsh, 9 years ago) (diff)

--

WARPLab 7.5.0: Benchmarks

NOTE: The WARPLab 7.5.0 MEX transport has been optimized for a single buffer read_iq:

  • rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);

vs

  • rx_IQ = wl_basebandCmd(node, [RF_RX_0, RF_RX_1], 'read_IQ', 0, rx_length);

Currently, the iteration over the interfaces occurring in M code vs MEX C code. This will be fixed in future releases, but for now, if you do multiple buffer reads in a single Read IQ command, you will see a significant memory and performance penalty.

Hardware and Software

  • Netgear ProSafe 5-port Gigabit Desktop Switch (GS105)
  • PC Hardware
    • Dell Optiplex 790
    • Intel Core i7-2600 3.4 GHz
    • 16 GB RAM
    • Window 7 Professional SP1 64-bit
    • Intel 82579LM Gigabit Network Connection
      • Configured to support Jumbo Packets of up to 9014 Bytes
  • PC Software
    • Matlab 7.12.0 (R2011a)
    • Microsoft Visual C++ 2010 Express (compiler for MEX)
    • Microsoft Windows 7 SDK


Procedure

  • Download Reference bit stream w/ iMPACT
  • Open MATLAB
    • Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release
    • Run the following commands
      • wl_setup
        • NOTE: This allows us to configure the Transport type and the Ethernet Packet Size
      • nodes = wl_initNodes(1);
      • for i={'read_iq', 'write_iq'}
        • results = wl_benchmark(node, i{1}, 1024, 2^15)
        • results = wl_benchmark(node, i{1}, 1024, 2^16)
        • results = wl_benchmark(node, i{1}, 1024, 2^17)
        • results = wl_benchmark(node, i{1}, 512, 2^18)
        • results = wl_benchmark(node, i{1}, 256, 2^19)
        • results = wl_benchmark(node, i{1}, 128, 2^20)
        • results = wl_benchmark(node, i{1}, 64, 2^21)
        • results = wl_benchmark(node, i{1}, 32, 2^22)
        • results = wl_benchmark(node, i{1}, 16, 2^23)
        • results = wl_benchmark(node, i{1}, 10, 2^24)
        • results = wl_benchmark(node, i{1}, 10, 2^25)

NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average.


Results

WARP v3 Hardware

No image "WARP_v3_Ethernet_Performance.png" attached to WARPLab/Benchmarks/WARPLAB_7_5_0

Java Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | Pkt Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.1.0 |  W3-a-00006 |    Java UDP |         8962 |       32768 |            0.82 |      10000 |                  13.66 |                     76.75 |                  22.39 |                     46.83 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.3.0 |  W3-a-00006 |    Java UDP |         8962 |       32768 |            0.82 |      10000 |                  12.19 |                     86.02 |                  14.04 |                     74.69 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       32768 |            0.82 |       1024 |                  13.37 |                     78.44 |                  13.28 |                     78.96 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       65536 |            1.64 |       1024 |                  25.87 |                     81.06 |                  25.15 |                     83.37 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      131072 |            3.28 |       1024 |                  48.68 |                     86.17 |                  48.46 |                     86.56 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      262144 |            6.55 |        512 |                  96.66 |                     86.79 |                  95.46 |                     87.88 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      524288 |           13.11 |        256 |                 192.56 |                     87.13 |                 188.75 |                     88.89 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     1048576 |           26.21 |        128 |                 384.84 |                     87.19 |                 384.77 |                     87.21 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     2097152 |           52.43 |         64 |                 775.91 |                     86.49 |                 789.60 |                     84.99 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     4194304 |          104.86 |         32 |                1549.37 |                     86.63 |                1668.52 |                     80.44 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     8388608 |          209.72 |         16 |                3102.08 |                     86.53 |                3686.46 |                     72.82 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |    16777216 |          419.43 |         10 |                6167.20 |                     87.05 |                8693.87 |                     61.75 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |    33554432 |          838.86 |         10 |               12395.46 |                     86.62 |               22799.77 |                     47.09 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

MEX Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | Pkt Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.3.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       32768 |            0.82 |      10000 |                   2.24 |                    467.55 |                   2.14 |                    489.29 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       32768 |            0.82 |       1024 |                   2.33 |                    450.28 |                   1.86 |                    564.20 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       65536 |            1.64 |       1024 |                   3.89 |                    539.55 |                   2.95 |                    710.59 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      131072 |            3.28 |       1024 |                   6.38 |                    657.33 |                   5.05 |                    830.45 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      262144 |            6.55 |       1024 |                  11.92 |                    703.65 |                   9.41 |                    891.63 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      524288 |           13.11 |       1024 |                  23.26 |                    721.23 |                  18.17 |                    923.57 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     1048576 |           26.21 |       1024 |                  45.66 |                    734.87 |                  35.44 |                    946.78 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     2097152 |           52.43 |        512 |                  89.98 |                    745.78 |                  69.67 |                    963.22 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     4194304 |          104.86 |        256 |                 179.23 |                    748.88 |                 138.51 |                    969.03 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     8388608 |          209.72 |        128 |                 355.85 |                    754.35 |                 275.90 |                    972.94 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |    16777216 |          419.43 |         64 |                 711.47 |                    754.59 |                 550.54 |                    975.18 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |    33554432 |          838.86 |         32 |                1429.02 |                    751.38 |                1099.62 |                    976.47 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Attachments (1)

Download all attachments as: .zip