View Source Benchmark :100:

We used Benchee as a framework to write a simple, (possibly) unscientific Benchmark.

defense

Defense

We pair 100 users, 1,000 users and 10,000 users with 100 BitTorrents, 1,000 BitTorrents and 10,000 BitTorrents one by one to form a 3 × 3 matrix, and obtained a total of 9 groups of cases. Then use functions to randomly generate Request based on cases in each run to imitate the performance of users of different sizes in accessing the server in different numbers of BitTorrents lists.

     BitTorrent   BitTorrent    BitTorrent
User (100, 100)   (1000, 100)   (10000, 100)       Randomly generate `Request`
User (100, 1000)  (1000, 1000)  (10000, 1000)   -------------------------------->   &Benchee.run/2
User (100, 10000) (1000, 10000) (10000, 10000)

report

Report

System info
  • Elixir Version: 1.14.2
  • Erlang Version: 25.2
  • Operating system: Linux
  • Available memory: 6.78 GB
  • CPU Information: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
  • Number of Available Cores: 2
Environment variables
  • YABTT_QUERY_LIMIT: 30
Benchmark configuration
  • warmup: 2 s
  • time: 5 s
  • memory time: 0 ns
  • reduction time: 0 ns
  • reduction time: 0 ns
  • parallel: 1

large-number-of-bittorrents

Large number of BitTorrents

NameIterations per SecondAverageDeviationMedianModeMinimumMaximumSample size
large number of users1.53 K652.99 μs±33.85%628.70 μs645.40 μs, 635.70 μs419.50 μs5584.01 μs7617
moderate number of users1.50 K664.84 μs±37.05%629.50 μs535.00 μs409.90 μs7383.41 μs7480
small number of users1.01 K991.33 μs±29.80%940.79 μs824.90 μs, 897.60 μs671.00 μs10153.44 μs5025

ips-1

run-time-1

medium-number-of-bittorrents

Medium number of BitTorrents

NameIterations per SecondAverageDeviationMedianModeMinimumMaximumSample size
large number of users1.88 K531.61 μs±37.47%485.50 μs493.90 μs346.30 μs5613.71 μs9349
moderate number of users1.87 K533.89 μs±47.34%488.80 μs443 μs, 491.70 μs, 417.20 μs, 440.20 μs345.90 μs8931.21 μs9307
small number of users1.32 K755.99 μs±61.85%706.20 μs634.60 μs, 702.00 μs, 832.80 μs, 691.80 μs518.50 μs33562.44 μs6582

ips-2

run-time-2

small-amount-of-bittorrent

Small amount of BitTorrent

NameIterations per SecondAverageDeviationMedianModeMinimumMaximumSample size
large number of users1.91 K524.12 μs±42.72%480.50 μs445.70 μs, 502.80 μs, 491.60 μs, 489.80 μs, 449.40 μs, 368.30 μs, 498.50 μs, 447 μs, 503.10 μs, 438.20 μs, 498.70 μs339.50 μs6138.81 μs9480
moderate number of users1.83 K547.28 μs±52.97%480.50 μs483.80 μs345.40 μs6824.51 μs9082
small number of users1.34 K744.98 μs±31.50%707.30 μs639.90 μs517 μs6809.51 μs6680

ips-3

run-time-3

Note This report applies to application version 0.0.4.