An HTTP server using io_uring written purely in LitaC. This is still in heavy development and is not production quality - this was more for fun than for actual use (at least for now).

• ✅ Multi-part support
• ✅ Transfer-Encoding: Chunked
  • ✅ From Request
  • ✅ From Response
• ❌ Transfer-Encoding: Gzip
• ✅ Transfer-Encoding: Deflate
• ✅ Form URL Encoded bodies
• ✅ Path Values
• ✅ Path Templates
• ✅ Query Params
• ✅ Headers
• ✅ Serve static files
• ✅ Connection Keep-Alive (with timeouts)
• ✅ Configurable max request sizes
• ❌ Split into segments: static and dynamic to minimize overall memory footprint
  • Currently all requests are given max/equal amount of memory
• ❌ Clean handling of Out of Memory
  • ❌ OOM for a request
  • ❌ OOM for the server
• ✅ ~840K Request/Second on single instance (Request Kind: parse Query Params and echo back in JSON)
  • ✅ Support multi-threading
• ❌ Do performance tuning
  • ❌ SIMD for HTTP parsing
  • ❌ Explore batching opportunities
• 🔧 Client API
  • ✅ Register routes handlers
  • ✅ Register routes with path templates
  • ✅ Allow for global server error handler
  • ✅ Allow for global 404 handler
  • ✅ Allow for setting raw body contents
  • ✅ Allow for chunked replies (via Stream)
  • ✅ Allow for specifying headers
  • ❌ API for specifying content-type (response.json(..) response.html(..), etc.)
  • ❌ Template engine integration (mustache? custom?)
• ✅ WebSocket
• ❌ Test Suite

This has only been tested on Ubuntu 22.04

Setup and Build

# Download the liburing litac bindings dependency (this only needs to be done once)
litac -pkg-install

# Build the project
litac -pkg-build

Build and Run

# Build the project and run the executable
litac -pkg-build -run

Run executable

# Run the generated executable without litac
./bin/ring

Host machine AMD Ryzen 5 2600 (6 cores) with 16 GiB RAM

Ring Configuration

Results

tony@tony-ubuntu:~/projects/ring-http$ wrk -t2 -c20 -d30s --timeout 1s http://localhost:8080/echo?hello=world
Running 30s test @ http://localhost:8080/echo?hello=world
  2 threads and 20 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    88.33us  104.06us   5.13ms   99.28%
    Req/Sec    76.39k     1.73k   80.87k    68.50%
  4559696 requests in 30.00s, 560.95MB read
Requests/sec: 151978.76
Transfer/sec:     18.70MB
tony@tony-ubuntu:~/projects/ring-http$ wrk -t16 -c200 -d30s --timeout 1s http://localhost:8080/echo?hello=world
Running 30s test @ http://localhost:8080/echo?hello=world
  16 threads and 200 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   670.04us  725.95us  26.26ms   90.12%
    Req/Sec    19.55k     1.37k   36.09k    76.19%
  9341785 requests in 30.02s, 1.12GB read
Requests/sec: 311170.48
Transfer/sec:     38.28MB

On my new machine: AMD Ryzen 7 8845HS w/ Radeon 780M Graphics (16) @ 5.102GHz with 32 GiB RAM

tony@mini:~$ wrk -t16 -c200 -d30s --timeout 1s http://localhost:8080/echo?hello=world
Running 30s test @ http://localhost:8080/echo?hello=world
  16 threads and 200 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.79ms    8.62ms 427.95ms   96.19%
    Req/Sec    53.11k    16.36k  137.52k    78.23%
  25401875 requests in 30.10s, 3.05GB read
Requests/sec: 844053.43
Transfer/sec:    103.84MB