Software Engineer β’ Open Source Contributor β’ AI Enthusiast
π Port Jefferson, NY
π§ [email protected]
I'm a software engineer passionate about building scalable backend systems, developing developer-friendly tools, and simplifying AI application development. I enjoy working on open-source projects and currently co-creating Apiary β an open-source LLM gateway for smart request routing, caching, and observability.
An open-source, self-hosted LLM gateway for routing, caching, and observing multi-model AI requests.
Key Highlights:
- Unified abstraction layer for LLM providers (OpenAI, Anthropic, Amazon Bedrock, etc.)
- Rules-based routing engine for load balancing, fallback logic, and semantic caching
- Integrated observability system using Parquet, AWS S3, Athena, DynamoDB
- Vector-based caching using OpenSearch and Bedrock Titan
- Dynamic Configuration Dashboard in React
- Developed a complete LIMS using TypeScript, Express, PostgreSQL, React
- Added QR scanning, secure login (JWT + Google Sign-In), and Slack integration
- AI chatbot with RAG and PDF-to-Markdown ingestion
- Webhook collection app inspired by RequestBin
- GitHub: MaxHass12
- LinkedIn: shwetank-tewari-447a9b216
βSimplicity is the soul of efficiency.β β Austin Freeman