### **About Us** We are a **stealth-mode startup** building new infrastructure for the AI industry. Our mission is to make advanced language models deployable, customizable, and secure across diverse environments. Our platform leverages an existing SaaS codebase for authentication, billing, and user management, and we are extending it with AI-specific features including runtime orchestration, dashboards, and secure communication layers. ### **Role** We are seeking a **Backend Engineer (Node.js/NestJS)** to extend our platform using our existing codebase. You'll build the **proxy backend** that interacts with our custom inference runtime and extend dashboards. This role requires strong backend engineering skills, an ability to integrate existing systems, and comfort working closely with C++ engineers who are building low-level runtime features. ### **Responsibilities** **Proxy Backend for Inference Runtime** * Build and maintain a **Node.js-based proxy backend** that: * + Accepts inference requests from the frontend. + Schedules and serializes prompts. + Manages **QKV cache load/unload** (API hooks from the C++ runtime). + Provides APIs to **manage LoRA adapters**. * Integrate with authentication, RBAC, and logging already provided by the existing stack. * Expose metrics and logs for monitoring inference usage and performance. **Dashboards** * Extend existing **Dashboard**: Dataset upload, training job view, model management, inference usage, request history, and adapter selection. * Reuse **auth, billing, and user management code** (Auth0, Stripe). * Add necessary backend endpoints to support new UI flows. **Core Stack & Infrastructure** * Develop using NestJS as the main backend framework. * Work with PostgreSQL, Redis, and HashiCorp Vault for persistence, caching, and secrets. * Use Socket.IO for real-time updates (job status, inference progress). * Ensure secure integration with Stripe (billing) and Auth0 (identity). Collaborate with DevOps on deployment pipelines (Proxmox, Docker, CI/CD). ### **Requirements** * Strong experience with **Node.js** and **NestJS** framework. * Proficiency in **PostgreSQL** and **Redis** for persistence and caching. * Hands-on experience with **Socket.IO** or other WebSocket libraries. * Experience with **secure configuration and secrets management** (HashiCorp Vault preferred). * Comfortable working with **microservices** and integrating with existing codebases. * Strong debugging and systems thinking able to reason about scheduling, state management, and concurrency. ### **Nice to Have** * Experience integrating with **AI runtimes** (gRPC/REST backends for inference). * Familiarity with **C++ service APIs** (FFI, REST, or gRPC bindings). * Experience with **authentication/authorization frameworks** (Auth0, JWT, RBAC). * Familiarity with **Stripe API** or similar billing systems. * Contributions to backend open-source projects. ### **Why Join** * Extend a proven SaaS foundation into a **new AI runtime platform**. * Work directly with a **C++ systems team** building custom inference features. * Build real products (dashboards + runtime APIs) used by vendors and customers. * Competitive compensation, equity potential. Please Use this link to apply to this job: https://www.baasi.com/career/apply/3164237