Software Engineer
Backend-focused engineer building scalable APIs and data pipelines that power AI-driven features (LLMs, embeddings, RAG).
carbonhouse is looking for a Software Engineer with a strong interest in applied AI to help build intelligent, scalable systems. This role focuses on integrating AI capabilities into production software — bridging traditional engineering with modern machine learning and LLM workflows.
You'll work on backend services, APIs and data pipelines that power AI-driven features, collaborating closely with product and design to bring those capabilities to life.
What you'll do.
- Design, build and maintain scalable backend systems and APIs
- Integrate AI/ML capabilities into applications — LLMs, embeddings, classification and more
- Develop and optimize data pipelines for AI workflows
- Implement retrieval-augmented generation (RAG) and context-aware systems
- Evaluate and integrate third-party AI tools and services
- Improve system performance, reliability and cost efficiency
- Write clean, maintainable, well-tested code and collaborate cross-functionally to ship AI-powered features
- Contribute to architecture decisions and technical direction
What you'll bring.
- Strong programming experience in one or more languages (Python, JavaScript/TypeScript, PHP, Go)
- Experience building and maintaining backend systems and APIs
- Familiarity with cloud platforms (AWS, GCP or Azure)
- Experience with databases (SQL and/or NoSQL)
- Understanding of software design principles and system architecture
- Familiarity with integrating AI APIs (OpenAI, Anthropic) — prompt engineering, embeddings and vector search, model limitations and evaluation
Bonus points.
- Experience building AI-powered applications in production
- Familiarity with vector databases (Pinecone, Weaviate) and frameworks like LangChain or LlamaIndex
- Knowledge of ML fundamentals (training, fine-tuning, evaluation)
- Experience with Docker/Kubernetes, event-driven or streaming architectures
- Frontend experience (React, Next.js) is a plus but not required
Hybrid role — onsite three days per week at our Charlotte, NC office.
Work visa sponsorship is not offered for this position.
carbonhouse is an equal opportunity employer.
Ready to apply?
Applications for this role are processed through AXS, our parent company. You'll complete your application on their careers portal.