Collaboration.Ai: Senior Backend Engineer – Data Engineering & AI/LLM Focus
Collaboration.Ai
Headquarters: Minneapolis, MN
URL: https://collaboration.ai
Who We’re Hiring:
We are looking for a highly skilled and passionate Senior Backend Engineer with deep expertise in data engineering and AI/LLM integrations to drive the development of our core backend systems and data platform. This is a pivotal role where you will architect and build scalable, robust, and secure backend services, data pipelines, and APIs that power our intelligent applications and agentic workflows.
You will be at the forefront of designing solutions for raw data capture, web scraping, data processing, transformation, and storage, ultimately feeding our cutting-edge AI/LLM systems. Your expertise in Python, data engineering principles, and backend architectures will be critical as we scale our platform.
If you are a data-driven backend engineer with a passion for building high-performance systems, tackling complex data and scaling challenges, and working with AI/LLM technologies, we want to hear from you!
Why Join Us?
This is a rare opportunity to be a foundational backend and data engineering leader at a company at the forefront of AI innovation. You will have the chance to build our core backend systems and data platform from scratch, directly impacting the success of our AI-driven products. You will work with cutting-edge technologies, tackle challenging data problems, and be surrounded by a team of highly motivated engineers. If you are ready to take your backend and data engineering skills to the next level and build the future of AI, apply now!
Key Responsibilities:
- Backend Architecture & Development (Data & AI Focus):
- Architect, design, develop, and maintain high-performance backend systems, microservices, and robust data pipelines.
- Lead the development of solutions for raw data capture, web scraping, data processing, cleaning, and transformation to prepare data for LLM/Agent consumption.
- Design and implement APIs for data access, processing, and integration with frontend applications and AI/LLM systems.
- Contribute to the overall architecture and scalability of our backend infrastructure and data platform.
- Data Engineering & Pipeline Optimization:
- Design, build, and optimize data pipelines for efficient data ingestion, processing, and storage.
- Work with various data storage technologies, including RDBMS, NoSQL databases, GraphDBs, and vector/RAG storage solutions.
- Implement data quality checks and monitoring to ensure data integrity and reliability.
- Optimize data pipelines for performance, scalability, and cost-effectiveness.
- AI/LLM System Integration:
- Develop and maintain backend services that integrate with our AI/LLM models and agentic frameworks.
- Design APIs and data flows to support the deployment, monitoring, and scaling of AI/LLM applications.
- Collaborate with AI/ML engineers to optimize data pipelines and infrastructure for AI workloads.
- Security & Compliance:
- Implement robust security best practices for backend systems and data handling, ensuring data security and system integrity.
- Collaborate with DevOps and security teams to ensure our backend systems meet relevant security and compliance standards (e.g., NIST frameworks, SOC2).
- Implement data access controls and security measures to protect sensitive information.
- Mentorship & Collaboration:
- Mentor junior engineers and contribute to code reviews and architectural discussions.
- Collaborate effectively with cross-functional teams (frontend, AI/ML, product) in an agile environment.
- Champion best practices in backend development, data engineering, and security.
Basic Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 7+ years of professional experience in backend development, with proficiency in Python and experience working with strongly-typed languages (such as Kotlin, Java, Go, or Rust). We value engineers who can bring experience from both dynamically-typed and statically-typed language paradigms.
- Extensive experience in data engineering principles and building robust data pipelines.
- Proven expertise in designing and developing scalable and secure backend systems and microservices.
- Familiarity with containerization (Docker, Kubernetes) and modern deployment practices.
- Proficiency with multiple persistence technologies including RDBMS, NoSQL, GraphDBs, and vector/RAG storage solutions.
- Solid understanding of cloud platforms (AWS, Azure, or GCP).
Preferred Qualifications:
- Deep experience building and deploying backend systems in regulated environments requiring NIST-53 compliance.
- Strong background in AI/LLM system integrations and agentic software development.
- Experience with web scraping technologies and data extraction techniques.
- Proven leadership in architecting enterprise-grade backend and data solutions.
- Experience with data streaming technologies (e.g., Kafka, Kinesis).
- Advanced degree in Computer Science, Data Science, or a related field.
Location: Remote, with preference for candidates in the Central Time Zone.
Source ⇲
We Work Remotely: Remote jobs in design, programming, marketing and more
